2023-01-04T17:57:03.163 INFO:root:teuthology version: 0.0.1.dev18+g19d18db 2023-01-04T17:57:03.163 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} --name yuriw-2023-01-04_17:39:36-fs-pacific_16.2.11_RC4-distro-default-smithi --owner scheduled_yuriw@teuthology --verbose --archive /home/teuthworker/archive/yuriw-2023-01-04_17:39:36-fs-pacific_16.2.11_RC4-distro-default-smithi/7131558 -- /home/teuthworker/archive/yuriw-2023-01-04_17:39:36-fs-pacific_16.2.11_RC4-distro-default-smithi/7131558/orig.config.yaml 2023-01-04T17:57:03.244 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-01-04T17:57:03.317 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-01-04_17:39:36-fs-pacific_16.2.11_RC4-distro-default-smithi/7131558 branch: pacific_16.2.11_RC4 description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} email: ceph-qa@ceph.io first_in_suite: false job_id: '7131558' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/pacific v16.2.4 ' name: yuriw-2023-01-04_17:39:36-fs-pacific_16.2.11_RC4-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: pacific_16.2.11_RC4 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: f2bb1478686242c0f68882a9cf8df4e0f8363116 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: f2bb1478686242c0f68882a9cf8df4e0f8363116 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: pacific_16.2.11_RC4 sha1: f2bb1478686242c0f68882a9cf8df4e0f8363116 owner: scheduled_yuriw@teuthology priority: 70 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 sha1: f2bb1478686242c0f68882a9cf8df4e0f8363116 sleep_before_teardown: 0 suite: fs suite_branch: pacific_16.2.11_RC4 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f2bb1478686242c0f68882a9cf8df4e0f8363116/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f2bb1478686242c0f68882a9cf8df4e0f8363116 targets: smithi050.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSU3/OmB4CuXQd8bU+wIrB8nIW3A5hXzsh3rR1yeEO6UsGuT0LCaF5gidAWgRMX8TzrvIKf0IAb5rrHcDw8dIfH8vc/dH423FeaWPgi0K/2elcLMI7YDWa4sZ+8qazlyQxTD7r/oZO4k+6DKoqD9sLkyqdOguXeaS9s6/V7zx6lNLOsOAFuFLU6avOLhX/N6izi0YWL8rwkveun0hMrjZpp3e8V95cIpI4ZeF/C11KYhVUDnhOCx0+vGC14BTsEZ3W/KsNhhbSbnCuIz7kwCutwqsVpnQAeAJtdVF5fM5aX7MyInLVYU8/REeZPtfRBSvp1AuW+28i+h7PCU5WdHSovQAYIvWsI1XjGjWBMsi9+iJreR1eQwh8fM0q80/htkArBl+diFsgLAUAaXPxqhqPIerZ4WkQpKK+YAJeWOyL17PGviQuuu9eY7BOUDUCuijvivb+l+cB7DAtxp03ZzdVgXC9S4gJqPxDLZgVoAiuh+lYyPXy2RQvNnYlAu8naPc= smithi098.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzZZhtNS9s7vbxs0AwJgpuP2C1gFhVwqdI7s9rfK9+foCEAwsLDLsWooSDGLI+/1QZHHv6+R5YC3jfSgzXaqWwn+8CwnZq6F49cfSJJ4+7txigEIiWFYJZGrxStdBmfUwrCc7k/yPaIObkPxYwcKdwJ6XZ9r64VYuZq+PeVXNawt8fz3+B5qiQZGVR/3FigDp/i+pluJJMIHaTyUfeacYtGtEPd3/w/edVGMbeLpjA/71O2MuJ2xRNoC8Qvxs82DQfXmYxcFvYOBtwk7e/n7l+E3tzGHvEJQZiHyS2F/hQ5AQcLQqS5tRrf6O2ip7YR0OSwAIRS+SsN1ehYQrDRDmx5Y0B71m+A8pfORF1hhf0rZs+99XW3HHhYGvAysxdGgvFAmFNdCV/zatPvU8KR/ZEyuI9xFaUc2hI3XLCIM5FON/9uYb1bAjkJqE/ZeW6MfLdo3FgjP2/3GZ/AGvmXw/3oBiKZzebhx4TuGHAC4izfblqxahI81IzzFdJYtdgeyE= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - pexec: clients: - sudo modprobe -r ceph - sudo modprobe ceph disable_send_metrics=on - install: exclude_packages: - ceph-volume tag: v16.2.4 - print: '**** done install task...' - cephadm: avoid_pacific_features: true cephadm_branch: v16.2.4 cephadm_git_url: https://github.com/ceph/ceph image: docker.io/ceph/ceph:v16.2.4 roleless: true - print: '**** done starting v16.2.4' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 19d18db866afdc31fd6586f558fc29b95a87ccfb timestamp: 2023-01-04_17:39:36 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1997 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2023-01-04T17:57:03.317 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f2bb1478686242c0f68882a9cf8df4e0f8363116/qa; will attempt to use it 2023-01-04T17:57:03.318 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f2bb1478686242c0f68882a9cf8df4e0f8363116/qa/tasks 2023-01-04T17:57:03.318 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-01-04T17:57:03.320 INFO:teuthology.task.internal:Checking packages... 2023-01-04T17:57:03.365 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f2bb1478686242c0f68882a9cf8df4e0f8363116' 2023-01-04T17:57:03.365 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-01-04T17:57:03.365 INFO:teuthology.packaging:ref: None 2023-01-04T17:57:03.365 INFO:teuthology.packaging:tag: None 2023-01-04T17:57:03.365 INFO:teuthology.packaging:branch: pacific_16.2.11_RC4 2023-01-04T17:57:03.365 INFO:teuthology.packaging:sha1: f2bb1478686242c0f68882a9cf8df4e0f8363116 2023-01-04T17:57:03.365 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific_16.2.11_RC4 2023-01-04T17:57:03.527 INFO:teuthology.task.internal:Found packages for ceph version 16.2.10-1543.gf2bb1478 2023-01-04T17:57:03.527 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-01-04T17:57:03.536 INFO:teuthology.task.internal:no buildpackages task found 2023-01-04T17:57:03.536 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-01-04T17:57:03.543 INFO:teuthology.task.internal:Saving configuration 2023-01-04T17:57:03.569 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-01-04T17:57:03.578 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-01-04T17:57:03.598 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-04_17:39:36-fs-pacific_16.2.11_RC4-distro-default-smithi/7131558', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-04 17:41:21.750982', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBONfQVnUFXl49UrtwScDjxeZccZzex7dS2tbVSujKxE61DYt8OYmJ7QKiqloj2ALALAwsbEci59GOlIwQuCXWIw='} 2023-01-04T17:57:03.618 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-04_17:39:36-fs-pacific_16.2.11_RC4-distro-default-smithi/7131558', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-04 17:41:21.749807', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE4IgJmO3Qjn7pcfhWyhX/gi/1Ol+9D7q9fRfQx6eq3CbjQZ1E5BFFIc/8OdHqxs1IK/Sx3KGZdLTuDRamqUlw8='} 2023-01-04T17:57:03.619 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-01-04T17:57:03.625 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2023-01-04T17:57:03.626 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2023-01-04T17:57:03.626 INFO:teuthology.run_tasks:Running task console_log... 2023-01-04T17:57:03.717 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3aa26d0e50>, signals=[15]) 2023-01-04T17:57:03.718 INFO:teuthology.run_tasks:Running task internal.connect... 2023-01-04T17:57:03.724 INFO:teuthology.task.internal:Opening connections... 2023-01-04T17:57:03.724 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2023-01-04T17:57:03.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-04T17:57:03.843 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2023-01-04T17:57:03.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-04T17:57:03.954 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-01-04T17:57:03.963 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2023-01-04T17:57:03.988 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2023-01-04T17:57:03.988 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-01-04T17:57:04.049 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2023-01-04T17:57:04.050 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8" 2023-01-04T17:57:04.050 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2023-01-04T17:57:04.050 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2023-01-04T17:57:04.050 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8" 2023-01-04T17:57:04.050 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2023-01-04T17:57:04.050 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 8" 2023-01-04T17:57:04.050 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2023-01-04T17:57:04.050 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-01-04T17:57:04.050 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2023-01-04T17:57:04.050 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-04T17:57:04.050 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-04T17:57:04.050 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-01-04T17:57:04.051 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-01-04T17:57:04.066 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2023-01-04T17:57:04.086 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2023-01-04T17:57:04.087 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-01-04T17:57:04.148 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2023-01-04T17:57:04.148 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8" 2023-01-04T17:57:04.148 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2023-01-04T17:57:04.148 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2023-01-04T17:57:04.149 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8" 2023-01-04T17:57:04.149 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8" 2023-01-04T17:57:04.149 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 8" 2023-01-04T17:57:04.149 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-01-04T17:57:04.149 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-01-04T17:57:04.149 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2023-01-04T17:57:04.149 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-04T17:57:04.149 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-04T17:57:04.149 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-01-04T17:57:04.149 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-01-04T17:57:04.165 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-01-04T17:57:04.175 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-01-04T17:57:04.182 INFO:teuthology.task.internal:Checking for old test directory... 2023-01-04T17:57:04.183 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2023-01-04T17:57:04.186 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2023-01-04T17:57:04.206 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-01-04T17:57:04.216 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-01-04T17:57:04.217 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2023-01-04T17:57:04.247 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2023-01-04T17:57:04.285 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-01-04T17:57:04.336 INFO:teuthology.run_tasks:Running task kernel... 2023-01-04T17:57:04.355 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-01-04T17:57:04.355 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-01-04T17:57:04.355 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-04T17:57:04.356 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-04T17:57:04.374 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-04T17:57:04.376 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2023-01-04T17:57:04.376 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-04T17:57:04.377 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2023-01-04T17:57:04.435 INFO:teuthology.orchestra.run.smithi098.stdout:4.18.0-408.el8.x86_64 2023-01-04T17:57:04.435 INFO:teuthology.task.kernel:Running kernel on smithi098: 4.18.0-408.el8.x86_64 2023-01-04T17:57:04.435 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum install -y kernel 2023-01-04T17:57:04.438 INFO:teuthology.orchestra.run.smithi050.stdout:4.18.0-408.el8.x86_64 2023-01-04T17:57:04.438 INFO:teuthology.task.kernel:Running kernel on smithi050: 4.18.0-408.el8.x86_64 2023-01-04T17:57:04.438 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum install -y kernel 2023-01-04T17:57:08.077 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - AppStream 37 MB/s | 27 MB 00:00 2023-01-04T17:57:08.381 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS-8 - AppStream 27 MB/s | 27 MB 00:00 2023-01-04T17:57:14.318 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - BaseOS 24 MB/s | 26 MB 00:01 2023-01-04T17:57:15.064 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS-8 - BaseOS 14 MB/s | 26 MB 00:01 2023-01-04T17:57:18.584 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - Extras 154 kB/s | 18 kB 00:00 2023-01-04T17:57:18.972 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - PowerTools 21 MB/s | 5.5 MB 00:00 2023-01-04T17:57:19.163 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS-8 - Extras 153 kB/s | 18 kB 00:00 2023-01-04T17:57:19.675 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS-8 - PowerTools 14 MB/s | 5.5 MB 00:00 2023-01-04T17:57:21.885 INFO:teuthology.orchestra.run.smithi050.stdout:Copr repo for python3-asyncssh owned by ceph 1.9 kB/s | 3.5 kB 00:01 2023-01-04T17:57:22.532 INFO:teuthology.orchestra.run.smithi098.stdout:Copr repo for python3-asyncssh owned by ceph 1.9 kB/s | 3.5 kB 00:01 2023-01-04T17:57:23.826 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 7.3 MB/s | 13 MB 00:01 2023-01-04T17:57:24.582 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 6.9 MB/s | 13 MB 00:01 2023-01-04T17:57:27.202 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 420 kB/s | 24 kB 00:00 2023-01-04T17:57:27.774 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 362 kB/s | 24 kB 00:00 2023-01-04T17:57:30.368 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-4.18.0-408.el8.x86_64 is already installed. 2023-01-04T17:57:30.368 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2023-01-04T17:57:30.542 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T17:57:30.543 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-01-04T17:57:30.544 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T17:57:30.648 DEBUG:teuthology.orchestra.run.smithi050:> echo no | sudo yum reinstall kernel || true 2023-01-04T17:57:30.760 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-4.18.0-408.el8.x86_64 is already installed. 2023-01-04T17:57:30.761 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2023-01-04T17:57:30.919 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T17:57:30.919 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2023-01-04T17:57:30.919 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T17:57:31.029 DEBUG:teuthology.orchestra.run.smithi098:> echo no | sudo yum reinstall kernel || true 2023-01-04T17:57:31.339 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:00:04 ago on Wed 04 Jan 2023 05:57:27 PM UTC. 2023-01-04T17:57:31.721 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:04 ago on Wed 04 Jan 2023 05:57:27 PM UTC. 2023-01-04T17:57:32.530 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T17:57:32.530 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T17:57:32.530 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2023-01-04T17:57:32.530 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T17:57:32.530 INFO:teuthology.orchestra.run.smithi050.stdout:Reinstalling: 2023-01-04T17:57:32.530 INFO:teuthology.orchestra.run.smithi050.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2023-01-04T17:57:32.531 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T17:57:32.531 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-01-04T17:57:32.531 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T17:57:32.531 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T17:57:32.531 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 8.5 M 2023-01-04T17:57:32.531 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 0 2023-01-04T17:57:32.531 INFO:teuthology.orchestra.run.smithi050.stderr:Operation aborted. 2023-01-04T17:57:32.612 INFO:teuthology.orchestra.run.smithi050.stdout:Is this ok [y/N]: 2023-01-04T17:57:32.613 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum reinstall -y kernel || true 2023-01-04T17:57:32.829 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T17:57:32.829 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T17:57:32.829 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2023-01-04T17:57:32.829 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T17:57:32.829 INFO:teuthology.orchestra.run.smithi098.stdout:Reinstalling: 2023-01-04T17:57:32.829 INFO:teuthology.orchestra.run.smithi098.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2023-01-04T17:57:32.830 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T17:57:32.830 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-01-04T17:57:32.830 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T17:57:32.830 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T17:57:32.830 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 8.5 M 2023-01-04T17:57:32.830 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 0 2023-01-04T17:57:32.830 INFO:teuthology.orchestra.run.smithi098.stderr:Operation aborted. 2023-01-04T17:57:32.910 INFO:teuthology.orchestra.run.smithi098.stdout:Is this ok [y/N]: 2023-01-04T17:57:32.910 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum reinstall -y kernel || true 2023-01-04T17:57:33.287 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:00:06 ago on Wed 04 Jan 2023 05:57:27 PM UTC. 2023-01-04T17:57:33.552 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:06 ago on Wed 04 Jan 2023 05:57:27 PM UTC. 2023-01-04T17:57:34.479 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T17:57:34.480 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T17:57:34.481 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2023-01-04T17:57:34.481 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T17:57:34.481 INFO:teuthology.orchestra.run.smithi050.stdout:Reinstalling: 2023-01-04T17:57:34.481 INFO:teuthology.orchestra.run.smithi050.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2023-01-04T17:57:34.482 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T17:57:34.482 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-01-04T17:57:34.482 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T17:57:34.482 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T17:57:34.482 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 8.5 M 2023-01-04T17:57:34.483 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 0 2023-01-04T17:57:34.483 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-01-04T17:57:34.652 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T17:57:34.652 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T17:57:34.652 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2023-01-04T17:57:34.653 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T17:57:34.653 INFO:teuthology.orchestra.run.smithi098.stdout:Reinstalling: 2023-01-04T17:57:34.653 INFO:teuthology.orchestra.run.smithi098.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2023-01-04T17:57:34.653 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T17:57:34.653 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-01-04T17:57:34.653 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T17:57:34.653 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T17:57:34.654 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 8.5 M 2023-01-04T17:57:34.654 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 0 2023-01-04T17:57:34.654 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2023-01-04T17:57:34.721 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-4.18.0-408.el8.x86_64.rpm 36 MB/s | 8.5 MB 00:00 2023-01-04T17:57:34.722 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-01-04T17:57:34.723 INFO:teuthology.orchestra.run.smithi050.stdout:Total 35 MB/s | 8.5 MB 00:00 2023-01-04T17:57:34.817 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-01-04T17:57:34.875 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-4.18.0-408.el8.x86_64.rpm 39 MB/s | 8.5 MB 00:00 2023-01-04T17:57:34.876 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2023-01-04T17:57:34.876 INFO:teuthology.orchestra.run.smithi098.stdout:Total 38 MB/s | 8.5 MB 00:00 2023-01-04T17:57:34.972 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2023-01-04T17:57:35.192 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-01-04T17:57:35.192 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-01-04T17:57:35.351 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2023-01-04T17:57:35.351 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2023-01-04T17:57:35.383 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-01-04T17:57:35.408 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-01-04T17:57:35.536 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2023-01-04T17:57:35.559 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2023-01-04T17:57:35.736 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-01-04T17:57:35.888 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2023-01-04T17:57:35.968 INFO:teuthology.orchestra.run.smithi050.stdout: Reinstalling : kernel-4.18.0-408.el8.x86_64 1/2 2023-01-04T17:57:35.968 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : kernel-4.18.0-408.el8.x86_64 2/2 2023-01-04T17:57:36.161 INFO:teuthology.orchestra.run.smithi098.stdout: Reinstalling : kernel-4.18.0-408.el8.x86_64 1/2 2023-01-04T17:57:36.161 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : kernel-4.18.0-408.el8.x86_64 2/2 2023-01-04T17:57:36.443 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-4.18.0-408.el8.x86_64 2/2 2023-01-04T17:57:36.443 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 1/2 2023-01-04T17:57:36.597 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-4.18.0-408.el8.x86_64 2/2 2023-01-04T17:57:36.597 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 1/2 2023-01-04T17:57:36.999 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 2/2 2023-01-04T17:57:36.999 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T17:57:36.999 INFO:teuthology.orchestra.run.smithi050.stdout:Reinstalled: 2023-01-04T17:57:36.999 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-4.18.0-408.el8.x86_64 2023-01-04T17:57:36.999 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T17:57:36.999 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T17:57:37.099 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q kernel --last | head -n 1 2023-01-04T17:57:37.122 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 2/2 2023-01-04T17:57:37.122 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T17:57:37.122 INFO:teuthology.orchestra.run.smithi098.stdout:Reinstalled: 2023-01-04T17:57:37.122 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-4.18.0-408.el8.x86_64 2023-01-04T17:57:37.122 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T17:57:37.122 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T17:57:37.217 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q kernel --last | head -n 1 2023-01-04T17:57:37.239 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-4.18.0-408.el8.x86_64 Wed 04 Jan 2023 05:57:35 PM UTC 2023-01-04T17:57:37.241 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-408.el8.x86_64 2023-01-04T17:57:37.241 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-01-04T17:57:37.241 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2023-01-04T17:57:37.241 DEBUG:teuthology.orchestra.run.smithi050:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-04T17:57:37.279 INFO:teuthology.orchestra.run.smithi050.stdout:ttyS1 2023-01-04T17:57:37.298 DEBUG:teuthology.parallel:result is None 2023-01-04T17:57:37.384 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-4.18.0-408.el8.x86_64 Wed 04 Jan 2023 05:57:35 PM UTC 2023-01-04T17:57:37.385 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-408.el8.x86_64 2023-01-04T17:57:37.385 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-01-04T17:57:37.385 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2023-01-04T17:57:37.385 DEBUG:teuthology.orchestra.run.smithi098:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-04T17:57:37.422 INFO:teuthology.orchestra.run.smithi098.stdout:ttyS1 2023-01-04T17:57:37.435 DEBUG:teuthology.parallel:result is None 2023-01-04T17:57:37.435 INFO:teuthology.run_tasks:Running task internal.base... 2023-01-04T17:57:37.449 INFO:teuthology.task.internal:Creating test directory... 2023-01-04T17:57:37.450 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-04T17:57:37.452 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-04T17:57:37.493 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-01-04T17:57:37.504 INFO:teuthology.run_tasks:Running task internal.archive... 2023-01-04T17:57:37.516 INFO:teuthology.task.internal:Creating archive directory... 2023-01-04T17:57:37.516 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-04T17:57:37.520 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-04T17:57:37.561 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-01-04T17:57:37.571 INFO:teuthology.task.internal:Enabling coredump saving... 2023-01-04T17:57:37.571 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-04T17:57:37.590 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-04T17:57:37.627 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-04T17:57:37.629 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-04T17:57:37.637 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-04T17:57:37.639 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-04T17:57:37.640 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-01-04T17:57:37.649 INFO:teuthology.task.internal:Configuring sudo... 2023-01-04T17:57:37.649 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-04T17:57:37.688 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-04T17:57:37.714 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-01-04T17:57:37.724 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-01-04T17:57:37.725 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-04T17:57:37.755 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-04T17:57:37.773 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-04T17:57:37.854 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-04T17:57:37.917 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-04T17:57:37.998 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-04T17:57:38.047 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-01-04T17:57:38.047 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-04T17:57:38.115 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-04T17:57:38.157 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-04T17:57:38.205 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-04T17:57:38.283 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-04T17:57:38.330 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-01-04T17:57:38.330 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-04T17:57:38.397 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2023-01-04T17:57:38.400 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2023-01-04T17:57:38.456 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-04T17:57:38.496 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-04T17:57:38.841 INFO:teuthology.run_tasks:Running task internal.timer... 2023-01-04T17:57:38.856 INFO:teuthology.task.internal:Starting timer... 2023-01-04T17:57:38.856 INFO:teuthology.run_tasks:Running task pcp... 2023-01-04T17:57:38.869 INFO:teuthology.run_tasks:Running task selinux... 2023-01-04T17:57:38.890 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-01-04T17:57:38.891 DEBUG:teuthology.orchestra.run.smithi050:> sudo service auditd rotate 2023-01-04T17:57:38.986 INFO:teuthology.orchestra.run.smithi050.stdout:Rotating logs: 2023-01-04T17:57:38.990 DEBUG:teuthology.orchestra.run.smithi098:> sudo service auditd rotate 2023-01-04T17:57:39.049 INFO:teuthology.orchestra.run.smithi098.stdout:Rotating logs: 2023-01-04T17:57:39.051 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-01-04T17:57:39.051 DEBUG:teuthology.orchestra.run.smithi050:> /usr/sbin/getenforce 2023-01-04T17:57:39.084 INFO:teuthology.orchestra.run.smithi050.stdout:Permissive 2023-01-04T17:57:39.084 DEBUG:teuthology.orchestra.run.smithi098:> /usr/sbin/getenforce 2023-01-04T17:57:39.138 INFO:teuthology.orchestra.run.smithi098.stdout:Permissive 2023-01-04T17:57:39.139 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi050.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi098.front.sepia.ceph.com': 'permissive'} 2023-01-04T17:57:39.139 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-04T17:57:39.169 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-04T17:57:39.169 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-04T17:57:39.196 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-04T17:57:39.196 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-01-04T17:57:39.197 DEBUG:teuthology.orchestra.run.smithi050:> sudo /usr/sbin/setenforce permissive 2023-01-04T17:57:39.254 DEBUG:teuthology.orchestra.run.smithi098:> sudo /usr/sbin/setenforce permissive 2023-01-04T17:57:39.281 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-01-04T17:57:39.295 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-01-04T17:57:39.295 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-01-04T17:57:39.316 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-01-04T17:57:39.317 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi050.front.sepia.ceph.com,smithi098.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-01-04T18:04:40.064 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi098.front.sepia.ceph.com')] 2023-01-04T18:04:40.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-01-04T18:04:40.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-04T18:04:40.135 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-01-04T18:04:40.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-01-04T18:04:40.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-04T18:04:40.226 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-01-04T18:04:40.293 INFO:teuthology.run_tasks:Running task clock... 2023-01-04T18:04:40.305 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-01-04T18:04:40.306 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-04T18:04:40.306 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-04T18:04:40.308 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-04T18:04:40.308 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-04T18:04:40.340 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-01-04T18:04:40.354 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-01-04T18:04:40.367 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-01-04T18:04:40.381 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-01-04T18:04:40.416 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: ntpd: command not found 2023-01-04T18:04:40.428 INFO:teuthology.orchestra.run.smithi050.stdout:506 Cannot talk to daemon 2023-01-04T18:04:40.442 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-01-04T18:04:40.445 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: ntpd: command not found 2023-01-04T18:04:40.455 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-01-04T18:04:40.456 INFO:teuthology.orchestra.run.smithi098.stdout:506 Cannot talk to daemon 2023-01-04T18:04:40.469 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-01-04T18:04:40.483 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-01-04T18:04:40.516 INFO:teuthology.orchestra.run.smithi050.stderr:bash: ntpq: command not found 2023-01-04T18:04:40.519 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-04T18:04:40.519 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2023-01-04T18:04:40.519 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-04T18:04:40.519 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-04T18:04:40.520 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-04T18:04:40.520 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-04T18:04:40.550 INFO:teuthology.orchestra.run.smithi098.stderr:bash: ntpq: command not found 2023-01-04T18:04:40.553 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-04T18:04:40.553 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2023-01-04T18:04:40.553 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-04T18:04:40.553 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-04T18:04:40.553 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-04T18:04:40.554 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-04T18:04:40.555 INFO:teuthology.run_tasks:Running task pexec... 2023-01-04T18:04:40.566 INFO:teuthology.task.pexec:Executing custom commands... 2023-01-04T18:04:40.567 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi050.front.sepia.ceph.com 2023-01-04T18:04:40.567 DEBUG:teuthology.orchestra.run.smithi050:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-01-04T18:04:40.567 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi098.front.sepia.ceph.com 2023-01-04T18:04:40.567 DEBUG:teuthology.orchestra.run.smithi098:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-01-04T18:04:41.275 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:17 ago on Wed 04 Jan 2023 06:03:24 PM UTC. 2023-01-04T18:04:41.278 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:14 ago on Wed 04 Jan 2023 06:03:27 PM UTC. 2023-01-04T18:04:42.677 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:04:42.677 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:04:42.677 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2023-01-04T18:04:42.678 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:04:42.678 INFO:teuthology.orchestra.run.smithi098.stdout:Resetting modules: 2023-01-04T18:04:42.678 INFO:teuthology.orchestra.run.smithi098.stdout: container-tools 2023-01-04T18:04:42.678 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:04:42.678 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-01-04T18:04:42.678 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:04:42.678 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:04:42.807 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:04:42.809 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:04:42.809 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2023-01-04T18:04:42.809 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:04:42.809 INFO:teuthology.orchestra.run.smithi050.stdout:Resetting modules: 2023-01-04T18:04:42.809 INFO:teuthology.orchestra.run.smithi050.stdout: container-tools 2023-01-04T18:04:42.809 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:04:42.809 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-01-04T18:04:42.809 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:04:42.809 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:04:42.908 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:04:43.187 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:04:43.615 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:19 ago on Wed 04 Jan 2023 06:03:24 PM UTC. 2023-01-04T18:04:43.933 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:16 ago on Wed 04 Jan 2023 06:03:27 PM UTC. 2023-01-04T18:04:45.011 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:04:45.013 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================================= 2023-01-04T18:04:45.013 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2023-01-04T18:04:45.013 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================================= 2023-01-04T18:04:45.014 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrading: 2023-01-04T18:04:45.014 INFO:teuthology.orchestra.run.smithi098.stdout: conmon x86_64 3:2.1.4-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 57 k 2023-01-04T18:04:45.014 INFO:teuthology.orchestra.run.smithi098.stdout: container-selinux noarch 2:2.189.0-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 60 k 2023-01-04T18:04:45.014 INFO:teuthology.orchestra.run.smithi098.stdout: containernetworking-plugins x86_64 1:1.1.1-3.module_el8.7.0+1216+b022c01d CentOS-AppStream 18 M 2023-01-04T18:04:45.014 INFO:teuthology.orchestra.run.smithi098.stdout: criu x86_64 3.15-3.module_el8.7.0+1216+b022c01d CentOS-AppStream 518 k 2023-01-04T18:04:45.014 INFO:teuthology.orchestra.run.smithi098.stdout: fuse-overlayfs x86_64 1.9-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 73 k 2023-01-04T18:04:45.014 INFO:teuthology.orchestra.run.smithi098.stdout: libslirp x86_64 4.4.0-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 70 k 2023-01-04T18:04:45.014 INFO:teuthology.orchestra.run.smithi098.stdout: runc x86_64 1:1.1.4-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 2.9 M 2023-01-04T18:04:45.014 INFO:teuthology.orchestra.run.smithi098.stdout: slirp4netns x86_64 1.2.0-2.module_el8.7.0+1216+b022c01d CentOS-AppStream 54 k 2023-01-04T18:04:45.014 INFO:teuthology.orchestra.run.smithi098.stdout:Installing group/module packages: 2023-01-04T18:04:45.014 INFO:teuthology.orchestra.run.smithi098.stdout: aardvark-dns x86_64 2:1.1.0-4.module_el8.7.0+1216+b022c01d CentOS-AppStream 997 k 2023-01-04T18:04:45.014 INFO:teuthology.orchestra.run.smithi098.stdout: buildah x86_64 1:1.27.0-2.module_el8.7.0+1216+b022c01d CentOS-AppStream 8.1 M 2023-01-04T18:04:45.015 INFO:teuthology.orchestra.run.smithi098.stdout: cockpit-podman noarch 53-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 547 k 2023-01-04T18:04:45.015 INFO:teuthology.orchestra.run.smithi098.stdout: crun x86_64 1.5-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 213 k 2023-01-04T18:04:45.015 INFO:teuthology.orchestra.run.smithi098.stdout: netavark x86_64 2:1.1.0-6.module_el8.7.0+1216+b022c01d CentOS-AppStream 2.2 M 2023-01-04T18:04:45.015 INFO:teuthology.orchestra.run.smithi098.stdout: python3-podman noarch 4.2.0-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 151 k 2023-01-04T18:04:45.015 INFO:teuthology.orchestra.run.smithi098.stdout: skopeo x86_64 2:1.9.2-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 6.8 M 2023-01-04T18:04:45.015 INFO:teuthology.orchestra.run.smithi098.stdout: toolbox x86_64 0.0.99.3-1.module_el8.5.0+877+1c30e0c9 CentOS-AppStream 2.3 M 2023-01-04T18:04:45.015 INFO:teuthology.orchestra.run.smithi098.stdout: udica noarch 0.2.6-3.module_el8.7.0+1216+b022c01d CentOS-AppStream 49 k 2023-01-04T18:04:45.015 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2023-01-04T18:04:45.015 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 CentOS-AppStream 25 k 2023-01-04T18:04:45.015 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyxdg noarch 0.25-16.el8 CentOS-AppStream 94 k 2023-01-04T18:04:45.015 INFO:teuthology.orchestra.run.smithi098.stdout: yajl x86_64 2.1.0-11.el8 CentOS-AppStream 41 k 2023-01-04T18:04:45.015 INFO:teuthology.orchestra.run.smithi098.stdout:Installing module profiles: 2023-01-04T18:04:45.016 INFO:teuthology.orchestra.run.smithi098.stdout: container-tools/common 2023-01-04T18:04:45.016 INFO:teuthology.orchestra.run.smithi098.stdout:Enabling module streams: 2023-01-04T18:04:45.016 INFO:teuthology.orchestra.run.smithi098.stdout: container-tools rhel8 2023-01-04T18:04:45.016 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:04:45.016 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-01-04T18:04:45.016 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================================= 2023-01-04T18:04:45.016 INFO:teuthology.orchestra.run.smithi098.stdout:Install 12 Packages 2023-01-04T18:04:45.016 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrade 8 Packages 2023-01-04T18:04:45.016 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:04:45.017 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 43 M 2023-01-04T18:04:45.017 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2023-01-04T18:04:45.106 INFO:teuthology.orchestra.run.smithi098.stdout:(1/20): aardvark-dns-1.1.0-4.module_el8.7.0+121 11 MB/s | 997 kB 00:00 2023-01-04T18:04:45.131 INFO:teuthology.orchestra.run.smithi098.stdout:(2/20): crun-1.5-1.module_el8.7.0+1216+b022c01d 8.4 MB/s | 213 kB 00:00 2023-01-04T18:04:45.156 INFO:teuthology.orchestra.run.smithi098.stdout:(3/20): cockpit-podman-53-1.module_el8.7.0+1216 3.9 MB/s | 547 kB 00:00 2023-01-04T18:04:45.190 INFO:teuthology.orchestra.run.smithi098.stdout:(4/20): python3-podman-4.2.0-1.module_el8.7.0+1 4.4 MB/s | 151 kB 00:00 2023-01-04T18:04:45.215 INFO:teuthology.orchestra.run.smithi098.stdout:(5/20): python3-pytoml-0.1.14-5.git7dea353.el8. 992 kB/s | 25 kB 00:00 2023-01-04T18:04:45.241 INFO:teuthology.orchestra.run.smithi098.stdout:(6/20): python3-pyxdg-0.25-16.el8.noarch.rpm 3.7 MB/s | 94 kB 00:00 2023-01-04T18:04:45.333 INFO:teuthology.orchestra.run.smithi098.stdout:(7/20): netavark-1.1.0-6.module_el8.7.0+1216+b0 11 MB/s | 2.2 MB 00:00 2023-01-04T18:04:45.421 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:04:45.424 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================================= 2023-01-04T18:04:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-01-04T18:04:45.424 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================================= 2023-01-04T18:04:45.424 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrading: 2023-01-04T18:04:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: conmon x86_64 3:2.1.4-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 57 k 2023-01-04T18:04:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: container-selinux noarch 2:2.189.0-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 60 k 2023-01-04T18:04:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: containernetworking-plugins x86_64 1:1.1.1-3.module_el8.7.0+1216+b022c01d CentOS-AppStream 18 M 2023-01-04T18:04:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: criu x86_64 3.15-3.module_el8.7.0+1216+b022c01d CentOS-AppStream 518 k 2023-01-04T18:04:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: fuse-overlayfs x86_64 1.9-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 73 k 2023-01-04T18:04:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: libslirp x86_64 4.4.0-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 70 k 2023-01-04T18:04:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: runc x86_64 1:1.1.4-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 2.9 M 2023-01-04T18:04:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: slirp4netns x86_64 1.2.0-2.module_el8.7.0+1216+b022c01d CentOS-AppStream 54 k 2023-01-04T18:04:45.425 INFO:teuthology.orchestra.run.smithi050.stdout:Installing group/module packages: 2023-01-04T18:04:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: aardvark-dns x86_64 2:1.1.0-4.module_el8.7.0+1216+b022c01d CentOS-AppStream 997 k 2023-01-04T18:04:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: buildah x86_64 1:1.27.0-2.module_el8.7.0+1216+b022c01d CentOS-AppStream 8.1 M 2023-01-04T18:04:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: cockpit-podman noarch 53-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 547 k 2023-01-04T18:04:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: crun x86_64 1.5-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 213 k 2023-01-04T18:04:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: netavark x86_64 2:1.1.0-6.module_el8.7.0+1216+b022c01d CentOS-AppStream 2.2 M 2023-01-04T18:04:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: python3-podman noarch 4.2.0-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 151 k 2023-01-04T18:04:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: skopeo x86_64 2:1.9.2-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 6.8 M 2023-01-04T18:04:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: toolbox x86_64 0.0.99.3-1.module_el8.5.0+877+1c30e0c9 CentOS-AppStream 2.3 M 2023-01-04T18:04:45.426 INFO:teuthology.orchestra.run.smithi050.stdout: udica noarch 0.2.6-3.module_el8.7.0+1216+b022c01d CentOS-AppStream 49 k 2023-01-04T18:04:45.426 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-01-04T18:04:45.426 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 CentOS-AppStream 25 k 2023-01-04T18:04:45.426 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyxdg noarch 0.25-16.el8 CentOS-AppStream 94 k 2023-01-04T18:04:45.426 INFO:teuthology.orchestra.run.smithi050.stdout: yajl x86_64 2.1.0-11.el8 CentOS-AppStream 41 k 2023-01-04T18:04:45.426 INFO:teuthology.orchestra.run.smithi050.stdout:Installing module profiles: 2023-01-04T18:04:45.426 INFO:teuthology.orchestra.run.smithi050.stdout: container-tools/common 2023-01-04T18:04:45.426 INFO:teuthology.orchestra.run.smithi050.stdout:Enabling module streams: 2023-01-04T18:04:45.426 INFO:teuthology.orchestra.run.smithi050.stdout: container-tools rhel8 2023-01-04T18:04:45.426 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:04:45.426 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-01-04T18:04:45.426 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================================= 2023-01-04T18:04:45.427 INFO:teuthology.orchestra.run.smithi050.stdout:Install 12 Packages 2023-01-04T18:04:45.427 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrade 8 Packages 2023-01-04T18:04:45.427 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:04:45.427 INFO:teuthology.orchestra.run.smithi098.stdout:(8/20): toolbox-0.0.99.3-1.module_el8.5.0+877+1 25 MB/s | 2.3 MB 00:00 2023-01-04T18:04:45.428 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 43 M 2023-01-04T18:04:45.428 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-01-04T18:04:45.450 INFO:teuthology.orchestra.run.smithi098.stdout:(9/20): udica-0.2.6-3.module_el8.7.0+1216+b022c 1.9 MB/s | 49 kB 00:00 2023-01-04T18:04:45.475 INFO:teuthology.orchestra.run.smithi098.stdout:(10/20): yajl-2.1.0-11.el8.x86_64.rpm 1.6 MB/s | 41 kB 00:00 2023-01-04T18:04:45.524 INFO:teuthology.orchestra.run.smithi050.stdout:(1/20): cockpit-podman-53-1.module_el8.7.0+1216 5.6 MB/s | 547 kB 00:00 2023-01-04T18:04:45.543 INFO:teuthology.orchestra.run.smithi098.stdout:(11/20): conmon-2.1.4-1.module_el8.7.0+1216+b02 908 kB/s | 57 kB 00:00 2023-01-04T18:04:45.560 INFO:teuthology.orchestra.run.smithi050.stdout:(2/20): crun-1.5-1.module_el8.7.0+1216+b022c01d 6.3 MB/s | 213 kB 00:00 2023-01-04T18:04:45.568 INFO:teuthology.orchestra.run.smithi098.stdout:(12/20): container-selinux-2.189.0-1.module_el8 2.0 MB/s | 60 kB 00:00 2023-01-04T18:04:45.633 INFO:teuthology.orchestra.run.smithi050.stdout:(3/20): aardvark-dns-1.1.0-4.module_el8.7.0+121 4.8 MB/s | 997 kB 00:00 2023-01-04T18:04:45.696 INFO:teuthology.orchestra.run.smithi050.stdout:(4/20): python3-podman-4.2.0-1.module_el8.7.0+1 2.5 MB/s | 151 kB 00:00 2023-01-04T18:04:45.709 INFO:teuthology.orchestra.run.smithi050.stdout:(5/20): python3-pytoml-0.1.14-5.git7dea353.el8. 1.5 MB/s | 25 kB 00:00 2023-01-04T18:04:45.742 INFO:teuthology.orchestra.run.smithi050.stdout:(6/20): python3-pyxdg-0.25-16.el8.noarch.rpm 2.8 MB/s | 94 kB 00:00 2023-01-04T18:04:45.752 INFO:teuthology.orchestra.run.smithi098.stdout:(13/20): skopeo-1.9.2-1.module_el8.7.0+1216+b02 13 MB/s | 6.8 MB 00:00 2023-01-04T18:04:45.859 INFO:teuthology.orchestra.run.smithi050.stdout:(7/20): buildah-1.27.0-2.module_el8.7.0+1216+b0 19 MB/s | 8.1 MB 00:00 2023-01-04T18:04:45.868 INFO:teuthology.orchestra.run.smithi098.stdout:(14/20): buildah-1.27.0-2.module_el8.7.0+1216+b 9.5 MB/s | 8.1 MB 00:00 2023-01-04T18:04:45.894 INFO:teuthology.orchestra.run.smithi098.stdout:(15/20): fuse-overlayfs-1.9-1.module_el8.7.0+12 2.9 MB/s | 73 kB 00:00 2023-01-04T18:04:45.909 INFO:teuthology.orchestra.run.smithi050.stdout:(8/20): netavark-1.1.0-6.module_el8.7.0+1216+b0 6.1 MB/s | 2.2 MB 00:00 2023-01-04T18:04:45.928 INFO:teuthology.orchestra.run.smithi098.stdout:(16/20): criu-3.15-3.module_el8.7.0+1216+b022c0 2.9 MB/s | 518 kB 00:00 2023-01-04T18:04:45.937 INFO:teuthology.orchestra.run.smithi050.stdout:(9/20): udica-0.2.6-3.module_el8.7.0+1216+b022c 1.9 MB/s | 49 kB 00:00 2023-01-04T18:04:45.952 INFO:teuthology.orchestra.run.smithi098.stdout:(17/20): libslirp-4.4.0-1.module_el8.7.0+1216+b 1.2 MB/s | 70 kB 00:00 2023-01-04T18:04:45.960 INFO:teuthology.orchestra.run.smithi050.stdout:(10/20): yajl-2.1.0-11.el8.x86_64.rpm 1.6 MB/s | 41 kB 00:00 2023-01-04T18:04:45.978 INFO:teuthology.orchestra.run.smithi098.stdout:(18/20): slirp4netns-1.2.0-2.module_el8.7.0+121 2.1 MB/s | 54 kB 00:00 2023-01-04T18:04:45.986 INFO:teuthology.orchestra.run.smithi050.stdout:(11/20): conmon-2.1.4-1.module_el8.7.0+1216+b02 2.2 MB/s | 57 kB 00:00 2023-01-04T18:04:46.029 INFO:teuthology.orchestra.run.smithi050.stdout:(12/20): toolbox-0.0.99.3-1.module_el8.5.0+877+ 13 MB/s | 2.3 MB 00:00 2023-01-04T18:04:46.053 INFO:teuthology.orchestra.run.smithi050.stdout:(13/20): container-selinux-2.189.0-1.module_el8 904 kB/s | 60 kB 00:00 2023-01-04T18:04:46.111 INFO:teuthology.orchestra.run.smithi050.stdout:(14/20): criu-3.15-3.module_el8.7.0+1216+b022c0 8.7 MB/s | 518 kB 00:00 2023-01-04T18:04:46.112 INFO:teuthology.orchestra.run.smithi098.stdout:(19/20): runc-1.1.4-1.module_el8.7.0+1216+b022c 16 MB/s | 2.9 MB 00:00 2023-01-04T18:04:46.153 INFO:teuthology.orchestra.run.smithi050.stdout:(15/20): fuse-overlayfs-1.9-1.module_el8.7.0+12 1.7 MB/s | 73 kB 00:00 2023-01-04T18:04:46.187 INFO:teuthology.orchestra.run.smithi050.stdout:(16/20): libslirp-4.4.0-1.module_el8.7.0+1216+b 2.0 MB/s | 70 kB 00:00 2023-01-04T18:04:46.370 INFO:teuthology.orchestra.run.smithi098.stdout:(20/20): containernetworking-plugins-1.1.1-3.mo 23 MB/s | 18 MB 00:00 2023-01-04T18:04:46.372 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:04:46.373 INFO:teuthology.orchestra.run.smithi098.stdout:Total 32 MB/s | 43 MB 00:01 2023-01-04T18:04:46.396 INFO:teuthology.orchestra.run.smithi050.stdout:(17/20): skopeo-1.9.2-1.module_el8.7.0+1216+b02 10 MB/s | 6.8 MB 00:00 2023-01-04T18:04:46.421 INFO:teuthology.orchestra.run.smithi050.stdout:(18/20): slirp4netns-1.2.0-2.module_el8.7.0+121 2.1 MB/s | 54 kB 00:00 2023-01-04T18:04:46.513 INFO:teuthology.orchestra.run.smithi050.stdout:(19/20): runc-1.1.4-1.module_el8.7.0+1216+b022c 9.1 MB/s | 2.9 MB 00:00 2023-01-04T18:04:46.730 INFO:teuthology.orchestra.run.smithi050.stdout:(20/20): containernetworking-plugins-1.1.1-3.mo 26 MB/s | 18 MB 00:00 2023-01-04T18:04:46.732 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:04:46.732 INFO:teuthology.orchestra.run.smithi050.stdout:Total 33 MB/s | 43 MB 00:01 2023-01-04T18:04:46.792 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2023-01-04T18:04:46.838 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2023-01-04T18:04:46.838 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2023-01-04T18:04:47.165 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-01-04T18:04:47.214 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-01-04T18:04:47.215 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-01-04T18:04:47.344 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2023-01-04T18:04:47.348 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2023-01-04T18:04:47.720 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-01-04T18:04:47.724 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-01-04T18:04:48.520 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2023-01-04T18:04:48.532 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module_el8.7.0+1216+b0 1/1 2023-01-04T18:04:48.575 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module_el8.7.0+1216+ 1/28 2023-01-04T18:04:48.796 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : container-selinux-2:2.189.0-1.module_el8.7.0+1216+ 1/28 2023-01-04T18:04:48.799 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-01-04T18:04:48.815 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module_el8.7.0+1216+b0 1/1 2023-01-04T18:04:48.863 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module_el8.7.0+1216+ 1/28 2023-01-04T18:04:49.066 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : container-selinux-2:2.189.0-1.module_el8.7.0+1216+ 1/28 2023-01-04T18:05:06.126 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module_el8.7.0+1216+ 1/28 2023-01-04T18:05:06.385 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 2/28 2023-01-04T18:05:06.601 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 3/28 2023-01-04T18:05:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 4/28 2023-01-04T18:05:07.533 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module_el8.7.0+1216+ 1/28 2023-01-04T18:05:07.730 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 2/28 2023-01-04T18:05:07.972 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 3/28 2023-01-04T18:05:08.537 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 4/28 2023-01-04T18:05:08.885 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 5/28 2023-01-04T18:05:09.167 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : containernetworking-plugins-1:1.1.1-3.module_el8.7 6/28 2023-01-04T18:05:09.364 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : yajl-2.1.0-11.el8.x86_64 7/28 2023-01-04T18:05:09.535 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 8/28 2023-01-04T18:05:09.843 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 9/28 2023-01-04T18:05:10.253 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : aardvark-dns-2:1.1.0-4.module_el8.7.0+1216+b022c01 10/28 2023-01-04T18:05:10.337 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 5/28 2023-01-04T18:05:10.546 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : containernetworking-plugins-1:1.1.1-3.module_el8.7 6/28 2023-01-04T18:05:10.761 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : yajl-2.1.0-11.el8.x86_64 7/28 2023-01-04T18:05:10.905 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 8/28 2023-01-04T18:05:11.145 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : netavark-2:1.1.0-6.module_el8.7.0+1216+b022c01d.x8 11/28 2023-01-04T18:05:11.202 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 9/28 2023-01-04T18:05:11.426 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : buildah-1:1.27.0-2.module_el8.7.0+1216+b022c01d.x8 12/28 2023-01-04T18:05:11.577 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : aardvark-dns-2:1.1.0-4.module_el8.7.0+1216+b022c01 10/28 2023-01-04T18:05:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-podman-4.2.0-1.module_el8.7.0+1216+b022c01 13/28 2023-01-04T18:05:11.830 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : crun-1.5-1.module_el8.7.0+1216+b022c01d.x86_64 14/28 2023-01-04T18:05:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : udica-0.2.6-3.module_el8.7.0+1216+b022c01d.noarch 15/28 2023-01-04T18:05:12.343 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : fuse-overlayfs-1.9-1.module_el8.7.0+1216+b022c01d. 16/28 2023-01-04T18:05:12.362 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: fuse-overlayfs-1.9-1.module_el8.7.0+1216+b022c01d. 16/28 2023-01-04T18:05:12.452 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : netavark-2:1.1.0-6.module_el8.7.0+1216+b022c01d.x8 11/28 2023-01-04T18:05:12.754 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : buildah-1:1.27.0-2.module_el8.7.0+1216+b022c01d.x8 12/28 2023-01-04T18:05:12.807 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : conmon-3:2.1.4-1.module_el8.7.0+1216+b022c01d.x86_ 17/28 2023-01-04T18:05:13.107 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-podman-4.2.0-1.module_el8.7.0+1216+b022c01 13/28 2023-01-04T18:05:13.293 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : crun-1.5-1.module_el8.7.0+1216+b022c01d.x86_64 14/28 2023-01-04T18:05:13.557 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : udica-0.2.6-3.module_el8.7.0+1216+b022c01d.noarch 15/28 2023-01-04T18:05:13.621 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 18/28 2023-01-04T18:05:13.771 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : fuse-overlayfs-1.9-1.module_el8.7.0+1216+b022c01d. 16/28 2023-01-04T18:05:13.793 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: fuse-overlayfs-1.9-1.module_el8.7.0+1216+b022c01d. 16/28 2023-01-04T18:05:13.887 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : skopeo-2:1.9.2-1.module_el8.7.0+1216+b022c01d.x86_ 19/28 2023-01-04T18:05:14.085 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cockpit-podman-53-1.module_el8.7.0+1216+b022c01d.n 20/28 2023-01-04T18:05:14.086 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : container-selinux-2:2.180.0-1.module_el8.7.0+1106+ 21/28 2023-01-04T18:05:14.195 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : conmon-3:2.1.4-1.module_el8.7.0+1216+b022c01d.x86_ 17/28 2023-01-04T18:05:14.261 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: container-selinux-2:2.180.0-1.module_el8.7.0+1106+ 21/28 2023-01-04T18:05:14.444 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : slirp4netns-1.1.8-2.module_el8.7.0+1106+45480ee0.x 22/28 2023-01-04T18:05:14.636 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : runc-1:1.0.3-3.module_el8.7.0+1106+45480ee0.x86_64 23/28 2023-01-04T18:05:14.782 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : criu-3.15-3.module_el8.6.0+926+8bef8ae7.x86_64 24/28 2023-01-04T18:05:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : libslirp-4.4.0-1.module_el8.6.0+926+8bef8ae7.x86_6 25/28 2023-01-04T18:05:14.991 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 18/28 2023-01-04T18:05:15.173 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : fuse-overlayfs-1.8.2-1.module_el8.7.0+1106+45480ee 26/28 2023-01-04T18:05:15.199 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : skopeo-2:1.9.2-1.module_el8.7.0+1216+b022c01d.x86_ 19/28 2023-01-04T18:05:15.372 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cockpit-podman-53-1.module_el8.7.0+1216+b022c01d.n 20/28 2023-01-04T18:05:15.372 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : container-selinux-2:2.180.0-1.module_el8.7.0+1106+ 21/28 2023-01-04T18:05:15.385 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : containernetworking-plugins-1:1.1.1-1.module_el8.7 27/28 2023-01-04T18:05:15.539 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: container-selinux-2:2.180.0-1.module_el8.7.0+1106+ 21/28 2023-01-04T18:05:15.574 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : conmon-2:2.1.0-1.module_el8.7.0+1106+45480ee0.x86_ 28/28 2023-01-04T18:05:15.689 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : slirp4netns-1.1.8-2.module_el8.7.0+1106+45480ee0.x 22/28 2023-01-04T18:05:15.863 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : runc-1:1.0.3-3.module_el8.7.0+1106+45480ee0.x86_64 23/28 2023-01-04T18:05:16.019 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : criu-3.15-3.module_el8.6.0+926+8bef8ae7.x86_64 24/28 2023-01-04T18:05:16.172 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libslirp-4.4.0-1.module_el8.6.0+926+8bef8ae7.x86_6 25/28 2023-01-04T18:05:16.361 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : fuse-overlayfs-1.8.2-1.module_el8.7.0+1106+45480ee 26/28 2023-01-04T18:05:16.586 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : containernetworking-plugins-1:1.1.1-1.module_el8.7 27/28 2023-01-04T18:05:16.754 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : conmon-2:2.1.0-1.module_el8.7.0+1106+45480ee0.x86_ 28/28 2023-01-04T18:05:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module_el8.7.0+1216+ 28/28 2023-01-04T18:05:54.464 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: conmon-2:2.1.0-1.module_el8.7.0+1106+45480ee0.x86_ 28/28 2023-01-04T18:05:54.464 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : aardvark-dns-2:1.1.0-4.module_el8.7.0+1216+b022c01 1/28 2023-01-04T18:05:54.464 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : buildah-1:1.27.0-2.module_el8.7.0+1216+b022c01d.x8 2/28 2023-01-04T18:05:54.464 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cockpit-podman-53-1.module_el8.7.0+1216+b022c01d.n 3/28 2023-01-04T18:05:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : crun-1.5-1.module_el8.7.0+1216+b022c01d.x86_64 4/28 2023-01-04T18:05:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : netavark-2:1.1.0-6.module_el8.7.0+1216+b022c01d.x8 5/28 2023-01-04T18:05:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-podman-4.2.0-1.module_el8.7.0+1216+b022c01 6/28 2023-01-04T18:05:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 7/28 2023-01-04T18:05:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 8/28 2023-01-04T18:05:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : skopeo-2:1.9.2-1.module_el8.7.0+1216+b022c01d.x86_ 9/28 2023-01-04T18:05:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 10/28 2023-01-04T18:05:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : udica-0.2.6-3.module_el8.7.0+1216+b022c01d.noarch 11/28 2023-01-04T18:05:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : yajl-2.1.0-11.el8.x86_64 12/28 2023-01-04T18:05:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : conmon-3:2.1.4-1.module_el8.7.0+1216+b022c01d.x86_ 13/28 2023-01-04T18:05:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : conmon-2:2.1.0-1.module_el8.7.0+1106+45480ee0.x86_ 14/28 2023-01-04T18:05:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : container-selinux-2:2.189.0-1.module_el8.7.0+1216+ 15/28 2023-01-04T18:05:54.466 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : container-selinux-2:2.180.0-1.module_el8.7.0+1106+ 16/28 2023-01-04T18:05:54.466 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : containernetworking-plugins-1:1.1.1-3.module_el8.7 17/28 2023-01-04T18:05:54.466 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : containernetworking-plugins-1:1.1.1-1.module_el8.7 18/28 2023-01-04T18:05:54.466 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 19/28 2023-01-04T18:05:54.466 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : criu-3.15-3.module_el8.6.0+926+8bef8ae7.x86_64 20/28 2023-01-04T18:05:54.466 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fuse-overlayfs-1.9-1.module_el8.7.0+1216+b022c01d. 21/28 2023-01-04T18:05:54.466 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fuse-overlayfs-1.8.2-1.module_el8.7.0+1106+45480ee 22/28 2023-01-04T18:05:54.466 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 23/28 2023-01-04T18:05:54.466 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libslirp-4.4.0-1.module_el8.6.0+926+8bef8ae7.x86_6 24/28 2023-01-04T18:05:54.466 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 25/28 2023-01-04T18:05:54.466 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : runc-1:1.0.3-3.module_el8.7.0+1106+45480ee0.x86_64 26/28 2023-01-04T18:05:54.467 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 27/28 2023-01-04T18:05:55.460 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : slirp4netns-1.1.8-2.module_el8.7.0+1106+45480ee0.x 28/28 2023-01-04T18:05:55.460 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:05:55.460 INFO:teuthology.orchestra.run.smithi098.stdout:Upgraded: 2023-01-04T18:05:55.460 INFO:teuthology.orchestra.run.smithi098.stdout: conmon-3:2.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:55.460 INFO:teuthology.orchestra.run.smithi098.stdout: container-selinux-2:2.189.0-1.module_el8.7.0+1216+b022c01d.noarch 2023-01-04T18:05:55.460 INFO:teuthology.orchestra.run.smithi098.stdout: containernetworking-plugins-1:1.1.1-3.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:55.461 INFO:teuthology.orchestra.run.smithi098.stdout: criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:55.461 INFO:teuthology.orchestra.run.smithi098.stdout: fuse-overlayfs-1.9-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:55.461 INFO:teuthology.orchestra.run.smithi098.stdout: libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:55.461 INFO:teuthology.orchestra.run.smithi098.stdout: runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:55.461 INFO:teuthology.orchestra.run.smithi098.stdout: slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:55.461 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2023-01-04T18:05:55.461 INFO:teuthology.orchestra.run.smithi098.stdout: aardvark-dns-2:1.1.0-4.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:55.461 INFO:teuthology.orchestra.run.smithi098.stdout: buildah-1:1.27.0-2.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:55.461 INFO:teuthology.orchestra.run.smithi098.stdout: cockpit-podman-53-1.module_el8.7.0+1216+b022c01d.noarch 2023-01-04T18:05:55.461 INFO:teuthology.orchestra.run.smithi098.stdout: crun-1.5-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:55.462 INFO:teuthology.orchestra.run.smithi098.stdout: netavark-2:1.1.0-6.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:55.462 INFO:teuthology.orchestra.run.smithi098.stdout: python3-podman-4.2.0-1.module_el8.7.0+1216+b022c01d.noarch 2023-01-04T18:05:55.462 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-01-04T18:05:55.462 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-01-04T18:05:55.462 INFO:teuthology.orchestra.run.smithi098.stdout: skopeo-2:1.9.2-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:55.462 INFO:teuthology.orchestra.run.smithi098.stdout: toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86_64 2023-01-04T18:05:55.462 INFO:teuthology.orchestra.run.smithi098.stdout: udica-0.2.6-3.module_el8.7.0+1216+b022c01d.noarch 2023-01-04T18:05:55.462 INFO:teuthology.orchestra.run.smithi098.stdout: yajl-2.1.0-11.el8.x86_64 2023-01-04T18:05:55.462 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:05:55.462 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:05:55.783 DEBUG:teuthology.parallel:result is None 2023-01-04T18:05:55.844 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: container-selinux-2:2.189.0-1.module_el8.7.0+1216+ 28/28 2023-01-04T18:05:56.337 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: conmon-2:2.1.0-1.module_el8.7.0+1106+45480ee0.x86_ 28/28 2023-01-04T18:05:56.337 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : aardvark-dns-2:1.1.0-4.module_el8.7.0+1216+b022c01 1/28 2023-01-04T18:05:56.337 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : buildah-1:1.27.0-2.module_el8.7.0+1216+b022c01d.x8 2/28 2023-01-04T18:05:56.337 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cockpit-podman-53-1.module_el8.7.0+1216+b022c01d.n 3/28 2023-01-04T18:05:56.337 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : crun-1.5-1.module_el8.7.0+1216+b022c01d.x86_64 4/28 2023-01-04T18:05:56.337 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : netavark-2:1.1.0-6.module_el8.7.0+1216+b022c01d.x8 5/28 2023-01-04T18:05:56.338 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-podman-4.2.0-1.module_el8.7.0+1216+b022c01 6/28 2023-01-04T18:05:56.338 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 7/28 2023-01-04T18:05:56.338 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 8/28 2023-01-04T18:05:56.338 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : skopeo-2:1.9.2-1.module_el8.7.0+1216+b022c01d.x86_ 9/28 2023-01-04T18:05:56.338 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 10/28 2023-01-04T18:05:56.338 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : udica-0.2.6-3.module_el8.7.0+1216+b022c01d.noarch 11/28 2023-01-04T18:05:56.338 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : yajl-2.1.0-11.el8.x86_64 12/28 2023-01-04T18:05:56.338 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : conmon-3:2.1.4-1.module_el8.7.0+1216+b022c01d.x86_ 13/28 2023-01-04T18:05:56.338 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : conmon-2:2.1.0-1.module_el8.7.0+1106+45480ee0.x86_ 14/28 2023-01-04T18:05:56.338 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : container-selinux-2:2.189.0-1.module_el8.7.0+1216+ 15/28 2023-01-04T18:05:56.338 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : container-selinux-2:2.180.0-1.module_el8.7.0+1106+ 16/28 2023-01-04T18:05:56.339 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : containernetworking-plugins-1:1.1.1-3.module_el8.7 17/28 2023-01-04T18:05:56.339 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : containernetworking-plugins-1:1.1.1-1.module_el8.7 18/28 2023-01-04T18:05:56.339 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 19/28 2023-01-04T18:05:56.339 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : criu-3.15-3.module_el8.6.0+926+8bef8ae7.x86_64 20/28 2023-01-04T18:05:56.339 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-overlayfs-1.9-1.module_el8.7.0+1216+b022c01d. 21/28 2023-01-04T18:05:56.339 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-overlayfs-1.8.2-1.module_el8.7.0+1106+45480ee 22/28 2023-01-04T18:05:56.339 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 23/28 2023-01-04T18:05:56.339 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libslirp-4.4.0-1.module_el8.6.0+926+8bef8ae7.x86_6 24/28 2023-01-04T18:05:56.339 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 25/28 2023-01-04T18:05:56.339 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : runc-1:1.0.3-3.module_el8.7.0+1106+45480ee0.x86_64 26/28 2023-01-04T18:05:56.340 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 27/28 2023-01-04T18:05:57.264 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : slirp4netns-1.1.8-2.module_el8.7.0+1106+45480ee0.x 28/28 2023-01-04T18:05:57.266 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:05:57.266 INFO:teuthology.orchestra.run.smithi050.stdout:Upgraded: 2023-01-04T18:05:57.266 INFO:teuthology.orchestra.run.smithi050.stdout: conmon-3:2.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:57.266 INFO:teuthology.orchestra.run.smithi050.stdout: container-selinux-2:2.189.0-1.module_el8.7.0+1216+b022c01d.noarch 2023-01-04T18:05:57.266 INFO:teuthology.orchestra.run.smithi050.stdout: containernetworking-plugins-1:1.1.1-3.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:57.266 INFO:teuthology.orchestra.run.smithi050.stdout: criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:57.266 INFO:teuthology.orchestra.run.smithi050.stdout: fuse-overlayfs-1.9-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:57.266 INFO:teuthology.orchestra.run.smithi050.stdout: libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:57.266 INFO:teuthology.orchestra.run.smithi050.stdout: runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:57.266 INFO:teuthology.orchestra.run.smithi050.stdout: slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:57.266 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-01-04T18:05:57.267 INFO:teuthology.orchestra.run.smithi050.stdout: aardvark-dns-2:1.1.0-4.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:57.267 INFO:teuthology.orchestra.run.smithi050.stdout: buildah-1:1.27.0-2.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:57.267 INFO:teuthology.orchestra.run.smithi050.stdout: cockpit-podman-53-1.module_el8.7.0+1216+b022c01d.noarch 2023-01-04T18:05:57.267 INFO:teuthology.orchestra.run.smithi050.stdout: crun-1.5-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:57.267 INFO:teuthology.orchestra.run.smithi050.stdout: netavark-2:1.1.0-6.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:57.267 INFO:teuthology.orchestra.run.smithi050.stdout: python3-podman-4.2.0-1.module_el8.7.0+1216+b022c01d.noarch 2023-01-04T18:05:57.267 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-01-04T18:05:57.267 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-01-04T18:05:57.267 INFO:teuthology.orchestra.run.smithi050.stdout: skopeo-2:1.9.2-1.module_el8.7.0+1216+b022c01d.x86_64 2023-01-04T18:05:57.267 INFO:teuthology.orchestra.run.smithi050.stdout: toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86_64 2023-01-04T18:05:57.267 INFO:teuthology.orchestra.run.smithi050.stdout: udica-0.2.6-3.module_el8.7.0+1216+b022c01d.noarch 2023-01-04T18:05:57.267 INFO:teuthology.orchestra.run.smithi050.stdout: yajl-2.1.0-11.el8.x86_64 2023-01-04T18:05:57.268 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:05:57.268 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:05:57.600 DEBUG:teuthology.parallel:result is None 2023-01-04T18:05:57.601 INFO:teuthology.run_tasks:Running task pexec... 2023-01-04T18:05:57.611 INFO:teuthology.task.pexec:Executing custom commands... 2023-01-04T18:05:57.611 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi050.front.sepia.ceph.com 2023-01-04T18:05:57.611 DEBUG:teuthology.orchestra.run.smithi050:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-01-04T18:05:57.612 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi098.front.sepia.ceph.com 2023-01-04T18:05:57.612 DEBUG:teuthology.orchestra.run.smithi098:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-01-04T18:05:57.774 DEBUG:teuthology.parallel:result is None 2023-01-04T18:05:57.780 DEBUG:teuthology.parallel:result is None 2023-01-04T18:05:57.781 INFO:teuthology.run_tasks:Running task install... 2023-01-04T18:05:57.789 DEBUG:teuthology.task.install:project ceph 2023-01-04T18:05:57.789 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f2bb1478686242c0f68882a9cf8df4e0f8363116'}} 2023-01-04T18:05:57.789 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v16.2.4', 'flavor': 'default', 'sha1': 'f2bb1478686242c0f68882a9cf8df4e0f8363116'} 2023-01-04T18:05:57.789 INFO:teuthology.task.install:Using flavor: default 2023-01-04T18:05:57.795 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-01-04T18:05:57.795 INFO:teuthology.task.install:extra packages: [] 2023-01-04T18:05:57.795 DEBUG:teuthology.orchestra.run.smithi050:> sudo lsb_release -is 2023-01-04T18:05:57.833 INFO:teuthology.orchestra.run.smithi050.stdout:CentOSStream 2023-01-04T18:05:57.834 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-04T18:05:57.834 DEBUG:teuthology.orchestra.run.smithi098:> sudo lsb_release -is 2023-01-04T18:05:57.834 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f2bb1478686242c0f68882a9cf8df4e0f8363116', 'tag': 'v16.2.4', 'wait_for_package': False} 2023-01-04T18:05:57.835 DEBUG:teuthology.orchestra.run.smithi050:> sudo lsb_release -is 2023-01-04T18:05:57.872 INFO:teuthology.orchestra.run.smithi098.stdout:CentOSStream 2023-01-04T18:05:57.873 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-04T18:05:57.873 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f2bb1478686242c0f68882a9cf8df4e0f8363116', 'tag': 'v16.2.4', 'wait_for_package': False} 2023-01-04T18:05:57.873 DEBUG:teuthology.orchestra.run.smithi098:> sudo lsb_release -is 2023-01-04T18:05:57.910 INFO:teuthology.orchestra.run.smithi050.stdout:CentOSStream 2023-01-04T18:05:57.911 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-04T18:05:57.911 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2023-01-04T18:05:57.914 INFO:teuthology.packaging:ref: None 2023-01-04T18:05:57.914 INFO:teuthology.packaging:tag: v16.2.4 2023-01-04T18:05:57.914 INFO:teuthology.packaging:branch: None 2023-01-04T18:05:57.914 INFO:teuthology.packaging:sha1: f2bb1478686242c0f68882a9cf8df4e0f8363116 2023-01-04T18:05:58.320 DEBUG:teuthology.repo_utils:git ls-remote https://github.com/ceph/ceph-ci v16.2.4^{} -> 3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2023-01-04T18:05:58.321 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2023-01-04T18:05:58.370 INFO:teuthology.orchestra.run.smithi098.stdout:CentOSStream 2023-01-04T18:05:58.371 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-04T18:05:58.371 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2023-01-04T18:05:58.371 INFO:teuthology.packaging:ref: None 2023-01-04T18:05:58.371 INFO:teuthology.packaging:tag: v16.2.4 2023-01-04T18:05:58.371 INFO:teuthology.packaging:branch: None 2023-01-04T18:05:58.372 INFO:teuthology.packaging:sha1: f2bb1478686242c0f68882a9cf8df4e0f8363116 2023-01-04T18:05:58.926 DEBUG:teuthology.repo_utils:git ls-remote https://github.com/ceph/ceph-ci v16.2.4^{} -> 3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2023-01-04T18:05:58.927 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2023-01-04T18:05:59.054 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/ 2023-01-04T18:05:59.054 INFO:teuthology.task.install.rpm:Package version is 16.2.4-0 2023-01-04T18:05:59.087 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-01-04T18:05:59.087 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-01-04T18:05:59.087 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-01-04T18:05:59.116 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/ 2023-01-04T18:05:59.116 INFO:teuthology.task.install.rpm:Package version is 16.2.4-0 2023-01-04T18:05:59.129 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-01-04T18:05:59.130 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2023-01-04T18:05:59.130 INFO:teuthology.packaging:ref: None 2023-01-04T18:05:59.130 INFO:teuthology.packaging:tag: v16.2.4 2023-01-04T18:05:59.130 INFO:teuthology.packaging:branch: None 2023-01-04T18:05:59.130 INFO:teuthology.packaging:sha1: f2bb1478686242c0f68882a9cf8df4e0f8363116 2023-01-04T18:05:59.130 DEBUG:teuthology.orchestra.run.smithi050:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v16.2.4/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-01-04T18:05:59.144 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-01-04T18:05:59.145 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-01-04T18:05:59.145 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-01-04T18:05:59.175 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-01-04T18:05:59.176 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2023-01-04T18:05:59.176 INFO:teuthology.packaging:ref: None 2023-01-04T18:05:59.176 INFO:teuthology.packaging:tag: v16.2.4 2023-01-04T18:05:59.176 INFO:teuthology.packaging:branch: None 2023-01-04T18:05:59.176 INFO:teuthology.packaging:sha1: f2bb1478686242c0f68882a9cf8df4e0f8363116 2023-01-04T18:05:59.176 DEBUG:teuthology.orchestra.run.smithi098:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v16.2.4/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-01-04T18:05:59.205 DEBUG:teuthology.orchestra.run.smithi050:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-01-04T18:05:59.247 DEBUG:teuthology.orchestra.run.smithi098:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-01-04T18:05:59.289 DEBUG:teuthology.orchestra.run.smithi050:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-01-04T18:05:59.327 DEBUG:teuthology.orchestra.run.smithi098:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-01-04T18:05:59.359 INFO:teuthology.orchestra.run.smithi050.stdout:check_obsoletes = 1 2023-01-04T18:05:59.361 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum clean all 2023-01-04T18:05:59.395 INFO:teuthology.orchestra.run.smithi098.stdout:check_obsoletes = 1 2023-01-04T18:05:59.396 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum clean all 2023-01-04T18:05:59.631 INFO:teuthology.orchestra.run.smithi050.stdout:62 files removed 2023-01-04T18:05:59.651 INFO:teuthology.orchestra.run.smithi098.stdout:62 files removed 2023-01-04T18:05:59.659 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-radosgw 2023-01-04T18:05:59.679 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-radosgw 2023-01-04T18:06:00.130 INFO:teuthology.orchestra.run.smithi050.stdout:ceph packages for x86_64 1.0 MB/s | 74 kB 00:00 2023-01-04T18:06:00.131 INFO:teuthology.orchestra.run.smithi098.stdout:ceph packages for x86_64 914 kB/s | 74 kB 00:00 2023-01-04T18:06:00.238 INFO:teuthology.orchestra.run.smithi050.stdout:ceph noarch packages 209 kB/s | 15 kB 00:00 2023-01-04T18:06:00.240 INFO:teuthology.orchestra.run.smithi098.stdout:ceph noarch packages 203 kB/s | 15 kB 00:00 2023-01-04T18:06:00.341 INFO:teuthology.orchestra.run.smithi098.stdout:ceph source packages 23 kB/s | 1.7 kB 00:00 2023-01-04T18:06:00.366 INFO:teuthology.orchestra.run.smithi050.stdout:ceph source packages 17 kB/s | 1.7 kB 00:00 2023-01-04T18:06:01.193 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS-8 - AppStream 32 MB/s | 27 MB 00:00 2023-01-04T18:06:01.392 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - AppStream 27 MB/s | 27 MB 00:01 2023-01-04T18:06:06.677 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS-8 - BaseOS 41 MB/s | 26 MB 00:00 2023-01-04T18:06:07.208 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - BaseOS 42 MB/s | 26 MB 00:00 2023-01-04T18:06:10.817 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS-8 - Extras 164 kB/s | 18 kB 00:00 2023-01-04T18:06:11.229 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS-8 - PowerTools 19 MB/s | 5.5 MB 00:00 2023-01-04T18:06:11.566 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - Extras 151 kB/s | 18 kB 00:00 2023-01-04T18:06:11.935 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-8 - PowerTools 23 MB/s | 5.5 MB 00:00 2023-01-04T18:06:14.853 INFO:teuthology.orchestra.run.smithi098.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-01-04T18:06:15.568 INFO:teuthology.orchestra.run.smithi050.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-01-04T18:06:17.203 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 5.9 MB/s | 13 MB 00:02 2023-01-04T18:06:17.926 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 5.9 MB/s | 13 MB 00:02 2023-01-04T18:06:20.520 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 276 kB/s | 24 kB 00:00 2023-01-04T18:06:21.352 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 493 kB/s | 24 kB 00:00 2023-01-04T18:06:23.797 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:06:23.800 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:06:23.800 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2023-01-04T18:06:23.800 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:06:23.800 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2023-01-04T18:06:23.800 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw x86_64 2:16.2.4-0.el8 ceph 13 M 2023-01-04T18:06:23.800 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrading: 2023-01-04T18:06:23.800 INFO:teuthology.orchestra.run.smithi098.stdout: librados2 x86_64 2:16.2.4-0.el8 ceph 3.7 M 2023-01-04T18:06:23.800 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1 x86_64 2:16.2.4-0.el8 ceph 4.0 M 2023-01-04T18:06:23.800 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2023-01-04T18:06:23.800 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base x86_64 2:16.2.4-0.el8 ceph 6.0 M 2023-01-04T18:06:23.801 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common x86_64 2:16.2.4-0.el8 ceph 24 M 2023-01-04T18:06:23.801 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux x86_64 2:16.2.4-0.el8 ceph 25 k 2023-01-04T18:06:23.801 INFO:teuthology.orchestra.run.smithi098.stdout: daxctl-libs x86_64 71.1-4.el8 CentOS-BaseOS 42 k 2023-01-04T18:06:23.801 INFO:teuthology.orchestra.run.smithi098.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2023-01-04T18:06:23.801 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-01-04T18:06:23.801 INFO:teuthology.orchestra.run.smithi098.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-01-04T18:06:23.801 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2 x86_64 2:16.2.4-0.el8 ceph 801 k 2023-01-04T18:06:23.801 INFO:teuthology.orchestra.run.smithi098.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-01-04T18:06:23.801 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj x86_64 1.6.1-1.el8 CentOS-AppStream 145 k 2023-01-04T18:06:23.801 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2023-01-04T18:06:23.801 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1 x86_64 2:16.2.4-0.el8 ceph 486 k 2023-01-04T18:06:23.802 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2023-01-04T18:06:23.802 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2 x86_64 2:16.2.4-0.el8 ceph 4.1 M 2023-01-04T18:06:23.802 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-01-04T18:06:23.802 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2023-01-04T18:06:23.802 INFO:teuthology.orchestra.run.smithi098.stdout: ndctl-libs x86_64 71.1-4.el8 CentOS-BaseOS 80 k 2023-01-04T18:06:23.802 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse x86_64 2:16.2.4-0.el8 ceph 44 k 2023-01-04T18:06:23.802 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common x86_64 2:16.2.4-0.el8 ceph 80 k 2023-01-04T18:06:23.802 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs x86_64 2:16.2.4-0.el8 ceph 213 k 2023-01-04T18:06:23.802 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2023-01-04T18:06:23.802 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados x86_64 2:16.2.4-0.el8 ceph 387 k 2023-01-04T18:06:23.802 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd x86_64 2:16.2.4-0.el8 ceph 368 k 2023-01-04T18:06:23.802 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw x86_64 2:16.2.4-0.el8 ceph 114 k 2023-01-04T18:06:23.803 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:06:23.803 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-01-04T18:06:23.803 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:06:23.803 INFO:teuthology.orchestra.run.smithi098.stdout:Install 25 Packages 2023-01-04T18:06:23.803 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrade 2 Packages 2023-01-04T18:06:23.803 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:06:23.803 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 59 M 2023-01-04T18:06:23.804 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2023-01-04T18:06:24.138 INFO:teuthology.orchestra.run.smithi098.stdout:(1/27): ceph-common-16.2.4-0.el8.x86_64.rpm 72 MB/s | 24 MB 00:00 2023-01-04T18:06:24.163 INFO:teuthology.orchestra.run.smithi098.stdout:(2/27): ceph-selinux-16.2.4-0.el8.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2023-01-04T18:06:24.233 INFO:teuthology.orchestra.run.smithi098.stdout:(3/27): libcephfs2-16.2.4-0.el8.x86_64.rpm 11 MB/s | 801 kB 00:00 2023-01-04T18:06:24.272 INFO:teuthology.orchestra.run.smithi098.stdout:(4/27): libradosstriper1-16.2.4-0.el8.x86_64.rp 12 MB/s | 486 kB 00:00 2023-01-04T18:06:24.373 INFO:teuthology.orchestra.run.smithi098.stdout:(5/27): librgw2-16.2.4-0.el8.x86_64.rpm 41 MB/s | 4.1 MB 00:00 2023-01-04T18:06:24.479 INFO:teuthology.orchestra.run.smithi098.stdout:(6/27): ceph-base-16.2.4-0.el8.x86_64.rpm 8.9 MB/s | 6.0 MB 00:00 2023-01-04T18:06:24.506 INFO:teuthology.orchestra.run.smithi098.stdout:(7/27): python3-ceph-argparse-16.2.4-0.el8.x86_ 333 kB/s | 44 kB 00:00 2023-01-04T18:06:24.532 INFO:teuthology.orchestra.run.smithi098.stdout:(8/27): python3-ceph-common-16.2.4-0.el8.x86_64 1.5 MB/s | 80 kB 00:00 2023-01-04T18:06:24.559 INFO:teuthology.orchestra.run.smithi098.stdout:(9/27): python3-cephfs-16.2.4-0.el8.x86_64.rpm 4.0 MB/s | 213 kB 00:00 2023-01-04T18:06:24.585 INFO:teuthology.orchestra.run.smithi098.stdout:(10/27): python3-rados-16.2.4-0.el8.x86_64.rpm 7.2 MB/s | 387 kB 00:00 2023-01-04T18:06:24.610 INFO:teuthology.orchestra.run.smithi098.stdout:(11/27): python3-rbd-16.2.4-0.el8.x86_64.rpm 7.1 MB/s | 368 kB 00:00 2023-01-04T18:06:24.627 INFO:teuthology.orchestra.run.smithi098.stdout:(12/27): python3-rgw-16.2.4-0.el8.x86_64.rpm 2.7 MB/s | 114 kB 00:00 2023-01-04T18:06:24.811 INFO:teuthology.orchestra.run.smithi098.stdout:(13/27): ceph-radosgw-16.2.4-0.el8.x86_64.rpm 13 MB/s | 13 MB 00:01 2023-01-04T18:06:24.844 INFO:teuthology.orchestra.run.smithi098.stdout:(14/27): libpmemobj-1.6.1-1.el8.x86_64.rpm 621 kB/s | 145 kB 00:00 2023-01-04T18:06:24.856 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:06:24.859 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:06:24.859 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-01-04T18:06:24.859 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:06:24.859 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-01-04T18:06:24.859 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw x86_64 2:16.2.4-0.el8 ceph 13 M 2023-01-04T18:06:24.859 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrading: 2023-01-04T18:06:24.859 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 x86_64 2:16.2.4-0.el8 ceph 3.7 M 2023-01-04T18:06:24.860 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1 x86_64 2:16.2.4-0.el8 ceph 4.0 M 2023-01-04T18:06:24.860 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-01-04T18:06:24.860 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base x86_64 2:16.2.4-0.el8 ceph 6.0 M 2023-01-04T18:06:24.860 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common x86_64 2:16.2.4-0.el8 ceph 24 M 2023-01-04T18:06:24.860 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux x86_64 2:16.2.4-0.el8 ceph 25 k 2023-01-04T18:06:24.860 INFO:teuthology.orchestra.run.smithi050.stdout: daxctl-libs x86_64 71.1-4.el8 CentOS-BaseOS 42 k 2023-01-04T18:06:24.860 INFO:teuthology.orchestra.run.smithi050.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2023-01-04T18:06:24.860 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-01-04T18:06:24.860 INFO:teuthology.orchestra.run.smithi050.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-01-04T18:06:24.860 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 x86_64 2:16.2.4-0.el8 ceph 801 k 2023-01-04T18:06:24.861 INFO:teuthology.orchestra.run.smithi050.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-01-04T18:06:24.861 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj x86_64 1.6.1-1.el8 CentOS-AppStream 145 k 2023-01-04T18:06:24.861 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2023-01-04T18:06:24.861 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 x86_64 2:16.2.4-0.el8 ceph 486 k 2023-01-04T18:06:24.861 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2023-01-04T18:06:24.861 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2 x86_64 2:16.2.4-0.el8 ceph 4.1 M 2023-01-04T18:06:24.861 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-01-04T18:06:24.861 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2023-01-04T18:06:24.861 INFO:teuthology.orchestra.run.smithi050.stdout: ndctl-libs x86_64 71.1-4.el8 CentOS-BaseOS 80 k 2023-01-04T18:06:24.861 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse x86_64 2:16.2.4-0.el8 ceph 44 k 2023-01-04T18:06:24.861 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common x86_64 2:16.2.4-0.el8 ceph 80 k 2023-01-04T18:06:24.862 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs x86_64 2:16.2.4-0.el8 ceph 213 k 2023-01-04T18:06:24.862 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2023-01-04T18:06:24.862 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados x86_64 2:16.2.4-0.el8 ceph 387 k 2023-01-04T18:06:24.862 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd x86_64 2:16.2.4-0.el8 ceph 368 k 2023-01-04T18:06:24.862 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw x86_64 2:16.2.4-0.el8 ceph 114 k 2023-01-04T18:06:24.862 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:06:24.862 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-01-04T18:06:24.862 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:06:24.862 INFO:teuthology.orchestra.run.smithi050.stdout:Install 25 Packages 2023-01-04T18:06:24.862 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrade 2 Packages 2023-01-04T18:06:24.862 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:06:24.863 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 59 M 2023-01-04T18:06:24.863 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-01-04T18:06:24.870 INFO:teuthology.orchestra.run.smithi098.stdout:(15/27): librdkafka-0.11.4-3.el8.x86_64.rpm 1.5 MB/s | 354 kB 00:00 2023-01-04T18:06:24.895 INFO:teuthology.orchestra.run.smithi098.stdout:(16/27): python3-prettytable-0.7.2-14.el8.noarc 887 kB/s | 44 kB 00:00 2023-01-04T18:06:24.920 INFO:teuthology.orchestra.run.smithi098.stdout:(17/27): daxctl-libs-71.1-4.el8.x86_64.rpm 835 kB/s | 42 kB 00:00 2023-01-04T18:06:24.945 INFO:teuthology.orchestra.run.smithi098.stdout:(18/27): librabbitmq-0.9.0-3.el8.x86_64.rpm 930 kB/s | 47 kB 00:00 2023-01-04T18:06:24.970 INFO:teuthology.orchestra.run.smithi098.stdout:(19/27): ndctl-libs-71.1-4.el8.x86_64.rpm 1.6 MB/s | 80 kB 00:00 2023-01-04T18:06:25.014 INFO:teuthology.orchestra.run.smithi050.stdout:(1/27): ceph-base-16.2.4-0.el8.x86_64.rpm 43 MB/s | 6.0 MB 00:00 2023-01-04T18:06:25.014 INFO:teuthology.orchestra.run.smithi098.stdout:(20/27): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.4 MB/s | 259 kB 00:00 2023-01-04T18:06:25.028 INFO:teuthology.orchestra.run.smithi050.stdout:(2/27): ceph-selinux-16.2.4-0.el8.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2023-01-04T18:06:25.070 INFO:teuthology.orchestra.run.smithi050.stdout:(3/27): libcephfs2-16.2.4-0.el8.x86_64.rpm 19 MB/s | 801 kB 00:00 2023-01-04T18:06:25.104 INFO:teuthology.orchestra.run.smithi050.stdout:(4/27): libradosstriper1-16.2.4-0.el8.x86_64.rp 14 MB/s | 486 kB 00:00 2023-01-04T18:06:25.204 INFO:teuthology.orchestra.run.smithi050.stdout:(5/27): librgw2-16.2.4-0.el8.x86_64.rpm 41 MB/s | 4.1 MB 00:00 2023-01-04T18:06:25.238 INFO:teuthology.orchestra.run.smithi050.stdout:(6/27): python3-ceph-argparse-16.2.4-0.el8.x86_ 1.3 MB/s | 44 kB 00:00 2023-01-04T18:06:25.268 INFO:teuthology.orchestra.run.smithi050.stdout:(7/27): python3-ceph-common-16.2.4-0.el8.x86_64 2.6 MB/s | 80 kB 00:00 2023-01-04T18:06:25.293 INFO:teuthology.orchestra.run.smithi050.stdout:(8/27): python3-cephfs-16.2.4-0.el8.x86_64.rpm 8.4 MB/s | 213 kB 00:00 2023-01-04T18:06:25.327 INFO:teuthology.orchestra.run.smithi050.stdout:(9/27): python3-rados-16.2.4-0.el8.x86_64.rpm 11 MB/s | 387 kB 00:00 2023-01-04T18:06:25.361 INFO:teuthology.orchestra.run.smithi050.stdout:(10/27): python3-rbd-16.2.4-0.el8.x86_64.rpm 11 MB/s | 368 kB 00:00 2023-01-04T18:06:25.371 INFO:teuthology.orchestra.run.smithi098.stdout:(21/27): fmt-6.2.1-1.el8.x86_64.rpm 273 kB/s | 116 kB 00:00 2023-01-04T18:06:25.386 INFO:teuthology.orchestra.run.smithi050.stdout:(11/27): python3-rgw-16.2.4-0.el8.x86_64.rpm 4.5 MB/s | 114 kB 00:00 2023-01-04T18:06:25.388 INFO:teuthology.orchestra.run.smithi098.stdout:(22/27): leveldb-1.22-1.el8.x86_64.rpm 461 kB/s | 181 kB 00:00 2023-01-04T18:06:25.455 INFO:teuthology.orchestra.run.smithi098.stdout:(23/27): gperftools-libs-2.7-9.el8.x86_64.rpm 632 kB/s | 306 kB 00:00 2023-01-04T18:06:25.480 INFO:teuthology.orchestra.run.smithi098.stdout:(24/27): liboath-2.6.2-3.el8.x86_64.rpm 541 kB/s | 59 kB 00:00 2023-01-04T18:06:25.505 INFO:teuthology.orchestra.run.smithi098.stdout:(25/27): libunwind-1.3.1-3.el8.x86_64.rpm 640 kB/s | 75 kB 00:00 2023-01-04T18:06:25.528 INFO:teuthology.orchestra.run.smithi050.stdout:(12/27): ceph-radosgw-16.2.4-0.el8.x86_64.rpm 19 MB/s | 13 MB 00:00 2023-01-04T18:06:25.562 INFO:teuthology.orchestra.run.smithi050.stdout:(13/27): libpmemobj-1.6.1-1.el8.x86_64.rpm 829 kB/s | 145 kB 00:00 2023-01-04T18:06:25.595 INFO:teuthology.orchestra.run.smithi050.stdout:(14/27): lttng-ust-2.8.1-11.el8.x86_64.rpm 7.7 MB/s | 259 kB 00:00 2023-01-04T18:06:25.606 INFO:teuthology.orchestra.run.smithi098.stdout:(26/27): librados2-16.2.4-0.el8.x86_64.rpm 25 MB/s | 3.7 MB 00:00 2023-01-04T18:06:25.621 INFO:teuthology.orchestra.run.smithi050.stdout:(15/27): python3-prettytable-0.7.2-14.el8.noarc 1.7 MB/s | 44 kB 00:00 2023-01-04T18:06:25.646 INFO:teuthology.orchestra.run.smithi050.stdout:(16/27): daxctl-libs-71.1-4.el8.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2023-01-04T18:06:25.664 INFO:teuthology.orchestra.run.smithi098.stdout:(27/27): librbd1-16.2.4-0.el8.x86_64.rpm 22 MB/s | 4.0 MB 00:00 2023-01-04T18:06:25.668 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:06:25.668 INFO:teuthology.orchestra.run.smithi098.stdout:Total 31 MB/s | 59 MB 00:01 2023-01-04T18:06:25.671 INFO:teuthology.orchestra.run.smithi050.stdout:(17/27): librdkafka-0.11.4-3.el8.x86_64.rpm 2.4 MB/s | 354 kB 00:00 2023-01-04T18:06:25.722 INFO:teuthology.orchestra.run.smithi050.stdout:(18/27): librabbitmq-0.9.0-3.el8.x86_64.rpm 622 kB/s | 47 kB 00:00 2023-01-04T18:06:25.733 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2023-01-04T18:06:25.747 INFO:teuthology.orchestra.run.smithi050.stdout:(19/27): ndctl-libs-71.1-4.el8.x86_64.rpm 1.0 MB/s | 80 kB 00:00 2023-01-04T18:06:25.781 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2023-01-04T18:06:25.781 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2023-01-04T18:06:26.014 INFO:teuthology.orchestra.run.smithi050.stdout:(20/27): ceph-common-16.2.4-0.el8.x86_64.rpm 21 MB/s | 24 MB 00:01 2023-01-04T18:06:26.039 INFO:teuthology.orchestra.run.smithi050.stdout:(21/27): fmt-6.2.1-1.el8.x86_64.rpm 366 kB/s | 116 kB 00:00 2023-01-04T18:06:26.115 INFO:teuthology.orchestra.run.smithi050.stdout:(22/27): liboath-2.6.2-3.el8.x86_64.rpm 784 kB/s | 59 kB 00:00 2023-01-04T18:06:26.117 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2023-01-04T18:06:26.120 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2023-01-04T18:06:26.190 INFO:teuthology.orchestra.run.smithi050.stdout:(23/27): libunwind-1.3.1-3.el8.x86_64.rpm 1.0 MB/s | 75 kB 00:00 2023-01-04T18:06:26.274 INFO:teuthology.orchestra.run.smithi050.stdout:(24/27): librados2-16.2.4-0.el8.x86_64.rpm 45 MB/s | 3.7 MB 00:00 2023-01-04T18:06:26.316 INFO:teuthology.orchestra.run.smithi050.stdout:(25/27): leveldb-1.22-1.el8.x86_64.rpm 601 kB/s | 181 kB 00:00 2023-01-04T18:06:26.383 INFO:teuthology.orchestra.run.smithi050.stdout:(26/27): librbd1-16.2.4-0.el8.x86_64.rpm 37 MB/s | 4.0 MB 00:00 2023-01-04T18:06:26.408 INFO:teuthology.orchestra.run.smithi050.stdout:(27/27): gperftools-libs-2.7-9.el8.x86_64.rpm 463 kB/s | 306 kB 00:00 2023-01-04T18:06:26.411 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:06:26.411 INFO:teuthology.orchestra.run.smithi050.stdout:Total 38 MB/s | 59 MB 00:01 2023-01-04T18:06:26.475 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-01-04T18:06:26.526 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-01-04T18:06:26.527 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-01-04T18:06:26.883 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-01-04T18:06:26.887 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-01-04T18:06:27.317 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2023-01-04T18:06:27.481 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/29 2023-01-04T18:06:27.717 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/29 2023-01-04T18:06:27.925 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/29 2023-01-04T18:06:28.043 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-01-04T18:06:28.201 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/29 2023-01-04T18:06:28.334 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/29 2023-01-04T18:06:28.406 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/29 2023-01-04T18:06:28.561 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/29 2023-01-04T18:06:28.583 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librados2-2:16.2.4-0.el8.x86_64 4/29 2023-01-04T18:06:28.681 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:16.2.4-0.el8.x86_64 4/29 2023-01-04T18:06:28.982 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/29 2023-01-04T18:06:29.049 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rados-2:16.2.4-0.el8.x86_64 5/29 2023-01-04T18:06:29.170 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librados2-2:16.2.4-0.el8.x86_64 4/29 2023-01-04T18:06:29.250 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2023-01-04T18:06:29.267 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:16.2.4-0.el8.x86_64 4/29 2023-01-04T18:06:29.352 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2023-01-04T18:06:29.523 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rados-2:16.2.4-0.el8.x86_64 5/29 2023-01-04T18:06:29.538 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/29 2023-01-04T18:06:29.686 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2023-01-04T18:06:29.733 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 8/29 2023-01-04T18:06:29.736 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2023-01-04T18:06:29.919 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/29 2023-01-04T18:06:30.078 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 8/29 2023-01-04T18:06:30.211 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 8/29 2023-01-04T18:06:30.408 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librgw2-2:16.2.4-0.el8.x86_64 9/29 2023-01-04T18:06:30.483 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librgw2-2:16.2.4-0.el8.x86_64 9/29 2023-01-04T18:06:30.524 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 8/29 2023-01-04T18:06:30.694 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librgw2-2:16.2.4-0.el8.x86_64 9/29 2023-01-04T18:06:30.696 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/29 2023-01-04T18:06:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:16.2.4-0.el8.x86_64 9/29 2023-01-04T18:06:30.883 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : daxctl-libs-71.1-4.el8.x86_64 11/29 2023-01-04T18:06:30.940 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: daxctl-libs-71.1-4.el8.x86_64 11/29 2023-01-04T18:06:30.941 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/29 2023-01-04T18:06:31.079 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 12/29 2023-01-04T18:06:31.086 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : daxctl-libs-71.1-4.el8.x86_64 11/29 2023-01-04T18:06:31.160 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: daxctl-libs-71.1-4.el8.x86_64 11/29 2023-01-04T18:06:31.301 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 12/29 2023-01-04T18:06:31.316 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cephfs-2:16.2.4-0.el8.x86_64 13/29 2023-01-04T18:06:31.462 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cephfs-2:16.2.4-0.el8.x86_64 13/29 2023-01-04T18:06:31.516 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ndctl-libs-71.1-4.el8.x86_64 14/29 2023-01-04T18:06:31.622 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ndctl-libs-71.1-4.el8.x86_64 14/29 2023-01-04T18:06:31.628 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ndctl-libs-71.1-4.el8.x86_64 14/29 2023-01-04T18:06:31.686 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ndctl-libs-71.1-4.el8.x86_64 14/29 2023-01-04T18:06:31.799 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libpmemobj-1.6.1-1.el8.x86_64 15/29 2023-01-04T18:06:31.853 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libpmemobj-1.6.1-1.el8.x86_64 15/29 2023-01-04T18:06:32.245 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libpmemobj-1.6.1-1.el8.x86_64 15/29 2023-01-04T18:06:32.306 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libpmemobj-1.6.1-1.el8.x86_64 15/29 2023-01-04T18:06:32.457 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librbd1-2:16.2.4-0.el8.x86_64 16/29 2023-01-04T18:06:32.510 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librbd1-2:16.2.4-0.el8.x86_64 16/29 2023-01-04T18:06:32.549 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:16.2.4-0.el8.x86_64 16/29 2023-01-04T18:06:32.611 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:16.2.4-0.el8.x86_64 16/29 2023-01-04T18:06:32.777 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rbd-2:16.2.4-0.el8.x86_64 17/29 2023-01-04T18:06:32.823 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rbd-2:16.2.4-0.el8.x86_64 17/29 2023-01-04T18:06:33.043 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rgw-2:16.2.4-0.el8.x86_64 18/29 2023-01-04T18:06:33.090 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rgw-2:16.2.4-0.el8.x86_64 18/29 2023-01-04T18:06:33.257 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2023-01-04T18:06:33.269 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2023-01-04T18:06:33.326 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2023-01-04T18:06:33.336 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2023-01-04T18:06:33.586 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 20/29 2023-01-04T18:06:33.588 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 20/29 2023-01-04T18:06:33.795 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 21/29 2023-01-04T18:06:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 21/29 2023-01-04T18:06:33.997 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 22/29 2023-01-04T18:06:34.124 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 22/29 2023-01-04T18:06:34.169 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-common-2:16.2.4-0.el8.x86_64 23/29 2023-01-04T18:06:34.349 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-common-2:16.2.4-0.el8.x86_64 23/29 2023-01-04T18:06:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2023-01-04T18:06:37.960 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2023-01-04T18:06:38.169 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-common-2:16.2.4-0.el8.x86_64 24/29 2023-01-04T18:06:38.199 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-common-2:16.2.4-0.el8.x86_64 24/29 2023-01-04T18:06:38.889 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2023-01-04T18:06:38.904 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2023-01-04T18:06:39.233 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-base-2:16.2.4-0.el8.x86_64 25/29 2023-01-04T18:06:39.334 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:16.2.4-0.el8.x86_64 25/29 2023-01-04T18:06:39.475 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-base-2:16.2.4-0.el8.x86_64 25/29 2023-01-04T18:06:39.501 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2023-01-04T18:06:39.623 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-base-2:16.2.4-0.el8.x86_64 25/29 2023-01-04T18:06:39.823 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2023-01-04T18:06:58.995 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2023-01-04T18:06:58.995 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /sys 2023-01-04T18:06:58.995 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /proc 2023-01-04T18:06:58.995 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /dev 2023-01-04T18:06:58.995 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /run 2023-01-04T18:06:58.995 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /mnt 2023-01-04T18:06:58.995 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /var/tmp 2023-01-04T18:06:58.995 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /home 2023-01-04T18:06:58.996 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /tmp 2023-01-04T18:06:58.996 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /dev 2023-01-04T18:06:58.996 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:06:59.353 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2023-01-04T18:06:59.353 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /sys 2023-01-04T18:06:59.353 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /proc 2023-01-04T18:06:59.353 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /dev 2023-01-04T18:06:59.353 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /run 2023-01-04T18:06:59.354 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /mnt 2023-01-04T18:06:59.354 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /var/tmp 2023-01-04T18:06:59.354 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /home 2023-01-04T18:06:59.354 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /tmp 2023-01-04T18:06:59.354 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /dev 2023-01-04T18:06:59.354 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:00.389 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2023-01-04T18:07:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2023-01-04T18:07:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 28/29 2023-01-04T18:07:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 28/29 2023-01-04T18:07:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 29/29 2023-01-04T18:07:00.788 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2023-01-04T18:07:00.863 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2023-01-04T18:07:00.864 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 28/29 2023-01-04T18:07:01.076 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 28/29 2023-01-04T18:07:01.076 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 29/29 2023-01-04T18:07:01.456 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 29/29 2023-01-04T18:07:01.457 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-base-2:16.2.4-0.el8.x86_64 1/29 2023-01-04T18:07:01.457 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-common-2:16.2.4-0.el8.x86_64 2/29 2023-01-04T18:07:01.457 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-radosgw-2:16.2.4-0.el8.x86_64 3/29 2023-01-04T18:07:01.457 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-selinux-2:16.2.4-0.el8.x86_64 4/29 2023-01-04T18:07:01.457 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs2-2:16.2.4-0.el8.x86_64 5/29 2023-01-04T18:07:01.457 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libradosstriper1-2:16.2.4-0.el8.x86_64 6/29 2023-01-04T18:07:01.457 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librgw2-2:16.2.4-0.el8.x86_64 7/29 2023-01-04T18:07:01.457 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 8/29 2023-01-04T18:07:01.457 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-common-2:16.2.4-0.el8.x86_64 9/29 2023-01-04T18:07:01.457 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cephfs-2:16.2.4-0.el8.x86_64 10/29 2023-01-04T18:07:01.458 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rados-2:16.2.4-0.el8.x86_64 11/29 2023-01-04T18:07:01.458 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rbd-2:16.2.4-0.el8.x86_64 12/29 2023-01-04T18:07:01.458 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rgw-2:16.2.4-0.el8.x86_64 13/29 2023-01-04T18:07:01.458 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libpmemobj-1.6.1-1.el8.x86_64 14/29 2023-01-04T18:07:01.458 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 15/29 2023-01-04T18:07:01.458 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 16/29 2023-01-04T18:07:01.458 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 17/29 2023-01-04T18:07:01.458 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : daxctl-libs-71.1-4.el8.x86_64 18/29 2023-01-04T18:07:01.458 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 19/29 2023-01-04T18:07:01.459 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ndctl-libs-71.1-4.el8.x86_64 20/29 2023-01-04T18:07:01.459 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 21/29 2023-01-04T18:07:01.459 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 22/29 2023-01-04T18:07:01.459 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : leveldb-1.22-1.el8.x86_64 23/29 2023-01-04T18:07:01.459 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 24/29 2023-01-04T18:07:01.459 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 25/29 2023-01-04T18:07:01.459 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:16.2.4-0.el8.x86_64 26/29 2023-01-04T18:07:01.459 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 27/29 2023-01-04T18:07:01.459 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:16.2.4-0.el8.x86_64 28/29 2023-01-04T18:07:01.806 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 29/29 2023-01-04T18:07:01.807 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:16.2.4-0.el8.x86_64 1/29 2023-01-04T18:07:01.807 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:16.2.4-0.el8.x86_64 2/29 2023-01-04T18:07:01.807 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:16.2.4-0.el8.x86_64 3/29 2023-01-04T18:07:01.807 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:16.2.4-0.el8.x86_64 4/29 2023-01-04T18:07:01.807 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:16.2.4-0.el8.x86_64 5/29 2023-01-04T18:07:01.807 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:16.2.4-0.el8.x86_64 6/29 2023-01-04T18:07:01.808 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:16.2.4-0.el8.x86_64 7/29 2023-01-04T18:07:01.808 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 8/29 2023-01-04T18:07:01.808 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:16.2.4-0.el8.x86_64 9/29 2023-01-04T18:07:01.808 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:16.2.4-0.el8.x86_64 10/29 2023-01-04T18:07:01.808 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:16.2.4-0.el8.x86_64 11/29 2023-01-04T18:07:01.808 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:16.2.4-0.el8.x86_64 12/29 2023-01-04T18:07:01.808 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:16.2.4-0.el8.x86_64 13/29 2023-01-04T18:07:01.808 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libpmemobj-1.6.1-1.el8.x86_64 14/29 2023-01-04T18:07:01.808 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 15/29 2023-01-04T18:07:01.809 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 16/29 2023-01-04T18:07:01.809 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 17/29 2023-01-04T18:07:01.809 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : daxctl-libs-71.1-4.el8.x86_64 18/29 2023-01-04T18:07:01.809 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 19/29 2023-01-04T18:07:01.809 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ndctl-libs-71.1-4.el8.x86_64 20/29 2023-01-04T18:07:01.809 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 21/29 2023-01-04T18:07:01.809 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 22/29 2023-01-04T18:07:01.809 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : leveldb-1.22-1.el8.x86_64 23/29 2023-01-04T18:07:01.809 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 24/29 2023-01-04T18:07:01.809 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 25/29 2023-01-04T18:07:01.809 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:16.2.4-0.el8.x86_64 26/29 2023-01-04T18:07:01.810 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 27/29 2023-01-04T18:07:01.810 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:16.2.4-0.el8.x86_64 28/29 2023-01-04T18:07:02.361 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 29/29 2023-01-04T18:07:02.361 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:02.361 INFO:teuthology.orchestra.run.smithi098.stdout:Upgraded: 2023-01-04T18:07:02.362 INFO:teuthology.orchestra.run.smithi098.stdout: librados2-2:16.2.4-0.el8.x86_64 librbd1-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.362 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2023-01-04T18:07:02.362 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.362 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.362 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.362 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.362 INFO:teuthology.orchestra.run.smithi098.stdout: daxctl-libs-71.1-4.el8.x86_64 2023-01-04T18:07:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: fmt-6.2.1-1.el8.x86_64 2023-01-04T18:07:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-01-04T18:07:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: leveldb-1.22-1.el8.x86_64 2023-01-04T18:07:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: liboath-2.6.2-3.el8.x86_64 2023-01-04T18:07:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj-1.6.1-1.el8.x86_64 2023-01-04T18:07:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-01-04T18:07:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-01-04T18:07:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind-1.3.1-3.el8.x86_64 2023-01-04T18:07:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-01-04T18:07:02.364 INFO:teuthology.orchestra.run.smithi098.stdout: ndctl-libs-71.1-4.el8.x86_64 2023-01-04T18:07:02.364 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.364 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.364 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.364 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-01-04T18:07:02.364 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.364 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.364 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.364 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:02.364 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:07:02.666 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-test 2023-01-04T18:07:02.900 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 29/29 2023-01-04T18:07:02.900 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:02.901 INFO:teuthology.orchestra.run.smithi050.stdout:Upgraded: 2023-01-04T18:07:02.901 INFO:teuthology.orchestra.run.smithi050.stdout: librados2-2:16.2.4-0.el8.x86_64 librbd1-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.901 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-01-04T18:07:02.901 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.901 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.901 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.901 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.901 INFO:teuthology.orchestra.run.smithi050.stdout: daxctl-libs-71.1-4.el8.x86_64 2023-01-04T18:07:02.901 INFO:teuthology.orchestra.run.smithi050.stdout: fmt-6.2.1-1.el8.x86_64 2023-01-04T18:07:02.901 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-01-04T18:07:02.901 INFO:teuthology.orchestra.run.smithi050.stdout: leveldb-1.22-1.el8.x86_64 2023-01-04T18:07:02.902 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.902 INFO:teuthology.orchestra.run.smithi050.stdout: liboath-2.6.2-3.el8.x86_64 2023-01-04T18:07:02.902 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj-1.6.1-1.el8.x86_64 2023-01-04T18:07:02.902 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-01-04T18:07:02.902 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.902 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-01-04T18:07:02.902 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.902 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind-1.3.1-3.el8.x86_64 2023-01-04T18:07:02.902 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-01-04T18:07:02.902 INFO:teuthology.orchestra.run.smithi050.stdout: ndctl-libs-71.1-4.el8.x86_64 2023-01-04T18:07:02.902 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.902 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.903 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.903 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-01-04T18:07:02.903 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.903 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.903 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:02.903 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:02.903 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:07:03.182 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-test 2023-01-04T18:07:03.325 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:43 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:07:03.864 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:00:42 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:07:04.446 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:07:04.447 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:07:04.447 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2023-01-04T18:07:04.447 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:07:04.447 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2023-01-04T18:07:04.447 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test x86_64 2:16.2.4-0.el8 ceph 52 M 2023-01-04T18:07:04.447 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2023-01-04T18:07:04.447 INFO:teuthology.orchestra.run.smithi098.stdout: jq x86_64 1.6-6.el8 CentOS-AppStream 202 k 2023-01-04T18:07:04.447 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite x86_64 2:16.2.4-0.el8 ceph 169 k 2023-01-04T18:07:04.448 INFO:teuthology.orchestra.run.smithi098.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2023-01-04T18:07:04.448 INFO:teuthology.orchestra.run.smithi098.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2023-01-04T18:07:04.448 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet x86_64 1.6.1-20.el8 CentOS-AppStream 71 k 2023-01-04T18:07:04.448 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:04.448 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-01-04T18:07:04.448 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:07:04.448 INFO:teuthology.orchestra.run.smithi098.stdout:Install 6 Packages 2023-01-04T18:07:04.448 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:04.449 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 53 M 2023-01-04T18:07:04.449 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 229 M 2023-01-04T18:07:04.449 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2023-01-04T18:07:04.550 INFO:teuthology.orchestra.run.smithi098.stdout:(1/6): jq-1.6-6.el8.x86_64.rpm 2.0 MB/s | 202 kB 00:00 2023-01-04T18:07:04.576 INFO:teuthology.orchestra.run.smithi098.stdout:(2/6): libcephsqlite-16.2.4-0.el8.x86_64.rpm 1.3 MB/s | 169 kB 00:00 2023-01-04T18:07:04.622 INFO:teuthology.orchestra.run.smithi098.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 2.6 MB/s | 187 kB 00:00 2023-01-04T18:07:04.660 INFO:teuthology.orchestra.run.smithi098.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.1 MB/s | 71 kB 00:00 2023-01-04T18:07:04.710 INFO:teuthology.orchestra.run.smithi098.stdout:(5/6): socat-1.7.4.1-1.el8.x86_64.rpm 2.4 MB/s | 323 kB 00:00 2023-01-04T18:07:05.068 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:07:05.069 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:07:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-01-04T18:07:05.069 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:07:05.069 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-01-04T18:07:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test x86_64 2:16.2.4-0.el8 ceph 52 M 2023-01-04T18:07:05.069 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-01-04T18:07:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: jq x86_64 1.6-6.el8 CentOS-AppStream 202 k 2023-01-04T18:07:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite x86_64 2:16.2.4-0.el8 ceph 169 k 2023-01-04T18:07:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2023-01-04T18:07:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2023-01-04T18:07:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet x86_64 1.6.1-20.el8 CentOS-AppStream 71 k 2023-01-04T18:07:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:05.070 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-01-04T18:07:05.071 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:07:05.071 INFO:teuthology.orchestra.run.smithi050.stdout:Install 6 Packages 2023-01-04T18:07:05.071 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:05.072 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 53 M 2023-01-04T18:07:05.072 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 229 M 2023-01-04T18:07:05.072 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-01-04T18:07:05.155 INFO:teuthology.orchestra.run.smithi050.stdout:(1/6): libcephsqlite-16.2.4-0.el8.x86_64.rpm 2.0 MB/s | 169 kB 00:00 2023-01-04T18:07:05.189 INFO:teuthology.orchestra.run.smithi050.stdout:(2/6): jq-1.6-6.el8.x86_64.rpm 1.7 MB/s | 202 kB 00:00 2023-01-04T18:07:05.222 INFO:teuthology.orchestra.run.smithi050.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 2.8 MB/s | 187 kB 00:00 2023-01-04T18:07:05.256 INFO:teuthology.orchestra.run.smithi050.stdout:(4/6): socat-1.7.4.1-1.el8.x86_64.rpm 4.8 MB/s | 323 kB 00:00 2023-01-04T18:07:05.273 INFO:teuthology.orchestra.run.smithi050.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2023-01-04T18:07:05.302 INFO:teuthology.orchestra.run.smithi098.stdout:(6/6): ceph-test-16.2.4-0.el8.x86_64.rpm 61 MB/s | 52 MB 00:00 2023-01-04T18:07:05.306 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:07:05.306 INFO:teuthology.orchestra.run.smithi098.stdout:Total 62 MB/s | 53 MB 00:00 2023-01-04T18:07:05.347 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2023-01-04T18:07:05.368 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2023-01-04T18:07:05.368 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2023-01-04T18:07:05.661 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2023-01-04T18:07:05.665 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2023-01-04T18:07:05.903 INFO:teuthology.orchestra.run.smithi050.stdout:(6/6): ceph-test-16.2.4-0.el8.x86_64.rpm 62 MB/s | 52 MB 00:00 2023-01-04T18:07:05.906 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:07:05.906 INFO:teuthology.orchestra.run.smithi050.stdout:Total 63 MB/s | 53 MB 00:00 2023-01-04T18:07:05.950 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-01-04T18:07:05.973 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-01-04T18:07:05.973 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-01-04T18:07:06.240 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2023-01-04T18:07:06.284 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-01-04T18:07:06.287 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-01-04T18:07:06.464 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-01-04T18:07:06.705 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-01-04T18:07:06.875 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-01-04T18:07:06.878 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-04T18:07:06.956 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-04T18:07:07.070 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-01-04T18:07:07.227 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : jq-1.6-6.el8.x86_64 4/6 2023-01-04T18:07:07.260 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-01-04T18:07:07.398 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-04T18:07:07.436 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2023-01-04T18:07:07.495 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-04T18:07:07.706 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : jq-1.6-6.el8.x86_64 4/6 2023-01-04T18:07:07.914 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2023-01-04T18:07:12.244 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2023-01-04T18:07:12.565 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-test-2:16.2.4-0.el8.x86_64 6/6 2023-01-04T18:07:12.821 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-test-2:16.2.4-0.el8.x86_64 6/6 2023-01-04T18:07:12.821 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-test-2:16.2.4-0.el8.x86_64 1/6 2023-01-04T18:07:12.821 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephsqlite-2:16.2.4-0.el8.x86_64 2/6 2023-01-04T18:07:12.821 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : jq-1.6-6.el8.x86_64 3/6 2023-01-04T18:07:12.821 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-01-04T18:07:12.821 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-01-04T18:07:13.000 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2023-01-04T18:07:13.261 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-test-2:16.2.4-0.el8.x86_64 6/6 2023-01-04T18:07:13.388 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-01-04T18:07:13.388 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:13.388 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2023-01-04T18:07:13.388 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test-2:16.2.4-0.el8.x86_64 jq-1.6-6.el8.x86_64 2023-01-04T18:07:13.389 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite-2:16.2.4-0.el8.x86_64 oniguruma-6.8.2-2.el8.x86_64 2023-01-04T18:07:13.389 INFO:teuthology.orchestra.run.smithi098.stdout: socat-1.7.4.1-1.el8.x86_64 xmlstarlet-1.6.1-20.el8.x86_64 2023-01-04T18:07:13.389 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:13.389 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:07:13.542 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-test-2:16.2.4-0.el8.x86_64 6/6 2023-01-04T18:07:13.543 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:16.2.4-0.el8.x86_64 1/6 2023-01-04T18:07:13.543 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephsqlite-2:16.2.4-0.el8.x86_64 2/6 2023-01-04T18:07:13.543 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : jq-1.6-6.el8.x86_64 3/6 2023-01-04T18:07:13.543 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-01-04T18:07:13.543 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-01-04T18:07:13.603 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph 2023-01-04T18:07:14.044 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-01-04T18:07:14.044 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:14.044 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-01-04T18:07:14.045 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test-2:16.2.4-0.el8.x86_64 jq-1.6-6.el8.x86_64 2023-01-04T18:07:14.045 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite-2:16.2.4-0.el8.x86_64 oniguruma-6.8.2-2.el8.x86_64 2023-01-04T18:07:14.045 INFO:teuthology.orchestra.run.smithi050.stdout: socat-1.7.4.1-1.el8.x86_64 xmlstarlet-1.6.1-20.el8.x86_64 2023-01-04T18:07:14.045 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:14.045 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:07:14.261 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:54 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:07:14.278 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph 2023-01-04T18:07:14.966 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:00:53 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:07:15.345 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:07:15.348 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:07:15.348 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2023-01-04T18:07:15.348 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:07:15.348 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2023-01-04T18:07:15.348 INFO:teuthology.orchestra.run.smithi098.stdout: ceph x86_64 2:16.2.4-0.el8 ceph 6.3 k 2023-01-04T18:07:15.349 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2023-01-04T18:07:15.349 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds x86_64 2:16.2.4-0.el8 ceph 2.4 M 2023-01-04T18:07:15.349 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr x86_64 2:16.2.4-0.el8 ceph 1.6 M 2023-01-04T18:07:15.349 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core noarch 2:16.2.4-0.el8 ceph-noarch 220 k 2023-01-04T18:07:15.349 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon x86_64 2:16.2.4-0.el8 ceph 5.0 M 2023-01-04T18:07:15.349 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd x86_64 2:16.2.4-0.el8 ceph 18 M 2023-01-04T18:07:15.349 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-01-04T18:07:15.349 INFO:teuthology.orchestra.run.smithi098.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-01-04T18:07:15.349 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2023-01-04T18:07:15.349 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-01-04T18:07:15.350 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-01-04T18:07:15.350 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2023-01-04T18:07:15.350 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-01-04T18:07:15.350 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-01-04T18:07:15.350 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-01-04T18:07:15.350 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2023-01-04T18:07:15.350 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2023-01-04T18:07:15.350 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-01-04T18:07:15.350 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-01-04T18:07:15.350 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-01-04T18:07:15.350 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2023-01-04T18:07:15.351 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2023-01-04T18:07:15.351 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2023-01-04T18:07:15.351 INFO:teuthology.orchestra.run.smithi098.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-01-04T18:07:15.351 INFO:teuthology.orchestra.run.smithi098.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-01-04T18:07:15.351 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-01-04T18:07:15.351 INFO:teuthology.orchestra.run.smithi098.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-01-04T18:07:15.351 INFO:teuthology.orchestra.run.smithi098.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-01-04T18:07:15.351 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-01-04T18:07:15.351 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-01-04T18:07:15.351 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2023-01-04T18:07:15.351 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-01-04T18:07:15.351 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:15.352 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-01-04T18:07:15.352 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:07:15.352 INFO:teuthology.orchestra.run.smithi098.stdout:Install 32 Packages 2023-01-04T18:07:15.352 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:15.352 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 31 M 2023-01-04T18:07:15.352 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 111 M 2023-01-04T18:07:15.353 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2023-01-04T18:07:15.405 INFO:teuthology.orchestra.run.smithi098.stdout:(1/32): ceph-16.2.4-0.el8.x86_64.rpm 124 kB/s | 6.3 kB 00:00 2023-01-04T18:07:15.506 INFO:teuthology.orchestra.run.smithi098.stdout:(2/32): ceph-mon-16.2.4-0.el8.x86_64.rpm 50 MB/s | 5.0 MB 00:00 2023-01-04T18:07:15.547 INFO:teuthology.orchestra.run.smithi098.stdout:(3/32): ceph-mgr-16.2.4-0.el8.x86_64.rpm 8.1 MB/s | 1.6 MB 00:00 2023-01-04T18:07:15.598 INFO:teuthology.orchestra.run.smithi098.stdout:(4/32): ceph-mds-16.2.4-0.el8.x86_64.rpm 9.8 MB/s | 2.4 MB 00:00 2023-01-04T18:07:15.623 INFO:teuthology.orchestra.run.smithi098.stdout:(5/32): ceph-mgr-modules-core-16.2.4-0.el8.noar 2.9 MB/s | 220 kB 00:00 2023-01-04T18:07:15.704 INFO:teuthology.orchestra.run.smithi098.stdout:(6/32): python3-mako-1.0.6-13.el8.noarch.rpm 1.4 MB/s | 157 kB 00:00 2023-01-04T18:07:15.740 INFO:teuthology.orchestra.run.smithi098.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 2.9 MB/s | 103 kB 00:00 2023-01-04T18:07:15.766 INFO:teuthology.orchestra.run.smithi098.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 280 kB/s | 39 kB 00:00 2023-01-04T18:07:15.783 INFO:teuthology.orchestra.run.smithi098.stdout:(9/32): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-01-04T18:07:15.825 INFO:teuthology.orchestra.run.smithi098.stdout:(10/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 5.6 MB/s | 237 kB 00:00 2023-01-04T18:07:15.850 INFO:teuthology.orchestra.run.smithi098.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 5.3 MB/s | 457 kB 00:00 2023-01-04T18:07:15.875 INFO:teuthology.orchestra.run.smithi098.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 4.3 MB/s | 109 kB 00:00 2023-01-04T18:07:15.909 INFO:teuthology.orchestra.run.smithi098.stdout:(13/32): python3-cryptography-3.2.1-5.el8.x86_6 6.5 MB/s | 559 kB 00:00 2023-01-04T18:07:16.118 INFO:teuthology.orchestra.run.smithi098.stdout:(14/32): ceph-osd-16.2.4-0.el8.x86_64.rpm 30 MB/s | 18 MB 00:00 2023-01-04T18:07:16.143 INFO:teuthology.orchestra.run.smithi098.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 163 kB/s | 44 kB 00:00 2023-01-04T18:07:16.160 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:07:16.164 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:07:16.164 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-01-04T18:07:16.164 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:07:16.164 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-01-04T18:07:16.164 INFO:teuthology.orchestra.run.smithi050.stdout: ceph x86_64 2:16.2.4-0.el8 ceph 6.3 k 2023-01-04T18:07:16.164 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-01-04T18:07:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds x86_64 2:16.2.4-0.el8 ceph 2.4 M 2023-01-04T18:07:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr x86_64 2:16.2.4-0.el8 ceph 1.6 M 2023-01-04T18:07:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core noarch 2:16.2.4-0.el8 ceph-noarch 220 k 2023-01-04T18:07:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon x86_64 2:16.2.4-0.el8 ceph 5.0 M 2023-01-04T18:07:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd x86_64 2:16.2.4-0.el8 ceph 18 M 2023-01-04T18:07:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-01-04T18:07:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-01-04T18:07:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2023-01-04T18:07:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-01-04T18:07:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-01-04T18:07:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2023-01-04T18:07:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-01-04T18:07:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-01-04T18:07:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-01-04T18:07:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2023-01-04T18:07:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2023-01-04T18:07:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-01-04T18:07:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-01-04T18:07:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-01-04T18:07:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2023-01-04T18:07:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2023-01-04T18:07:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2023-01-04T18:07:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-01-04T18:07:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-01-04T18:07:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-01-04T18:07:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-01-04T18:07:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-01-04T18:07:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-01-04T18:07:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-01-04T18:07:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2023-01-04T18:07:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-01-04T18:07:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:16.168 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-01-04T18:07:16.168 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:07:16.168 INFO:teuthology.orchestra.run.smithi050.stdout:Install 32 Packages 2023-01-04T18:07:16.168 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:16.168 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 31 M 2023-01-04T18:07:16.168 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 111 M 2023-01-04T18:07:16.169 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-01-04T18:07:16.218 INFO:teuthology.orchestra.run.smithi050.stdout:(1/32): ceph-16.2.4-0.el8.x86_64.rpm 135 kB/s | 6.3 kB 00:00 2023-01-04T18:07:16.268 INFO:teuthology.orchestra.run.smithi050.stdout:(2/32): ceph-mgr-16.2.4-0.el8.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2023-01-04T18:07:16.318 INFO:teuthology.orchestra.run.smithi050.stdout:(3/32): ceph-mds-16.2.4-0.el8.x86_64.rpm 16 MB/s | 2.4 MB 00:00 2023-01-04T18:07:16.360 INFO:teuthology.orchestra.run.smithi098.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 411 kB/s | 185 kB 00:00 2023-01-04T18:07:16.360 INFO:teuthology.orchestra.run.smithi050.stdout:(4/32): ceph-mgr-modules-core-16.2.4-0.el8.noar 5.2 MB/s | 220 kB 00:00 2023-01-04T18:07:16.385 INFO:teuthology.orchestra.run.smithi098.stdout:(17/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.6 MB/s | 384 kB 00:00 2023-01-04T18:07:16.419 INFO:teuthology.orchestra.run.smithi098.stdout:(18/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 574 kB/s | 173 kB 00:00 2023-01-04T18:07:16.444 INFO:teuthology.orchestra.run.smithi050.stdout:(5/32): ceph-mon-16.2.4-0.el8.x86_64.rpm 22 MB/s | 5.0 MB 00:00 2023-01-04T18:07:16.469 INFO:teuthology.orchestra.run.smithi098.stdout:(19/32): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2023-01-04T18:07:16.494 INFO:teuthology.orchestra.run.smithi098.stdout:(20/32): python3-jaraco-functools-2.0-4.el8.noa 161 kB/s | 18 kB 00:00 2023-01-04T18:07:16.502 INFO:teuthology.orchestra.run.smithi050.stdout:(6/32): python3-mako-1.0.6-13.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2023-01-04T18:07:16.519 INFO:teuthology.orchestra.run.smithi098.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 485 kB/s | 49 kB 00:00 2023-01-04T18:07:16.545 INFO:teuthology.orchestra.run.smithi050.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 2.5 MB/s | 103 kB 00:00 2023-01-04T18:07:16.545 INFO:teuthology.orchestra.run.smithi098.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 778 kB/s | 59 kB 00:00 2023-01-04T18:07:16.570 INFO:teuthology.orchestra.run.smithi050.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 311 kB/s | 39 kB 00:00 2023-01-04T18:07:16.595 INFO:teuthology.orchestra.run.smithi050.stdout:(9/32): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-01-04T18:07:16.595 INFO:teuthology.orchestra.run.smithi098.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2023-01-04T18:07:16.620 INFO:teuthology.orchestra.run.smithi098.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 248 kB/s | 19 kB 00:00 2023-01-04T18:07:16.629 INFO:teuthology.orchestra.run.smithi050.stdout:(10/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 6.9 MB/s | 237 kB 00:00 2023-01-04T18:07:16.646 INFO:teuthology.orchestra.run.smithi098.stdout:(25/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2023-01-04T18:07:16.654 INFO:teuthology.orchestra.run.smithi050.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 5.3 MB/s | 457 kB 00:00 2023-01-04T18:07:16.671 INFO:teuthology.orchestra.run.smithi098.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 317 kB/s | 24 kB 00:00 2023-01-04T18:07:16.679 INFO:teuthology.orchestra.run.smithi050.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 4.3 MB/s | 109 kB 00:00 2023-01-04T18:07:16.721 INFO:teuthology.orchestra.run.smithi098.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 290 kB/s | 29 kB 00:00 2023-01-04T18:07:16.738 INFO:teuthology.orchestra.run.smithi050.stdout:(13/32): python3-cryptography-3.2.1-5.el8.x86_6 5.0 MB/s | 559 kB 00:00 2023-01-04T18:07:16.747 INFO:teuthology.orchestra.run.smithi098.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 274 kB/s | 27 kB 00:00 2023-01-04T18:07:16.772 INFO:teuthology.orchestra.run.smithi098.stdout:(29/32): python3-waitress-1.2.1-2.el8.1.noarch. 2.3 MB/s | 241 kB 00:00 2023-01-04T18:07:16.822 INFO:teuthology.orchestra.run.smithi098.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.1 MB/s | 85 kB 00:00 2023-01-04T18:07:16.847 INFO:teuthology.orchestra.run.smithi098.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 305 kB/s | 23 kB 00:00 2023-01-04T18:07:16.873 INFO:teuthology.orchestra.run.smithi098.stdout:(32/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.6 MB/s | 251 kB 00:00 2023-01-04T18:07:16.876 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:07:16.877 INFO:teuthology.orchestra.run.smithi098.stdout:Total 20 MB/s | 31 MB 00:01 2023-01-04T18:07:16.958 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2023-01-04T18:07:16.996 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2023-01-04T18:07:16.996 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2023-01-04T18:07:17.055 INFO:teuthology.orchestra.run.smithi050.stdout:(14/32): ceph-osd-16.2.4-0.el8.x86_64.rpm 23 MB/s | 18 MB 00:00 2023-01-04T18:07:17.080 INFO:teuthology.orchestra.run.smithi050.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 109 kB/s | 44 kB 00:00 2023-01-04T18:07:17.228 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2023-01-04T18:07:17.231 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2023-01-04T18:07:17.289 INFO:teuthology.orchestra.run.smithi050.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 336 kB/s | 185 kB 00:00 2023-01-04T18:07:17.322 INFO:teuthology.orchestra.run.smithi050.stdout:(17/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.6 MB/s | 384 kB 00:00 2023-01-04T18:07:17.348 INFO:teuthology.orchestra.run.smithi050.stdout:(18/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 590 kB/s | 173 kB 00:00 2023-01-04T18:07:17.373 INFO:teuthology.orchestra.run.smithi050.stdout:(19/32): python3-jaraco-6.2-6.el8.noarch.rpm 132 kB/s | 11 kB 00:00 2023-01-04T18:07:17.398 INFO:teuthology.orchestra.run.smithi050.stdout:(20/32): python3-jaraco-functools-2.0-4.el8.noa 233 kB/s | 18 kB 00:00 2023-01-04T18:07:17.424 INFO:teuthology.orchestra.run.smithi050.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 646 kB/s | 49 kB 00:00 2023-01-04T18:07:17.449 INFO:teuthology.orchestra.run.smithi050.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 778 kB/s | 59 kB 00:00 2023-01-04T18:07:17.508 INFO:teuthology.orchestra.run.smithi050.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 186 kB/s | 16 kB 00:00 2023-01-04T18:07:17.533 INFO:teuthology.orchestra.run.smithi050.stdout:(24/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2023-01-04T18:07:17.558 INFO:teuthology.orchestra.run.smithi050.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 172 kB/s | 19 kB 00:00 2023-01-04T18:07:17.583 INFO:teuthology.orchestra.run.smithi050.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 317 kB/s | 24 kB 00:00 2023-01-04T18:07:17.609 INFO:teuthology.orchestra.run.smithi050.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 386 kB/s | 29 kB 00:00 2023-01-04T18:07:17.634 INFO:teuthology.orchestra.run.smithi050.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 365 kB/s | 27 kB 00:00 2023-01-04T18:07:17.659 INFO:teuthology.orchestra.run.smithi050.stdout:(29/32): python3-waitress-1.2.1-2.el8.1.noarch. 3.1 MB/s | 241 kB 00:00 2023-01-04T18:07:17.701 INFO:teuthology.orchestra.run.smithi050.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.2 MB/s | 85 kB 00:00 2023-01-04T18:07:17.735 INFO:teuthology.orchestra.run.smithi050.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 305 kB/s | 23 kB 00:00 2023-01-04T18:07:17.760 INFO:teuthology.orchestra.run.smithi050.stdout:(32/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.6 MB/s | 251 kB 00:00 2023-01-04T18:07:17.764 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:07:17.764 INFO:teuthology.orchestra.run.smithi050.stdout:Total 19 MB/s | 31 MB 00:01 2023-01-04T18:07:17.850 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-01-04T18:07:17.892 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-01-04T18:07:17.892 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-01-04T18:07:18.139 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-01-04T18:07:18.143 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-01-04T18:07:18.431 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2023-01-04T18:07:18.715 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-01-04T18:07:19.018 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-01-04T18:07:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-01-04T18:07:19.306 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-01-04T18:07:19.581 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-01-04T18:07:19.582 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/32 2023-01-04T18:07:19.830 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-01-04T18:07:19.854 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-01-04T18:07:20.037 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-01-04T18:07:20.114 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-01-04T18:07:20.276 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-01-04T18:07:20.336 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/32 2023-01-04T18:07:20.465 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-01-04T18:07:20.567 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-01-04T18:07:20.715 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-01-04T18:07:20.749 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-01-04T18:07:20.949 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-01-04T18:07:21.035 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-01-04T18:07:21.144 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-01-04T18:07:21.264 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-01-04T18:07:21.473 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-01-04T18:07:21.528 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-01-04T18:07:21.741 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-01-04T18:07:21.924 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/32 2023-01-04T18:07:21.997 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-01-04T18:07:22.264 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-01-04T18:07:22.329 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/32 2023-01-04T18:07:22.508 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-01-04T18:07:22.646 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/32 2023-01-04T18:07:22.766 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-01-04T18:07:22.992 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/32 2023-01-04T18:07:23.060 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-04T18:07:23.196 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-01-04T18:07:23.375 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-01-04T18:07:23.458 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-01-04T18:07:23.623 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-01-04T18:07:23.698 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-04T18:07:23.828 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2023-01-04T18:07:24.030 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-01-04T18:07:24.072 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-01-04T18:07:24.228 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-01-04T18:07:24.324 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-01-04T18:07:24.432 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2023-01-04T18:07:24.604 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-01-04T18:07:24.693 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-01-04T18:07:24.873 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-01-04T18:07:24.946 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-01-04T18:07:25.185 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-01-04T18:07:25.260 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2023-01-04T18:07:25.447 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-01-04T18:07:25.656 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-01-04T18:07:25.805 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2023-01-04T18:07:26.074 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 27/32 2023-01-04T18:07:26.158 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-01-04T18:07:26.301 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2023-01-04T18:07:26.539 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 27/32 2023-01-04T18:07:26.747 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2023-01-04T18:07:27.824 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2023-01-04T18:07:28.054 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2023-01-04T18:07:28.372 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2023-01-04T18:07:28.488 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2023-01-04T18:07:28.616 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2023-01-04T18:07:28.737 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2023-01-04T18:07:28.958 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2023-01-04T18:07:29.075 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2023-01-04T18:07:29.150 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2023-01-04T18:07:29.167 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2023-01-04T18:07:29.272 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-2:16.2.4-0.el8.x86_64 32/32 2023-01-04T18:07:29.664 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-2:16.2.4-0.el8.x86_64 32/32 2023-01-04T18:07:29.664 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-2:16.2.4-0.el8.x86_64 1/32 2023-01-04T18:07:29.664 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mds-2:16.2.4-0.el8.x86_64 2/32 2023-01-04T18:07:29.664 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-2:16.2.4-0.el8.x86_64 3/32 2023-01-04T18:07:29.664 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mon-2:16.2.4-0.el8.x86_64 4/32 2023-01-04T18:07:29.665 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-osd-2:16.2.4-0.el8.x86_64 5/32 2023-01-04T18:07:29.665 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 6/32 2023-01-04T18:07:29.665 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 7/32 2023-01-04T18:07:29.665 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-01-04T18:07:29.665 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-01-04T18:07:29.665 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 10/32 2023-01-04T18:07:29.665 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-01-04T18:07:29.665 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 12/32 2023-01-04T18:07:29.665 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 13/32 2023-01-04T18:07:29.665 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-01-04T18:07:29.666 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-01-04T18:07:29.666 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-01-04T18:07:29.666 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-04T18:07:29.666 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-01-04T18:07:29.666 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-01-04T18:07:29.666 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-01-04T18:07:29.666 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-01-04T18:07:29.666 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-01-04T18:07:29.666 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-01-04T18:07:29.666 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-01-04T18:07:29.667 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-01-04T18:07:29.667 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-01-04T18:07:29.667 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-01-04T18:07:29.667 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-01-04T18:07:29.667 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 29/32 2023-01-04T18:07:29.667 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-01-04T18:07:29.667 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-01-04T18:07:29.799 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2023-01-04T18:07:30.035 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2023-01-04T18:07:30.245 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2023-01-04T18:07:30.263 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2023-01-04T18:07:30.393 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-2:16.2.4-0.el8.x86_64 32/32 2023-01-04T18:07:30.569 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-01-04T18:07:30.569 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:30.569 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2023-01-04T18:07:30.569 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:30.569 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:30.569 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:30.569 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 2023-01-04T18:07:30.570 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:30.570 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:30.570 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-01-04T18:07:30.570 INFO:teuthology.orchestra.run.smithi098.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-01-04T18:07:30.570 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-01-04T18:07:30.570 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-01-04T18:07:30.570 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-01-04T18:07:30.570 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-01-04T18:07:30.570 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-6.2-6.el8.noarch 2023-01-04T18:07:30.571 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-01-04T18:07:30.571 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-01-04T18:07:30.571 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako-1.0.6-13.el8.noarch 2023-01-04T18:07:30.571 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-01-04T18:07:30.571 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-01-04T18:07:30.571 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-01-04T18:07:30.571 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend-2.6-1.el8.noarch 2023-01-04T18:07:30.571 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-01-04T18:07:30.571 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser-2.14-14.el8.noarch 2023-01-04T18:07:30.572 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz-2017.2-9.el8.noarch 2023-01-04T18:07:30.572 INFO:teuthology.orchestra.run.smithi098.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-01-04T18:07:30.572 INFO:teuthology.orchestra.run.smithi098.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-01-04T18:07:30.572 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-01-04T18:07:30.572 INFO:teuthology.orchestra.run.smithi098.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-01-04T18:07:30.572 INFO:teuthology.orchestra.run.smithi098.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-01-04T18:07:30.572 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-01-04T18:07:30.572 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-01-04T18:07:30.572 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-01-04T18:07:30.572 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-01-04T18:07:30.572 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:30.573 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:07:30.812 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-2:16.2.4-0.el8.x86_64 32/32 2023-01-04T18:07:30.812 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:16.2.4-0.el8.x86_64 1/32 2023-01-04T18:07:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:16.2.4-0.el8.x86_64 2/32 2023-01-04T18:07:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:16.2.4-0.el8.x86_64 3/32 2023-01-04T18:07:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:16.2.4-0.el8.x86_64 4/32 2023-01-04T18:07:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:16.2.4-0.el8.x86_64 5/32 2023-01-04T18:07:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 6/32 2023-01-04T18:07:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 7/32 2023-01-04T18:07:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-01-04T18:07:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-01-04T18:07:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 10/32 2023-01-04T18:07:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-01-04T18:07:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 12/32 2023-01-04T18:07:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 13/32 2023-01-04T18:07:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-01-04T18:07:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-01-04T18:07:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-01-04T18:07:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-04T18:07:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-01-04T18:07:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-01-04T18:07:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-01-04T18:07:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-01-04T18:07:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-01-04T18:07:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-01-04T18:07:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-01-04T18:07:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-01-04T18:07:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-01-04T18:07:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-01-04T18:07:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-01-04T18:07:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 29/32 2023-01-04T18:07:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-01-04T18:07:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-01-04T18:07:30.840 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-base 2023-01-04T18:07:31.496 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:11 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:07:31.791 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-01-04T18:07:31.791 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:31.791 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-01-04T18:07:31.791 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:31.791 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:31.791 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:31.791 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 2023-01-04T18:07:31.792 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:31.792 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:31.792 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-01-04T18:07:31.792 INFO:teuthology.orchestra.run.smithi050.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-01-04T18:07:31.792 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-01-04T18:07:31.792 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-01-04T18:07:31.792 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-01-04T18:07:31.792 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-01-04T18:07:31.792 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-6.2-6.el8.noarch 2023-01-04T18:07:31.792 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-01-04T18:07:31.793 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-01-04T18:07:31.793 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako-1.0.6-13.el8.noarch 2023-01-04T18:07:31.793 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-01-04T18:07:31.793 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-01-04T18:07:31.793 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-01-04T18:07:31.793 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend-2.6-1.el8.noarch 2023-01-04T18:07:31.793 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-01-04T18:07:31.793 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser-2.14-14.el8.noarch 2023-01-04T18:07:31.793 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz-2017.2-9.el8.noarch 2023-01-04T18:07:31.793 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-01-04T18:07:31.793 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-01-04T18:07:31.794 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-01-04T18:07:31.794 INFO:teuthology.orchestra.run.smithi050.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-01-04T18:07:31.794 INFO:teuthology.orchestra.run.smithi050.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-01-04T18:07:31.794 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-01-04T18:07:31.794 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-01-04T18:07:31.794 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-01-04T18:07:31.794 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-01-04T18:07:31.794 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:31.794 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:07:32.019 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-base 2023-01-04T18:07:32.510 INFO:teuthology.orchestra.run.smithi098.stdout:Package ceph-base-2:16.2.4-0.el8.x86_64 is already installed. 2023-01-04T18:07:32.609 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:07:32.610 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2023-01-04T18:07:32.611 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:07:32.700 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:11 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:07:32.729 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install cephadm 2023-01-04T18:07:33.380 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:13 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:07:33.797 INFO:teuthology.orchestra.run.smithi050.stdout:Package ceph-base-2:16.2.4-0.el8.x86_64 is already installed. 2023-01-04T18:07:33.905 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:07:33.906 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-01-04T18:07:33.906 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:07:34.006 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install cephadm 2023-01-04T18:07:34.499 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:07:34.499 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:07:34.499 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2023-01-04T18:07:34.500 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:07:34.500 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2023-01-04T18:07:34.500 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm noarch 2:16.2.4-0.el8 ceph-noarch 71 k 2023-01-04T18:07:34.500 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:34.500 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-01-04T18:07:34.500 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:07:34.500 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2023-01-04T18:07:34.500 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:34.501 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 71 k 2023-01-04T18:07:34.501 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 290 k 2023-01-04T18:07:34.501 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2023-01-04T18:07:34.550 INFO:teuthology.orchestra.run.smithi098.stdout:cephadm-16.2.4-0.el8.noarch.rpm 1.4 MB/s | 71 kB 00:00 2023-01-04T18:07:34.550 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:07:34.550 INFO:teuthology.orchestra.run.smithi098.stdout:Total 1.4 MB/s | 71 kB 00:00 2023-01-04T18:07:34.551 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2023-01-04T18:07:34.557 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2023-01-04T18:07:34.557 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2023-01-04T18:07:34.559 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2023-01-04T18:07:34.563 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2023-01-04T18:07:34.608 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2023-01-04T18:07:34.686 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:13 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:07:35.884 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:07:35.884 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:07:35.884 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2023-01-04T18:07:35.885 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:07:35.885 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-01-04T18:07:35.885 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm noarch 2:16.2.4-0.el8 ceph-noarch 71 k 2023-01-04T18:07:35.885 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:35.885 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-01-04T18:07:35.885 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:07:35.885 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-01-04T18:07:35.885 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:35.885 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 71 k 2023-01-04T18:07:35.885 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 290 k 2023-01-04T18:07:35.886 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-01-04T18:07:35.928 INFO:teuthology.orchestra.run.smithi050.stdout:cephadm-16.2.4-0.el8.noarch.rpm 1.6 MB/s | 71 kB 00:00 2023-01-04T18:07:35.929 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:07:35.929 INFO:teuthology.orchestra.run.smithi050.stdout:Total 1.6 MB/s | 71 kB 00:00 2023-01-04T18:07:35.929 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-01-04T18:07:35.936 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-01-04T18:07:35.936 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-01-04T18:07:35.938 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-01-04T18:07:35.942 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-01-04T18:07:35.993 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-01-04T18:07:36.143 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2023-01-04T18:07:36.310 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephadm-2:16.2.4-0.el8.noarch 1/1 2023-01-04T18:07:36.512 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2023-01-04T18:07:36.976 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephadm-2:16.2.4-0.el8.noarch 1/1 2023-01-04T18:07:36.976 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:36.976 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2023-01-04T18:07:36.976 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm-2:16.2.4-0.el8.noarch 2023-01-04T18:07:36.976 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:36.976 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:07:37.169 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-immutable-object-cache 2023-01-04T18:07:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2023-01-04T18:07:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephadm-2:16.2.4-0.el8.noarch 1/1 2023-01-04T18:07:37.826 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:17 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:07:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2023-01-04T18:07:38.426 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephadm-2:16.2.4-0.el8.noarch 1/1 2023-01-04T18:07:38.427 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:38.427 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-01-04T18:07:38.427 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm-2:16.2.4-0.el8.noarch 2023-01-04T18:07:38.427 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:38.427 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:07:38.633 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-immutable-object-cache 2023-01-04T18:07:38.946 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:07:38.946 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:07:38.946 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repo Size 2023-01-04T18:07:38.946 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:07:38.946 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2023-01-04T18:07:38.946 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache x86_64 2:16.2.4-0.el8 ceph 163 k 2023-01-04T18:07:38.947 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:38.947 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-01-04T18:07:38.947 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:07:38.947 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2023-01-04T18:07:38.947 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:38.947 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 163 k 2023-01-04T18:07:38.948 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 587 k 2023-01-04T18:07:38.948 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2023-01-04T18:07:39.137 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-immutable-object-cache-16.2.4-0.el8.x86_64 859 kB/s | 163 kB 00:00 2023-01-04T18:07:39.138 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:07:39.138 INFO:teuthology.orchestra.run.smithi098.stdout:Total 854 kB/s | 163 kB 00:00 2023-01-04T18:07:39.138 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2023-01-04T18:07:39.149 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2023-01-04T18:07:39.149 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2023-01-04T18:07:39.199 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2023-01-04T18:07:39.202 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2023-01-04T18:07:39.321 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:18 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:07:39.890 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2023-01-04T18:07:40.499 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:07:40.515 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:07:40.516 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:07:40.516 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repo Size 2023-01-04T18:07:40.516 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:07:40.516 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-01-04T18:07:40.516 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache x86_64 2:16.2.4-0.el8 ceph 163 k 2023-01-04T18:07:40.516 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:40.516 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-01-04T18:07:40.517 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:07:40.517 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-01-04T18:07:40.517 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:40.517 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 163 k 2023-01-04T18:07:40.517 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 587 k 2023-01-04T18:07:40.518 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-01-04T18:07:40.861 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-immutable-object-cache-16.2.4-0.el8.x86_64 475 kB/s | 163 kB 00:00 2023-01-04T18:07:40.861 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:07:40.862 INFO:teuthology.orchestra.run.smithi050.stdout:Total 473 kB/s | 163 kB 00:00 2023-01-04T18:07:40.862 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-01-04T18:07:40.874 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-01-04T18:07:40.874 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-01-04T18:07:40.906 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:07:40.929 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-01-04T18:07:40.932 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-01-04T18:07:41.390 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:07:41.390 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:41.390 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2023-01-04T18:07:41.390 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:41.390 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:41.390 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:07:41.551 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-01-04T18:07:41.631 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr 2023-01-04T18:07:42.127 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:07:42.293 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:22 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:07:42.566 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:07:43.002 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:07:43.002 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:43.002 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-01-04T18:07:43.003 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 2023-01-04T18:07:43.003 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:43.003 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:07:43.205 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr 2023-01-04T18:07:43.302 INFO:teuthology.orchestra.run.smithi098.stdout:Package ceph-mgr-2:16.2.4-0.el8.x86_64 is already installed. 2023-01-04T18:07:43.398 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:07:43.400 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2023-01-04T18:07:43.400 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:07:43.481 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-dashboard 2023-01-04T18:07:43.897 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:22 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:07:44.130 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:24 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:07:44.977 INFO:teuthology.orchestra.run.smithi050.stdout:Package ceph-mgr-2:16.2.4-0.el8.x86_64 is already installed. 2023-01-04T18:07:45.084 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:07:45.085 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-01-04T18:07:45.085 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:07:45.189 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr-dashboard 2023-01-04T18:07:45.242 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:07:45.243 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:07:45.243 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2023-01-04T18:07:45.243 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:07:45.243 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2023-01-04T18:07:45.243 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard noarch 2:16.2.4-0.el8 ceph-noarch 2.7 M 2023-01-04T18:07:45.243 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2023-01-04T18:07:45.243 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards noarch 2:16.2.4-0.el8 ceph-noarch 24 k 2023-01-04T18:07:45.243 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts noarch 2:16.2.4-0.el8 ceph-noarch 8.9 k 2023-01-04T18:07:45.243 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2023-01-04T18:07:45.244 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-01-04T18:07:45.244 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-01-04T18:07:45.244 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:45.244 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-01-04T18:07:45.244 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:07:45.244 INFO:teuthology.orchestra.run.smithi098.stdout:Install 6 Packages 2023-01-04T18:07:45.244 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:45.245 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 3.0 M 2023-01-04T18:07:45.245 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 15 M 2023-01-04T18:07:45.245 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2023-01-04T18:07:45.335 INFO:teuthology.orchestra.run.smithi098.stdout:(1/6): ceph-mgr-dashboard-16.2.4-0.el8.noarch.r 29 MB/s | 2.7 MB 00:00 2023-01-04T18:07:45.352 INFO:teuthology.orchestra.run.smithi098.stdout:(2/6): ceph-prometheus-alerts-16.2.4-0.el8.noar 83 kB/s | 8.9 kB 00:00 2023-01-04T18:07:45.369 INFO:teuthology.orchestra.run.smithi098.stdout:(3/6): ceph-grafana-dashboards-16.2.4-0.el8.noa 194 kB/s | 24 kB 00:00 2023-01-04T18:07:45.411 INFO:teuthology.orchestra.run.smithi098.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 564 kB/s | 43 kB 00:00 2023-01-04T18:07:45.514 INFO:teuthology.orchestra.run.smithi098.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 209 kB/s | 34 kB 00:00 2023-01-04T18:07:45.570 INFO:teuthology.orchestra.run.smithi098.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.0 MB/s | 196 kB 00:00 2023-01-04T18:07:45.572 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:07:45.573 INFO:teuthology.orchestra.run.smithi098.stdout:Total 9.0 MB/s | 3.0 MB 00:00 2023-01-04T18:07:45.582 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2023-01-04T18:07:45.592 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2023-01-04T18:07:45.592 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2023-01-04T18:07:45.694 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2023-01-04T18:07:45.697 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2023-01-04T18:07:45.874 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:24 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:07:46.809 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2023-01-04T18:07:47.045 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-01-04T18:07:47.065 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:07:47.067 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:07:47.067 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-01-04T18:07:47.067 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:07:47.067 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-01-04T18:07:47.067 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard noarch 2:16.2.4-0.el8 ceph-noarch 2.7 M 2023-01-04T18:07:47.067 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-01-04T18:07:47.067 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards noarch 2:16.2.4-0.el8 ceph-noarch 24 k 2023-01-04T18:07:47.067 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts noarch 2:16.2.4-0.el8 ceph-noarch 8.9 k 2023-01-04T18:07:47.067 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2023-01-04T18:07:47.068 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-01-04T18:07:47.068 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-01-04T18:07:47.068 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:47.068 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-01-04T18:07:47.068 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:07:47.068 INFO:teuthology.orchestra.run.smithi050.stdout:Install 6 Packages 2023-01-04T18:07:47.068 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:47.069 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 3.0 M 2023-01-04T18:07:47.069 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 15 M 2023-01-04T18:07:47.069 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-01-04T18:07:47.282 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-01-04T18:07:47.329 INFO:teuthology.orchestra.run.smithi050.stdout:(1/6): ceph-grafana-dashboards-16.2.4-0.el8.noa 93 kB/s | 24 kB 00:00 2023-01-04T18:07:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-01-04T18:07:47.535 INFO:teuthology.orchestra.run.smithi050.stdout:(2/6): ceph-prometheus-alerts-16.2.4-0.el8.noar 19 kB/s | 8.9 kB 00:00 2023-01-04T18:07:47.605 INFO:teuthology.orchestra.run.smithi050.stdout:(3/6): ceph-mgr-dashboard-16.2.4-0.el8.noarch.r 5.0 MB/s | 2.7 MB 00:00 2023-01-04T18:07:47.630 INFO:teuthology.orchestra.run.smithi050.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 142 kB/s | 43 kB 00:00 2023-01-04T18:07:47.645 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 4/6 2023-01-04T18:07:47.680 INFO:teuthology.orchestra.run.smithi050.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 234 kB/s | 34 kB 00:00 2023-01-04T18:07:47.772 INFO:teuthology.orchestra.run.smithi050.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.2 MB/s | 196 kB 00:00 2023-01-04T18:07:47.775 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:07:47.775 INFO:teuthology.orchestra.run.smithi050.stdout:Total 4.2 MB/s | 3.0 MB 00:00 2023-01-04T18:07:47.787 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-01-04T18:07:47.798 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-01-04T18:07:47.798 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-01-04T18:07:47.898 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-01-04T18:07:47.902 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-01-04T18:07:48.179 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-01-04T18:07:48.417 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-01-04T18:07:48.628 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-01-04T18:07:48.654 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 5/6 2023-01-04T18:07:48.836 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-01-04T18:07:48.966 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 4/6 2023-01-04T18:07:48.967 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2023-01-04T18:07:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2023-01-04T18:07:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 1/6 2023-01-04T18:07:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2/6 2023-01-04T18:07:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 3/6 2023-01-04T18:07:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-01-04T18:07:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-01-04T18:07:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-01-04T18:07:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:49.730 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2023-01-04T18:07:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 2023-01-04T18:07:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2023-01-04T18:07:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 2023-01-04T18:07:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-01-04T18:07:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-01-04T18:07:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes-2.4.1-12.el8.noarch 2023-01-04T18:07:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:49.731 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:07:49.848 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-diskprediction-local 2023-01-04T18:07:50.057 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 5/6 2023-01-04T18:07:50.346 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2023-01-04T18:07:50.499 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:30 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:07:50.625 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2023-01-04T18:07:50.625 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 1/6 2023-01-04T18:07:50.626 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2/6 2023-01-04T18:07:50.626 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 3/6 2023-01-04T18:07:50.626 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-01-04T18:07:50.626 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-01-04T18:07:51.123 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-01-04T18:07:51.123 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:51.123 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-01-04T18:07:51.123 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 2023-01-04T18:07:51.123 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2023-01-04T18:07:51.123 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 2023-01-04T18:07:51.123 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-01-04T18:07:51.123 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-01-04T18:07:51.124 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes-2.4.1-12.el8.noarch 2023-01-04T18:07:51.124 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:51.124 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:07:51.241 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr-diskprediction-local 2023-01-04T18:07:51.606 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:07:51.607 INFO:teuthology.orchestra.run.smithi098.stdout:===================================================================================================== 2023-01-04T18:07:51.607 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2023-01-04T18:07:51.607 INFO:teuthology.orchestra.run.smithi098.stdout:===================================================================================================== 2023-01-04T18:07:51.607 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2023-01-04T18:07:51.607 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.4-0.el8 ceph-noarch 8.6 M 2023-01-04T18:07:51.607 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2023-01-04T18:07:51.608 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran x86_64 8.5.0-17.el8 CentOS-BaseOS 645 k 2023-01-04T18:07:51.608 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath x86_64 8.5.0-17.el8 CentOS-BaseOS 172 k 2023-01-04T18:07:51.608 INFO:teuthology.orchestra.run.smithi098.stdout: openblas x86_64 0.3.15-4.el8 CentOS-AppStream 4.7 M 2023-01-04T18:07:51.608 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-threads x86_64 0.3.15-4.el8 CentOS-AppStream 4.9 M 2023-01-04T18:07:51.608 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2023-01-04T18:07:51.608 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2023-01-04T18:07:51.608 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2023-01-04T18:07:51.608 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:51.608 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-01-04T18:07:51.608 INFO:teuthology.orchestra.run.smithi098.stdout:===================================================================================================== 2023-01-04T18:07:51.608 INFO:teuthology.orchestra.run.smithi098.stdout:Install 8 Packages 2023-01-04T18:07:51.609 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:07:51.609 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 37 M 2023-01-04T18:07:51.609 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 210 M 2023-01-04T18:07:51.609 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2023-01-04T18:07:51.834 INFO:teuthology.orchestra.run.smithi098.stdout:(1/8): ceph-mgr-diskprediction-local-16.2.4-0.e 38 MB/s | 8.6 MB 00:00 2023-01-04T18:07:51.925 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:30 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:07:52.303 INFO:teuthology.orchestra.run.smithi098.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 7.0 MB/s | 4.9 MB 00:00 2023-01-04T18:07:52.518 INFO:teuthology.orchestra.run.smithi098.stdout:(3/8): openblas-0.3.15-4.el8.x86_64.rpm 5.2 MB/s | 4.7 MB 00:00 2023-01-04T18:07:52.643 INFO:teuthology.orchestra.run.smithi098.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 663 kB/s | 225 kB 00:00 2023-01-04T18:07:52.761 INFO:teuthology.orchestra.run.smithi098.stdout:(5/8): libgfortran-8.5.0-17.el8.x86_64.rpm 5.3 MB/s | 645 kB 00:00 2023-01-04T18:07:52.803 INFO:teuthology.orchestra.run.smithi098.stdout:(6/8): libquadmath-8.5.0-17.el8.x86_64.rpm 4.0 MB/s | 172 kB 00:00 2023-01-04T18:07:52.864 INFO:teuthology.orchestra.run.smithi098.stdout:(7/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 3.6 MB/s | 3.7 MB 00:01 2023-01-04T18:07:53.121 INFO:teuthology.orchestra.run.smithi098.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 23 MB/s | 14 MB 00:00 2023-01-04T18:07:53.123 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:07:53.124 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:07:53.124 INFO:teuthology.orchestra.run.smithi098.stdout:Total 24 MB/s | 37 MB 00:01 2023-01-04T18:07:53.125 INFO:teuthology.orchestra.run.smithi050.stdout:===================================================================================================== 2023-01-04T18:07:53.125 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-01-04T18:07:53.125 INFO:teuthology.orchestra.run.smithi050.stdout:===================================================================================================== 2023-01-04T18:07:53.125 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-01-04T18:07:53.125 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.4-0.el8 ceph-noarch 8.6 M 2023-01-04T18:07:53.125 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-01-04T18:07:53.125 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran x86_64 8.5.0-17.el8 CentOS-BaseOS 645 k 2023-01-04T18:07:53.125 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath x86_64 8.5.0-17.el8 CentOS-BaseOS 172 k 2023-01-04T18:07:53.125 INFO:teuthology.orchestra.run.smithi050.stdout: openblas x86_64 0.3.15-4.el8 CentOS-AppStream 4.7 M 2023-01-04T18:07:53.126 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-threads x86_64 0.3.15-4.el8 CentOS-AppStream 4.9 M 2023-01-04T18:07:53.126 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2023-01-04T18:07:53.126 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2023-01-04T18:07:53.126 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2023-01-04T18:07:53.126 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:53.126 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-01-04T18:07:53.126 INFO:teuthology.orchestra.run.smithi050.stdout:===================================================================================================== 2023-01-04T18:07:53.126 INFO:teuthology.orchestra.run.smithi050.stdout:Install 8 Packages 2023-01-04T18:07:53.126 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:07:53.127 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 37 M 2023-01-04T18:07:53.127 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 210 M 2023-01-04T18:07:53.127 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-01-04T18:07:53.309 INFO:teuthology.orchestra.run.smithi050.stdout:(1/8): ceph-mgr-diskprediction-local-16.2.4-0.e 47 MB/s | 8.6 MB 00:00 2023-01-04T18:07:53.352 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2023-01-04T18:07:53.370 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2023-01-04T18:07:53.370 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2023-01-04T18:07:53.418 INFO:teuthology.orchestra.run.smithi050.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 17 MB/s | 4.9 MB 00:00 2023-01-04T18:07:53.485 INFO:teuthology.orchestra.run.smithi050.stdout:(3/8): openblas-0.3.15-4.el8.x86_64.rpm 13 MB/s | 4.7 MB 00:00 2023-01-04T18:07:53.510 INFO:teuthology.orchestra.run.smithi050.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 2.4 MB/s | 225 kB 00:00 2023-01-04T18:07:53.560 INFO:teuthology.orchestra.run.smithi050.stdout:(5/8): libgfortran-8.5.0-17.el8.x86_64.rpm 13 MB/s | 645 kB 00:00 2023-01-04T18:07:53.598 INFO:teuthology.orchestra.run.smithi050.stdout:(6/8): libquadmath-8.5.0-17.el8.x86_64.rpm 5.0 MB/s | 172 kB 00:00 2023-01-04T18:07:53.661 INFO:teuthology.orchestra.run.smithi050.stdout:(7/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 11 MB/s | 3.7 MB 00:00 2023-01-04T18:07:53.684 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2023-01-04T18:07:53.688 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2023-01-04T18:07:53.903 INFO:teuthology.orchestra.run.smithi050.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 33 MB/s | 14 MB 00:00 2023-01-04T18:07:53.906 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:07:53.906 INFO:teuthology.orchestra.run.smithi050.stdout:Total 47 MB/s | 37 MB 00:00 2023-01-04T18:07:54.142 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-01-04T18:07:54.161 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-01-04T18:07:54.162 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-01-04T18:07:54.268 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2023-01-04T18:07:54.480 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libquadmath-8.5.0-17.el8.x86_64 1/8 2023-01-04T18:07:54.495 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-01-04T18:07:54.499 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-01-04T18:07:54.624 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libquadmath-8.5.0-17.el8.x86_64 1/8 2023-01-04T18:07:54.805 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libgfortran-8.5.0-17.el8.x86_64 2/8 2023-01-04T18:07:55.074 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-01-04T18:07:55.283 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libquadmath-8.5.0-17.el8.x86_64 1/8 2023-01-04T18:07:55.385 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libgfortran-8.5.0-17.el8.x86_64 2/8 2023-01-04T18:07:55.412 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libquadmath-8.5.0-17.el8.x86_64 1/8 2023-01-04T18:07:55.541 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libgfortran-8.5.0-17.el8.x86_64 2/8 2023-01-04T18:07:55.597 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-01-04T18:07:56.168 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libgfortran-8.5.0-17.el8.x86_64 2/8 2023-01-04T18:07:56.212 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-01-04T18:07:56.341 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-01-04T18:07:56.372 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-04T18:07:56.989 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-01-04T18:07:57.045 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-04T18:07:57.149 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-04T18:07:57.433 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-01-04T18:07:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-04T18:07:57.870 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-04T18:07:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-01-04T18:07:59.066 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-04T18:07:59.416 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-04T18:08:00.797 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-01-04T18:08:00.913 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-04T18:08:01.020 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2023-01-04T18:08:01.351 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2023-01-04T18:08:01.351 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 1/8 2023-01-04T18:08:01.351 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-01-04T18:08:01.352 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-01-04T18:08:01.352 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-01-04T18:08:01.352 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-01-04T18:08:01.352 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-01-04T18:08:01.352 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libgfortran-8.5.0-17.el8.x86_64 7/8 2023-01-04T18:08:01.848 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libquadmath-8.5.0-17.el8.x86_64 8/8 2023-01-04T18:08:01.848 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:01.848 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2023-01-04T18:08:01.848 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 2023-01-04T18:08:01.848 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran-8.5.0-17.el8.x86_64 2023-01-04T18:08:01.849 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath-8.5.0-17.el8.x86_64 2023-01-04T18:08:01.849 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-0.3.15-4.el8.x86_64 2023-01-04T18:08:01.849 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-01-04T18:08:01.849 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-01-04T18:08:01.849 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-01-04T18:08:01.849 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-01-04T18:08:01.849 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:01.849 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:08:01.984 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-rook 2023-01-04T18:08:02.309 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-01-04T18:08:02.523 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2023-01-04T18:08:02.642 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:42 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:08:02.834 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2023-01-04T18:08:02.834 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 1/8 2023-01-04T18:08:02.834 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-01-04T18:08:02.834 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-01-04T18:08:02.834 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-01-04T18:08:02.835 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-01-04T18:08:02.835 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-01-04T18:08:02.835 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgfortran-8.5.0-17.el8.x86_64 7/8 2023-01-04T18:08:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libquadmath-8.5.0-17.el8.x86_64 8/8 2023-01-04T18:08:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:03.338 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-01-04T18:08:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 2023-01-04T18:08:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran-8.5.0-17.el8.x86_64 2023-01-04T18:08:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath-8.5.0-17.el8.x86_64 2023-01-04T18:08:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-0.3.15-4.el8.x86_64 2023-01-04T18:08:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-01-04T18:08:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-01-04T18:08:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-01-04T18:08:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-01-04T18:08:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:03.339 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:08:03.482 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr-rook 2023-01-04T18:08:03.763 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:08:03.765 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:03.765 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2023-01-04T18:08:03.765 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:03.765 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2023-01-04T18:08:03.765 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook noarch 2:16.2.4-0.el8 ceph-noarch 27 k 2023-01-04T18:08:03.766 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2023-01-04T18:08:03.766 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-01-04T18:08:03.766 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-01-04T18:08:03.766 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-01-04T18:08:03.766 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2023-01-04T18:08:03.766 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2023-01-04T18:08:03.766 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-01-04T18:08:03.766 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2023-01-04T18:08:03.766 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2023-01-04T18:08:03.766 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2023-01-04T18:08:03.767 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2023-01-04T18:08:03.767 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-01-04T18:08:03.767 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-01-04T18:08:03.767 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:03.767 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-01-04T18:08:03.767 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:03.767 INFO:teuthology.orchestra.run.smithi098.stdout:Install 13 Packages 2023-01-04T18:08:03.767 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:03.768 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 1.9 M 2023-01-04T18:08:03.768 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 24 M 2023-01-04T18:08:03.768 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2023-01-04T18:08:03.816 INFO:teuthology.orchestra.run.smithi098.stdout:(1/13): ceph-mgr-rook-16.2.4-0.el8.noarch.rpm 572 kB/s | 27 kB 00:00 2023-01-04T18:08:03.843 INFO:teuthology.orchestra.run.smithi098.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 368 kB/s | 27 kB 00:00 2023-01-04T18:08:03.883 INFO:teuthology.orchestra.run.smithi098.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 174 kB/s | 20 kB 00:00 2023-01-04T18:08:03.917 INFO:teuthology.orchestra.run.smithi098.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 1.4 MB/s | 110 kB 00:00 2023-01-04T18:08:03.934 INFO:teuthology.orchestra.run.smithi098.stdout:(5/13): python3-requests-oauthlib-1.0.0-1.el8.n 2.5 MB/s | 43 kB 00:00 2023-01-04T18:08:03.959 INFO:teuthology.orchestra.run.smithi098.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 2.0 MB/s | 155 kB 00:00 2023-01-04T18:08:04.143 INFO:teuthology.orchestra.run.smithi098.stdout:(7/13): python3-cachetools-3.1.1-4.el8.noarch.r 158 kB/s | 33 kB 00:00 2023-01-04T18:08:04.163 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:43 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:08:04.193 INFO:teuthology.orchestra.run.smithi098.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 70 kB/s | 16 kB 00:00 2023-01-04T18:08:04.226 INFO:teuthology.orchestra.run.smithi098.stdout:(9/13): python3-google-auth-1.1.1-10.el8.noarch 970 kB/s | 81 kB 00:00 2023-01-04T18:08:04.286 INFO:teuthology.orchestra.run.smithi098.stdout:(10/13): python3-rsa-4.8-1.el8.noarch.rpm 1.0 MB/s | 61 kB 00:00 2023-01-04T18:08:04.327 INFO:teuthology.orchestra.run.smithi098.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 1.4 MB/s | 61 kB 00:00 2023-01-04T18:08:04.433 INFO:teuthology.orchestra.run.smithi098.stdout:(12/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 205 kB/s | 126 kB 00:00 2023-01-04T18:08:04.619 INFO:teuthology.orchestra.run.smithi098.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 2.7 MB/s | 1.2 MB 00:00 2023-01-04T18:08:04.622 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:08:04.622 INFO:teuthology.orchestra.run.smithi098.stdout:Total 2.2 MB/s | 1.9 MB 00:00 2023-01-04T18:08:04.674 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2023-01-04T18:08:04.689 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2023-01-04T18:08:04.695 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2023-01-04T18:08:04.780 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2023-01-04T18:08:04.784 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2023-01-04T18:08:05.343 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2023-01-04T18:08:05.356 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:08:05.358 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:05.358 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-01-04T18:08:05.358 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:05.358 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-01-04T18:08:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook noarch 2:16.2.4-0.el8 ceph-noarch 27 k 2023-01-04T18:08:05.359 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-01-04T18:08:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-01-04T18:08:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-01-04T18:08:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-01-04T18:08:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2023-01-04T18:08:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2023-01-04T18:08:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-01-04T18:08:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2023-01-04T18:08:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2023-01-04T18:08:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2023-01-04T18:08:05.359 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2023-01-04T18:08:05.360 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-01-04T18:08:05.360 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-01-04T18:08:05.360 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:05.360 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-01-04T18:08:05.360 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:05.360 INFO:teuthology.orchestra.run.smithi050.stdout:Install 13 Packages 2023-01-04T18:08:05.360 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:05.361 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 1.9 M 2023-01-04T18:08:05.361 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 24 M 2023-01-04T18:08:05.361 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-01-04T18:08:05.430 INFO:teuthology.orchestra.run.smithi050.stdout:(1/13): ceph-mgr-rook-16.2.4-0.el8.noarch.rpm 395 kB/s | 27 kB 00:00 2023-01-04T18:08:05.462 INFO:teuthology.orchestra.run.smithi050.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 266 kB/s | 27 kB 00:00 2023-01-04T18:08:05.487 INFO:teuthology.orchestra.run.smithi050.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 159 kB/s | 20 kB 00:00 2023-01-04T18:08:05.529 INFO:teuthology.orchestra.run.smithi050.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 2.6 MB/s | 110 kB 00:00 2023-01-04T18:08:05.555 INFO:teuthology.orchestra.run.smithi050.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 2.3 MB/s | 155 kB 00:00 2023-01-04T18:08:05.605 INFO:teuthology.orchestra.run.smithi050.stdout:(6/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 729 kB/s | 126 kB 00:00 2023-01-04T18:08:05.630 INFO:teuthology.orchestra.run.smithi050.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 424 kB/s | 43 kB 00:00 2023-01-04T18:08:05.681 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-01-04T18:08:05.714 INFO:teuthology.orchestra.run.smithi050.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 207 kB/s | 33 kB 00:00 2023-01-04T18:08:05.739 INFO:teuthology.orchestra.run.smithi050.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 122 kB/s | 16 kB 00:00 2023-01-04T18:08:05.764 INFO:teuthology.orchestra.run.smithi050.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 607 kB/s | 81 kB 00:00 2023-01-04T18:08:05.815 INFO:teuthology.orchestra.run.smithi050.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 1.2 MB/s | 61 kB 00:00 2023-01-04T18:08:05.840 INFO:teuthology.orchestra.run.smithi050.stdout:(12/13): python3-rsa-4.8-1.el8.noarch.rpm 613 kB/s | 61 kB 00:00 2023-01-04T18:08:05.904 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-01-04T18:08:06.082 INFO:teuthology.orchestra.run.smithi050.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 3.2 MB/s | 1.2 MB 00:00 2023-01-04T18:08:06.084 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:08:06.084 INFO:teuthology.orchestra.run.smithi050.stdout:Total 2.6 MB/s | 1.9 MB 00:00 2023-01-04T18:08:06.136 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-01-04T18:08:06.152 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-01-04T18:08:06.152 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-01-04T18:08:06.231 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rsa-4.8-1.el8.noarch 3/13 2023-01-04T18:08:06.249 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-01-04T18:08:06.253 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-01-04T18:08:06.535 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-01-04T18:08:06.754 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-01-04T18:08:06.792 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-01-04T18:08:07.019 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-01-04T18:08:07.055 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-01-04T18:08:07.242 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-01-04T18:08:07.406 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-01-04T18:08:07.501 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rsa-4.8-1.el8.noarch 3/13 2023-01-04T18:08:07.657 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-01-04T18:08:07.797 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-01-04T18:08:08.029 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-01-04T18:08:08.253 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-01-04T18:08:08.554 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-01-04T18:08:08.716 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-01-04T18:08:08.769 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-01-04T18:08:09.035 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-01-04T18:08:09.719 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-01-04T18:08:09.847 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-01-04T18:08:09.936 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-01-04T18:08:10.120 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2023-01-04T18:08:10.246 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-01-04T18:08:10.404 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2023-01-04T18:08:10.404 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-rook-2:16.2.4-0.el8.noarch 1/13 2023-01-04T18:08:10.404 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-01-04T18:08:10.404 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-01-04T18:08:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-01-04T18:08:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-01-04T18:08:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-01-04T18:08:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-01-04T18:08:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-01-04T18:08:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-01-04T18:08:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-01-04T18:08:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-01-04T18:08:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 12/13 2023-01-04T18:08:10.438 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-01-04T18:08:10.622 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-01-04T18:08:10.781 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2023-01-04T18:08:10.988 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-01-04T18:08:10.988 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:10.988 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2023-01-04T18:08:10.988 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook-2:16.2.4-0.el8.noarch 2023-01-04T18:08:10.988 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-01-04T18:08:10.988 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-01-04T18:08:10.988 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-01-04T18:08:10.988 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-01-04T18:08:10.988 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-01-04T18:08:10.988 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-01-04T18:08:10.989 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-01-04T18:08:10.989 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-01-04T18:08:10.989 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-01-04T18:08:10.989 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-01-04T18:08:10.989 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa-4.8-1.el8.noarch 2023-01-04T18:08:10.989 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-01-04T18:08:10.989 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:10.989 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:08:11.074 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2023-01-04T18:08:11.074 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-rook-2:16.2.4-0.el8.noarch 1/13 2023-01-04T18:08:11.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-01-04T18:08:11.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-01-04T18:08:11.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-01-04T18:08:11.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-01-04T18:08:11.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-01-04T18:08:11.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-01-04T18:08:11.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-01-04T18:08:11.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-01-04T18:08:11.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-01-04T18:08:11.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-01-04T18:08:11.075 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 12/13 2023-01-04T18:08:11.153 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-cephadm 2023-01-04T18:08:11.658 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-01-04T18:08:11.658 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:11.659 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-01-04T18:08:11.659 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook-2:16.2.4-0.el8.noarch 2023-01-04T18:08:11.659 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-01-04T18:08:11.659 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-01-04T18:08:11.659 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-01-04T18:08:11.659 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-01-04T18:08:11.659 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-01-04T18:08:11.659 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-01-04T18:08:11.659 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-01-04T18:08:11.659 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-01-04T18:08:11.659 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-01-04T18:08:11.660 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-01-04T18:08:11.660 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa-4.8-1.el8.noarch 2023-01-04T18:08:11.660 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-01-04T18:08:11.660 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:11.660 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:08:11.806 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:51 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:08:11.808 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr-cephadm 2023-01-04T18:08:12.497 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:51 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:08:12.925 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:08:12.926 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:12.926 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2023-01-04T18:08:12.926 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:12.926 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2023-01-04T18:08:12.926 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm noarch 2:16.2.4-0.el8 ceph-noarch 89 k 2023-01-04T18:08:12.926 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2023-01-04T18:08:12.926 INFO:teuthology.orchestra.run.smithi098.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-01-04T18:08:12.926 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2023-01-04T18:08:12.926 INFO:teuthology.orchestra.run.smithi098.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-01-04T18:08:12.926 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2023-01-04T18:08:12.927 INFO:teuthology.orchestra.run.smithi098.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-01-04T18:08:12.927 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:12.927 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-01-04T18:08:12.927 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:12.927 INFO:teuthology.orchestra.run.smithi098.stdout:Install 6 Packages 2023-01-04T18:08:12.927 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:12.928 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 5.8 M 2023-01-04T18:08:12.928 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 24 M 2023-01-04T18:08:12.928 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2023-01-04T18:08:12.976 INFO:teuthology.orchestra.run.smithi098.stdout:(1/6): ceph-mgr-cephadm-16.2.4-0.el8.noarch.rpm 1.8 MB/s | 89 kB 00:00 2023-01-04T18:08:13.018 INFO:teuthology.orchestra.run.smithi098.stdout:(2/6): python3-jinja2-2.10.1-3.el8.noarch.rpm 5.9 MB/s | 538 kB 00:00 2023-01-04T18:08:13.152 INFO:teuthology.orchestra.run.smithi098.stdout:(3/6): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2023-01-04T18:08:13.169 INFO:teuthology.orchestra.run.smithi098.stdout:(4/6): python3-apipkg-1.5-6.el8.noarch.rpm 111 kB/s | 21 kB 00:00 2023-01-04T18:08:13.227 INFO:teuthology.orchestra.run.smithi098.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 650 kB/s | 49 kB 00:00 2023-01-04T18:08:13.294 INFO:teuthology.orchestra.run.smithi098.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 1.3 MB/s | 355 kB 00:00 2023-01-04T18:08:13.296 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:08:13.296 INFO:teuthology.orchestra.run.smithi098.stdout:Total 16 MB/s | 5.8 MB 00:00 2023-01-04T18:08:13.346 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2023-01-04T18:08:13.356 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2023-01-04T18:08:13.356 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2023-01-04T18:08:13.455 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2023-01-04T18:08:13.458 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2023-01-04T18:08:13.693 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:08:13.694 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:13.694 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-01-04T18:08:13.694 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:13.694 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-01-04T18:08:13.694 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm noarch 2:16.2.4-0.el8 ceph-noarch 89 k 2023-01-04T18:08:13.694 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-01-04T18:08:13.694 INFO:teuthology.orchestra.run.smithi050.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-01-04T18:08:13.695 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2023-01-04T18:08:13.695 INFO:teuthology.orchestra.run.smithi050.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-01-04T18:08:13.695 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2023-01-04T18:08:13.695 INFO:teuthology.orchestra.run.smithi050.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-01-04T18:08:13.695 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:13.695 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-01-04T18:08:13.695 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:13.695 INFO:teuthology.orchestra.run.smithi050.stdout:Install 6 Packages 2023-01-04T18:08:13.695 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:13.696 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 5.8 M 2023-01-04T18:08:13.696 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 24 M 2023-01-04T18:08:13.696 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-01-04T18:08:13.740 INFO:teuthology.orchestra.run.smithi050.stdout:(1/6): ceph-mgr-cephadm-16.2.4-0.el8.noarch.rpm 2.0 MB/s | 89 kB 00:00 2023-01-04T18:08:13.781 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2023-01-04T18:08:13.782 INFO:teuthology.orchestra.run.smithi050.stdout:(2/6): python3-jinja2-2.10.1-3.el8.noarch.rpm 6.2 MB/s | 538 kB 00:00 2023-01-04T18:08:13.899 INFO:teuthology.orchestra.run.smithi050.stdout:(3/6): python3-babel-2.5.1-7.el8.noarch.rpm 24 MB/s | 4.8 MB 00:00 2023-01-04T18:08:13.916 INFO:teuthology.orchestra.run.smithi050.stdout:(4/6): python3-apipkg-1.5-6.el8.noarch.rpm 122 kB/s | 21 kB 00:00 2023-01-04T18:08:14.016 INFO:teuthology.orchestra.run.smithi050.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 418 kB/s | 49 kB 00:00 2023-01-04T18:08:14.049 INFO:teuthology.orchestra.run.smithi050.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 1.3 MB/s | 355 kB 00:00 2023-01-04T18:08:14.051 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:08:14.051 INFO:teuthology.orchestra.run.smithi050.stdout:Total 16 MB/s | 5.8 MB 00:00 2023-01-04T18:08:14.075 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2023-01-04T18:08:14.104 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-01-04T18:08:14.114 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-01-04T18:08:14.114 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-01-04T18:08:14.218 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-01-04T18:08:14.222 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-01-04T18:08:14.421 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2023-01-04T18:08:14.512 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-01-04T18:08:14.786 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2023-01-04T18:08:15.069 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2023-01-04T18:08:15.377 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2023-01-04T18:08:15.780 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2023-01-04T18:08:16.065 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2023-01-04T18:08:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 5/6 2023-01-04T18:08:16.293 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2023-01-04T18:08:16.460 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2023-01-04T18:08:16.561 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2023-01-04T18:08:16.561 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 1/6 2023-01-04T18:08:16.562 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2023-01-04T18:08:16.562 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/6 2023-01-04T18:08:16.562 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2023-01-04T18:08:16.562 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2023-01-04T18:08:16.720 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 5/6 2023-01-04T18:08:16.896 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2023-01-04T18:08:17.064 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2023-01-04T18:08:17.064 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:17.064 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2023-01-04T18:08:17.064 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch python3-apipkg-1.5-6.el8.noarch 2023-01-04T18:08:17.064 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel-2.5.1-7.el8.noarch python3-execnet-1.7.1-1.el8.noarch 2023-01-04T18:08:17.064 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2-2.10.1-3.el8.noarch python3-remoto-1.2.1-1.el8.noarch 2023-01-04T18:08:17.065 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:17.065 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:08:17.167 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-fuse 2023-01-04T18:08:17.178 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2023-01-04T18:08:17.178 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 1/6 2023-01-04T18:08:17.178 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2023-01-04T18:08:17.178 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/6 2023-01-04T18:08:17.179 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2023-01-04T18:08:17.179 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2023-01-04T18:08:17.688 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2023-01-04T18:08:17.688 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:17.688 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-01-04T18:08:17.688 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch python3-apipkg-1.5-6.el8.noarch 2023-01-04T18:08:17.689 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel-2.5.1-7.el8.noarch python3-execnet-1.7.1-1.el8.noarch 2023-01-04T18:08:17.689 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2-2.10.1-3.el8.noarch python3-remoto-1.2.1-1.el8.noarch 2023-01-04T18:08:17.689 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:17.689 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:08:17.810 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:57 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:08:17.813 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-fuse 2023-01-04T18:08:18.497 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:57 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:08:18.911 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:08:18.912 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2023-01-04T18:08:18.912 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:18.912 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2023-01-04T18:08:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse x86_64 2:16.2.4-0.el8 ceph 885 k 2023-01-04T18:08:18.912 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2023-01-04T18:08:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2023-01-04T18:08:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:18.912 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-01-04T18:08:18.912 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:18.913 INFO:teuthology.orchestra.run.smithi098.stdout:Install 2 Packages 2023-01-04T18:08:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:18.913 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 968 k 2023-01-04T18:08:18.913 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 3.2 M 2023-01-04T18:08:18.913 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2023-01-04T18:08:18.978 INFO:teuthology.orchestra.run.smithi098.stdout:(1/2): ceph-fuse-16.2.4-0.el8.x86_64.rpm 13 MB/s | 885 kB 00:00 2023-01-04T18:08:19.003 INFO:teuthology.orchestra.run.smithi098.stdout:(2/2): fuse-2.9.7-16.el8.x86_64.rpm 926 kB/s | 83 kB 00:00 2023-01-04T18:08:19.004 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:08:19.004 INFO:teuthology.orchestra.run.smithi098.stdout:Total 10 MB/s | 968 kB 00:00 2023-01-04T18:08:19.014 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2023-01-04T18:08:19.033 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2023-01-04T18:08:19.033 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2023-01-04T18:08:19.119 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2023-01-04T18:08:19.122 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2023-01-04T18:08:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2023-01-04T18:08:19.627 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : fuse-2.9.7-16.el8.x86_64 1/2 2023-01-04T18:08:19.687 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:08:19.688 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:19.688 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2023-01-04T18:08:19.688 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:19.688 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-01-04T18:08:19.688 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse x86_64 2:16.2.4-0.el8 ceph 885 k 2023-01-04T18:08:19.688 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-01-04T18:08:19.689 INFO:teuthology.orchestra.run.smithi050.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2023-01-04T18:08:19.689 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:19.689 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-01-04T18:08:19.689 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:19.689 INFO:teuthology.orchestra.run.smithi050.stdout:Install 2 Packages 2023-01-04T18:08:19.689 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:19.690 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 968 k 2023-01-04T18:08:19.690 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 3.2 M 2023-01-04T18:08:19.690 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-01-04T18:08:19.741 INFO:teuthology.orchestra.run.smithi050.stdout:(1/2): ceph-fuse-16.2.4-0.el8.x86_64.rpm 17 MB/s | 885 kB 00:00 2023-01-04T18:08:19.766 INFO:teuthology.orchestra.run.smithi050.stdout:(2/2): fuse-2.9.7-16.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-01-04T18:08:19.767 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:08:19.767 INFO:teuthology.orchestra.run.smithi050.stdout:Total 12 MB/s | 968 kB 00:00 2023-01-04T18:08:19.777 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-01-04T18:08:19.799 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-01-04T18:08:19.799 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-01-04T18:08:19.866 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2023-01-04T18:08:19.893 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-01-04T18:08:19.896 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-01-04T18:08:20.078 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-01-04T18:08:20.278 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2023-01-04T18:08:20.278 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-fuse-2:16.2.4-0.el8.x86_64 1/2 2023-01-04T18:08:20.377 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fuse-2.9.7-16.el8.x86_64 1/2 2023-01-04T18:08:20.662 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2023-01-04T18:08:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 2/2 2023-01-04T18:08:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:20.755 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2023-01-04T18:08:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse-2:16.2.4-0.el8.x86_64 fuse-2.9.7-16.el8.x86_64 2023-01-04T18:08:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:20.755 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:08:20.964 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install librados-devel 2023-01-04T18:08:21.053 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2023-01-04T18:08:21.053 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:16.2.4-0.el8.x86_64 1/2 2023-01-04T18:08:21.600 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 2/2 2023-01-04T18:08:21.600 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:21.600 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-01-04T18:08:21.600 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse-2:16.2.4-0.el8.x86_64 fuse-2.9.7-16.el8.x86_64 2023-01-04T18:08:21.600 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:21.600 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:08:21.630 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:01 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:08:21.842 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install librados-devel 2023-01-04T18:08:22.534 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:01 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:08:22.742 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:08:22.743 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:22.743 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2023-01-04T18:08:22.743 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:22.743 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2023-01-04T18:08:22.743 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel x86_64 2:16.2.4-0.el8 ceph 131 k 2023-01-04T18:08:22.743 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:22.744 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-01-04T18:08:22.744 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:22.744 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2023-01-04T18:08:22.744 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:22.744 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 131 k 2023-01-04T18:08:22.744 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 439 k 2023-01-04T18:08:22.745 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2023-01-04T18:08:22.810 INFO:teuthology.orchestra.run.smithi098.stdout:librados-devel-16.2.4-0.el8.x86_64.rpm 1.9 MB/s | 131 kB 00:00 2023-01-04T18:08:22.811 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:08:22.811 INFO:teuthology.orchestra.run.smithi098.stdout:Total 1.9 MB/s | 131 kB 00:00 2023-01-04T18:08:22.811 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2023-01-04T18:08:22.816 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2023-01-04T18:08:22.816 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2023-01-04T18:08:22.868 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2023-01-04T18:08:22.872 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2023-01-04T18:08:22.989 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2023-01-04T18:08:23.256 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:23.541 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados-devel-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:23.722 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:08:23.723 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:23.723 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2023-01-04T18:08:23.723 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:23.723 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-01-04T18:08:23.723 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel x86_64 2:16.2.4-0.el8 ceph 131 k 2023-01-04T18:08:23.723 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:23.723 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-01-04T18:08:23.723 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:23.723 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-01-04T18:08:23.723 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:23.724 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 131 k 2023-01-04T18:08:23.724 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 439 k 2023-01-04T18:08:23.724 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-01-04T18:08:23.772 INFO:teuthology.orchestra.run.smithi050.stdout:librados-devel-16.2.4-0.el8.x86_64.rpm 2.7 MB/s | 131 kB 00:00 2023-01-04T18:08:23.773 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:08:23.773 INFO:teuthology.orchestra.run.smithi050.stdout:Total 2.6 MB/s | 131 kB 00:00 2023-01-04T18:08:23.773 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-01-04T18:08:23.778 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-01-04T18:08:23.778 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-01-04T18:08:23.834 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-01-04T18:08:23.838 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-01-04T18:08:23.959 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-01-04T18:08:24.034 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:24.034 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:24.034 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2023-01-04T18:08:24.034 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel-2:16.2.4-0.el8.x86_64 2023-01-04T18:08:24.034 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:24.034 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:08:24.193 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:24.273 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install libcephfs2 2023-01-04T18:08:24.457 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados-devel-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:24.923 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:24.923 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:24.923 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-01-04T18:08:24.923 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel-2:16.2.4-0.el8.x86_64 2023-01-04T18:08:24.923 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:24.923 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:08:24.928 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:04 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:08:25.138 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install libcephfs2 2023-01-04T18:08:25.821 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:04 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:08:25.942 INFO:teuthology.orchestra.run.smithi098.stdout:Package libcephfs2-2:16.2.4-0.el8.x86_64 is already installed. 2023-01-04T18:08:26.041 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:08:26.042 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2023-01-04T18:08:26.042 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:08:26.621 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install libcephfs-devel 2023-01-04T18:08:26.908 INFO:teuthology.orchestra.run.smithi050.stdout:Package libcephfs2-2:16.2.4-0.el8.x86_64 is already installed. 2023-01-04T18:08:27.016 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:08:27.018 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-01-04T18:08:27.018 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:08:27.119 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install libcephfs-devel 2023-01-04T18:08:27.270 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:07 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:08:27.805 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:06 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:08:28.400 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:08:28.401 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:28.401 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2023-01-04T18:08:28.402 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:28.402 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2023-01-04T18:08:28.402 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel x86_64 2:16.2.4-0.el8 ceph 24 k 2023-01-04T18:08:28.402 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:28.402 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-01-04T18:08:28.402 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:28.403 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2023-01-04T18:08:28.403 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:28.403 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 24 k 2023-01-04T18:08:28.403 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 94 k 2023-01-04T18:08:28.403 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2023-01-04T18:08:28.449 INFO:teuthology.orchestra.run.smithi098.stdout:libcephfs-devel-16.2.4-0.el8.x86_64.rpm 520 kB/s | 24 kB 00:00 2023-01-04T18:08:28.449 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:08:28.449 INFO:teuthology.orchestra.run.smithi098.stdout:Total 507 kB/s | 24 kB 00:00 2023-01-04T18:08:28.450 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2023-01-04T18:08:28.453 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2023-01-04T18:08:28.453 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2023-01-04T18:08:28.455 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2023-01-04T18:08:28.458 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2023-01-04T18:08:28.537 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2023-01-04T18:08:28.714 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:28.965 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:29.018 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:08:29.018 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:29.018 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2023-01-04T18:08:29.018 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:29.019 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-01-04T18:08:29.019 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel x86_64 2:16.2.4-0.el8 ceph 24 k 2023-01-04T18:08:29.019 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:29.019 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-01-04T18:08:29.019 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:29.019 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-01-04T18:08:29.019 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:29.020 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 24 k 2023-01-04T18:08:29.020 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 94 k 2023-01-04T18:08:29.020 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-01-04T18:08:29.183 INFO:teuthology.orchestra.run.smithi050.stdout:libcephfs-devel-16.2.4-0.el8.x86_64.rpm 149 kB/s | 24 kB 00:00 2023-01-04T18:08:29.183 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:08:29.184 INFO:teuthology.orchestra.run.smithi050.stdout:Total 148 kB/s | 24 kB 00:00 2023-01-04T18:08:29.184 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-01-04T18:08:29.187 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-01-04T18:08:29.188 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-01-04T18:08:29.190 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-01-04T18:08:29.194 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-01-04T18:08:29.245 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-01-04T18:08:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:29.452 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2023-01-04T18:08:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel-2:16.2.4-0.el8.x86_64 2023-01-04T18:08:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:29.452 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:08:29.468 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:29.582 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install librados2 2023-01-04T18:08:29.720 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:30.174 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:30.174 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:30.174 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-01-04T18:08:30.174 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel-2:16.2.4-0.el8.x86_64 2023-01-04T18:08:30.175 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:30.175 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:08:30.228 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:10 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:08:30.337 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install librados2 2023-01-04T18:08:31.018 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:10 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:08:31.244 INFO:teuthology.orchestra.run.smithi098.stdout:Package librados2-2:16.2.4-0.el8.x86_64 is already installed. 2023-01-04T18:08:31.343 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:08:31.343 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2023-01-04T18:08:31.344 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:08:31.436 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install librbd1 2023-01-04T18:08:32.084 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:12 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:08:32.104 INFO:teuthology.orchestra.run.smithi050.stdout:Package librados2-2:16.2.4-0.el8.x86_64 is already installed. 2023-01-04T18:08:32.214 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:08:32.216 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-01-04T18:08:32.216 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:08:32.321 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install librbd1 2023-01-04T18:08:33.001 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:11 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:08:33.090 INFO:teuthology.orchestra.run.smithi098.stdout:Package librbd1-2:16.2.4-0.el8.x86_64 is already installed. 2023-01-04T18:08:33.191 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:08:33.192 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2023-01-04T18:08:33.192 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:08:33.287 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-rados 2023-01-04T18:08:33.934 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:13 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:08:34.087 INFO:teuthology.orchestra.run.smithi050.stdout:Package librbd1-2:16.2.4-0.el8.x86_64 is already installed. 2023-01-04T18:08:34.197 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:08:34.199 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-01-04T18:08:34.199 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:08:34.299 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-rados 2023-01-04T18:08:34.960 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-rados-2:16.2.4-0.el8.x86_64 is already installed. 2023-01-04T18:08:34.980 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:13 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:08:35.059 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:08:35.060 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2023-01-04T18:08:35.060 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:08:35.145 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-rgw 2023-01-04T18:08:35.803 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:15 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:08:36.076 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-rados-2:16.2.4-0.el8.x86_64 is already installed. 2023-01-04T18:08:36.187 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:08:36.188 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-01-04T18:08:36.188 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:08:36.293 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-rgw 2023-01-04T18:08:36.813 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-rgw-2:16.2.4-0.el8.x86_64 is already installed. 2023-01-04T18:08:36.912 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:08:36.913 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2023-01-04T18:08:36.913 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:08:36.972 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:15 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:08:36.999 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-cephfs 2023-01-04T18:08:37.649 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:17 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:08:38.055 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-rgw-2:16.2.4-0.el8.x86_64 is already installed. 2023-01-04T18:08:38.166 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:08:38.167 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-01-04T18:08:38.167 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:08:38.269 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-cephfs 2023-01-04T18:08:38.667 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-cephfs-2:16.2.4-0.el8.x86_64 is already installed. 2023-01-04T18:08:38.765 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:08:38.766 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2023-01-04T18:08:38.766 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:08:38.850 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-rbd 2023-01-04T18:08:38.954 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:17 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:08:39.498 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:19 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:08:40.051 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-cephfs-2:16.2.4-0.el8.x86_64 is already installed. 2023-01-04T18:08:40.161 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:08:40.163 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-01-04T18:08:40.163 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:08:40.273 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-rbd 2023-01-04T18:08:40.498 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-rbd-2:16.2.4-0.el8.x86_64 is already installed. 2023-01-04T18:08:40.599 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:08:40.600 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2023-01-04T18:08:40.600 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:08:40.691 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install rbd-fuse 2023-01-04T18:08:40.954 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:19 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:08:41.340 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:21 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:08:42.033 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-rbd-2:16.2.4-0.el8.x86_64 is already installed. 2023-01-04T18:08:42.145 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:08:42.146 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-01-04T18:08:42.146 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:08:42.247 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install rbd-fuse 2023-01-04T18:08:42.458 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:08:42.459 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:42.459 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2023-01-04T18:08:42.459 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:42.459 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2023-01-04T18:08:42.460 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse x86_64 2:16.2.4-0.el8 ceph 89 k 2023-01-04T18:08:42.460 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:42.460 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-01-04T18:08:42.460 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:42.460 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2023-01-04T18:08:42.460 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:42.461 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 89 k 2023-01-04T18:08:42.461 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 298 k 2023-01-04T18:08:42.461 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2023-01-04T18:08:42.514 INFO:teuthology.orchestra.run.smithi098.stdout:rbd-fuse-16.2.4-0.el8.x86_64.rpm 1.6 MB/s | 89 kB 00:00 2023-01-04T18:08:42.515 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:08:42.515 INFO:teuthology.orchestra.run.smithi098.stdout:Total 1.6 MB/s | 89 kB 00:00 2023-01-04T18:08:42.515 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2023-01-04T18:08:42.524 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2023-01-04T18:08:42.524 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2023-01-04T18:08:42.575 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2023-01-04T18:08:42.579 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2023-01-04T18:08:42.705 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2023-01-04T18:08:42.928 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:42.936 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:21 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:08:43.300 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:43.805 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:43.805 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:43.805 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2023-01-04T18:08:43.805 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse-2:16.2.4-0.el8.x86_64 2023-01-04T18:08:43.805 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:43.805 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:08:44.000 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install rbd-mirror 2023-01-04T18:08:44.131 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:08:44.132 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:44.132 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2023-01-04T18:08:44.132 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:44.132 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-01-04T18:08:44.132 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse x86_64 2:16.2.4-0.el8 ceph 89 k 2023-01-04T18:08:44.132 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:44.132 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-01-04T18:08:44.132 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:44.133 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-01-04T18:08:44.133 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:44.133 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 89 k 2023-01-04T18:08:44.133 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 298 k 2023-01-04T18:08:44.133 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-01-04T18:08:44.183 INFO:teuthology.orchestra.run.smithi050.stdout:rbd-fuse-16.2.4-0.el8.x86_64.rpm 1.7 MB/s | 89 kB 00:00 2023-01-04T18:08:44.184 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:08:44.184 INFO:teuthology.orchestra.run.smithi050.stdout:Total 1.7 MB/s | 89 kB 00:00 2023-01-04T18:08:44.184 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-01-04T18:08:44.195 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-01-04T18:08:44.195 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-01-04T18:08:44.250 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-01-04T18:08:44.254 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-01-04T18:08:44.378 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-01-04T18:08:44.590 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:44.667 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:24 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:08:44.853 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:45.327 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:45.327 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:45.327 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-01-04T18:08:45.327 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse-2:16.2.4-0.el8.x86_64 2023-01-04T18:08:45.327 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:45.327 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:08:45.574 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install rbd-mirror 2023-01-04T18:08:45.785 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:08:45.786 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:45.786 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2023-01-04T18:08:45.786 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:45.787 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2023-01-04T18:08:45.787 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror x86_64 2:16.2.4-0.el8 ceph 3.7 M 2023-01-04T18:08:45.787 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:45.787 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-01-04T18:08:45.787 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:45.787 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2023-01-04T18:08:45.788 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:45.788 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 3.7 M 2023-01-04T18:08:45.788 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 18 M 2023-01-04T18:08:45.788 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2023-01-04T18:08:45.871 INFO:teuthology.orchestra.run.smithi098.stdout:rbd-mirror-16.2.4-0.el8.x86_64.rpm 44 MB/s | 3.7 MB 00:00 2023-01-04T18:08:45.872 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:08:45.872 INFO:teuthology.orchestra.run.smithi098.stdout:Total 43 MB/s | 3.7 MB 00:00 2023-01-04T18:08:45.872 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2023-01-04T18:08:45.883 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2023-01-04T18:08:45.884 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2023-01-04T18:08:45.948 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2023-01-04T18:08:45.951 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2023-01-04T18:08:46.266 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:25 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:08:46.430 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2023-01-04T18:08:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:47.086 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:47.466 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:08:47.466 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:47.466 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2023-01-04T18:08:47.466 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:47.466 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-01-04T18:08:47.467 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror x86_64 2:16.2.4-0.el8 ceph 3.7 M 2023-01-04T18:08:47.467 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:47.467 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-01-04T18:08:47.467 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:47.467 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-01-04T18:08:47.467 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:47.468 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 3.7 M 2023-01-04T18:08:47.468 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 18 M 2023-01-04T18:08:47.468 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-01-04T18:08:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:47.505 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2023-01-04T18:08:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror-2:16.2.4-0.el8.x86_64 2023-01-04T18:08:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:47.506 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:08:47.561 INFO:teuthology.orchestra.run.smithi050.stdout:rbd-mirror-16.2.4-0.el8.x86_64.rpm 40 MB/s | 3.7 MB 00:00 2023-01-04T18:08:47.561 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:08:47.562 INFO:teuthology.orchestra.run.smithi050.stdout:Total 39 MB/s | 3.7 MB 00:00 2023-01-04T18:08:47.562 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-01-04T18:08:47.575 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-01-04T18:08:47.575 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-01-04T18:08:47.646 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-01-04T18:08:47.650 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-01-04T18:08:47.727 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install rbd-nbd 2023-01-04T18:08:48.158 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-01-04T18:08:48.368 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:48.394 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:28 ago on Wed 04 Jan 2023 06:06:20 PM UTC. 2023-01-04T18:08:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:49.260 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:49.260 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:49.260 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-01-04T18:08:49.260 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror-2:16.2.4-0.el8.x86_64 2023-01-04T18:08:49.261 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:49.261 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:08:49.501 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-01-04T18:08:49.501 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:49.501 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2023-01-04T18:08:49.502 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:49.502 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2023-01-04T18:08:49.502 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd x86_64 2:16.2.4-0.el8 ceph 173 k 2023-01-04T18:08:49.502 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:49.502 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-01-04T18:08:49.502 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2023-01-04T18:08:49.502 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2023-01-04T18:08:49.502 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:49.503 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 173 k 2023-01-04T18:08:49.503 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 649 k 2023-01-04T18:08:49.503 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2023-01-04T18:08:49.523 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install rbd-nbd 2023-01-04T18:08:49.552 INFO:teuthology.orchestra.run.smithi098.stdout:rbd-nbd-16.2.4-0.el8.x86_64.rpm 3.5 MB/s | 173 kB 00:00 2023-01-04T18:08:49.552 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:08:49.553 INFO:teuthology.orchestra.run.smithi098.stdout:Total 3.4 MB/s | 173 kB 00:00 2023-01-04T18:08:49.553 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2023-01-04T18:08:49.563 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2023-01-04T18:08:49.564 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2023-01-04T18:08:49.615 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2023-01-04T18:08:49.619 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2023-01-04T18:08:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2023-01-04T18:08:49.961 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:50.216 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:29 ago on Wed 04 Jan 2023 06:06:21 PM UTC. 2023-01-04T18:08:50.264 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:50.793 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:50.794 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:50.794 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2023-01-04T18:08:50.794 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd-2:16.2.4-0.el8.x86_64 2023-01-04T18:08:50.794 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:08:50.794 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-01-04T18:08:51.039 DEBUG:teuthology.parallel:result is None 2023-01-04T18:08:51.429 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-01-04T18:08:51.429 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:51.430 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2023-01-04T18:08:51.430 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:51.430 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-01-04T18:08:51.430 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd x86_64 2:16.2.4-0.el8 ceph 173 k 2023-01-04T18:08:51.430 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:51.430 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-01-04T18:08:51.430 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-01-04T18:08:51.430 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2023-01-04T18:08:51.430 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:51.431 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 173 k 2023-01-04T18:08:51.431 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 649 k 2023-01-04T18:08:51.432 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-01-04T18:08:51.473 INFO:teuthology.orchestra.run.smithi050.stdout:rbd-nbd-16.2.4-0.el8.x86_64.rpm 4.0 MB/s | 173 kB 00:00 2023-01-04T18:08:51.474 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-01-04T18:08:51.474 INFO:teuthology.orchestra.run.smithi050.stdout:Total 3.9 MB/s | 173 kB 00:00 2023-01-04T18:08:51.474 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-01-04T18:08:51.486 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-01-04T18:08:51.486 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-01-04T18:08:51.543 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-01-04T18:08:51.546 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-01-04T18:08:51.670 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-01-04T18:08:51.857 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:52.132 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:52.595 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2023-01-04T18:08:52.596 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:52.596 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-01-04T18:08:52.596 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd-2:16.2.4-0.el8.x86_64 2023-01-04T18:08:52.596 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:08:52.596 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-01-04T18:08:52.830 DEBUG:teuthology.parallel:result is None 2023-01-04T18:08:52.831 DEBUG:teuthology.orchestra.run.smithi050:> sudo lsb_release -is 2023-01-04T18:08:52.869 INFO:teuthology.orchestra.run.smithi050.stdout:CentOSStream 2023-01-04T18:08:52.870 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-04T18:08:52.870 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2023-01-04T18:08:52.871 INFO:teuthology.packaging:ref: None 2023-01-04T18:08:52.871 INFO:teuthology.packaging:tag: v16.2.4 2023-01-04T18:08:52.871 INFO:teuthology.packaging:branch: None 2023-01-04T18:08:52.871 INFO:teuthology.packaging:sha1: f2bb1478686242c0f68882a9cf8df4e0f8363116 2023-01-04T18:08:53.087 DEBUG:teuthology.repo_utils:git ls-remote https://github.com/ceph/ceph-ci v16.2.4^{} -> 3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2023-01-04T18:08:53.087 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2023-01-04T18:08:53.248 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-01-04T18:08:53.271 INFO:teuthology.orchestra.run.smithi050.stdout:16.2.4-0.el8 2023-01-04T18:08:53.272 INFO:teuthology.packaging:The installed version of ceph is 16.2.4-0.el8 2023-01-04T18:08:53.272 INFO:teuthology.task.install:The correct ceph version 16.2.4-0 is installed. 2023-01-04T18:08:53.273 DEBUG:teuthology.orchestra.run.smithi098:> sudo lsb_release -is 2023-01-04T18:08:53.316 INFO:teuthology.orchestra.run.smithi098.stdout:CentOSStream 2023-01-04T18:08:53.318 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-04T18:08:53.318 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2023-01-04T18:08:53.318 INFO:teuthology.packaging:ref: None 2023-01-04T18:08:53.318 INFO:teuthology.packaging:tag: v16.2.4 2023-01-04T18:08:53.318 INFO:teuthology.packaging:branch: None 2023-01-04T18:08:53.318 INFO:teuthology.packaging:sha1: f2bb1478686242c0f68882a9cf8df4e0f8363116 2023-01-04T18:08:53.534 DEBUG:teuthology.repo_utils:git ls-remote https://github.com/ceph/ceph-ci v16.2.4^{} -> 3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2023-01-04T18:08:53.534 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2023-01-04T18:08:53.688 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-01-04T18:08:53.714 INFO:teuthology.orchestra.run.smithi098.stdout:16.2.4-0.el8 2023-01-04T18:08:53.714 INFO:teuthology.packaging:The installed version of ceph is 16.2.4-0.el8 2023-01-04T18:08:53.715 INFO:teuthology.task.install:The correct ceph version 16.2.4-0 is installed. 2023-01-04T18:08:53.715 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-01-04T18:08:53.715 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-01-04T18:08:53.715 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-04T18:08:53.745 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-01-04T18:08:53.746 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-04T18:08:53.785 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-01-04T18:08:53.786 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-01-04T18:08:53.786 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2023-01-04T18:08:53.814 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-04T18:08:53.883 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-01-04T18:08:53.883 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2023-01-04T18:08:53.912 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-04T18:08:53.982 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-01-04T18:08:53.983 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-01-04T18:08:53.983 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-04T18:08:54.011 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-04T18:08:54.080 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-01-04T18:08:54.080 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-04T18:08:54.108 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-04T18:08:54.177 INFO:teuthology.run_tasks:Running task print... 2023-01-04T18:08:54.192 INFO:teuthology.task.print:**** done install task... 2023-01-04T18:08:54.192 INFO:teuthology.run_tasks:Running task cephadm... 2023-01-04T18:08:54.268 INFO:tasks.cephadm:Config: {'avoid_pacific_features': True, 'cephadm_branch': 'v16.2.4', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'docker.io/ceph/ceph:v16.2.4', 'roleless': True, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'f2bb1478686242c0f68882a9cf8df4e0f8363116'} 2023-01-04T18:08:54.268 INFO:tasks.cephadm:Cluster image is docker.io/ceph/ceph:v16.2.4 2023-01-04T18:08:54.276 INFO:tasks.cephadm:Cluster fsid is d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:08:54.277 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-01-04T18:08:54.277 INFO:tasks.cephadm:No mon roles; fabricating mons 2023-01-04T18:08:54.277 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi050': '172.21.15.50', 'mon.smithi098': '172.21.15.98'} 2023-01-04T18:08:54.277 INFO:tasks.cephadm:Normalizing hostnames... 2023-01-04T18:08:54.277 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname $(hostname -s) 2023-01-04T18:08:54.305 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname $(hostname -s) 2023-01-04T18:08:54.335 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v16.2.4)... 2023-01-04T18:08:54.335 DEBUG:teuthology.orchestra.run.smithi050:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v16.2.4/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-01-04T18:08:54.563 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-rw-r--. 1 ubuntu ubuntu 292005 Jan 4 18:08 /home/ubuntu/cephtest/cephadm 2023-01-04T18:08:54.563 DEBUG:teuthology.orchestra.run.smithi098:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v16.2.4/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-01-04T18:08:54.768 INFO:teuthology.orchestra.run.smithi098.stdout:-rw-rw-r--. 1 ubuntu ubuntu 292005 Jan 4 18:08 /home/ubuntu/cephtest/cephadm 2023-01-04T18:08:54.768 DEBUG:teuthology.orchestra.run.smithi050:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-01-04T18:08:54.788 DEBUG:teuthology.orchestra.run.smithi098:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-01-04T18:08:54.827 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph 2023-01-04T18:08:54.856 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph 2023-01-04T18:08:54.884 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /etc/ceph 2023-01-04T18:08:54.924 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /etc/ceph 2023-01-04T18:08:54.953 INFO:tasks.cephadm:Writing seed config... 2023-01-04T18:08:54.954 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-01-04T18:08:54.954 INFO:tasks.cephadm: override: [client] debug client = 20 2023-01-04T18:08:54.954 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-01-04T18:08:54.954 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-01-04T18:08:54.955 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-01-04T18:08:54.955 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2023-01-04T18:08:54.955 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-01-04T18:08:54.955 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-01-04T18:08:54.955 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-01-04T18:08:54.955 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-01-04T18:08:54.955 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-01-04T18:08:54.955 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-01-04T18:08:54.955 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-01-04T18:08:54.955 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-01-04T18:08:54.955 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-01-04T18:08:54.956 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-01-04T18:08:54.956 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-01-04T18:08:54.956 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-01-04T18:08:54.956 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-01-04T18:08:54.956 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-01-04T18:08:54.956 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-01-04T18:08:54.956 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-01-04T18:08:54.956 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-01-04T18:08:54.956 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-01-04T18:08:54.956 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-01-04T18:08:54.956 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-01-04T18:08:54.957 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-01-04T18:08:54.957 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-01-04T18:08:54.957 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-01-04T18:08:54.957 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-01-04T18:08:54.957 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-01-04T18:08:54.957 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-01-04T18:08:54.957 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-01-04T18:08:54.957 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-01-04T18:08:54.957 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-01-04T18:08:54.957 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-01-04T18:08:54.957 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-01-04T18:08:54.958 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-01-04T18:08:54.958 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-01-04T18:08:54.982 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d98671da-8c5a-11ed-821a-001a4aab830c mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-01-04T18:08:54.983 DEBUG:teuthology.orchestra.run.smithi050:mon.smithi050> sudo journalctl -f -n 0 -u ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mon.smithi050.service 2023-01-04T18:08:55.025 INFO:tasks.cephadm:Bootstrapping... 2023-01-04T18:08:55.025 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 -v bootstrap --fsid d98671da-8c5a-11ed-821a-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.50 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-01-04T18:08:55.052 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:-- Logs begin at Wed 2023-01-04 17:48:26 UTC. -- 2023-01-04T18:08:55.280 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2023-01-04T18:08:56.458 INFO:teuthology.orchestra.run.smithi050.stderr:/bin/podman: 4.2.0 2023-01-04T18:08:56.507 INFO:teuthology.orchestra.run.smithi050.stderr:Verifying podman|docker is present... 2023-01-04T18:08:56.507 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2023-01-04T18:08:56.543 INFO:teuthology.orchestra.run.smithi050.stderr:/bin/podman: 4.2.0 2023-01-04T18:08:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:Verifying lvm2 is present... 2023-01-04T18:08:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:Verifying time synchronization is in place... 2023-01-04T18:08:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl is-enabled chrony.service 2023-01-04T18:08:56.663 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2023-01-04T18:08:56.664 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl is-active chrony.service 2023-01-04T18:08:56.670 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: inactive 2023-01-04T18:08:56.671 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl is-enabled chronyd.service 2023-01-04T18:08:56.677 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: enabled 2023-01-04T18:08:56.678 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl is-active chronyd.service 2023-01-04T18:08:56.684 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: active 2023-01-04T18:08:56.685 INFO:teuthology.orchestra.run.smithi050.stderr:Unit chronyd.service is enabled and running 2023-01-04T18:08:56.685 INFO:teuthology.orchestra.run.smithi050.stderr:Repeating the final host check... 2023-01-04T18:08:56.685 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2023-01-04T18:08:56.717 INFO:teuthology.orchestra.run.smithi050.stderr:/bin/podman: 4.2.0 2023-01-04T18:08:56.825 INFO:teuthology.orchestra.run.smithi050.stderr:podman|docker (/bin/podman) is present 2023-01-04T18:08:56.825 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl is present 2023-01-04T18:08:56.825 INFO:teuthology.orchestra.run.smithi050.stderr:lvcreate is present 2023-01-04T18:08:56.825 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl is-enabled chrony.service 2023-01-04T18:08:56.831 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2023-01-04T18:08:56.832 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl is-active chrony.service 2023-01-04T18:08:56.838 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: inactive 2023-01-04T18:08:56.838 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl is-enabled chronyd.service 2023-01-04T18:08:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: enabled 2023-01-04T18:08:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl is-active chronyd.service 2023-01-04T18:08:56.851 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: active 2023-01-04T18:08:56.852 INFO:teuthology.orchestra.run.smithi050.stderr:Unit chronyd.service is enabled and running 2023-01-04T18:08:56.852 INFO:teuthology.orchestra.run.smithi050.stderr:Host looks OK 2023-01-04T18:08:56.852 INFO:teuthology.orchestra.run.smithi050.stderr:Cluster fsid: d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:08:56.852 INFO:teuthology.orchestra.run.smithi050.stderr:Acquiring lock 140226162273640 on /run/cephadm/d98671da-8c5a-11ed-821a-001a4aab830c.lock 2023-01-04T18:08:56.852 INFO:teuthology.orchestra.run.smithi050.stderr:Lock 140226162273640 acquired on /run/cephadm/d98671da-8c5a-11ed-821a-001a4aab830c.lock 2023-01-04T18:08:56.853 INFO:teuthology.orchestra.run.smithi050.stderr:Verifying IP 172.21.15.50 port 3300 ... 2023-01-04T18:08:56.853 INFO:teuthology.orchestra.run.smithi050.stderr:Verifying IP 172.21.15.50 port 6789 ... 2023-01-04T18:08:56.853 INFO:teuthology.orchestra.run.smithi050.stderr:Base mon IP is 172.21.15.50, final addrv is [v2:172.21.15.50:3300,v1:172.21.15.50:6789] 2023-01-04T18:08:56.854 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /sbin/ip route ls 2023-01-04T18:08:56.856 INFO:teuthology.orchestra.run.smithi050.stderr:/sbin/ip: default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.50 metric 100 2023-01-04T18:08:56.857 INFO:teuthology.orchestra.run.smithi050.stderr:/sbin/ip: 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.50 metric 100 2023-01-04T18:08:56.857 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /sbin/ip -6 route ls 2023-01-04T18:08:56.859 INFO:teuthology.orchestra.run.smithi050.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2023-01-04T18:08:56.860 INFO:teuthology.orchestra.run.smithi050.stderr:/sbin/ip: fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-01-04T18:08:56.860 INFO:teuthology.orchestra.run.smithi050.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1734sec hoplimit 64 pref medium 2023-01-04T18:08:56.860 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /sbin/ip -6 addr ls 2023-01-04T18:08:56.862 INFO:teuthology.orchestra.run.smithi050.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-01-04T18:08:56.863 INFO:teuthology.orchestra.run.smithi050.stderr:/sbin/ip: inet6 ::1/128 scope host 2023-01-04T18:08:56.863 INFO:teuthology.orchestra.run.smithi050.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2023-01-04T18:08:56.863 INFO:teuthology.orchestra.run.smithi050.stderr:/sbin/ip: 4: ens1f0: mtu 1500 state UP qlen 1000 2023-01-04T18:08:56.863 INFO:teuthology.orchestra.run.smithi050.stderr:/sbin/ip: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-01-04T18:08:56.863 INFO:teuthology.orchestra.run.smithi050.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2023-01-04T18:08:56.864 INFO:teuthology.orchestra.run.smithi050.stderr:Mon IP 172.21.15.50 is in CIDR network 172.21.0.0/20 2023-01-04T18:08:56.864 INFO:teuthology.orchestra.run.smithi050.stderr:- internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-01-04T18:08:56.865 INFO:teuthology.orchestra.run.smithi050.stderr:Pulling container image docker.io/ceph/ceph:v16.2.4... 2023-01-04T18:08:56.865 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman pull docker.io/ceph/ceph:v16.2.4 2023-01-04T18:08:56.974 INFO:teuthology.orchestra.run.smithi050.stderr:/bin/podman: Trying to pull docker.io/ceph/ceph:v16.2.4... 2023-01-04T18:08:57.230 INFO:teuthology.orchestra.run.smithi050.stderr:/bin/podman: Getting image source signatures 2023-01-04T18:08:57.240 INFO:teuthology.orchestra.run.smithi050.stderr:/bin/podman: Copying blob sha256:551101690791055467b1840be133b2e6b029d263771bc6c46a96bb7acdacac39 2023-01-04T18:08:57.240 INFO:teuthology.orchestra.run.smithi050.stderr:/bin/podman: Copying blob sha256:7a0437f04f83f084b7ed68ad9c4a4947e12fc4e1b006b38129bac89114ec3621 2023-01-04T18:09:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:/bin/podman: Copying config sha256:8d91d370c2b86c07de46146aba8d36718eaefa69b1880c77fa312fda6efd7d29 2023-01-04T18:09:08.845 INFO:teuthology.orchestra.run.smithi050.stderr:/bin/podman: Writing manifest to image destination 2023-01-04T18:09:08.845 INFO:teuthology.orchestra.run.smithi050.stderr:/bin/podman: Storing signatures 2023-01-04T18:09:09.166 INFO:teuthology.orchestra.run.smithi050.stderr:/bin/podman: 8d91d370c2b86c07de46146aba8d36718eaefa69b1880c77fa312fda6efd7d29 2023-01-04T18:09:09.226 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --version 2023-01-04T18:09:09.808 INFO:teuthology.orchestra.run.smithi050.stderr:ceph: ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable) 2023-01-04T18:09:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:Ceph version: ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable) 2023-01-04T18:09:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:Extracting ceph user uid/gid from container image... 2023-01-04T18:09:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint stat --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 -c %u %g /var/lib/ceph 2023-01-04T18:09:10.515 INFO:teuthology.orchestra.run.smithi050.stderr:stat: 167 167 2023-01-04T18:09:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:Creating initial keys... 2023-01-04T18:09:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2023-01-04T18:09:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-authtool: AQDHwLVj7M7GCxAA+PX8vfmztZY0a6fD42o58Q== 2023-01-04T18:09:11.561 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2023-01-04T18:09:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-authtool: AQDHwLVjvfJENxAAVIT88pWU/PqQEE2YUyn8bA== 2023-01-04T18:09:12.606 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2023-01-04T18:09:12.980 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-authtool: AQDIwLVji6/6ORAA6OqqcAWQRZNYJUKdB+MorQ== 2023-01-04T18:09:13.360 INFO:teuthology.orchestra.run.smithi050.stderr:Creating initial monmap... 2023-01-04T18:09:13.360 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/monmaptool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /tmp/ceph-tmpkzibyoxi:/tmp/monmap:z docker.io/ceph/ceph:v16.2.4 --create --clobber --fsid d98671da-8c5a-11ed-821a-001a4aab830c --addv smithi050 [v2:172.21.15.50:3300,v1:172.21.15.50:6789] /tmp/monmap 2023-01-04T18:09:13.704 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2023-01-04T18:09:13.705 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:09:13.705 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-01-04T18:09:14.107 INFO:teuthology.orchestra.run.smithi050.stderr:monmaptool for smithi050 [v2:172.21.15.50:3300,v1:172.21.15.50:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-01-04T18:09:14.108 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/monmaptool: set fsid to d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:09:14.108 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-01-04T18:09:14.108 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-01-04T18:09:14.108 INFO:teuthology.orchestra.run.smithi050.stderr:Creating mon... 2023-01-04T18:09:14.109 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-mon --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050:/var/lib/ceph/mon/ceph-smithi050:z -v /tmp/ceph-tmpwm0k7d0o:/tmp/keyring:z -v /tmp/ceph-tmpkzibyoxi:/tmp/monmap:z docker.io/ceph/ceph:v16.2.4 --mkfs -i smithi050 --fsid d98671da-8c5a-11ed-821a-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2023-01-04T18:09:14.483 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.455+0000 7fa651a3d700 0 set uid:gid to 167:167 (ceph:ceph) 2023-01-04T18:09:14.483 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.455+0000 7fa651a3d700 1 imported monmap: 2023-01-04T18:09:14.483 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: epoch 0 2023-01-04T18:09:14.483 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: fsid d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:09:14.483 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: last_changed 2023-01-04T18:09:13.702416+0000 2023-01-04T18:09:14.483 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: created 2023-01-04T18:09:13.702416+0000 2023-01-04T18:09:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2023-01-04T18:09:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: election_strategy: 1 2023-01-04T18:09:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.smithi050 2023-01-04T18:09:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: 2023-01-04T18:09:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.455+0000 7fa651a3d700 0 /usr/bin/ceph-mon: set fsid to d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:09:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: RocksDB version: 6.8.1 2023-01-04T18:09:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: 2023-01-04T18:09:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-01-04T18:09:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Compile date May 13 2021 2023-01-04T18:09:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: DB SUMMARY 2023-01-04T18:09:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: 2023-01-04T18:09:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi050/store.db dir, Total Num: 0, files: 2023-01-04T18:09:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: 2023-01-04T18:09:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi050/store.db: 2023-01-04T18:09:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: 2023-01-04T18:09:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.error_if_exists: 0 2023-01-04T18:09:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.create_if_missing: 1 2023-01-04T18:09:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.paranoid_checks: 1 2023-01-04T18:09:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.env: 0x55f28855c1c0 2023-01-04T18:09:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.fs: Posix File System 2023-01-04T18:09:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.info_log: 0x55f28acd2ec0 2023-01-04T18:09:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.max_file_opening_threads: 16 2023-01-04T18:09:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.statistics: (nil) 2023-01-04T18:09:14.486 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.use_fsync: 0 2023-01-04T18:09:14.486 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.max_log_file_size: 0 2023-01-04T18:09:14.486 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-01-04T18:09:14.486 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.log_file_time_to_roll: 0 2023-01-04T18:09:14.486 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.keep_log_file_num: 1000 2023-01-04T18:09:14.486 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.recycle_log_file_num: 0 2023-01-04T18:09:14.486 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.allow_fallocate: 1 2023-01-04T18:09:14.486 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.allow_mmap_reads: 0 2023-01-04T18:09:14.486 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.allow_mmap_writes: 0 2023-01-04T18:09:14.486 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.use_direct_reads: 0 2023-01-04T18:09:14.486 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-01-04T18:09:14.487 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.create_missing_column_families: 0 2023-01-04T18:09:14.487 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.db_log_dir: 2023-01-04T18:09:14.487 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi050/store.db 2023-01-04T18:09:14.487 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.table_cache_numshardbits: 6 2023-01-04T18:09:14.487 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.max_subcompactions: 1 2023-01-04T18:09:14.487 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.max_background_flushes: -1 2023-01-04T18:09:14.487 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-01-04T18:09:14.487 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-01-04T18:09:14.487 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-01-04T18:09:14.487 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-01-04T18:09:14.487 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-01-04T18:09:14.488 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.advise_random_on_open: 1 2023-01-04T18:09:14.488 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.db_write_buffer_size: 0 2023-01-04T18:09:14.488 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.write_buffer_manager: 0x55f28acd9530 2023-01-04T18:09:14.488 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-01-04T18:09:14.488 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-01-04T18:09:14.488 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-01-04T18:09:14.488 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.use_adaptive_mutex: 0 2023-01-04T18:09:14.488 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.rate_limiter: (nil) 2023-01-04T18:09:14.488 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-01-04T18:09:14.488 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.wal_recovery_mode: 2 2023-01-04T18:09:14.488 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.enable_thread_tracking: 0 2023-01-04T18:09:14.488 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.enable_pipelined_write: 0 2023-01-04T18:09:14.489 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.unordered_write: 0 2023-01-04T18:09:14.489 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-01-04T18:09:14.489 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-01-04T18:09:14.489 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-01-04T18:09:14.489 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-01-04T18:09:14.489 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.row_cache: None 2023-01-04T18:09:14.489 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.wal_filter: None 2023-01-04T18:09:14.489 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-01-04T18:09:14.489 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.allow_ingest_behind: 0 2023-01-04T18:09:14.489 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.preserve_deletes: 0 2023-01-04T18:09:14.489 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.two_write_queues: 0 2023-01-04T18:09:14.490 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.manual_wal_flush: 0 2023-01-04T18:09:14.490 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.atomic_flush: 0 2023-01-04T18:09:14.490 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-01-04T18:09:14.490 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.persist_stats_to_disk: 0 2023-01-04T18:09:14.490 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.write_dbid_to_manifest: 0 2023-01-04T18:09:14.490 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.log_readahead_size: 0 2023-01-04T18:09:14.490 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2023-01-04T18:09:14.490 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.max_background_jobs: 2 2023-01-04T18:09:14.490 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.max_background_compactions: -1 2023-01-04T18:09:14.490 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-01-04T18:09:14.490 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-01-04T18:09:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.delayed_write_rate : 16777216 2023-01-04T18:09:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.max_total_wal_size: 0 2023-01-04T18:09:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-01-04T18:09:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.stats_dump_period_sec: 600 2023-01-04T18:09:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.stats_persist_period_sec: 600 2023-01-04T18:09:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-01-04T18:09:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.max_open_files: -1 2023-01-04T18:09:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.bytes_per_sync: 0 2023-01-04T18:09:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-01-04T18:09:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.strict_bytes_per_sync: 0 2023-01-04T18:09:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Options.compaction_readahead_size: 0 2023-01-04T18:09:14.491 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Compression algorithms supported: 2023-01-04T18:09:14.492 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-01-04T18:09:14.492 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: kZSTD supported: 0 2023-01-04T18:09:14.492 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: kXpressCompression supported: 0 2023-01-04T18:09:14.492 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: kLZ4HCCompression supported: 1 2023-01-04T18:09:14.492 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: kLZ4Compression supported: 1 2023-01-04T18:09:14.492 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: kBZip2Compression supported: 0 2023-01-04T18:09:14.492 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: kZlibCompression supported: 1 2023-01-04T18:09:14.492 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: kSnappyCompression supported: 1 2023-01-04T18:09:14.492 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.456+0000 7fa651a3d700 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-01-04T18:09:14.492 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2023-01-04T18:09:14.492 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: 2023-01-04T18:09:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi050/store.db/MANIFEST-000001 2023-01-04T18:09:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: 2023-01-04T18:09:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2023-01-04T18:09:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: 2023-01-04T18:09:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-01-04T18:09:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.merge_operator: 2023-01-04T18:09:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.compaction_filter: None 2023-01-04T18:09:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.compaction_filter_factory: None 2023-01-04T18:09:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-01-04T18:09:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.table_factory: BlockBasedTable 2023-01-04T18:09:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f28abea120) 2023-01-04T18:09:14.493 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2023-01-04T18:09:14.494 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2023-01-04T18:09:14.494 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2023-01-04T18:09:14.494 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2023-01-04T18:09:14.494 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: index_type: 0 2023-01-04T18:09:14.494 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2023-01-04T18:09:14.494 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: index_shortening: 1 2023-01-04T18:09:14.494 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2023-01-04T18:09:14.494 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2023-01-04T18:09:14.494 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: checksum: 1 2023-01-04T18:09:14.494 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2023-01-04T18:09:14.494 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: block_cache: 0x55f28ac20d10 2023-01-04T18:09:14.495 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2023-01-04T18:09:14.495 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: block_cache_options: 2023-01-04T18:09:14.495 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: capacity : 536870912 2023-01-04T18:09:14.495 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2023-01-04T18:09:14.495 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2023-01-04T18:09:14.495 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2023-01-04T18:09:14.495 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2023-01-04T18:09:14.495 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2023-01-04T18:09:14.495 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: block_size: 4096 2023-01-04T18:09:14.495 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2023-01-04T18:09:14.495 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2023-01-04T18:09:14.495 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2023-01-04T18:09:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2023-01-04T18:09:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: partition_filters: 0 2023-01-04T18:09:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2023-01-04T18:09:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2023-01-04T18:09:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2023-01-04T18:09:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: verify_compression: 0 2023-01-04T18:09:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2023-01-04T18:09:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: format_version: 2 2023-01-04T18:09:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2023-01-04T18:09:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: block_align: 0 2023-01-04T18:09:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: 2023-01-04T18:09:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.write_buffer_size: 33554432 2023-01-04T18:09:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.max_write_buffer_number: 2 2023-01-04T18:09:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.compression: NoCompression 2023-01-04T18:09:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.bottommost_compression: Disabled 2023-01-04T18:09:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.prefix_extractor: nullptr 2023-01-04T18:09:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-01-04T18:09:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.num_levels: 7 2023-01-04T18:09:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-01-04T18:09:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-01-04T18:09:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-01-04T18:09:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-01-04T18:09:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-01-04T18:09:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-01-04T18:09:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-01-04T18:09:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-01-04T18:09:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-01-04T18:09:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.compression_opts.window_bits: -14 2023-01-04T18:09:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.compression_opts.level: 32767 2023-01-04T18:09:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.compression_opts.strategy: 0 2023-01-04T18:09:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-01-04T18:09:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-01-04T18:09:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.compression_opts.enabled: false 2023-01-04T18:09:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-01-04T18:09:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-01-04T18:09:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-01-04T18:09:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.target_file_size_base: 67108864 2023-01-04T18:09:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.target_file_size_multiplier: 1 2023-01-04T18:09:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-01-04T18:09:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-01-04T18:09:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-01-04T18:09:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-01-04T18:09:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-01-04T18:09:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-01-04T18:09:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-01-04T18:09:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-01-04T18:09:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-01-04T18:09:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-01-04T18:09:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-01-04T18:09:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-01-04T18:09:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.arena_block_size: 4194304 2023-01-04T18:09:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-01-04T18:09:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-01-04T18:09:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-01-04T18:09:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.disable_auto_compactions: 0 2023-01-04T18:09:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-01-04T18:09:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-01-04T18:09:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-01-04T18:09:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-01-04T18:09:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-01-04T18:09:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-01-04T18:09:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-01-04T18:09:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-01-04T18:09:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-01-04T18:09:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-01-04T18:09:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.table_properties_collectors: 2023-01-04T18:09:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.inplace_update_support: 0 2023-01-04T18:09:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-01-04T18:09:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-01-04T18:09:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-01-04T18:09:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.memtable_huge_page_size: 0 2023-01-04T18:09:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.bloom_locality: 0 2023-01-04T18:09:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.max_successive_merges: 0 2023-01-04T18:09:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-01-04T18:09:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.paranoid_file_checks: 0 2023-01-04T18:09:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.force_consistency_checks: 0 2023-01-04T18:09:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.report_bg_io_stats: 0 2023-01-04T18:09:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.ttl: 2592000 2023-01-04T18:09:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.457+0000 7fa651a3d700 4 rocksdb: Options.periodic_compaction_seconds: 0 2023-01-04T18:09:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.458+0000 7fa651a3d700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi050/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-01-04T18:09:14.503 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: 2023-01-04T18:09:14.503 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.458+0000 7fa651a3d700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2023-01-04T18:09:14.503 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: 2023-01-04T18:09:14.503 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.458+0000 7fa651a3d700 4 rocksdb: DB pointer 0x55f28ace5800 2023-01-04T18:09:14.503 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.459+0000 7fa63a8d6700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2023-01-04T18:09:14.503 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.459+0000 7fa63a8d6700 4 rocksdb: [db_impl/db_impl.cc:851] 2023-01-04T18:09:14.503 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2023-01-04T18:09:14.503 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2023-01-04T18:09:14.503 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-01-04T18:09:14.503 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-01-04T18:09:14.504 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-01-04T18:09:14.504 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-01-04T18:09:14.504 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-01-04T18:09:14.504 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-01-04T18:09:14.504 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: 2023-01-04T18:09:14.504 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2023-01-04T18:09:14.504 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-04T18:09:14.504 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-04T18:09:14.504 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-01-04T18:09:14.504 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-01-04T18:09:14.504 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: 2023-01-04T18:09:14.505 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2023-01-04T18:09:14.505 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-04T18:09:14.505 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-04T18:09:14.505 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2023-01-04T18:09:14.505 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2023-01-04T18:09:14.505 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2023-01-04T18:09:14.505 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2023-01-04T18:09:14.505 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2023-01-04T18:09:14.505 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2023-01-04T18:09:14.505 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-04T18:09:14.505 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-04T18:09:14.505 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-01-04T18:09:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: 2023-01-04T18:09:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2023-01-04T18:09:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: 2023-01-04T18:09:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2023-01-04T18:09:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-04T18:09:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-04T18:09:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-01-04T18:09:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-01-04T18:09:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: 2023-01-04T18:09:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2023-01-04T18:09:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-04T18:09:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-04T18:09:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2023-01-04T18:09:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2023-01-04T18:09:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2023-01-04T18:09:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2023-01-04T18:09:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2023-01-04T18:09:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2023-01-04T18:09:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-04T18:09:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-04T18:09:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-01-04T18:09:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: 2023-01-04T18:09:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2023-01-04T18:09:14.508 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: 2023-01-04T18:09:14.508 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.460+0000 7fa651a3d700 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2023-01-04T18:09:14.508 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.460+0000 7fa651a3d700 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2023-01-04T18:09:14.508 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph-mon: debug 2023-01-04T18:09:14.460+0000 7fa651a3d700 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-smithi050 for mon.smithi050 2023-01-04T18:09:14.851 INFO:teuthology.orchestra.run.smithi050.stderr:create mon.smithi050 on 2023-01-04T18:09:14.851 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:09:14.857 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl disable ceph.target 2023-01-04T18:09:14.864 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-01-04T18:09:14.955 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl enable ceph.target 2023-01-04T18:09:14.962 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-01-04T18:09:15.052 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl start ceph.target 2023-01-04T18:09:15.060 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl enable ceph-d98671da-8c5a-11ed-821a-001a4aab830c.target 2023-01-04T18:09:15.066 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d98671da-8c5a-11ed-821a-001a4aab830c.target → /etc/systemd/system/ceph-d98671da-8c5a-11ed-821a-001a4aab830c.target. 2023-01-04T18:09:15.066 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-d98671da-8c5a-11ed-821a-001a4aab830c.target → /etc/systemd/system/ceph-d98671da-8c5a-11ed-821a-001a4aab830c.target. 2023-01-04T18:09:15.151 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl start ceph-d98671da-8c5a-11ed-821a-001a4aab830c.target 2023-01-04T18:09:15.158 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl daemon-reload 2023-01-04T18:09:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl stop ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mon.smithi050 2023-01-04T18:09:15.273 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl reset-failed ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mon.smithi050 2023-01-04T18:09:15.278 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: Failed to reset failed state of unit ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mon.smithi050.service: Unit ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mon.smithi050.service not loaded. 2023-01-04T18:09:15.279 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl enable ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mon.smithi050 2023-01-04T18:09:15.286 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: Created symlink /etc/systemd/system/ceph-d98671da-8c5a-11ed-821a-001a4aab830c.target.wants/ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mon.smithi050.service → /etc/systemd/system/ceph-d98671da-8c5a-11ed-821a-001a4aab830c@.service. 2023-01-04T18:09:15.376 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl start ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mon.smithi050 2023-01-04T18:09:16.010 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl is-enabled firewalld.service 2023-01-04T18:09:16.019 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: disabled 2023-01-04T18:09:16.019 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl is-active firewalld.service 2023-01-04T18:09:16.027 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: inactive 2023-01-04T18:09:16.028 INFO:teuthology.orchestra.run.smithi050.stderr:firewalld.service is not enabled 2023-01-04T18:09:16.028 INFO:teuthology.orchestra.run.smithi050.stderr:Not possible to enable service . firewalld.service is not available 2023-01-04T18:09:16.028 INFO:teuthology.orchestra.run.smithi050.stderr:Not possible to open ports <[]>. firewalld.service is not available 2023-01-04T18:09:16.028 INFO:teuthology.orchestra.run.smithi050.stderr:Waiting for mon to start... 2023-01-04T18:09:16.034 INFO:teuthology.orchestra.run.smithi050.stderr:Waiting for mon... 2023-01-04T18:09:16.035 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050:/var/lib/ceph/mon/ceph-smithi050:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status 2023-01-04T18:09:16.234 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:16 smithi050 systemd[1]: Started Ceph mon.smithi050 for d98671da-8c5a-11ed-821a-001a4aab830c. 2023-01-04T18:09:16.234 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[131653]: cluster 2023-01-04T18:09:16.009381+0000 mon.smithi050 (mon.0) 0 : [INF] mkfs d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:09:16.234 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[131653]: cluster 2023-01-04T18:09:15.992936+0000 mon.smithi050 (mon.0) 1 : cluster [INF] mon.smithi050 is new leader, mons smithi050 in quorum (ranks 0) 2023-01-04T18:09:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.467+0000 7f424506a700 1 Processor -- start 2023-01-04T18:09:16.473 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.468+0000 7f424506a700 1 -- start start 2023-01-04T18:09:16.473 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.468+0000 7f424506a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42400fd200 0x7f42400fd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.468+0000 7f424506a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42400fdb10 con 0x7f42400fd200 2023-01-04T18:09:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.468+0000 7f423ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42400fd200 0x7f42400fd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.468+0000 7f423ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42400fd200 0x7f42400fd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42142/0 (socket says 172.21.15.50:42142) 2023-01-04T18:09:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.468+0000 7f423ed9d700 1 -- 172.21.15.50:0/3451734136 learned_addr learned my addr 172.21.15.50:0/3451734136 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.468+0000 7f423ed9d700 1 -- 172.21.15.50:0/3451734136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42400fdc50 con 0x7f42400fd200 2023-01-04T18:09:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.469+0000 7f423ed9d700 1 --2- 172.21.15.50:0/3451734136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42400fd200 0x7f42400fd620 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f423000b5f0 tx=0x7f4230006ee0).ready entity=mon.0 client_cookie=a823d80171e7ee98 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.469+0000 7f423dd9b700 1 -- 172.21.15.50:0/3451734136 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f423000d600 con 0x7f42400fd200 2023-01-04T18:09:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.469+0000 7f423dd9b700 1 -- 172.21.15.50:0/3451734136 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423000d760 con 0x7f42400fd200 2023-01-04T18:09:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.469+0000 7f423dd9b700 1 -- 172.21.15.50:0/3451734136 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f423000da30 con 0x7f42400fd200 2023-01-04T18:09:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.469+0000 7f424506a700 1 -- 172.21.15.50:0/3451734136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42400fd200 msgr2=0x7f42400fd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:16.475 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.469+0000 7f424506a700 1 --2- 172.21.15.50:0/3451734136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42400fd200 0x7f42400fd620 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f423000b5f0 tx=0x7f4230006ee0).stop 2023-01-04T18:09:16.475 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.469+0000 7f424506a700 1 -- 172.21.15.50:0/3451734136 shutdown_connections 2023-01-04T18:09:16.475 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.469+0000 7f424506a700 1 --2- 172.21.15.50:0/3451734136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42400fd200 0x7f42400fd620 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:16.475 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.469+0000 7f424506a700 1 -- 172.21.15.50:0/3451734136 >> 172.21.15.50:0/3451734136 conn(0x7f42400f5a80 msgr2=0x7f42400f7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:16.475 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.469+0000 7f424506a700 1 -- 172.21.15.50:0/3451734136 shutdown_connections 2023-01-04T18:09:16.475 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.469+0000 7f424506a700 1 -- 172.21.15.50:0/3451734136 wait complete. 2023-01-04T18:09:16.475 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.470+0000 7f424506a700 1 Processor -- start 2023-01-04T18:09:16.475 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.470+0000 7f424506a700 1 -- start start 2023-01-04T18:09:16.477 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.471+0000 7f424506a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42400fd200 0x7f42400fcad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:16.477 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.471+0000 7f424506a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42400faf50 con 0x7f42400fd200 2023-01-04T18:09:16.477 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.471+0000 7f423ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42400fd200 0x7f42400fcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:16.477 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.471+0000 7f423ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42400fd200 0x7f42400fcad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42150/0 (socket says 172.21.15.50:42150) 2023-01-04T18:09:16.477 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.471+0000 7f423ed9d700 1 -- 172.21.15.50:0/3499957700 learned_addr learned my addr 172.21.15.50:0/3499957700 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:16.477 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.471+0000 7f423ed9d700 1 -- 172.21.15.50:0/3499957700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423000b200 con 0x7f42400fd200 2023-01-04T18:09:16.477 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.471+0000 7f423ed9d700 1 --2- 172.21.15.50:0/3499957700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42400fd200 0x7f42400fcad0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f4230006c70 tx=0x7f4230016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:16.477 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.471+0000 7f42377fe700 1 -- 172.21.15.50:0/3499957700 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4230011b40 con 0x7f42400fd200 2023-01-04T18:09:16.478 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.471+0000 7f42377fe700 1 -- 172.21.15.50:0/3499957700 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4230011ca0 con 0x7f42400fd200 2023-01-04T18:09:16.478 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.471+0000 7f424506a700 1 -- 172.21.15.50:0/3499957700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42400fb0f0 con 0x7f42400fd200 2023-01-04T18:09:16.478 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.471+0000 7f42377fe700 1 -- 172.21.15.50:0/3499957700 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f423001d430 con 0x7f42400fd200 2023-01-04T18:09:16.478 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.471+0000 7f424506a700 1 -- 172.21.15.50:0/3499957700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42400fb500 con 0x7f42400fd200 2023-01-04T18:09:16.478 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.472+0000 7f42377fe700 1 -- 172.21.15.50:0/3499957700 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f423000f070 con 0x7f42400fd200 2023-01-04T18:09:16.478 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.472+0000 7f42377fe700 1 -- 172.21.15.50:0/3499957700 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f4230027460 con 0x7f42400fd200 2023-01-04T18:09:16.478 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.473+0000 7f424506a700 1 -- 172.21.15.50:0/3499957700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4240045ad0 con 0x7f42400fd200 2023-01-04T18:09:16.478 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.475+0000 7f42377fe700 1 -- 172.21.15.50:0/3499957700 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f4230016070 con 0x7f42400fd200 2023-01-04T18:09:16.550 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.544+0000 7f424506a700 1 -- 172.21.15.50:0/3499957700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f4240103d40 con 0x7f42400fd200 2023-01-04T18:09:16.551 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.545+0000 7f42377fe700 1 -- 172.21.15.50:0/3499957700 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f423001d640 con 0x7f42400fd200 2023-01-04T18:09:16.551 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: cluster: 2023-01-04T18:09:16.551 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: id: d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:09:16.551 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: health: HEALTH_OK 2023-01-04T18:09:16.551 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.551 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: services: 2023-01-04T18:09:16.551 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: mon: 1 daemons, quorum smithi050 (age 0.537594s) 2023-01-04T18:09:16.551 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: mgr: no daemons active 2023-01-04T18:09:16.551 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2023-01-04T18:09:16.552 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.552 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: data: 2023-01-04T18:09:16.552 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2023-01-04T18:09:16.552 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2023-01-04T18:09:16.552 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2023-01-04T18:09:16.552 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: pgs: 2023-01-04T18:09:16.552 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.552 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.545+0000 7f424506a700 1 -- 172.21.15.50:0/3499957700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42400fd200 msgr2=0x7f42400fcad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:16.552 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.545+0000 7f424506a700 1 --2- 172.21.15.50:0/3499957700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42400fd200 0x7f42400fcad0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f4230006c70 tx=0x7f4230016000).stop 2023-01-04T18:09:16.552 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.546+0000 7f424506a700 1 -- 172.21.15.50:0/3499957700 shutdown_connections 2023-01-04T18:09:16.552 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.546+0000 7f424506a700 1 --2- 172.21.15.50:0/3499957700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42400fd200 0x7f42400fcad0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:16.553 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.546+0000 7f424506a700 1 -- 172.21.15.50:0/3499957700 >> 172.21.15.50:0/3499957700 conn(0x7f42400f5a80 msgr2=0x7f42400fea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:16.553 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.546+0000 7f424506a700 1 -- 172.21.15.50:0/3499957700 shutdown_connections 2023-01-04T18:09:16.553 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:16.546+0000 7f424506a700 1 -- 172.21.15.50:0/3499957700 wait complete. 2023-01-04T18:09:16.968 INFO:teuthology.orchestra.run.smithi050.stderr:mon is available 2023-01-04T18:09:16.969 INFO:teuthology.orchestra.run.smithi050.stderr:Assimilating anything we can from ceph.conf... 2023-01-04T18:09:16.969 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z -v /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050:/var/lib/ceph/mon/ceph-smithi050:z docker.io/ceph/ceph:v16.2.4 config assimilate-conf -i /var/lib/ceph/mon/ceph-smithi050/config 2023-01-04T18:09:17.181 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:17 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[131653]: cluster 2023-01-04T18:09:16.008729+0000 mon.smithi050 (mon.0) 2 : cluster [INF] mon.smithi050 is new leader, mons smithi050 in quorum (ranks 0) 2023-01-04T18:09:17.181 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:17 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[131653]: cluster 2023-01-04T18:09:16.008895+0000 mon.smithi050 (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {smithi050=[v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0]} 2023-01-04T18:09:17.182 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:17 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[131653]: cluster 2023-01-04T18:09:16.010718+0000 mon.smithi050 (mon.0) 4 : cluster [DBG] fsmap 2023-01-04T18:09:17.182 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:17 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[131653]: cluster 2023-01-04T18:09:16.012605+0000 mon.smithi050 (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2023-01-04T18:09:17.182 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:17 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[131653]: cluster 2023-01-04T18:09:16.012974+0000 mon.smithi050 (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2023-01-04T18:09:17.182 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:17 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[131653]: audit 2023-01-04T18:09:16.546282+0000 mon.smithi050 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.50:0/3499957700' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-01-04T18:09:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.417+0000 7f3cf759e700 1 Processor -- start 2023-01-04T18:09:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.417+0000 7f3cf759e700 1 -- start start 2023-01-04T18:09:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.417+0000 7f3cf759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cf806fbd0 0x7f3cf8100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.417+0000 7f3cf759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf80fc4a0 con 0x7f3cf806fbd0 2023-01-04T18:09:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.417+0000 7f3cf659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cf806fbd0 0x7f3cf8100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.417+0000 7f3cf659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cf806fbd0 0x7f3cf8100ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60824/0 (socket says 172.21.15.50:60824) 2023-01-04T18:09:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.417+0000 7f3cf659c700 1 -- 172.21.15.50:0/2707078641 learned_addr learned my addr 172.21.15.50:0/2707078641 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.418+0000 7f3cf659c700 1 -- 172.21.15.50:0/2707078641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf8100fa0 con 0x7f3cf806fbd0 2023-01-04T18:09:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.418+0000 7f3cf659c700 1 --2- 172.21.15.50:0/2707078641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cf806fbd0 0x7f3cf8100ab0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f3ce800b5f0 tx=0x7f3ce8006ee0).ready entity=mon.0 client_cookie=6a20bb84ed6cf88d server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.418+0000 7f3cf559a700 1 -- 172.21.15.50:0/2707078641 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ce800d600 con 0x7f3cf806fbd0 2023-01-04T18:09:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.418+0000 7f3cf559a700 1 -- 172.21.15.50:0/2707078641 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce800d760 con 0x7f3cf806fbd0 2023-01-04T18:09:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.418+0000 7f3cf559a700 1 -- 172.21.15.50:0/2707078641 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ce800da30 con 0x7f3cf806fbd0 2023-01-04T18:09:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.418+0000 7f3cf759e700 1 -- 172.21.15.50:0/2707078641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cf806fbd0 msgr2=0x7f3cf8100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.418+0000 7f3cf759e700 1 --2- 172.21.15.50:0/2707078641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cf806fbd0 0x7f3cf8100ab0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f3ce800b5f0 tx=0x7f3ce8006ee0).stop 2023-01-04T18:09:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.418+0000 7f3cf759e700 1 -- 172.21.15.50:0/2707078641 shutdown_connections 2023-01-04T18:09:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.418+0000 7f3cf759e700 1 --2- 172.21.15.50:0/2707078641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cf806fbd0 0x7f3cf8100ab0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.418+0000 7f3cf759e700 1 -- 172.21.15.50:0/2707078641 >> 172.21.15.50:0/2707078641 conn(0x7f3cf80f6130 msgr2=0x7f3cf80f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.419+0000 7f3cf759e700 1 -- 172.21.15.50:0/2707078641 shutdown_connections 2023-01-04T18:09:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.419+0000 7f3cf759e700 1 -- 172.21.15.50:0/2707078641 wait complete. 2023-01-04T18:09:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.419+0000 7f3cf759e700 1 Processor -- start 2023-01-04T18:09:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.419+0000 7f3cf759e700 1 -- start start 2023-01-04T18:09:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.420+0000 7f3cf759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cf806fbd0 0x7f3cf810c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.420+0000 7f3cf759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf810c710 con 0x7f3cf806fbd0 2023-01-04T18:09:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.420+0000 7f3cf659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cf806fbd0 0x7f3cf810c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.420+0000 7f3cf659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cf806fbd0 0x7f3cf810c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60832/0 (socket says 172.21.15.50:60832) 2023-01-04T18:09:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.420+0000 7f3cf659c700 1 -- 172.21.15.50:0/3163848410 learned_addr learned my addr 172.21.15.50:0/3163848410 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.420+0000 7f3cf659c700 1 -- 172.21.15.50:0/3163848410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce800b200 con 0x7f3cf806fbd0 2023-01-04T18:09:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.420+0000 7f3cf659c700 1 --2- 172.21.15.50:0/3163848410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cf806fbd0 0x7f3cf810c220 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f3ce8006c70 tx=0x7f3ce8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.420+0000 7f3ce6ffd700 1 -- 172.21.15.50:0/3163848410 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ce8011b40 con 0x7f3cf806fbd0 2023-01-04T18:09:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.420+0000 7f3ce6ffd700 1 -- 172.21.15.50:0/3163848410 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce8011ca0 con 0x7f3cf806fbd0 2023-01-04T18:09:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.420+0000 7f3cf759e700 1 -- 172.21.15.50:0/3163848410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf810c910 con 0x7f3cf806fbd0 2023-01-04T18:09:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.420+0000 7f3ce6ffd700 1 -- 172.21.15.50:0/3163848410 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ce801d430 con 0x7f3cf806fbd0 2023-01-04T18:09:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.420+0000 7f3cf759e700 1 -- 172.21.15.50:0/3163848410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf810cd20 con 0x7f3cf806fbd0 2023-01-04T18:09:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.421+0000 7f3ce6ffd700 1 -- 172.21.15.50:0/3163848410 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f3ce800f070 con 0x7f3cf806fbd0 2023-01-04T18:09:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.421+0000 7f3ce6ffd700 1 -- 172.21.15.50:0/3163848410 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f3ce8027460 con 0x7f3cf806fbd0 2023-01-04T18:09:17.427 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.422+0000 7f3cf759e700 1 -- 172.21.15.50:0/3163848410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf8045ad0 con 0x7f3cf806fbd0 2023-01-04T18:09:17.428 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.425+0000 7f3ce6ffd700 1 -- 172.21.15.50:0/3163848410 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f3ce8016070 con 0x7f3cf806fbd0 2023-01-04T18:09:17.494 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.491+0000 7f3cf759e700 1 -- 172.21.15.50:0/3163848410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f3cf8101190 con 0x7f3cf806fbd0 2023-01-04T18:09:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.495+0000 7f3ce6ffd700 1 -- 172.21.15.50:0/3163848410 <== mon.0 v2:172.21.15.50:3300/0 7 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f3ce801d5e0 con 0x7f3cf806fbd0 2023-01-04T18:09:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.495+0000 7f3ce6ffd700 1 -- 172.21.15.50:0/3163848410 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+464 (secure 0 0 0) 0x7f3ce8036020 con 0x7f3cf806fbd0 2023-01-04T18:09:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.498 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: [global] 2023-01-04T18:09:17.500 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: fsid = d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:09:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.50:3300,v1:172.21.15.50:6789] 2023-01-04T18:09:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2023-01-04T18:09:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2023-01-04T18:09:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2023-01-04T18:09:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2023-01-04T18:09:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: [mgr] 2023-01-04T18:09:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2023-01-04T18:09:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.501 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: [osd] 2023-01-04T18:09:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: mon_osd_backfillfull_ratio = 0.85 2023-01-04T18:09:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: mon_osd_full_ratio = 0.9 2023-01-04T18:09:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: mon_osd_nearfull_ratio = 0.8 2023-01-04T18:09:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2023-01-04T18:09:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: osd_memory_target_autotune = true 2023-01-04T18:09:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2023-01-04T18:09:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.496+0000 7f3cf759e700 1 -- 172.21.15.50:0/3163848410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cf806fbd0 msgr2=0x7f3cf810c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.496+0000 7f3cf759e700 1 --2- 172.21.15.50:0/3163848410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cf806fbd0 0x7f3cf810c220 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f3ce8006c70 tx=0x7f3ce8016000).stop 2023-01-04T18:09:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.496+0000 7f3cf759e700 1 -- 172.21.15.50:0/3163848410 shutdown_connections 2023-01-04T18:09:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.496+0000 7f3cf759e700 1 --2- 172.21.15.50:0/3163848410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cf806fbd0 0x7f3cf810c220 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:17.502 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.496+0000 7f3cf759e700 1 -- 172.21.15.50:0/3163848410 >> 172.21.15.50:0/3163848410 conn(0x7f3cf80f6130 msgr2=0x7f3cf80f7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.496+0000 7f3cf759e700 1 -- 172.21.15.50:0/3163848410 shutdown_connections 2023-01-04T18:09:17.503 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:17.496+0000 7f3cf759e700 1 -- 172.21.15.50:0/3163848410 wait complete. 2023-01-04T18:09:17.905 INFO:teuthology.orchestra.run.smithi050.stderr:Generating new minimal ceph.conf... 2023-01-04T18:09:17.905 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z -v /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050:/var/lib/ceph/mon/ceph-smithi050:z docker.io/ceph/ceph:v16.2.4 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-smithi050/config 2023-01-04T18:09:18.089 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[131653]: audit 2023-01-04T18:09:17.492789+0000 mon.smithi050 (mon.0) 8 : audit [INF] from='client.? 172.21.15.50:0/3163848410' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-01-04T18:09:18.089 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[131653]: audit 2023-01-04T18:09:17.496277+0000 mon.smithi050 (mon.0) 9 : audit [INF] from='client.? 172.21.15.50:0/3163848410' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-01-04T18:09:18.328 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.325+0000 7f1dbdc60700 1 Processor -- start 2023-01-04T18:09:18.328 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.325+0000 7f1dbdc60700 1 -- start start 2023-01-04T18:09:18.328 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.325+0000 7f1dbdc60700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db8070c50 0x7f1db806f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:18.328 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.325+0000 7f1dbdc60700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db8071070 con 0x7f1db8070c50 2023-01-04T18:09:18.331 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.325+0000 7f1db77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db8070c50 0x7f1db806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:18.331 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.325+0000 7f1db77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db8070c50 0x7f1db806f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60846/0 (socket says 172.21.15.50:60846) 2023-01-04T18:09:18.331 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.325+0000 7f1db77fe700 1 -- 172.21.15.50:0/1333474846 learned_addr learned my addr 172.21.15.50:0/1333474846 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:18.331 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.325+0000 7f1db77fe700 1 -- 172.21.15.50:0/1333474846 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db806f610 con 0x7f1db8070c50 2023-01-04T18:09:18.331 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.325+0000 7f1db77fe700 1 --2- 172.21.15.50:0/1333474846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db8070c50 0x7f1db806f120 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f1da800b5f0 tx=0x7f1da8006ee0).ready entity=mon.0 client_cookie=ae9fc2273a8ad495 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:18.331 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.326+0000 7f1db67fc700 1 -- 172.21.15.50:0/1333474846 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1da800d600 con 0x7f1db8070c50 2023-01-04T18:09:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.326+0000 7f1db67fc700 1 -- 172.21.15.50:0/1333474846 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f1da800dbd0 con 0x7f1db8070c50 2023-01-04T18:09:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.326+0000 7f1db67fc700 1 -- 172.21.15.50:0/1333474846 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1da8011c00 con 0x7f1db8070c50 2023-01-04T18:09:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.326+0000 7f1dbdc60700 1 -- 172.21.15.50:0/1333474846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db8070c50 msgr2=0x7f1db806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.326+0000 7f1dbdc60700 1 --2- 172.21.15.50:0/1333474846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db8070c50 0x7f1db806f120 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f1da800b5f0 tx=0x7f1da8006ee0).stop 2023-01-04T18:09:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.326+0000 7f1dbdc60700 1 -- 172.21.15.50:0/1333474846 shutdown_connections 2023-01-04T18:09:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.326+0000 7f1dbdc60700 1 --2- 172.21.15.50:0/1333474846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db8070c50 0x7f1db806f120 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.326+0000 7f1dbdc60700 1 -- 172.21.15.50:0/1333474846 >> 172.21.15.50:0/1333474846 conn(0x7f1db80f73e0 msgr2=0x7f1db80f9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.326+0000 7f1dbdc60700 1 -- 172.21.15.50:0/1333474846 shutdown_connections 2023-01-04T18:09:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.326+0000 7f1dbdc60700 1 -- 172.21.15.50:0/1333474846 wait complete. 2023-01-04T18:09:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.327+0000 7f1dbdc60700 1 Processor -- start 2023-01-04T18:09:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.327+0000 7f1dbdc60700 1 -- start start 2023-01-04T18:09:18.332 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.327+0000 7f1dbdc60700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db8070c50 0x7f1db810cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:18.333 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.327+0000 7f1dbdc60700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db810d1d0 con 0x7f1db8070c50 2023-01-04T18:09:18.333 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.327+0000 7f1db77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db8070c50 0x7f1db810cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:18.333 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.327+0000 7f1db77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db8070c50 0x7f1db810cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60850/0 (socket says 172.21.15.50:60850) 2023-01-04T18:09:18.333 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.327+0000 7f1db77fe700 1 -- 172.21.15.50:0/425634704 learned_addr learned my addr 172.21.15.50:0/425634704 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:18.333 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.328+0000 7f1db77fe700 1 -- 172.21.15.50:0/425634704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da800b200 con 0x7f1db8070c50 2023-01-04T18:09:18.333 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.328+0000 7f1db77fe700 1 --2- 172.21.15.50:0/425634704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db8070c50 0x7f1db810cce0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f1da800b190 tx=0x7f1da8006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:18.333 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.328+0000 7f1d9ffff700 1 -- 172.21.15.50:0/425634704 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1da801b410 con 0x7f1db8070c50 2023-01-04T18:09:18.333 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.328+0000 7f1d9ffff700 1 -- 172.21.15.50:0/425634704 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f1da801b9e0 con 0x7f1db8070c50 2023-01-04T18:09:18.333 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.328+0000 7f1dbdc60700 1 -- 172.21.15.50:0/425634704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db810d3d0 con 0x7f1db8070c50 2023-01-04T18:09:18.333 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.328+0000 7f1d9ffff700 1 -- 172.21.15.50:0/425634704 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1da801a880 con 0x7f1db8070c50 2023-01-04T18:09:18.334 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.328+0000 7f1dbdc60700 1 -- 172.21.15.50:0/425634704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db810d7e0 con 0x7f1db8070c50 2023-01-04T18:09:18.334 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.328+0000 7f1d9ffff700 1 -- 172.21.15.50:0/425634704 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f1da800f070 con 0x7f1db8070c50 2023-01-04T18:09:18.334 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.328+0000 7f1d9ffff700 1 -- 172.21.15.50:0/425634704 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f1da8025b70 con 0x7f1db8070c50 2023-01-04T18:09:18.334 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.329+0000 7f1dbdc60700 1 -- 172.21.15.50:0/425634704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db8059100 con 0x7f1db8070c50 2023-01-04T18:09:18.334 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.331+0000 7f1d9ffff700 1 -- 172.21.15.50:0/425634704 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f1da8016070 con 0x7f1db8070c50 2023-01-04T18:09:18.400 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.398+0000 7f1dbdc60700 1 -- 172.21.15.50:0/425634704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f1db8045ad0 con 0x7f1db8070c50 2023-01-04T18:09:18.401 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.398+0000 7f1d9ffff700 1 -- 172.21.15.50:0/425634704 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f1db8045ad0 con 0x7f1db8070c50 2023-01-04T18:09:18.402 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.399+0000 7f1dbdc60700 1 -- 172.21.15.50:0/425634704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db8070c50 msgr2=0x7f1db810cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:18.402 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.399+0000 7f1dbdc60700 1 --2- 172.21.15.50:0/425634704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db8070c50 0x7f1db810cce0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f1da800b190 tx=0x7f1da8006ee0).stop 2023-01-04T18:09:18.402 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.399+0000 7f1dbdc60700 1 -- 172.21.15.50:0/425634704 shutdown_connections 2023-01-04T18:09:18.402 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.399+0000 7f1dbdc60700 1 --2- 172.21.15.50:0/425634704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1db8070c50 0x7f1db810cce0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:18.402 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.399+0000 7f1dbdc60700 1 -- 172.21.15.50:0/425634704 >> 172.21.15.50:0/425634704 conn(0x7f1db80f73e0 msgr2=0x7f1db80f8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:18.402 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.400+0000 7f1dbdc60700 1 -- 172.21.15.50:0/425634704 shutdown_connections 2023-01-04T18:09:18.403 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:18.400+0000 7f1dbdc60700 1 -- 172.21.15.50:0/425634704 wait complete. 2023-01-04T18:09:18.843 INFO:teuthology.orchestra.run.smithi050.stderr:Restarting the monitor... 2023-01-04T18:09:18.843 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl restart ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mon.smithi050 2023-01-04T18:09:19.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:18 smithi050 systemd[1]: Stopping Ceph mon.smithi050 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:09:19.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[131653]: debug 2023-01-04T18:09:18.916+0000 7f88e294c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi050 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2023-01-04T18:09:19.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[131653]: debug 2023-01-04T18:09:18.916+0000 7f88e294c700 -1 mon.smithi050@0(leader) e1 *** Got Signal Terminated *** 2023-01-04T18:09:19.583 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:19 smithi050 podman[131989]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050 2023-01-04T18:09:19.875 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:19 smithi050 systemd[1]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mon.smithi050.service: Succeeded. 2023-01-04T18:09:19.875 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:19 smithi050 systemd[1]: Stopped Ceph mon.smithi050 for d98671da-8c5a-11ed-821a-001a4aab830c. 2023-01-04T18:09:19.875 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:19 smithi050 systemd[1]: Starting Ceph mon.smithi050 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:09:20.145 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:19 smithi050 podman[132068]: 2023-01-04T18:09:20.215 INFO:teuthology.orchestra.run.smithi050.stderr:Setting mon public_network to 172.21.0.0/20 2023-01-04T18:09:20.216 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mon public_network 172.21.0.0/20 2023-01-04T18:09:20.406 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 bash[132068]: 7ef171ad1e932ddae5784e1d97bf4eeab855173c6949db38fe94de9a7e96f48e 2023-01-04T18:09:20.406 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.145+0000 7fd812601700 0 set uid:gid to 167:167 (ceph:ceph) 2023-01-04T18:09:20.406 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.145+0000 7fd812601700 0 ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable), process ceph-mon, pid 7 2023-01-04T18:09:20.406 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.145+0000 7fd812601700 0 pidfile_write: ignore empty --pid-file 2023-01-04T18:09:20.406 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.149+0000 7fd812601700 0 load: jerasure load: lrc load: isa 2023-01-04T18:09:20.406 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: RocksDB version: 6.8.1 2023-01-04T18:09:20.407 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: 2023-01-04T18:09:20.407 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-01-04T18:09:20.407 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Compile date May 13 2021 2023-01-04T18:09:20.407 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: DB SUMMARY 2023-01-04T18:09:20.407 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: 2023-01-04T18:09:20.407 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: CURRENT file: CURRENT 2023-01-04T18:09:20.407 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: 2023-01-04T18:09:20.407 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: IDENTITY file: IDENTITY 2023-01-04T18:09:20.407 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: 2023-01-04T18:09:20.407 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2023-01-04T18:09:20.407 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: 2023-01-04T18:09:20.408 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi050/store.db dir, Total Num: 1, files: 000004.sst 2023-01-04T18:09:20.408 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: 2023-01-04T18:09:20.408 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi050/store.db: 000006.log size: 92456 ; 2023-01-04T18:09:20.408 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: 2023-01-04T18:09:20.408 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.error_if_exists: 0 2023-01-04T18:09:20.408 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.create_if_missing: 0 2023-01-04T18:09:20.408 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.paranoid_checks: 1 2023-01-04T18:09:20.408 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.env: 0x5610d48401c0 2023-01-04T18:09:20.408 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.fs: Posix File System 2023-01-04T18:09:20.408 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.info_log: 0x5610d546d960 2023-01-04T18:09:20.408 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_file_opening_threads: 16 2023-01-04T18:09:20.408 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.statistics: (nil) 2023-01-04T18:09:20.409 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.use_fsync: 0 2023-01-04T18:09:20.409 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_log_file_size: 0 2023-01-04T18:09:20.409 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-01-04T18:09:20.409 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.log_file_time_to_roll: 0 2023-01-04T18:09:20.409 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.keep_log_file_num: 1000 2023-01-04T18:09:20.409 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.recycle_log_file_num: 0 2023-01-04T18:09:20.409 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.allow_fallocate: 1 2023-01-04T18:09:20.409 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.allow_mmap_reads: 0 2023-01-04T18:09:20.409 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.allow_mmap_writes: 0 2023-01-04T18:09:20.409 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.use_direct_reads: 0 2023-01-04T18:09:20.409 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-01-04T18:09:20.409 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.create_missing_column_families: 0 2023-01-04T18:09:20.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.db_log_dir: 2023-01-04T18:09:20.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi050/store.db 2023-01-04T18:09:20.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.table_cache_numshardbits: 6 2023-01-04T18:09:20.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_subcompactions: 1 2023-01-04T18:09:20.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_background_flushes: -1 2023-01-04T18:09:20.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-01-04T18:09:20.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-01-04T18:09:20.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-01-04T18:09:20.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-01-04T18:09:20.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-01-04T18:09:20.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.advise_random_on_open: 1 2023-01-04T18:09:20.411 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.db_write_buffer_size: 0 2023-01-04T18:09:20.411 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.write_buffer_manager: 0x5610d60e2030 2023-01-04T18:09:20.411 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-01-04T18:09:20.411 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-01-04T18:09:20.411 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-01-04T18:09:20.411 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.use_adaptive_mutex: 0 2023-01-04T18:09:20.411 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.rate_limiter: (nil) 2023-01-04T18:09:20.411 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-01-04T18:09:20.411 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.wal_recovery_mode: 2 2023-01-04T18:09:20.411 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.enable_thread_tracking: 0 2023-01-04T18:09:20.411 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.enable_pipelined_write: 0 2023-01-04T18:09:20.411 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.unordered_write: 0 2023-01-04T18:09:20.412 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-01-04T18:09:20.412 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-01-04T18:09:20.412 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-01-04T18:09:20.412 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-01-04T18:09:20.412 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.row_cache: None 2023-01-04T18:09:20.412 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.wal_filter: None 2023-01-04T18:09:20.412 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-01-04T18:09:20.412 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.allow_ingest_behind: 0 2023-01-04T18:09:20.412 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.preserve_deletes: 0 2023-01-04T18:09:20.412 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.two_write_queues: 0 2023-01-04T18:09:20.412 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.manual_wal_flush: 0 2023-01-04T18:09:20.412 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.atomic_flush: 0 2023-01-04T18:09:20.413 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-01-04T18:09:20.413 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.persist_stats_to_disk: 0 2023-01-04T18:09:20.413 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.write_dbid_to_manifest: 0 2023-01-04T18:09:20.413 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.log_readahead_size: 0 2023-01-04T18:09:20.413 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2023-01-04T18:09:20.413 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_background_jobs: 2 2023-01-04T18:09:20.413 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_background_compactions: -1 2023-01-04T18:09:20.413 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-01-04T18:09:20.413 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-01-04T18:09:20.413 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.delayed_write_rate : 16777216 2023-01-04T18:09:20.413 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_total_wal_size: 0 2023-01-04T18:09:20.414 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-01-04T18:09:20.414 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.stats_dump_period_sec: 600 2023-01-04T18:09:20.414 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.stats_persist_period_sec: 600 2023-01-04T18:09:20.414 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-01-04T18:09:20.414 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_open_files: -1 2023-01-04T18:09:20.414 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.bytes_per_sync: 0 2023-01-04T18:09:20.414 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-01-04T18:09:20.414 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.strict_bytes_per_sync: 0 2023-01-04T18:09:20.414 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.compaction_readahead_size: 0 2023-01-04T18:09:20.414 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Compression algorithms supported: 2023-01-04T18:09:20.414 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-01-04T18:09:20.414 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: kZSTD supported: 0 2023-01-04T18:09:20.414 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: kXpressCompression supported: 0 2023-01-04T18:09:20.415 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: kLZ4HCCompression supported: 1 2023-01-04T18:09:20.415 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: kLZ4Compression supported: 1 2023-01-04T18:09:20.415 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: kBZip2Compression supported: 0 2023-01-04T18:09:20.415 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: kZlibCompression supported: 1 2023-01-04T18:09:20.415 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: kSnappyCompression supported: 1 2023-01-04T18:09:20.415 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-01-04T18:09:20.415 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi050/store.db/MANIFEST-000005 2023-01-04T18:09:20.415 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: 2023-01-04T18:09:20.415 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2023-01-04T18:09:20.415 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: 2023-01-04T18:09:20.415 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-01-04T18:09:20.415 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.merge_operator: 2023-01-04T18:09:20.416 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.compaction_filter: None 2023-01-04T18:09:20.416 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.compaction_filter_factory: None 2023-01-04T18:09:20.416 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-01-04T18:09:20.416 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.table_factory: BlockBasedTable 2023-01-04T18:09:20.416 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5610d5384128) 2023-01-04T18:09:20.416 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cache_index_and_filter_blocks: 1 2023-01-04T18:09:20.416 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cache_index_and_filter_blocks_with_high_priority: 0 2023-01-04T18:09:20.416 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: pin_l0_filter_and_index_blocks_in_cache: 0 2023-01-04T18:09:20.416 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: pin_top_level_index_and_filter: 1 2023-01-04T18:09:20.416 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: index_type: 0 2023-01-04T18:09:20.416 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: data_block_index_type: 0 2023-01-04T18:09:20.416 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: index_shortening: 1 2023-01-04T18:09:20.417 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: data_block_hash_table_util_ratio: 0.750000 2023-01-04T18:09:20.417 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: hash_index_allow_collision: 1 2023-01-04T18:09:20.417 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: checksum: 1 2023-01-04T18:09:20.417 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: no_block_cache: 0 2023-01-04T18:09:20.417 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: block_cache: 0x5610d53baf10 2023-01-04T18:09:20.417 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: block_cache_name: BinnedLRUCache 2023-01-04T18:09:20.417 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: block_cache_options: 2023-01-04T18:09:20.417 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: capacity : 536870912 2023-01-04T18:09:20.417 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: num_shard_bits : 4 2023-01-04T18:09:20.417 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: strict_capacity_limit : 0 2023-01-04T18:09:20.417 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: high_pri_pool_ratio: 0.000 2023-01-04T18:09:20.417 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: block_cache_compressed: (nil) 2023-01-04T18:09:20.418 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: persistent_cache: (nil) 2023-01-04T18:09:20.418 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: block_size: 4096 2023-01-04T18:09:20.418 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: block_size_deviation: 10 2023-01-04T18:09:20.418 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: block_restart_interval: 16 2023-01-04T18:09:20.418 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: index_block_restart_interval: 1 2023-01-04T18:09:20.418 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: metadata_block_size: 4096 2023-01-04T18:09:20.418 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: partition_filters: 0 2023-01-04T18:09:20.418 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: use_delta_encoding: 1 2023-01-04T18:09:20.418 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: filter_policy: rocksdb.BuiltinBloomFilter 2023-01-04T18:09:20.418 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: whole_key_filtering: 1 2023-01-04T18:09:20.418 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: verify_compression: 0 2023-01-04T18:09:20.418 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: read_amp_bytes_per_bit: 0 2023-01-04T18:09:20.419 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: format_version: 2 2023-01-04T18:09:20.419 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: enable_index_compression: 1 2023-01-04T18:09:20.419 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: block_align: 0 2023-01-04T18:09:20.419 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: 2023-01-04T18:09:20.419 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.write_buffer_size: 33554432 2023-01-04T18:09:20.419 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_write_buffer_number: 2 2023-01-04T18:09:20.419 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.compression: NoCompression 2023-01-04T18:09:20.419 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.bottommost_compression: Disabled 2023-01-04T18:09:20.419 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.prefix_extractor: nullptr 2023-01-04T18:09:20.419 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-01-04T18:09:20.419 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.num_levels: 7 2023-01-04T18:09:20.419 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-01-04T18:09:20.420 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-01-04T18:09:20.420 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-01-04T18:09:20.420 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-01-04T18:09:20.420 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-01-04T18:09:20.420 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-01-04T18:09:20.420 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-01-04T18:09:20.420 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-01-04T18:09:20.420 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-01-04T18:09:20.420 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.compression_opts.window_bits: -14 2023-01-04T18:09:20.420 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.compression_opts.level: 32767 2023-01-04T18:09:20.420 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.compression_opts.strategy: 0 2023-01-04T18:09:20.421 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-01-04T18:09:20.421 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-01-04T18:09:20.421 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.compression_opts.enabled: false 2023-01-04T18:09:20.421 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-01-04T18:09:20.421 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-01-04T18:09:20.421 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-01-04T18:09:20.421 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.target_file_size_base: 67108864 2023-01-04T18:09:20.421 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.target_file_size_multiplier: 1 2023-01-04T18:09:20.421 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-01-04T18:09:20.421 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-01-04T18:09:20.421 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-01-04T18:09:20.422 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-01-04T18:09:20.422 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-01-04T18:09:20.422 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-01-04T18:09:20.422 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-01-04T18:09:20.422 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-01-04T18:09:20.422 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-01-04T18:09:20.422 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-01-04T18:09:20.422 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-01-04T18:09:20.422 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-01-04T18:09:20.422 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.arena_block_size: 4194304 2023-01-04T18:09:20.422 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-01-04T18:09:20.422 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-01-04T18:09:20.423 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-01-04T18:09:20.423 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.disable_auto_compactions: 0 2023-01-04T18:09:20.423 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-01-04T18:09:20.423 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-01-04T18:09:20.423 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-01-04T18:09:20.423 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-01-04T18:09:20.423 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-01-04T18:09:20.424 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-01-04T18:09:20.424 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-01-04T18:09:20.424 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-01-04T18:09:20.424 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-01-04T18:09:20.425 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-01-04T18:09:20.425 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.table_properties_collectors: 2023-01-04T18:09:20.425 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.inplace_update_support: 0 2023-01-04T18:09:20.425 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-01-04T18:09:20.425 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-01-04T18:09:20.425 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-01-04T18:09:20.425 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.memtable_huge_page_size: 0 2023-01-04T18:09:20.425 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.bloom_locality: 0 2023-01-04T18:09:20.425 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.max_successive_merges: 0 2023-01-04T18:09:20.425 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-01-04T18:09:20.425 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.paranoid_file_checks: 0 2023-01-04T18:09:20.425 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.force_consistency_checks: 0 2023-01-04T18:09:20.426 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.report_bg_io_stats: 0 2023-01-04T18:09:20.426 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.ttl: 2592000 2023-01-04T18:09:20.426 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.150+0000 7fd812601700 4 rocksdb: Options.periodic_compaction_seconds: 0 2023-01-04T18:09:20.426 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.151+0000 7fd812601700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi050/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-01-04T18:09:20.426 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: 2023-01-04T18:09:20.426 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.151+0000 7fd812601700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2023-01-04T18:09:20.426 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: 2023-01-04T18:09:20.426 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.151+0000 7fd812601700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1672855760151658, "job": 1, "event": "recovery_started", "log_files": [6]} 2023-01-04T18:09:20.426 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.151+0000 7fd812601700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2023-01-04T18:09:20.426 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.151+0000 7fd812601700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-01-04T18:09:20.426 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.152+0000 7fd812601700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1672855760152562, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 88256, "table_properties": {"data_size": 86383, "index_size": 350, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 709, "raw_key_size": 12269, "raw_average_key_size": 49, "raw_value_size": 79597, "raw_average_value_size": 322, "num_data_blocks": 11, "num_entries": 247, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1672855760, "oldest_key_time": 3, "file_creation_time": 0}} 2023-01-04T18:09:20.427 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.152+0000 7fd812601700 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2023-01-04T18:09:20.427 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: 2023-01-04T18:09:20.427 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.152+0000 7fd812601700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1672855760152956, "job": 1, "event": "recovery_finished"} 2023-01-04T18:09:20.427 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.153+0000 7fd812601700 4 rocksdb: DB pointer 0x5610d547f800 2023-01-04T18:09:20.427 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.153+0000 7fd7f9419700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2023-01-04T18:09:20.427 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.153+0000 7fd7f9419700 4 rocksdb: [db_impl/db_impl.cc:851] 2023-01-04T18:09:20.427 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: ** DB Stats ** 2023-01-04T18:09:20.427 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Uptime(secs): 0.0 total, 0.0 interval 2023-01-04T18:09:20.427 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-01-04T18:09:20.427 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-01-04T18:09:20.427 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-01-04T18:09:20.428 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-01-04T18:09:20.428 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-01-04T18:09:20.428 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-01-04T18:09:20.428 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: 2023-01-04T18:09:20.428 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: ** Compaction Stats [default] ** 2023-01-04T18:09:20.428 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-04T18:09:20.428 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-04T18:09:20.428 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: L0 2/0 87.88 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 142.2 0.00 0.00 1 0.001 0 0 2023-01-04T18:09:20.428 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Sum 2/0 87.88 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 142.2 0.00 0.00 1 0.001 0 0 2023-01-04T18:09:20.428 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 142.2 0.00 0.00 1 0.001 0 0 2023-01-04T18:09:20.428 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: 2023-01-04T18:09:20.428 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: ** Compaction Stats [default] ** 2023-01-04T18:09:20.429 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-04T18:09:20.429 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-04T18:09:20.429 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 142.2 0.00 0.00 1 0.001 0 0 2023-01-04T18:09:20.429 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Uptime(secs): 0.0 total, 0.0 interval 2023-01-04T18:09:20.429 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Flush(GB): cumulative 0.000, interval 0.000 2023-01-04T18:09:20.429 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: AddFile(GB): cumulative 0.000, interval 0.000 2023-01-04T18:09:20.429 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: AddFile(Total Files): cumulative 0, interval 0 2023-01-04T18:09:20.429 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: AddFile(L0 Files): cumulative 0, interval 0 2023-01-04T18:09:20.429 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: AddFile(Keys): cumulative 0, interval 0 2023-01-04T18:09:20.429 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Cumulative compaction: 0.00 GB write, 29.84 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-04T18:09:20.429 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Interval compaction: 0.00 GB write, 29.84 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-04T18:09:20.430 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-01-04T18:09:20.430 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: 2023-01-04T18:09:20.430 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: ** File Read Latency Histogram By Level [default] ** 2023-01-04T18:09:20.430 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: 2023-01-04T18:09:20.430 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: ** Compaction Stats [default] ** 2023-01-04T18:09:20.430 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-04T18:09:20.430 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-04T18:09:20.430 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: L0 2/0 87.88 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 142.2 0.00 0.00 1 0.001 0 0 2023-01-04T18:09:20.430 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Sum 2/0 87.88 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 142.2 0.00 0.00 1 0.001 0 0 2023-01-04T18:09:20.430 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-01-04T18:09:20.430 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: 2023-01-04T18:09:20.430 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: ** Compaction Stats [default] ** 2023-01-04T18:09:20.431 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-04T18:09:20.431 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-04T18:09:20.431 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 142.2 0.00 0.00 1 0.001 0 0 2023-01-04T18:09:20.431 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Uptime(secs): 0.0 total, 0.0 interval 2023-01-04T18:09:20.431 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Flush(GB): cumulative 0.000, interval 0.000 2023-01-04T18:09:20.431 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: AddFile(GB): cumulative 0.000, interval 0.000 2023-01-04T18:09:20.431 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: AddFile(Total Files): cumulative 0, interval 0 2023-01-04T18:09:20.431 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: AddFile(L0 Files): cumulative 0, interval 0 2023-01-04T18:09:20.431 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: AddFile(Keys): cumulative 0, interval 0 2023-01-04T18:09:20.431 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Cumulative compaction: 0.00 GB write, 29.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-04T18:09:20.431 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-04T18:09:20.432 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-01-04T18:09:20.432 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: 2023-01-04T18:09:20.432 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: ** File Read Latency Histogram By Level [default] ** 2023-01-04T18:09:20.432 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: 2023-01-04T18:09:20.432 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.153+0000 7fd812601700 0 starting mon.smithi050 rank 0 at public addrs [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] at bind addrs [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi050 fsid d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:09:20.432 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.154+0000 7fd812601700 1 mon.smithi050@-1(???) e1 preinit fsid d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:09:20.432 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.155+0000 7fd812601700 0 mon.smithi050@-1(???).mds e1 new map 2023-01-04T18:09:20.432 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.155+0000 7fd812601700 0 mon.smithi050@-1(???).mds e1 print_map 2023-01-04T18:09:20.432 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: e1 2023-01-04T18:09:20.432 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:09:20.432 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:09:20.433 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: legacy client fscid: -1 2023-01-04T18:09:20.433 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: 2023-01-04T18:09:20.433 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: No filesystems configured 2023-01-04T18:09:20.433 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: 2023-01-04T18:09:20.433 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.155+0000 7fd812601700 0 mon.smithi050@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-01-04T18:09:20.433 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.155+0000 7fd812601700 0 mon.smithi050@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-01-04T18:09:20.433 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.155+0000 7fd812601700 0 mon.smithi050@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-01-04T18:09:20.433 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.155+0000 7fd812601700 0 mon.smithi050@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-01-04T18:09:20.433 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:17.492789+0000 mon.smithi050 (mon.0) 8 : audit [INF] from='client.? 172.21.15.50:0/3163848410' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-01-04T18:09:20.433 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:17.496277+0000 mon.smithi050 (mon.0) 9 : audit [INF] from='client.? 172.21.15.50:0/3163848410' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-01-04T18:09:20.433 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.155+0000 7fd812601700 1 mon.smithi050@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-01-04T18:09:20.433 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.156+0000 7fd812601700 20 expand_channel_meta expand map: {default=false} 2023-01-04T18:09:20.434 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.156+0000 7fd812601700 20 expand_channel_meta from 'false' to 'false' 2023-01-04T18:09:20.434 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.156+0000 7fd812601700 20 expand_channel_meta expanded map: {default=false} 2023-01-04T18:09:20.434 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.156+0000 7fd812601700 20 expand_channel_meta expand map: {default=info} 2023-01-04T18:09:20.434 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.156+0000 7fd812601700 20 expand_channel_meta from 'info' to 'info' 2023-01-04T18:09:20.434 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.156+0000 7fd812601700 20 expand_channel_meta expanded map: {default=info} 2023-01-04T18:09:20.434 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.156+0000 7fd812601700 20 expand_channel_meta expand map: {default=daemon} 2023-01-04T18:09:20.434 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.156+0000 7fd812601700 20 expand_channel_meta from 'daemon' to 'daemon' 2023-01-04T18:09:20.434 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.156+0000 7fd812601700 20 expand_channel_meta expanded map: {default=daemon} 2023-01-04T18:09:20.434 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.156+0000 7fd812601700 20 expand_channel_meta expand map: {default=debug} 2023-01-04T18:09:20.434 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.156+0000 7fd812601700 20 expand_channel_meta from 'debug' to 'debug' 2023-01-04T18:09:20.434 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:09:20.156+0000 7fd812601700 20 expand_channel_meta expanded map: {default=debug} 2023-01-04T18:09:20.435 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:20 smithi050 systemd[1]: Started Ceph mon.smithi050 for d98671da-8c5a-11ed-821a-001a4aab830c. 2023-01-04T18:09:20.627 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.625+0000 7fa58759e700 1 Processor -- start 2023-01-04T18:09:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.625+0000 7fa58759e700 1 -- start start 2023-01-04T18:09:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.625+0000 7fa58759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880fb9a0 0x7fa5880fbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.625+0000 7fa58759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880fc2b0 con 0x7fa5880fb9a0 2023-01-04T18:09:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.625+0000 7fa58659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880fb9a0 0x7fa5880fbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.625+0000 7fa58659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880fb9a0 0x7fa5880fbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60856/0 (socket says 172.21.15.50:60856) 2023-01-04T18:09:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.625+0000 7fa58659c700 1 -- 172.21.15.50:0/1092053014 learned_addr learned my addr 172.21.15.50:0/1092053014 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.626+0000 7fa58659c700 1 -- 172.21.15.50:0/1092053014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5880fc3f0 con 0x7fa5880fb9a0 2023-01-04T18:09:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.626+0000 7fa58659c700 1 --2- 172.21.15.50:0/1092053014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880fb9a0 0x7fa5880fbdc0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fa580009960 tx=0x7fa5800092d0).ready entity=mon.0 client_cookie=d0f10b5b3e8081c3 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.626+0000 7fa58559a700 1 -- 172.21.15.50:0/1092053014 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa58000b9c0 con 0x7fa5880fb9a0 2023-01-04T18:09:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.626+0000 7fa58559a700 1 -- 172.21.15.50:0/1092053014 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fa580011400 con 0x7fa5880fb9a0 2023-01-04T18:09:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.626+0000 7fa58559a700 1 -- 172.21.15.50:0/1092053014 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa5800103a0 con 0x7fa5880fb9a0 2023-01-04T18:09:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.627+0000 7fa58759e700 1 -- 172.21.15.50:0/1092053014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880fb9a0 msgr2=0x7fa5880fbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.627+0000 7fa58759e700 1 --2- 172.21.15.50:0/1092053014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880fb9a0 0x7fa5880fbdc0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fa580009960 tx=0x7fa5800092d0).stop 2023-01-04T18:09:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.627+0000 7fa58759e700 1 -- 172.21.15.50:0/1092053014 shutdown_connections 2023-01-04T18:09:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.627+0000 7fa58759e700 1 --2- 172.21.15.50:0/1092053014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880fb9a0 0x7fa5880fbdc0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:20.632 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.627+0000 7fa58759e700 1 -- 172.21.15.50:0/1092053014 >> 172.21.15.50:0/1092053014 conn(0x7fa5880f7200 msgr2=0x7fa5880f9620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:20.632 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.627+0000 7fa58759e700 1 -- 172.21.15.50:0/1092053014 shutdown_connections 2023-01-04T18:09:20.632 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.627+0000 7fa58759e700 1 -- 172.21.15.50:0/1092053014 wait complete. 2023-01-04T18:09:20.632 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.627+0000 7fa58759e700 1 Processor -- start 2023-01-04T18:09:20.632 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.628+0000 7fa58759e700 1 -- start start 2023-01-04T18:09:20.632 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.628+0000 7fa58759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880fb9a0 0x7fa58810a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:20.632 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.628+0000 7fa58759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58810ac80 con 0x7fa5880fb9a0 2023-01-04T18:09:20.632 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.628+0000 7fa58659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880fb9a0 0x7fa58810a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:20.633 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.628+0000 7fa58659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880fb9a0 0x7fa58810a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60858/0 (socket says 172.21.15.50:60858) 2023-01-04T18:09:20.633 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.628+0000 7fa58659c700 1 -- 172.21.15.50:0/495448469 learned_addr learned my addr 172.21.15.50:0/495448469 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:20.633 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.628+0000 7fa58659c700 1 -- 172.21.15.50:0/495448469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa580009570 con 0x7fa5880fb9a0 2023-01-04T18:09:20.633 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.628+0000 7fa58659c700 1 --2- 172.21.15.50:0/495448469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880fb9a0 0x7fa58810a790 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7fa58000ba90 tx=0x7fa5800092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:20.633 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.629+0000 7fa57effd700 1 -- 172.21.15.50:0/495448469 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa580010870 con 0x7fa5880fb9a0 2023-01-04T18:09:20.633 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.629+0000 7fa57effd700 1 -- 172.21.15.50:0/495448469 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fa580010e40 con 0x7fa5880fb9a0 2023-01-04T18:09:20.633 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.629+0000 7fa58759e700 1 -- 172.21.15.50:0/495448469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa58810ae80 con 0x7fa5880fb9a0 2023-01-04T18:09:20.633 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.629+0000 7fa57effd700 1 -- 172.21.15.50:0/495448469 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa58001ae10 con 0x7fa5880fb9a0 2023-01-04T18:09:20.633 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.629+0000 7fa58759e700 1 -- 172.21.15.50:0/495448469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58810b290 con 0x7fa5880fb9a0 2023-01-04T18:09:20.633 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.629+0000 7fa57effd700 1 -- 172.21.15.50:0/495448469 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fa58002a070 con 0x7fa5880fb9a0 2023-01-04T18:09:20.633 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.629+0000 7fa57effd700 1 -- 172.21.15.50:0/495448469 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fa580022780 con 0x7fa5880fb9a0 2023-01-04T18:09:20.633 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.630+0000 7fa58759e700 1 -- 172.21.15.50:0/495448469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa588045ad0 con 0x7fa5880fb9a0 2023-01-04T18:09:20.634 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.632+0000 7fa57effd700 1 -- 172.21.15.50:0/495448469 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7fa580028060 con 0x7fa5880fb9a0 2023-01-04T18:09:20.701 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.699+0000 7fa58759e700 1 -- 172.21.15.50:0/495448469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fa5881046f0 con 0x7fa5880fb9a0 2023-01-04T18:09:20.703 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.701+0000 7fa57effd700 1 -- 172.21.15.50:0/495448469 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa58001e030 con 0x7fa5880fb9a0 2023-01-04T18:09:20.704 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.702+0000 7fa58759e700 1 -- 172.21.15.50:0/495448469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880fb9a0 msgr2=0x7fa58810a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:20.704 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.702+0000 7fa58759e700 1 --2- 172.21.15.50:0/495448469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880fb9a0 0x7fa58810a790 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7fa58000ba90 tx=0x7fa5800092d0).stop 2023-01-04T18:09:20.705 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.702+0000 7fa58759e700 1 -- 172.21.15.50:0/495448469 shutdown_connections 2023-01-04T18:09:20.705 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.702+0000 7fa58759e700 1 --2- 172.21.15.50:0/495448469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5880fb9a0 0x7fa58810a790 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:20.705 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.702+0000 7fa58759e700 1 -- 172.21.15.50:0/495448469 >> 172.21.15.50:0/495448469 conn(0x7fa5880f7200 msgr2=0x7fa5880f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:20.705 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.702+0000 7fa58759e700 1 -- 172.21.15.50:0/495448469 shutdown_connections 2023-01-04T18:09:20.705 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:20.702+0000 7fa58759e700 1 -- 172.21.15.50:0/495448469 wait complete. 2023-01-04T18:09:21.158 INFO:teuthology.orchestra.run.smithi050.stderr:Wrote config to /etc/ceph/ceph.conf 2023-01-04T18:09:21.158 INFO:teuthology.orchestra.run.smithi050.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-01-04T18:09:21.158 INFO:teuthology.orchestra.run.smithi050.stderr:Creating mgr... 2023-01-04T18:09:21.158 INFO:teuthology.orchestra.run.smithi050.stderr:Verifying port 9283 ... 2023-01-04T18:09:21.160 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl daemon-reload 2023-01-04T18:09:21.261 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl stop ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mgr.smithi050.emnywo 2023-01-04T18:09:21.286 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl reset-failed ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mgr.smithi050.emnywo 2023-01-04T18:09:21.292 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: Failed to reset failed state of unit ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mgr.smithi050.emnywo.service: Unit ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mgr.smithi050.emnywo.service not loaded. 2023-01-04T18:09:21.292 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl enable ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mgr.smithi050.emnywo 2023-01-04T18:09:21.298 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: Created symlink /etc/systemd/system/ceph-d98671da-8c5a-11ed-821a-001a4aab830c.target.wants/ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mgr.smithi050.emnywo.service → /etc/systemd/system/ceph-d98671da-8c5a-11ed-821a-001a4aab830c@.service. 2023-01-04T18:09:21.389 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl start ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mgr.smithi050.emnywo 2023-01-04T18:09:21.396 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:20.172131+0000 mon.smithi050 (mon.0) 1 : cluster [INF] mon.smithi050 is new leader, mons smithi050 in quorum (ranks 0) 2023-01-04T18:09:21.396 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:20.172176+0000 mon.smithi050 (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {smithi050=[v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0]} 2023-01-04T18:09:21.396 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:20.172206+0000 mon.smithi050 (mon.0) 3 : cluster [DBG] fsmap 2023-01-04T18:09:21.396 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:20.172237+0000 mon.smithi050 (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2023-01-04T18:09:21.396 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:20.172549+0000 mon.smithi050 (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2023-01-04T18:09:21.397 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:20.701641+0000 mon.smithi050 (mon.0) 6 : audit [INF] from='client.? 172.21.15.50:0/495448469' entity='client.admin' 2023-01-04T18:09:22.107 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl is-enabled firewalld.service 2023-01-04T18:09:22.115 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: disabled 2023-01-04T18:09:22.116 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl is-active firewalld.service 2023-01-04T18:09:22.124 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: inactive 2023-01-04T18:09:22.124 INFO:teuthology.orchestra.run.smithi050.stderr:firewalld.service is not enabled 2023-01-04T18:09:22.125 INFO:teuthology.orchestra.run.smithi050.stderr:Not possible to enable service . firewalld.service is not available 2023-01-04T18:09:22.125 INFO:teuthology.orchestra.run.smithi050.stderr:Not possible to open ports <[]>. firewalld.service is not available 2023-01-04T18:09:22.125 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl is-enabled firewalld.service 2023-01-04T18:09:22.132 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: disabled 2023-01-04T18:09:22.133 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl is-active firewalld.service 2023-01-04T18:09:22.140 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: inactive 2023-01-04T18:09:22.141 INFO:teuthology.orchestra.run.smithi050.stderr:firewalld.service is not enabled 2023-01-04T18:09:22.141 INFO:teuthology.orchestra.run.smithi050.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2023-01-04T18:09:22.141 INFO:teuthology.orchestra.run.smithi050.stderr:Waiting for mgr to start... 2023-01-04T18:09:22.141 INFO:teuthology.orchestra.run.smithi050.stderr:Waiting for mgr... 2023-01-04T18:09:22.142 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2023-01-04T18:09:22.618 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.614+0000 7f436d49d700 1 Processor -- start 2023-01-04T18:09:22.618 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.614+0000 7f436d49d700 1 -- start start 2023-01-04T18:09:22.618 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.614+0000 7f436d49d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f436806fc30 0x7f43680fe690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:22.618 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.614+0000 7f436d49d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43680feb80 con 0x7f436806fc30 2023-01-04T18:09:22.618 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.615+0000 7f4366ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f436806fc30 0x7f43680fe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:22.618 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.615+0000 7f4366ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f436806fc30 0x7f43680fe690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60890/0 (socket says 172.21.15.50:60890) 2023-01-04T18:09:22.618 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.615+0000 7f4366ffd700 1 -- 172.21.15.50:0/246170975 learned_addr learned my addr 172.21.15.50:0/246170975 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:22.618 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.615+0000 7f4366ffd700 1 -- 172.21.15.50:0/246170975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43680fecc0 con 0x7f436806fc30 2023-01-04T18:09:22.618 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.615+0000 7f4366ffd700 1 --2- 172.21.15.50:0/246170975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f436806fc30 0x7f43680fe690 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f435800b5f0 tx=0x7f4358006ee0).ready entity=mon.0 client_cookie=c0f3ff18a2149cfe server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:22.620 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.615+0000 7f4365ffb700 1 -- 172.21.15.50:0/246170975 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f435800d600 con 0x7f436806fc30 2023-01-04T18:09:22.620 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.615+0000 7f4365ffb700 1 -- 172.21.15.50:0/246170975 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f435800dbd0 con 0x7f436806fc30 2023-01-04T18:09:22.620 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.615+0000 7f4365ffb700 1 -- 172.21.15.50:0/246170975 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4358011c00 con 0x7f436806fc30 2023-01-04T18:09:22.620 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.616+0000 7f436d49d700 1 -- 172.21.15.50:0/246170975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f436806fc30 msgr2=0x7f43680fe690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:22.621 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.616+0000 7f436d49d700 1 --2- 172.21.15.50:0/246170975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f436806fc30 0x7f43680fe690 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f435800b5f0 tx=0x7f4358006ee0).stop 2023-01-04T18:09:22.621 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.616+0000 7f436d49d700 1 -- 172.21.15.50:0/246170975 shutdown_connections 2023-01-04T18:09:22.621 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.616+0000 7f436d49d700 1 --2- 172.21.15.50:0/246170975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f436806fc30 0x7f43680fe690 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:22.621 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.616+0000 7f436d49d700 1 -- 172.21.15.50:0/246170975 >> 172.21.15.50:0/246170975 conn(0x7f43680f6170 msgr2=0x7f43680f8590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:22.621 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.616+0000 7f436d49d700 1 -- 172.21.15.50:0/246170975 shutdown_connections 2023-01-04T18:09:22.621 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.616+0000 7f436d49d700 1 -- 172.21.15.50:0/246170975 wait complete. 2023-01-04T18:09:22.621 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.617+0000 7f436d49d700 1 Processor -- start 2023-01-04T18:09:22.621 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.617+0000 7f436d49d700 1 -- start start 2023-01-04T18:09:22.621 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.617+0000 7f436d49d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f436806fc30 0x7f436810a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:22.621 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.617+0000 7f436d49d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436810ad00 con 0x7f436806fc30 2023-01-04T18:09:22.621 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.617+0000 7f4366ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f436806fc30 0x7f436810a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:22.622 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.617+0000 7f4366ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f436806fc30 0x7f436810a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60906/0 (socket says 172.21.15.50:60906) 2023-01-04T18:09:22.622 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.617+0000 7f4366ffd700 1 -- 172.21.15.50:0/2794876875 learned_addr learned my addr 172.21.15.50:0/2794876875 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:22.622 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.618+0000 7f4366ffd700 1 -- 172.21.15.50:0/2794876875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435800b200 con 0x7f436806fc30 2023-01-04T18:09:22.622 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.618+0000 7f4366ffd700 1 --2- 172.21.15.50:0/2794876875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f436806fc30 0x7f436810a810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f435800e040 tx=0x7f4358006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:22.622 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.618+0000 7f434f7fe700 1 -- 172.21.15.50:0/2794876875 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f435800d9f0 con 0x7f436806fc30 2023-01-04T18:09:22.622 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.618+0000 7f436d49d700 1 -- 172.21.15.50:0/2794876875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436810af00 con 0x7f436806fc30 2023-01-04T18:09:22.622 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.618+0000 7f434f7fe700 1 -- 172.21.15.50:0/2794876875 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f435801a9f0 con 0x7f436806fc30 2023-01-04T18:09:22.622 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.618+0000 7f434f7fe700 1 -- 172.21.15.50:0/2794876875 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f435801b8c0 con 0x7f436806fc30 2023-01-04T18:09:22.622 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.618+0000 7f436d49d700 1 -- 172.21.15.50:0/2794876875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436810b310 con 0x7f436806fc30 2023-01-04T18:09:22.623 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.618+0000 7f434f7fe700 1 -- 172.21.15.50:0/2794876875 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f435800f070 con 0x7f436806fc30 2023-01-04T18:09:22.623 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.618+0000 7f434f7fe700 1 -- 172.21.15.50:0/2794876875 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f4358025b30 con 0x7f436806fc30 2023-01-04T18:09:22.623 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.619+0000 7f436d49d700 1 -- 172.21.15.50:0/2794876875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4368045ad0 con 0x7f436806fc30 2023-01-04T18:09:22.624 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.622+0000 7f434f7fe700 1 -- 172.21.15.50:0/2794876875 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f4358016070 con 0x7f436806fc30 2023-01-04T18:09:22.696 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.694+0000 7f436d49d700 1 -- 172.21.15.50:0/2794876875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f4368104660 con 0x7f436806fc30 2023-01-04T18:09:22.696 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.694+0000 7f434f7fe700 1 -- 172.21.15.50:0/2794876875 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1230 (secure 0 0 0) 0x7f435801bd70 con 0x7f436806fc30 2023-01-04T18:09:22.698 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.698 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: { 2023-01-04T18:09:22.698 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "fsid": "d98671da-8c5a-11ed-821a-001a4aab830c", 2023-01-04T18:09:22.698 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "health": { 2023-01-04T18:09:22.698 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2023-01-04T18:09:22.698 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "checks": {}, 2023-01-04T18:09:22.698 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "mutes": [] 2023-01-04T18:09:22.698 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: }, 2023-01-04T18:09:22.699 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "election_epoch": 5, 2023-01-04T18:09:22.699 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "quorum": [ 2023-01-04T18:09:22.699 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 0 2023-01-04T18:09:22.699 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: ], 2023-01-04T18:09:22.699 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "quorum_names": [ 2023-01-04T18:09:22.699 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "smithi050" 2023-01-04T18:09:22.702 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: ], 2023-01-04T18:09:22.702 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "quorum_age": 2, 2023-01-04T18:09:22.702 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "monmap": { 2023-01-04T18:09:22.703 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "epoch": 1, 2023-01-04T18:09:22.703 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2023-01-04T18:09:22.703 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_mons": 1 2023-01-04T18:09:22.703 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: }, 2023-01-04T18:09:22.703 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "osdmap": { 2023-01-04T18:09:22.703 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "epoch": 1, 2023-01-04T18:09:22.703 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_osds": 0, 2023-01-04T18:09:22.703 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_up_osds": 0, 2023-01-04T18:09:22.703 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "osd_up_since": 0, 2023-01-04T18:09:22.704 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_in_osds": 0, 2023-01-04T18:09:22.704 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "osd_in_since": 0, 2023-01-04T18:09:22.704 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2023-01-04T18:09:22.704 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: }, 2023-01-04T18:09:22.704 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "pgmap": { 2023-01-04T18:09:22.704 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "pgs_by_state": [], 2023-01-04T18:09:22.704 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_pgs": 0, 2023-01-04T18:09:22.704 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_pools": 0, 2023-01-04T18:09:22.704 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_objects": 0, 2023-01-04T18:09:22.704 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "data_bytes": 0, 2023-01-04T18:09:22.704 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "bytes_used": 0, 2023-01-04T18:09:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "bytes_avail": 0, 2023-01-04T18:09:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "bytes_total": 0 2023-01-04T18:09:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: }, 2023-01-04T18:09:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "fsmap": { 2023-01-04T18:09:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "epoch": 1, 2023-01-04T18:09:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "by_rank": [], 2023-01-04T18:09:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "up:standby": 0 2023-01-04T18:09:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: }, 2023-01-04T18:09:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "mgrmap": { 2023-01-04T18:09:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "available": false, 2023-01-04T18:09:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_standbys": 0, 2023-01-04T18:09:22.708 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "modules": [ 2023-01-04T18:09:22.708 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "iostat", 2023-01-04T18:09:22.708 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "restful" 2023-01-04T18:09:22.708 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: ], 2023-01-04T18:09:22.708 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "services": {} 2023-01-04T18:09:22.708 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: }, 2023-01-04T18:09:22.708 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "servicemap": { 2023-01-04T18:09:22.708 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "epoch": 1, 2023-01-04T18:09:22.708 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "modified": "2023-01-04T18:09:16.009794+0000", 2023-01-04T18:09:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "services": {} 2023-01-04T18:09:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: }, 2023-01-04T18:09:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "progress_events": {} 2023-01-04T18:09:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: } 2023-01-04T18:09:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.695+0000 7f436d49d700 1 -- 172.21.15.50:0/2794876875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f436806fc30 msgr2=0x7f436810a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.695+0000 7f436d49d700 1 --2- 172.21.15.50:0/2794876875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f436806fc30 0x7f436810a810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f435800e040 tx=0x7f4358006ee0).stop 2023-01-04T18:09:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.695+0000 7f436d49d700 1 -- 172.21.15.50:0/2794876875 shutdown_connections 2023-01-04T18:09:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.695+0000 7f436d49d700 1 --2- 172.21.15.50:0/2794876875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f436806fc30 0x7f436810a810 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.695+0000 7f436d49d700 1 -- 172.21.15.50:0/2794876875 >> 172.21.15.50:0/2794876875 conn(0x7f43680f6170 msgr2=0x7f43680f7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.695+0000 7f436d49d700 1 -- 172.21.15.50:0/2794876875 shutdown_connections 2023-01-04T18:09:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:22.695+0000 7f436d49d700 1 -- 172.21.15.50:0/2794876875 wait complete. 2023-01-04T18:09:23.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:22.694705+0000 mon.smithi050 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.50:0/2794876875' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-01-04T18:09:23.088 INFO:teuthology.orchestra.run.smithi050.stderr:mgr not available, waiting (1/15)... 2023-01-04T18:09:25.091 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2023-01-04T18:09:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.644+0000 7f6c533e1700 1 Processor -- start 2023-01-04T18:09:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.644+0000 7f6c533e1700 1 -- start start 2023-01-04T18:09:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.644+0000 7f6c533e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4c06fc70 0x7f6c4c100c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.644+0000 7f6c533e1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c0fc680 con 0x7f6c4c06fc70 2023-01-04T18:09:25.647 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.645+0000 7f6c5117d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4c06fc70 0x7f6c4c100c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:25.648 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.645+0000 7f6c5117d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4c06fc70 0x7f6c4c100c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60910/0 (socket says 172.21.15.50:60910) 2023-01-04T18:09:25.650 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.645+0000 7f6c5117d700 1 -- 172.21.15.50:0/1371914991 learned_addr learned my addr 172.21.15.50:0/1371914991 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:25.650 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.645+0000 7f6c5117d700 1 -- 172.21.15.50:0/1371914991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c1010f0 con 0x7f6c4c06fc70 2023-01-04T18:09:25.650 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.645+0000 7f6c5117d700 1 --2- 172.21.15.50:0/1371914991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4c06fc70 0x7f6c4c100c00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f6c4800b5f0 tx=0x7f6c48006ee0).ready entity=mon.0 client_cookie=fbce414ed50e2243 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:25.650 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.645+0000 7f6c3bfff700 1 -- 172.21.15.50:0/1371914991 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c4800d600 con 0x7f6c4c06fc70 2023-01-04T18:09:25.650 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.645+0000 7f6c3bfff700 1 -- 172.21.15.50:0/1371914991 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f6c4800dbd0 con 0x7f6c4c06fc70 2023-01-04T18:09:25.650 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.645+0000 7f6c3bfff700 1 -- 172.21.15.50:0/1371914991 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c48011c00 con 0x7f6c4c06fc70 2023-01-04T18:09:25.651 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.646+0000 7f6c533e1700 1 -- 172.21.15.50:0/1371914991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4c06fc70 msgr2=0x7f6c4c100c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:25.651 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.646+0000 7f6c533e1700 1 --2- 172.21.15.50:0/1371914991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4c06fc70 0x7f6c4c100c00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f6c4800b5f0 tx=0x7f6c48006ee0).stop 2023-01-04T18:09:25.651 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.646+0000 7f6c533e1700 1 -- 172.21.15.50:0/1371914991 shutdown_connections 2023-01-04T18:09:25.651 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.646+0000 7f6c533e1700 1 --2- 172.21.15.50:0/1371914991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4c06fc70 0x7f6c4c100c00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:25.651 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.646+0000 7f6c533e1700 1 -- 172.21.15.50:0/1371914991 >> 172.21.15.50:0/1371914991 conn(0x7f6c4c0f6280 msgr2=0x7f6c4c0f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:25.651 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.646+0000 7f6c533e1700 1 -- 172.21.15.50:0/1371914991 shutdown_connections 2023-01-04T18:09:25.651 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.646+0000 7f6c533e1700 1 -- 172.21.15.50:0/1371914991 wait complete. 2023-01-04T18:09:25.651 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.647+0000 7f6c533e1700 1 Processor -- start 2023-01-04T18:09:25.651 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.647+0000 7f6c533e1700 1 -- start start 2023-01-04T18:09:25.651 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.647+0000 7f6c533e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4c06fc70 0x7f6c4c10cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:25.651 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.647+0000 7f6c533e1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c10d090 con 0x7f6c4c06fc70 2023-01-04T18:09:25.652 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.647+0000 7f6c5117d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4c06fc70 0x7f6c4c10cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:25.652 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.647+0000 7f6c5117d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4c06fc70 0x7f6c4c10cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60920/0 (socket says 172.21.15.50:60920) 2023-01-04T18:09:25.652 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.647+0000 7f6c5117d700 1 -- 172.21.15.50:0/617488457 learned_addr learned my addr 172.21.15.50:0/617488457 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:25.652 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.648+0000 7f6c5117d700 1 -- 172.21.15.50:0/617488457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4800b200 con 0x7f6c4c06fc70 2023-01-04T18:09:25.652 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.648+0000 7f6c5117d700 1 --2- 172.21.15.50:0/617488457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4c06fc70 0x7f6c4c10cba0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f6c4800e040 tx=0x7f6c48006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:25.652 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.648+0000 7f6c39ffb700 1 -- 172.21.15.50:0/617488457 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c4801b410 con 0x7f6c4c06fc70 2023-01-04T18:09:25.652 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.648+0000 7f6c39ffb700 1 -- 172.21.15.50:0/617488457 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f6c4801b9e0 con 0x7f6c4c06fc70 2023-01-04T18:09:25.653 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.648+0000 7f6c533e1700 1 -- 172.21.15.50:0/617488457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4c10d290 con 0x7f6c4c06fc70 2023-01-04T18:09:25.653 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.648+0000 7f6c39ffb700 1 -- 172.21.15.50:0/617488457 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c4801a770 con 0x7f6c4c06fc70 2023-01-04T18:09:25.653 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.648+0000 7f6c533e1700 1 -- 172.21.15.50:0/617488457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4c10d6a0 con 0x7f6c4c06fc70 2023-01-04T18:09:25.653 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.649+0000 7f6c39ffb700 1 -- 172.21.15.50:0/617488457 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f6c4800f070 con 0x7f6c4c06fc70 2023-01-04T18:09:25.653 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.649+0000 7f6c39ffb700 1 -- 172.21.15.50:0/617488457 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f6c48024b50 con 0x7f6c4c06fc70 2023-01-04T18:09:25.653 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.649+0000 7f6c533e1700 1 -- 172.21.15.50:0/617488457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4c045ad0 con 0x7f6c4c06fc70 2023-01-04T18:09:25.653 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.651+0000 7f6c39ffb700 1 -- 172.21.15.50:0/617488457 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f6c48016070 con 0x7f6c4c06fc70 2023-01-04T18:09:25.724 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.721+0000 7f6c533e1700 1 -- 172.21.15.50:0/617488457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f6c4c106a20 con 0x7f6c4c06fc70 2023-01-04T18:09:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.721+0000 7f6c39ffb700 1 -- 172.21.15.50:0/617488457 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1230 (secure 0 0 0) 0x7f6c48024de0 con 0x7f6c4c06fc70 2023-01-04T18:09:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: { 2023-01-04T18:09:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "fsid": "d98671da-8c5a-11ed-821a-001a4aab830c", 2023-01-04T18:09:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "health": { 2023-01-04T18:09:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2023-01-04T18:09:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "checks": {}, 2023-01-04T18:09:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "mutes": [] 2023-01-04T18:09:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: }, 2023-01-04T18:09:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "election_epoch": 5, 2023-01-04T18:09:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "quorum": [ 2023-01-04T18:09:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 0 2023-01-04T18:09:25.726 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: ], 2023-01-04T18:09:25.731 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "quorum_names": [ 2023-01-04T18:09:25.731 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "smithi050" 2023-01-04T18:09:25.731 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: ], 2023-01-04T18:09:25.731 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "quorum_age": 5, 2023-01-04T18:09:25.731 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "monmap": { 2023-01-04T18:09:25.731 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "epoch": 1, 2023-01-04T18:09:25.731 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2023-01-04T18:09:25.731 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_mons": 1 2023-01-04T18:09:25.731 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: }, 2023-01-04T18:09:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "osdmap": { 2023-01-04T18:09:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "epoch": 1, 2023-01-04T18:09:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_osds": 0, 2023-01-04T18:09:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_up_osds": 0, 2023-01-04T18:09:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "osd_up_since": 0, 2023-01-04T18:09:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_in_osds": 0, 2023-01-04T18:09:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "osd_in_since": 0, 2023-01-04T18:09:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2023-01-04T18:09:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: }, 2023-01-04T18:09:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "pgmap": { 2023-01-04T18:09:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "pgs_by_state": [], 2023-01-04T18:09:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_pgs": 0, 2023-01-04T18:09:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_pools": 0, 2023-01-04T18:09:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_objects": 0, 2023-01-04T18:09:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "data_bytes": 0, 2023-01-04T18:09:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "bytes_used": 0, 2023-01-04T18:09:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "bytes_avail": 0, 2023-01-04T18:09:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "bytes_total": 0 2023-01-04T18:09:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: }, 2023-01-04T18:09:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "fsmap": { 2023-01-04T18:09:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "epoch": 1, 2023-01-04T18:09:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "by_rank": [], 2023-01-04T18:09:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "up:standby": 0 2023-01-04T18:09:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: }, 2023-01-04T18:09:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "mgrmap": { 2023-01-04T18:09:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "available": false, 2023-01-04T18:09:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_standbys": 0, 2023-01-04T18:09:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "modules": [ 2023-01-04T18:09:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "iostat", 2023-01-04T18:09:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "restful" 2023-01-04T18:09:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: ], 2023-01-04T18:09:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "services": {} 2023-01-04T18:09:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: }, 2023-01-04T18:09:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "servicemap": { 2023-01-04T18:09:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "epoch": 1, 2023-01-04T18:09:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "modified": "2023-01-04T18:09:16.009794+0000", 2023-01-04T18:09:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "services": {} 2023-01-04T18:09:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: }, 2023-01-04T18:09:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "progress_events": {} 2023-01-04T18:09:25.735 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: } 2023-01-04T18:09:25.735 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.722+0000 7f6c533e1700 1 -- 172.21.15.50:0/617488457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4c06fc70 msgr2=0x7f6c4c10cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:25.735 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.722+0000 7f6c533e1700 1 --2- 172.21.15.50:0/617488457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4c06fc70 0x7f6c4c10cba0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f6c4800e040 tx=0x7f6c48006ee0).stop 2023-01-04T18:09:25.735 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.722+0000 7f6c533e1700 1 -- 172.21.15.50:0/617488457 shutdown_connections 2023-01-04T18:09:25.735 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.722+0000 7f6c533e1700 1 --2- 172.21.15.50:0/617488457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4c06fc70 0x7f6c4c10cba0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:25.735 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.722+0000 7f6c533e1700 1 -- 172.21.15.50:0/617488457 >> 172.21.15.50:0/617488457 conn(0x7f6c4c0f6280 msgr2=0x7f6c4c0f7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:25.735 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.722+0000 7f6c533e1700 1 -- 172.21.15.50:0/617488457 shutdown_connections 2023-01-04T18:09:25.735 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:25.722+0000 7f6c533e1700 1 -- 172.21.15.50:0/617488457 wait complete. 2023-01-04T18:09:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:mgr not available, waiting (2/15)... 2023-01-04T18:09:26.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:25.721876+0000 mon.smithi050 (mon.0) 8 : audit [DBG] from='client.? 172.21.15.50:0/617488457' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-01-04T18:09:27.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:27.209260+0000 mon.smithi050 (mon.0) 9 : cluster [INF] Activating manager daemon smithi050.emnywo 2023-01-04T18:09:27.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:27.212007+0000 mon.smithi050 (mon.0) 10 : cluster [DBG] mgrmap e2: smithi050.emnywo(active, starting, since 0.00283331s) 2023-01-04T18:09:27.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:27.213035+0000 mon.smithi050 (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.15.50:0/3467761100' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-01-04T18:09:27.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:27.213238+0000 mon.smithi050 (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.50:0/3467761100' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-01-04T18:09:27.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:27.213385+0000 mon.smithi050 (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.50:0/3467761100' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-01-04T18:09:27.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:27.213552+0000 mon.smithi050 (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.50:0/3467761100' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi050"}]: dispatch 2023-01-04T18:09:27.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:27.213735+0000 mon.smithi050 (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.50:0/3467761100' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mgr metadata", "who": "smithi050.emnywo", "id": "smithi050.emnywo"}]: dispatch 2023-01-04T18:09:27.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:27.227003+0000 mon.smithi050 (mon.0) 16 : cluster [INF] Manager daemon smithi050.emnywo is now available 2023-01-04T18:09:27.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:27.235185+0000 mon.smithi050 (mon.0) 17 : audit [INF] from='mgr.14100 172.21.15.50:0/3467761100' entity='mgr.smithi050.emnywo' 2023-01-04T18:09:27.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:27.239174+0000 mon.smithi050 (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.50:0/3467761100' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:09:27.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:27.240390+0000 mon.smithi050 (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.50:0/3467761100' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:09:27.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:27.245600+0000 mon.smithi050 (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.50:0/3467761100' entity='mgr.smithi050.emnywo' 2023-01-04T18:09:27.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:27.247433+0000 mon.smithi050 (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.50:0/3467761100' entity='mgr.smithi050.emnywo' 2023-01-04T18:09:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2023-01-04T18:09:28.581 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.579+0000 7f5c9a5c5700 1 Processor -- start 2023-01-04T18:09:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.579+0000 7f5c9a5c5700 1 -- start start 2023-01-04T18:09:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.579+0000 7f5c9a5c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c9406fcd0 0x7f5c940fe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.579+0000 7f5c9a5c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940fed20 con 0x7f5c9406fcd0 2023-01-04T18:09:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.579+0000 7f5c93fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c9406fcd0 0x7f5c940fe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:28.586 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.579+0000 7f5c93fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c9406fcd0 0x7f5c940fe7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43350/0 (socket says 172.21.15.50:43350) 2023-01-04T18:09:28.587 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.579+0000 7f5c93fff700 1 -- 172.21.15.50:0/1051978219 learned_addr learned my addr 172.21.15.50:0/1051978219 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:28.587 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.580+0000 7f5c93fff700 1 -- 172.21.15.50:0/1051978219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c940fee60 con 0x7f5c9406fcd0 2023-01-04T18:09:28.587 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.580+0000 7f5c93fff700 1 --2- 172.21.15.50:0/1051978219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c9406fcd0 0x7f5c940fe7a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f5c8400b5f0 tx=0x7f5c84006ee0).ready entity=mon.0 client_cookie=3236717cdfd07bf0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:28.587 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.580+0000 7f5c92ffd700 1 -- 172.21.15.50:0/1051978219 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c8400d600 con 0x7f5c9406fcd0 2023-01-04T18:09:28.587 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.580+0000 7f5c92ffd700 1 -- 172.21.15.50:0/1051978219 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f5c8400dbd0 con 0x7f5c9406fcd0 2023-01-04T18:09:28.587 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.580+0000 7f5c92ffd700 1 -- 172.21.15.50:0/1051978219 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c84011c00 con 0x7f5c9406fcd0 2023-01-04T18:09:28.587 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.580+0000 7f5c9a5c5700 1 -- 172.21.15.50:0/1051978219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c9406fcd0 msgr2=0x7f5c940fe7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:28.587 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.580+0000 7f5c9a5c5700 1 --2- 172.21.15.50:0/1051978219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c9406fcd0 0x7f5c940fe7a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f5c8400b5f0 tx=0x7f5c84006ee0).stop 2023-01-04T18:09:28.587 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.580+0000 7f5c9a5c5700 1 -- 172.21.15.50:0/1051978219 shutdown_connections 2023-01-04T18:09:28.587 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.580+0000 7f5c9a5c5700 1 --2- 172.21.15.50:0/1051978219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c9406fcd0 0x7f5c940fe7a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:28.587 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.580+0000 7f5c9a5c5700 1 -- 172.21.15.50:0/1051978219 >> 172.21.15.50:0/1051978219 conn(0x7f5c940f6280 msgr2=0x7f5c940f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:28.588 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.580+0000 7f5c9a5c5700 1 -- 172.21.15.50:0/1051978219 shutdown_connections 2023-01-04T18:09:28.588 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.581+0000 7f5c9a5c5700 1 -- 172.21.15.50:0/1051978219 wait complete. 2023-01-04T18:09:28.588 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.581+0000 7f5c9a5c5700 1 Processor -- start 2023-01-04T18:09:28.588 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.581+0000 7f5c9a5c5700 1 -- start start 2023-01-04T18:09:28.588 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.582+0000 7f5c9a5c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c9406fcd0 0x7f5c9410cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:28.588 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.582+0000 7f5c9a5c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9410d0f0 con 0x7f5c9406fcd0 2023-01-04T18:09:28.588 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.582+0000 7f5c93fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c9406fcd0 0x7f5c9410cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:28.588 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.582+0000 7f5c93fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c9406fcd0 0x7f5c9410cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43362/0 (socket says 172.21.15.50:43362) 2023-01-04T18:09:28.588 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.582+0000 7f5c93fff700 1 -- 172.21.15.50:0/1140695462 learned_addr learned my addr 172.21.15.50:0/1140695462 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:28.588 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.582+0000 7f5c93fff700 1 -- 172.21.15.50:0/1140695462 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8400b200 con 0x7f5c9406fcd0 2023-01-04T18:09:28.588 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.582+0000 7f5c93fff700 1 --2- 172.21.15.50:0/1140695462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c9406fcd0 0x7f5c9410cc00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f5c84000c00 tx=0x7f5c84006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:28.589 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.582+0000 7f5c90ff9700 1 -- 172.21.15.50:0/1140695462 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c84011690 con 0x7f5c9406fcd0 2023-01-04T18:09:28.589 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.582+0000 7f5c9a5c5700 1 -- 172.21.15.50:0/1140695462 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c9410d2f0 con 0x7f5c9406fcd0 2023-01-04T18:09:28.589 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.582+0000 7f5c90ff9700 1 -- 172.21.15.50:0/1140695462 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f5c8400d9f0 con 0x7f5c9406fcd0 2023-01-04T18:09:28.589 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.582+0000 7f5c90ff9700 1 -- 172.21.15.50:0/1140695462 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c8401b710 con 0x7f5c9406fcd0 2023-01-04T18:09:28.589 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.582+0000 7f5c9a5c5700 1 -- 172.21.15.50:0/1140695462 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c9410d700 con 0x7f5c9406fcd0 2023-01-04T18:09:28.589 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.583+0000 7f5c90ff9700 1 -- 172.21.15.50:0/1140695462 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 36029+0+0 (secure 0 0 0) 0x7f5c8400f070 con 0x7f5c9406fcd0 2023-01-04T18:09:28.589 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.583+0000 7f5c90ff9700 1 --2- 172.21.15.50:0/1140695462 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7f5c8002fc50 0x7f5c80032110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:28.589 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.583+0000 7f5c90ff9700 1 -- 172.21.15.50:0/1140695462 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f5c84040ff0 con 0x7f5c9406fcd0 2023-01-04T18:09:28.589 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.583+0000 7f5c937fe700 1 --2- 172.21.15.50:0/1140695462 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7f5c8002fc50 0x7f5c80032110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:28.589 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.584+0000 7f5c9a5c5700 1 -- 172.21.15.50:0/1140695462 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c94059100 con 0x7f5c9406fcd0 2023-01-04T18:09:28.589 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.584+0000 7f5c937fe700 1 --2- 172.21.15.50:0/1140695462 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7f5c8002fc50 0x7f5c80032110 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f5c880096a0 tx=0x7f5c88006b40).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:28.590 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.588+0000 7f5c90ff9700 1 -- 172.21.15.50:0/1140695462 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f5c84016070 con 0x7f5c9406fcd0 2023-01-04T18:09:28.815 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.803+0000 7f5c9a5c5700 1 -- 172.21.15.50:0/1140695462 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f5c940ffb90 con 0x7f5c9406fcd0 2023-01-04T18:09:28.816 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.804+0000 7f5c90ff9700 1 -- 172.21.15.50:0/1140695462 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1229 (secure 0 0 0) 0x7f5c840226d0 con 0x7f5c9406fcd0 2023-01-04T18:09:28.816 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.816 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: { 2023-01-04T18:09:28.816 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "fsid": "d98671da-8c5a-11ed-821a-001a4aab830c", 2023-01-04T18:09:28.816 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "health": { 2023-01-04T18:09:28.816 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2023-01-04T18:09:28.816 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "checks": {}, 2023-01-04T18:09:28.816 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "mutes": [] 2023-01-04T18:09:28.816 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: }, 2023-01-04T18:09:28.817 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "election_epoch": 5, 2023-01-04T18:09:28.817 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "quorum": [ 2023-01-04T18:09:28.817 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 0 2023-01-04T18:09:28.817 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: ], 2023-01-04T18:09:28.817 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "quorum_names": [ 2023-01-04T18:09:28.817 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "smithi050" 2023-01-04T18:09:28.817 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: ], 2023-01-04T18:09:28.817 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "quorum_age": 8, 2023-01-04T18:09:28.817 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "monmap": { 2023-01-04T18:09:28.817 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "epoch": 1, 2023-01-04T18:09:28.817 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2023-01-04T18:09:28.817 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_mons": 1 2023-01-04T18:09:28.818 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: }, 2023-01-04T18:09:28.818 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "osdmap": { 2023-01-04T18:09:28.818 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "epoch": 1, 2023-01-04T18:09:28.818 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_osds": 0, 2023-01-04T18:09:28.818 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_up_osds": 0, 2023-01-04T18:09:28.818 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "osd_up_since": 0, 2023-01-04T18:09:28.818 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_in_osds": 0, 2023-01-04T18:09:28.818 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "osd_in_since": 0, 2023-01-04T18:09:28.818 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2023-01-04T18:09:28.818 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: }, 2023-01-04T18:09:28.818 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "pgmap": { 2023-01-04T18:09:28.819 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "pgs_by_state": [], 2023-01-04T18:09:28.819 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_pgs": 0, 2023-01-04T18:09:28.819 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_pools": 0, 2023-01-04T18:09:28.819 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_objects": 0, 2023-01-04T18:09:28.819 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "data_bytes": 0, 2023-01-04T18:09:28.819 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "bytes_used": 0, 2023-01-04T18:09:28.819 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "bytes_avail": 0, 2023-01-04T18:09:28.819 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "bytes_total": 0 2023-01-04T18:09:28.819 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: }, 2023-01-04T18:09:28.819 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "fsmap": { 2023-01-04T18:09:28.819 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "epoch": 1, 2023-01-04T18:09:28.819 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "by_rank": [], 2023-01-04T18:09:28.820 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "up:standby": 0 2023-01-04T18:09:28.820 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: }, 2023-01-04T18:09:28.820 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "mgrmap": { 2023-01-04T18:09:28.820 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "available": true, 2023-01-04T18:09:28.820 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_standbys": 0, 2023-01-04T18:09:28.820 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "modules": [ 2023-01-04T18:09:28.820 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "iostat", 2023-01-04T18:09:28.820 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "restful" 2023-01-04T18:09:28.820 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: ], 2023-01-04T18:09:28.820 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "services": {} 2023-01-04T18:09:28.820 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: }, 2023-01-04T18:09:28.820 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "servicemap": { 2023-01-04T18:09:28.821 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "epoch": 1, 2023-01-04T18:09:28.821 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "modified": "2023-01-04T18:09:16.009794+0000", 2023-01-04T18:09:28.821 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "services": {} 2023-01-04T18:09:28.821 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: }, 2023-01-04T18:09:28.821 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "progress_events": {} 2023-01-04T18:09:28.821 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: } 2023-01-04T18:09:28.821 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.805+0000 7f5c9a5c5700 1 -- 172.21.15.50:0/1140695462 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7f5c8002fc50 msgr2=0x7f5c80032110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:28.821 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.805+0000 7f5c9a5c5700 1 --2- 172.21.15.50:0/1140695462 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7f5c8002fc50 0x7f5c80032110 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f5c880096a0 tx=0x7f5c88006b40).stop 2023-01-04T18:09:28.821 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.805+0000 7f5c9a5c5700 1 -- 172.21.15.50:0/1140695462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c9406fcd0 msgr2=0x7f5c9410cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:28.821 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.805+0000 7f5c9a5c5700 1 --2- 172.21.15.50:0/1140695462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c9406fcd0 0x7f5c9410cc00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f5c84000c00 tx=0x7f5c84006ee0).stop 2023-01-04T18:09:28.821 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.806+0000 7f5c9a5c5700 1 -- 172.21.15.50:0/1140695462 shutdown_connections 2023-01-04T18:09:28.821 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.806+0000 7f5c9a5c5700 1 --2- 172.21.15.50:0/1140695462 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7f5c8002fc50 0x7f5c80032110 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:28.822 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.806+0000 7f5c9a5c5700 1 --2- 172.21.15.50:0/1140695462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c9406fcd0 0x7f5c9410cc00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:28.822 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.806+0000 7f5c9a5c5700 1 -- 172.21.15.50:0/1140695462 >> 172.21.15.50:0/1140695462 conn(0x7f5c940f6280 msgr2=0x7f5c940f7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:28.822 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.806+0000 7f5c9a5c5700 1 -- 172.21.15.50:0/1140695462 shutdown_connections 2023-01-04T18:09:28.822 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:28.806+0000 7f5c9a5c5700 1 -- 172.21.15.50:0/1140695462 wait complete. 2023-01-04T18:09:29.170 INFO:teuthology.orchestra.run.smithi050.stderr:mgr is available 2023-01-04T18:09:29.171 INFO:teuthology.orchestra.run.smithi050.stderr:Enabling cephadm module... 2023-01-04T18:09:29.171 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable cephadm 2023-01-04T18:09:29.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:28.214275+0000 mon.smithi050 (mon.0) 22 : cluster [DBG] mgrmap e3: smithi050.emnywo(active, since 1.0051s) 2023-01-04T18:09:29.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:28.804516+0000 mon.smithi050 (mon.0) 23 : audit [DBG] from='client.? 172.21.15.50:0/1140695462' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-01-04T18:09:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.565+0000 7fb356043700 1 Processor -- start 2023-01-04T18:09:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.566+0000 7fb356043700 1 -- start start 2023-01-04T18:09:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.566+0000 7fb356043700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb35006fbf0 0x7fb350100a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.566+0000 7fb356043700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500fc480 con 0x7fb35006fbf0 2023-01-04T18:09:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.566+0000 7fb355041700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb35006fbf0 0x7fb350100a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.566+0000 7fb355041700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb35006fbf0 0x7fb350100a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43372/0 (socket says 172.21.15.50:43372) 2023-01-04T18:09:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.566+0000 7fb355041700 1 -- 172.21.15.50:0/730680598 learned_addr learned my addr 172.21.15.50:0/730680598 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.566+0000 7fb355041700 1 -- 172.21.15.50:0/730680598 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb350100f80 con 0x7fb35006fbf0 2023-01-04T18:09:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.567+0000 7fb355041700 1 --2- 172.21.15.50:0/730680598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb35006fbf0 0x7fb350100a90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fb34c00b5f0 tx=0x7fb34c006ee0).ready entity=mon.0 client_cookie=61d99c4fa3e58a18 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.567+0000 7fb33ffff700 1 -- 172.21.15.50:0/730680598 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb34c00d600 con 0x7fb35006fbf0 2023-01-04T18:09:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.567+0000 7fb33ffff700 1 -- 172.21.15.50:0/730680598 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fb34c00dbd0 con 0x7fb35006fbf0 2023-01-04T18:09:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.567+0000 7fb33ffff700 1 -- 172.21.15.50:0/730680598 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb34c011c30 con 0x7fb35006fbf0 2023-01-04T18:09:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.567+0000 7fb356043700 1 -- 172.21.15.50:0/730680598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb35006fbf0 msgr2=0x7fb350100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.567+0000 7fb356043700 1 --2- 172.21.15.50:0/730680598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb35006fbf0 0x7fb350100a90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fb34c00b5f0 tx=0x7fb34c006ee0).stop 2023-01-04T18:09:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.567+0000 7fb356043700 1 -- 172.21.15.50:0/730680598 shutdown_connections 2023-01-04T18:09:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.567+0000 7fb356043700 1 --2- 172.21.15.50:0/730680598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb35006fbf0 0x7fb350100a90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.567+0000 7fb356043700 1 -- 172.21.15.50:0/730680598 >> 172.21.15.50:0/730680598 conn(0x7fb3500f6130 msgr2=0x7fb3500f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.567+0000 7fb356043700 1 -- 172.21.15.50:0/730680598 shutdown_connections 2023-01-04T18:09:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.567+0000 7fb356043700 1 -- 172.21.15.50:0/730680598 wait complete. 2023-01-04T18:09:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.568+0000 7fb356043700 1 Processor -- start 2023-01-04T18:09:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.568+0000 7fb356043700 1 -- start start 2023-01-04T18:09:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.568+0000 7fb356043700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb35006fbf0 0x7fb35010c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.568+0000 7fb356043700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35010ce50 con 0x7fb35006fbf0 2023-01-04T18:09:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.568+0000 7fb355041700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb35006fbf0 0x7fb35010c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.568+0000 7fb355041700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb35006fbf0 0x7fb35010c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43384/0 (socket says 172.21.15.50:43384) 2023-01-04T18:09:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.568+0000 7fb355041700 1 -- 172.21.15.50:0/4070389780 learned_addr learned my addr 172.21.15.50:0/4070389780 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.569+0000 7fb355041700 1 -- 172.21.15.50:0/4070389780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c00b200 con 0x7fb35006fbf0 2023-01-04T18:09:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.569+0000 7fb355041700 1 --2- 172.21.15.50:0/4070389780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb35006fbf0 0x7fb35010c960 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fb34c011850 tx=0x7fb34c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.569+0000 7fb33dffb700 1 -- 172.21.15.50:0/4070389780 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb34c01b570 con 0x7fb35006fbf0 2023-01-04T18:09:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.569+0000 7fb356043700 1 -- 172.21.15.50:0/4070389780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb35010d050 con 0x7fb35006fbf0 2023-01-04T18:09:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.569+0000 7fb33dffb700 1 -- 172.21.15.50:0/4070389780 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fb34c01bb40 con 0x7fb35006fbf0 2023-01-04T18:09:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.569+0000 7fb33dffb700 1 -- 172.21.15.50:0/4070389780 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb34c01aa10 con 0x7fb35006fbf0 2023-01-04T18:09:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.569+0000 7fb356043700 1 -- 172.21.15.50:0/4070389780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35010d460 con 0x7fb35006fbf0 2023-01-04T18:09:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.570+0000 7fb33dffb700 1 -- 172.21.15.50:0/4070389780 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 36109+0+0 (secure 0 0 0) 0x7fb34c00f070 con 0x7fb35006fbf0 2023-01-04T18:09:29.576 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.570+0000 7fb356043700 1 -- 172.21.15.50:0/4070389780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb350045ad0 con 0x7fb35006fbf0 2023-01-04T18:09:29.576 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.570+0000 7fb33dffb700 1 --2- 172.21.15.50:0/4070389780 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7fb33802fd00 0x7fb3380321c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:29.576 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.570+0000 7fb33dffb700 1 -- 172.21.15.50:0/4070389780 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fb34c040ff0 con 0x7fb35006fbf0 2023-01-04T18:09:29.576 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.571+0000 7fb354840700 1 --2- 172.21.15.50:0/4070389780 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7fb33802fd00 0x7fb3380321c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:29.576 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.571+0000 7fb354840700 1 --2- 172.21.15.50:0/4070389780 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7fb33802fd00 0x7fb3380321c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fb3400096a0 tx=0x7fb340006b40).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:29.577 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.575+0000 7fb33dffb700 1 -- 172.21.15.50:0/4070389780 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb34c019950 con 0x7fb35006fbf0 2023-01-04T18:09:29.772 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:29.770+0000 7fb356043700 1 -- 172.21.15.50:0/4070389780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fb350101b30 con 0x7fb35006fbf0 2023-01-04T18:09:30.219 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:30.216+0000 7fb33dffb700 1 -- 172.21.15.50:0/4070389780 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 5) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fb34c01ab70 con 0x7fb35006fbf0 2023-01-04T18:09:30.220 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:30.217+0000 7fb33dffb700 1 -- 172.21.15.50:0/4070389780 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fb34c023370 con 0x7fb35006fbf0 2023-01-04T18:09:30.222 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:30.219+0000 7fb356043700 1 -- 172.21.15.50:0/4070389780 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7fb33802fd00 msgr2=0x7fb3380321c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:30.223 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:30.219+0000 7fb356043700 1 --2- 172.21.15.50:0/4070389780 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7fb33802fd00 0x7fb3380321c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fb3400096a0 tx=0x7fb340006b40).stop 2023-01-04T18:09:30.223 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:30.219+0000 7fb356043700 1 -- 172.21.15.50:0/4070389780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb35006fbf0 msgr2=0x7fb35010c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:30.223 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:30.219+0000 7fb356043700 1 --2- 172.21.15.50:0/4070389780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb35006fbf0 0x7fb35010c960 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fb34c011850 tx=0x7fb34c006ee0).stop 2023-01-04T18:09:30.223 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:30.219+0000 7fb356043700 1 -- 172.21.15.50:0/4070389780 shutdown_connections 2023-01-04T18:09:30.223 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:30.219+0000 7fb356043700 1 --2- 172.21.15.50:0/4070389780 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7fb33802fd00 0x7fb3380321c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:30.223 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:30.219+0000 7fb356043700 1 --2- 172.21.15.50:0/4070389780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb35006fbf0 0x7fb35010c960 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:30.223 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:30.219+0000 7fb356043700 1 -- 172.21.15.50:0/4070389780 >> 172.21.15.50:0/4070389780 conn(0x7fb3500f6130 msgr2=0x7fb3500f7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:30.223 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:30.219+0000 7fb356043700 1 -- 172.21.15.50:0/4070389780 shutdown_connections 2023-01-04T18:09:30.223 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:30.219+0000 7fb356043700 1 -- 172.21.15.50:0/4070389780 wait complete. 2023-01-04T18:09:30.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:29.215524+0000 mon.smithi050 (mon.0) 24 : cluster [DBG] mgrmap e4: smithi050.emnywo(active, since 2s) 2023-01-04T18:09:30.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:29.771143+0000 mon.smithi050 (mon.0) 25 : audit [INF] from='client.? 172.21.15.50:0/4070389780' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-01-04T18:09:30.608 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr stat 2023-01-04T18:09:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.073+0000 7fce76dae700 1 Processor -- start 2023-01-04T18:09:31.077 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.073+0000 7fce76dae700 1 -- start start 2023-01-04T18:09:31.078 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.073+0000 7fce76dae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce7006fbf0 0x7fce70100a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:31.078 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.073+0000 7fce76dae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce700fc480 con 0x7fce7006fbf0 2023-01-04T18:09:31.078 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.073+0000 7fce75dac700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce7006fbf0 0x7fce70100a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:31.078 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.073+0000 7fce75dac700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce7006fbf0 0x7fce70100a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43420/0 (socket says 172.21.15.50:43420) 2023-01-04T18:09:31.078 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.073+0000 7fce75dac700 1 -- 172.21.15.50:0/3618356985 learned_addr learned my addr 172.21.15.50:0/3618356985 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:31.078 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.074+0000 7fce75dac700 1 -- 172.21.15.50:0/3618356985 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce70100f80 con 0x7fce7006fbf0 2023-01-04T18:09:31.078 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.074+0000 7fce75dac700 1 --2- 172.21.15.50:0/3618356985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce7006fbf0 0x7fce70100a90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fce6c00b5f0 tx=0x7fce6c006ee0).ready entity=mon.0 client_cookie=bc11c4a174c44949 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:31.078 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.074+0000 7fce74daa700 1 -- 172.21.15.50:0/3618356985 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce6c00d600 con 0x7fce7006fbf0 2023-01-04T18:09:31.078 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.074+0000 7fce74daa700 1 -- 172.21.15.50:0/3618356985 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fce6c00dbd0 con 0x7fce7006fbf0 2023-01-04T18:09:31.079 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.074+0000 7fce74daa700 1 -- 172.21.15.50:0/3618356985 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce6c011c30 con 0x7fce7006fbf0 2023-01-04T18:09:31.080 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.074+0000 7fce76dae700 1 -- 172.21.15.50:0/3618356985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce7006fbf0 msgr2=0x7fce70100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:31.080 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.074+0000 7fce76dae700 1 --2- 172.21.15.50:0/3618356985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce7006fbf0 0x7fce70100a90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fce6c00b5f0 tx=0x7fce6c006ee0).stop 2023-01-04T18:09:31.080 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.075+0000 7fce76dae700 1 -- 172.21.15.50:0/3618356985 shutdown_connections 2023-01-04T18:09:31.080 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.075+0000 7fce76dae700 1 --2- 172.21.15.50:0/3618356985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce7006fbf0 0x7fce70100a90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:31.080 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.075+0000 7fce76dae700 1 -- 172.21.15.50:0/3618356985 >> 172.21.15.50:0/3618356985 conn(0x7fce700f6130 msgr2=0x7fce700f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:31.080 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.075+0000 7fce76dae700 1 -- 172.21.15.50:0/3618356985 shutdown_connections 2023-01-04T18:09:31.080 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.075+0000 7fce76dae700 1 -- 172.21.15.50:0/3618356985 wait complete. 2023-01-04T18:09:31.080 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.076+0000 7fce76dae700 1 Processor -- start 2023-01-04T18:09:31.080 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.076+0000 7fce76dae700 1 -- start start 2023-01-04T18:09:31.081 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.076+0000 7fce76dae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce7006fbf0 0x7fce7010c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:31.081 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.076+0000 7fce76dae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7010ced0 con 0x7fce7006fbf0 2023-01-04T18:09:31.081 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.076+0000 7fce75dac700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce7006fbf0 0x7fce7010c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:31.081 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.076+0000 7fce75dac700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce7006fbf0 0x7fce7010c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43434/0 (socket says 172.21.15.50:43434) 2023-01-04T18:09:31.081 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.076+0000 7fce75dac700 1 -- 172.21.15.50:0/3007143149 learned_addr learned my addr 172.21.15.50:0/3007143149 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.076+0000 7fce75dac700 1 -- 172.21.15.50:0/3007143149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c00b200 con 0x7fce7006fbf0 2023-01-04T18:09:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.076+0000 7fce75dac700 1 --2- 172.21.15.50:0/3007143149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce7006fbf0 0x7fce7010c9e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fce6c011550 tx=0x7fce6c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.077+0000 7fce5e7fc700 1 -- 172.21.15.50:0/3007143149 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce6c00d9f0 con 0x7fce7006fbf0 2023-01-04T18:09:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.077+0000 7fce5e7fc700 1 -- 172.21.15.50:0/3007143149 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fce6c01a9f0 con 0x7fce7006fbf0 2023-01-04T18:09:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.077+0000 7fce76dae700 1 -- 172.21.15.50:0/3007143149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7010d0d0 con 0x7fce7006fbf0 2023-01-04T18:09:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.077+0000 7fce5e7fc700 1 -- 172.21.15.50:0/3007143149 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce6c01ba30 con 0x7fce7006fbf0 2023-01-04T18:09:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.077+0000 7fce76dae700 1 -- 172.21.15.50:0/3007143149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7010d4e0 con 0x7fce7006fbf0 2023-01-04T18:09:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.078+0000 7fce5e7fc700 1 -- 172.21.15.50:0/3007143149 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fce6c00f070 con 0x7fce7006fbf0 2023-01-04T18:09:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.078+0000 7fce76dae700 1 -- 172.21.15.50:0/3007143149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce70045ad0 con 0x7fce7006fbf0 2023-01-04T18:09:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.078+0000 7fce5e7fc700 1 --2- 172.21.15.50:0/3007143149 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7fce5802fd50 0x7fce58032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.078+0000 7fce755ab700 1 -- 172.21.15.50:0/3007143149 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7fce5802fd50 msgr2=0x7fce58032210 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/27207172 2023-01-04T18:09:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.078+0000 7fce5e7fc700 1 -- 172.21.15.50:0/3007143149 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fce6c042210 con 0x7fce7006fbf0 2023-01-04T18:09:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.078+0000 7fce755ab700 1 --2- 172.21.15.50:0/3007143149 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7fce5802fd50 0x7fce58032210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-01-04T18:09:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.082+0000 7fce5e7fc700 1 -- 172.21.15.50:0/3007143149 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fce6c010360 con 0x7fce7006fbf0 2023-01-04T18:09:31.282 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.279+0000 7fce755ab700 1 -- 172.21.15.50:0/3007143149 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7fce5802fd50 msgr2=0x7fce58032210 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/27207172 2023-01-04T18:09:31.282 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.279+0000 7fce755ab700 1 --2- 172.21.15.50:0/3007143149 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7fce5802fd50 0x7fce58032210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-01-04T18:09:31.286 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.283+0000 7fce76dae700 1 -- 172.21.15.50:0/3007143149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fce701068d0 con 0x7fce7006fbf0 2023-01-04T18:09:31.287 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.283+0000 7fce5e7fc700 1 -- 172.21.15.50:0/3007143149 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fce6c016070 con 0x7fce7006fbf0 2023-01-04T18:09:31.287 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: { 2023-01-04T18:09:31.287 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "epoch": 5, 2023-01-04T18:09:31.287 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "available": true, 2023-01-04T18:09:31.287 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "active_name": "smithi050.emnywo", 2023-01-04T18:09:31.287 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_standby": 0 2023-01-04T18:09:31.287 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: } 2023-01-04T18:09:31.289 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.285+0000 7fce76dae700 1 -- 172.21.15.50:0/3007143149 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7fce5802fd50 msgr2=0x7fce58032210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-01-04T18:09:31.289 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.285+0000 7fce76dae700 1 --2- 172.21.15.50:0/3007143149 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7fce5802fd50 0x7fce58032210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-01-04T18:09:31.289 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.285+0000 7fce76dae700 1 -- 172.21.15.50:0/3007143149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce7006fbf0 msgr2=0x7fce7010c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:31.289 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.285+0000 7fce76dae700 1 --2- 172.21.15.50:0/3007143149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce7006fbf0 0x7fce7010c9e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fce6c011550 tx=0x7fce6c006ee0).stop 2023-01-04T18:09:31.289 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.285+0000 7fce76dae700 1 -- 172.21.15.50:0/3007143149 shutdown_connections 2023-01-04T18:09:31.289 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.285+0000 7fce76dae700 1 --2- 172.21.15.50:0/3007143149 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7fce5802fd50 0x7fce58032210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-01-04T18:09:31.289 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.285+0000 7fce76dae700 1 --2- 172.21.15.50:0/3007143149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce7006fbf0 0x7fce7010c9e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:31.289 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.285+0000 7fce76dae700 1 -- 172.21.15.50:0/3007143149 >> 172.21.15.50:0/3007143149 conn(0x7fce700f6130 msgr2=0x7fce700f7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:31.289 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.286+0000 7fce76dae700 1 -- 172.21.15.50:0/3007143149 shutdown_connections 2023-01-04T18:09:31.289 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:31.286+0000 7fce76dae700 1 -- 172.21.15.50:0/3007143149 wait complete. 2023-01-04T18:09:31.487 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:30.218178+0000 mon.smithi050 (mon.0) 26 : audit [INF] from='client.? 172.21.15.50:0/4070389780' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-01-04T18:09:31.487 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:30.218231+0000 mon.smithi050 (mon.0) 27 : cluster [DBG] mgrmap e5: smithi050.emnywo(active, since 3s) 2023-01-04T18:09:31.744 INFO:teuthology.orchestra.run.smithi050.stderr:Waiting for the mgr to restart... 2023-01-04T18:09:31.744 INFO:teuthology.orchestra.run.smithi050.stderr:Waiting for mgr epoch 5... 2023-01-04T18:09:31.744 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 tell mgr mgr_status 2023-01-04T18:09:32.209 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.203+0000 7f31b8a22700 1 Processor -- start 2023-01-04T18:09:32.209 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.203+0000 7f31b8a22700 1 -- start start 2023-01-04T18:09:32.209 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.204+0000 7f31b8a22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31b40faae0 0x7f31b40faf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:32.209 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.204+0000 7f31b8a22700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40fb480 con 0x7f31b40faae0 2023-01-04T18:09:32.209 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.204+0000 7f31b259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31b40faae0 0x7f31b40faf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:32.209 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.204+0000 7f31b259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31b40faae0 0x7f31b40faf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43450/0 (socket says 172.21.15.50:43450) 2023-01-04T18:09:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.204+0000 7f31b259c700 1 -- 172.21.15.50:0/2674557491 learned_addr learned my addr 172.21.15.50:0/2674557491 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.204+0000 7f31b259c700 1 -- 172.21.15.50:0/2674557491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b40fb5c0 con 0x7f31b40faae0 2023-01-04T18:09:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.204+0000 7f31b259c700 1 --2- 172.21.15.50:0/2674557491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31b40faae0 0x7f31b40faf00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f31a400b5f0 tx=0x7f31a4006ee0).ready entity=mon.0 client_cookie=17212c1da92a740d server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.205+0000 7f31b159a700 1 -- 172.21.15.50:0/2674557491 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31a400d600 con 0x7f31b40faae0 2023-01-04T18:09:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.205+0000 7f31b159a700 1 -- 172.21.15.50:0/2674557491 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f31a400dbd0 con 0x7f31b40faae0 2023-01-04T18:09:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.205+0000 7f31b159a700 1 -- 172.21.15.50:0/2674557491 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31a4011c00 con 0x7f31b40faae0 2023-01-04T18:09:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.205+0000 7f31b8a22700 1 -- 172.21.15.50:0/2674557491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31b40faae0 msgr2=0x7f31b40faf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.205+0000 7f31b8a22700 1 --2- 172.21.15.50:0/2674557491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31b40faae0 0x7f31b40faf00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f31a400b5f0 tx=0x7f31a4006ee0).stop 2023-01-04T18:09:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.205+0000 7f31b8a22700 1 -- 172.21.15.50:0/2674557491 shutdown_connections 2023-01-04T18:09:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.205+0000 7f31b8a22700 1 --2- 172.21.15.50:0/2674557491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31b40faae0 0x7f31b40faf00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.205+0000 7f31b8a22700 1 -- 172.21.15.50:0/2674557491 >> 172.21.15.50:0/2674557491 conn(0x7f31b40f6280 msgr2=0x7f31b40f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:32.211 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.205+0000 7f31b8a22700 1 -- 172.21.15.50:0/2674557491 shutdown_connections 2023-01-04T18:09:32.211 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.205+0000 7f31b8a22700 1 -- 172.21.15.50:0/2674557491 wait complete. 2023-01-04T18:09:32.211 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.206+0000 7f31b8a22700 1 Processor -- start 2023-01-04T18:09:32.211 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.206+0000 7f31b8a22700 1 -- start start 2023-01-04T18:09:32.212 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.206+0000 7f31b8a22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31b40faae0 0x7f31b410fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:32.212 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.206+0000 7f31b8a22700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b410b540 con 0x7f31b40faae0 2023-01-04T18:09:32.212 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.206+0000 7f31b259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31b40faae0 0x7f31b410fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:32.213 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.206+0000 7f31b259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31b40faae0 0x7f31b410fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43456/0 (socket says 172.21.15.50:43456) 2023-01-04T18:09:32.213 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.206+0000 7f31b259c700 1 -- 172.21.15.50:0/3112517102 learned_addr learned my addr 172.21.15.50:0/3112517102 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:32.213 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.207+0000 7f31b259c700 1 -- 172.21.15.50:0/3112517102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a400b200 con 0x7f31b40faae0 2023-01-04T18:09:32.213 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.207+0000 7f31b259c700 1 --2- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31b40faae0 0x7f31b410fb50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f31a4002f40 tx=0x7f31a4006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:32.213 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.207+0000 7f31a2ffd700 1 -- 172.21.15.50:0/3112517102 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31a4011690 con 0x7f31b40faae0 2023-01-04T18:09:32.213 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.207+0000 7f31a2ffd700 1 -- 172.21.15.50:0/3112517102 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f31a401b880 con 0x7f31b40faae0 2023-01-04T18:09:32.213 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.207+0000 7f31b8a22700 1 -- 172.21.15.50:0/3112517102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b406fc50 con 0x7f31b40faae0 2023-01-04T18:09:32.213 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.207+0000 7f31a2ffd700 1 -- 172.21.15.50:0/3112517102 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31a401a6b0 con 0x7f31b40faae0 2023-01-04T18:09:32.213 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.207+0000 7f31b8a22700 1 -- 172.21.15.50:0/3112517102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b4110040 con 0x7f31b40faae0 2023-01-04T18:09:32.213 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.208+0000 7f31a2ffd700 1 -- 172.21.15.50:0/3112517102 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f31a400f070 con 0x7f31b40faae0 2023-01-04T18:09:32.213 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.208+0000 7f31a2ffd700 1 --2- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7f319802fd50 0x7f3198032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:32.214 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.208+0000 7f31a2ffd700 1 -- 172.21.15.50:0/3112517102 --> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f31980328d0 con 0x7f319802fd50 2023-01-04T18:09:32.214 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.208+0000 7f31a2ffd700 1 -- 172.21.15.50:0/3112517102 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f31a40410a0 con 0x7f31b40faae0 2023-01-04T18:09:32.214 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.208+0000 7f31b1d9b700 1 -- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7f319802fd50 msgr2=0x7f3198032210 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/27207172 2023-01-04T18:09:32.214 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.208+0000 7f31b1d9b700 1 --2- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7f319802fd50 0x7f3198032210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-01-04T18:09:32.412 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.409+0000 7f31b1d9b700 1 -- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7f319802fd50 msgr2=0x7f3198032210 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/27207172 2023-01-04T18:09:32.412 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.409+0000 7f31b1d9b700 1 --2- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7f319802fd50 0x7f3198032210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-01-04T18:09:32.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:31.284783+0000 mon.smithi050 (mon.0) 28 : audit [DBG] from='client.? 172.21.15.50:0/3007143149' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-01-04T18:09:32.813 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.810+0000 7f31b1d9b700 1 -- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7f319802fd50 msgr2=0x7f3198032210 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/27207172 2023-01-04T18:09:32.813 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:32.810+0000 7f31b1d9b700 1 --2- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7f319802fd50 0x7f3198032210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-01-04T18:09:33.614 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:33.611+0000 7f31b1d9b700 1 -- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7f319802fd50 msgr2=0x7f3198032210 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/27207172 2023-01-04T18:09:33.614 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:33.611+0000 7f31b1d9b700 1 --2- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7f319802fd50 0x7f3198032210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-01-04T18:09:35.216 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:35.212+0000 7f31b1d9b700 1 -- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7f319802fd50 msgr2=0x7f3198032210 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/27207172 2023-01-04T18:09:35.216 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:35.212+0000 7f31b1d9b700 1 --2- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7f319802fd50 0x7f3198032210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-01-04T18:09:36.164 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:36.160+0000 7f31a2ffd700 1 -- 172.21.15.50:0/3112517102 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mgrmap(e 6) v1 ==== 35970+0+0 (secure 0 0 0) 0x7f31a4025ce0 con 0x7f31b40faae0 2023-01-04T18:09:36.164 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:36.160+0000 7f31a2ffd700 1 -- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7f319802fd50 msgr2=0x7f3198032210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-01-04T18:09:36.164 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:36.160+0000 7f31a2ffd700 1 --2- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7f319802fd50 0x7f3198032210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-01-04T18:09:36.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:35.421175+0000 mon.smithi050 (mon.0) 29 : cluster [INF] Active manager daemon smithi050.emnywo restarted 2023-01-04T18:09:36.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:35.421669+0000 mon.smithi050 (mon.0) 30 : cluster [INF] Activating manager daemon smithi050.emnywo 2023-01-04T18:09:36.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:35.423283+0000 mon.smithi050 (mon.0) 31 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2023-01-04T18:09:36.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:36.163570+0000 mon.smithi050 (mon.0) 32 : cluster [DBG] mgrmap e6: smithi050.emnywo(active, starting, since 0.74199s) 2023-01-04T18:09:36.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:36.164671+0000 mon.smithi050 (mon.0) 33 : audit [DBG] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi050"}]: dispatch 2023-01-04T18:09:36.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:36.165397+0000 mon.smithi050 (mon.0) 34 : audit [DBG] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mgr metadata", "who": "smithi050.emnywo", "id": "smithi050.emnywo"}]: dispatch 2023-01-04T18:09:36.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:36.166306+0000 mon.smithi050 (mon.0) 35 : audit [DBG] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-01-04T18:09:36.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:36.166628+0000 mon.smithi050 (mon.0) 36 : audit [DBG] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-01-04T18:09:36.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:36.166923+0000 mon.smithi050 (mon.0) 37 : audit [DBG] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-01-04T18:09:36.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:36.180880+0000 mon.smithi050 (mon.0) 38 : cluster [INF] Manager daemon smithi050.emnywo is now available 2023-01-04T18:09:36.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:36.196886+0000 mon.smithi050 (mon.0) 39 : audit [INF] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' 2023-01-04T18:09:36.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:36.199914+0000 mon.smithi050 (mon.0) 40 : audit [INF] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' 2023-01-04T18:09:36.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:36.202671+0000 mon.smithi050 (mon.0) 41 : audit [INF] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' 2023-01-04T18:09:36.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:36.302614+0000 mon.smithi050 (mon.0) 42 : audit [INF] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' 2023-01-04T18:09:36.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:36.303362+0000 mon.smithi050 (mon.0) 43 : audit [DBG] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:09:36.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:36.304519+0000 mon.smithi050 (mon.0) 44 : audit [DBG] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:09:36.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:36.306766+0000 mon.smithi050 (mon.0) 45 : audit [DBG] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:09:36.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:36.317320+0000 mon.smithi050 (mon.0) 46 : audit [INF] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:09:36.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:36.318567+0000 mon.smithi050 (mon.0) 47 : audit [INF] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:09:37.165 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:37.162+0000 7f31a2ffd700 1 -- 172.21.15.50:0/3112517102 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 7) v1 ==== 36040+0+0 (secure 0 0 0) 0x7f31a4042ac0 con 0x7f31b40faae0 2023-01-04T18:09:37.166 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:37.162+0000 7f31a2ffd700 1 --2- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f3198033820 0x7f3198035c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:37.166 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:37.162+0000 7f31a2ffd700 1 -- 172.21.15.50:0/3112517102 --> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f31980328d0 con 0x7f3198033820 2023-01-04T18:09:37.166 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:37.162+0000 7f31b1d9b700 1 --2- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f3198033820 0x7f3198035c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:37.166 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:37.163+0000 7f31b1d9b700 1 --2- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f3198033820 0x7f3198035c10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f31a8006fd0 tx=0x7f31a8006cf0).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:37.167 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:37.164+0000 7f31a2ffd700 1 -- 172.21.15.50:0/3112517102 <== mgr.14114 v2:172.21.15.50:6800/3751193798 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7f31980328d0 con 0x7f3198033820 2023-01-04T18:09:37.173 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:37.170+0000 7f31b8a22700 1 -- 172.21.15.50:0/3112517102 --> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f31b4059100 con 0x7f3198033820 2023-01-04T18:09:37.174 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:37.170+0000 7f31a2ffd700 1 -- 172.21.15.50:0/3112517102 <== mgr.14114 v2:172.21.15.50:6800/3751193798 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f31b4059100 con 0x7f3198033820 2023-01-04T18:09:37.174 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: { 2023-01-04T18:09:37.175 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2023-01-04T18:09:37.175 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "initialized": true 2023-01-04T18:09:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: } 2023-01-04T18:09:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:37.171+0000 7f31b8a22700 1 -- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f3198033820 msgr2=0x7f3198035c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:37.171+0000 7f31b8a22700 1 --2- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f3198033820 0x7f3198035c10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f31a8006fd0 tx=0x7f31a8006cf0).stop 2023-01-04T18:09:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:37.171+0000 7f31b8a22700 1 -- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31b40faae0 msgr2=0x7f31b410fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:37.171+0000 7f31b8a22700 1 --2- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31b40faae0 0x7f31b410fb50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f31a4002f40 tx=0x7f31a4006ee0).stop 2023-01-04T18:09:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:37.171+0000 7f31b8a22700 1 -- 172.21.15.50:0/3112517102 shutdown_connections 2023-01-04T18:09:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:37.171+0000 7f31b8a22700 1 --2- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f3198033820 0x7f3198035c10 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:37.171+0000 7f31b8a22700 1 --2- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31b40faae0 0x7f31b410fb50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:37.171+0000 7f31b8a22700 1 --2- 172.21.15.50:0/3112517102 >> [v2:172.21.15.50:6800/27207172,v1:172.21.15.50:6801/27207172] conn(0x7f319802fd50 0x7f3198032210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-01-04T18:09:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:37.171+0000 7f31b8a22700 1 -- 172.21.15.50:0/3112517102 >> 172.21.15.50:0/3112517102 conn(0x7f31b40f6280 msgr2=0x7f31b40f7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:37.177 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:37.171+0000 7f31b8a22700 1 -- 172.21.15.50:0/3112517102 shutdown_connections 2023-01-04T18:09:37.177 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:37.171+0000 7f31b8a22700 1 -- 172.21.15.50:0/3112517102 wait complete. 2023-01-04T18:09:38.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:37.164931+0000 mgr.smithi050.emnywo (mgr.14114) 1 : audit [DBG] from='client.14118 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-01-04T18:09:38.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:37.166159+0000 mon.smithi050 (mon.0) 48 : cluster [DBG] mgrmap e7: smithi050.emnywo(active, since 1.74459s) 2023-01-04T18:09:38.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:37.172016+0000 mgr.smithi050.emnywo (mgr.14114) 2 : audit [DBG] from='client.14118 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-01-04T18:09:39.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:39 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:38.168126+0000 mon.smithi050 (mon.0) 49 : cluster [DBG] mgrmap e8: smithi050.emnywo(active, since 2s) 2023-01-04T18:09:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:mgr epoch 5 is available 2023-01-04T18:09:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:Setting orchestrator backend to cephadm... 2023-01-04T18:09:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch set backend cephadm 2023-01-04T18:09:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.651+0000 7f28531e3700 1 Processor -- start 2023-01-04T18:09:41.852 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.651+0000 7f28531e3700 1 -- start start 2023-01-04T18:09:41.852 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.651+0000 7f28531e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f284c0faae0 0x7f284c0faf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:41.852 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.652+0000 7f28531e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0fb480 con 0x7f284c0faae0 2023-01-04T18:09:41.852 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.652+0000 7f2850f7f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f284c0faae0 0x7f284c0faf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:41.852 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.652+0000 7f2850f7f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f284c0faae0 0x7f284c0faf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35540/0 (socket says 172.21.15.50:35540) 2023-01-04T18:09:41.852 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.652+0000 7f2850f7f700 1 -- 172.21.15.50:0/3971395954 learned_addr learned my addr 172.21.15.50:0/3971395954 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:41.852 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.652+0000 7f2850f7f700 1 -- 172.21.15.50:0/3971395954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c0fb5c0 con 0x7f284c0faae0 2023-01-04T18:09:41.852 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.652+0000 7f2850f7f700 1 --2- 172.21.15.50:0/3971395954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f284c0faae0 0x7f284c0faf00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f284000b870 tx=0x7f2840006f70).ready entity=mon.0 client_cookie=8494db82ff5dd068 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:41.852 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.652+0000 7f284b7fe700 1 -- 172.21.15.50:0/3971395954 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f284000da20 con 0x7f284c0faae0 2023-01-04T18:09:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.652+0000 7f284b7fe700 1 -- 172.21.15.50:0/3971395954 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f2840010470 con 0x7f284c0faae0 2023-01-04T18:09:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.652+0000 7f284b7fe700 1 -- 172.21.15.50:0/3971395954 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f284000f5b0 con 0x7f284c0faae0 2023-01-04T18:09:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.653+0000 7f28531e3700 1 -- 172.21.15.50:0/3971395954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f284c0faae0 msgr2=0x7f284c0faf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.653+0000 7f28531e3700 1 --2- 172.21.15.50:0/3971395954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f284c0faae0 0x7f284c0faf00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f284000b870 tx=0x7f2840006f70).stop 2023-01-04T18:09:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.653+0000 7f28531e3700 1 -- 172.21.15.50:0/3971395954 shutdown_connections 2023-01-04T18:09:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.653+0000 7f28531e3700 1 --2- 172.21.15.50:0/3971395954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f284c0faae0 0x7f284c0faf00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.653+0000 7f28531e3700 1 -- 172.21.15.50:0/3971395954 >> 172.21.15.50:0/3971395954 conn(0x7f284c0f6280 msgr2=0x7f284c0f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.653+0000 7f28531e3700 1 -- 172.21.15.50:0/3971395954 shutdown_connections 2023-01-04T18:09:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.653+0000 7f28531e3700 1 -- 172.21.15.50:0/3971395954 wait complete. 2023-01-04T18:09:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.654+0000 7f28531e3700 1 Processor -- start 2023-01-04T18:09:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.654+0000 7f28531e3700 1 -- start start 2023-01-04T18:09:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.654+0000 7f28531e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f284c0faae0 0x7f284c10cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.654+0000 7f28531e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c10d040 con 0x7f284c0faae0 2023-01-04T18:09:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.654+0000 7f2850f7f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f284c0faae0 0x7f284c10cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.654+0000 7f2850f7f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f284c0faae0 0x7f284c10cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35546/0 (socket says 172.21.15.50:35546) 2023-01-04T18:09:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.654+0000 7f2850f7f700 1 -- 172.21.15.50:0/733105352 learned_addr learned my addr 172.21.15.50:0/733105352 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.654+0000 7f2850f7f700 1 -- 172.21.15.50:0/733105352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284000b480 con 0x7f284c0faae0 2023-01-04T18:09:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.655+0000 7f2850f7f700 1 --2- 172.21.15.50:0/733105352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f284c0faae0 0x7f284c10cb50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f2840006b80 tx=0x7f2840006f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.655+0000 7f28497fa700 1 -- 172.21.15.50:0/733105352 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f284000de10 con 0x7f284c0faae0 2023-01-04T18:09:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.655+0000 7f28497fa700 1 -- 172.21.15.50:0/733105352 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f284000fef0 con 0x7f284c0faae0 2023-01-04T18:09:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.655+0000 7f28497fa700 1 -- 172.21.15.50:0/733105352 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2840019de0 con 0x7f284c0faae0 2023-01-04T18:09:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.655+0000 7f28531e3700 1 -- 172.21.15.50:0/733105352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284c10d240 con 0x7f284c0faae0 2023-01-04T18:09:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.655+0000 7f28531e3700 1 -- 172.21.15.50:0/733105352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284c10d650 con 0x7f284c0faae0 2023-01-04T18:09:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.655+0000 7f28497fa700 1 -- 172.21.15.50:0/733105352 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f2840016030 con 0x7f284c0faae0 2023-01-04T18:09:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.656+0000 7f28497fa700 1 --2- 172.21.15.50:0/733105352 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f283002fdb0 0x7f2830032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.656+0000 7f28497fa700 1 -- 172.21.15.50:0/733105352 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f2840041a90 con 0x7f284c0faae0 2023-01-04T18:09:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.656+0000 7f284bfff700 1 --2- 172.21.15.50:0/733105352 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f283002fdb0 0x7f2830032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.656+0000 7f28531e3700 1 -- 172.21.15.50:0/733105352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284c059100 con 0x7f284c0faae0 2023-01-04T18:09:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.656+0000 7f284bfff700 1 --2- 172.21.15.50:0/733105352 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f283002fdb0 0x7f2830032270 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f28380096a0 tx=0x7f2838006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.660+0000 7f28497fa700 1 -- 172.21.15.50:0/733105352 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2840014070 con 0x7f284c0faae0 2023-01-04T18:09:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.847+0000 7f28531e3700 1 -- 172.21.15.50:0/733105352 --> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f284c102560 con 0x7f283002fdb0 2023-01-04T18:09:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.852+0000 7f28497fa700 1 -- 172.21.15.50:0/733105352 <== mgr.14114 v2:172.21.15.50:6800/3751193798 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f284c102560 con 0x7f283002fdb0 2023-01-04T18:09:41.857 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.853+0000 7f28531e3700 1 -- 172.21.15.50:0/733105352 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f283002fdb0 msgr2=0x7f2830032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:41.857 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.853+0000 7f28531e3700 1 --2- 172.21.15.50:0/733105352 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f283002fdb0 0x7f2830032270 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f28380096a0 tx=0x7f2838006b40).stop 2023-01-04T18:09:41.857 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.853+0000 7f28531e3700 1 -- 172.21.15.50:0/733105352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f284c0faae0 msgr2=0x7f284c10cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:41.857 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.853+0000 7f28531e3700 1 --2- 172.21.15.50:0/733105352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f284c0faae0 0x7f284c10cb50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f2840006b80 tx=0x7f2840006f70).stop 2023-01-04T18:09:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.855+0000 7f28531e3700 1 -- 172.21.15.50:0/733105352 shutdown_connections 2023-01-04T18:09:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.855+0000 7f28531e3700 1 --2- 172.21.15.50:0/733105352 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f283002fdb0 0x7f2830032270 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.855+0000 7f28531e3700 1 --2- 172.21.15.50:0/733105352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f284c0faae0 0x7f284c10cb50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.855+0000 7f28531e3700 1 -- 172.21.15.50:0/733105352 >> 172.21.15.50:0/733105352 conn(0x7f284c0f6280 msgr2=0x7f284c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.855+0000 7f28531e3700 1 -- 172.21.15.50:0/733105352 shutdown_connections 2023-01-04T18:09:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:41.856+0000 7f28531e3700 1 -- 172.21.15.50:0/733105352 wait complete. 2023-01-04T18:09:43.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:41.849139+0000 mgr.smithi050.emnywo (mgr.14114) 3 : audit [DBG] from='client.14124 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:09:43.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:41.852950+0000 mon.smithi050 (mon.0) 50 : audit [INF] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' 2023-01-04T18:09:43.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:41.856760+0000 mon.smithi050 (mon.0) 51 : audit [DBG] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:09:43.850 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm set-user root 2023-01-04T18:09:44.316 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.311+0000 7f7b5fc8d700 1 Processor -- start 2023-01-04T18:09:44.316 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.312+0000 7f7b5fc8d700 1 -- start start 2023-01-04T18:09:44.316 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.312+0000 7f7b5fc8d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5806fcd0 0x7f7b580fe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:44.317 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.312+0000 7f7b5fc8d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b580fed20 con 0x7f7b5806fcd0 2023-01-04T18:09:44.317 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.312+0000 7f7b5da29700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5806fcd0 0x7f7b580fe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:44.317 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.312+0000 7f7b5da29700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5806fcd0 0x7f7b580fe7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35554/0 (socket says 172.21.15.50:35554) 2023-01-04T18:09:44.317 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.312+0000 7f7b5da29700 1 -- 172.21.15.50:0/829542222 learned_addr learned my addr 172.21.15.50:0/829542222 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:44.317 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.312+0000 7f7b5da29700 1 -- 172.21.15.50:0/829542222 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b580fee60 con 0x7f7b5806fcd0 2023-01-04T18:09:44.317 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.312+0000 7f7b5da29700 1 --2- 172.21.15.50:0/829542222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5806fcd0 0x7f7b580fe7a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f7b5400b5f0 tx=0x7f7b54006ee0).ready entity=mon.0 client_cookie=90af30837879b077 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:44.317 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.313+0000 7f7b5ca27700 1 -- 172.21.15.50:0/829542222 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b5400d600 con 0x7f7b5806fcd0 2023-01-04T18:09:44.317 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.313+0000 7f7b5ca27700 1 -- 172.21.15.50:0/829542222 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f7b5400dbd0 con 0x7f7b5806fcd0 2023-01-04T18:09:44.317 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.313+0000 7f7b5ca27700 1 -- 172.21.15.50:0/829542222 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b54011c00 con 0x7f7b5806fcd0 2023-01-04T18:09:44.318 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.313+0000 7f7b5fc8d700 1 -- 172.21.15.50:0/829542222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5806fcd0 msgr2=0x7f7b580fe7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:44.321 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.313+0000 7f7b5fc8d700 1 --2- 172.21.15.50:0/829542222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5806fcd0 0x7f7b580fe7a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f7b5400b5f0 tx=0x7f7b54006ee0).stop 2023-01-04T18:09:44.321 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.313+0000 7f7b5fc8d700 1 -- 172.21.15.50:0/829542222 shutdown_connections 2023-01-04T18:09:44.321 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.313+0000 7f7b5fc8d700 1 --2- 172.21.15.50:0/829542222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5806fcd0 0x7f7b580fe7a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:44.321 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.313+0000 7f7b5fc8d700 1 -- 172.21.15.50:0/829542222 >> 172.21.15.50:0/829542222 conn(0x7f7b580f6280 msgr2=0x7f7b580f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:44.321 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.313+0000 7f7b5fc8d700 1 -- 172.21.15.50:0/829542222 shutdown_connections 2023-01-04T18:09:44.321 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.313+0000 7f7b5fc8d700 1 -- 172.21.15.50:0/829542222 wait complete. 2023-01-04T18:09:44.322 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.314+0000 7f7b5fc8d700 1 Processor -- start 2023-01-04T18:09:44.322 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.314+0000 7f7b5fc8d700 1 -- start start 2023-01-04T18:09:44.322 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.314+0000 7f7b5fc8d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5806fcd0 0x7f7b5810a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:44.322 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.314+0000 7f7b5fc8d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5810aee0 con 0x7f7b5806fcd0 2023-01-04T18:09:44.322 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.314+0000 7f7b5da29700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5806fcd0 0x7f7b5810a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:44.322 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.314+0000 7f7b5da29700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5806fcd0 0x7f7b5810a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35562/0 (socket says 172.21.15.50:35562) 2023-01-04T18:09:44.322 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.314+0000 7f7b5da29700 1 -- 172.21.15.50:0/3472556738 learned_addr learned my addr 172.21.15.50:0/3472556738 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:44.322 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.315+0000 7f7b5da29700 1 -- 172.21.15.50:0/3472556738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5400b200 con 0x7f7b5806fcd0 2023-01-04T18:09:44.322 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.315+0000 7f7b5da29700 1 --2- 172.21.15.50:0/3472556738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5806fcd0 0x7f7b5810a9f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7b54000c00 tx=0x7f7b54006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:44.322 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.315+0000 7f7b467fc700 1 -- 172.21.15.50:0/3472556738 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b54011690 con 0x7f7b5806fcd0 2023-01-04T18:09:44.322 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.315+0000 7f7b5fc8d700 1 -- 172.21.15.50:0/3472556738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b5810b0e0 con 0x7f7b5806fcd0 2023-01-04T18:09:44.323 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.315+0000 7f7b467fc700 1 -- 172.21.15.50:0/3472556738 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f7b5400d9f0 con 0x7f7b5806fcd0 2023-01-04T18:09:44.323 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.315+0000 7f7b467fc700 1 -- 172.21.15.50:0/3472556738 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b5401b710 con 0x7f7b5806fcd0 2023-01-04T18:09:44.323 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.315+0000 7f7b5fc8d700 1 -- 172.21.15.50:0/3472556738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b5810b4f0 con 0x7f7b5806fcd0 2023-01-04T18:09:44.323 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.316+0000 7f7b467fc700 1 -- 172.21.15.50:0/3472556738 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f7b5400f070 con 0x7f7b5806fcd0 2023-01-04T18:09:44.323 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.316+0000 7f7b467fc700 1 --2- 172.21.15.50:0/3472556738 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f7b4002fd50 0x7f7b40032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:44.323 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.316+0000 7f7b467fc700 1 -- 172.21.15.50:0/3472556738 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f7b54041170 con 0x7f7b5806fcd0 2023-01-04T18:09:44.323 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.316+0000 7f7b5d228700 1 --2- 172.21.15.50:0/3472556738 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f7b4002fd50 0x7f7b40032210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:44.323 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.316+0000 7f7b5d228700 1 --2- 172.21.15.50:0/3472556738 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f7b4002fd50 0x7f7b40032210 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f7b480096a0 tx=0x7f7b48006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:44.323 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.316+0000 7f7b5fc8d700 1 -- 172.21.15.50:0/3472556738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b58059100 con 0x7f7b5806fcd0 2023-01-04T18:09:44.324 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.321+0000 7f7b467fc700 1 -- 172.21.15.50:0/3472556738 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7b54016070 con 0x7f7b5806fcd0 2023-01-04T18:09:44.485 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.482+0000 7f7b5fc8d700 1 -- 172.21.15.50:0/3472556738 --> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b58104890 con 0x7f7b4002fd50 2023-01-04T18:09:44.486 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.482+0000 7f7b467fc700 1 -- 172.21.15.50:0/3472556738 <== mgr.14114 v2:172.21.15.50:6800/3751193798 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f7b58104890 con 0x7f7b4002fd50 2023-01-04T18:09:44.486 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: value unchanged 2023-01-04T18:09:44.488 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.484+0000 7f7b5fc8d700 1 -- 172.21.15.50:0/3472556738 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f7b4002fd50 msgr2=0x7f7b40032210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:44.488 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.484+0000 7f7b5fc8d700 1 --2- 172.21.15.50:0/3472556738 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f7b4002fd50 0x7f7b40032210 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f7b480096a0 tx=0x7f7b48006b40).stop 2023-01-04T18:09:44.488 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.484+0000 7f7b5fc8d700 1 -- 172.21.15.50:0/3472556738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5806fcd0 msgr2=0x7f7b5810a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:44.488 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.484+0000 7f7b5fc8d700 1 --2- 172.21.15.50:0/3472556738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5806fcd0 0x7f7b5810a9f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7b54000c00 tx=0x7f7b54006ee0).stop 2023-01-04T18:09:44.488 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.484+0000 7f7b5fc8d700 1 -- 172.21.15.50:0/3472556738 shutdown_connections 2023-01-04T18:09:44.488 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.484+0000 7f7b5fc8d700 1 --2- 172.21.15.50:0/3472556738 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f7b4002fd50 0x7f7b40032210 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:44.488 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.484+0000 7f7b5fc8d700 1 --2- 172.21.15.50:0/3472556738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b5806fcd0 0x7f7b5810a9f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:44.489 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.484+0000 7f7b5fc8d700 1 -- 172.21.15.50:0/3472556738 >> 172.21.15.50:0/3472556738 conn(0x7f7b580f6280 msgr2=0x7f7b580f7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:44.489 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.485+0000 7f7b5fc8d700 1 -- 172.21.15.50:0/3472556738 shutdown_connections 2023-01-04T18:09:44.489 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:44.485+0000 7f7b5fc8d700 1 -- 172.21.15.50:0/3472556738 wait complete. 2023-01-04T18:09:44.893 INFO:teuthology.orchestra.run.smithi050.stderr:Generating ssh key... 2023-01-04T18:09:44.893 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm generate-key 2023-01-04T18:09:45.335 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.331+0000 7fec69d18700 1 Processor -- start 2023-01-04T18:09:45.335 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.331+0000 7fec69d18700 1 -- start start 2023-01-04T18:09:45.336 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.332+0000 7fec69d18700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec640faae0 0x7fec640faf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:45.336 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.332+0000 7fec69d18700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec640fb480 con 0x7fec640faae0 2023-01-04T18:09:45.336 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.332+0000 7fec637fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec640faae0 0x7fec640faf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:45.336 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.332+0000 7fec637fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec640faae0 0x7fec640faf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35570/0 (socket says 172.21.15.50:35570) 2023-01-04T18:09:45.336 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.332+0000 7fec637fe700 1 -- 172.21.15.50:0/315031098 learned_addr learned my addr 172.21.15.50:0/315031098 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:45.337 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.332+0000 7fec637fe700 1 -- 172.21.15.50:0/315031098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec640fb5c0 con 0x7fec640faae0 2023-01-04T18:09:45.337 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.333+0000 7fec637fe700 1 --2- 172.21.15.50:0/315031098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec640faae0 0x7fec640faf00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fec5400b5f0 tx=0x7fec54006ee0).ready entity=mon.0 client_cookie=8743df5c54ecfae2 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:45.337 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.333+0000 7fec627fc700 1 -- 172.21.15.50:0/315031098 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec5400d600 con 0x7fec640faae0 2023-01-04T18:09:45.337 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.333+0000 7fec627fc700 1 -- 172.21.15.50:0/315031098 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fec5400dbd0 con 0x7fec640faae0 2023-01-04T18:09:45.337 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.333+0000 7fec627fc700 1 -- 172.21.15.50:0/315031098 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec54011c00 con 0x7fec640faae0 2023-01-04T18:09:45.339 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.333+0000 7fec69d18700 1 -- 172.21.15.50:0/315031098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec640faae0 msgr2=0x7fec640faf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:45.339 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.333+0000 7fec69d18700 1 --2- 172.21.15.50:0/315031098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec640faae0 0x7fec640faf00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fec5400b5f0 tx=0x7fec54006ee0).stop 2023-01-04T18:09:45.340 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.333+0000 7fec69d18700 1 -- 172.21.15.50:0/315031098 shutdown_connections 2023-01-04T18:09:45.340 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.333+0000 7fec69d18700 1 --2- 172.21.15.50:0/315031098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec640faae0 0x7fec640faf00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:45.340 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.333+0000 7fec69d18700 1 -- 172.21.15.50:0/315031098 >> 172.21.15.50:0/315031098 conn(0x7fec640f6280 msgr2=0x7fec640f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:45.340 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.334+0000 7fec69d18700 1 -- 172.21.15.50:0/315031098 shutdown_connections 2023-01-04T18:09:45.340 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.334+0000 7fec69d18700 1 -- 172.21.15.50:0/315031098 wait complete. 2023-01-04T18:09:45.340 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.334+0000 7fec69d18700 1 Processor -- start 2023-01-04T18:09:45.340 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.335+0000 7fec69d18700 1 -- start start 2023-01-04T18:09:45.340 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.335+0000 7fec69d18700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec640faae0 0x7fec641098d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:45.340 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.335+0000 7fec69d18700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec64109dc0 con 0x7fec640faae0 2023-01-04T18:09:45.340 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.335+0000 7fec637fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec640faae0 0x7fec641098d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:45.340 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.335+0000 7fec637fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec640faae0 0x7fec641098d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35576/0 (socket says 172.21.15.50:35576) 2023-01-04T18:09:45.341 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.335+0000 7fec637fe700 1 -- 172.21.15.50:0/3709285326 learned_addr learned my addr 172.21.15.50:0/3709285326 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:45.341 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.335+0000 7fec637fe700 1 -- 172.21.15.50:0/3709285326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5400b200 con 0x7fec640faae0 2023-01-04T18:09:45.341 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.335+0000 7fec637fe700 1 --2- 172.21.15.50:0/3709285326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec640faae0 0x7fec641098d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fec5400b1d0 tx=0x7fec54006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:45.341 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.335+0000 7fec5bfff700 1 -- 172.21.15.50:0/3709285326 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec54011a20 con 0x7fec640faae0 2023-01-04T18:09:45.341 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.336+0000 7fec69d18700 1 -- 172.21.15.50:0/3709285326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec64109fc0 con 0x7fec640faae0 2023-01-04T18:09:45.341 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.336+0000 7fec5bfff700 1 -- 172.21.15.50:0/3709285326 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fec5401b880 con 0x7fec640faae0 2023-01-04T18:09:45.341 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.336+0000 7fec5bfff700 1 -- 172.21.15.50:0/3709285326 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec5401a700 con 0x7fec640faae0 2023-01-04T18:09:45.341 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.336+0000 7fec69d18700 1 -- 172.21.15.50:0/3709285326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6410a3d0 con 0x7fec640faae0 2023-01-04T18:09:45.341 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.336+0000 7fec5bfff700 1 -- 172.21.15.50:0/3709285326 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fec5400f070 con 0x7fec640faae0 2023-01-04T18:09:45.342 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.336+0000 7fec5bfff700 1 --2- 172.21.15.50:0/3709285326 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fec4402fd50 0x7fec44032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:45.342 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.337+0000 7fec5bfff700 1 -- 172.21.15.50:0/3709285326 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7fec54041090 con 0x7fec640faae0 2023-01-04T18:09:45.342 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.337+0000 7fec69d18700 1 -- 172.21.15.50:0/3709285326 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec64045ad0 con 0x7fec640faae0 2023-01-04T18:09:45.342 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.337+0000 7fec62ffd700 1 --2- 172.21.15.50:0/3709285326 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fec4402fd50 0x7fec44032210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:45.342 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.337+0000 7fec62ffd700 1 --2- 172.21.15.50:0/3709285326 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fec4402fd50 0x7fec44032210 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fec4c0096a0 tx=0x7fec4c006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:45.344 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.341+0000 7fec5bfff700 1 -- 172.21.15.50:0/3709285326 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fec54016070 con 0x7fec640faae0 2023-01-04T18:09:45.504 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.500+0000 7fec69d18700 1 -- 172.21.15.50:0/3709285326 --> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fec64103780 con 0x7fec4402fd50 2023-01-04T18:09:45.733 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.730+0000 7fec5bfff700 1 -- 172.21.15.50:0/3709285326 <== mgr.14114 v2:172.21.15.50:6800/3751193798 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fec64103780 con 0x7fec4402fd50 2023-01-04T18:09:45.735 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.732+0000 7fec69d18700 1 -- 172.21.15.50:0/3709285326 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fec4402fd50 msgr2=0x7fec44032210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:45.736 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.732+0000 7fec69d18700 1 --2- 172.21.15.50:0/3709285326 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fec4402fd50 0x7fec44032210 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fec4c0096a0 tx=0x7fec4c006b40).stop 2023-01-04T18:09:45.736 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.732+0000 7fec69d18700 1 -- 172.21.15.50:0/3709285326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec640faae0 msgr2=0x7fec641098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:45.736 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.732+0000 7fec69d18700 1 --2- 172.21.15.50:0/3709285326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec640faae0 0x7fec641098d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fec5400b1d0 tx=0x7fec54006ee0).stop 2023-01-04T18:09:45.737 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.732+0000 7fec69d18700 1 -- 172.21.15.50:0/3709285326 shutdown_connections 2023-01-04T18:09:45.737 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.732+0000 7fec69d18700 1 --2- 172.21.15.50:0/3709285326 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fec4402fd50 0x7fec44032210 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:45.737 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.732+0000 7fec69d18700 1 --2- 172.21.15.50:0/3709285326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec640faae0 0x7fec641098d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:45.737 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.732+0000 7fec69d18700 1 -- 172.21.15.50:0/3709285326 >> 172.21.15.50:0/3709285326 conn(0x7fec640f6280 msgr2=0x7fec640f7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:45.737 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.733+0000 7fec69d18700 1 -- 172.21.15.50:0/3709285326 shutdown_connections 2023-01-04T18:09:45.737 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:45.733+0000 7fec69d18700 1 -- 172.21.15.50:0/3709285326 wait complete. 2023-01-04T18:09:46.131 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm get-pub-key 2023-01-04T18:09:46.318 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:44.483751+0000 mgr.smithi050.emnywo (mgr.14114) 4 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:09:46.318 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:45.729416+0000 mon.smithi050 (mon.0) 52 : audit [INF] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' 2023-01-04T18:09:46.318 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:45.731180+0000 mon.smithi050 (mon.0) 53 : audit [INF] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' 2023-01-04T18:09:46.577 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.570+0000 7fb8a1324700 1 Processor -- start 2023-01-04T18:09:46.577 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.570+0000 7fb8a1324700 1 -- start start 2023-01-04T18:09:46.577 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.570+0000 7fb8a1324700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c0faae0 0x7fb89c0faf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:46.577 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.570+0000 7fb8a1324700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c0fb480 con 0x7fb89c0faae0 2023-01-04T18:09:46.577 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.571+0000 7fb89affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c0faae0 0x7fb89c0faf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:46.577 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.571+0000 7fb89affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c0faae0 0x7fb89c0faf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60008/0 (socket says 172.21.15.50:60008) 2023-01-04T18:09:46.577 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.571+0000 7fb89affd700 1 -- 172.21.15.50:0/2376396728 learned_addr learned my addr 172.21.15.50:0/2376396728 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:46.578 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.571+0000 7fb89affd700 1 -- 172.21.15.50:0/2376396728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c0fb5c0 con 0x7fb89c0faae0 2023-01-04T18:09:46.578 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.571+0000 7fb89affd700 1 --2- 172.21.15.50:0/2376396728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c0faae0 0x7fb89c0faf00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb88c00b5f0 tx=0x7fb88c006ee0).ready entity=mon.0 client_cookie=97d77a77a7f735fc server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:46.578 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.571+0000 7fb899ffb700 1 -- 172.21.15.50:0/2376396728 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb88c00d600 con 0x7fb89c0faae0 2023-01-04T18:09:46.578 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.571+0000 7fb899ffb700 1 -- 172.21.15.50:0/2376396728 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fb88c00dbd0 con 0x7fb89c0faae0 2023-01-04T18:09:46.578 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.571+0000 7fb899ffb700 1 -- 172.21.15.50:0/2376396728 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb88c011c00 con 0x7fb89c0faae0 2023-01-04T18:09:46.578 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.572+0000 7fb8a1324700 1 -- 172.21.15.50:0/2376396728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c0faae0 msgr2=0x7fb89c0faf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:46.578 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.572+0000 7fb8a1324700 1 --2- 172.21.15.50:0/2376396728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c0faae0 0x7fb89c0faf00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb88c00b5f0 tx=0x7fb88c006ee0).stop 2023-01-04T18:09:46.578 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.572+0000 7fb8a1324700 1 -- 172.21.15.50:0/2376396728 shutdown_connections 2023-01-04T18:09:46.578 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.572+0000 7fb8a1324700 1 --2- 172.21.15.50:0/2376396728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c0faae0 0x7fb89c0faf00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:46.578 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.572+0000 7fb8a1324700 1 -- 172.21.15.50:0/2376396728 >> 172.21.15.50:0/2376396728 conn(0x7fb89c0f6280 msgr2=0x7fb89c0f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:46.579 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.572+0000 7fb8a1324700 1 -- 172.21.15.50:0/2376396728 shutdown_connections 2023-01-04T18:09:46.579 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.572+0000 7fb8a1324700 1 -- 172.21.15.50:0/2376396728 wait complete. 2023-01-04T18:09:46.579 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.573+0000 7fb8a1324700 1 Processor -- start 2023-01-04T18:09:46.579 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.573+0000 7fb8a1324700 1 -- start start 2023-01-04T18:09:46.579 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.573+0000 7fb8a1324700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c0faae0 0x7fb89c10a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:46.579 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.573+0000 7fb8a1324700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c10aee0 con 0x7fb89c0faae0 2023-01-04T18:09:46.579 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.573+0000 7fb89affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c0faae0 0x7fb89c10a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:46.579 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.573+0000 7fb89affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c0faae0 0x7fb89c10a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60018/0 (socket says 172.21.15.50:60018) 2023-01-04T18:09:46.579 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.573+0000 7fb89affd700 1 -- 172.21.15.50:0/3892211244 learned_addr learned my addr 172.21.15.50:0/3892211244 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.573+0000 7fb89affd700 1 -- 172.21.15.50:0/3892211244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88c00b200 con 0x7fb89c0faae0 2023-01-04T18:09:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.573+0000 7fb89affd700 1 --2- 172.21.15.50:0/3892211244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c0faae0 0x7fb89c10a9f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fb88c00b1d0 tx=0x7fb88c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.574+0000 7fb8937fe700 1 -- 172.21.15.50:0/3892211244 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb88c011a20 con 0x7fb89c0faae0 2023-01-04T18:09:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.574+0000 7fb8937fe700 1 -- 172.21.15.50:0/3892211244 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fb88c01b880 con 0x7fb89c0faae0 2023-01-04T18:09:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.574+0000 7fb8937fe700 1 -- 172.21.15.50:0/3892211244 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb88c01a700 con 0x7fb89c0faae0 2023-01-04T18:09:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.574+0000 7fb8a1324700 1 -- 172.21.15.50:0/3892211244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb89c10b0e0 con 0x7fb89c0faae0 2023-01-04T18:09:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.574+0000 7fb8a1324700 1 -- 172.21.15.50:0/3892211244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb89c10b4f0 con 0x7fb89c0faae0 2023-01-04T18:09:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.575+0000 7fb8a1324700 1 -- 172.21.15.50:0/3892211244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb89c045ad0 con 0x7fb89c0faae0 2023-01-04T18:09:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.575+0000 7fb8937fe700 1 -- 172.21.15.50:0/3892211244 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fb88c00f070 con 0x7fb89c0faae0 2023-01-04T18:09:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.575+0000 7fb8937fe700 1 --2- 172.21.15.50:0/3892211244 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fb87c02fd50 0x7fb87c032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.575+0000 7fb8937fe700 1 -- 172.21.15.50:0/3892211244 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7fb88c0410d0 con 0x7fb89c0faae0 2023-01-04T18:09:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.576+0000 7fb89a7fc700 1 --2- 172.21.15.50:0/3892211244 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fb87c02fd50 0x7fb87c032210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:46.582 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.576+0000 7fb89a7fc700 1 --2- 172.21.15.50:0/3892211244 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fb87c02fd50 0x7fb87c032210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fb8840096a0 tx=0x7fb884006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:46.583 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.580+0000 7fb8937fe700 1 -- 172.21.15.50:0/3892211244 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb88c022310 con 0x7fb89c0faae0 2023-01-04T18:09:46.742 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.738+0000 7fb8a1324700 1 -- 172.21.15.50:0/3892211244 --> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fb89c10bdd0 con 0x7fb87c02fd50 2023-01-04T18:09:46.742 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.739+0000 7fb8937fe700 1 -- 172.21.15.50:0/3892211244 <== mgr.14114 v2:172.21.15.50:6800/3751193798 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fb89c10bdd0 con 0x7fb87c02fd50 2023-01-04T18:09:46.742 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcflAq/5AaapAgLE6KDeh2SUQvuimcN5EV6XDaoIZ6Knn3OgJSPX0RJBRTxHPoKkbjJbowALF58PKrU9WZpopcZaiOzun4DYRgypbCbpDmixlovomSDP+V/8Kf+RXBXTng7cmCm9ryo/ZBQZJCDdldIXYfO35Bv0M8BPgGet1+cEqDvQ5z5MDfjv425cCkodk7uTcqQ5ZwO9pJskec3b6u46o+9Tt7rh29xuxwNwrUldxVeI3PO8SyptHtTua2myWZBPgCbemjGuePpYZZwGQa8FcqPuAX7gNkkidEOAKzCfGIdCOKZ38hZqeF8aleUmV9G3WAoGA93IJITXbnWtmjl3pr3xbesOlelXdOgvNgM1AgVVraDm04fjiUYb5b1U2kXwGtts8cQ5fpYaStLZMhL3d7HjMNb2qxN0AlsWoWI3NCFsDyPPs5STorLMZ+QACkonoV6yYAvTO+a7Ncg1ZiZnfNeb1sHYVYQtkEebjq4tv6xWTYW4YkOI2y7XRA9YE= ceph-d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:09:46.744 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.740+0000 7fb8a1324700 1 -- 172.21.15.50:0/3892211244 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fb87c02fd50 msgr2=0x7fb87c032210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:46.744 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.740+0000 7fb8a1324700 1 --2- 172.21.15.50:0/3892211244 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fb87c02fd50 0x7fb87c032210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fb8840096a0 tx=0x7fb884006b40).stop 2023-01-04T18:09:46.745 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.740+0000 7fb8a1324700 1 -- 172.21.15.50:0/3892211244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c0faae0 msgr2=0x7fb89c10a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:46.745 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.740+0000 7fb8a1324700 1 --2- 172.21.15.50:0/3892211244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c0faae0 0x7fb89c10a9f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fb88c00b1d0 tx=0x7fb88c006ee0).stop 2023-01-04T18:09:46.745 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.741+0000 7fb8a1324700 1 -- 172.21.15.50:0/3892211244 shutdown_connections 2023-01-04T18:09:46.745 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.741+0000 7fb8a1324700 1 --2- 172.21.15.50:0/3892211244 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fb87c02fd50 0x7fb87c032210 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:46.745 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.741+0000 7fb8a1324700 1 --2- 172.21.15.50:0/3892211244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb89c0faae0 0x7fb89c10a9f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:46.745 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.741+0000 7fb8a1324700 1 -- 172.21.15.50:0/3892211244 >> 172.21.15.50:0/3892211244 conn(0x7fb89c0f6280 msgr2=0x7fb89c06f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:46.745 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.741+0000 7fb8a1324700 1 -- 172.21.15.50:0/3892211244 shutdown_connections 2023-01-04T18:09:46.745 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:46.741+0000 7fb8a1324700 1 -- 172.21.15.50:0/3892211244 wait complete. 2023-01-04T18:09:47.167 INFO:teuthology.orchestra.run.smithi050.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-01-04T18:09:47.167 INFO:teuthology.orchestra.run.smithi050.stderr:Adding key to root@localhost authorized_keys... 2023-01-04T18:09:47.167 INFO:teuthology.orchestra.run.smithi050.stderr:Adding host smithi050... 2023-01-04T18:09:47.167 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch host add smithi050 172.21.15.50 2023-01-04T18:09:47.435 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:09:45.502597+0000 mgr.smithi050.emnywo (mgr.14114) 6 : cephadm [INF] Generating ssh key... 2023-01-04T18:09:47.625 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.622+0000 7f9395b82700 1 Processor -- start 2023-01-04T18:09:47.626 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.622+0000 7f9395b82700 1 -- start start 2023-01-04T18:09:47.626 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.622+0000 7f9395b82700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f939006fbf0 0x7f93900fe690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:47.626 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.622+0000 7f9395b82700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93900feb80 con 0x7f939006fbf0 2023-01-04T18:09:47.628 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.622+0000 7f9394b80700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f939006fbf0 0x7f93900fe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:47.628 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.622+0000 7f9394b80700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f939006fbf0 0x7f93900fe690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60026/0 (socket says 172.21.15.50:60026) 2023-01-04T18:09:47.628 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.622+0000 7f9394b80700 1 -- 172.21.15.50:0/3073266243 learned_addr learned my addr 172.21.15.50:0/3073266243 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:47.628 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.622+0000 7f9394b80700 1 -- 172.21.15.50:0/3073266243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93900fecc0 con 0x7f939006fbf0 2023-01-04T18:09:47.629 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.623+0000 7f9394b80700 1 --2- 172.21.15.50:0/3073266243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f939006fbf0 0x7f93900fe690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f938400b5f0 tx=0x7f9384006ee0).ready entity=mon.0 client_cookie=36ce8627065977ca server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:47.629 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.623+0000 7f938f7fe700 1 -- 172.21.15.50:0/3073266243 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f938400d600 con 0x7f939006fbf0 2023-01-04T18:09:47.629 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.623+0000 7f938f7fe700 1 -- 172.21.15.50:0/3073266243 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f938400dbd0 con 0x7f939006fbf0 2023-01-04T18:09:47.629 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.623+0000 7f938f7fe700 1 -- 172.21.15.50:0/3073266243 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9384011c30 con 0x7f939006fbf0 2023-01-04T18:09:47.629 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.623+0000 7f9395b82700 1 -- 172.21.15.50:0/3073266243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f939006fbf0 msgr2=0x7f93900fe690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:47.629 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.623+0000 7f9395b82700 1 --2- 172.21.15.50:0/3073266243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f939006fbf0 0x7f93900fe690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f938400b5f0 tx=0x7f9384006ee0).stop 2023-01-04T18:09:47.629 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.624+0000 7f9395b82700 1 -- 172.21.15.50:0/3073266243 shutdown_connections 2023-01-04T18:09:47.629 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.624+0000 7f9395b82700 1 --2- 172.21.15.50:0/3073266243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f939006fbf0 0x7f93900fe690 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:47.629 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.624+0000 7f9395b82700 1 -- 172.21.15.50:0/3073266243 >> 172.21.15.50:0/3073266243 conn(0x7f93900f6130 msgr2=0x7f93900f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:47.629 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.624+0000 7f9395b82700 1 -- 172.21.15.50:0/3073266243 shutdown_connections 2023-01-04T18:09:47.629 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.624+0000 7f9395b82700 1 -- 172.21.15.50:0/3073266243 wait complete. 2023-01-04T18:09:47.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.624+0000 7f9395b82700 1 Processor -- start 2023-01-04T18:09:47.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.624+0000 7f9395b82700 1 -- start start 2023-01-04T18:09:47.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.624+0000 7f9395b82700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f939006fbf0 0x7f93900fc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:47.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.625+0000 7f9395b82700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93900fa590 con 0x7f939006fbf0 2023-01-04T18:09:47.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.625+0000 7f9394b80700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f939006fbf0 0x7f93900fc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:47.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.625+0000 7f9394b80700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f939006fbf0 0x7f93900fc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60042/0 (socket says 172.21.15.50:60042) 2023-01-04T18:09:47.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.625+0000 7f9394b80700 1 -- 172.21.15.50:0/1526244540 learned_addr learned my addr 172.21.15.50:0/1526244540 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:47.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.625+0000 7f9394b80700 1 -- 172.21.15.50:0/1526244540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938400b200 con 0x7f939006fbf0 2023-01-04T18:09:47.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.625+0000 7f9394b80700 1 --2- 172.21.15.50:0/1526244540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f939006fbf0 0x7f93900fc110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9384011550 tx=0x7f9384006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:47.631 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.625+0000 7f938d7fa700 1 -- 172.21.15.50:0/1526244540 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f938400d9f0 con 0x7f939006fbf0 2023-01-04T18:09:47.632 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.625+0000 7f938d7fa700 1 -- 172.21.15.50:0/1526244540 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f938401a9f0 con 0x7f939006fbf0 2023-01-04T18:09:47.632 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.625+0000 7f9395b82700 1 -- 172.21.15.50:0/1526244540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93900fa730 con 0x7f939006fbf0 2023-01-04T18:09:47.632 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.625+0000 7f938d7fa700 1 -- 172.21.15.50:0/1526244540 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f938401ba30 con 0x7f939006fbf0 2023-01-04T18:09:47.632 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.625+0000 7f9395b82700 1 -- 172.21.15.50:0/1526244540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93900fab40 con 0x7f939006fbf0 2023-01-04T18:09:47.632 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.626+0000 7f938d7fa700 1 -- 172.21.15.50:0/1526244540 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f938400f070 con 0x7f939006fbf0 2023-01-04T18:09:47.632 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.626+0000 7f938d7fa700 1 --2- 172.21.15.50:0/1526244540 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f937402fdb0 0x7f9374032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:47.632 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.626+0000 7f938d7fa700 1 -- 172.21.15.50:0/1526244540 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f9384041360 con 0x7f939006fbf0 2023-01-04T18:09:47.632 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.626+0000 7f9395b82700 1 -- 172.21.15.50:0/1526244540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9390045ad0 con 0x7f939006fbf0 2023-01-04T18:09:47.632 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.627+0000 7f938ffff700 1 --2- 172.21.15.50:0/1526244540 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f937402fdb0 0x7f9374032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:47.632 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.627+0000 7f938ffff700 1 --2- 172.21.15.50:0/1526244540 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f937402fdb0 0x7f9374032270 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f937c0096a0 tx=0x7f937c006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:47.634 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.631+0000 7f938d7fa700 1 -- 172.21.15.50:0/1526244540 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9384016070 con 0x7f939006fbf0 2023-01-04T18:09:47.816 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:47.813+0000 7f9395b82700 1 -- 172.21.15.50:0/1526244540 --> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi050", "addr": "172.21.15.50", "target": ["mon-mgr", ""]}) v1 -- 0x7f93900fad80 con 0x7f937402fdb0 2023-01-04T18:09:48.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:46.740514+0000 mgr.smithi050.emnywo (mgr.14114) 7 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:09:48.546 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: Added host 'smithi050' 2023-01-04T18:09:48.546 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:48.541+0000 7f938d7fa700 1 -- 172.21.15.50:0/1526244540 <== mgr.14114 v2:172.21.15.50:6800/3751193798 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+23 (secure 0 0 0) 0x7f93900fad80 con 0x7f937402fdb0 2023-01-04T18:09:48.547 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:48.544+0000 7f9395b82700 1 -- 172.21.15.50:0/1526244540 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f937402fdb0 msgr2=0x7f9374032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:48.548 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:48.544+0000 7f9395b82700 1 --2- 172.21.15.50:0/1526244540 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f937402fdb0 0x7f9374032270 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f937c0096a0 tx=0x7f937c006b40).stop 2023-01-04T18:09:48.548 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:48.544+0000 7f9395b82700 1 -- 172.21.15.50:0/1526244540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f939006fbf0 msgr2=0x7f93900fc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:48.548 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:48.544+0000 7f9395b82700 1 --2- 172.21.15.50:0/1526244540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f939006fbf0 0x7f93900fc110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9384011550 tx=0x7f9384006ee0).stop 2023-01-04T18:09:48.548 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:48.545+0000 7f9395b82700 1 -- 172.21.15.50:0/1526244540 shutdown_connections 2023-01-04T18:09:48.549 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:48.545+0000 7f9395b82700 1 --2- 172.21.15.50:0/1526244540 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f937402fdb0 0x7f9374032270 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:48.549 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:48.545+0000 7f9395b82700 1 --2- 172.21.15.50:0/1526244540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f939006fbf0 0x7f93900fc110 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:48.549 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:48.545+0000 7f9395b82700 1 -- 172.21.15.50:0/1526244540 >> 172.21.15.50:0/1526244540 conn(0x7f93900f6130 msgr2=0x7f93900f7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:48.549 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:48.545+0000 7f9395b82700 1 -- 172.21.15.50:0/1526244540 shutdown_connections 2023-01-04T18:09:48.549 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:48.545+0000 7f9395b82700 1 -- 172.21.15.50:0/1526244540 wait complete. 2023-01-04T18:09:49.006 INFO:teuthology.orchestra.run.smithi050.stderr:Deploying mon service with default placement... 2023-01-04T18:09:49.006 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply mon 2023-01-04T18:09:49.202 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:49 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:47.815027+0000 mgr.smithi050.emnywo (mgr.14114) 8 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi050", "addr": "172.21.15.50", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:09:49.202 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:49 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:48.542457+0000 mon.smithi050 (mon.0) 54 : audit [INF] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' 2023-01-04T18:09:49.202 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:49 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:48.543034+0000 mon.smithi050 (mon.0) 55 : audit [DBG] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:09:49.452 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.448+0000 7fb940c05700 1 Processor -- start 2023-01-04T18:09:49.452 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.448+0000 7fb940c05700 1 -- start start 2023-01-04T18:09:49.453 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.448+0000 7fb940c05700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb93c06fcd0 0x7fb93c0fe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:49.453 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.448+0000 7fb940c05700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c0fed20 con 0x7fb93c06fcd0 2023-01-04T18:09:49.453 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.449+0000 7fb93a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb93c06fcd0 0x7fb93c0fe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:49.453 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.449+0000 7fb93a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb93c06fcd0 0x7fb93c0fe7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60050/0 (socket says 172.21.15.50:60050) 2023-01-04T18:09:49.456 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.449+0000 7fb93a59c700 1 -- 172.21.15.50:0/681654806 learned_addr learned my addr 172.21.15.50:0/681654806 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:49.456 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.449+0000 7fb93a59c700 1 -- 172.21.15.50:0/681654806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c0fee60 con 0x7fb93c06fcd0 2023-01-04T18:09:49.456 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.449+0000 7fb93a59c700 1 --2- 172.21.15.50:0/681654806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb93c06fcd0 0x7fb93c0fe7a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fb93000b5f0 tx=0x7fb930006ee0).ready entity=mon.0 client_cookie=8c76c0c6defbea26 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:49.456 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.449+0000 7fb93959a700 1 -- 172.21.15.50:0/681654806 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb93000d600 con 0x7fb93c06fcd0 2023-01-04T18:09:49.456 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.449+0000 7fb93959a700 1 -- 172.21.15.50:0/681654806 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fb93000dbd0 con 0x7fb93c06fcd0 2023-01-04T18:09:49.456 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.449+0000 7fb93959a700 1 -- 172.21.15.50:0/681654806 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb930011c00 con 0x7fb93c06fcd0 2023-01-04T18:09:49.456 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.450+0000 7fb940c05700 1 -- 172.21.15.50:0/681654806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb93c06fcd0 msgr2=0x7fb93c0fe7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:49.456 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.450+0000 7fb940c05700 1 --2- 172.21.15.50:0/681654806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb93c06fcd0 0x7fb93c0fe7a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fb93000b5f0 tx=0x7fb930006ee0).stop 2023-01-04T18:09:49.456 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.450+0000 7fb940c05700 1 -- 172.21.15.50:0/681654806 shutdown_connections 2023-01-04T18:09:49.456 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.450+0000 7fb940c05700 1 --2- 172.21.15.50:0/681654806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb93c06fcd0 0x7fb93c0fe7a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:49.457 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.450+0000 7fb940c05700 1 -- 172.21.15.50:0/681654806 >> 172.21.15.50:0/681654806 conn(0x7fb93c0f6280 msgr2=0x7fb93c0f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:49.457 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.450+0000 7fb940c05700 1 -- 172.21.15.50:0/681654806 shutdown_connections 2023-01-04T18:09:49.457 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.450+0000 7fb940c05700 1 -- 172.21.15.50:0/681654806 wait complete. 2023-01-04T18:09:49.457 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.451+0000 7fb940c05700 1 Processor -- start 2023-01-04T18:09:49.457 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.451+0000 7fb940c05700 1 -- start start 2023-01-04T18:09:49.457 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.451+0000 7fb940c05700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb93c06fcd0 0x7fb93c10a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:49.457 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.451+0000 7fb940c05700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c10ae90 con 0x7fb93c06fcd0 2023-01-04T18:09:49.457 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.452+0000 7fb93a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb93c06fcd0 0x7fb93c10a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:49.457 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.452+0000 7fb93a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb93c06fcd0 0x7fb93c10a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60062/0 (socket says 172.21.15.50:60062) 2023-01-04T18:09:49.457 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.452+0000 7fb93a59c700 1 -- 172.21.15.50:0/879862029 learned_addr learned my addr 172.21.15.50:0/879862029 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:49.457 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.452+0000 7fb93a59c700 1 -- 172.21.15.50:0/879862029 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93000b200 con 0x7fb93c06fcd0 2023-01-04T18:09:49.457 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.452+0000 7fb93a59c700 1 --2- 172.21.15.50:0/879862029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb93c06fcd0 0x7fb93c10a9a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fb93000e040 tx=0x7fb930006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:49.458 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.452+0000 7fb92affd700 1 -- 172.21.15.50:0/879862029 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb93001b410 con 0x7fb93c06fcd0 2023-01-04T18:09:49.458 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.452+0000 7fb92affd700 1 -- 172.21.15.50:0/879862029 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fb93001b9e0 con 0x7fb93c06fcd0 2023-01-04T18:09:49.458 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.452+0000 7fb940c05700 1 -- 172.21.15.50:0/879862029 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb93c10b090 con 0x7fb93c06fcd0 2023-01-04T18:09:49.458 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.452+0000 7fb92affd700 1 -- 172.21.15.50:0/879862029 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb93001a770 con 0x7fb93c06fcd0 2023-01-04T18:09:49.458 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.452+0000 7fb940c05700 1 -- 172.21.15.50:0/879862029 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93c10b4a0 con 0x7fb93c06fcd0 2023-01-04T18:09:49.459 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.453+0000 7fb92affd700 1 -- 172.21.15.50:0/879862029 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fb93000f070 con 0x7fb93c06fcd0 2023-01-04T18:09:49.459 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.453+0000 7fb92affd700 1 --2- 172.21.15.50:0/879862029 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fb92002fdb0 0x7fb920032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:49.459 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.453+0000 7fb92affd700 1 -- 172.21.15.50:0/879862029 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7fb930040fc0 con 0x7fb93c06fcd0 2023-01-04T18:09:49.459 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.453+0000 7fb940c05700 1 -- 172.21.15.50:0/879862029 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb93c045ad0 con 0x7fb93c06fcd0 2023-01-04T18:09:49.459 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.453+0000 7fb939d9b700 1 --2- 172.21.15.50:0/879862029 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fb92002fdb0 0x7fb920032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:49.459 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.454+0000 7fb939d9b700 1 --2- 172.21.15.50:0/879862029 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fb92002fdb0 0x7fb920032270 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fb92c0096a0 tx=0x7fb92c006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:49.461 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.458+0000 7fb92affd700 1 -- 172.21.15.50:0/879862029 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb930016080 con 0x7fb93c06fcd0 2023-01-04T18:09:49.651 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.647+0000 7fb940c05700 1 -- 172.21.15.50:0/879862029 --> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7fb93c104930 con 0x7fb92002fdb0 2023-01-04T18:09:49.655 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.652+0000 7fb92affd700 1 -- 172.21.15.50:0/879862029 <== mgr.14114 v2:172.21.15.50:6800/3751193798 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fb93c104930 con 0x7fb92002fdb0 2023-01-04T18:09:49.655 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: Scheduled mon update... 2023-01-04T18:09:49.657 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.654+0000 7fb940c05700 1 -- 172.21.15.50:0/879862029 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fb92002fdb0 msgr2=0x7fb920032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:49.658 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.654+0000 7fb940c05700 1 --2- 172.21.15.50:0/879862029 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fb92002fdb0 0x7fb920032270 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fb92c0096a0 tx=0x7fb92c006b40).stop 2023-01-04T18:09:49.658 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.654+0000 7fb940c05700 1 -- 172.21.15.50:0/879862029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb93c06fcd0 msgr2=0x7fb93c10a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:49.660 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.654+0000 7fb940c05700 1 --2- 172.21.15.50:0/879862029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb93c06fcd0 0x7fb93c10a9a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fb93000e040 tx=0x7fb930006ee0).stop 2023-01-04T18:09:49.660 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.654+0000 7fb940c05700 1 -- 172.21.15.50:0/879862029 shutdown_connections 2023-01-04T18:09:49.660 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.654+0000 7fb940c05700 1 --2- 172.21.15.50:0/879862029 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fb92002fdb0 0x7fb920032270 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:49.660 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.654+0000 7fb940c05700 1 --2- 172.21.15.50:0/879862029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb93c06fcd0 0x7fb93c10a9a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:49.660 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.654+0000 7fb940c05700 1 -- 172.21.15.50:0/879862029 >> 172.21.15.50:0/879862029 conn(0x7fb93c0f6280 msgr2=0x7fb93c0f7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:49.660 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.654+0000 7fb940c05700 1 -- 172.21.15.50:0/879862029 shutdown_connections 2023-01-04T18:09:49.660 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:49.654+0000 7fb940c05700 1 -- 172.21.15.50:0/879862029 wait complete. 2023-01-04T18:09:50.148 INFO:teuthology.orchestra.run.smithi050.stderr:Deploying mgr service with default placement... 2023-01-04T18:09:50.148 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply mgr 2023-01-04T18:09:50.373 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:09:48.542772+0000 mgr.smithi050.emnywo (mgr.14114) 9 : cephadm [INF] Added host smithi050 2023-01-04T18:09:50.373 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:49.653080+0000 mon.smithi050 (mon.0) 56 : audit [INF] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' 2023-01-04T18:09:50.766 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.761+0000 7ff05c22c700 1 Processor -- start 2023-01-04T18:09:50.766 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.761+0000 7ff05c22c700 1 -- start start 2023-01-04T18:09:50.766 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.762+0000 7ff05c22c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0540fd1e0 0x7ff0540fd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:50.766 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.762+0000 7ff05c22c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0540fdb80 con 0x7ff0540fd1e0 2023-01-04T18:09:50.767 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.762+0000 7ff059fc8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0540fd1e0 0x7ff0540fd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:50.767 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.762+0000 7ff059fc8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0540fd1e0 0x7ff0540fd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60068/0 (socket says 172.21.15.50:60068) 2023-01-04T18:09:50.767 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.762+0000 7ff059fc8700 1 -- 172.21.15.50:0/520984716 learned_addr learned my addr 172.21.15.50:0/520984716 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:50.767 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.762+0000 7ff059fc8700 1 -- 172.21.15.50:0/520984716 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0540fdcc0 con 0x7ff0540fd1e0 2023-01-04T18:09:50.767 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.762+0000 7ff059fc8700 1 --2- 172.21.15.50:0/520984716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0540fd1e0 0x7ff0540fd600 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7ff04400b5f0 tx=0x7ff044006ee0).ready entity=mon.0 client_cookie=a2ca54ca17e29490 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:50.767 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.762+0000 7ff058fc6700 1 -- 172.21.15.50:0/520984716 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff04400d600 con 0x7ff0540fd1e0 2023-01-04T18:09:50.767 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.763+0000 7ff058fc6700 1 -- 172.21.15.50:0/520984716 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7ff04400dbd0 con 0x7ff0540fd1e0 2023-01-04T18:09:50.767 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.763+0000 7ff058fc6700 1 -- 172.21.15.50:0/520984716 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff044011c00 con 0x7ff0540fd1e0 2023-01-04T18:09:50.767 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.763+0000 7ff05c22c700 1 -- 172.21.15.50:0/520984716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0540fd1e0 msgr2=0x7ff0540fd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:50.770 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.763+0000 7ff05c22c700 1 --2- 172.21.15.50:0/520984716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0540fd1e0 0x7ff0540fd600 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7ff04400b5f0 tx=0x7ff044006ee0).stop 2023-01-04T18:09:50.770 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.763+0000 7ff05c22c700 1 -- 172.21.15.50:0/520984716 shutdown_connections 2023-01-04T18:09:50.770 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.763+0000 7ff05c22c700 1 --2- 172.21.15.50:0/520984716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0540fd1e0 0x7ff0540fd600 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:50.770 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.763+0000 7ff05c22c700 1 -- 172.21.15.50:0/520984716 >> 172.21.15.50:0/520984716 conn(0x7ff0540f59e0 msgr2=0x7ff0540f7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:50.770 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.763+0000 7ff05c22c700 1 -- 172.21.15.50:0/520984716 shutdown_connections 2023-01-04T18:09:50.770 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.763+0000 7ff05c22c700 1 -- 172.21.15.50:0/520984716 wait complete. 2023-01-04T18:09:50.771 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.764+0000 7ff05c22c700 1 Processor -- start 2023-01-04T18:09:50.771 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.764+0000 7ff05c22c700 1 -- start start 2023-01-04T18:09:50.771 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.764+0000 7ff05c22c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0540fd1e0 0x7ff05410aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:50.771 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.764+0000 7ff05c22c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05410af90 con 0x7ff0540fd1e0 2023-01-04T18:09:50.771 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.764+0000 7ff059fc8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0540fd1e0 0x7ff05410aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:50.771 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.765+0000 7ff059fc8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0540fd1e0 0x7ff05410aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60082/0 (socket says 172.21.15.50:60082) 2023-01-04T18:09:50.771 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.765+0000 7ff059fc8700 1 -- 172.21.15.50:0/4134017521 learned_addr learned my addr 172.21.15.50:0/4134017521 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:50.771 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.765+0000 7ff059fc8700 1 -- 172.21.15.50:0/4134017521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04400b200 con 0x7ff0540fd1e0 2023-01-04T18:09:50.771 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.765+0000 7ff059fc8700 1 --2- 172.21.15.50:0/4134017521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0540fd1e0 0x7ff05410aaa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff04400bdc0 tx=0x7ff044006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:50.771 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.765+0000 7ff0427fc700 1 -- 172.21.15.50:0/4134017521 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff044011690 con 0x7ff0540fd1e0 2023-01-04T18:09:50.771 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.765+0000 7ff0427fc700 1 -- 172.21.15.50:0/4134017521 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7ff04400d9f0 con 0x7ff0540fd1e0 2023-01-04T18:09:50.772 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.765+0000 7ff05c22c700 1 -- 172.21.15.50:0/4134017521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05410b190 con 0x7ff0540fd1e0 2023-01-04T18:09:50.772 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.765+0000 7ff0427fc700 1 -- 172.21.15.50:0/4134017521 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff04401b780 con 0x7ff0540fd1e0 2023-01-04T18:09:50.772 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.765+0000 7ff05c22c700 1 -- 172.21.15.50:0/4134017521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05410b5a0 con 0x7ff0540fd1e0 2023-01-04T18:09:50.772 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.766+0000 7ff0427fc700 1 -- 172.21.15.50:0/4134017521 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7ff04400f070 con 0x7ff0540fd1e0 2023-01-04T18:09:50.772 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.766+0000 7ff0427fc700 1 --2- 172.21.15.50:0/4134017521 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7ff03c034160 0x7ff03c036620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:50.772 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.766+0000 7ff05c22c700 1 -- 172.21.15.50:0/4134017521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff054045ad0 con 0x7ff0540fd1e0 2023-01-04T18:09:50.772 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.766+0000 7ff0427fc700 1 -- 172.21.15.50:0/4134017521 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7ff044040d00 con 0x7ff0540fd1e0 2023-01-04T18:09:50.772 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.766+0000 7ff0597c7700 1 --2- 172.21.15.50:0/4134017521 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7ff03c034160 0x7ff03c036620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:50.772 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.767+0000 7ff0597c7700 1 --2- 172.21.15.50:0/4134017521 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7ff03c034160 0x7ff03c036620 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7ff0500096a0 tx=0x7ff050006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:50.774 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.771+0000 7ff0427fc700 1 -- 172.21.15.50:0/4134017521 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff044016080 con 0x7ff0540fd1e0 2023-01-04T18:09:50.797 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.793+0000 7ff0427fc700 1 -- 172.21.15.50:0/4134017521 <== mon.0 v2:172.21.15.50:3300/0 7 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff044006a40 con 0x7ff0540fd1e0 2023-01-04T18:09:50.966 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.963+0000 7ff05c22c700 1 -- 172.21.15.50:0/4134017521 --> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7ff05410be30 con 0x7ff03c034160 2023-01-04T18:09:50.971 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.967+0000 7ff0427fc700 1 -- 172.21.15.50:0/4134017521 <== mgr.14114 v2:172.21.15.50:6800/3751193798 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ff05410be30 con 0x7ff03c034160 2023-01-04T18:09:50.971 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: Scheduled mgr update... 2023-01-04T18:09:50.973 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.969+0000 7ff05c22c700 1 -- 172.21.15.50:0/4134017521 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7ff03c034160 msgr2=0x7ff03c036620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:50.973 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.969+0000 7ff05c22c700 1 --2- 172.21.15.50:0/4134017521 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7ff03c034160 0x7ff03c036620 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7ff0500096a0 tx=0x7ff050006b40).stop 2023-01-04T18:09:50.973 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.969+0000 7ff05c22c700 1 -- 172.21.15.50:0/4134017521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0540fd1e0 msgr2=0x7ff05410aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:50.973 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.969+0000 7ff05c22c700 1 --2- 172.21.15.50:0/4134017521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0540fd1e0 0x7ff05410aaa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff04400bdc0 tx=0x7ff044006ee0).stop 2023-01-04T18:09:50.973 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.969+0000 7ff05c22c700 1 -- 172.21.15.50:0/4134017521 shutdown_connections 2023-01-04T18:09:50.974 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.969+0000 7ff05c22c700 1 --2- 172.21.15.50:0/4134017521 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7ff03c034160 0x7ff03c036620 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:50.974 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.969+0000 7ff05c22c700 1 --2- 172.21.15.50:0/4134017521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0540fd1e0 0x7ff05410aaa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:50.974 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.969+0000 7ff05c22c700 1 -- 172.21.15.50:0/4134017521 >> 172.21.15.50:0/4134017521 conn(0x7ff0540f59e0 msgr2=0x7ff0540ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:50.974 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.970+0000 7ff05c22c700 1 -- 172.21.15.50:0/4134017521 shutdown_connections 2023-01-04T18:09:50.974 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:50.970+0000 7ff05c22c700 1 -- 172.21.15.50:0/4134017521 wait complete. 2023-01-04T18:09:51.387 INFO:teuthology.orchestra.run.smithi050.stderr:Deploying crash service with default placement... 2023-01-04T18:09:51.387 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply crash 2023-01-04T18:09:51.420 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:49.650077+0000 mgr.smithi050.emnywo (mgr.14114) 10 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:09:51.421 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:09:49.650831+0000 mgr.smithi050.emnywo (mgr.14114) 11 : cephadm [INF] Saving service mon spec with placement count:5 2023-01-04T18:09:51.421 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:50.795038+0000 mon.smithi050 (mon.0) 57 : audit [INF] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' 2023-01-04T18:09:51.421 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:50.968702+0000 mon.smithi050 (mon.0) 58 : audit [INF] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' 2023-01-04T18:09:51.421 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:51.132982+0000 mon.smithi050 (mon.0) 59 : audit [INF] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' 2023-01-04T18:09:51.822 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.817+0000 7fcdc0bc4700 1 Processor -- start 2023-01-04T18:09:51.823 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.817+0000 7fcdc0bc4700 1 -- start start 2023-01-04T18:09:51.823 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.818+0000 7fcdc0bc4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdbc06fc90 0x7fcdbc0fe7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:51.823 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.818+0000 7fcdc0bc4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc0fed60 con 0x7fcdbc06fc90 2023-01-04T18:09:51.823 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.818+0000 7fcdba59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdbc06fc90 0x7fcdbc0fe7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:51.823 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.818+0000 7fcdba59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdbc06fc90 0x7fcdbc0fe7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60090/0 (socket says 172.21.15.50:60090) 2023-01-04T18:09:51.823 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.818+0000 7fcdba59c700 1 -- 172.21.15.50:0/892102931 learned_addr learned my addr 172.21.15.50:0/892102931 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:51.823 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.818+0000 7fcdba59c700 1 -- 172.21.15.50:0/892102931 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdbc0feea0 con 0x7fcdbc06fc90 2023-01-04T18:09:51.823 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.818+0000 7fcdba59c700 1 --2- 172.21.15.50:0/892102931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdbc06fc90 0x7fcdbc0fe7e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcdac00b5f0 tx=0x7fcdac006ee0).ready entity=mon.0 client_cookie=6a458baa4e941264 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:51.823 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.818+0000 7fcdb9d9b700 1 -- 172.21.15.50:0/892102931 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcdac00d600 con 0x7fcdbc06fc90 2023-01-04T18:09:51.824 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.818+0000 7fcdb9d9b700 1 -- 172.21.15.50:0/892102931 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcdac00dc10 con 0x7fcdbc06fc90 2023-01-04T18:09:51.824 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.818+0000 7fcdb9d9b700 1 -- 172.21.15.50:0/892102931 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcdac011cd0 con 0x7fcdbc06fc90 2023-01-04T18:09:51.824 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.819+0000 7fcdc0bc4700 1 -- 172.21.15.50:0/892102931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdbc06fc90 msgr2=0x7fcdbc0fe7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:51.824 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.819+0000 7fcdc0bc4700 1 --2- 172.21.15.50:0/892102931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdbc06fc90 0x7fcdbc0fe7e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcdac00b5f0 tx=0x7fcdac006ee0).stop 2023-01-04T18:09:51.824 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.819+0000 7fcdc0bc4700 1 -- 172.21.15.50:0/892102931 shutdown_connections 2023-01-04T18:09:51.824 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.819+0000 7fcdc0bc4700 1 --2- 172.21.15.50:0/892102931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdbc06fc90 0x7fcdbc0fe7e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:51.826 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.819+0000 7fcdc0bc4700 1 -- 172.21.15.50:0/892102931 >> 172.21.15.50:0/892102931 conn(0x7fcdbc0f6280 msgr2=0x7fcdbc0f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:51.827 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.819+0000 7fcdc0bc4700 1 -- 172.21.15.50:0/892102931 shutdown_connections 2023-01-04T18:09:51.827 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.819+0000 7fcdc0bc4700 1 -- 172.21.15.50:0/892102931 wait complete. 2023-01-04T18:09:51.827 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.820+0000 7fcdc0bc4700 1 Processor -- start 2023-01-04T18:09:51.827 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.820+0000 7fcdc0bc4700 1 -- start start 2023-01-04T18:09:51.827 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.820+0000 7fcdc0bc4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdbc06fc90 0x7fcdbc10aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:51.827 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.820+0000 7fcdc0bc4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc10af10 con 0x7fcdbc06fc90 2023-01-04T18:09:51.827 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.820+0000 7fcdba59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdbc06fc90 0x7fcdbc10aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:51.827 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.820+0000 7fcdba59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdbc06fc90 0x7fcdbc10aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60092/0 (socket says 172.21.15.50:60092) 2023-01-04T18:09:51.827 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.820+0000 7fcdba59c700 1 -- 172.21.15.50:0/2358318984 learned_addr learned my addr 172.21.15.50:0/2358318984 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:51.827 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.821+0000 7fcdba59c700 1 -- 172.21.15.50:0/2358318984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac00b200 con 0x7fcdbc06fc90 2023-01-04T18:09:51.827 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.821+0000 7fcdba59c700 1 --2- 172.21.15.50:0/2358318984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdbc06fc90 0x7fcdbc10aa20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fcdac00dfb0 tx=0x7fcdac006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:51.828 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.821+0000 7fcdb37fe700 1 -- 172.21.15.50:0/2358318984 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcdac011df0 con 0x7fcdbc06fc90 2023-01-04T18:09:51.828 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.821+0000 7fcdc0bc4700 1 -- 172.21.15.50:0/2358318984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdbc10b110 con 0x7fcdbc06fc90 2023-01-04T18:09:51.828 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.821+0000 7fcdb37fe700 1 -- 172.21.15.50:0/2358318984 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcdac01b8c0 con 0x7fcdbc06fc90 2023-01-04T18:09:51.828 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.821+0000 7fcdb37fe700 1 -- 172.21.15.50:0/2358318984 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcdac01a7c0 con 0x7fcdbc06fc90 2023-01-04T18:09:51.828 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.821+0000 7fcdc0bc4700 1 -- 172.21.15.50:0/2358318984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdbc10b520 con 0x7fcdbc06fc90 2023-01-04T18:09:51.828 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.822+0000 7fcdb37fe700 1 -- 172.21.15.50:0/2358318984 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fcdac00f070 con 0x7fcdbc06fc90 2023-01-04T18:09:51.828 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.822+0000 7fcdb37fe700 1 --2- 172.21.15.50:0/2358318984 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fcd9c02fd50 0x7fcd9c032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:51.828 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.822+0000 7fcdb37fe700 1 -- 172.21.15.50:0/2358318984 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7fcdac040ff0 con 0x7fcdbc06fc90 2023-01-04T18:09:51.828 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.822+0000 7fcdb1d9b700 1 --2- 172.21.15.50:0/2358318984 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fcd9c02fd50 0x7fcd9c032210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:51.828 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.822+0000 7fcdc0bc4700 1 -- 172.21.15.50:0/2358318984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdbc059100 con 0x7fcdbc06fc90 2023-01-04T18:09:51.828 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.823+0000 7fcdb1d9b700 1 --2- 172.21.15.50:0/2358318984 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fcd9c02fd50 0x7fcd9c032210 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fcda40096a0 tx=0x7fcda4006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:51.829 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:51.826+0000 7fcdb37fe700 1 -- 172.21.15.50:0/2358318984 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fcdac016070 con 0x7fcdbc06fc90 2023-01-04T18:09:52.034 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:52.031+0000 7fcdc0bc4700 1 -- 172.21.15.50:0/2358318984 --> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fcdbc104960 con 0x7fcd9c02fd50 2023-01-04T18:09:52.038 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:52.034+0000 7fcdb37fe700 1 -- 172.21.15.50:0/2358318984 <== mgr.14114 v2:172.21.15.50:6800/3751193798 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fcdbc104960 con 0x7fcd9c02fd50 2023-01-04T18:09:52.038 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: Scheduled crash update... 2023-01-04T18:09:52.040 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:52.036+0000 7fcdc0bc4700 1 -- 172.21.15.50:0/2358318984 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fcd9c02fd50 msgr2=0x7fcd9c032210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:52.041 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:52.036+0000 7fcdc0bc4700 1 --2- 172.21.15.50:0/2358318984 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fcd9c02fd50 0x7fcd9c032210 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fcda40096a0 tx=0x7fcda4006b40).stop 2023-01-04T18:09:52.041 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:52.036+0000 7fcdc0bc4700 1 -- 172.21.15.50:0/2358318984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdbc06fc90 msgr2=0x7fcdbc10aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:52.041 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:52.036+0000 7fcdc0bc4700 1 --2- 172.21.15.50:0/2358318984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdbc06fc90 0x7fcdbc10aa20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fcdac00dfb0 tx=0x7fcdac006ee0).stop 2023-01-04T18:09:52.041 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:52.037+0000 7fcdc0bc4700 1 -- 172.21.15.50:0/2358318984 shutdown_connections 2023-01-04T18:09:52.041 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:52.037+0000 7fcdc0bc4700 1 --2- 172.21.15.50:0/2358318984 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fcd9c02fd50 0x7fcd9c032210 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:52.041 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:52.037+0000 7fcdc0bc4700 1 --2- 172.21.15.50:0/2358318984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdbc06fc90 0x7fcdbc10aa20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:52.041 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:52.037+0000 7fcdc0bc4700 1 -- 172.21.15.50:0/2358318984 >> 172.21.15.50:0/2358318984 conn(0x7fcdbc0f6280 msgr2=0x7fcdbc0f7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:52.041 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:52.037+0000 7fcdc0bc4700 1 -- 172.21.15.50:0/2358318984 shutdown_connections 2023-01-04T18:09:52.041 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:52.037+0000 7fcdc0bc4700 1 -- 172.21.15.50:0/2358318984 wait complete. 2023-01-04T18:09:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:Enabling mgr prometheus module... 2023-01-04T18:09:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable prometheus 2023-01-04T18:09:52.527 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:50.965830+0000 mgr.smithi050.emnywo (mgr.14114) 12 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:09:52.527 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:09:50.966397+0000 mgr.smithi050.emnywo (mgr.14114) 13 : cephadm [INF] Saving service mgr spec with placement count:2 2023-01-04T18:09:52.527 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:52.035886+0000 mon.smithi050 (mon.0) 60 : audit [INF] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' 2023-01-04T18:09:53.039 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.035+0000 7f993eb0d700 1 Processor -- start 2023-01-04T18:09:53.040 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.035+0000 7f993eb0d700 1 -- start start 2023-01-04T18:09:53.040 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.035+0000 7f993eb0d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f993806fc90 0x7f99380fe7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:53.040 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.035+0000 7f993eb0d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99380fed60 con 0x7f993806fc90 2023-01-04T18:09:53.040 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.035+0000 7f993c8a9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f993806fc90 0x7f99380fe7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:53.040 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.035+0000 7f993c8a9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f993806fc90 0x7f99380fe7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60104/0 (socket says 172.21.15.50:60104) 2023-01-04T18:09:53.040 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.035+0000 7f993c8a9700 1 -- 172.21.15.50:0/26834215 learned_addr learned my addr 172.21.15.50:0/26834215 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:53.040 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.036+0000 7f993c8a9700 1 -- 172.21.15.50:0/26834215 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99380feea0 con 0x7f993806fc90 2023-01-04T18:09:53.040 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.036+0000 7f993c8a9700 1 --2- 172.21.15.50:0/26834215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f993806fc90 0x7f99380fe7e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f992c00b5f0 tx=0x7f992c006ee0).ready entity=mon.0 client_cookie=905671f0754d609e server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:53.040 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.036+0000 7f99377fe700 1 -- 172.21.15.50:0/26834215 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f992c00d600 con 0x7f993806fc90 2023-01-04T18:09:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.036+0000 7f99377fe700 1 -- 172.21.15.50:0/26834215 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f992c00dc10 con 0x7f993806fc90 2023-01-04T18:09:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.036+0000 7f99377fe700 1 -- 172.21.15.50:0/26834215 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f992c011cd0 con 0x7f993806fc90 2023-01-04T18:09:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.036+0000 7f993eb0d700 1 -- 172.21.15.50:0/26834215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f993806fc90 msgr2=0x7f99380fe7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.036+0000 7f993eb0d700 1 --2- 172.21.15.50:0/26834215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f993806fc90 0x7f99380fe7e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f992c00b5f0 tx=0x7f992c006ee0).stop 2023-01-04T18:09:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.036+0000 7f993eb0d700 1 -- 172.21.15.50:0/26834215 shutdown_connections 2023-01-04T18:09:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.037+0000 7f993eb0d700 1 --2- 172.21.15.50:0/26834215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f993806fc90 0x7f99380fe7e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.037+0000 7f993eb0d700 1 -- 172.21.15.50:0/26834215 >> 172.21.15.50:0/26834215 conn(0x7f99380f6280 msgr2=0x7f99380f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.037+0000 7f993eb0d700 1 -- 172.21.15.50:0/26834215 shutdown_connections 2023-01-04T18:09:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.037+0000 7f993eb0d700 1 -- 172.21.15.50:0/26834215 wait complete. 2023-01-04T18:09:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.037+0000 7f993eb0d700 1 Processor -- start 2023-01-04T18:09:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.037+0000 7f993eb0d700 1 -- start start 2023-01-04T18:09:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.038+0000 7f993eb0d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f993806fc90 0x7f99380fc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.038+0000 7f993eb0d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99380fa6e0 con 0x7f993806fc90 2023-01-04T18:09:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.038+0000 7f993c8a9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f993806fc90 0x7f99380fc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:53.045 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.038+0000 7f993c8a9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f993806fc90 0x7f99380fc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60110/0 (socket says 172.21.15.50:60110) 2023-01-04T18:09:53.045 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.038+0000 7f993c8a9700 1 -- 172.21.15.50:0/1821187694 learned_addr learned my addr 172.21.15.50:0/1821187694 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:53.045 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.038+0000 7f993c8a9700 1 -- 172.21.15.50:0/1821187694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c00b200 con 0x7f993806fc90 2023-01-04T18:09:53.045 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.038+0000 7f993c8a9700 1 --2- 172.21.15.50:0/1821187694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f993806fc90 0x7f99380fc260 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f992c006cb0 tx=0x7f992c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:53.045 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.038+0000 7f99357fa700 1 -- 172.21.15.50:0/1821187694 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f992c011df0 con 0x7f993806fc90 2023-01-04T18:09:53.045 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.038+0000 7f99357fa700 1 -- 172.21.15.50:0/1821187694 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f992c01b8c0 con 0x7f993806fc90 2023-01-04T18:09:53.045 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.038+0000 7f993eb0d700 1 -- 172.21.15.50:0/1821187694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99380fa880 con 0x7f993806fc90 2023-01-04T18:09:53.045 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.038+0000 7f99357fa700 1 -- 172.21.15.50:0/1821187694 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f992c01a930 con 0x7f993806fc90 2023-01-04T18:09:53.045 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.038+0000 7f993eb0d700 1 -- 172.21.15.50:0/1821187694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99380fac90 con 0x7f993806fc90 2023-01-04T18:09:53.045 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.039+0000 7f99357fa700 1 -- 172.21.15.50:0/1821187694 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f992c00f070 con 0x7f993806fc90 2023-01-04T18:09:53.045 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.039+0000 7f99357fa700 1 --2- 172.21.15.50:0/1821187694 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f991c02fd50 0x7f991c032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:53.046 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.039+0000 7f993eb0d700 1 -- 172.21.15.50:0/1821187694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9938045ad0 con 0x7f993806fc90 2023-01-04T18:09:53.046 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.040+0000 7f99357fa700 1 -- 172.21.15.50:0/1821187694 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f992c040e20 con 0x7f993806fc90 2023-01-04T18:09:53.046 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.040+0000 7f9937fff700 1 --2- 172.21.15.50:0/1821187694 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f991c02fd50 0x7f991c032210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:53.046 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.040+0000 7f9937fff700 1 --2- 172.21.15.50:0/1821187694 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f991c02fd50 0x7f991c032210 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f99240096a0 tx=0x7f9924006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:53.047 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.044+0000 7f99357fa700 1 -- 172.21.15.50:0/1821187694 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f992c016030 con 0x7f993806fc90 2023-01-04T18:09:53.251 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:53.248+0000 7f993eb0d700 1 -- 172.21.15.50:0/1821187694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "prometheus"} v 0) v1 -- 0x7f99380ffc40 con 0x7f993806fc90 2023-01-04T18:09:53.267 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:52.032989+0000 mgr.smithi050.emnywo (mgr.14114) 14 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:09:53.267 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:09:52.033634+0000 mgr.smithi050.emnywo (mgr.14114) 15 : cephadm [INF] Saving service crash spec with placement * 2023-01-04T18:09:53.267 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:52.392326+0000 mon.smithi050 (mon.0) 61 : audit [INF] from='mgr.14114 172.21.15.50:0/1748849826' entity='mgr.smithi050.emnywo' 2023-01-04T18:09:54.173 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:54.170+0000 7f99357fa700 1 -- 172.21.15.50:0/1821187694 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 9) v1 ==== 36134+0+0 (secure 0 0 0) 0x7f992c03a070 con 0x7f993806fc90 2023-01-04T18:09:54.174 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:54.171+0000 7f99357fa700 1 -- 172.21.15.50:0/1821187694 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "prometheus"}]=0 v9) v1 ==== 89+0+0 (secure 0 0 0) 0x7f992c03b710 con 0x7f993806fc90 2023-01-04T18:09:54.178 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:54.173+0000 7f993eb0d700 1 -- 172.21.15.50:0/1821187694 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f991c02fd50 msgr2=0x7f991c032210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:54.178 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:54.173+0000 7f993eb0d700 1 --2- 172.21.15.50:0/1821187694 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f991c02fd50 0x7f991c032210 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f99240096a0 tx=0x7f9924006b40).stop 2023-01-04T18:09:54.178 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:54.173+0000 7f993eb0d700 1 -- 172.21.15.50:0/1821187694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f993806fc90 msgr2=0x7f99380fc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:54.178 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:54.173+0000 7f993eb0d700 1 --2- 172.21.15.50:0/1821187694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f993806fc90 0x7f99380fc260 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f992c006cb0 tx=0x7f992c006ee0).stop 2023-01-04T18:09:54.178 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:54.174+0000 7f993eb0d700 1 -- 172.21.15.50:0/1821187694 shutdown_connections 2023-01-04T18:09:54.178 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:54.174+0000 7f993eb0d700 1 --2- 172.21.15.50:0/1821187694 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7f991c02fd50 0x7f991c032210 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:54.178 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:54.174+0000 7f993eb0d700 1 --2- 172.21.15.50:0/1821187694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f993806fc90 0x7f99380fc260 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:54.179 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:54.174+0000 7f993eb0d700 1 -- 172.21.15.50:0/1821187694 >> 172.21.15.50:0/1821187694 conn(0x7f99380f6280 msgr2=0x7f99380f7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:54.179 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:54.174+0000 7f993eb0d700 1 -- 172.21.15.50:0/1821187694 shutdown_connections 2023-01-04T18:09:54.179 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:54.174+0000 7f993eb0d700 1 -- 172.21.15.50:0/1821187694 wait complete. 2023-01-04T18:09:54.510 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:53.249865+0000 mon.smithi050 (mon.0) 62 : audit [INF] from='client.? 172.21.15.50:0/1821187694' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-01-04T18:09:54.567 INFO:teuthology.orchestra.run.smithi050.stderr:Deploying prometheus service with default placement... 2023-01-04T18:09:54.568 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply prometheus 2023-01-04T18:09:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.009+0000 7fba34827700 1 Processor -- start 2023-01-04T18:09:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.009+0000 7fba34827700 1 -- start start 2023-01-04T18:09:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.009+0000 7fba34827700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba3006fbf0 0x7fba30100a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.009+0000 7fba34827700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba300fc480 con 0x7fba3006fbf0 2023-01-04T18:09:55.014 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.009+0000 7fba2f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba3006fbf0 0x7fba30100a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:55.014 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.009+0000 7fba2f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba3006fbf0 0x7fba30100a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60138/0 (socket says 172.21.15.50:60138) 2023-01-04T18:09:55.014 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.009+0000 7fba2f7fe700 1 -- 172.21.15.50:0/2120268179 learned_addr learned my addr 172.21.15.50:0/2120268179 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:55.014 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.010+0000 7fba2f7fe700 1 -- 172.21.15.50:0/2120268179 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba30100f80 con 0x7fba3006fbf0 2023-01-04T18:09:55.014 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.010+0000 7fba2f7fe700 1 --2- 172.21.15.50:0/2120268179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba3006fbf0 0x7fba30100a90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fba2000b5f0 tx=0x7fba20006ee0).ready entity=mon.0 client_cookie=fb4e810bd0be4562 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:55.014 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.010+0000 7fba2e7fc700 1 -- 172.21.15.50:0/2120268179 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba2000d600 con 0x7fba3006fbf0 2023-01-04T18:09:55.014 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.010+0000 7fba2e7fc700 1 -- 172.21.15.50:0/2120268179 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fba2000dc10 con 0x7fba3006fbf0 2023-01-04T18:09:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.010+0000 7fba2e7fc700 1 -- 172.21.15.50:0/2120268179 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba20011d00 con 0x7fba3006fbf0 2023-01-04T18:09:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.011+0000 7fba34827700 1 -- 172.21.15.50:0/2120268179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba3006fbf0 msgr2=0x7fba30100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:09:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.011+0000 7fba34827700 1 --2- 172.21.15.50:0/2120268179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba3006fbf0 0x7fba30100a90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fba2000b5f0 tx=0x7fba20006ee0).stop 2023-01-04T18:09:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.011+0000 7fba34827700 1 -- 172.21.15.50:0/2120268179 shutdown_connections 2023-01-04T18:09:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.011+0000 7fba34827700 1 --2- 172.21.15.50:0/2120268179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba3006fbf0 0x7fba30100a90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:09:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.011+0000 7fba34827700 1 -- 172.21.15.50:0/2120268179 >> 172.21.15.50:0/2120268179 conn(0x7fba300f6130 msgr2=0x7fba300f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:09:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.011+0000 7fba34827700 1 -- 172.21.15.50:0/2120268179 shutdown_connections 2023-01-04T18:09:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.011+0000 7fba34827700 1 -- 172.21.15.50:0/2120268179 wait complete. 2023-01-04T18:09:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.012+0000 7fba34827700 1 Processor -- start 2023-01-04T18:09:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.012+0000 7fba34827700 1 -- start start 2023-01-04T18:09:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.012+0000 7fba34827700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba3006fbf0 0x7fba3010ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.012+0000 7fba34827700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3010cf30 con 0x7fba3006fbf0 2023-01-04T18:09:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.012+0000 7fba2f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba3006fbf0 0x7fba3010ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:09:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.013+0000 7fba2f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba3006fbf0 0x7fba3010ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60150/0 (socket says 172.21.15.50:60150) 2023-01-04T18:09:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.013+0000 7fba2f7fe700 1 -- 172.21.15.50:0/427545854 learned_addr learned my addr 172.21.15.50:0/427545854 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:09:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.013+0000 7fba2f7fe700 1 -- 172.21.15.50:0/427545854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2000b200 con 0x7fba3006fbf0 2023-01-04T18:09:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.013+0000 7fba2f7fe700 1 --2- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba3006fbf0 0x7fba3010ca40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fba2000bf30 tx=0x7fba20006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:09:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.013+0000 7fba17fff700 1 -- 172.21.15.50:0/427545854 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba2001b410 con 0x7fba3006fbf0 2023-01-04T18:09:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.013+0000 7fba17fff700 1 -- 172.21.15.50:0/427545854 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fba2001ba20 con 0x7fba3006fbf0 2023-01-04T18:09:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.013+0000 7fba34827700 1 -- 172.21.15.50:0/427545854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba3010d130 con 0x7fba3006fbf0 2023-01-04T18:09:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.013+0000 7fba17fff700 1 -- 172.21.15.50:0/427545854 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba2001aa40 con 0x7fba3006fbf0 2023-01-04T18:09:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.013+0000 7fba34827700 1 -- 172.21.15.50:0/427545854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3010d540 con 0x7fba3006fbf0 2023-01-04T18:09:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.014+0000 7fba34827700 1 -- 172.21.15.50:0/427545854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba30045ad0 con 0x7fba3006fbf0 2023-01-04T18:09:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.014+0000 7fba17fff700 1 -- 172.21.15.50:0/427545854 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 9) v1 ==== 36134+0+0 (secure 0 0 0) 0x7fba2000f070 con 0x7fba3006fbf0 2023-01-04T18:09:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.014+0000 7fba17fff700 1 --2- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fba1c02fdb0 0x7fba1c032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:09:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.014+0000 7fba17fff700 1 -- 172.21.15.50:0/427545854 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7fba20041130 con 0x7fba3006fbf0 2023-01-04T18:09:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.014+0000 7fba2effd700 1 -- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fba1c02fdb0 msgr2=0x7fba1c032270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/3751193798 2023-01-04T18:09:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.014+0000 7fba2effd700 1 --2- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fba1c02fdb0 0x7fba1c032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-01-04T18:09:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.022+0000 7fba17fff700 1 -- 172.21.15.50:0/427545854 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fba20010d70 con 0x7fba3006fbf0 2023-01-04T18:09:55.216 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.213+0000 7fba34827700 1 -- 172.21.15.50:0/427545854 --> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fba3010de20 con 0x7fba1c02fdb0 2023-01-04T18:09:55.218 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.215+0000 7fba2effd700 1 -- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fba1c02fdb0 msgr2=0x7fba1c032270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/3751193798 2023-01-04T18:09:55.218 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.215+0000 7fba2effd700 1 --2- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fba1c02fdb0 0x7fba1c032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-01-04T18:09:55.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:54.172703+0000 mon.smithi050 (mon.0) 63 : audit [INF] from='client.? 172.21.15.50:0/1821187694' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-01-04T18:09:55.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:09:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:54.172779+0000 mon.smithi050 (mon.0) 64 : cluster [DBG] mgrmap e9: smithi050.emnywo(active, since 18s) 2023-01-04T18:09:55.619 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.616+0000 7fba2effd700 1 -- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fba1c02fdb0 msgr2=0x7fba1c032270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/3751193798 2023-01-04T18:09:55.619 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:55.616+0000 7fba2effd700 1 --2- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fba1c02fdb0 0x7fba1c032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-01-04T18:09:56.420 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:56.417+0000 7fba2effd700 1 -- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fba1c02fdb0 msgr2=0x7fba1c032270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/3751193798 2023-01-04T18:09:56.420 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:56.417+0000 7fba2effd700 1 --2- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fba1c02fdb0 0x7fba1c032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-01-04T18:09:58.022 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:58.019+0000 7fba2effd700 1 -- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fba1c02fdb0 msgr2=0x7fba1c032270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/3751193798 2023-01-04T18:09:58.022 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:58.019+0000 7fba2effd700 1 --2- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fba1c02fdb0 0x7fba1c032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-01-04T18:09:59.414 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:59.412+0000 7fba17fff700 1 -- 172.21.15.50:0/427545854 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 10) v1 ==== 35984+0+0 (secure 0 0 0) 0x7fba2001acf0 con 0x7fba3006fbf0 2023-01-04T18:09:59.414 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:59.412+0000 7fba17fff700 1 -- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fba1c02fdb0 msgr2=0x7fba1c032270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-01-04T18:09:59.414 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:09:59.412+0000 7fba17fff700 1 --2- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fba1c02fdb0 0x7fba1c032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-01-04T18:10:00.417 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:00.413+0000 7fba17fff700 1 -- 172.21.15.50:0/427545854 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mgrmap(e 11) v1 ==== 36054+0+0 (secure 0 0 0) 0x7fba2003cdb0 con 0x7fba3006fbf0 2023-01-04T18:10:00.417 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:00.413+0000 7fba17fff700 1 --2- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7fba1c033c20 0x7fba1c036010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:00.417 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:00.413+0000 7fba17fff700 1 -- 172.21.15.50:0/427545854 --> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fba3010de20 con 0x7fba1c033c20 2023-01-04T18:10:00.417 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:00.414+0000 7fba2effd700 1 --2- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7fba1c033c20 0x7fba1c036010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:00.418 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:00.414+0000 7fba2effd700 1 --2- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7fba1c033c20 0x7fba1c036010 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fba240036d0 tx=0x7fba24006cb0).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:00.420 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:00.418+0000 7fba17fff700 1 -- 172.21.15.50:0/427545854 <== mgr.14142 v2:172.21.15.50:6800/2515216785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fba3010de20 con 0x7fba1c033c20 2023-01-04T18:10:00.421 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: Scheduled prometheus update... 2023-01-04T18:10:00.423 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:00.420+0000 7fba34827700 1 -- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7fba1c033c20 msgr2=0x7fba1c036010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:00.423 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:00.420+0000 7fba34827700 1 --2- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7fba1c033c20 0x7fba1c036010 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fba240036d0 tx=0x7fba24006cb0).stop 2023-01-04T18:10:00.423 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:00.420+0000 7fba34827700 1 -- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba3006fbf0 msgr2=0x7fba3010ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:00.423 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:00.420+0000 7fba34827700 1 --2- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba3006fbf0 0x7fba3010ca40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fba2000bf30 tx=0x7fba20006ee0).stop 2023-01-04T18:10:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:00.420+0000 7fba34827700 1 -- 172.21.15.50:0/427545854 shutdown_connections 2023-01-04T18:10:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:00.420+0000 7fba34827700 1 --2- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7fba1c033c20 0x7fba1c036010 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:00.420+0000 7fba34827700 1 --2- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba3006fbf0 0x7fba3010ca40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:00.420+0000 7fba34827700 1 --2- 172.21.15.50:0/427545854 >> [v2:172.21.15.50:6800/3751193798,v1:172.21.15.50:6801/3751193798] conn(0x7fba1c02fdb0 0x7fba1c032270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-01-04T18:10:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:00.420+0000 7fba34827700 1 -- 172.21.15.50:0/427545854 >> 172.21.15.50:0/427545854 conn(0x7fba300f6130 msgr2=0x7fba300f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:00.420+0000 7fba34827700 1 -- 172.21.15.50:0/427545854 shutdown_connections 2023-01-04T18:10:00.424 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:00.420+0000 7fba34827700 1 -- 172.21.15.50:0/427545854 wait complete. 2023-01-04T18:10:00.451 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:59.360290+0000 mon.smithi050 (mon.0) 65 : cluster [INF] Active manager daemon smithi050.emnywo restarted 2023-01-04T18:10:00.451 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:59.360714+0000 mon.smithi050 (mon.0) 66 : cluster [INF] Activating manager daemon smithi050.emnywo 2023-01-04T18:10:00.451 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:59.362594+0000 mon.smithi050 (mon.0) 67 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2023-01-04T18:10:00.451 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:59.413500+0000 mon.smithi050 (mon.0) 68 : cluster [DBG] mgrmap e10: smithi050.emnywo(active, starting, since 0.0528772s) 2023-01-04T18:10:00.451 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:59.414620+0000 mon.smithi050 (mon.0) 69 : audit [DBG] from='mgr.14142 172.21.15.50:0/288554034' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi050"}]: dispatch 2023-01-04T18:10:00.452 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:59.415170+0000 mon.smithi050 (mon.0) 70 : audit [DBG] from='mgr.14142 172.21.15.50:0/288554034' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mgr metadata", "who": "smithi050.emnywo", "id": "smithi050.emnywo"}]: dispatch 2023-01-04T18:10:00.452 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:59.416083+0000 mon.smithi050 (mon.0) 71 : audit [DBG] from='mgr.14142 172.21.15.50:0/288554034' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-01-04T18:10:00.452 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:59.416248+0000 mon.smithi050 (mon.0) 72 : audit [DBG] from='mgr.14142 172.21.15.50:0/288554034' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-01-04T18:10:00.452 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:59.416390+0000 mon.smithi050 (mon.0) 73 : audit [DBG] from='mgr.14142 172.21.15.50:0/288554034' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-01-04T18:10:00.452 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:09:59.429881+0000 mon.smithi050 (mon.0) 74 : cluster [INF] Manager daemon smithi050.emnywo is now available 2023-01-04T18:10:00.452 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:59.535094+0000 mon.smithi050 (mon.0) 75 : audit [DBG] from='mgr.14142 172.21.15.50:0/288554034' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:10:00.452 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:59.536837+0000 mon.smithi050 (mon.0) 76 : audit [DBG] from='mgr.14142 172.21.15.50:0/288554034' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:10:00.452 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:59.553023+0000 mon.smithi050 (mon.0) 77 : audit [INF] from='mgr.14142 172.21.15.50:0/288554034' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:10:00.452 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:09:59.555319+0000 mon.smithi050 (mon.0) 78 : audit [INF] from='mgr.14142 172.21.15.50:0/288554034' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:10:01.018 INFO:teuthology.orchestra.run.smithi050.stderr:Deploying grafana service with default placement... 2023-01-04T18:10:01.018 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply grafana 2023-01-04T18:10:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.516+0000 7f90c572a700 1 Processor -- start 2023-01-04T18:10:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.516+0000 7f90c572a700 1 -- start start 2023-01-04T18:10:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.517+0000 7f90c572a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90c006fc70 0x7f90c0100c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.517+0000 7f90c572a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c00fc680 con 0x7f90c006fc70 2023-01-04T18:10:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.517+0000 7f90beffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90c006fc70 0x7f90c0100c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:01.521 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.517+0000 7f90beffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90c006fc70 0x7f90c0100c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48192/0 (socket says 172.21.15.50:48192) 2023-01-04T18:10:01.521 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.517+0000 7f90beffd700 1 -- 172.21.15.50:0/2724748313 learned_addr learned my addr 172.21.15.50:0/2724748313 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:01.522 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.517+0000 7f90beffd700 1 -- 172.21.15.50:0/2724748313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c01010f0 con 0x7f90c006fc70 2023-01-04T18:10:01.522 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.517+0000 7f90beffd700 1 --2- 172.21.15.50:0/2724748313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90c006fc70 0x7f90c0100c00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f90b000b5f0 tx=0x7f90b0006ee0).ready entity=mon.0 client_cookie=e3617ec59e1170f6 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:01.522 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.518+0000 7f90be7fc700 1 -- 172.21.15.50:0/2724748313 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90b000d600 con 0x7f90c006fc70 2023-01-04T18:10:01.522 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.518+0000 7f90be7fc700 1 -- 172.21.15.50:0/2724748313 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f90b000dc10 con 0x7f90c006fc70 2023-01-04T18:10:01.522 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.518+0000 7f90be7fc700 1 -- 172.21.15.50:0/2724748313 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90b0011cd0 con 0x7f90c006fc70 2023-01-04T18:10:01.522 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.518+0000 7f90c572a700 1 -- 172.21.15.50:0/2724748313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90c006fc70 msgr2=0x7f90c0100c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:01.522 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.518+0000 7f90c572a700 1 --2- 172.21.15.50:0/2724748313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90c006fc70 0x7f90c0100c00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f90b000b5f0 tx=0x7f90b0006ee0).stop 2023-01-04T18:10:01.522 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.518+0000 7f90c572a700 1 -- 172.21.15.50:0/2724748313 shutdown_connections 2023-01-04T18:10:01.522 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.518+0000 7f90c572a700 1 --2- 172.21.15.50:0/2724748313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90c006fc70 0x7f90c0100c00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:01.522 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.518+0000 7f90c572a700 1 -- 172.21.15.50:0/2724748313 >> 172.21.15.50:0/2724748313 conn(0x7f90c00f6280 msgr2=0x7f90c00f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:01.522 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.518+0000 7f90c572a700 1 -- 172.21.15.50:0/2724748313 shutdown_connections 2023-01-04T18:10:01.523 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.518+0000 7f90c572a700 1 -- 172.21.15.50:0/2724748313 wait complete. 2023-01-04T18:10:01.523 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.519+0000 7f90c572a700 1 Processor -- start 2023-01-04T18:10:01.523 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.519+0000 7f90c572a700 1 -- start start 2023-01-04T18:10:01.523 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.519+0000 7f90c572a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90c006fc70 0x7f90c010cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:01.523 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.519+0000 7f90c572a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c010d100 con 0x7f90c006fc70 2023-01-04T18:10:01.523 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:01 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:00.415783+0000 mon.smithi050 (mon.0) 79 : cluster [DBG] mgrmap e11: smithi050.emnywo(active, since 1.05516s) 2023-01-04T18:10:01.523 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:01 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:10:00.416740+0000 mgr.smithi050.emnywo (mgr.14142) 2 : cephadm [INF] Saving service prometheus spec with placement count:1 2023-01-04T18:10:01.524 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:01 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:00.418718+0000 mon.smithi050 (mon.0) 80 : audit [INF] from='mgr.14142 172.21.15.50:0/288554034' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:01.524 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:01 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:01.186621+0000 mon.smithi050 (mon.0) 81 : audit [INF] from='mgr.14142 172.21.15.50:0/288554034' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:01.525 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.520+0000 7f90beffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90c006fc70 0x7f90c010cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:01.525 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.520+0000 7f90beffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90c006fc70 0x7f90c010cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48202/0 (socket says 172.21.15.50:48202) 2023-01-04T18:10:01.525 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.520+0000 7f90beffd700 1 -- 172.21.15.50:0/1455827008 learned_addr learned my addr 172.21.15.50:0/1455827008 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:01.525 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.520+0000 7f90beffd700 1 -- 172.21.15.50:0/1455827008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b000b200 con 0x7f90c006fc70 2023-01-04T18:10:01.525 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.520+0000 7f90beffd700 1 --2- 172.21.15.50:0/1455827008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90c006fc70 0x7f90c010cc10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f90b000b1d0 tx=0x7f90b0006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.520+0000 7f90b7fff700 1 -- 172.21.15.50:0/1455827008 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90b0011df0 con 0x7f90c006fc70 2023-01-04T18:10:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.520+0000 7f90c572a700 1 -- 172.21.15.50:0/1455827008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c010d300 con 0x7f90c006fc70 2023-01-04T18:10:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.520+0000 7f90b7fff700 1 -- 172.21.15.50:0/1455827008 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f90b001b8c0 con 0x7f90c006fc70 2023-01-04T18:10:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.520+0000 7f90b7fff700 1 -- 172.21.15.50:0/1455827008 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90b001a7b0 con 0x7f90c006fc70 2023-01-04T18:10:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.520+0000 7f90c572a700 1 -- 172.21.15.50:0/1455827008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c010d710 con 0x7f90c006fc70 2023-01-04T18:10:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.521+0000 7f90b7fff700 1 -- 172.21.15.50:0/1455827008 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 11) v1 ==== 36054+0+0 (secure 0 0 0) 0x7f90b000f070 con 0x7f90c006fc70 2023-01-04T18:10:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.521+0000 7f90b7fff700 1 --2- 172.21.15.50:0/1455827008 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f90a002fd10 0x7f90a00321d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.521+0000 7f90b7fff700 1 -- 172.21.15.50:0/1455827008 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f90b001ba30 con 0x7f90c006fc70 2023-01-04T18:10:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.521+0000 7f90c572a700 1 -- 172.21.15.50:0/1455827008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c0045ad0 con 0x7f90c006fc70 2023-01-04T18:10:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.522+0000 7f90b67fc700 1 --2- 172.21.15.50:0/1455827008 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f90a002fd10 0x7f90a00321d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.522+0000 7f90b67fc700 1 --2- 172.21.15.50:0/1455827008 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f90a002fd10 0x7f90a00321d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f90a80096a0 tx=0x7f90a8006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.526+0000 7f90b7fff700 1 -- 172.21.15.50:0/1455827008 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f90b0016070 con 0x7f90c006fc70 2023-01-04T18:10:01.719 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.716+0000 7f90c572a700 1 -- 172.21.15.50:0/1455827008 --> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f90c010e050 con 0x7f90a002fd10 2023-01-04T18:10:01.722 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.720+0000 7f90b7fff700 1 -- 172.21.15.50:0/1455827008 <== mgr.14142 v2:172.21.15.50:6800/2515216785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f90c010e050 con 0x7f90a002fd10 2023-01-04T18:10:01.722 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: Scheduled grafana update... 2023-01-04T18:10:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.722+0000 7f90c572a700 1 -- 172.21.15.50:0/1455827008 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f90a002fd10 msgr2=0x7f90a00321d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.722+0000 7f90c572a700 1 --2- 172.21.15.50:0/1455827008 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f90a002fd10 0x7f90a00321d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f90a80096a0 tx=0x7f90a8006b40).stop 2023-01-04T18:10:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.722+0000 7f90c572a700 1 -- 172.21.15.50:0/1455827008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90c006fc70 msgr2=0x7f90c010cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.722+0000 7f90c572a700 1 --2- 172.21.15.50:0/1455827008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90c006fc70 0x7f90c010cc10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f90b000b1d0 tx=0x7f90b0006ee0).stop 2023-01-04T18:10:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.722+0000 7f90c572a700 1 -- 172.21.15.50:0/1455827008 shutdown_connections 2023-01-04T18:10:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.722+0000 7f90c572a700 1 --2- 172.21.15.50:0/1455827008 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f90a002fd10 0x7f90a00321d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.722+0000 7f90c572a700 1 --2- 172.21.15.50:0/1455827008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90c006fc70 0x7f90c010cc10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.722+0000 7f90c572a700 1 -- 172.21.15.50:0/1455827008 >> 172.21.15.50:0/1455827008 conn(0x7f90c00f6280 msgr2=0x7f90c00f7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.722+0000 7f90c572a700 1 -- 172.21.15.50:0/1455827008 shutdown_connections 2023-01-04T18:10:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:01.722+0000 7f90c572a700 1 -- 172.21.15.50:0/1455827008 wait complete. 2023-01-04T18:10:02.260 INFO:teuthology.orchestra.run.smithi050.stderr:Deploying node-exporter service with default placement... 2023-01-04T18:10:02.260 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply node-exporter 2023-01-04T18:10:02.790 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.786+0000 7f2b2b7fb700 1 Processor -- start 2023-01-04T18:10:02.790 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.786+0000 7f2b2b7fb700 1 -- start start 2023-01-04T18:10:02.790 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.787+0000 7f2b2b7fb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b24071cd0 0x7f2b24070270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:02.790 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.787+0000 7f2b2b7fb700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b240720f0 con 0x7f2b24071cd0 2023-01-04T18:10:02.790 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.787+0000 7f2b29597700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b24071cd0 0x7f2b24070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:02.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.787+0000 7f2b29597700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b24071cd0 0x7f2b24070270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48204/0 (socket says 172.21.15.50:48204) 2023-01-04T18:10:02.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.787+0000 7f2b29597700 1 -- 172.21.15.50:0/105043917 learned_addr learned my addr 172.21.15.50:0/105043917 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:02.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.787+0000 7f2b29597700 1 -- 172.21.15.50:0/105043917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b24070760 con 0x7f2b24071cd0 2023-01-04T18:10:02.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.787+0000 7f2b29597700 1 --2- 172.21.15.50:0/105043917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b24071cd0 0x7f2b24070270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f2b1800b5f0 tx=0x7f2b18006ee0).ready entity=mon.0 client_cookie=2e5bc38e5b99258b server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:02.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.788+0000 7f2b17fff700 1 -- 172.21.15.50:0/105043917 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b1800d600 con 0x7f2b24071cd0 2023-01-04T18:10:02.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.788+0000 7f2b17fff700 1 -- 172.21.15.50:0/105043917 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2b1800dc10 con 0x7f2b24071cd0 2023-01-04T18:10:02.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.788+0000 7f2b17fff700 1 -- 172.21.15.50:0/105043917 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b18011cd0 con 0x7f2b24071cd0 2023-01-04T18:10:02.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.788+0000 7f2b2b7fb700 1 -- 172.21.15.50:0/105043917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b24071cd0 msgr2=0x7f2b24070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:02.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.788+0000 7f2b2b7fb700 1 --2- 172.21.15.50:0/105043917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b24071cd0 0x7f2b24070270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f2b1800b5f0 tx=0x7f2b18006ee0).stop 2023-01-04T18:10:02.794 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.788+0000 7f2b2b7fb700 1 -- 172.21.15.50:0/105043917 shutdown_connections 2023-01-04T18:10:02.794 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.788+0000 7f2b2b7fb700 1 --2- 172.21.15.50:0/105043917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b24071cd0 0x7f2b24070270 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:02.794 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.788+0000 7f2b2b7fb700 1 -- 172.21.15.50:0/105043917 >> 172.21.15.50:0/105043917 conn(0x7f2b240f73f0 msgr2=0x7f2b240f9810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:02.794 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.788+0000 7f2b2b7fb700 1 -- 172.21.15.50:0/105043917 shutdown_connections 2023-01-04T18:10:02.794 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.788+0000 7f2b2b7fb700 1 -- 172.21.15.50:0/105043917 wait complete. 2023-01-04T18:10:02.794 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.789+0000 7f2b2b7fb700 1 Processor -- start 2023-01-04T18:10:02.794 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.789+0000 7f2b2b7fb700 1 -- start start 2023-01-04T18:10:02.794 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.789+0000 7f2b2b7fb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b24071cd0 0x7f2b2410cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:02.794 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.789+0000 7f2b2b7fb700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2410d0a0 con 0x7f2b24071cd0 2023-01-04T18:10:02.795 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.789+0000 7f2b29597700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b24071cd0 0x7f2b2410cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:02.795 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.789+0000 7f2b29597700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b24071cd0 0x7f2b2410cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48206/0 (socket says 172.21.15.50:48206) 2023-01-04T18:10:02.795 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.789+0000 7f2b29597700 1 -- 172.21.15.50:0/2006342354 learned_addr learned my addr 172.21.15.50:0/2006342354 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:02.795 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.790+0000 7f2b29597700 1 -- 172.21.15.50:0/2006342354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1800b200 con 0x7f2b24071cd0 2023-01-04T18:10:02.795 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.790+0000 7f2b29597700 1 --2- 172.21.15.50:0/2006342354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b24071cd0 0x7f2b2410cbb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f2b18006a40 tx=0x7f2b18006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:02.795 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.790+0000 7f2b15ffb700 1 -- 172.21.15.50:0/2006342354 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b18011c90 con 0x7f2b24071cd0 2023-01-04T18:10:02.795 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.790+0000 7f2b15ffb700 1 -- 172.21.15.50:0/2006342354 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2b1801b8c0 con 0x7f2b24071cd0 2023-01-04T18:10:02.795 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.790+0000 7f2b2b7fb700 1 -- 172.21.15.50:0/2006342354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b2410d2a0 con 0x7f2b24071cd0 2023-01-04T18:10:02.795 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.790+0000 7f2b15ffb700 1 -- 172.21.15.50:0/2006342354 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b1801a8c0 con 0x7f2b24071cd0 2023-01-04T18:10:02.795 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.790+0000 7f2b2b7fb700 1 -- 172.21.15.50:0/2006342354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2410d6b0 con 0x7f2b24071cd0 2023-01-04T18:10:02.796 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.791+0000 7f2b15ffb700 1 -- 172.21.15.50:0/2006342354 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f2b1800f070 con 0x7f2b24071cd0 2023-01-04T18:10:02.796 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.791+0000 7f2b15ffb700 1 --2- 172.21.15.50:0/2006342354 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f2b0c02feb0 0x7f2b0c032370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:02.796 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.791+0000 7f2b15ffb700 1 -- 172.21.15.50:0/2006342354 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f2b18040930 con 0x7f2b24071cd0 2023-01-04T18:10:02.796 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.791+0000 7f2b2b7fb700 1 -- 172.21.15.50:0/2006342354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b24045ad0 con 0x7f2b24071cd0 2023-01-04T18:10:02.796 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.791+0000 7f2b28d96700 1 --2- 172.21.15.50:0/2006342354 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f2b0c02feb0 0x7f2b0c032370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:02.796 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.792+0000 7f2b28d96700 1 --2- 172.21.15.50:0/2006342354 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f2b0c02feb0 0x7f2b0c032370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f2b200096a0 tx=0x7f2b20006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:02.798 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.795+0000 7f2b15ffb700 1 -- 172.21.15.50:0/2006342354 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2b18016070 con 0x7f2b24071cd0 2023-01-04T18:10:02.983 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.981+0000 7f2b2b7fb700 1 -- 172.21.15.50:0/2006342354 --> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b2410df90 con 0x7f2b0c02feb0 2023-01-04T18:10:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.984+0000 7f2b15ffb700 1 -- 172.21.15.50:0/2006342354 <== mgr.14142 v2:172.21.15.50:6800/2515216785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f2b2410df90 con 0x7f2b0c02feb0 2023-01-04T18:10:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: Scheduled node-exporter update... 2023-01-04T18:10:02.989 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.986+0000 7f2b2b7fb700 1 -- 172.21.15.50:0/2006342354 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f2b0c02feb0 msgr2=0x7f2b0c032370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:02.989 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.986+0000 7f2b2b7fb700 1 --2- 172.21.15.50:0/2006342354 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f2b0c02feb0 0x7f2b0c032370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f2b200096a0 tx=0x7f2b20006b40).stop 2023-01-04T18:10:02.990 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.986+0000 7f2b2b7fb700 1 -- 172.21.15.50:0/2006342354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b24071cd0 msgr2=0x7f2b2410cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:02.990 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.986+0000 7f2b2b7fb700 1 --2- 172.21.15.50:0/2006342354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b24071cd0 0x7f2b2410cbb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f2b18006a40 tx=0x7f2b18006ee0).stop 2023-01-04T18:10:02.990 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.986+0000 7f2b2b7fb700 1 -- 172.21.15.50:0/2006342354 shutdown_connections 2023-01-04T18:10:02.990 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.986+0000 7f2b2b7fb700 1 --2- 172.21.15.50:0/2006342354 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f2b0c02feb0 0x7f2b0c032370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:02.990 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.986+0000 7f2b2b7fb700 1 --2- 172.21.15.50:0/2006342354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b24071cd0 0x7f2b2410cbb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:02.990 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.986+0000 7f2b2b7fb700 1 -- 172.21.15.50:0/2006342354 >> 172.21.15.50:0/2006342354 conn(0x7f2b240f73f0 msgr2=0x7f2b240f8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:02.990 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.986+0000 7f2b2b7fb700 1 -- 172.21.15.50:0/2006342354 shutdown_connections 2023-01-04T18:10:02.990 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:02.986+0000 7f2b2b7fb700 1 -- 172.21.15.50:0/2006342354 wait complete. 2023-01-04T18:10:03.009 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:01.717653+0000 mgr.smithi050.emnywo (mgr.14142) 3 : audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:10:03.009 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:10:01.718241+0000 mgr.smithi050.emnywo (mgr.14142) 4 : cephadm [INF] Saving service grafana spec with placement count:1 2023-01-04T18:10:03.009 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:01.720347+0000 mon.smithi050 (mon.0) 82 : audit [INF] from='mgr.14142 172.21.15.50:0/288554034' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:03.009 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:02.187898+0000 mon.smithi050 (mon.0) 83 : cluster [DBG] mgrmap e12: smithi050.emnywo(active, since 2s) 2023-01-04T18:10:03.399 INFO:teuthology.orchestra.run.smithi050.stderr:Deploying alertmanager service with default placement... 2023-01-04T18:10:03.399 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply alertmanager 2023-01-04T18:10:03.839 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.836+0000 7f570359e700 1 Processor -- start 2023-01-04T18:10:03.839 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.836+0000 7f570359e700 1 -- start start 2023-01-04T18:10:03.839 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.836+0000 7f570359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57040fa8f0 0x7f57040fad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:03.839 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.836+0000 7f570359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57040fb200 con 0x7f57040fa8f0 2023-01-04T18:10:03.840 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.836+0000 7f570259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57040fa8f0 0x7f57040fad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:03.840 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.836+0000 7f570259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57040fa8f0 0x7f57040fad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48208/0 (socket says 172.21.15.50:48208) 2023-01-04T18:10:03.840 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.836+0000 7f570259c700 1 -- 172.21.15.50:0/1595866932 learned_addr learned my addr 172.21.15.50:0/1595866932 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:03.840 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.837+0000 7f570259c700 1 -- 172.21.15.50:0/1595866932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57040fb340 con 0x7f57040fa8f0 2023-01-04T18:10:03.843 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.837+0000 7f570259c700 1 --2- 172.21.15.50:0/1595866932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57040fa8f0 0x7f57040fad10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f56f400b5f0 tx=0x7f56f4006ee0).ready entity=mon.0 client_cookie=4a29b422473cca7f server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:03.843 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.837+0000 7f570159a700 1 -- 172.21.15.50:0/1595866932 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56f400d600 con 0x7f57040fa8f0 2023-01-04T18:10:03.843 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.837+0000 7f570159a700 1 -- 172.21.15.50:0/1595866932 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f56f400dc10 con 0x7f57040fa8f0 2023-01-04T18:10:03.843 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.837+0000 7f570159a700 1 -- 172.21.15.50:0/1595866932 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56f4011cd0 con 0x7f57040fa8f0 2023-01-04T18:10:03.843 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.837+0000 7f570359e700 1 -- 172.21.15.50:0/1595866932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57040fa8f0 msgr2=0x7f57040fad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:03.843 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.837+0000 7f570359e700 1 --2- 172.21.15.50:0/1595866932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57040fa8f0 0x7f57040fad10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f56f400b5f0 tx=0x7f56f4006ee0).stop 2023-01-04T18:10:03.843 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.837+0000 7f570359e700 1 -- 172.21.15.50:0/1595866932 shutdown_connections 2023-01-04T18:10:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.837+0000 7f570359e700 1 --2- 172.21.15.50:0/1595866932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57040fa8f0 0x7f57040fad10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.837+0000 7f570359e700 1 -- 172.21.15.50:0/1595866932 >> 172.21.15.50:0/1595866932 conn(0x7f57040f6130 msgr2=0x7f57040f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.838+0000 7f570359e700 1 -- 172.21.15.50:0/1595866932 shutdown_connections 2023-01-04T18:10:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.838+0000 7f570359e700 1 -- 172.21.15.50:0/1595866932 wait complete. 2023-01-04T18:10:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.838+0000 7f570359e700 1 Processor -- start 2023-01-04T18:10:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.838+0000 7f570359e700 1 -- start start 2023-01-04T18:10:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.838+0000 7f570359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57040fa8f0 0x7f57041096d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.838+0000 7f570359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5704109bc0 con 0x7f57040fa8f0 2023-01-04T18:10:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.838+0000 7f570259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57040fa8f0 0x7f57041096d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.838+0000 7f570259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57040fa8f0 0x7f57041096d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48212/0 (socket says 172.21.15.50:48212) 2023-01-04T18:10:03.845 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.838+0000 7f570259c700 1 -- 172.21.15.50:0/3379150650 learned_addr learned my addr 172.21.15.50:0/3379150650 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:03.845 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.839+0000 7f570259c700 1 -- 172.21.15.50:0/3379150650 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f400b200 con 0x7f57040fa8f0 2023-01-04T18:10:03.845 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.839+0000 7f570259c700 1 --2- 172.21.15.50:0/3379150650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57040fa8f0 0x7f57041096d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f56f400e040 tx=0x7f56f4006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:03.845 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.839+0000 7f56f2ffd700 1 -- 172.21.15.50:0/3379150650 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56f401b410 con 0x7f57040fa8f0 2023-01-04T18:10:03.845 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.839+0000 7f56f2ffd700 1 -- 172.21.15.50:0/3379150650 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f56f401ba20 con 0x7f57040fa8f0 2023-01-04T18:10:03.845 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.839+0000 7f570359e700 1 -- 172.21.15.50:0/3379150650 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5704109dc0 con 0x7f57040fa8f0 2023-01-04T18:10:03.845 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.839+0000 7f56f2ffd700 1 -- 172.21.15.50:0/3379150650 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56f401a910 con 0x7f57040fa8f0 2023-01-04T18:10:03.845 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.839+0000 7f570359e700 1 -- 172.21.15.50:0/3379150650 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f570410a1d0 con 0x7f57040fa8f0 2023-01-04T18:10:03.845 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.840+0000 7f56f2ffd700 1 -- 172.21.15.50:0/3379150650 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f56f400f070 con 0x7f57040fa8f0 2023-01-04T18:10:03.845 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.840+0000 7f56f2ffd700 1 --2- 172.21.15.50:0/3379150650 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f56e802fe60 0x7f56e8032320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:03.845 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.840+0000 7f56f2ffd700 1 -- 172.21.15.50:0/3379150650 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f56f4041210 con 0x7f57040fa8f0 2023-01-04T18:10:03.845 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.840+0000 7f5701d9b700 1 --2- 172.21.15.50:0/3379150650 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f56e802fe60 0x7f56e8032320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:03.846 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.840+0000 7f570359e700 1 -- 172.21.15.50:0/3379150650 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5704059100 con 0x7f57040fa8f0 2023-01-04T18:10:03.846 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.841+0000 7f5701d9b700 1 --2- 172.21.15.50:0/3379150650 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f56e802fe60 0x7f56e8032320 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f56f80096a0 tx=0x7f56f8006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:03.846 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:03.844+0000 7f56f2ffd700 1 -- 172.21.15.50:0/3379150650 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f56f4016020 con 0x7f57040fa8f0 2023-01-04T18:10:04.034 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.032+0000 7f570359e700 1 -- 172.21.15.50:0/3379150650 --> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f57041035e0 con 0x7f56e802fe60 2023-01-04T18:10:04.038 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.035+0000 7f56f2ffd700 1 -- 172.21.15.50:0/3379150650 <== mgr.14142 v2:172.21.15.50:6800/2515216785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f57041035e0 con 0x7f56e802fe60 2023-01-04T18:10:04.038 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: Scheduled alertmanager update... 2023-01-04T18:10:04.041 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.037+0000 7f570359e700 1 -- 172.21.15.50:0/3379150650 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f56e802fe60 msgr2=0x7f56e8032320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:04.041 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.037+0000 7f570359e700 1 --2- 172.21.15.50:0/3379150650 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f56e802fe60 0x7f56e8032320 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f56f80096a0 tx=0x7f56f8006b40).stop 2023-01-04T18:10:04.041 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.037+0000 7f570359e700 1 -- 172.21.15.50:0/3379150650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57040fa8f0 msgr2=0x7f57041096d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:04.041 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.037+0000 7f570359e700 1 --2- 172.21.15.50:0/3379150650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57040fa8f0 0x7f57041096d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f56f400e040 tx=0x7f56f4006ee0).stop 2023-01-04T18:10:04.041 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.037+0000 7f570359e700 1 -- 172.21.15.50:0/3379150650 shutdown_connections 2023-01-04T18:10:04.042 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.037+0000 7f570359e700 1 --2- 172.21.15.50:0/3379150650 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f56e802fe60 0x7f56e8032320 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:04.042 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.037+0000 7f570359e700 1 --2- 172.21.15.50:0/3379150650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57040fa8f0 0x7f57041096d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:04.042 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.037+0000 7f570359e700 1 -- 172.21.15.50:0/3379150650 >> 172.21.15.50:0/3379150650 conn(0x7f57040f6130 msgr2=0x7f57040f7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:04.042 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.037+0000 7f570359e700 1 -- 172.21.15.50:0/3379150650 shutdown_connections 2023-01-04T18:10:04.042 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.037+0000 7f570359e700 1 -- 172.21.15.50:0/3379150650 wait complete. 2023-01-04T18:10:04.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:02.982036+0000 mgr.smithi050.emnywo (mgr.14142) 5 : audit [DBG] from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:10:04.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:10:02.982716+0000 mgr.smithi050.emnywo (mgr.14142) 6 : cephadm [INF] Saving service node-exporter spec with placement * 2023-01-04T18:10:04.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:02.984844+0000 mon.smithi050 (mon.0) 84 : audit [INF] from='mgr.14142 172.21.15.50:0/288554034' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:04.435 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mgr mgr/cephadm/container_init True --force 2023-01-04T18:10:04.848 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.843+0000 7f7a5f828700 1 Processor -- start 2023-01-04T18:10:04.848 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.843+0000 7f7a5f828700 1 -- start start 2023-01-04T18:10:04.848 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.844+0000 7f7a5f828700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a5806fcb0 0x7f7a580fe7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.844+0000 7f7a5f828700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a580fed40 con 0x7f7a5806fcb0 2023-01-04T18:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.844+0000 7f7a5d5c4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a5806fcb0 0x7f7a580fe7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.844+0000 7f7a5d5c4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a5806fcb0 0x7f7a580fe7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48224/0 (socket says 172.21.15.50:48224) 2023-01-04T18:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.844+0000 7f7a5d5c4700 1 -- 172.21.15.50:0/4215836150 learned_addr learned my addr 172.21.15.50:0/4215836150 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.844+0000 7f7a5d5c4700 1 -- 172.21.15.50:0/4215836150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a580fee80 con 0x7f7a5806fcb0 2023-01-04T18:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.845+0000 7f7a5d5c4700 1 --2- 172.21.15.50:0/4215836150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a5806fcb0 0x7f7a580fe7c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f7a5400b5f0 tx=0x7f7a54006ee0).ready entity=mon.0 client_cookie=a425ab10b96f99d5 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.845+0000 7f7a47fff700 1 -- 172.21.15.50:0/4215836150 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a5400d600 con 0x7f7a5806fcb0 2023-01-04T18:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.845+0000 7f7a47fff700 1 -- 172.21.15.50:0/4215836150 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7a5400dc10 con 0x7f7a5806fcb0 2023-01-04T18:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.845+0000 7f7a47fff700 1 -- 172.21.15.50:0/4215836150 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a54011cd0 con 0x7f7a5806fcb0 2023-01-04T18:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.845+0000 7f7a5f828700 1 -- 172.21.15.50:0/4215836150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a5806fcb0 msgr2=0x7f7a580fe7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.845+0000 7f7a5f828700 1 --2- 172.21.15.50:0/4215836150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a5806fcb0 0x7f7a580fe7c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f7a5400b5f0 tx=0x7f7a54006ee0).stop 2023-01-04T18:10:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.846+0000 7f7a5f828700 1 -- 172.21.15.50:0/4215836150 shutdown_connections 2023-01-04T18:10:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.846+0000 7f7a5f828700 1 --2- 172.21.15.50:0/4215836150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a5806fcb0 0x7f7a580fe7c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.846+0000 7f7a5f828700 1 -- 172.21.15.50:0/4215836150 >> 172.21.15.50:0/4215836150 conn(0x7f7a580f6280 msgr2=0x7f7a580f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.846+0000 7f7a5f828700 1 -- 172.21.15.50:0/4215836150 shutdown_connections 2023-01-04T18:10:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.846+0000 7f7a5f828700 1 -- 172.21.15.50:0/4215836150 wait complete. 2023-01-04T18:10:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.846+0000 7f7a5f828700 1 Processor -- start 2023-01-04T18:10:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.847+0000 7f7a5f828700 1 -- start start 2023-01-04T18:10:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.847+0000 7f7a5f828700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a5806fcb0 0x7f7a5810aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.847+0000 7f7a5f828700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5810af10 con 0x7f7a5806fcb0 2023-01-04T18:10:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.847+0000 7f7a5d5c4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a5806fcb0 0x7f7a5810aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.847+0000 7f7a5d5c4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a5806fcb0 0x7f7a5810aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48240/0 (socket says 172.21.15.50:48240) 2023-01-04T18:10:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.847+0000 7f7a5d5c4700 1 -- 172.21.15.50:0/328524572 learned_addr learned my addr 172.21.15.50:0/328524572 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.847+0000 7f7a5d5c4700 1 -- 172.21.15.50:0/328524572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5400b200 con 0x7f7a5806fcb0 2023-01-04T18:10:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.847+0000 7f7a5d5c4700 1 --2- 172.21.15.50:0/328524572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a5806fcb0 0x7f7a5810aa20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f7a5400b1d0 tx=0x7f7a54006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.848+0000 7f7a45ffb700 1 -- 172.21.15.50:0/328524572 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a54011df0 con 0x7f7a5806fcb0 2023-01-04T18:10:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.848+0000 7f7a5f828700 1 -- 172.21.15.50:0/328524572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5810b110 con 0x7f7a5806fcb0 2023-01-04T18:10:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.848+0000 7f7a45ffb700 1 -- 172.21.15.50:0/328524572 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7a5401b8c0 con 0x7f7a5806fcb0 2023-01-04T18:10:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.848+0000 7f7a45ffb700 1 -- 172.21.15.50:0/328524572 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a5401a7b0 con 0x7f7a5806fcb0 2023-01-04T18:10:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.848+0000 7f7a5f828700 1 -- 172.21.15.50:0/328524572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5810b520 con 0x7f7a5806fcb0 2023-01-04T18:10:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.849+0000 7f7a45ffb700 1 -- 172.21.15.50:0/328524572 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f7a5400f070 con 0x7f7a5806fcb0 2023-01-04T18:10:04.853 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.849+0000 7f7a45ffb700 1 --2- 172.21.15.50:0/328524572 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f7a4002fe60 0x7f7a40032320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:04.854 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.849+0000 7f7a45ffb700 1 -- 172.21.15.50:0/328524572 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f7a54041390 con 0x7f7a5806fcb0 2023-01-04T18:10:04.854 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.849+0000 7f7a5f828700 1 -- 172.21.15.50:0/328524572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a58045ad0 con 0x7f7a5806fcb0 2023-01-04T18:10:04.854 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.849+0000 7f7a5cdc3700 1 --2- 172.21.15.50:0/328524572 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f7a4002fe60 0x7f7a40032320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:04.854 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.850+0000 7f7a5cdc3700 1 --2- 172.21.15.50:0/328524572 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f7a4002fe60 0x7f7a40032320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f7a480096a0 tx=0x7f7a48006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:04.855 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:04.853+0000 7f7a45ffb700 1 -- 172.21.15.50:0/328524572 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7a54016070 con 0x7f7a5806fcb0 2023-01-04T18:10:05.017 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.014+0000 7f7a5f828700 1 -- 172.21.15.50:0/328524572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f7a58104860 con 0x7f7a5806fcb0 2023-01-04T18:10:05.019 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.017+0000 7f7a45ffb700 1 -- 172.21.15.50:0/328524572 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v9)=0 v9) v1 ==== 142+0+0 (secure 0 0 0) 0x7f7a54025460 con 0x7f7a5806fcb0 2023-01-04T18:10:05.021 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.019+0000 7f7a5f828700 1 -- 172.21.15.50:0/328524572 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f7a4002fe60 msgr2=0x7f7a40032320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:05.022 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.019+0000 7f7a5f828700 1 --2- 172.21.15.50:0/328524572 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f7a4002fe60 0x7f7a40032320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f7a480096a0 tx=0x7f7a48006b40).stop 2023-01-04T18:10:05.022 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.019+0000 7f7a5f828700 1 -- 172.21.15.50:0/328524572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a5806fcb0 msgr2=0x7f7a5810aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:05.022 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.019+0000 7f7a5f828700 1 --2- 172.21.15.50:0/328524572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a5806fcb0 0x7f7a5810aa20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f7a5400b1d0 tx=0x7f7a54006ee0).stop 2023-01-04T18:10:05.022 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.019+0000 7f7a5f828700 1 -- 172.21.15.50:0/328524572 shutdown_connections 2023-01-04T18:10:05.023 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.019+0000 7f7a5f828700 1 --2- 172.21.15.50:0/328524572 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f7a4002fe60 0x7f7a40032320 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:05.023 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.019+0000 7f7a5f828700 1 --2- 172.21.15.50:0/328524572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a5806fcb0 0x7f7a5810aa20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:05.023 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.019+0000 7f7a5f828700 1 -- 172.21.15.50:0/328524572 >> 172.21.15.50:0/328524572 conn(0x7f7a580f6280 msgr2=0x7f7a580f7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:05.023 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.019+0000 7f7a5f828700 1 -- 172.21.15.50:0/328524572 shutdown_connections 2023-01-04T18:10:05.023 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.019+0000 7f7a5f828700 1 -- 172.21.15.50:0/328524572 wait complete. 2023-01-04T18:10:05.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:04.033410+0000 mgr.smithi050.emnywo (mgr.14142) 7 : audit [DBG] from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:10:05.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:10:04.033946+0000 mgr.smithi050.emnywo (mgr.14142) 8 : cephadm [INF] Saving service alertmanager spec with placement count:1 2023-01-04T18:10:05.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:04.035873+0000 mon.smithi050 (mon.0) 85 : audit [INF] from='mgr.14142 172.21.15.50:0/288554034' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:05.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:05.017719+0000 mon.smithi050 (mon.0) 86 : audit [INF] from='client.? 172.21.15.50:0/328524572' entity='client.admin' 2023-01-04T18:10:05.373 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mgr mgr/dashboard/ssl_server_port 8443 2023-01-04T18:10:05.785 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.782+0000 7f526b13b700 1 Processor -- start 2023-01-04T18:10:05.785 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.782+0000 7f526b13b700 1 -- start start 2023-01-04T18:10:05.785 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.783+0000 7f526b13b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f526406fc90 0x7f5264100be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:05.785 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.783+0000 7f526b13b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52640fc660 con 0x7f526406fc90 2023-01-04T18:10:05.787 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.783+0000 7f5268ed7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f526406fc90 0x7f5264100be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:05.787 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.783+0000 7f5268ed7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f526406fc90 0x7f5264100be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48244/0 (socket says 172.21.15.50:48244) 2023-01-04T18:10:05.787 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.783+0000 7f5268ed7700 1 -- 172.21.15.50:0/4191086160 learned_addr learned my addr 172.21.15.50:0/4191086160 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:05.787 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.783+0000 7f5268ed7700 1 -- 172.21.15.50:0/4191086160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52641010d0 con 0x7f526406fc90 2023-01-04T18:10:05.787 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.783+0000 7f5268ed7700 1 --2- 172.21.15.50:0/4191086160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f526406fc90 0x7f5264100be0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f525800b5f0 tx=0x7f5258006ee0).ready entity=mon.0 client_cookie=c4fa6f9b97842ffd server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:05.788 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.783+0000 7f52637fe700 1 -- 172.21.15.50:0/4191086160 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f525800d600 con 0x7f526406fc90 2023-01-04T18:10:05.788 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.783+0000 7f52637fe700 1 -- 172.21.15.50:0/4191086160 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f525800dc10 con 0x7f526406fc90 2023-01-04T18:10:05.788 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.784+0000 7f52637fe700 1 -- 172.21.15.50:0/4191086160 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5258011cd0 con 0x7f526406fc90 2023-01-04T18:10:05.788 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.784+0000 7f526b13b700 1 -- 172.21.15.50:0/4191086160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f526406fc90 msgr2=0x7f5264100be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:05.788 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.784+0000 7f526b13b700 1 --2- 172.21.15.50:0/4191086160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f526406fc90 0x7f5264100be0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f525800b5f0 tx=0x7f5258006ee0).stop 2023-01-04T18:10:05.788 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.784+0000 7f526b13b700 1 -- 172.21.15.50:0/4191086160 shutdown_connections 2023-01-04T18:10:05.788 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.784+0000 7f526b13b700 1 --2- 172.21.15.50:0/4191086160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f526406fc90 0x7f5264100be0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:05.788 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.784+0000 7f526b13b700 1 -- 172.21.15.50:0/4191086160 >> 172.21.15.50:0/4191086160 conn(0x7f52640f6280 msgr2=0x7f52640f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:05.788 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.784+0000 7f526b13b700 1 -- 172.21.15.50:0/4191086160 shutdown_connections 2023-01-04T18:10:05.788 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.784+0000 7f526b13b700 1 -- 172.21.15.50:0/4191086160 wait complete. 2023-01-04T18:10:05.788 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.785+0000 7f526b13b700 1 Processor -- start 2023-01-04T18:10:05.789 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.785+0000 7f526b13b700 1 -- start start 2023-01-04T18:10:05.790 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.785+0000 7f526b13b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f526406fc90 0x7f526410cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:05.790 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.785+0000 7f526b13b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526410d1f0 con 0x7f526406fc90 2023-01-04T18:10:05.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.786+0000 7f5268ed7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f526406fc90 0x7f526410cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:05.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.786+0000 7f5268ed7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f526406fc90 0x7f526410cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48254/0 (socket says 172.21.15.50:48254) 2023-01-04T18:10:05.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.786+0000 7f5268ed7700 1 -- 172.21.15.50:0/2637256118 learned_addr learned my addr 172.21.15.50:0/2637256118 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:05.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.786+0000 7f5268ed7700 1 -- 172.21.15.50:0/2637256118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525800b200 con 0x7f526406fc90 2023-01-04T18:10:05.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.786+0000 7f5268ed7700 1 --2- 172.21.15.50:0/2637256118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f526406fc90 0x7f526410cd00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f525800dfb0 tx=0x7f5258006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:05.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.786+0000 7f52617fa700 1 -- 172.21.15.50:0/2637256118 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5258011df0 con 0x7f526406fc90 2023-01-04T18:10:05.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.786+0000 7f52617fa700 1 -- 172.21.15.50:0/2637256118 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f525801b8c0 con 0x7f526406fc90 2023-01-04T18:10:05.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.786+0000 7f526b13b700 1 -- 172.21.15.50:0/2637256118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526410d3f0 con 0x7f526406fc90 2023-01-04T18:10:05.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.786+0000 7f52617fa700 1 -- 172.21.15.50:0/2637256118 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f525801a800 con 0x7f526406fc90 2023-01-04T18:10:05.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.786+0000 7f526b13b700 1 -- 172.21.15.50:0/2637256118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526410d800 con 0x7f526406fc90 2023-01-04T18:10:05.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.787+0000 7f52617fa700 1 -- 172.21.15.50:0/2637256118 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f525800f070 con 0x7f526406fc90 2023-01-04T18:10:05.792 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.787+0000 7f52617fa700 1 --2- 172.21.15.50:0/2637256118 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f524802fe60 0x7f5248032320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:05.792 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.787+0000 7f52617fa700 1 -- 172.21.15.50:0/2637256118 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f5258040f90 con 0x7f526406fc90 2023-01-04T18:10:05.792 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.787+0000 7f526b13b700 1 -- 172.21.15.50:0/2637256118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5264045ad0 con 0x7f526406fc90 2023-01-04T18:10:05.792 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.788+0000 7f5263fff700 1 --2- 172.21.15.50:0/2637256118 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f524802fe60 0x7f5248032320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:05.792 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.788+0000 7f5263fff700 1 --2- 172.21.15.50:0/2637256118 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f524802fe60 0x7f5248032320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f52500096a0 tx=0x7f5250006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:05.794 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.792+0000 7f52617fa700 1 -- 172.21.15.50:0/2637256118 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f5258016070 con 0x7f526406fc90 2023-01-04T18:10:05.954 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.952+0000 7f526b13b700 1 -- 172.21.15.50:0/2637256118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f526410e6a0 con 0x7f526406fc90 2023-01-04T18:10:05.958 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.956+0000 7f52617fa700 1 -- 172.21.15.50:0/2637256118 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v10)=0 v10) v1 ==== 130+0+0 (secure 0 0 0) 0x7f52580107b0 con 0x7f526406fc90 2023-01-04T18:10:05.961 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.958+0000 7f526b13b700 1 -- 172.21.15.50:0/2637256118 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f524802fe60 msgr2=0x7f5248032320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:05.961 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.958+0000 7f526b13b700 1 --2- 172.21.15.50:0/2637256118 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f524802fe60 0x7f5248032320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f52500096a0 tx=0x7f5250006b40).stop 2023-01-04T18:10:05.961 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.958+0000 7f526b13b700 1 -- 172.21.15.50:0/2637256118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f526406fc90 msgr2=0x7f526410cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:05.961 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.958+0000 7f526b13b700 1 --2- 172.21.15.50:0/2637256118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f526406fc90 0x7f526410cd00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f525800dfb0 tx=0x7f5258006ee0).stop 2023-01-04T18:10:05.961 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.958+0000 7f526b13b700 1 -- 172.21.15.50:0/2637256118 shutdown_connections 2023-01-04T18:10:05.962 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.958+0000 7f526b13b700 1 --2- 172.21.15.50:0/2637256118 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f524802fe60 0x7f5248032320 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:05.962 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.958+0000 7f526b13b700 1 --2- 172.21.15.50:0/2637256118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f526406fc90 0x7f526410cd00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:05.962 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.958+0000 7f526b13b700 1 -- 172.21.15.50:0/2637256118 >> 172.21.15.50:0/2637256118 conn(0x7f52640f6280 msgr2=0x7f52640f7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:05.962 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.959+0000 7f526b13b700 1 -- 172.21.15.50:0/2637256118 shutdown_connections 2023-01-04T18:10:05.962 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:05.959+0000 7f526b13b700 1 -- 172.21.15.50:0/2637256118 wait complete. 2023-01-04T18:10:06.311 INFO:teuthology.orchestra.run.smithi050.stderr:Enabling the dashboard module... 2023-01-04T18:10:06.313 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable dashboard 2023-01-04T18:10:06.806 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.802+0000 7fcb42607700 1 Processor -- start 2023-01-04T18:10:06.806 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.802+0000 7fcb42607700 1 -- start start 2023-01-04T18:10:06.807 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.802+0000 7fcb42607700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb3c0fc210 0x7fcb3c0fc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:06.807 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.802+0000 7fcb42607700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c0fcb20 con 0x7fcb3c0fc210 2023-01-04T18:10:06.807 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.802+0000 7fcb3bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb3c0fc210 0x7fcb3c0fc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:06.807 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.802+0000 7fcb3bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb3c0fc210 0x7fcb3c0fc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46886/0 (socket says 172.21.15.50:46886) 2023-01-04T18:10:06.807 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.802+0000 7fcb3bfff700 1 -- 172.21.15.50:0/521369516 learned_addr learned my addr 172.21.15.50:0/521369516 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:06.807 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.802+0000 7fcb3bfff700 1 -- 172.21.15.50:0/521369516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c0fcc60 con 0x7fcb3c0fc210 2023-01-04T18:10:06.807 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.803+0000 7fcb3bfff700 1 --2- 172.21.15.50:0/521369516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb3c0fc210 0x7fcb3c0fc630 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fcb2c00b5f0 tx=0x7fcb2c006ee0).ready entity=mon.0 client_cookie=7f43976de008da95 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:06.807 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.803+0000 7fcb3affd700 1 -- 172.21.15.50:0/521369516 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb2c00d600 con 0x7fcb3c0fc210 2023-01-04T18:10:06.807 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.803+0000 7fcb3affd700 1 -- 172.21.15.50:0/521369516 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcb2c00dc10 con 0x7fcb3c0fc210 2023-01-04T18:10:06.807 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.803+0000 7fcb3affd700 1 -- 172.21.15.50:0/521369516 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb2c011cd0 con 0x7fcb3c0fc210 2023-01-04T18:10:06.807 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.803+0000 7fcb42607700 1 -- 172.21.15.50:0/521369516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb3c0fc210 msgr2=0x7fcb3c0fc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:06.808 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.803+0000 7fcb42607700 1 --2- 172.21.15.50:0/521369516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb3c0fc210 0x7fcb3c0fc630 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fcb2c00b5f0 tx=0x7fcb2c006ee0).stop 2023-01-04T18:10:06.808 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.803+0000 7fcb42607700 1 -- 172.21.15.50:0/521369516 shutdown_connections 2023-01-04T18:10:06.808 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.803+0000 7fcb42607700 1 --2- 172.21.15.50:0/521369516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb3c0fc210 0x7fcb3c0fc630 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:06.808 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.803+0000 7fcb42607700 1 -- 172.21.15.50:0/521369516 >> 172.21.15.50:0/521369516 conn(0x7fcb3c0f5a80 msgr2=0x7fcb3c0f7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:06.808 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.804+0000 7fcb42607700 1 -- 172.21.15.50:0/521369516 shutdown_connections 2023-01-04T18:10:06.808 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.804+0000 7fcb42607700 1 -- 172.21.15.50:0/521369516 wait complete. 2023-01-04T18:10:06.810 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.804+0000 7fcb42607700 1 Processor -- start 2023-01-04T18:10:06.810 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.804+0000 7fcb42607700 1 -- start start 2023-01-04T18:10:06.810 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.805+0000 7fcb42607700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb3c0fc210 0x7fcb3c10cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:06.810 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.805+0000 7fcb42607700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c10d1d0 con 0x7fcb3c0fc210 2023-01-04T18:10:06.811 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.805+0000 7fcb3bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb3c0fc210 0x7fcb3c10cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:06.811 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.805+0000 7fcb3bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb3c0fc210 0x7fcb3c10cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46898/0 (socket says 172.21.15.50:46898) 2023-01-04T18:10:06.811 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.805+0000 7fcb3bfff700 1 -- 172.21.15.50:0/1684197717 learned_addr learned my addr 172.21.15.50:0/1684197717 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:06.811 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.805+0000 7fcb3bfff700 1 -- 172.21.15.50:0/1684197717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2c00b200 con 0x7fcb3c0fc210 2023-01-04T18:10:06.811 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.805+0000 7fcb3bfff700 1 --2- 172.21.15.50:0/1684197717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb3c0fc210 0x7fcb3c10cce0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fcb2c00dfb0 tx=0x7fcb2c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:06.811 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.805+0000 7fcb38ff9700 1 -- 172.21.15.50:0/1684197717 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb2c011df0 con 0x7fcb3c0fc210 2023-01-04T18:10:06.811 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.805+0000 7fcb38ff9700 1 -- 172.21.15.50:0/1684197717 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcb2c01b8c0 con 0x7fcb3c0fc210 2023-01-04T18:10:06.811 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.805+0000 7fcb42607700 1 -- 172.21.15.50:0/1684197717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3c10d3d0 con 0x7fcb3c0fc210 2023-01-04T18:10:06.811 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.805+0000 7fcb38ff9700 1 -- 172.21.15.50:0/1684197717 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb2c01a7c0 con 0x7fcb3c0fc210 2023-01-04T18:10:06.811 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.805+0000 7fcb42607700 1 -- 172.21.15.50:0/1684197717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb3c10d7e0 con 0x7fcb3c0fc210 2023-01-04T18:10:06.811 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.806+0000 7fcb38ff9700 1 -- 172.21.15.50:0/1684197717 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7fcb2c00f070 con 0x7fcb3c0fc210 2023-01-04T18:10:06.812 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.806+0000 7fcb42607700 1 -- 172.21.15.50:0/1684197717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3c045ad0 con 0x7fcb3c0fc210 2023-01-04T18:10:06.812 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.807+0000 7fcb38ff9700 1 --2- 172.21.15.50:0/1684197717 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7fcb2802fe60 0x7fcb28032320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:06.812 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.807+0000 7fcb38ff9700 1 -- 172.21.15.50:0/1684197717 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7fcb2c041050 con 0x7fcb3c0fc210 2023-01-04T18:10:06.812 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.807+0000 7fcb3b7fe700 1 --2- 172.21.15.50:0/1684197717 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7fcb2802fe60 0x7fcb28032320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:06.812 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.807+0000 7fcb3b7fe700 1 --2- 172.21.15.50:0/1684197717 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7fcb2802fe60 0x7fcb28032320 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fcb300096a0 tx=0x7fcb30006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:06.813 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:06.811+0000 7fcb38ff9700 1 -- 172.21.15.50:0/1684197717 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fcb2c019d60 con 0x7fcb3c0fc210 2023-01-04T18:10:07.011 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:07.009+0000 7fcb42607700 1 -- 172.21.15.50:0/1684197717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fcb3c101de0 con 0x7fcb3c0fc210 2023-01-04T18:10:07.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:05.956541+0000 mon.smithi050 (mon.0) 87 : audit [INF] from='client.? 172.21.15.50:0/2637256118' entity='client.admin' 2023-01-04T18:10:07.960 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:07.958+0000 7fcb38ff9700 1 -- 172.21.15.50:0/1684197717 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 13) v1 ==== 36208+0+0 (secure 0 0 0) 0x7fcb2c01b410 con 0x7fcb3c0fc210 2023-01-04T18:10:07.962 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:07.959+0000 7fcb38ff9700 1 -- 172.21.15.50:0/1684197717 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v13) v1 ==== 88+0+0 (secure 0 0 0) 0x7fcb2c0437f0 con 0x7fcb3c0fc210 2023-01-04T18:10:07.964 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:07.962+0000 7fcb42607700 1 -- 172.21.15.50:0/1684197717 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7fcb2802fe60 msgr2=0x7fcb28032320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:07.964 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:07.962+0000 7fcb42607700 1 --2- 172.21.15.50:0/1684197717 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7fcb2802fe60 0x7fcb28032320 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fcb300096a0 tx=0x7fcb30006b40).stop 2023-01-04T18:10:07.964 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:07.962+0000 7fcb42607700 1 -- 172.21.15.50:0/1684197717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb3c0fc210 msgr2=0x7fcb3c10cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:07.965 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:07.962+0000 7fcb42607700 1 --2- 172.21.15.50:0/1684197717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb3c0fc210 0x7fcb3c10cce0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fcb2c00dfb0 tx=0x7fcb2c006ee0).stop 2023-01-04T18:10:07.965 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:07.962+0000 7fcb42607700 1 -- 172.21.15.50:0/1684197717 shutdown_connections 2023-01-04T18:10:07.966 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:07.962+0000 7fcb42607700 1 --2- 172.21.15.50:0/1684197717 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7fcb2802fe60 0x7fcb28032320 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:07.966 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:07.962+0000 7fcb42607700 1 --2- 172.21.15.50:0/1684197717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb3c0fc210 0x7fcb3c10cce0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:07.966 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:07.962+0000 7fcb42607700 1 -- 172.21.15.50:0/1684197717 >> 172.21.15.50:0/1684197717 conn(0x7fcb3c0f5a80 msgr2=0x7fcb3c0f7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:07.966 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:07.962+0000 7fcb42607700 1 -- 172.21.15.50:0/1684197717 shutdown_connections 2023-01-04T18:10:07.966 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:07.962+0000 7fcb42607700 1 -- 172.21.15.50:0/1684197717 wait complete. 2023-01-04T18:10:08.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:07.009733+0000 mon.smithi050 (mon.0) 88 : audit [INF] from='client.? 172.21.15.50:0/1684197717' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-01-04T18:10:08.353 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr stat 2023-01-04T18:10:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.782+0000 7f12e62b6700 1 Processor -- start 2023-01-04T18:10:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.782+0000 7f12e62b6700 1 -- start start 2023-01-04T18:10:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.783+0000 7f12e62b6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12e00fd280 0x7f12e00fd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.783+0000 7f12e62b6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00fdb90 con 0x7f12e00fd280 2023-01-04T18:10:08.786 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.783+0000 7f12dffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12e00fd280 0x7f12e00fd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:08.787 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.783+0000 7f12dffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12e00fd280 0x7f12e00fd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46920/0 (socket says 172.21.15.50:46920) 2023-01-04T18:10:08.787 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.783+0000 7f12dffff700 1 -- 172.21.15.50:0/2758969272 learned_addr learned my addr 172.21.15.50:0/2758969272 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:08.787 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.783+0000 7f12dffff700 1 -- 172.21.15.50:0/2758969272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e00fdcd0 con 0x7f12e00fd280 2023-01-04T18:10:08.787 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.783+0000 7f12dffff700 1 --2- 172.21.15.50:0/2758969272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12e00fd280 0x7f12e00fd6a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f12d000b5f0 tx=0x7f12d0006ee0).ready entity=mon.0 client_cookie=c19bf068431c0d25 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.783+0000 7f12deffd700 1 -- 172.21.15.50:0/2758969272 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12d000d600 con 0x7f12e00fd280 2023-01-04T18:10:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.784+0000 7f12deffd700 1 -- 172.21.15.50:0/2758969272 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f12d000dc10 con 0x7f12e00fd280 2023-01-04T18:10:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.784+0000 7f12deffd700 1 -- 172.21.15.50:0/2758969272 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12d0011cd0 con 0x7f12e00fd280 2023-01-04T18:10:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.784+0000 7f12e62b6700 1 -- 172.21.15.50:0/2758969272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12e00fd280 msgr2=0x7f12e00fd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.784+0000 7f12e62b6700 1 --2- 172.21.15.50:0/2758969272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12e00fd280 0x7f12e00fd6a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f12d000b5f0 tx=0x7f12d0006ee0).stop 2023-01-04T18:10:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.784+0000 7f12e62b6700 1 -- 172.21.15.50:0/2758969272 shutdown_connections 2023-01-04T18:10:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.784+0000 7f12e62b6700 1 --2- 172.21.15.50:0/2758969272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12e00fd280 0x7f12e00fd6a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.784+0000 7f12e62b6700 1 -- 172.21.15.50:0/2758969272 >> 172.21.15.50:0/2758969272 conn(0x7f12e00f5a80 msgr2=0x7f12e00f7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.784+0000 7f12e62b6700 1 -- 172.21.15.50:0/2758969272 shutdown_connections 2023-01-04T18:10:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.785+0000 7f12e62b6700 1 -- 172.21.15.50:0/2758969272 wait complete. 2023-01-04T18:10:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.785+0000 7f12e62b6700 1 Processor -- start 2023-01-04T18:10:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.785+0000 7f12e62b6700 1 -- start start 2023-01-04T18:10:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.785+0000 7f12e62b6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12e00fd280 0x7f12e010aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:08.790 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.785+0000 7f12e62b6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e010af00 con 0x7f12e00fd280 2023-01-04T18:10:08.790 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.786+0000 7f12dffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12e00fd280 0x7f12e010aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:08.790 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.786+0000 7f12dffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12e00fd280 0x7f12e010aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46926/0 (socket says 172.21.15.50:46926) 2023-01-04T18:10:08.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.786+0000 7f12dffff700 1 -- 172.21.15.50:0/2543792359 learned_addr learned my addr 172.21.15.50:0/2543792359 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:08.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.786+0000 7f12dffff700 1 -- 172.21.15.50:0/2543792359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d000b200 con 0x7f12e00fd280 2023-01-04T18:10:08.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.786+0000 7f12dffff700 1 --2- 172.21.15.50:0/2543792359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12e00fd280 0x7f12e010aa10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f12d0006cb0 tx=0x7f12d0006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:08.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.786+0000 7f12dcff9700 1 -- 172.21.15.50:0/2543792359 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12d0011df0 con 0x7f12e00fd280 2023-01-04T18:10:08.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.786+0000 7f12e62b6700 1 -- 172.21.15.50:0/2543792359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e010b100 con 0x7f12e00fd280 2023-01-04T18:10:08.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.786+0000 7f12dcff9700 1 -- 172.21.15.50:0/2543792359 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f12d001b8c0 con 0x7f12e00fd280 2023-01-04T18:10:08.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.786+0000 7f12dcff9700 1 -- 172.21.15.50:0/2543792359 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12d001a930 con 0x7f12e00fd280 2023-01-04T18:10:08.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.786+0000 7f12e62b6700 1 -- 172.21.15.50:0/2543792359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e010b510 con 0x7f12e00fd280 2023-01-04T18:10:08.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.787+0000 7f12dcff9700 1 -- 172.21.15.50:0/2543792359 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 36208+0+0 (secure 0 0 0) 0x7f12d000f070 con 0x7f12e00fd280 2023-01-04T18:10:08.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.787+0000 7f12dcff9700 1 --2- 172.21.15.50:0/2543792359 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f12cc02feb0 0x7f12cc032370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:08.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.787+0000 7f12dcff9700 1 -- 172.21.15.50:0/2543792359 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f12d0041f90 con 0x7f12e00fd280 2023-01-04T18:10:08.791 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.787+0000 7f12df7fe700 1 -- 172.21.15.50:0/2543792359 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f12cc02feb0 msgr2=0x7f12cc032370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/2515216785 2023-01-04T18:10:08.792 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.787+0000 7f12df7fe700 1 --2- 172.21.15.50:0/2543792359 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f12cc02feb0 0x7f12cc032370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-01-04T18:10:08.792 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.788+0000 7f12e62b6700 1 -- 172.21.15.50:0/2543792359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e0059100 con 0x7f12e00fd280 2023-01-04T18:10:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.793+0000 7f12dcff9700 1 -- 172.21.15.50:0/2543792359 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f12d0016070 con 0x7f12e00fd280 2023-01-04T18:10:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.988+0000 7f12df7fe700 1 -- 172.21.15.50:0/2543792359 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f12cc02feb0 msgr2=0x7f12cc032370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/2515216785 2023-01-04T18:10:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.988+0000 7f12df7fe700 1 --2- 172.21.15.50:0/2543792359 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f12cc02feb0 0x7f12cc032370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-01-04T18:10:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.997+0000 7f12e62b6700 1 -- 172.21.15.50:0/2543792359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f12e00fa6b0 con 0x7f12e00fd280 2023-01-04T18:10:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:08.997+0000 7f12dcff9700 1 -- 172.21.15.50:0/2543792359 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v13) v1 ==== 56+0+104 (secure 0 0 0) 0x7f12d0024410 con 0x7f12e00fd280 2023-01-04T18:10:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: { 2023-01-04T18:10:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "epoch": 13, 2023-01-04T18:10:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "available": true, 2023-01-04T18:10:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "active_name": "smithi050.emnywo", 2023-01-04T18:10:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "num_standby": 0 2023-01-04T18:10:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: } 2023-01-04T18:10:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.000+0000 7f12e62b6700 1 -- 172.21.15.50:0/2543792359 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f12cc02feb0 msgr2=0x7f12cc032370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-01-04T18:10:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.000+0000 7f12e62b6700 1 --2- 172.21.15.50:0/2543792359 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f12cc02feb0 0x7f12cc032370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-01-04T18:10:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.000+0000 7f12e62b6700 1 -- 172.21.15.50:0/2543792359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12e00fd280 msgr2=0x7f12e010aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.000+0000 7f12e62b6700 1 --2- 172.21.15.50:0/2543792359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12e00fd280 0x7f12e010aa10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f12d0006cb0 tx=0x7f12d0006ee0).stop 2023-01-04T18:10:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.000+0000 7f12e62b6700 1 -- 172.21.15.50:0/2543792359 shutdown_connections 2023-01-04T18:10:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.000+0000 7f12e62b6700 1 --2- 172.21.15.50:0/2543792359 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f12cc02feb0 0x7f12cc032370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-01-04T18:10:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.000+0000 7f12e62b6700 1 --2- 172.21.15.50:0/2543792359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12e00fd280 0x7f12e010aa10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.000+0000 7f12e62b6700 1 -- 172.21.15.50:0/2543792359 >> 172.21.15.50:0/2543792359 conn(0x7f12e00f5a80 msgr2=0x7f12e00ff1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.000+0000 7f12e62b6700 1 -- 172.21.15.50:0/2543792359 shutdown_connections 2023-01-04T18:10:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.000+0000 7f12e62b6700 1 -- 172.21.15.50:0/2543792359 wait complete. 2023-01-04T18:10:09.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:07.959984+0000 mon.smithi050 (mon.0) 89 : audit [INF] from='client.? 172.21.15.50:0/1684197717' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-01-04T18:10:09.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:07.960067+0000 mon.smithi050 (mon.0) 90 : cluster [DBG] mgrmap e13: smithi050.emnywo(active, since 8s) 2023-01-04T18:10:09.390 INFO:teuthology.orchestra.run.smithi050.stderr:Waiting for the mgr to restart... 2023-01-04T18:10:09.390 INFO:teuthology.orchestra.run.smithi050.stderr:Waiting for mgr epoch 13... 2023-01-04T18:10:09.390 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 tell mgr mgr_status 2023-01-04T18:10:09.863 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.858+0000 7f51adf5b700 1 Processor -- start 2023-01-04T18:10:09.863 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.858+0000 7f51adf5b700 1 -- start start 2023-01-04T18:10:09.863 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.858+0000 7f51adf5b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51a80fa8f0 0x7f51a80fad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:09.863 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.858+0000 7f51adf5b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80fb200 con 0x7f51a80fa8f0 2023-01-04T18:10:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.858+0000 7f51acf59700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51a80fa8f0 0x7f51a80fad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.858+0000 7f51acf59700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51a80fa8f0 0x7f51a80fad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46928/0 (socket says 172.21.15.50:46928) 2023-01-04T18:10:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.858+0000 7f51acf59700 1 -- 172.21.15.50:0/4098255999 learned_addr learned my addr 172.21.15.50:0/4098255999 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.859+0000 7f51acf59700 1 -- 172.21.15.50:0/4098255999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a80fb340 con 0x7f51a80fa8f0 2023-01-04T18:10:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.859+0000 7f51acf59700 1 --2- 172.21.15.50:0/4098255999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51a80fa8f0 0x7f51a80fad10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f519c00b5f0 tx=0x7f519c006ee0).ready entity=mon.0 client_cookie=fe07e40877fc1aaa server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.859+0000 7f51a77fe700 1 -- 172.21.15.50:0/4098255999 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f519c00d600 con 0x7f51a80fa8f0 2023-01-04T18:10:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.859+0000 7f51a77fe700 1 -- 172.21.15.50:0/4098255999 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f519c00dc10 con 0x7f51a80fa8f0 2023-01-04T18:10:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.859+0000 7f51a77fe700 1 -- 172.21.15.50:0/4098255999 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f519c011cd0 con 0x7f51a80fa8f0 2023-01-04T18:10:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.860+0000 7f51adf5b700 1 -- 172.21.15.50:0/4098255999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51a80fa8f0 msgr2=0x7f51a80fad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.860+0000 7f51adf5b700 1 --2- 172.21.15.50:0/4098255999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51a80fa8f0 0x7f51a80fad10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f519c00b5f0 tx=0x7f519c006ee0).stop 2023-01-04T18:10:09.867 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.860+0000 7f51adf5b700 1 -- 172.21.15.50:0/4098255999 shutdown_connections 2023-01-04T18:10:09.867 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.860+0000 7f51adf5b700 1 --2- 172.21.15.50:0/4098255999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51a80fa8f0 0x7f51a80fad10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:09.867 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.860+0000 7f51adf5b700 1 -- 172.21.15.50:0/4098255999 >> 172.21.15.50:0/4098255999 conn(0x7f51a80f6130 msgr2=0x7f51a80f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:09.868 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.860+0000 7f51adf5b700 1 -- 172.21.15.50:0/4098255999 shutdown_connections 2023-01-04T18:10:09.868 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.860+0000 7f51adf5b700 1 -- 172.21.15.50:0/4098255999 wait complete. 2023-01-04T18:10:09.868 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.860+0000 7f51adf5b700 1 Processor -- start 2023-01-04T18:10:09.868 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.860+0000 7f51adf5b700 1 -- start start 2023-01-04T18:10:09.868 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.861+0000 7f51adf5b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51a80fa8f0 0x7f51a81085f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:09.868 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.861+0000 7f51adf5b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a8108ae0 con 0x7f51a80fa8f0 2023-01-04T18:10:09.868 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.861+0000 7f51acf59700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51a80fa8f0 0x7f51a81085f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:09.868 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.861+0000 7f51acf59700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51a80fa8f0 0x7f51a81085f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46936/0 (socket says 172.21.15.50:46936) 2023-01-04T18:10:09.868 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.861+0000 7f51acf59700 1 -- 172.21.15.50:0/1110850771 learned_addr learned my addr 172.21.15.50:0/1110850771 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:09.868 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.861+0000 7f51acf59700 1 -- 172.21.15.50:0/1110850771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c00b200 con 0x7f51a80fa8f0 2023-01-04T18:10:09.869 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.861+0000 7f51acf59700 1 --2- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51a80fa8f0 0x7f51a81085f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f519c00dfb0 tx=0x7f519c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:09.869 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.861+0000 7f51a57fa700 1 -- 172.21.15.50:0/1110850771 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f519c011df0 con 0x7f51a80fa8f0 2023-01-04T18:10:09.869 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.862+0000 7f51a57fa700 1 -- 172.21.15.50:0/1110850771 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f519c01b8c0 con 0x7f51a80fa8f0 2023-01-04T18:10:09.869 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.862+0000 7f51adf5b700 1 -- 172.21.15.50:0/1110850771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a8108ce0 con 0x7f51a80fa8f0 2023-01-04T18:10:09.869 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.862+0000 7f51a57fa700 1 -- 172.21.15.50:0/1110850771 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f519c01a8c0 con 0x7f51a80fa8f0 2023-01-04T18:10:09.869 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.862+0000 7f51adf5b700 1 -- 172.21.15.50:0/1110850771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a81090f0 con 0x7f51a80fa8f0 2023-01-04T18:10:09.869 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.863+0000 7f51a57fa700 1 -- 172.21.15.50:0/1110850771 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) v1 ==== 36208+0+0 (secure 0 0 0) 0x7f519c00f070 con 0x7f51a80fa8f0 2023-01-04T18:10:09.869 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.863+0000 7f51a57fa700 1 --2- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f518c032150 0x7f518c034610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:09.869 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.863+0000 7f51a57fa700 1 -- 172.21.15.50:0/1110850771 --> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f518c034cd0 con 0x7f518c032150 2023-01-04T18:10:09.869 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.863+0000 7f51a57fa700 1 -- 172.21.15.50:0/1110850771 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f519c041060 con 0x7f51a80fa8f0 2023-01-04T18:10:09.870 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.863+0000 7f51a7fff700 1 -- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f518c032150 msgr2=0x7f518c034610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/2515216785 2023-01-04T18:10:09.870 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:09.863+0000 7f51a7fff700 1 --2- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f518c032150 0x7f518c034610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-01-04T18:10:10.067 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:10.064+0000 7f51a7fff700 1 -- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f518c032150 msgr2=0x7f518c034610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/2515216785 2023-01-04T18:10:10.067 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:10.064+0000 7f51a7fff700 1 --2- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f518c032150 0x7f518c034610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-01-04T18:10:10.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:09 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:08.998083+0000 mon.smithi050 (mon.0) 91 : audit [DBG] from='client.? 172.21.15.50:0/2543792359' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-01-04T18:10:10.468 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:10.465+0000 7f51a7fff700 1 -- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f518c032150 msgr2=0x7f518c034610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/2515216785 2023-01-04T18:10:10.468 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:10.465+0000 7f51a7fff700 1 --2- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f518c032150 0x7f518c034610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-01-04T18:10:11.269 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:11.266+0000 7f51a7fff700 1 -- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f518c032150 msgr2=0x7f518c034610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/2515216785 2023-01-04T18:10:11.270 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:11.266+0000 7f51a7fff700 1 --2- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f518c032150 0x7f518c034610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-01-04T18:10:12.870 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:12.867+0000 7f51a7fff700 1 -- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f518c032150 msgr2=0x7f518c034610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/2515216785 2023-01-04T18:10:12.870 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:12.867+0000 7f51a7fff700 1 --2- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f518c032150 0x7f518c034610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-01-04T18:10:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:13.244+0000 7f51a57fa700 1 -- 172.21.15.50:0/1110850771 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mgrmap(e 14) v1 ==== 35997+0+0 (secure 0 0 0) 0x7f519c01aa40 con 0x7f51a80fa8f0 2023-01-04T18:10:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:13.244+0000 7f51a57fa700 1 -- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f518c032150 msgr2=0x7f518c034610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-01-04T18:10:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:13.244+0000 7f51a57fa700 1 --2- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f518c032150 0x7f518c034610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-01-04T18:10:14.250 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:14.246+0000 7f51a57fa700 1 -- 172.21.15.50:0/1110850771 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 15) v1 ==== 36067+0+0 (secure 0 0 0) 0x7f519c041e50 con 0x7f51a80fa8f0 2023-01-04T18:10:14.250 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:14.246+0000 7f51a57fa700 1 --2- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f518c035de0 0x7f518c0381d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:14.251 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:14.246+0000 7f51a57fa700 1 -- 172.21.15.50:0/1110850771 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f518c034cd0 con 0x7f518c035de0 2023-01-04T18:10:14.251 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:14.247+0000 7f51a7fff700 1 --2- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f518c035de0 0x7f518c0381d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:14.251 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:14.247+0000 7f51a7fff700 1 --2- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f518c035de0 0x7f518c0381d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f5194006fd0 tx=0x7f5194006d70).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:14.251 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:14.248+0000 7f51a57fa700 1 -- 172.21.15.50:0/1110850771 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7f518c034cd0 con 0x7f518c035de0 2023-01-04T18:10:14.259 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:14.254+0000 7f51adf5b700 1 -- 172.21.15.50:0/1110850771 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f51a8059100 con 0x7f518c035de0 2023-01-04T18:10:14.259 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:14.254+0000 7f51a57fa700 1 -- 172.21.15.50:0/1110850771 <== mgr.14162 v2:172.21.15.50:6800/2223914843 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f51a8059100 con 0x7f518c035de0 2023-01-04T18:10:14.260 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: { 2023-01-04T18:10:14.260 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "mgrmap_epoch": 15, 2023-01-04T18:10:14.260 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: "initialized": true 2023-01-04T18:10:14.260 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: } 2023-01-04T18:10:14.260 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:14.254+0000 7f51adf5b700 1 -- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f518c035de0 msgr2=0x7f518c0381d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:14.260 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:14.254+0000 7f51adf5b700 1 --2- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f518c035de0 0x7f518c0381d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f5194006fd0 tx=0x7f5194006d70).stop 2023-01-04T18:10:14.260 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:14.254+0000 7f51adf5b700 1 -- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51a80fa8f0 msgr2=0x7f51a81085f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:14.260 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:14.254+0000 7f51adf5b700 1 --2- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51a80fa8f0 0x7f51a81085f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f519c00dfb0 tx=0x7f519c006ee0).stop 2023-01-04T18:10:14.261 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:14.254+0000 7f51adf5b700 1 -- 172.21.15.50:0/1110850771 shutdown_connections 2023-01-04T18:10:14.261 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:14.254+0000 7f51adf5b700 1 --2- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f518c035de0 0x7f518c0381d0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:14.261 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:14.254+0000 7f51adf5b700 1 --2- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51a80fa8f0 0x7f51a81085f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:14.261 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:14.254+0000 7f51adf5b700 1 --2- 172.21.15.50:0/1110850771 >> [v2:172.21.15.50:6800/2515216785,v1:172.21.15.50:6801/2515216785] conn(0x7f518c032150 0x7f518c034610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-01-04T18:10:14.261 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:14.254+0000 7f51adf5b700 1 -- 172.21.15.50:0/1110850771 >> 172.21.15.50:0/1110850771 conn(0x7f51a80f6130 msgr2=0x7f51a80ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:14.261 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:14.254+0000 7f51adf5b700 1 -- 172.21.15.50:0/1110850771 shutdown_connections 2023-01-04T18:10:14.261 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:14.254+0000 7f51adf5b700 1 -- 172.21.15.50:0/1110850771 wait complete. 2023-01-04T18:10:14.473 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:13.194061+0000 mon.smithi050 (mon.0) 92 : cluster [INF] Active manager daemon smithi050.emnywo restarted 2023-01-04T18:10:14.473 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:13.194437+0000 mon.smithi050 (mon.0) 93 : cluster [INF] Activating manager daemon smithi050.emnywo 2023-01-04T18:10:14.473 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:13.196014+0000 mon.smithi050 (mon.0) 94 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2023-01-04T18:10:14.473 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:13.247276+0000 mon.smithi050 (mon.0) 95 : cluster [DBG] mgrmap e14: smithi050.emnywo(active, starting, since 0.0529166s) 2023-01-04T18:10:14.474 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:13.248533+0000 mon.smithi050 (mon.0) 96 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi050"}]: dispatch 2023-01-04T18:10:14.474 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:13.249098+0000 mon.smithi050 (mon.0) 97 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mgr metadata", "who": "smithi050.emnywo", "id": "smithi050.emnywo"}]: dispatch 2023-01-04T18:10:14.474 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:13.249996+0000 mon.smithi050 (mon.0) 98 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-01-04T18:10:14.474 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:13.250181+0000 mon.smithi050 (mon.0) 99 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-01-04T18:10:14.474 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:13.250346+0000 mon.smithi050 (mon.0) 100 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-01-04T18:10:14.474 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:13.264765+0000 mon.smithi050 (mon.0) 101 : cluster [INF] Manager daemon smithi050.emnywo is now available 2023-01-04T18:10:14.474 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:13.369982+0000 mon.smithi050 (mon.0) 102 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:10:14.474 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:13.372499+0000 mon.smithi050 (mon.0) 103 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:10:14.474 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:13.397056+0000 mon.smithi050 (mon.0) 104 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:10:14.474 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:13.399797+0000 mon.smithi050 (mon.0) 105 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:10:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:mgr epoch 13 is available 2023-01-04T18:10:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:Generating a dashboard self-signed certificate... 2023-01-04T18:10:15.141 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 dashboard create-self-signed-cert 2023-01-04T18:10:15.381 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:14.249006+0000 mgr.smithi050.emnywo (mgr.14162) 1 : audit [DBG] from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-01-04T18:10:15.381 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:14.249382+0000 mon.smithi050 (mon.0) 106 : cluster [DBG] mgrmap e15: smithi050.emnywo(active, since 1.05503s) 2023-01-04T18:10:15.382 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:14.255537+0000 mgr.smithi050.emnywo (mgr.14162) 2 : audit [DBG] from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-01-04T18:10:15.629 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.624+0000 7fb1695b4700 1 Processor -- start 2023-01-04T18:10:15.629 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.624+0000 7fb1695b4700 1 -- start start 2023-01-04T18:10:15.629 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.624+0000 7fb1695b4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb16406fc90 0x7fb1640fe7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:15.629 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.624+0000 7fb1695b4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640fed60 con 0x7fb16406fc90 2023-01-04T18:10:15.629 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.625+0000 7fb162ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb16406fc90 0x7fb1640fe7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:15.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.625+0000 7fb162ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb16406fc90 0x7fb1640fe7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47004/0 (socket says 172.21.15.50:47004) 2023-01-04T18:10:15.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.625+0000 7fb162ffd700 1 -- 172.21.15.50:0/1319560523 learned_addr learned my addr 172.21.15.50:0/1319560523 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:15.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.625+0000 7fb162ffd700 1 -- 172.21.15.50:0/1319560523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1640feea0 con 0x7fb16406fc90 2023-01-04T18:10:15.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.625+0000 7fb162ffd700 1 --2- 172.21.15.50:0/1319560523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb16406fc90 0x7fb1640fe7e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb15400b5f0 tx=0x7fb154006ee0).ready entity=mon.0 client_cookie=b5d3d95977786812 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:15.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.625+0000 7fb161ffb700 1 -- 172.21.15.50:0/1319560523 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb15400d600 con 0x7fb16406fc90 2023-01-04T18:10:15.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.625+0000 7fb161ffb700 1 -- 172.21.15.50:0/1319560523 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb15400dc10 con 0x7fb16406fc90 2023-01-04T18:10:15.630 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.625+0000 7fb161ffb700 1 -- 172.21.15.50:0/1319560523 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb154011cd0 con 0x7fb16406fc90 2023-01-04T18:10:15.634 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.626+0000 7fb1695b4700 1 -- 172.21.15.50:0/1319560523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb16406fc90 msgr2=0x7fb1640fe7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:15.635 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.626+0000 7fb1695b4700 1 --2- 172.21.15.50:0/1319560523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb16406fc90 0x7fb1640fe7e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb15400b5f0 tx=0x7fb154006ee0).stop 2023-01-04T18:10:15.635 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.626+0000 7fb1695b4700 1 -- 172.21.15.50:0/1319560523 shutdown_connections 2023-01-04T18:10:15.635 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.626+0000 7fb1695b4700 1 --2- 172.21.15.50:0/1319560523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb16406fc90 0x7fb1640fe7e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:15.635 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.626+0000 7fb1695b4700 1 -- 172.21.15.50:0/1319560523 >> 172.21.15.50:0/1319560523 conn(0x7fb1640f6280 msgr2=0x7fb1640f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:15.635 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.627+0000 7fb1695b4700 1 -- 172.21.15.50:0/1319560523 shutdown_connections 2023-01-04T18:10:15.635 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.627+0000 7fb1695b4700 1 -- 172.21.15.50:0/1319560523 wait complete. 2023-01-04T18:10:15.635 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.628+0000 7fb1695b4700 1 Processor -- start 2023-01-04T18:10:15.635 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.628+0000 7fb1695b4700 1 -- start start 2023-01-04T18:10:15.636 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.628+0000 7fb1695b4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb16406fc90 0x7fb1640fc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:15.636 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.628+0000 7fb1695b4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640fa6e0 con 0x7fb16406fc90 2023-01-04T18:10:15.636 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.628+0000 7fb162ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb16406fc90 0x7fb1640fc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:15.636 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.628+0000 7fb162ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb16406fc90 0x7fb1640fc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47016/0 (socket says 172.21.15.50:47016) 2023-01-04T18:10:15.636 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.628+0000 7fb162ffd700 1 -- 172.21.15.50:0/1296284752 learned_addr learned my addr 172.21.15.50:0/1296284752 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:15.636 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.628+0000 7fb162ffd700 1 -- 172.21.15.50:0/1296284752 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15400b200 con 0x7fb16406fc90 2023-01-04T18:10:15.636 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.629+0000 7fb162ffd700 1 --2- 172.21.15.50:0/1296284752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb16406fc90 0x7fb1640fc260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fb15400dfb0 tx=0x7fb154006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:15.636 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.629+0000 7fb14b7fe700 1 -- 172.21.15.50:0/1296284752 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb154011df0 con 0x7fb16406fc90 2023-01-04T18:10:15.636 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.629+0000 7fb1695b4700 1 -- 172.21.15.50:0/1296284752 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1640fa880 con 0x7fb16406fc90 2023-01-04T18:10:15.636 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.629+0000 7fb14b7fe700 1 -- 172.21.15.50:0/1296284752 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb15401b8c0 con 0x7fb16406fc90 2023-01-04T18:10:15.637 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.629+0000 7fb14b7fe700 1 -- 172.21.15.50:0/1296284752 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb15401a7c0 con 0x7fb16406fc90 2023-01-04T18:10:15.637 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.629+0000 7fb1695b4700 1 -- 172.21.15.50:0/1296284752 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1640fac90 con 0x7fb16406fc90 2023-01-04T18:10:15.637 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.630+0000 7fb14b7fe700 1 -- 172.21.15.50:0/1296284752 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 15) v1 ==== 36067+0+0 (secure 0 0 0) 0x7fb15400f070 con 0x7fb16406fc90 2023-01-04T18:10:15.637 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.630+0000 7fb1695b4700 1 -- 172.21.15.50:0/1296284752 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb164045ad0 con 0x7fb16406fc90 2023-01-04T18:10:15.637 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.630+0000 7fb14b7fe700 1 --2- 172.21.15.50:0/1296284752 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb15002fd50 0x7fb150032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:15.637 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.630+0000 7fb14b7fe700 1 -- 172.21.15.50:0/1296284752 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7fb154040fe0 con 0x7fb16406fc90 2023-01-04T18:10:15.637 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.630+0000 7fb1627fc700 1 --2- 172.21.15.50:0/1296284752 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb15002fd50 0x7fb150032210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:15.637 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.631+0000 7fb1627fc700 1 --2- 172.21.15.50:0/1296284752 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb15002fd50 0x7fb150032210 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fb1580096a0 tx=0x7fb158006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:15.641 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.638+0000 7fb14b7fe700 1 -- 172.21.15.50:0/1296284752 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb154010be0 con 0x7fb16406fc90 2023-01-04T18:10:15.812 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:15.809+0000 7fb1695b4700 1 -- 172.21.15.50:0/1296284752 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1640faed0 con 0x7fb15002fd50 2023-01-04T18:10:16.079 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:16.075+0000 7fb14b7fe700 1 -- 172.21.15.50:0/1296284752 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fb1640faed0 con 0x7fb15002fd50 2023-01-04T18:10:16.079 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: Self-signed certificate created 2023-01-04T18:10:16.081 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:16.077+0000 7fb1695b4700 1 -- 172.21.15.50:0/1296284752 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb15002fd50 msgr2=0x7fb150032210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:16.081 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:16.077+0000 7fb1695b4700 1 --2- 172.21.15.50:0/1296284752 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb15002fd50 0x7fb150032210 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fb1580096a0 tx=0x7fb158006b40).stop 2023-01-04T18:10:16.081 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:16.077+0000 7fb1695b4700 1 -- 172.21.15.50:0/1296284752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb16406fc90 msgr2=0x7fb1640fc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:16.081 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:16.077+0000 7fb1695b4700 1 --2- 172.21.15.50:0/1296284752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb16406fc90 0x7fb1640fc260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fb15400dfb0 tx=0x7fb154006ee0).stop 2023-01-04T18:10:16.081 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:16.077+0000 7fb1695b4700 1 -- 172.21.15.50:0/1296284752 shutdown_connections 2023-01-04T18:10:16.081 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:16.077+0000 7fb1695b4700 1 --2- 172.21.15.50:0/1296284752 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb15002fd50 0x7fb150032210 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:16.081 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:16.077+0000 7fb1695b4700 1 --2- 172.21.15.50:0/1296284752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb16406fc90 0x7fb1640fc260 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:16.081 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:16.077+0000 7fb1695b4700 1 -- 172.21.15.50:0/1296284752 >> 172.21.15.50:0/1296284752 conn(0x7fb1640f6280 msgr2=0x7fb1640f7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:16.082 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:16.078+0000 7fb1695b4700 1 -- 172.21.15.50:0/1296284752 shutdown_connections 2023-01-04T18:10:16.082 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:16.078+0000 7fb1695b4700 1 -- 172.21.15.50:0/1296284752 wait complete. 2023-01-04T18:10:16.580 INFO:teuthology.orchestra.run.smithi050.stderr:Creating initial admin user... 2023-01-04T18:10:16.581 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpw2qaxkvr:/tmp/dashboard.pw:z docker.io/ceph/ceph:v16.2.4 dashboard ac-user-create admin -i /tmp/dashboard.pw administrator --force-password --pwd-update-required 2023-01-04T18:10:16.711 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:15.527490+0000 mon.smithi050 (mon.0) 107 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:16.711 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:15.810969+0000 mgr.smithi050.emnywo (mgr.14162) 3 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:10:16.711 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:16.074954+0000 mon.smithi050 (mon.0) 108 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:16.711 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:16.076778+0000 mon.smithi050 (mon.0) 109 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:16.711 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:16.170476+0000 mon.smithi050 (mon.0) 110 : cluster [DBG] mgrmap e16: smithi050.emnywo(active, since 2s) 2023-01-04T18:10:17.141 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.136+0000 7fa985252700 1 Processor -- start 2023-01-04T18:10:17.141 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.136+0000 7fa985252700 1 -- start start 2023-01-04T18:10:17.141 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.137+0000 7fa985252700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98006fc90 0x7fa9800fe7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:17.141 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.137+0000 7fa985252700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9800fed60 con 0x7fa98006fc90 2023-01-04T18:10:17.141 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.137+0000 7fa97ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98006fc90 0x7fa9800fe7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:17.141 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.137+0000 7fa97ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98006fc90 0x7fa9800fe7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56122/0 (socket says 172.21.15.50:56122) 2023-01-04T18:10:17.142 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.137+0000 7fa97ed9d700 1 -- 172.21.15.50:0/34877234 learned_addr learned my addr 172.21.15.50:0/34877234 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:17.142 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.137+0000 7fa97ed9d700 1 -- 172.21.15.50:0/34877234 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9800feea0 con 0x7fa98006fc90 2023-01-04T18:10:17.142 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.137+0000 7fa97ed9d700 1 --2- 172.21.15.50:0/34877234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98006fc90 0x7fa9800fe7e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fa97000b5f0 tx=0x7fa970006ee0).ready entity=mon.0 client_cookie=4a66eee72e0296b0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:17.142 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.137+0000 7fa97dd9b700 1 -- 172.21.15.50:0/34877234 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa97000d600 con 0x7fa98006fc90 2023-01-04T18:10:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.138+0000 7fa97dd9b700 1 -- 172.21.15.50:0/34877234 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa97000dc10 con 0x7fa98006fc90 2023-01-04T18:10:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.138+0000 7fa97dd9b700 1 -- 172.21.15.50:0/34877234 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa970011cd0 con 0x7fa98006fc90 2023-01-04T18:10:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.138+0000 7fa985252700 1 -- 172.21.15.50:0/34877234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98006fc90 msgr2=0x7fa9800fe7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.138+0000 7fa985252700 1 --2- 172.21.15.50:0/34877234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98006fc90 0x7fa9800fe7e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fa97000b5f0 tx=0x7fa970006ee0).stop 2023-01-04T18:10:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.138+0000 7fa985252700 1 -- 172.21.15.50:0/34877234 shutdown_connections 2023-01-04T18:10:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.138+0000 7fa985252700 1 --2- 172.21.15.50:0/34877234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98006fc90 0x7fa9800fe7e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.138+0000 7fa985252700 1 -- 172.21.15.50:0/34877234 >> 172.21.15.50:0/34877234 conn(0x7fa9800f6280 msgr2=0x7fa9800f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.138+0000 7fa985252700 1 -- 172.21.15.50:0/34877234 shutdown_connections 2023-01-04T18:10:17.145 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.138+0000 7fa985252700 1 -- 172.21.15.50:0/34877234 wait complete. 2023-01-04T18:10:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.139+0000 7fa985252700 1 Processor -- start 2023-01-04T18:10:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.139+0000 7fa985252700 1 -- start start 2023-01-04T18:10:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.139+0000 7fa985252700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98006fc90 0x7fa98010a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.139+0000 7fa985252700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98010aed0 con 0x7fa98006fc90 2023-01-04T18:10:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.139+0000 7fa97ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98006fc90 0x7fa98010a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.139+0000 7fa97ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98006fc90 0x7fa98010a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56134/0 (socket says 172.21.15.50:56134) 2023-01-04T18:10:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.139+0000 7fa97ed9d700 1 -- 172.21.15.50:0/118899851 learned_addr learned my addr 172.21.15.50:0/118899851 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.139+0000 7fa97ed9d700 1 -- 172.21.15.50:0/118899851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97000b200 con 0x7fa98006fc90 2023-01-04T18:10:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.140+0000 7fa97ed9d700 1 --2- 172.21.15.50:0/118899851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98006fc90 0x7fa98010a9e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fa970006cb0 tx=0x7fa970006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:17.146 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.140+0000 7fa9777fe700 1 -- 172.21.15.50:0/118899851 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa970011df0 con 0x7fa98006fc90 2023-01-04T18:10:17.147 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.140+0000 7fa9777fe700 1 -- 172.21.15.50:0/118899851 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa97001b8c0 con 0x7fa98006fc90 2023-01-04T18:10:17.147 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.140+0000 7fa985252700 1 -- 172.21.15.50:0/118899851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98010b0d0 con 0x7fa98006fc90 2023-01-04T18:10:17.147 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.140+0000 7fa9777fe700 1 -- 172.21.15.50:0/118899851 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa97001a930 con 0x7fa98006fc90 2023-01-04T18:10:17.147 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.140+0000 7fa985252700 1 -- 172.21.15.50:0/118899851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98010b4e0 con 0x7fa98006fc90 2023-01-04T18:10:17.147 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.141+0000 7fa9777fe700 1 -- 172.21.15.50:0/118899851 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) v1 ==== 36208+0+0 (secure 0 0 0) 0x7fa97000f070 con 0x7fa98006fc90 2023-01-04T18:10:17.147 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.141+0000 7fa9777fe700 1 --2- 172.21.15.50:0/118899851 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fa96002feb0 0x7fa960032370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:17.147 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.141+0000 7fa9777fe700 1 -- 172.21.15.50:0/118899851 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7fa9700410a0 con 0x7fa98006fc90 2023-01-04T18:10:17.147 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.141+0000 7fa97e59c700 1 --2- 172.21.15.50:0/118899851 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fa96002feb0 0x7fa960032370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:17.147 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.141+0000 7fa985252700 1 -- 172.21.15.50:0/118899851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa980059100 con 0x7fa98006fc90 2023-01-04T18:10:17.147 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.141+0000 7fa97e59c700 1 --2- 172.21.15.50:0/118899851 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fa96002feb0 0x7fa960032370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fa9680096a0 tx=0x7fa968006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:17.148 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.145+0000 7fa9777fe700 1 -- 172.21.15.50:0/118899851 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa970016070 con 0x7fa98006fc90 2023-01-04T18:10:17.325 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.321+0000 7fa985252700 1 -- 172.21.15.50:0/118899851 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fa980045ad0 con 0x7fa96002feb0 2023-01-04T18:10:17.570 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.567+0000 7fa9777fe700 1 -- 172.21.15.50:0/118899851 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fa980045ad0 con 0x7fa96002feb0 2023-01-04T18:10:17.570 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$7w6bE0Ux9fbvFZ00uvj5kuj3AsYzzseaoYS0Gi79kIZSXrpqcYWJm", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1672855817, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-01-04T18:10:17.572 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.568+0000 7fa985252700 1 -- 172.21.15.50:0/118899851 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fa96002feb0 msgr2=0x7fa960032370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:17.573 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.568+0000 7fa985252700 1 --2- 172.21.15.50:0/118899851 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fa96002feb0 0x7fa960032370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fa9680096a0 tx=0x7fa968006b40).stop 2023-01-04T18:10:17.573 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.568+0000 7fa985252700 1 -- 172.21.15.50:0/118899851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98006fc90 msgr2=0x7fa98010a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:17.573 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.568+0000 7fa985252700 1 --2- 172.21.15.50:0/118899851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98006fc90 0x7fa98010a9e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fa970006cb0 tx=0x7fa970006ee0).stop 2023-01-04T18:10:17.573 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.569+0000 7fa985252700 1 -- 172.21.15.50:0/118899851 shutdown_connections 2023-01-04T18:10:17.573 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.569+0000 7fa985252700 1 --2- 172.21.15.50:0/118899851 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fa96002feb0 0x7fa960032370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:17.573 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.569+0000 7fa985252700 1 --2- 172.21.15.50:0/118899851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa98006fc90 0x7fa98010a9e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:17.573 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.569+0000 7fa985252700 1 -- 172.21.15.50:0/118899851 >> 172.21.15.50:0/118899851 conn(0x7fa9800f6280 msgr2=0x7fa9800f7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:17.573 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.569+0000 7fa985252700 1 -- 172.21.15.50:0/118899851 shutdown_connections 2023-01-04T18:10:17.573 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:17.569+0000 7fa985252700 1 -- 172.21.15.50:0/118899851 wait complete. 2023-01-04T18:10:17.912 INFO:teuthology.orchestra.run.smithi050.stderr:Fetching dashboard port number... 2023-01-04T18:10:17.912 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi050 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmphq0e1x6f:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpccxsaw_n:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config get mgr mgr/dashboard/ssl_server_port 2023-01-04T18:10:18.359 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.355+0000 7f7670ff2700 1 Processor -- start 2023-01-04T18:10:18.359 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.355+0000 7f7670ff2700 1 -- start start 2023-01-04T18:10:18.359 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.355+0000 7f7670ff2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f766c06fcd0 0x7f766c0fe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:18.360 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.356+0000 7f7670ff2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c0fed20 con 0x7f766c06fcd0 2023-01-04T18:10:18.360 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.356+0000 7f766a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f766c06fcd0 0x7f766c0fe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:18.360 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.356+0000 7f766a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f766c06fcd0 0x7f766c0fe7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56140/0 (socket says 172.21.15.50:56140) 2023-01-04T18:10:18.360 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.356+0000 7f766a59c700 1 -- 172.21.15.50:0/2955019956 learned_addr learned my addr 172.21.15.50:0/2955019956 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:18.362 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.356+0000 7f766a59c700 1 -- 172.21.15.50:0/2955019956 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c0fee60 con 0x7f766c06fcd0 2023-01-04T18:10:18.363 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.356+0000 7f766a59c700 1 --2- 172.21.15.50:0/2955019956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f766c06fcd0 0x7f766c0fe7a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f765c00b5f0 tx=0x7f765c006ee0).ready entity=mon.0 client_cookie=ea4cd1b2098675ec server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:18.363 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.356+0000 7f766959a700 1 -- 172.21.15.50:0/2955019956 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f765c00d600 con 0x7f766c06fcd0 2023-01-04T18:10:18.363 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.356+0000 7f766959a700 1 -- 172.21.15.50:0/2955019956 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f765c00dc10 con 0x7f766c06fcd0 2023-01-04T18:10:18.363 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.356+0000 7f766959a700 1 -- 172.21.15.50:0/2955019956 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f765c011cd0 con 0x7f766c06fcd0 2023-01-04T18:10:18.363 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.357+0000 7f7670ff2700 1 -- 172.21.15.50:0/2955019956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f766c06fcd0 msgr2=0x7f766c0fe7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:18.363 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.357+0000 7f7670ff2700 1 --2- 172.21.15.50:0/2955019956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f766c06fcd0 0x7f766c0fe7a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f765c00b5f0 tx=0x7f765c006ee0).stop 2023-01-04T18:10:18.363 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.357+0000 7f7670ff2700 1 -- 172.21.15.50:0/2955019956 shutdown_connections 2023-01-04T18:10:18.363 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.357+0000 7f7670ff2700 1 --2- 172.21.15.50:0/2955019956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f766c06fcd0 0x7f766c0fe7a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:18.363 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.357+0000 7f7670ff2700 1 -- 172.21.15.50:0/2955019956 >> 172.21.15.50:0/2955019956 conn(0x7f766c0f6280 msgr2=0x7f766c0f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:18.363 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.357+0000 7f7670ff2700 1 -- 172.21.15.50:0/2955019956 shutdown_connections 2023-01-04T18:10:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.357+0000 7f7670ff2700 1 -- 172.21.15.50:0/2955019956 wait complete. 2023-01-04T18:10:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.358+0000 7f7670ff2700 1 Processor -- start 2023-01-04T18:10:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.358+0000 7f7670ff2700 1 -- start start 2023-01-04T18:10:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.358+0000 7f7670ff2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f766c06fcd0 0x7f766c0fc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.358+0000 7f7670ff2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c0fa6a0 con 0x7f766c06fcd0 2023-01-04T18:10:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.358+0000 7f766a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f766c06fcd0 0x7f766c0fc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.358+0000 7f766a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f766c06fcd0 0x7f766c0fc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56154/0 (socket says 172.21.15.50:56154) 2023-01-04T18:10:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.358+0000 7f766a59c700 1 -- 172.21.15.50:0/4131139253 learned_addr learned my addr 172.21.15.50:0/4131139253 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.358+0000 7f766a59c700 1 -- 172.21.15.50:0/4131139253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c00b200 con 0x7f766c06fcd0 2023-01-04T18:10:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.358+0000 7f766a59c700 1 --2- 172.21.15.50:0/4131139253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f766c06fcd0 0x7f766c0fc220 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f765c00b1d0 tx=0x7f765c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.359+0000 7f7662ffd700 1 -- 172.21.15.50:0/4131139253 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f765c011df0 con 0x7f766c06fcd0 2023-01-04T18:10:18.364 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.359+0000 7f7662ffd700 1 -- 172.21.15.50:0/4131139253 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f765c01b8c0 con 0x7f766c06fcd0 2023-01-04T18:10:18.365 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.359+0000 7f7662ffd700 1 -- 172.21.15.50:0/4131139253 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f765c01a7b0 con 0x7f766c06fcd0 2023-01-04T18:10:18.365 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.359+0000 7f7670ff2700 1 -- 172.21.15.50:0/4131139253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766c0fa840 con 0x7f766c06fcd0 2023-01-04T18:10:18.365 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.359+0000 7f7670ff2700 1 -- 172.21.15.50:0/4131139253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766c0fac50 con 0x7f766c06fcd0 2023-01-04T18:10:18.365 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.359+0000 7f7662ffd700 1 -- 172.21.15.50:0/4131139253 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) v1 ==== 36208+0+0 (secure 0 0 0) 0x7f765c00f070 con 0x7f766c06fcd0 2023-01-04T18:10:18.365 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.360+0000 7f7662ffd700 1 --2- 172.21.15.50:0/4131139253 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f764c02ff00 0x7f764c0323c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:18.366 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.360+0000 7f7662ffd700 1 -- 172.21.15.50:0/4131139253 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f765c0413c0 con 0x7f766c06fcd0 2023-01-04T18:10:18.366 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.360+0000 7f7669d9b700 1 --2- 172.21.15.50:0/4131139253 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f764c02ff00 0x7f764c0323c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:18.366 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.360+0000 7f7670ff2700 1 -- 172.21.15.50:0/4131139253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766c059100 con 0x7f766c06fcd0 2023-01-04T18:10:18.366 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.360+0000 7f7669d9b700 1 --2- 172.21.15.50:0/4131139253 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f764c02ff00 0x7f764c0323c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f76540096a0 tx=0x7f7654006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:18.367 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.364+0000 7f7662ffd700 1 -- 172.21.15.50:0/4131139253 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f765c016030 con 0x7f766c06fcd0 2023-01-04T18:10:18.529 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.525+0000 7f7670ff2700 1 -- 172.21.15.50:0/4131139253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f766c045ad0 con 0x7f766c06fcd0 2023-01-04T18:10:18.529 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.526+0000 7f7662ffd700 1 -- 172.21.15.50:0/4131139253 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v10) v1 ==== 112+0+5 (secure 0 0 0) 0x7f765c019950 con 0x7f766c06fcd0 2023-01-04T18:10:18.529 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 8443 2023-01-04T18:10:18.532 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.528+0000 7f7670ff2700 1 -- 172.21.15.50:0/4131139253 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f764c02ff00 msgr2=0x7f764c0323c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:18.532 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.528+0000 7f7670ff2700 1 --2- 172.21.15.50:0/4131139253 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f764c02ff00 0x7f764c0323c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f76540096a0 tx=0x7f7654006b40).stop 2023-01-04T18:10:18.532 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.528+0000 7f7670ff2700 1 -- 172.21.15.50:0/4131139253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f766c06fcd0 msgr2=0x7f766c0fc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:18.532 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.528+0000 7f7670ff2700 1 --2- 172.21.15.50:0/4131139253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f766c06fcd0 0x7f766c0fc220 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f765c00b1d0 tx=0x7f765c006ee0).stop 2023-01-04T18:10:18.532 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.528+0000 7f7670ff2700 1 -- 172.21.15.50:0/4131139253 shutdown_connections 2023-01-04T18:10:18.532 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.528+0000 7f7670ff2700 1 --2- 172.21.15.50:0/4131139253 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f764c02ff00 0x7f764c0323c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:18.532 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.528+0000 7f7670ff2700 1 --2- 172.21.15.50:0/4131139253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f766c06fcd0 0x7f766c0fc220 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:18.532 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.528+0000 7f7670ff2700 1 -- 172.21.15.50:0/4131139253 >> 172.21.15.50:0/4131139253 conn(0x7f766c0f6280 msgr2=0x7f766c0f7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:18.533 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.528+0000 7f7670ff2700 1 -- 172.21.15.50:0/4131139253 shutdown_connections 2023-01-04T18:10:18.533 INFO:teuthology.orchestra.run.smithi050.stderr:/usr/bin/ceph: 2023-01-04T18:10:18.528+0000 7f7670ff2700 1 -- 172.21.15.50:0/4131139253 wait complete. 2023-01-04T18:10:18.948 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl is-enabled firewalld.service 2023-01-04T18:10:18.956 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: disabled 2023-01-04T18:10:18.956 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: systemctl is-active firewalld.service 2023-01-04T18:10:18.964 INFO:teuthology.orchestra.run.smithi050.stderr:systemctl: inactive 2023-01-04T18:10:18.964 INFO:teuthology.orchestra.run.smithi050.stderr:firewalld.service is not enabled 2023-01-04T18:10:18.964 INFO:teuthology.orchestra.run.smithi050.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2023-01-04T18:10:18.968 INFO:teuthology.orchestra.run.smithi050.stderr:Ceph Dashboard is now available at: 2023-01-04T18:10:18.968 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-01-04T18:10:18.968 INFO:teuthology.orchestra.run.smithi050.stderr: URL: https://smithi050.front.sepia.ceph.com:8443/ 2023-01-04T18:10:18.968 INFO:teuthology.orchestra.run.smithi050.stderr: User: admin 2023-01-04T18:10:18.968 INFO:teuthology.orchestra.run.smithi050.stderr: Password: 3gpl73ais1 2023-01-04T18:10:18.968 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-01-04T18:10:18.968 INFO:teuthology.orchestra.run.smithi050.stderr:You can access the Ceph CLI with: 2023-01-04T18:10:18.969 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-01-04T18:10:18.969 INFO:teuthology.orchestra.run.smithi050.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid d98671da-8c5a-11ed-821a-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-01-04T18:10:18.969 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-01-04T18:10:18.969 INFO:teuthology.orchestra.run.smithi050.stderr:Please consider enabling telemetry to help improve Ceph: 2023-01-04T18:10:18.969 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-01-04T18:10:18.969 INFO:teuthology.orchestra.run.smithi050.stderr: ceph telemetry on 2023-01-04T18:10:18.969 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-01-04T18:10:18.969 INFO:teuthology.orchestra.run.smithi050.stderr:For more information see: 2023-01-04T18:10:18.969 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-01-04T18:10:18.969 INFO:teuthology.orchestra.run.smithi050.stderr: https://docs.ceph.com/docs/pacific/mgr/telemetry/ 2023-01-04T18:10:18.969 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-01-04T18:10:18.969 INFO:teuthology.orchestra.run.smithi050.stderr:Bootstrap complete. 2023-01-04T18:10:18.969 INFO:teuthology.orchestra.run.smithi050.stderr:Releasing lock 140226162273640 on /run/cephadm/d98671da-8c5a-11ed-821a-001a4aab830c.lock 2023-01-04T18:10:18.970 INFO:teuthology.orchestra.run.smithi050.stderr:Lock 140226162273640 released on /run/cephadm/d98671da-8c5a-11ed-821a-001a4aab830c.lock 2023-01-04T18:10:18.971 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:17.323619+0000 mgr.smithi050.emnywo (mgr.14162) 4 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:10:18.971 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:17.568266+0000 mon.smithi050 (mon.0) 111 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:18.971 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:18.527271+0000 mon.smithi050 (mon.0) 112 : audit [DBG] from='client.? 172.21.15.50:0/4131139253' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-01-04T18:10:19.007 INFO:tasks.cephadm:Fetching config... 2023-01-04T18:10:19.007 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-01-04T18:10:19.007 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-01-04T18:10:19.065 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-01-04T18:10:19.065 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-01-04T18:10:19.065 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-01-04T18:10:19.122 INFO:tasks.cephadm:Fetching mon keyring... 2023-01-04T18:10:19.122 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-01-04T18:10:19.123 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050/keyring of=/dev/stdout 2023-01-04T18:10:19.196 INFO:tasks.cephadm:Fetching pub ssh key... 2023-01-04T18:10:19.196 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-01-04T18:10:19.196 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-01-04T18:10:19.255 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-01-04T18:10:19.255 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcflAq/5AaapAgLE6KDeh2SUQvuimcN5EV6XDaoIZ6Knn3OgJSPX0RJBRTxHPoKkbjJbowALF58PKrU9WZpopcZaiOzun4DYRgypbCbpDmixlovomSDP+V/8Kf+RXBXTng7cmCm9ryo/ZBQZJCDdldIXYfO35Bv0M8BPgGet1+cEqDvQ5z5MDfjv425cCkodk7uTcqQ5ZwO9pJskec3b6u46o+9Tt7rh29xuxwNwrUldxVeI3PO8SyptHtTua2myWZBPgCbemjGuePpYZZwGQa8FcqPuAX7gNkkidEOAKzCfGIdCOKZ38hZqeF8aleUmV9G3WAoGA93IJITXbnWtmjl3pr3xbesOlelXdOgvNgM1AgVVraDm04fjiUYb5b1U2kXwGtts8cQ5fpYaStLZMhL3d7HjMNb2qxN0AlsWoWI3NCFsDyPPs5STorLMZ+QACkonoV6yYAvTO+a7Ncg1ZiZnfNeb1sHYVYQtkEebjq4tv6xWTYW4YkOI2y7XRA9YE= ceph-d98671da-8c5a-11ed-821a-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-01-04T18:10:19.334 INFO:teuthology.orchestra.run.smithi050.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcflAq/5AaapAgLE6KDeh2SUQvuimcN5EV6XDaoIZ6Knn3OgJSPX0RJBRTxHPoKkbjJbowALF58PKrU9WZpopcZaiOzun4DYRgypbCbpDmixlovomSDP+V/8Kf+RXBXTng7cmCm9ryo/ZBQZJCDdldIXYfO35Bv0M8BPgGet1+cEqDvQ5z5MDfjv425cCkodk7uTcqQ5ZwO9pJskec3b6u46o+9Tt7rh29xuxwNwrUldxVeI3PO8SyptHtTua2myWZBPgCbemjGuePpYZZwGQa8FcqPuAX7gNkkidEOAKzCfGIdCOKZ38hZqeF8aleUmV9G3WAoGA93IJITXbnWtmjl3pr3xbesOlelXdOgvNgM1AgVVraDm04fjiUYb5b1U2kXwGtts8cQ5fpYaStLZMhL3d7HjMNb2qxN0AlsWoWI3NCFsDyPPs5STorLMZ+QACkonoV6yYAvTO+a7Ncg1ZiZnfNeb1sHYVYQtkEebjq4tv6xWTYW4YkOI2y7XRA9YE= ceph-d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:10:19.346 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcflAq/5AaapAgLE6KDeh2SUQvuimcN5EV6XDaoIZ6Knn3OgJSPX0RJBRTxHPoKkbjJbowALF58PKrU9WZpopcZaiOzun4DYRgypbCbpDmixlovomSDP+V/8Kf+RXBXTng7cmCm9ryo/ZBQZJCDdldIXYfO35Bv0M8BPgGet1+cEqDvQ5z5MDfjv425cCkodk7uTcqQ5ZwO9pJskec3b6u46o+9Tt7rh29xuxwNwrUldxVeI3PO8SyptHtTua2myWZBPgCbemjGuePpYZZwGQa8FcqPuAX7gNkkidEOAKzCfGIdCOKZ38hZqeF8aleUmV9G3WAoGA93IJITXbnWtmjl3pr3xbesOlelXdOgvNgM1AgVVraDm04fjiUYb5b1U2kXwGtts8cQ5fpYaStLZMhL3d7HjMNb2qxN0AlsWoWI3NCFsDyPPs5STorLMZ+QACkonoV6yYAvTO+a7Ncg1ZiZnfNeb1sHYVYQtkEebjq4tv6xWTYW4YkOI2y7XRA9YE= ceph-d98671da-8c5a-11ed-821a-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-01-04T18:10:19.392 INFO:teuthology.orchestra.run.smithi098.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcflAq/5AaapAgLE6KDeh2SUQvuimcN5EV6XDaoIZ6Knn3OgJSPX0RJBRTxHPoKkbjJbowALF58PKrU9WZpopcZaiOzun4DYRgypbCbpDmixlovomSDP+V/8Kf+RXBXTng7cmCm9ryo/ZBQZJCDdldIXYfO35Bv0M8BPgGet1+cEqDvQ5z5MDfjv425cCkodk7uTcqQ5ZwO9pJskec3b6u46o+9Tt7rh29xuxwNwrUldxVeI3PO8SyptHtTua2myWZBPgCbemjGuePpYZZwGQa8FcqPuAX7gNkkidEOAKzCfGIdCOKZ38hZqeF8aleUmV9G3WAoGA93IJITXbnWtmjl3pr3xbesOlelXdOgvNgM1AgVVraDm04fjiUYb5b1U2kXwGtts8cQ5fpYaStLZMhL3d7HjMNb2qxN0AlsWoWI3NCFsDyPPs5STorLMZ+QACkonoV6yYAvTO+a7Ncg1ZiZnfNeb1sHYVYQtkEebjq4tv6xWTYW4YkOI2y7XRA9YE= ceph-d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:10:19.403 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-01-04T18:10:20.707 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:19.570494+0000 mon.smithi050 (mon.0) 113 : cluster [DBG] mgrmap e17: smithi050.emnywo(active, since 6s) 2023-01-04T18:10:21.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.072+0000 7f2447362700 1 -- 172.21.15.50:0/549823740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2440060280 msgr2=0x7f24400f90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:21.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.072+0000 7f2447362700 1 --2- 172.21.15.50:0/549823740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2440060280 0x7f24400f90f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f243c009fb0 tx=0x7f243c009b30).stop 2023-01-04T18:10:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.074+0000 7f2447362700 1 -- 172.21.15.50:0/549823740 shutdown_connections 2023-01-04T18:10:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.074+0000 7f2447362700 1 --2- 172.21.15.50:0/549823740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2440060280 0x7f24400f90f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.074+0000 7f2447362700 1 -- 172.21.15.50:0/549823740 >> 172.21.15.50:0/549823740 conn(0x7f24400f0b70 msgr2=0x7f24400f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.074+0000 7f2447362700 1 -- 172.21.15.50:0/549823740 shutdown_connections 2023-01-04T18:10:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.074+0000 7f2447362700 1 -- 172.21.15.50:0/549823740 wait complete. 2023-01-04T18:10:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.075+0000 7f2447362700 1 Processor -- start 2023-01-04T18:10:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.075+0000 7f2447362700 1 -- start start 2023-01-04T18:10:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.075+0000 7f2447362700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2440060280 0x7f24401066b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.075+0000 7f2447362700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2440106ba0 con 0x7f2440060280 2023-01-04T18:10:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.075+0000 7f24450fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2440060280 0x7f24401066b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.075+0000 7f24450fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2440060280 0x7f24401066b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56168/0 (socket says 172.21.15.50:56168) 2023-01-04T18:10:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.075+0000 7f24450fe700 1 -- 172.21.15.50:0/4131631677 learned_addr learned my addr 172.21.15.50:0/4131631677 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.075+0000 7f24450fe700 1 -- 172.21.15.50:0/4131631677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243c005040 con 0x7f2440060280 2023-01-04T18:10:21.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.076+0000 7f24450fe700 1 --2- 172.21.15.50:0/4131631677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2440060280 0x7f24401066b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f243c013510 tx=0x7f243c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:21.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.076+0000 7f2435ffb700 1 -- 172.21.15.50:0/4131631677 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f243c009320 con 0x7f2440060280 2023-01-04T18:10:21.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.076+0000 7f2447362700 1 -- 172.21.15.50:0/4131631677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2440106da0 con 0x7f2440060280 2023-01-04T18:10:21.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.076+0000 7f2435ffb700 1 -- 172.21.15.50:0/4131631677 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f243c013f00 con 0x7f2440060280 2023-01-04T18:10:21.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.076+0000 7f2435ffb700 1 -- 172.21.15.50:0/4131631677 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f243c014dc0 con 0x7f2440060280 2023-01-04T18:10:21.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.076+0000 7f2447362700 1 -- 172.21.15.50:0/4131631677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2440107230 con 0x7f2440060280 2023-01-04T18:10:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.077+0000 7f2435ffb700 1 -- 172.21.15.50:0/4131631677 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f243c01d3d0 con 0x7f2440060280 2023-01-04T18:10:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.077+0000 7f2435ffb700 1 --2- 172.21.15.50:0/4131631677 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f242c02ff60 0x7f242c032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.077+0000 7f2435ffb700 1 -- 172.21.15.50:0/4131631677 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f243c041fd0 con 0x7f2440060280 2023-01-04T18:10:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.077+0000 7f24448fd700 1 --2- 172.21.15.50:0/4131631677 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f242c02ff60 0x7f242c032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.078+0000 7f2447362700 1 -- 172.21.15.50:0/4131631677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2440059100 con 0x7f2440060280 2023-01-04T18:10:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.078+0000 7f24448fd700 1 --2- 172.21.15.50:0/4131631677 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f242c02ff60 0x7f242c032420 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f24300096a0 tx=0x7f2430006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:21.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.083+0000 7f2435ffb700 1 -- 172.21.15.50:0/4131631677 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f243c012920 con 0x7f2440060280 2023-01-04T18:10:21.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.249+0000 7f2447362700 1 -- 172.21.15.50:0/4131631677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f2440045ad0 con 0x7f2440060280 2023-01-04T18:10:21.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.253+0000 7f2435ffb700 1 -- 172.21.15.50:0/4131631677 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v11)=0 v11) v1 ==== 125+0+0 (secure 0 0 0) 0x7f243c012330 con 0x7f2440060280 2023-01-04T18:10:21.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.256+0000 7f2447362700 1 -- 172.21.15.50:0/4131631677 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f242c02ff60 msgr2=0x7f242c032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:21.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.256+0000 7f2447362700 1 --2- 172.21.15.50:0/4131631677 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f242c02ff60 0x7f242c032420 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f24300096a0 tx=0x7f2430006b40).stop 2023-01-04T18:10:21.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.256+0000 7f2447362700 1 -- 172.21.15.50:0/4131631677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2440060280 msgr2=0x7f24401066b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:21.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.256+0000 7f2447362700 1 --2- 172.21.15.50:0/4131631677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2440060280 0x7f24401066b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f243c013510 tx=0x7f243c00b040).stop 2023-01-04T18:10:21.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.256+0000 7f2447362700 1 -- 172.21.15.50:0/4131631677 shutdown_connections 2023-01-04T18:10:21.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.256+0000 7f2447362700 1 --2- 172.21.15.50:0/4131631677 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f242c02ff60 0x7f242c032420 secure :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0x7f24300096a0 tx=0x7f2430006b40).stop 2023-01-04T18:10:21.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.256+0000 7f2447362700 1 --2- 172.21.15.50:0/4131631677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2440060280 0x7f24401066b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:21.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.256+0000 7f2447362700 1 -- 172.21.15.50:0/4131631677 >> 172.21.15.50:0/4131631677 conn(0x7f24400f0b70 msgr2=0x7f24400f1610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:21.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.256+0000 7f2447362700 1 -- 172.21.15.50:0/4131631677 shutdown_connections 2023-01-04T18:10:21.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:21.256+0000 7f2447362700 1 -- 172.21.15.50:0/4131631677 wait complete. 2023-01-04T18:10:21.632 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi098 2023-01-04T18:10:21.633 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-01-04T18:10:21.633 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/etc/ceph/ceph.conf 2023-01-04T18:10:21.651 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-01-04T18:10:21.651 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-01-04T18:10:21.709 INFO:tasks.cephadm:Adding host smithi098 to orchestrator... 2023-01-04T18:10:21.709 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph orch host add smithi098 2023-01-04T18:10:22.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:21.156459+0000 mon.smithi050 (mon.0) 114 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:22.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:21.254591+0000 mon.smithi050 (mon.0) 115 : audit [INF] from='client.? 172.21.15.50:0/4131631677' entity='client.admin' 2023-01-04T18:10:22.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:21.544483+0000 mon.smithi050 (mon.0) 116 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:22.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:10:21.551035+0000 mgr.smithi050.emnywo (mgr.14162) 5 : cephadm [INF] Deploying daemon alertmanager.smithi050 on smithi050 2023-01-04T18:10:30.032 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:28.796818+0000 mon.smithi050 (mon.0) 117 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:30.032 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:28.797832+0000 mon.smithi050 (mon.0) 118 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi050", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-01-04T18:10:30.033 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:28.799380+0000 mon.smithi050 (mon.0) 119 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi050", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-01-04T18:10:30.033 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:28.799946+0000 mon.smithi050 (mon.0) 120 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:10:30.033 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:10:28.800597+0000 mgr.smithi050.emnywo (mgr.14162) 6 : cephadm [INF] Deploying daemon crash.smithi050 on smithi050 2023-01-04T18:10:32.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:30.980361+0000 mon.smithi050 (mon.0) 121 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:32.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:31.053992+0000 mon.smithi050 (mon.0) 122 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:32.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:31.055820+0000 mon.smithi050 (mon.0) 123 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:32.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:31.056248+0000 mon.smithi050 (mon.0) 124 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-01-04T18:10:32.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:31.058996+0000 mon.smithi050 (mon.0) 125 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:33.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:31.056696+0000 mgr.smithi050.emnywo (mgr.14162) 7 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-01-04T18:10:33.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:10:31.062376+0000 mgr.smithi050.emnywo (mgr.14162) 8 : cephadm [INF] Deploying daemon grafana.smithi050 on smithi050 2023-01-04T18:10:34.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:33.250999+0000 mgr.smithi050.emnywo (mgr.14162) 9 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:10:36.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:35.251244+0000 mgr.smithi050.emnywo (mgr.14162) 10 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:10:36.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.942+0000 7fe20252f700 1 -- 172.21.15.98:0/1596665141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1fc0f6510 msgr2=0x7fe1fc0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:36.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.942+0000 7fe20252f700 1 --2- 172.21.15.98:0/1596665141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1fc0f6510 0x7fe1fc0f6930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fe1e4009fb0 tx=0x7fe1e4009b30).stop 2023-01-04T18:10:36.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.942+0000 7fe20252f700 1 -- 172.21.15.98:0/1596665141 shutdown_connections 2023-01-04T18:10:36.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.942+0000 7fe20252f700 1 --2- 172.21.15.98:0/1596665141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1fc0f6510 0x7fe1fc0f6930 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:36.945 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.942+0000 7fe20252f700 1 -- 172.21.15.98:0/1596665141 >> 172.21.15.98:0/1596665141 conn(0x7fe1fc0f1c70 msgr2=0x7fe1fc0f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:36.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.942+0000 7fe20252f700 1 -- 172.21.15.98:0/1596665141 shutdown_connections 2023-01-04T18:10:36.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.942+0000 7fe20252f700 1 -- 172.21.15.98:0/1596665141 wait complete. 2023-01-04T18:10:36.946 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.942+0000 7fe20252f700 1 Processor -- start 2023-01-04T18:10:36.947 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.943+0000 7fe20252f700 1 -- start start 2023-01-04T18:10:36.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.943+0000 7fe20252f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1fc0f6510 0x7fe1fc106730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:36.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.943+0000 7fe20252f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc106c20 con 0x7fe1fc0f6510 2023-01-04T18:10:36.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.943+0000 7fe1fbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1fc0f6510 0x7fe1fc106730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:36.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.943+0000 7fe1fbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1fc0f6510 0x7fe1fc106730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.98:47130/0 (socket says 172.21.15.98:47130) 2023-01-04T18:10:36.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.943+0000 7fe1fbfff700 1 -- 172.21.15.98:0/162616343 learned_addr learned my addr 172.21.15.98:0/162616343 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-01-04T18:10:36.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.943+0000 7fe1fbfff700 1 -- 172.21.15.98:0/162616343 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e4005040 con 0x7fe1fc0f6510 2023-01-04T18:10:36.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.944+0000 7fe1fbfff700 1 --2- 172.21.15.98:0/162616343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1fc0f6510 0x7fe1fc106730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fe1e4014000 tx=0x7fe1e400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:36.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.944+0000 7fe1f8ff9700 1 -- 172.21.15.98:0/162616343 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe1e40095f0 con 0x7fe1fc0f6510 2023-01-04T18:10:36.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.944+0000 7fe20252f700 1 -- 172.21.15.98:0/162616343 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1fc106e20 con 0x7fe1fc0f6510 2023-01-04T18:10:36.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.944+0000 7fe1f8ff9700 1 -- 172.21.15.98:0/162616343 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe1e4007e70 con 0x7fe1fc0f6510 2023-01-04T18:10:36.948 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.944+0000 7fe1f8ff9700 1 -- 172.21.15.98:0/162616343 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe1e4014ea0 con 0x7fe1fc0f6510 2023-01-04T18:10:36.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.944+0000 7fe20252f700 1 -- 172.21.15.98:0/162616343 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1fc1072b0 con 0x7fe1fc0f6510 2023-01-04T18:10:36.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.945+0000 7fe1f8ff9700 1 -- 172.21.15.98:0/162616343 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fe1e40079c0 con 0x7fe1fc0f6510 2023-01-04T18:10:36.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.945+0000 7fe20252f700 1 -- 172.21.15.98:0/162616343 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1fc045ad0 con 0x7fe1fc0f6510 2023-01-04T18:10:36.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.945+0000 7fe1f8ff9700 1 --2- 172.21.15.98:0/162616343 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe1e802ff60 0x7fe1e8032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:36.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.945+0000 7fe1f8ff9700 1 -- 172.21.15.98:0/162616343 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7fe1e4040860 con 0x7fe1fc0f6510 2023-01-04T18:10:36.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.945+0000 7fe1fb7fe700 1 --2- 172.21.15.98:0/162616343 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe1e802ff60 0x7fe1e8032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:36.949 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.945+0000 7fe1fb7fe700 1 --2- 172.21.15.98:0/162616343 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe1e802ff60 0x7fe1e8032420 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fe1ec0096a0 tx=0x7fe1ec006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:36.952 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:36.950+0000 7fe1f8ff9700 1 -- 172.21.15.98:0/162616343 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe1e400f950 con 0x7fe1fc0f6510 2023-01-04T18:10:37.122 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:37.120+0000 7fe20252f700 1 -- 172.21.15.98:0/162616343 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi098", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1fc0f2e70 con 0x7fe1e802ff60 2023-01-04T18:10:37.824 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:37.820+0000 7fe1f8ff9700 1 -- 172.21.15.98:0/162616343 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+23 (secure 0 0 0) 0x7fe1fc0f2e70 con 0x7fe1e802ff60 2023-01-04T18:10:37.824 INFO:teuthology.orchestra.run.smithi098.stdout:Added host 'smithi098' 2023-01-04T18:10:37.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:37.822+0000 7fe20252f700 1 -- 172.21.15.98:0/162616343 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe1e802ff60 msgr2=0x7fe1e8032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:37.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:37.822+0000 7fe20252f700 1 --2- 172.21.15.98:0/162616343 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe1e802ff60 0x7fe1e8032420 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fe1ec0096a0 tx=0x7fe1ec006b40).stop 2023-01-04T18:10:37.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:37.822+0000 7fe20252f700 1 -- 172.21.15.98:0/162616343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1fc0f6510 msgr2=0x7fe1fc106730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:37.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:37.822+0000 7fe20252f700 1 --2- 172.21.15.98:0/162616343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1fc0f6510 0x7fe1fc106730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fe1e4014000 tx=0x7fe1e400b040).stop 2023-01-04T18:10:37.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:37.822+0000 7fe20252f700 1 -- 172.21.15.98:0/162616343 shutdown_connections 2023-01-04T18:10:37.825 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:37.822+0000 7fe20252f700 1 --2- 172.21.15.98:0/162616343 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe1e802ff60 0x7fe1e8032420 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:37.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:37.822+0000 7fe20252f700 1 --2- 172.21.15.98:0/162616343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1fc0f6510 0x7fe1fc106730 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:37.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:37.822+0000 7fe20252f700 1 -- 172.21.15.98:0/162616343 >> 172.21.15.98:0/162616343 conn(0x7fe1fc0f1c70 msgr2=0x7fe1fc0f2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:37.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:37.822+0000 7fe20252f700 1 -- 172.21.15.98:0/162616343 shutdown_connections 2023-01-04T18:10:37.826 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:37.822+0000 7fe20252f700 1 -- 172.21.15.98:0/162616343 wait complete. 2023-01-04T18:10:38.237 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph orch host ls --format=json 2023-01-04T18:10:38.936 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:37.121811+0000 mgr.smithi050.emnywo (mgr.14162) 11 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi098", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:10:38.937 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:37.251472+0000 mgr.smithi050.emnywo (mgr.14162) 12 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:10:38.937 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:37.820413+0000 mon.smithi050 (mon.0) 126 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:38.937 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:10:37.820828+0000 mgr.smithi050.emnywo (mgr.14162) 13 : cephadm [INF] Added host smithi098 2023-01-04T18:10:39.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.809+0000 7f5d7edfb700 1 -- 172.21.15.98:0/1491481866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d780f5410 msgr2=0x7f5d780f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:39.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.809+0000 7f5d7edfb700 1 --2- 172.21.15.98:0/1491481866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d780f5410 0x7f5d780f5830 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5d6c009fb0 tx=0x7f5d6c009b30).stop 2023-01-04T18:10:39.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.809+0000 7f5d7edfb700 1 -- 172.21.15.98:0/1491481866 shutdown_connections 2023-01-04T18:10:39.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.809+0000 7f5d7edfb700 1 --2- 172.21.15.98:0/1491481866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d780f5410 0x7f5d780f5830 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:39.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.809+0000 7f5d7edfb700 1 -- 172.21.15.98:0/1491481866 >> 172.21.15.98:0/1491481866 conn(0x7f5d780f0b70 msgr2=0x7f5d780f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:39.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.809+0000 7f5d7edfb700 1 -- 172.21.15.98:0/1491481866 shutdown_connections 2023-01-04T18:10:39.813 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.809+0000 7f5d7edfb700 1 -- 172.21.15.98:0/1491481866 wait complete. 2023-01-04T18:10:39.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.810+0000 7f5d7edfb700 1 Processor -- start 2023-01-04T18:10:39.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.810+0000 7f5d7edfb700 1 -- start start 2023-01-04T18:10:39.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.810+0000 7f5d7edfb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d780f5410 0x7f5d7810b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:39.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.810+0000 7f5d7edfb700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d78107240 con 0x7f5d780f5410 2023-01-04T18:10:39.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.810+0000 7f5d7cb97700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d780f5410 0x7f5d7810b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:39.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.810+0000 7f5d7cb97700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d780f5410 0x7f5d7810b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.98:47144/0 (socket says 172.21.15.98:47144) 2023-01-04T18:10:39.814 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.810+0000 7f5d7cb97700 1 -- 172.21.15.98:0/849906888 learned_addr learned my addr 172.21.15.98:0/849906888 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-01-04T18:10:39.815 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.811+0000 7f5d7cb97700 1 -- 172.21.15.98:0/849906888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c005040 con 0x7f5d780f5410 2023-01-04T18:10:39.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.811+0000 7f5d7cb97700 1 --2- 172.21.15.98:0/849906888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d780f5410 0x7f5d7810b850 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f5d6c013510 tx=0x7f5d6c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:39.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.811+0000 7f5d757fa700 1 -- 172.21.15.98:0/849906888 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d6c009320 con 0x7f5d780f5410 2023-01-04T18:10:39.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.811+0000 7f5d757fa700 1 -- 172.21.15.98:0/849906888 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5d6c013f00 con 0x7f5d780f5410 2023-01-04T18:10:39.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.811+0000 7f5d7edfb700 1 -- 172.21.15.98:0/849906888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d78060220 con 0x7f5d780f5410 2023-01-04T18:10:39.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.811+0000 7f5d757fa700 1 -- 172.21.15.98:0/849906888 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d6c014d90 con 0x7f5d780f5410 2023-01-04T18:10:39.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.811+0000 7f5d7edfb700 1 -- 172.21.15.98:0/849906888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7810bd40 con 0x7f5d780f5410 2023-01-04T18:10:39.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.812+0000 7f5d757fa700 1 -- 172.21.15.98:0/849906888 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f5d6c0263a0 con 0x7f5d780f5410 2023-01-04T18:10:39.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.812+0000 7f5d7edfb700 1 -- 172.21.15.98:0/849906888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d78045ad0 con 0x7f5d780f5410 2023-01-04T18:10:39.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.812+0000 7f5d757fa700 1 --2- 172.21.15.98:0/849906888 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f5d6802ff60 0x7f5d68032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:39.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.812+0000 7f5d757fa700 1 -- 172.21.15.98:0/849906888 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f5d6c0413b0 con 0x7f5d780f5410 2023-01-04T18:10:39.816 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.812+0000 7f5d77fff700 1 --2- 172.21.15.98:0/849906888 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f5d6802ff60 0x7f5d68032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:39.817 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.812+0000 7f5d77fff700 1 --2- 172.21.15.98:0/849906888 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f5d6802ff60 0x7f5d68032420 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f5d640096a0 tx=0x7f5d64006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:39.819 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.816+0000 7f5d757fa700 1 -- 172.21.15.98:0/849906888 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f5d6c012330 con 0x7f5d780f5410 2023-01-04T18:10:39.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.986+0000 7f5d7edfb700 1 -- 172.21.15.98:0/849906888 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5d780f1d70 con 0x7f5d6802ff60 2023-01-04T18:10:39.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.988+0000 7f5d757fa700 1 -- 172.21.15.98:0/849906888 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+156 (secure 0 0 0) 0x7f5d780f1d70 con 0x7f5d6802ff60 2023-01-04T18:10:39.991 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:10:39.991 INFO:teuthology.orchestra.run.smithi098.stdout:[{"addr": "172.21.15.50", "hostname": "smithi050", "labels": [], "status": ""}, {"addr": "smithi098", "hostname": "smithi098", "labels": [], "status": ""}] 2023-01-04T18:10:39.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.989+0000 7f5d7edfb700 1 -- 172.21.15.98:0/849906888 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f5d6802ff60 msgr2=0x7f5d68032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:39.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.989+0000 7f5d7edfb700 1 --2- 172.21.15.98:0/849906888 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f5d6802ff60 0x7f5d68032420 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f5d640096a0 tx=0x7f5d64006b40).stop 2023-01-04T18:10:39.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.989+0000 7f5d7edfb700 1 -- 172.21.15.98:0/849906888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d780f5410 msgr2=0x7f5d7810b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:39.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.989+0000 7f5d7edfb700 1 --2- 172.21.15.98:0/849906888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d780f5410 0x7f5d7810b850 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f5d6c013510 tx=0x7f5d6c00b040).stop 2023-01-04T18:10:39.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.989+0000 7f5d7edfb700 1 -- 172.21.15.98:0/849906888 shutdown_connections 2023-01-04T18:10:39.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.989+0000 7f5d7edfb700 1 --2- 172.21.15.98:0/849906888 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f5d6802ff60 0x7f5d68032420 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:39.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.989+0000 7f5d7edfb700 1 --2- 172.21.15.98:0/849906888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d780f5410 0x7f5d7810b850 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:39.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.989+0000 7f5d7edfb700 1 -- 172.21.15.98:0/849906888 >> 172.21.15.98:0/849906888 conn(0x7f5d780f0b70 msgr2=0x7f5d780f1660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:39.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.989+0000 7f5d7edfb700 1 -- 172.21.15.98:0/849906888 shutdown_connections 2023-01-04T18:10:39.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:39.989+0000 7f5d7edfb700 1 -- 172.21.15.98:0/849906888 wait complete. 2023-01-04T18:10:40.468 INFO:tasks.cephadm:Setting crush tunables to default 2023-01-04T18:10:40.468 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph osd crush tunables default 2023-01-04T18:10:41.092 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:39.251688+0000 mgr.smithi050.emnywo (mgr.14162) 14 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:10:41.092 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:39.988341+0000 mgr.smithi050.emnywo (mgr.14162) 15 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-01-04T18:10:42.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.266+0000 7fb609032700 1 -- 172.21.15.50:0/1570354187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6040f5410 msgr2=0x7fb6040f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:42.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.266+0000 7fb609032700 1 --2- 172.21.15.50:0/1570354187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6040f5410 0x7fb6040f5830 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fb5f4009fb0 tx=0x7fb5f4009b30).stop 2023-01-04T18:10:42.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.266+0000 7fb609032700 1 -- 172.21.15.50:0/1570354187 shutdown_connections 2023-01-04T18:10:42.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.266+0000 7fb609032700 1 --2- 172.21.15.50:0/1570354187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6040f5410 0x7fb6040f5830 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:42.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.266+0000 7fb609032700 1 -- 172.21.15.50:0/1570354187 >> 172.21.15.50:0/1570354187 conn(0x7fb6040f0b70 msgr2=0x7fb6040f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:42.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.267+0000 7fb609032700 1 -- 172.21.15.50:0/1570354187 shutdown_connections 2023-01-04T18:10:42.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.267+0000 7fb609032700 1 -- 172.21.15.50:0/1570354187 wait complete. 2023-01-04T18:10:42.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.267+0000 7fb609032700 1 Processor -- start 2023-01-04T18:10:42.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.267+0000 7fb609032700 1 -- start start 2023-01-04T18:10:42.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.268+0000 7fb609032700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6040f5410 0x7fb604107170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:42.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.268+0000 7fb609032700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6040602f0 con 0x7fb6040f5410 2023-01-04T18:10:42.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.268+0000 7fb602d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6040f5410 0x7fb604107170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:42.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.268+0000 7fb602d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6040f5410 0x7fb604107170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57796/0 (socket says 172.21.15.50:57796) 2023-01-04T18:10:42.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.268+0000 7fb602d9d700 1 -- 172.21.15.50:0/1825318045 learned_addr learned my addr 172.21.15.50:0/1825318045 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:10:42.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.268+0000 7fb602d9d700 1 -- 172.21.15.50:0/1825318045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f4005040 con 0x7fb6040f5410 2023-01-04T18:10:42.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.268+0000 7fb602d9d700 1 --2- 172.21.15.50:0/1825318045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6040f5410 0x7fb604107170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb5f4013510 tx=0x7fb5f400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:42.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.268+0000 7fb5eb7fe700 1 -- 172.21.15.50:0/1825318045 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb5f4009320 con 0x7fb6040f5410 2023-01-04T18:10:42.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.268+0000 7fb5eb7fe700 1 -- 172.21.15.50:0/1825318045 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb5f4013f00 con 0x7fb6040f5410 2023-01-04T18:10:42.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.268+0000 7fb5eb7fe700 1 -- 172.21.15.50:0/1825318045 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb5f4014d90 con 0x7fb6040f5410 2023-01-04T18:10:42.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.268+0000 7fb609032700 1 -- 172.21.15.50:0/1825318045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6040604f0 con 0x7fb6040f5410 2023-01-04T18:10:42.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.269+0000 7fb609032700 1 -- 172.21.15.50:0/1825318045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6041078a0 con 0x7fb6040f5410 2023-01-04T18:10:42.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.269+0000 7fb5eb7fe700 1 -- 172.21.15.50:0/1825318045 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fb5f40263a0 con 0x7fb6040f5410 2023-01-04T18:10:42.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.270+0000 7fb5eb7fe700 1 --2- 172.21.15.50:0/1825318045 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb5ec02ffb0 0x7fb5ec032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:42.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.270+0000 7fb5eb7fe700 1 -- 172.21.15.50:0/1825318045 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7fb5f40412a0 con 0x7fb6040f5410 2023-01-04T18:10:42.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.270+0000 7fb609032700 1 -- 172.21.15.50:0/1825318045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb604045ad0 con 0x7fb6040f5410 2023-01-04T18:10:42.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.270+0000 7fb60259c700 1 --2- 172.21.15.50:0/1825318045 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb5ec02ffb0 0x7fb5ec032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:42.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.270+0000 7fb60259c700 1 --2- 172.21.15.50:0/1825318045 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb5ec02ffb0 0x7fb5ec032470 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fb5f80096a0 tx=0x7fb5f8006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:42.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.278+0000 7fb5eb7fe700 1 -- 172.21.15.50:0/1825318045 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb5f4012920 con 0x7fb6040f5410 2023-01-04T18:10:42.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:41.227038+0000 mon.smithi050 (mon.0) 127 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:42.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:10:41.228972+0000 mgr.smithi050.emnywo (mgr.14162) 16 : cephadm [INF] Deploying daemon node-exporter.smithi050 on smithi050 2023-01-04T18:10:42.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:41.251951+0000 mgr.smithi050.emnywo (mgr.14162) 17 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:10:42.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:42.448+0000 7fb609032700 1 -- 172.21.15.50:0/1825318045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb604107fa0 con 0x7fb6040f5410 2023-01-04T18:10:43.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:43.231+0000 7fb5eb7fe700 1 -- 172.21.15.50:0/1825318045 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v5) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb5f402b070 con 0x7fb6040f5410 2023-01-04T18:10:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:43.233+0000 7fb609032700 1 -- 172.21.15.50:0/1825318045 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb5ec02ffb0 msgr2=0x7fb5ec032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:43.233+0000 7fb609032700 1 --2- 172.21.15.50:0/1825318045 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb5ec02ffb0 0x7fb5ec032470 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fb5f80096a0 tx=0x7fb5f8006b40).stop 2023-01-04T18:10:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:43.233+0000 7fb609032700 1 -- 172.21.15.50:0/1825318045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6040f5410 msgr2=0x7fb604107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:43.233+0000 7fb609032700 1 --2- 172.21.15.50:0/1825318045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6040f5410 0x7fb604107170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb5f4013510 tx=0x7fb5f400b040).stop 2023-01-04T18:10:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:43.233+0000 7fb609032700 1 -- 172.21.15.50:0/1825318045 shutdown_connections 2023-01-04T18:10:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:43.233+0000 7fb609032700 1 --2- 172.21.15.50:0/1825318045 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb5ec02ffb0 0x7fb5ec032470 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:43.233+0000 7fb609032700 1 --2- 172.21.15.50:0/1825318045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6040f5410 0x7fb604107170 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:43.233+0000 7fb609032700 1 -- 172.21.15.50:0/1825318045 >> 172.21.15.50:0/1825318045 conn(0x7fb6040f0b70 msgr2=0x7fb6040f1660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:43.233+0000 7fb609032700 1 -- 172.21.15.50:0/1825318045 shutdown_connections 2023-01-04T18:10:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:10:43.233+0000 7fb609032700 1 -- 172.21.15.50:0/1825318045 wait complete. 2023-01-04T18:10:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:adjusted tunables profile to default 2023-01-04T18:10:43.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:42.448965+0000 mon.smithi050 (mon.0) 128 : audit [INF] from='client.? 172.21.15.50:0/1825318045' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-01-04T18:10:44.007 INFO:tasks.cephadm:Adding mon.smithi050 on smithi050 2023-01-04T18:10:44.008 INFO:tasks.cephadm:Adding mon.smithi098 on smithi098 2023-01-04T18:10:44.008 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph orch apply mon '2;smithi050:172.21.15.50=smithi050;smithi098:172.21.15.98=smithi098' 2023-01-04T18:10:44.538 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:43.231859+0000 mon.smithi050 (mon.0) 129 : audit [INF] from='client.? 172.21.15.50:0/1825318045' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-01-04T18:10:44.538 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:43.231909+0000 mon.smithi050 (mon.0) 130 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2023-01-04T18:10:44.538 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:43.252218+0000 mgr.smithi050.emnywo (mgr.14162) 18 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:10:45.433 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.430+0000 7fcac4b36700 1 -- 172.21.15.98:0/3957931996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcac00f6a00 msgr2=0x7fcac00f6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:45.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.430+0000 7fcac4b36700 1 --2- 172.21.15.98:0/3957931996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcac00f6a00 0x7fcac00f6e20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fcab4009fb0 tx=0x7fcab4009b30).stop 2023-01-04T18:10:45.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.430+0000 7fcac4b36700 1 -- 172.21.15.98:0/3957931996 shutdown_connections 2023-01-04T18:10:45.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.430+0000 7fcac4b36700 1 --2- 172.21.15.98:0/3957931996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcac00f6a00 0x7fcac00f6e20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:45.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.430+0000 7fcac4b36700 1 -- 172.21.15.98:0/3957931996 >> 172.21.15.98:0/3957931996 conn(0x7fcac00f0260 msgr2=0x7fcac00f2680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:45.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.430+0000 7fcac4b36700 1 -- 172.21.15.98:0/3957931996 shutdown_connections 2023-01-04T18:10:45.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.430+0000 7fcac4b36700 1 -- 172.21.15.98:0/3957931996 wait complete. 2023-01-04T18:10:45.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.431+0000 7fcac4b36700 1 Processor -- start 2023-01-04T18:10:45.436 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.431+0000 7fcac4b36700 1 -- start start 2023-01-04T18:10:45.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.431+0000 7fcac4b36700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcac00f6a00 0x7fcac0109370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:45.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.431+0000 7fcac4b36700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00f52f0 con 0x7fcac00f6a00 2023-01-04T18:10:45.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.432+0000 7fcabe59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcac00f6a00 0x7fcac0109370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:45.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.432+0000 7fcabe59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcac00f6a00 0x7fcac0109370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.98:49730/0 (socket says 172.21.15.98:49730) 2023-01-04T18:10:45.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.432+0000 7fcabe59c700 1 -- 172.21.15.98:0/2106565395 learned_addr learned my addr 172.21.15.98:0/2106565395 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-01-04T18:10:45.437 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.432+0000 7fcabe59c700 1 -- 172.21.15.98:0/2106565395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab4005040 con 0x7fcac00f6a00 2023-01-04T18:10:45.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.432+0000 7fcabe59c700 1 --2- 172.21.15.98:0/2106565395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcac00f6a00 0x7fcac0109370 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fcab4013510 tx=0x7fcab400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:45.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.432+0000 7fcaaeffd700 1 -- 172.21.15.98:0/2106565395 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcab4009320 con 0x7fcac00f6a00 2023-01-04T18:10:45.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.432+0000 7fcac4b36700 1 -- 172.21.15.98:0/2106565395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac00f54f0 con 0x7fcac00f6a00 2023-01-04T18:10:45.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.432+0000 7fcaaeffd700 1 -- 172.21.15.98:0/2106565395 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcab4013f00 con 0x7fcac00f6a00 2023-01-04T18:10:45.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.432+0000 7fcaaeffd700 1 -- 172.21.15.98:0/2106565395 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcab4014dc0 con 0x7fcac00f6a00 2023-01-04T18:10:45.438 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.432+0000 7fcac4b36700 1 -- 172.21.15.98:0/2106565395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac0109aa0 con 0x7fcac00f6a00 2023-01-04T18:10:45.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.433+0000 7fcaaeffd700 1 -- 172.21.15.98:0/2106565395 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fcab4014420 con 0x7fcac00f6a00 2023-01-04T18:10:45.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.433+0000 7fcac4b36700 1 -- 172.21.15.98:0/2106565395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac0045ad0 con 0x7fcac00f6a00 2023-01-04T18:10:45.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.434+0000 7fcaaeffd700 1 --2- 172.21.15.98:0/2106565395 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fcaa802ff60 0x7fcaa8032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:45.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.434+0000 7fcaaeffd700 1 -- 172.21.15.98:0/2106565395 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7fcab4041050 con 0x7fcac00f6a00 2023-01-04T18:10:45.439 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.434+0000 7fcabdd9b700 1 --2- 172.21.15.98:0/2106565395 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fcaa802ff60 0x7fcaa8032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:45.440 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.434+0000 7fcabdd9b700 1 --2- 172.21.15.98:0/2106565395 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fcaa802ff60 0x7fcaa8032420 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fcab00096a0 tx=0x7fcab0006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:45.441 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.438+0000 7fcaaeffd700 1 -- 172.21.15.98:0/2106565395 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fcab40095f0 con 0x7fcac00f6a00 2023-01-04T18:10:45.616 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.614+0000 7fcac4b36700 1 -- 172.21.15.98:0/2106565395 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi050:172.21.15.50=smithi050;smithi098:172.21.15.98=smithi098", "target": ["mon-mgr", ""]}) v1 -- 0x7fcac00f1520 con 0x7fcaa802ff60 2023-01-04T18:10:45.622 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.619+0000 7fcaaeffd700 1 -- 172.21.15.98:0/2106565395 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fcac00f1520 con 0x7fcaa802ff60 2023-01-04T18:10:45.622 INFO:teuthology.orchestra.run.smithi098.stdout:Scheduled mon update... 2023-01-04T18:10:45.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.621+0000 7fcac4b36700 1 -- 172.21.15.98:0/2106565395 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fcaa802ff60 msgr2=0x7fcaa8032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:45.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.621+0000 7fcac4b36700 1 --2- 172.21.15.98:0/2106565395 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fcaa802ff60 0x7fcaa8032420 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fcab00096a0 tx=0x7fcab0006b40).stop 2023-01-04T18:10:45.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.621+0000 7fcac4b36700 1 -- 172.21.15.98:0/2106565395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcac00f6a00 msgr2=0x7fcac0109370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:45.623 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.621+0000 7fcac4b36700 1 --2- 172.21.15.98:0/2106565395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcac00f6a00 0x7fcac0109370 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fcab4013510 tx=0x7fcab400b040).stop 2023-01-04T18:10:45.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.621+0000 7fcac4b36700 1 -- 172.21.15.98:0/2106565395 shutdown_connections 2023-01-04T18:10:45.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.621+0000 7fcac4b36700 1 --2- 172.21.15.98:0/2106565395 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fcaa802ff60 0x7fcaa8032420 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:45.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.621+0000 7fcac4b36700 1 --2- 172.21.15.98:0/2106565395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcac00f6a00 0x7fcac0109370 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:45.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.621+0000 7fcac4b36700 1 -- 172.21.15.98:0/2106565395 >> 172.21.15.98:0/2106565395 conn(0x7fcac00f0260 msgr2=0x7fcac00f0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:45.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.621+0000 7fcac4b36700 1 -- 172.21.15.98:0/2106565395 shutdown_connections 2023-01-04T18:10:45.624 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:45.621+0000 7fcac4b36700 1 -- 172.21.15.98:0/2106565395 wait complete. 2023-01-04T18:10:46.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:44.699964+0000 mon.smithi050 (mon.0) 131 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:46.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:10:44.705327+0000 mgr.smithi050.emnywo (mgr.14162) 19 : cephadm [INF] Deploying daemon prometheus.smithi050 on smithi050 2023-01-04T18:10:46.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:45.619911+0000 mon.smithi050 (mon.0) 132 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:46.050 DEBUG:teuthology.orchestra.run.smithi098:mon.smithi098> sudo journalctl -f -n 0 -u ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mon.smithi098.service 2023-01-04T18:10:46.052 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-01-04T18:10:46.052 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph mon dump -f json 2023-01-04T18:10:46.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:-- Logs begin at Wed 2023-01-04 17:56:23 UTC. -- 2023-01-04T18:10:47.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:45.252550+0000 mgr.smithi050.emnywo (mgr.14162) 20 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:10:47.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:45.615958+0000 mgr.smithi050.emnywo (mgr.14162) 21 : audit [DBG] from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi050:172.21.15.50=smithi050;smithi098:172.21.15.98=smithi098", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:10:47.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:10:45.617256+0000 mgr.smithi050.emnywo (mgr.14162) 22 : cephadm [INF] Saving service mon spec with placement smithi050:172.21.15.50=smithi050;smithi098:172.21.15.98=smithi098;count:2 2023-01-04T18:10:47.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.641+0000 7f58aeded700 1 -- 172.21.15.98:0/2033544007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58a80f47c0 msgr2=0x7f58a80f4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:47.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.641+0000 7f58aeded700 1 --2- 172.21.15.98:0/2033544007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58a80f47c0 0x7f58a80f4be0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f58a0009960 tx=0x7f58a0004d10).stop 2023-01-04T18:10:47.645 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.641+0000 7f58aeded700 1 -- 172.21.15.98:0/2033544007 shutdown_connections 2023-01-04T18:10:47.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.641+0000 7f58aeded700 1 --2- 172.21.15.98:0/2033544007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58a80f47c0 0x7f58a80f4be0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:47.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.641+0000 7f58aeded700 1 -- 172.21.15.98:0/2033544007 >> 172.21.15.98:0/2033544007 conn(0x7f58a80f02e0 msgr2=0x7f58a80f2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:47.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.641+0000 7f58aeded700 1 -- 172.21.15.98:0/2033544007 shutdown_connections 2023-01-04T18:10:47.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.641+0000 7f58aeded700 1 -- 172.21.15.98:0/2033544007 wait complete. 2023-01-04T18:10:47.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.642+0000 7f58aeded700 1 Processor -- start 2023-01-04T18:10:47.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.642+0000 7f58aeded700 1 -- start start 2023-01-04T18:10:47.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.642+0000 7f58aeded700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58a80f47c0 0x7f58a8106750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:47.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.642+0000 7f58aeded700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a8106c40 con 0x7f58a80f47c0 2023-01-04T18:10:47.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.642+0000 7f58acb89700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58a80f47c0 0x7f58a8106750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:47.646 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.642+0000 7f58acb89700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58a80f47c0 0x7f58a8106750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.98:49752/0 (socket says 172.21.15.98:49752) 2023-01-04T18:10:47.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.642+0000 7f58acb89700 1 -- 172.21.15.98:0/61287891 learned_addr learned my addr 172.21.15.98:0/61287891 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-01-04T18:10:47.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.642+0000 7f58acb89700 1 -- 172.21.15.98:0/61287891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a0009640 con 0x7f58a80f47c0 2023-01-04T18:10:47.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.643+0000 7f58acb89700 1 --2- 172.21.15.98:0/61287891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58a80f47c0 0x7f58a8106750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f58a0004a10 tx=0x7f58a0004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:47.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.643+0000 7f58a57fa700 1 -- 172.21.15.98:0/61287891 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58a0018070 con 0x7f58a80f47c0 2023-01-04T18:10:47.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.643+0000 7f58a57fa700 1 -- 172.21.15.98:0/61287891 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f58a0007e70 con 0x7f58a80f47c0 2023-01-04T18:10:47.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.643+0000 7f58aeded700 1 -- 172.21.15.98:0/61287891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a8106e40 con 0x7f58a80f47c0 2023-01-04T18:10:47.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.643+0000 7f58a57fa700 1 -- 172.21.15.98:0/61287891 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58a001d420 con 0x7f58a80f47c0 2023-01-04T18:10:47.647 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.643+0000 7f58aeded700 1 -- 172.21.15.98:0/61287891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a81072d0 con 0x7f58a80f47c0 2023-01-04T18:10:47.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.643+0000 7f58a57fa700 1 -- 172.21.15.98:0/61287891 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f58a0013630 con 0x7f58a80f47c0 2023-01-04T18:10:47.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.644+0000 7f58a57fa700 1 --2- 172.21.15.98:0/61287891 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f589402ff60 0x7f5894032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:47.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.644+0000 7f58aeded700 1 -- 172.21.15.98:0/61287891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a8045ad0 con 0x7f58a80f47c0 2023-01-04T18:10:47.648 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.644+0000 7f58a57fa700 1 -- 172.21.15.98:0/61287891 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f58a0041640 con 0x7f58a80f47c0 2023-01-04T18:10:47.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.644+0000 7f58a7fff700 1 --2- 172.21.15.98:0/61287891 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f589402ff60 0x7f5894032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:47.649 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.644+0000 7f58a7fff700 1 --2- 172.21.15.98:0/61287891 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f589402ff60 0x7f5894032420 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f58900096a0 tx=0x7f5890006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:47.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.648+0000 7f58a57fa700 1 -- 172.21.15.98:0/61287891 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f58a001bb60 con 0x7f58a80f47c0 2023-01-04T18:10:47.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.852+0000 7f58aeded700 1 -- 172.21.15.98:0/61287891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f58a80fbf60 con 0x7f58a80f47c0 2023-01-04T18:10:47.855 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.853+0000 7f58a57fa700 1 -- 172.21.15.98:0/61287891 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f58a000b870 con 0x7f58a80f47c0 2023-01-04T18:10:47.856 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:10:47.856 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"d98671da-8c5a-11ed-821a-001a4aab830c","modified":"2023-01-04T18:09:13.702416Z","created":"2023-01-04T18:09:13.702416Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi050","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-01-04T18:10:47.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.854+0000 7f58aeded700 1 -- 172.21.15.98:0/61287891 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f589402ff60 msgr2=0x7f5894032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:47.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.854+0000 7f58aeded700 1 --2- 172.21.15.98:0/61287891 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f589402ff60 0x7f5894032420 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f58900096a0 tx=0x7f5890006b40).stop 2023-01-04T18:10:47.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.854+0000 7f58aeded700 1 -- 172.21.15.98:0/61287891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58a80f47c0 msgr2=0x7f58a8106750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:47.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.854+0000 7f58aeded700 1 --2- 172.21.15.98:0/61287891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58a80f47c0 0x7f58a8106750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f58a0004a10 tx=0x7f58a0004d10).stop 2023-01-04T18:10:47.857 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.855+0000 7f58aeded700 1 -- 172.21.15.98:0/61287891 shutdown_connections 2023-01-04T18:10:47.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.855+0000 7f58aeded700 1 --2- 172.21.15.98:0/61287891 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f589402ff60 0x7f5894032420 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:47.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.855+0000 7f58aeded700 1 --2- 172.21.15.98:0/61287891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58a80f47c0 0x7f58a8106750 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:47.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.855+0000 7f58aeded700 1 -- 172.21.15.98:0/61287891 >> 172.21.15.98:0/61287891 conn(0x7f58a80f02e0 msgr2=0x7f58a80f0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:47.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.855+0000 7f58aeded700 1 -- 172.21.15.98:0/61287891 shutdown_connections 2023-01-04T18:10:47.858 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:47.855+0000 7f58aeded700 1 -- 172.21.15.98:0/61287891 wait complete. 2023-01-04T18:10:47.858 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2023-01-04T18:10:49.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:47.252850+0000 mgr.smithi050.emnywo (mgr.14162) 23 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:10:49.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:47.853968+0000 mon.smithi050 (mon.0) 133 : audit [DBG] from='client.? 172.21.15.98:0/61287891' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-01-04T18:10:49.312 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-01-04T18:10:49.312 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph mon dump -f json 2023-01-04T18:10:50.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.768+0000 7f3972c9f700 1 -- 172.21.15.98:0/3129209709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396c0f5410 msgr2=0x7f396c0f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:50.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.768+0000 7f3972c9f700 1 --2- 172.21.15.98:0/3129209709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396c0f5410 0x7f396c0f5830 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f3960009fb0 tx=0x7f3960009b30).stop 2023-01-04T18:10:50.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.768+0000 7f3972c9f700 1 -- 172.21.15.98:0/3129209709 shutdown_connections 2023-01-04T18:10:50.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.768+0000 7f3972c9f700 1 --2- 172.21.15.98:0/3129209709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396c0f5410 0x7f396c0f5830 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:50.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.768+0000 7f3972c9f700 1 -- 172.21.15.98:0/3129209709 >> 172.21.15.98:0/3129209709 conn(0x7f396c0f0b70 msgr2=0x7f396c0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:50.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.768+0000 7f3972c9f700 1 -- 172.21.15.98:0/3129209709 shutdown_connections 2023-01-04T18:10:50.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.769+0000 7f3972c9f700 1 -- 172.21.15.98:0/3129209709 wait complete. 2023-01-04T18:10:50.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.769+0000 7f3972c9f700 1 Processor -- start 2023-01-04T18:10:50.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.769+0000 7f3972c9f700 1 -- start start 2023-01-04T18:10:50.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.769+0000 7f3972c9f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396c0f5410 0x7f396c1066d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:50.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.769+0000 7f3972c9f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c106bc0 con 0x7f396c0f5410 2023-01-04T18:10:50.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.770+0000 7f3970a3b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396c0f5410 0x7f396c1066d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:50.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.770+0000 7f3970a3b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396c0f5410 0x7f396c1066d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.98:49758/0 (socket says 172.21.15.98:49758) 2023-01-04T18:10:50.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.770+0000 7f3970a3b700 1 -- 172.21.15.98:0/3975291246 learned_addr learned my addr 172.21.15.98:0/3975291246 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-01-04T18:10:50.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.770+0000 7f3970a3b700 1 -- 172.21.15.98:0/3975291246 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3960005040 con 0x7f396c0f5410 2023-01-04T18:10:50.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.770+0000 7f3970a3b700 1 --2- 172.21.15.98:0/3975291246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396c0f5410 0x7f396c1066d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3960013510 tx=0x7f396000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:50.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.770+0000 7f39697fa700 1 -- 172.21.15.98:0/3975291246 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3960009320 con 0x7f396c0f5410 2023-01-04T18:10:50.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.770+0000 7f3972c9f700 1 -- 172.21.15.98:0/3975291246 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396c106dc0 con 0x7f396c0f5410 2023-01-04T18:10:50.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.770+0000 7f39697fa700 1 -- 172.21.15.98:0/3975291246 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3960013f00 con 0x7f396c0f5410 2023-01-04T18:10:50.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.770+0000 7f39697fa700 1 -- 172.21.15.98:0/3975291246 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3960014d90 con 0x7f396c0f5410 2023-01-04T18:10:50.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.770+0000 7f3972c9f700 1 -- 172.21.15.98:0/3975291246 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396c107250 con 0x7f396c0f5410 2023-01-04T18:10:50.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.771+0000 7f39697fa700 1 -- 172.21.15.98:0/3975291246 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f39600263a0 con 0x7f396c0f5410 2023-01-04T18:10:50.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.771+0000 7f3972c9f700 1 -- 172.21.15.98:0/3975291246 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396c045ad0 con 0x7f396c0f5410 2023-01-04T18:10:50.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.771+0000 7f39697fa700 1 --2- 172.21.15.98:0/3975291246 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f395c02ff60 0x7f395c032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:50.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.771+0000 7f39697fa700 1 -- 172.21.15.98:0/3975291246 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f39600413c0 con 0x7f396c0f5410 2023-01-04T18:10:50.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.772+0000 7f396bfff700 1 --2- 172.21.15.98:0/3975291246 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f395c02ff60 0x7f395c032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:50.776 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.772+0000 7f396bfff700 1 --2- 172.21.15.98:0/3975291246 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f395c02ff60 0x7f395c032420 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f39580096a0 tx=0x7f3958006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:50.778 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.776+0000 7f39697fa700 1 -- 172.21.15.98:0/3975291246 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f39600126f0 con 0x7f396c0f5410 2023-01-04T18:10:50.897 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:49.253260+0000 mgr.smithi050.emnywo (mgr.14162) 24 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:10:50.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.980+0000 7f3972c9f700 1 -- 172.21.15.98:0/3975291246 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f396c108100 con 0x7f396c0f5410 2023-01-04T18:10:50.983 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.981+0000 7f39697fa700 1 -- 172.21.15.98:0/3975291246 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f3960012330 con 0x7f396c0f5410 2023-01-04T18:10:50.984 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:10:50.984 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"d98671da-8c5a-11ed-821a-001a4aab830c","modified":"2023-01-04T18:09:13.702416Z","created":"2023-01-04T18:09:13.702416Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi050","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-01-04T18:10:50.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.982+0000 7f3972c9f700 1 -- 172.21.15.98:0/3975291246 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f395c02ff60 msgr2=0x7f395c032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:50.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.982+0000 7f3972c9f700 1 --2- 172.21.15.98:0/3975291246 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f395c02ff60 0x7f395c032420 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f39580096a0 tx=0x7f3958006b40).stop 2023-01-04T18:10:50.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.982+0000 7f3972c9f700 1 -- 172.21.15.98:0/3975291246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396c0f5410 msgr2=0x7f396c1066d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:50.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.982+0000 7f3972c9f700 1 --2- 172.21.15.98:0/3975291246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396c0f5410 0x7f396c1066d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3960013510 tx=0x7f396000b040).stop 2023-01-04T18:10:50.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.982+0000 7f3972c9f700 1 -- 172.21.15.98:0/3975291246 shutdown_connections 2023-01-04T18:10:50.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.982+0000 7f3972c9f700 1 --2- 172.21.15.98:0/3975291246 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f395c02ff60 0x7f395c032420 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:50.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.982+0000 7f3972c9f700 1 --2- 172.21.15.98:0/3975291246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396c0f5410 0x7f396c1066d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:50.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.982+0000 7f3972c9f700 1 -- 172.21.15.98:0/3975291246 >> 172.21.15.98:0/3975291246 conn(0x7f396c0f0b70 msgr2=0x7f396c0f1610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:50.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.982+0000 7f3972c9f700 1 -- 172.21.15.98:0/3975291246 shutdown_connections 2023-01-04T18:10:50.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:50.982+0000 7f3972c9f700 1 -- 172.21.15.98:0/3975291246 wait complete. 2023-01-04T18:10:50.986 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2023-01-04T18:10:51.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:50.981591+0000 mon.smithi050 (mon.0) 134 : audit [DBG] from='client.? 172.21.15.98:0/3975291246' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-01-04T18:10:52.443 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-01-04T18:10:52.443 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph mon dump -f json 2023-01-04T18:10:53.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:51.253539+0000 mgr.smithi050.emnywo (mgr.14162) 25 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:10:53.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:51.859215+0000 mon.smithi050 (mon.0) 135 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:53.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:51.859776+0000 mon.smithi050 (mon.0) 136 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:10:53.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:52.190938+0000 mon.smithi050 (mon.0) 137 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:53.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:52.644265+0000 mon.smithi050 (mon.0) 138 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:54.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.798+0000 7f40a5980700 1 -- 172.21.15.98:0/1113865474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40a00f6a10 msgr2=0x7f40a00f6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:54.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.798+0000 7f40a5980700 1 --2- 172.21.15.98:0/1113865474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40a00f6a10 0x7f40a00f6e30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f4090009fb0 tx=0x7f4090009b30).stop 2023-01-04T18:10:54.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.798+0000 7f40a5980700 1 -- 172.21.15.98:0/1113865474 shutdown_connections 2023-01-04T18:10:54.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.798+0000 7f40a5980700 1 --2- 172.21.15.98:0/1113865474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40a00f6a10 0x7f40a00f6e30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:54.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.798+0000 7f40a5980700 1 -- 172.21.15.98:0/1113865474 >> 172.21.15.98:0/1113865474 conn(0x7f40a00f02e0 msgr2=0x7f40a00f2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:54.802 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.799+0000 7f40a5980700 1 -- 172.21.15.98:0/1113865474 shutdown_connections 2023-01-04T18:10:54.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.799+0000 7f40a5980700 1 -- 172.21.15.98:0/1113865474 wait complete. 2023-01-04T18:10:54.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.799+0000 7f40a5980700 1 Processor -- start 2023-01-04T18:10:54.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.799+0000 7f40a5980700 1 -- start start 2023-01-04T18:10:54.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.799+0000 7f40a5980700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40a00f6a10 0x7f40a01093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:54.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.799+0000 7f40a5980700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a00f5330 con 0x7f40a00f6a10 2023-01-04T18:10:54.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.800+0000 7f409effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40a00f6a10 0x7f40a01093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:54.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.800+0000 7f409effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40a00f6a10 0x7f40a01093f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.98:38830/0 (socket says 172.21.15.98:38830) 2023-01-04T18:10:54.803 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.800+0000 7f409effd700 1 -- 172.21.15.98:0/2089576921 learned_addr learned my addr 172.21.15.98:0/2089576921 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-01-04T18:10:54.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.800+0000 7f409effd700 1 -- 172.21.15.98:0/2089576921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4090005040 con 0x7f40a00f6a10 2023-01-04T18:10:54.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.800+0000 7f409effd700 1 --2- 172.21.15.98:0/2089576921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40a00f6a10 0x7f40a01093f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4090013510 tx=0x7f409000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:54.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.800+0000 7f40877fe700 1 -- 172.21.15.98:0/2089576921 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4090009320 con 0x7f40a00f6a10 2023-01-04T18:10:54.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.800+0000 7f40877fe700 1 -- 172.21.15.98:0/2089576921 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4090013f00 con 0x7f40a00f6a10 2023-01-04T18:10:54.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.800+0000 7f40a5980700 1 -- 172.21.15.98:0/2089576921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a00f5530 con 0x7f40a00f6a10 2023-01-04T18:10:54.805 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.800+0000 7f40877fe700 1 -- 172.21.15.98:0/2089576921 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4090014d90 con 0x7f40a00f6a10 2023-01-04T18:10:54.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.800+0000 7f40a5980700 1 -- 172.21.15.98:0/2089576921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a0109aa0 con 0x7f40a00f6a10 2023-01-04T18:10:54.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.801+0000 7f40877fe700 1 -- 172.21.15.98:0/2089576921 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f40900263a0 con 0x7f40a00f6a10 2023-01-04T18:10:54.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.801+0000 7f40877fe700 1 --2- 172.21.15.98:0/2089576921 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f408802ff60 0x7f4088032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:54.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.801+0000 7f40877fe700 1 -- 172.21.15.98:0/2089576921 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f4090041050 con 0x7f40a00f6a10 2023-01-04T18:10:54.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.801+0000 7f40a5980700 1 -- 172.21.15.98:0/2089576921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a0059100 con 0x7f40a00f6a10 2023-01-04T18:10:54.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.801+0000 7f409e7fc700 1 --2- 172.21.15.98:0/2089576921 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f408802ff60 0x7f4088032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:54.806 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.802+0000 7f409e7fc700 1 --2- 172.21.15.98:0/2089576921 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f408802ff60 0x7f4088032420 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f40940096a0 tx=0x7f4094006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:54.808 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:54.806+0000 7f40877fe700 1 -- 172.21.15.98:0/2089576921 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4090012920 con 0x7f40a00f6a10 2023-01-04T18:10:55.025 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:55.023+0000 7f40a5980700 1 -- 172.21.15.98:0/2089576921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f40a010a0b0 con 0x7f40a00f6a10 2023-01-04T18:10:55.026 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:55.024+0000 7f40877fe700 1 -- 172.21.15.98:0/2089576921 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f409002b020 con 0x7f40a00f6a10 2023-01-04T18:10:55.026 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:10:55.027 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"d98671da-8c5a-11ed-821a-001a4aab830c","modified":"2023-01-04T18:09:13.702416Z","created":"2023-01-04T18:09:13.702416Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi050","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-01-04T18:10:55.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:55.025+0000 7f40a5980700 1 -- 172.21.15.98:0/2089576921 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f408802ff60 msgr2=0x7f4088032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:55.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:55.025+0000 7f40a5980700 1 --2- 172.21.15.98:0/2089576921 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f408802ff60 0x7f4088032420 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f40940096a0 tx=0x7f4094006b40).stop 2023-01-04T18:10:55.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:55.025+0000 7f40a5980700 1 -- 172.21.15.98:0/2089576921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40a00f6a10 msgr2=0x7f40a01093f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:55.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:55.025+0000 7f40a5980700 1 --2- 172.21.15.98:0/2089576921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40a00f6a10 0x7f40a01093f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4090013510 tx=0x7f409000b040).stop 2023-01-04T18:10:55.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:55.025+0000 7f40a5980700 1 -- 172.21.15.98:0/2089576921 shutdown_connections 2023-01-04T18:10:55.028 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:55.025+0000 7f40a5980700 1 --2- 172.21.15.98:0/2089576921 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f408802ff60 0x7f4088032420 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:55.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:55.025+0000 7f40a5980700 1 --2- 172.21.15.98:0/2089576921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40a00f6a10 0x7f40a01093f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:55.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:55.025+0000 7f40a5980700 1 -- 172.21.15.98:0/2089576921 >> 172.21.15.98:0/2089576921 conn(0x7f40a00f02e0 msgr2=0x7f40a00f0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:55.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:55.025+0000 7f40a5980700 1 -- 172.21.15.98:0/2089576921 shutdown_connections 2023-01-04T18:10:55.029 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:55.025+0000 7f40a5980700 1 -- 172.21.15.98:0/2089576921 wait complete. 2023-01-04T18:10:55.029 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2023-01-04T18:10:55.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:53.253751+0000 mgr.smithi050.emnywo (mgr.14162) 26 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:10:56.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:55.024620+0000 mon.smithi050 (mon.0) 139 : audit [DBG] from='client.? 172.21.15.98:0/2089576921' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-01-04T18:10:56.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:55.746302+0000 mon.smithi050 (mon.0) 140 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:56.563 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-01-04T18:10:56.564 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph mon dump -f json 2023-01-04T18:10:57.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:55.254006+0000 mgr.smithi050.emnywo (mgr.14162) 27 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:10:58.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.156+0000 7f71954c2700 1 -- 172.21.15.98:0/1146549610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71900f5410 msgr2=0x7f71900f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:58.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.156+0000 7f71954c2700 1 --2- 172.21.15.98:0/1146549610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71900f5410 0x7f71900f5830 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f7180009fb0 tx=0x7f7180009b30).stop 2023-01-04T18:10:58.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.156+0000 7f71954c2700 1 -- 172.21.15.98:0/1146549610 shutdown_connections 2023-01-04T18:10:58.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.156+0000 7f71954c2700 1 --2- 172.21.15.98:0/1146549610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71900f5410 0x7f71900f5830 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:58.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.156+0000 7f71954c2700 1 -- 172.21.15.98:0/1146549610 >> 172.21.15.98:0/1146549610 conn(0x7f71900f0b70 msgr2=0x7f71900f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:58.159 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.156+0000 7f71954c2700 1 -- 172.21.15.98:0/1146549610 shutdown_connections 2023-01-04T18:10:58.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.156+0000 7f71954c2700 1 -- 172.21.15.98:0/1146549610 wait complete. 2023-01-04T18:10:58.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.156+0000 7f71954c2700 1 Processor -- start 2023-01-04T18:10:58.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.156+0000 7f71954c2700 1 -- start start 2023-01-04T18:10:58.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.156+0000 7f71954c2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71900f5410 0x7f71901055d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:58.160 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.156+0000 7f71954c2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7190105ac0 con 0x7f71900f5410 2023-01-04T18:10:58.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.157+0000 7f718effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71900f5410 0x7f71901055d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:58.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.157+0000 7f718effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71900f5410 0x7f71901055d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.98:38844/0 (socket says 172.21.15.98:38844) 2023-01-04T18:10:58.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.157+0000 7f718effd700 1 -- 172.21.15.98:0/4124428038 learned_addr learned my addr 172.21.15.98:0/4124428038 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-01-04T18:10:58.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.157+0000 7f718effd700 1 -- 172.21.15.98:0/4124428038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7180005040 con 0x7f71900f5410 2023-01-04T18:10:58.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.157+0000 7f718effd700 1 --2- 172.21.15.98:0/4124428038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71900f5410 0x7f71901055d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f7180014000 tx=0x7f718000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:58.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.157+0000 7f71777fe700 1 -- 172.21.15.98:0/4124428038 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71800095f0 con 0x7f71900f5410 2023-01-04T18:10:58.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.157+0000 7f71777fe700 1 -- 172.21.15.98:0/4124428038 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7180007e70 con 0x7f71900f5410 2023-01-04T18:10:58.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.157+0000 7f71954c2700 1 -- 172.21.15.98:0/4124428038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7190105cc0 con 0x7f71900f5410 2023-01-04T18:10:58.162 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.157+0000 7f71777fe700 1 -- 172.21.15.98:0/4124428038 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7180014ea0 con 0x7f71900f5410 2023-01-04T18:10:58.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.158+0000 7f71954c2700 1 -- 172.21.15.98:0/4124428038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7190106150 con 0x7f71900f5410 2023-01-04T18:10:58.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.158+0000 7f71777fe700 1 -- 172.21.15.98:0/4124428038 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f71800079c0 con 0x7f71900f5410 2023-01-04T18:10:58.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.158+0000 7f71777fe700 1 --2- 172.21.15.98:0/4124428038 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f717802ffb0 0x7f7178032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:10:58.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.158+0000 7f71954c2700 1 -- 172.21.15.98:0/4124428038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7190045ad0 con 0x7f71900f5410 2023-01-04T18:10:58.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.158+0000 7f71777fe700 1 -- 172.21.15.98:0/4124428038 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f7180040820 con 0x7f71900f5410 2023-01-04T18:10:58.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.159+0000 7f718e7fc700 1 --2- 172.21.15.98:0/4124428038 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f717802ffb0 0x7f7178032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:10:58.163 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.159+0000 7f718e7fc700 1 --2- 172.21.15.98:0/4124428038 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f717802ffb0 0x7f7178032470 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f71840096a0 tx=0x7f7184006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:10:58.166 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.163+0000 7f71777fe700 1 -- 172.21.15.98:0/4124428038 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f718000f950 con 0x7f71900f5410 2023-01-04T18:10:58.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:56.955279+0000 mon.smithi050 (mon.0) 141 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:58.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:57.421262+0000 mon.smithi050 (mon.0) 142 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:58.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:57.423946+0000 mon.smithi050 (mon.0) 143 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:10:58.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:57.425135+0000 mon.smithi050 (mon.0) 144 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi098", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-01-04T18:10:58.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:57.427080+0000 mon.smithi050 (mon.0) 145 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi098", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-01-04T18:10:58.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:57.427941+0000 mon.smithi050 (mon.0) 146 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:10:58.391 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.389+0000 7f71954c2700 1 -- 172.21.15.98:0/4124428038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f71900fae60 con 0x7f71900f5410 2023-01-04T18:10:58.392 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.389+0000 7f71777fe700 1 -- 172.21.15.98:0/4124428038 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f7180010230 con 0x7f71900f5410 2023-01-04T18:10:58.392 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:10:58.393 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"d98671da-8c5a-11ed-821a-001a4aab830c","modified":"2023-01-04T18:09:13.702416Z","created":"2023-01-04T18:09:13.702416Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi050","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-01-04T18:10:58.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.391+0000 7f71954c2700 1 -- 172.21.15.98:0/4124428038 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f717802ffb0 msgr2=0x7f7178032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:58.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.391+0000 7f71954c2700 1 --2- 172.21.15.98:0/4124428038 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f717802ffb0 0x7f7178032470 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f71840096a0 tx=0x7f7184006b40).stop 2023-01-04T18:10:58.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.391+0000 7f71954c2700 1 -- 172.21.15.98:0/4124428038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71900f5410 msgr2=0x7f71901055d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:10:58.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.391+0000 7f71954c2700 1 --2- 172.21.15.98:0/4124428038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71900f5410 0x7f71901055d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f7180014000 tx=0x7f718000b040).stop 2023-01-04T18:10:58.394 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.391+0000 7f71954c2700 1 -- 172.21.15.98:0/4124428038 shutdown_connections 2023-01-04T18:10:58.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.391+0000 7f71954c2700 1 --2- 172.21.15.98:0/4124428038 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f717802ffb0 0x7f7178032470 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:58.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.391+0000 7f71954c2700 1 --2- 172.21.15.98:0/4124428038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71900f5410 0x7f71901055d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:10:58.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.391+0000 7f71954c2700 1 -- 172.21.15.98:0/4124428038 >> 172.21.15.98:0/4124428038 conn(0x7f71900f0b70 msgr2=0x7f71900f1610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:10:58.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.391+0000 7f71954c2700 1 -- 172.21.15.98:0/4124428038 shutdown_connections 2023-01-04T18:10:58.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:10:58.391+0000 7f71954c2700 1 -- 172.21.15.98:0/4124428038 wait complete. 2023-01-04T18:10:58.395 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2023-01-04T18:10:59.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:57.254332+0000 mgr.smithi050.emnywo (mgr.14162) 28 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:10:59.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:10:57.428835+0000 mgr.smithi050.emnywo (mgr.14162) 29 : cephadm [INF] Deploying daemon crash.smithi098 on smithi098 2023-01-04T18:10:59.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:10:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:10:58.390438+0000 mon.smithi050 (mon.0) 147 : audit [DBG] from='client.? 172.21.15.98:0/4124428038' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-01-04T18:11:00.118 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-01-04T18:11:00.119 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph mon dump -f json 2023-01-04T18:11:01.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:10:59.254548+0000 mgr.smithi050.emnywo (mgr.14162) 30 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:03.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:01.254877+0000 mgr.smithi050.emnywo (mgr.14162) 31 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:03.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:02.238828+0000 mon.smithi050 (mon.0) 148 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:03.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:02.240191+0000 mon.smithi050 (mon.0) 149 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.vhfzum", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-01-04T18:11:03.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:02.242175+0000 mon.smithi050 (mon.0) 150 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.vhfzum", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-01-04T18:11:03.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:02.243066+0000 mon.smithi050 (mon.0) 151 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-01-04T18:11:03.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:02.244086+0000 mon.smithi050 (mon.0) 152 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:11:04.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:02.244823+0000 mgr.smithi050.emnywo (mgr.14162) 32 : cephadm [INF] Deploying daemon mgr.smithi098.vhfzum on smithi098 2023-01-04T18:11:05.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:03.255234+0000 mgr.smithi050.emnywo (mgr.14162) 33 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:06.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:05.255506+0000 mgr.smithi050.emnywo (mgr.14162) 34 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:08.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:07.255756+0000 mgr.smithi050.emnywo (mgr.14162) 35 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:09.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.395+0000 7fe536f8c700 1 -- 172.21.15.98:0/2233561722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300f6510 msgr2=0x7fe5300f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:11:09.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.395+0000 7fe536f8c700 1 --2- 172.21.15.98:0/2233561722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300f6510 0x7fe5300f6930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fe524009fb0 tx=0x7fe524009b30).stop 2023-01-04T18:11:09.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.395+0000 7fe536f8c700 1 -- 172.21.15.98:0/2233561722 shutdown_connections 2023-01-04T18:11:09.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.395+0000 7fe536f8c700 1 --2- 172.21.15.98:0/2233561722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300f6510 0x7fe5300f6930 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:09.637 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.395+0000 7fe536f8c700 1 -- 172.21.15.98:0/2233561722 >> 172.21.15.98:0/2233561722 conn(0x7fe5300f1c70 msgr2=0x7fe5300f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:11:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.395+0000 7fe536f8c700 1 -- 172.21.15.98:0/2233561722 shutdown_connections 2023-01-04T18:11:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.395+0000 7fe536f8c700 1 -- 172.21.15.98:0/2233561722 wait complete. 2023-01-04T18:11:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.396+0000 7fe536f8c700 1 Processor -- start 2023-01-04T18:11:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.396+0000 7fe536f8c700 1 -- start start 2023-01-04T18:11:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.396+0000 7fe536f8c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300f6510 0x7fe5301066d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:11:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.396+0000 7fe536f8c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe530106bc0 con 0x7fe5300f6510 2023-01-04T18:11:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.396+0000 7fe534d28700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300f6510 0x7fe5301066d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:11:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.396+0000 7fe534d28700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300f6510 0x7fe5301066d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.98:60958/0 (socket says 172.21.15.98:60958) 2023-01-04T18:11:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.396+0000 7fe534d28700 1 -- 172.21.15.98:0/2478138228 learned_addr learned my addr 172.21.15.98:0/2478138228 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-01-04T18:11:09.638 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.397+0000 7fe534d28700 1 -- 172.21.15.98:0/2478138228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe524005040 con 0x7fe5300f6510 2023-01-04T18:11:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.397+0000 7fe534d28700 1 --2- 172.21.15.98:0/2478138228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300f6510 0x7fe5301066d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fe524013510 tx=0x7fe52400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:11:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.397+0000 7fe52d7fa700 1 -- 172.21.15.98:0/2478138228 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe524009320 con 0x7fe5300f6510 2023-01-04T18:11:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.397+0000 7fe52d7fa700 1 -- 172.21.15.98:0/2478138228 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe524013f00 con 0x7fe5300f6510 2023-01-04T18:11:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.397+0000 7fe536f8c700 1 -- 172.21.15.98:0/2478138228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe530106dc0 con 0x7fe5300f6510 2023-01-04T18:11:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.397+0000 7fe52d7fa700 1 -- 172.21.15.98:0/2478138228 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe524014d90 con 0x7fe5300f6510 2023-01-04T18:11:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.397+0000 7fe536f8c700 1 -- 172.21.15.98:0/2478138228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe530107250 con 0x7fe5300f6510 2023-01-04T18:11:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.398+0000 7fe52d7fa700 1 -- 172.21.15.98:0/2478138228 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fe5240095f0 con 0x7fe5300f6510 2023-01-04T18:11:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.398+0000 7fe536f8c700 1 -- 172.21.15.98:0/2478138228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe530045ad0 con 0x7fe5300f6510 2023-01-04T18:11:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.398+0000 7fe52d7fa700 1 --2- 172.21.15.98:0/2478138228 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe52002ff60 0x7fe520032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:11:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.398+0000 7fe52d7fa700 1 -- 172.21.15.98:0/2478138228 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7fe524041000 con 0x7fe5300f6510 2023-01-04T18:11:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.398+0000 7fe52ffff700 1 --2- 172.21.15.98:0/2478138228 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe52002ff60 0x7fe520032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:11:09.639 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.399+0000 7fe52ffff700 1 --2- 172.21.15.98:0/2478138228 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe52002ff60 0x7fe520032420 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fe51c0096a0 tx=0x7fe51c006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:11:09.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.403+0000 7fe52d7fa700 1 -- 172.21.15.98:0/2478138228 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe524014420 con 0x7fe5300f6510 2023-01-04T18:11:09.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.607+0000 7fe536f8c700 1 -- 172.21.15.98:0/2478138228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe530108100 con 0x7fe5300f6510 2023-01-04T18:11:09.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.607+0000 7fe52d7fa700 1 -- 172.21.15.98:0/2478138228 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7fe524010230 con 0x7fe5300f6510 2023-01-04T18:11:09.640 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:11:09.640 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"d98671da-8c5a-11ed-821a-001a4aab830c","modified":"2023-01-04T18:09:13.702416Z","created":"2023-01-04T18:09:13.702416Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi050","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-01-04T18:11:09.640 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.609+0000 7fe536f8c700 1 -- 172.21.15.98:0/2478138228 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe52002ff60 msgr2=0x7fe520032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:11:09.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.609+0000 7fe536f8c700 1 --2- 172.21.15.98:0/2478138228 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe52002ff60 0x7fe520032420 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fe51c0096a0 tx=0x7fe51c006b40).stop 2023-01-04T18:11:09.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.609+0000 7fe536f8c700 1 -- 172.21.15.98:0/2478138228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300f6510 msgr2=0x7fe5301066d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:11:09.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.609+0000 7fe536f8c700 1 --2- 172.21.15.98:0/2478138228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300f6510 0x7fe5301066d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fe524013510 tx=0x7fe52400b040).stop 2023-01-04T18:11:09.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.609+0000 7fe536f8c700 1 -- 172.21.15.98:0/2478138228 shutdown_connections 2023-01-04T18:11:09.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.609+0000 7fe536f8c700 1 --2- 172.21.15.98:0/2478138228 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe52002ff60 0x7fe520032420 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:09.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.609+0000 7fe536f8c700 1 --2- 172.21.15.98:0/2478138228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5300f6510 0x7fe5301066d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:09.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.609+0000 7fe536f8c700 1 -- 172.21.15.98:0/2478138228 >> 172.21.15.98:0/2478138228 conn(0x7fe5300f1c70 msgr2=0x7fe5300f2710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:11:09.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.609+0000 7fe536f8c700 1 -- 172.21.15.98:0/2478138228 shutdown_connections 2023-01-04T18:11:09.641 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:09.609+0000 7fe536f8c700 1 -- 172.21.15.98:0/2478138228 wait complete. 2023-01-04T18:11:09.641 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2023-01-04T18:11:10.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:09.256128+0000 mgr.smithi050.emnywo (mgr.14162) 36 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:10.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:09.608229+0000 mon.smithi050 (mon.0) 153 : audit [DBG] from='client.? 172.21.15.98:0/2478138228' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-01-04T18:11:11.389 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-01-04T18:11:11.390 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph mon dump -f json 2023-01-04T18:11:12.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:11.118863+0000 mon.smithi050 (mon.0) 154 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:12.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:11.120065+0000 mon.smithi050 (mon.0) 155 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-01-04T18:11:12.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:11.120984+0000 mon.smithi050 (mon.0) 156 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:11:12.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:11.121798+0000 mgr.smithi050.emnywo (mgr.14162) 37 : cephadm [INF] Deploying daemon mon.smithi098 on smithi098 2023-01-04T18:11:12.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:11.256545+0000 mgr.smithi050.emnywo (mgr.14162) 38 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:13.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.661+0000 7feb84ba8700 1 -- 172.21.15.98:0/4186899384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb800601e0 msgr2=0x7feb800f8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:11:13.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.661+0000 7feb84ba8700 1 --2- 172.21.15.98:0/4186899384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb800601e0 0x7feb800f8f20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7feb70009fb0 tx=0x7feb70009b30).stop 2023-01-04T18:11:13.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.662+0000 7feb84ba8700 1 -- 172.21.15.98:0/4186899384 shutdown_connections 2023-01-04T18:11:13.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.662+0000 7feb84ba8700 1 --2- 172.21.15.98:0/4186899384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb800601e0 0x7feb800f8f20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:13.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.662+0000 7feb84ba8700 1 -- 172.21.15.98:0/4186899384 >> 172.21.15.98:0/4186899384 conn(0x7feb800f09a0 msgr2=0x7feb800f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:11:13.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.662+0000 7feb84ba8700 1 -- 172.21.15.98:0/4186899384 shutdown_connections 2023-01-04T18:11:13.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.662+0000 7feb84ba8700 1 -- 172.21.15.98:0/4186899384 wait complete. 2023-01-04T18:11:13.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.662+0000 7feb84ba8700 1 Processor -- start 2023-01-04T18:11:13.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.662+0000 7feb84ba8700 1 -- start start 2023-01-04T18:11:13.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.662+0000 7feb84ba8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb800601e0 0x7feb80106500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:11:13.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.662+0000 7feb84ba8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb801069f0 con 0x7feb800601e0 2023-01-04T18:11:13.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.663+0000 7feb7f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb800601e0 0x7feb80106500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:11:13.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.663+0000 7feb7f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb800601e0 0x7feb80106500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.98:36768/0 (socket says 172.21.15.98:36768) 2023-01-04T18:11:13.667 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.663+0000 7feb7f7fe700 1 -- 172.21.15.98:0/2148908662 learned_addr learned my addr 172.21.15.98:0/2148908662 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-01-04T18:11:13.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.663+0000 7feb7f7fe700 1 -- 172.21.15.98:0/2148908662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb70005040 con 0x7feb800601e0 2023-01-04T18:11:13.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.663+0000 7feb7f7fe700 1 --2- 172.21.15.98:0/2148908662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb800601e0 0x7feb80106500 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7feb70013510 tx=0x7feb7000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:11:13.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.663+0000 7feb67fff700 1 -- 172.21.15.98:0/2148908662 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb70009320 con 0x7feb800601e0 2023-01-04T18:11:13.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.664+0000 7feb84ba8700 1 -- 172.21.15.98:0/2148908662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb80106bf0 con 0x7feb800601e0 2023-01-04T18:11:13.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.664+0000 7feb67fff700 1 -- 172.21.15.98:0/2148908662 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feb70013f00 con 0x7feb800601e0 2023-01-04T18:11:13.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.664+0000 7feb67fff700 1 -- 172.21.15.98:0/2148908662 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb70014d90 con 0x7feb800601e0 2023-01-04T18:11:13.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.664+0000 7feb84ba8700 1 -- 172.21.15.98:0/2148908662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb80107080 con 0x7feb800601e0 2023-01-04T18:11:13.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.664+0000 7feb67fff700 1 -- 172.21.15.98:0/2148908662 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7feb700263a0 con 0x7feb800601e0 2023-01-04T18:11:13.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.664+0000 7feb67fff700 1 --2- 172.21.15.98:0/2148908662 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7feb6802ff60 0x7feb68032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:11:13.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.664+0000 7feb84ba8700 1 -- 172.21.15.98:0/2148908662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb80045ad0 con 0x7feb800601e0 2023-01-04T18:11:13.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.665+0000 7feb67fff700 1 -- 172.21.15.98:0/2148908662 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7feb70041090 con 0x7feb800601e0 2023-01-04T18:11:13.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.665+0000 7feb7effd700 1 --2- 172.21.15.98:0/2148908662 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7feb6802ff60 0x7feb68032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:11:13.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.665+0000 7feb7effd700 1 --2- 172.21.15.98:0/2148908662 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7feb6802ff60 0x7feb68032420 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7feb740096a0 tx=0x7feb74006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:11:13.672 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.669+0000 7feb67fff700 1 -- 172.21.15.98:0/2148908662 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7feb70012920 con 0x7feb800601e0 2023-01-04T18:11:13.890 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.887+0000 7feb84ba8700 1 -- 172.21.15.98:0/2148908662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7feb80107f30 con 0x7feb800601e0 2023-01-04T18:11:13.891 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.888+0000 7feb67fff700 1 -- 172.21.15.98:0/2148908662 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7feb7002b020 con 0x7feb800601e0 2023-01-04T18:11:13.891 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:11:13.891 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"d98671da-8c5a-11ed-821a-001a4aab830c","modified":"2023-01-04T18:09:13.702416Z","created":"2023-01-04T18:09:13.702416Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi050","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-01-04T18:11:13.892 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.890+0000 7feb84ba8700 1 -- 172.21.15.98:0/2148908662 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7feb6802ff60 msgr2=0x7feb68032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:11:13.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.890+0000 7feb84ba8700 1 --2- 172.21.15.98:0/2148908662 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7feb6802ff60 0x7feb68032420 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7feb740096a0 tx=0x7feb74006b40).stop 2023-01-04T18:11:13.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.890+0000 7feb84ba8700 1 -- 172.21.15.98:0/2148908662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb800601e0 msgr2=0x7feb80106500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:11:13.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.890+0000 7feb84ba8700 1 --2- 172.21.15.98:0/2148908662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb800601e0 0x7feb80106500 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7feb70013510 tx=0x7feb7000b040).stop 2023-01-04T18:11:13.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.890+0000 7feb84ba8700 1 -- 172.21.15.98:0/2148908662 shutdown_connections 2023-01-04T18:11:13.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.890+0000 7feb84ba8700 1 --2- 172.21.15.98:0/2148908662 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7feb6802ff60 0x7feb68032420 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:13.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.890+0000 7feb84ba8700 1 --2- 172.21.15.98:0/2148908662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb800601e0 0x7feb80106500 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:13.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.890+0000 7feb84ba8700 1 -- 172.21.15.98:0/2148908662 >> 172.21.15.98:0/2148908662 conn(0x7feb800f09a0 msgr2=0x7feb800f1420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:11:13.893 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.890+0000 7feb84ba8700 1 -- 172.21.15.98:0/2148908662 shutdown_connections 2023-01-04T18:11:13.894 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:13.890+0000 7feb84ba8700 1 -- 172.21.15.98:0/2148908662 wait complete. 2023-01-04T18:11:13.894 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2023-01-04T18:11:14.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 systemd[1]: Starting Ceph mon.smithi098 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:11:14.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:13.256858+0000 mgr.smithi050.emnywo (mgr.14162) 39 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:14.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:13.398929+0000 mon.smithi050 (mon.0) 157 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:11:14.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:13.401461+0000 mon.smithi050 (mon.0) 158 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:11:14.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:13.889084+0000 mon.smithi050 (mon.0) 159 : audit [DBG] from='client.? 172.21.15.98:0/2148908662' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-01-04T18:11:14.941 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 podman[104693]: 2023-01-04T18:11:14.941 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.873+0000 7f143ff71700 0 set uid:gid to 167:167 (ceph:ceph) 2023-01-04T18:11:14.941 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.873+0000 7f143ff71700 0 ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable), process ceph-mon, pid 7 2023-01-04T18:11:14.942 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.873+0000 7f143ff71700 0 pidfile_write: ignore empty --pid-file 2023-01-04T18:11:14.942 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.877+0000 7f143ff71700 0 load: jerasure load: lrc load: isa 2023-01-04T18:11:14.942 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.877+0000 7f143ff71700 4 rocksdb: RocksDB version: 6.8.1 2023-01-04T18:11:14.942 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: 2023-01-04T18:11:14.942 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.877+0000 7f143ff71700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-01-04T18:11:14.942 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.877+0000 7f143ff71700 4 rocksdb: Compile date May 13 2021 2023-01-04T18:11:14.942 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.877+0000 7f143ff71700 4 rocksdb: DB SUMMARY 2023-01-04T18:11:14.942 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: 2023-01-04T18:11:14.942 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.877+0000 7f143ff71700 4 rocksdb: CURRENT file: CURRENT 2023-01-04T18:11:14.942 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: 2023-01-04T18:11:14.942 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.877+0000 7f143ff71700 4 rocksdb: IDENTITY file: IDENTITY 2023-01-04T18:11:14.943 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: 2023-01-04T18:11:14.943 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.877+0000 7f143ff71700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2023-01-04T18:11:14.943 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: 2023-01-04T18:11:14.943 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi098/store.db dir, Total Num: 0, files: 2023-01-04T18:11:14.943 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: 2023-01-04T18:11:14.943 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi098/store.db: 000003.log size: 511 ; 2023-01-04T18:11:14.943 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: 2023-01-04T18:11:14.943 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.error_if_exists: 0 2023-01-04T18:11:14.943 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.create_if_missing: 0 2023-01-04T18:11:14.943 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.paranoid_checks: 1 2023-01-04T18:11:14.943 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.env: 0x557dadae21c0 2023-01-04T18:11:14.943 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.fs: Posix File System 2023-01-04T18:11:14.944 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.info_log: 0x557dae8e5960 2023-01-04T18:11:14.944 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_file_opening_threads: 16 2023-01-04T18:11:14.944 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.statistics: (nil) 2023-01-04T18:11:14.944 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.use_fsync: 0 2023-01-04T18:11:14.944 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_log_file_size: 0 2023-01-04T18:11:14.944 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-01-04T18:11:14.944 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.log_file_time_to_roll: 0 2023-01-04T18:11:14.944 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.keep_log_file_num: 1000 2023-01-04T18:11:14.944 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.recycle_log_file_num: 0 2023-01-04T18:11:14.944 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.allow_fallocate: 1 2023-01-04T18:11:14.944 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.allow_mmap_reads: 0 2023-01-04T18:11:14.945 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.allow_mmap_writes: 0 2023-01-04T18:11:14.945 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.use_direct_reads: 0 2023-01-04T18:11:14.945 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-01-04T18:11:14.945 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.create_missing_column_families: 0 2023-01-04T18:11:14.945 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.db_log_dir: 2023-01-04T18:11:14.945 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi098/store.db 2023-01-04T18:11:14.945 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.table_cache_numshardbits: 6 2023-01-04T18:11:14.945 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_subcompactions: 1 2023-01-04T18:11:14.946 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_background_flushes: -1 2023-01-04T18:11:14.946 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-01-04T18:11:14.946 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-01-04T18:11:14.946 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-01-04T18:11:14.947 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-01-04T18:11:14.947 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-01-04T18:11:14.947 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.advise_random_on_open: 1 2023-01-04T18:11:14.947 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.db_write_buffer_size: 0 2023-01-04T18:11:14.947 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.write_buffer_manager: 0x557daf55a030 2023-01-04T18:11:14.947 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-01-04T18:11:14.947 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-01-04T18:11:14.947 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-01-04T18:11:14.947 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.use_adaptive_mutex: 0 2023-01-04T18:11:14.947 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.rate_limiter: (nil) 2023-01-04T18:11:14.947 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-01-04T18:11:14.948 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.wal_recovery_mode: 2 2023-01-04T18:11:14.948 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.enable_thread_tracking: 0 2023-01-04T18:11:14.948 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.enable_pipelined_write: 0 2023-01-04T18:11:14.948 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.unordered_write: 0 2023-01-04T18:11:14.948 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-01-04T18:11:14.948 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-01-04T18:11:14.948 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-01-04T18:11:14.948 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-01-04T18:11:14.948 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.row_cache: None 2023-01-04T18:11:14.948 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.wal_filter: None 2023-01-04T18:11:14.948 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-01-04T18:11:14.948 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.allow_ingest_behind: 0 2023-01-04T18:11:14.949 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.preserve_deletes: 0 2023-01-04T18:11:14.949 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.two_write_queues: 0 2023-01-04T18:11:14.949 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.manual_wal_flush: 0 2023-01-04T18:11:14.949 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.atomic_flush: 0 2023-01-04T18:11:14.949 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-01-04T18:11:14.949 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.persist_stats_to_disk: 0 2023-01-04T18:11:14.949 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.write_dbid_to_manifest: 0 2023-01-04T18:11:14.949 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.log_readahead_size: 0 2023-01-04T18:11:14.949 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2023-01-04T18:11:14.949 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_background_jobs: 2 2023-01-04T18:11:14.949 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_background_compactions: -1 2023-01-04T18:11:14.949 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-01-04T18:11:14.950 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-01-04T18:11:14.950 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.delayed_write_rate : 16777216 2023-01-04T18:11:14.950 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_total_wal_size: 0 2023-01-04T18:11:14.950 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-01-04T18:11:14.950 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.stats_dump_period_sec: 600 2023-01-04T18:11:14.950 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.stats_persist_period_sec: 600 2023-01-04T18:11:14.950 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-01-04T18:11:14.950 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_open_files: -1 2023-01-04T18:11:14.950 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.bytes_per_sync: 0 2023-01-04T18:11:14.950 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-01-04T18:11:14.950 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.strict_bytes_per_sync: 0 2023-01-04T18:11:14.951 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.compaction_readahead_size: 0 2023-01-04T18:11:14.951 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Compression algorithms supported: 2023-01-04T18:11:14.951 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-01-04T18:11:14.951 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: kZSTD supported: 0 2023-01-04T18:11:14.951 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: kXpressCompression supported: 0 2023-01-04T18:11:14.951 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: kLZ4HCCompression supported: 1 2023-01-04T18:11:14.951 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: kLZ4Compression supported: 1 2023-01-04T18:11:14.951 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: kBZip2Compression supported: 0 2023-01-04T18:11:14.951 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: kZlibCompression supported: 1 2023-01-04T18:11:14.951 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: kSnappyCompression supported: 1 2023-01-04T18:11:14.951 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-01-04T18:11:14.951 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi098/store.db/MANIFEST-000001 2023-01-04T18:11:14.952 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: 2023-01-04T18:11:14.952 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2023-01-04T18:11:14.952 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: 2023-01-04T18:11:14.952 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-01-04T18:11:14.952 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.merge_operator: 2023-01-04T18:11:14.952 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.compaction_filter: None 2023-01-04T18:11:14.952 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.compaction_filter_factory: None 2023-01-04T18:11:14.952 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-01-04T18:11:14.952 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.table_factory: BlockBasedTable 2023-01-04T18:11:14.952 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557dae7fc128) 2023-01-04T18:11:14.952 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cache_index_and_filter_blocks: 1 2023-01-04T18:11:14.953 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cache_index_and_filter_blocks_with_high_priority: 0 2023-01-04T18:11:14.953 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: pin_l0_filter_and_index_blocks_in_cache: 0 2023-01-04T18:11:14.953 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: pin_top_level_index_and_filter: 1 2023-01-04T18:11:14.953 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: index_type: 0 2023-01-04T18:11:14.953 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: data_block_index_type: 0 2023-01-04T18:11:14.953 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: index_shortening: 1 2023-01-04T18:11:14.953 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: data_block_hash_table_util_ratio: 0.750000 2023-01-04T18:11:14.953 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: hash_index_allow_collision: 1 2023-01-04T18:11:14.953 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: checksum: 1 2023-01-04T18:11:14.953 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: no_block_cache: 0 2023-01-04T18:11:14.953 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: block_cache: 0x557dae832f10 2023-01-04T18:11:14.953 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: block_cache_name: BinnedLRUCache 2023-01-04T18:11:14.954 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: block_cache_options: 2023-01-04T18:11:14.954 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: capacity : 536870912 2023-01-04T18:11:14.954 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: num_shard_bits : 4 2023-01-04T18:11:14.954 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: strict_capacity_limit : 0 2023-01-04T18:11:14.954 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: high_pri_pool_ratio: 0.000 2023-01-04T18:11:14.954 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: block_cache_compressed: (nil) 2023-01-04T18:11:14.954 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: persistent_cache: (nil) 2023-01-04T18:11:14.954 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: block_size: 4096 2023-01-04T18:11:14.954 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: block_size_deviation: 10 2023-01-04T18:11:14.955 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: block_restart_interval: 16 2023-01-04T18:11:14.955 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: index_block_restart_interval: 1 2023-01-04T18:11:14.955 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: metadata_block_size: 4096 2023-01-04T18:11:14.955 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: partition_filters: 0 2023-01-04T18:11:14.955 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: use_delta_encoding: 1 2023-01-04T18:11:14.955 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: filter_policy: rocksdb.BuiltinBloomFilter 2023-01-04T18:11:14.955 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: whole_key_filtering: 1 2023-01-04T18:11:14.955 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: verify_compression: 0 2023-01-04T18:11:14.955 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: read_amp_bytes_per_bit: 0 2023-01-04T18:11:14.955 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: format_version: 2 2023-01-04T18:11:14.955 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: enable_index_compression: 1 2023-01-04T18:11:14.955 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: block_align: 0 2023-01-04T18:11:14.956 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: 2023-01-04T18:11:14.956 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.write_buffer_size: 33554432 2023-01-04T18:11:14.956 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_write_buffer_number: 2 2023-01-04T18:11:14.956 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.compression: NoCompression 2023-01-04T18:11:14.956 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.bottommost_compression: Disabled 2023-01-04T18:11:14.956 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.prefix_extractor: nullptr 2023-01-04T18:11:14.956 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-01-04T18:11:14.956 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.num_levels: 7 2023-01-04T18:11:14.956 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-01-04T18:11:14.956 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-01-04T18:11:14.956 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-01-04T18:11:14.957 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-01-04T18:11:14.957 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-01-04T18:11:14.957 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-01-04T18:11:14.957 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-01-04T18:11:14.957 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-01-04T18:11:14.957 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-01-04T18:11:14.957 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.compression_opts.window_bits: -14 2023-01-04T18:11:14.957 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.compression_opts.level: 32767 2023-01-04T18:11:14.957 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.compression_opts.strategy: 0 2023-01-04T18:11:14.957 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-01-04T18:11:14.957 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-01-04T18:11:14.957 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.compression_opts.enabled: false 2023-01-04T18:11:14.958 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-01-04T18:11:14.958 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-01-04T18:11:14.958 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-01-04T18:11:14.958 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.target_file_size_base: 67108864 2023-01-04T18:11:14.958 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.target_file_size_multiplier: 1 2023-01-04T18:11:14.958 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-01-04T18:11:14.958 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-01-04T18:11:14.958 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-01-04T18:11:14.958 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-01-04T18:11:14.958 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-01-04T18:11:14.958 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-01-04T18:11:14.959 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-01-04T18:11:14.959 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-01-04T18:11:14.959 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-01-04T18:11:14.959 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-01-04T18:11:14.959 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-01-04T18:11:14.959 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-01-04T18:11:14.959 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.arena_block_size: 4194304 2023-01-04T18:11:14.959 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-01-04T18:11:14.959 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-01-04T18:11:14.959 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-01-04T18:11:14.959 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.disable_auto_compactions: 0 2023-01-04T18:11:14.959 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-01-04T18:11:14.960 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-01-04T18:11:14.960 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-01-04T18:11:14.960 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-01-04T18:11:14.960 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-01-04T18:11:14.960 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-01-04T18:11:14.960 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-01-04T18:11:14.960 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-01-04T18:11:14.960 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-01-04T18:11:14.960 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-01-04T18:11:14.960 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.table_properties_collectors: 2023-01-04T18:11:14.960 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.inplace_update_support: 0 2023-01-04T18:11:14.960 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-01-04T18:11:14.961 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-01-04T18:11:14.961 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-01-04T18:11:14.961 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.memtable_huge_page_size: 0 2023-01-04T18:11:14.961 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.bloom_locality: 0 2023-01-04T18:11:14.961 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.max_successive_merges: 0 2023-01-04T18:11:14.961 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-01-04T18:11:14.961 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.paranoid_file_checks: 0 2023-01-04T18:11:14.961 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.force_consistency_checks: 0 2023-01-04T18:11:14.961 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.report_bg_io_stats: 0 2023-01-04T18:11:14.961 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.ttl: 2592000 2023-01-04T18:11:14.961 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: Options.periodic_compaction_seconds: 0 2023-01-04T18:11:14.961 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi098/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-01-04T18:11:14.962 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: 2023-01-04T18:11:14.962 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2023-01-04T18:11:14.962 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: 2023-01-04T18:11:14.962 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1672855874879663, "job": 1, "event": "recovery_started", "log_files": [3]} 2023-01-04T18:11:14.962 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2023-01-04T18:11:14.962 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.878+0000 7f143ff71700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-01-04T18:11:14.962 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.879+0000 7f143ff71700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1672855874880116, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1437, "table_properties": {"data_size": 523, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1672855874, "oldest_key_time": 3, "file_creation_time": 0}} 2023-01-04T18:11:14.962 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.879+0000 7f143ff71700 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2023-01-04T18:11:14.962 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: 2023-01-04T18:11:14.962 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.879+0000 7f143ff71700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1672855874880469, "job": 1, "event": "recovery_finished"} 2023-01-04T18:11:14.962 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.880+0000 7f143ff71700 4 rocksdb: DB pointer 0x557dae8f7800 2023-01-04T18:11:14.962 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.880+0000 7f1426d89700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2023-01-04T18:11:14.963 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.880+0000 7f1426d89700 4 rocksdb: [db_impl/db_impl.cc:851] 2023-01-04T18:11:14.963 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: ** DB Stats ** 2023-01-04T18:11:14.963 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Uptime(secs): 0.0 total, 0.0 interval 2023-01-04T18:11:14.963 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-01-04T18:11:14.963 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-01-04T18:11:14.963 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-01-04T18:11:14.963 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-01-04T18:11:14.963 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-01-04T18:11:14.963 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-01-04T18:11:14.963 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: 2023-01-04T18:11:14.963 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: ** Compaction Stats [default] ** 2023-01-04T18:11:14.963 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-04T18:11:14.964 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-04T18:11:14.964 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.000 0 0 2023-01-04T18:11:14.964 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.000 0 0 2023-01-04T18:11:14.964 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.000 0 0 2023-01-04T18:11:14.964 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: 2023-01-04T18:11:14.964 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: ** Compaction Stats [default] ** 2023-01-04T18:11:14.964 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-04T18:11:14.964 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-04T18:11:14.964 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.3 0.00 0.00 1 0.000 0 0 2023-01-04T18:11:14.964 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Uptime(secs): 0.0 total, 0.0 interval 2023-01-04T18:11:14.964 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Flush(GB): cumulative 0.000, interval 0.000 2023-01-04T18:11:14.964 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: AddFile(GB): cumulative 0.000, interval 0.000 2023-01-04T18:11:14.965 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: AddFile(Total Files): cumulative 0, interval 0 2023-01-04T18:11:14.965 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: AddFile(L0 Files): cumulative 0, interval 0 2023-01-04T18:11:14.965 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: AddFile(Keys): cumulative 0, interval 0 2023-01-04T18:11:14.965 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-04T18:11:14.965 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-04T18:11:14.965 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-01-04T18:11:14.965 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: 2023-01-04T18:11:14.965 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: ** File Read Latency Histogram By Level [default] ** 2023-01-04T18:11:14.965 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: 2023-01-04T18:11:14.965 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: ** Compaction Stats [default] ** 2023-01-04T18:11:14.965 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-04T18:11:14.965 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-04T18:11:14.966 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.000 0 0 2023-01-04T18:11:14.966 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.000 0 0 2023-01-04T18:11:14.966 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-01-04T18:11:14.966 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: 2023-01-04T18:11:14.966 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: ** Compaction Stats [default] ** 2023-01-04T18:11:14.966 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-04T18:11:14.966 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-04T18:11:14.966 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.3 0.00 0.00 1 0.000 0 0 2023-01-04T18:11:14.966 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Uptime(secs): 0.0 total, 0.0 interval 2023-01-04T18:11:14.966 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Flush(GB): cumulative 0.000, interval 0.000 2023-01-04T18:11:14.966 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: AddFile(GB): cumulative 0.000, interval 0.000 2023-01-04T18:11:14.966 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: AddFile(Total Files): cumulative 0, interval 0 2023-01-04T18:11:14.967 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: AddFile(L0 Files): cumulative 0, interval 0 2023-01-04T18:11:14.967 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: AddFile(Keys): cumulative 0, interval 0 2023-01-04T18:11:14.967 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-04T18:11:14.967 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-04T18:11:14.967 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-01-04T18:11:14.967 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: 2023-01-04T18:11:14.967 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: ** File Read Latency Histogram By Level [default] ** 2023-01-04T18:11:14.967 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: 2023-01-04T18:11:14.967 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.880+0000 7f143ff71700 0 mon.smithi098 does not exist in monmap, will attempt to join an existing cluster 2023-01-04T18:11:14.967 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.880+0000 7f143ff71700 0 using public_addr v2:172.21.15.98:0/0 -> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2023-01-04T18:11:14.967 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.881+0000 7f143ff71700 0 starting mon.smithi098 rank -1 at public addrs [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] at bind addrs [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi098 fsid d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:11:14.967 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.882+0000 7f143ff71700 1 mon.smithi098@-1(???) e0 preinit fsid d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:11:14.968 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 bash[104693]: e6b6833279a46497c58b3b85ec0be70f4a1b33d3fffab33a1cccbc2e452ca4e1 2023-01-04T18:11:14.968 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.905+0000 7f142958e700 0 mon.smithi098@-1(synchronizing).mds e1 new map 2023-01-04T18:11:14.968 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.905+0000 7f142958e700 0 mon.smithi098@-1(synchronizing).mds e1 print_map 2023-01-04T18:11:14.968 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: e1 2023-01-04T18:11:14.968 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:11:14.968 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:11:14.968 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: legacy client fscid: -1 2023-01-04T18:11:14.968 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: 2023-01-04T18:11:14.969 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: No filesystems configured 2023-01-04T18:11:14.969 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: 2023-01-04T18:11:14.969 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.905+0000 7f142958e700 1 mon.smithi098@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-01-04T18:11:14.969 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.905+0000 7f142958e700 1 mon.smithi098@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-01-04T18:11:14.969 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.905+0000 7f142958e700 1 mon.smithi098@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-01-04T18:11:14.969 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.905+0000 7f142958e700 1 mon.smithi098@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-01-04T18:11:14.969 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.905+0000 7f142958e700 1 mon.smithi098@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-01-04T18:11:14.969 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.905+0000 7f142958e700 1 mon.smithi098@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-01-04T18:11:14.969 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.905+0000 7f142958e700 1 mon.smithi098@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2023-01-04T18:11:14.969 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.907+0000 7f142958e700 0 mon.smithi098@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2023-01-04T18:11:14.969 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.907+0000 7f142958e700 0 mon.smithi098@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-01-04T18:11:14.969 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.907+0000 7f142958e700 0 mon.smithi098@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-01-04T18:11:14.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.907+0000 7f142958e700 0 mon.smithi098@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-01-04T18:11:14.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:13.256858+0000 mgr.smithi050.emnywo (mgr.14162) 39 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:14.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:13.398929+0000 mon.smithi050 (mon.0) 157 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:11:14.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:13.401461+0000 mon.smithi050 (mon.0) 158 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:11:14.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:13.889084+0000 mon.smithi050 (mon.0) 159 : audit [DBG] from='client.? 172.21.15.98:0/2148908662' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-01-04T18:11:14.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.908+0000 7f142958e700 1 mon.smithi098@-1(synchronizing).paxosservice(auth 1..7) refresh upgraded, format 0 -> 3 2023-01-04T18:11:14.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.909+0000 7f142958e700 20 expand_channel_meta expand map: {default=false} 2023-01-04T18:11:14.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.909+0000 7f142958e700 20 expand_channel_meta from 'false' to 'false' 2023-01-04T18:11:14.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.909+0000 7f142958e700 20 expand_channel_meta expanded map: {default=false} 2023-01-04T18:11:14.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.909+0000 7f142958e700 20 expand_channel_meta expand map: {default=info} 2023-01-04T18:11:14.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.909+0000 7f142958e700 20 expand_channel_meta from 'info' to 'info' 2023-01-04T18:11:14.970 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.909+0000 7f142958e700 20 expand_channel_meta expanded map: {default=info} 2023-01-04T18:11:14.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.909+0000 7f142958e700 20 expand_channel_meta expand map: {default=daemon} 2023-01-04T18:11:14.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.909+0000 7f142958e700 20 expand_channel_meta from 'daemon' to 'daemon' 2023-01-04T18:11:14.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.909+0000 7f142958e700 20 expand_channel_meta expanded map: {default=daemon} 2023-01-04T18:11:14.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.909+0000 7f142958e700 20 expand_channel_meta expand map: {default=debug} 2023-01-04T18:11:14.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.909+0000 7f142958e700 20 expand_channel_meta from 'debug' to 'debug' 2023-01-04T18:11:14.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.909+0000 7f142958e700 20 expand_channel_meta expanded map: {default=debug} 2023-01-04T18:11:14.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:11:14.909+0000 7f142958e700 10 mon.smithi098@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-01-04T18:11:14.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:14 smithi098 systemd[1]: Started Ceph mon.smithi098 for d98671da-8c5a-11ed-821a-001a4aab830c. 2023-01-04T18:11:15.382 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-01-04T18:11:15.383 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph mon dump -f json 2023-01-04T18:11:19.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.962+0000 7feedf5e6700 1 -- 172.21.15.98:0/2249739631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feec4003250 msgr2=0x7feec40056e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:11:19.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.962+0000 7feedf5e6700 1 --2- 172.21.15.98:0/2249739631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feec4003250 0x7feec40056e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7feed805f870 tx=0x7feec800b040).stop 2023-01-04T18:11:19.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.962+0000 7feedf5e6700 1 -- 172.21.15.98:0/2249739631 shutdown_connections 2023-01-04T18:11:19.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.962+0000 7feedf5e6700 1 --2- 172.21.15.98:0/2249739631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feec4003250 0x7feec40056e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:19.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.962+0000 7feedf5e6700 1 -- 172.21.15.98:0/2249739631 >> 172.21.15.98:0/2249739631 conn(0x7feed80f0b70 msgr2=0x7feed80f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:11:19.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.962+0000 7feedf5e6700 1 -- 172.21.15.98:0/2249739631 shutdown_connections 2023-01-04T18:11:19.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.962+0000 7feedf5e6700 1 -- 172.21.15.98:0/2249739631 wait complete. 2023-01-04T18:11:19.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.963+0000 7feedf5e6700 1 Processor -- start 2023-01-04T18:11:19.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.963+0000 7feedf5e6700 1 -- start start 2023-01-04T18:11:19.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.964+0000 7feedf5e6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec4003250 0x7feed8106600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:11:19.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.964+0000 7feedf5e6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feed8106af0 0x7feed81079e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:11:19.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.964+0000 7feedf5e6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed8107050 con 0x7feed8106af0 2023-01-04T18:11:19.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.964+0000 7feedf5e6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed8107190 con 0x7feec4003250 2023-01-04T18:11:19.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.964+0000 7feedd382700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec4003250 0x7feed8106600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:11:19.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.964+0000 7feedd382700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec4003250 0x7feed8106600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34486/0 (socket says 172.21.15.98:34486) 2023-01-04T18:11:19.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.964+0000 7feedd382700 1 -- 172.21.15.98:0/2535398537 learned_addr learned my addr 172.21.15.98:0/2535398537 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-01-04T18:11:19.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.964+0000 7feedd382700 1 -- 172.21.15.98:0/2535398537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec4003250 msgr2=0x7feed8106600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-01-04T18:11:19.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.964+0000 7feedd382700 1 -- 172.21.15.98:0/2535398537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec4003250 msgr2=0x7feed8106600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-01-04T18:11:19.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.964+0000 7feedd382700 1 --2- 172.21.15.98:0/2535398537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec4003250 0x7feed8106600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-01-04T18:11:19.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.964+0000 7feedcb81700 1 --2- 172.21.15.98:0/2535398537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feed8106af0 0x7feed81079e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:11:19.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.964+0000 7feedd382700 1 --2- 172.21.15.98:0/2535398537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec4003250 0x7feed8106600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-01-04T18:11:19.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.964+0000 7feedcb81700 1 -- 172.21.15.98:0/2535398537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec4003250 msgr2=0x7feed8106600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-01-04T18:11:19.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.964+0000 7feedcb81700 1 --2- 172.21.15.98:0/2535398537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec4003250 0x7feed8106600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:19.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.964+0000 7feedcb81700 1 -- 172.21.15.98:0/2535398537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec8005040 con 0x7feed8106af0 2023-01-04T18:11:19.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.964+0000 7feedcb81700 1 --2- 172.21.15.98:0/2535398537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feed8106af0 0x7feed81079e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7feed4009390 tx=0x7feed4006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:11:19.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.965+0000 7feecdffb700 1 -- 172.21.15.98:0/2535398537 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feed40115e0 con 0x7feed8106af0 2023-01-04T18:11:19.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.965+0000 7feecdffb700 1 -- 172.21.15.98:0/2535398537 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feed4011bf0 con 0x7feed8106af0 2023-01-04T18:11:19.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.965+0000 7feecdffb700 1 -- 172.21.15.98:0/2535398537 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feed4010bf0 con 0x7feed8106af0 2023-01-04T18:11:19.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.965+0000 7feedf5e6700 1 -- 172.21.15.98:0/2535398537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed8107ff0 con 0x7feed8106af0 2023-01-04T18:11:19.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.965+0000 7feedf5e6700 1 -- 172.21.15.98:0/2535398537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed8108530 con 0x7feed8106af0 2023-01-04T18:11:19.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.966+0000 7feecdffb700 1 -- 172.21.15.98:0/2535398537 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7feed4018030 con 0x7feed8106af0 2023-01-04T18:11:19.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.966+0000 7feecdffb700 1 --2- 172.21.15.98:0/2535398537 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7feebc0300e0 0x7feebc0325a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:11:19.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.966+0000 7feecdffb700 1 -- 172.21.15.98:0/2535398537 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7feed4040510 con 0x7feed8106af0 2023-01-04T18:11:19.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.966+0000 7feedd382700 1 --2- 172.21.15.98:0/2535398537 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7feebc0300e0 0x7feebc0325a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:11:19.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.966+0000 7feedf5e6700 1 -- 172.21.15.98:0/2535398537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed8108800 con 0x7feed8106af0 2023-01-04T18:11:19.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.967+0000 7feedd382700 1 --2- 172.21.15.98:0/2535398537 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7feebc0300e0 0x7feebc0325a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7feec8007880 tx=0x7feec8002040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:11:19.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:19.971+0000 7feecdffb700 1 -- 172.21.15.98:0/2535398537 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7feed4017c30 con 0x7feed8106af0 2023-01-04T18:11:20.011 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:20.009+0000 7feecdffb700 1 -- 172.21.15.98:0/2535398537 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7feed400f070 con 0x7feed8106af0 2023-01-04T18:11:20.194 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:20.191+0000 7feedf5e6700 1 -- 172.21.15.98:0/2535398537 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7feed8059100 con 0x7feed8106af0 2023-01-04T18:11:20.195 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:20.192+0000 7feecdffb700 1 -- 172.21.15.98:0/2535398537 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+964 (secure 0 0 0) 0x7feed8059100 con 0x7feed8106af0 2023-01-04T18:11:20.195 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-01-04T18:11:20.195 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":2,"fsid":"d98671da-8c5a-11ed-821a-001a4aab830c","modified":"2023-01-04T18:11:14.912486Z","created":"2023-01-04T18:09:13.702416Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi050","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi098","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-01-04T18:11:20.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:20.194+0000 7feedf5e6700 1 -- 172.21.15.98:0/2535398537 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7feebc0300e0 msgr2=0x7feebc0325a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:11:20.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:20.194+0000 7feedf5e6700 1 --2- 172.21.15.98:0/2535398537 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7feebc0300e0 0x7feebc0325a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7feec8007880 tx=0x7feec8002040).stop 2023-01-04T18:11:20.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:20.194+0000 7feedf5e6700 1 -- 172.21.15.98:0/2535398537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feed8106af0 msgr2=0x7feed81079e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:11:20.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:20.194+0000 7feedf5e6700 1 --2- 172.21.15.98:0/2535398537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feed8106af0 0x7feed81079e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7feed4009390 tx=0x7feed4006e20).stop 2023-01-04T18:11:20.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:20.194+0000 7feedf5e6700 1 -- 172.21.15.98:0/2535398537 shutdown_connections 2023-01-04T18:11:20.197 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:20.194+0000 7feedf5e6700 1 --2- 172.21.15.98:0/2535398537 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7feebc0300e0 0x7feebc0325a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:20.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:20.194+0000 7feedf5e6700 1 --2- 172.21.15.98:0/2535398537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feec4003250 0x7feed8106600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:20.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:20.194+0000 7feedf5e6700 1 --2- 172.21.15.98:0/2535398537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feed8106af0 0x7feed81079e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:20.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:20.194+0000 7feedf5e6700 1 -- 172.21.15.98:0/2535398537 >> 172.21.15.98:0/2535398537 conn(0x7feed80f0b70 msgr2=0x7feed80fad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:11:20.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:20.194+0000 7feedf5e6700 1 -- 172.21.15.98:0/2535398537 shutdown_connections 2023-01-04T18:11:20.198 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:11:20.194+0000 7feedf5e6700 1 -- 172.21.15.98:0/2535398537 wait complete. 2023-01-04T18:11:20.198 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 2 2023-01-04T18:11:20.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:14.914917+0000 mon.smithi050 (mon.0) 161 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi050"}]: dispatch 2023-01-04T18:11:20.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:14.915108+0000 mon.smithi050 (mon.0) 162 : cluster [INF] mon.smithi050 calling monitor election 2023-01-04T18:11:20.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:14.928098+0000 mon.smithi050 (mon.0) 163 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2023-01-04T18:11:20.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:15.257220+0000 mgr.smithi050.emnywo (mgr.14162) 40 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:20.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:15.912419+0000 mon.smithi050 (mon.0) 164 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2023-01-04T18:11:20.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:16.179176+0000 mon.smithi050 (mon.0) 165 : audit [DBG] from='mgr.? 172.21.15.98:0/1683178752' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.vhfzum/crt"}]: dispatch 2023-01-04T18:11:20.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:16.912342+0000 mon.smithi050 (mon.0) 166 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2023-01-04T18:11:20.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:16.913638+0000 mon.smithi098 (mon.1) 1 : cluster [INF] mon.smithi098 calling monitor election 2023-01-04T18:11:20.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:17.257567+0000 mgr.smithi050.emnywo (mgr.14162) 41 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:20.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:17.912480+0000 mon.smithi050 (mon.0) 167 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2023-01-04T18:11:20.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:18.913045+0000 mon.smithi050 (mon.0) 168 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2023-01-04T18:11:20.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:19.912825+0000 mon.smithi050 (mon.0) 169 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2023-01-04T18:11:20.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:19.941916+0000 mon.smithi050 (mon.0) 170 : cluster [INF] mon.smithi050 is new leader, mons smithi050,smithi098 in quorum (ranks 0,1) 2023-01-04T18:11:20.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:19.950011+0000 mon.smithi050 (mon.0) 171 : cluster [DBG] monmap e2: 2 mons at {smithi050=[v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0],smithi098=[v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0]} 2023-01-04T18:11:20.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:19.950068+0000 mon.smithi050 (mon.0) 172 : cluster [DBG] fsmap 2023-01-04T18:11:20.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:19.950101+0000 mon.smithi050 (mon.0) 173 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2023-01-04T18:11:20.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:19.950330+0000 mon.smithi050 (mon.0) 174 : cluster [DBG] mgrmap e17: smithi050.emnywo(active, since 66s) 2023-01-04T18:11:20.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:19.951234+0000 mon.smithi050 (mon.0) 175 : cluster [DBG] Standby manager daemon smithi098.vhfzum started 2023-01-04T18:11:20.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:19.952276+0000 mon.smithi050 (mon.0) 176 : audit [DBG] from='mgr.? 172.21.15.98:0/1683178752' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-01-04T18:11:20.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:19.953890+0000 mon.smithi050 (mon.0) 177 : audit [DBG] from='mgr.? 172.21.15.98:0/1683178752' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.vhfzum/key"}]: dispatch 2023-01-04T18:11:20.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:19.954390+0000 mon.smithi050 (mon.0) 178 : audit [DBG] from='mgr.? 172.21.15.98:0/1683178752' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-01-04T18:11:20.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:19.957373+0000 mon.smithi050 (mon.0) 179 : cluster [INF] overall HEALTH_OK 2023-01-04T18:11:20.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:19.962244+0000 mon.smithi050 (mon.0) 180 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:20.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:14.914917+0000 mon.smithi050 (mon.0) 161 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi050"}]: dispatch 2023-01-04T18:11:20.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:14.915108+0000 mon.smithi050 (mon.0) 162 : cluster [INF] mon.smithi050 calling monitor election 2023-01-04T18:11:20.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:14.928098+0000 mon.smithi050 (mon.0) 163 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2023-01-04T18:11:20.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:15.257220+0000 mgr.smithi050.emnywo (mgr.14162) 40 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:20.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:15.912419+0000 mon.smithi050 (mon.0) 164 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2023-01-04T18:11:20.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:16.179176+0000 mon.smithi050 (mon.0) 165 : audit [DBG] from='mgr.? 172.21.15.98:0/1683178752' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.vhfzum/crt"}]: dispatch 2023-01-04T18:11:20.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:16.912342+0000 mon.smithi050 (mon.0) 166 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2023-01-04T18:11:20.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:16.913638+0000 mon.smithi098 (mon.1) 1 : cluster [INF] mon.smithi098 calling monitor election 2023-01-04T18:11:20.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:17.257567+0000 mgr.smithi050.emnywo (mgr.14162) 41 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:20.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:17.912480+0000 mon.smithi050 (mon.0) 167 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2023-01-04T18:11:20.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:18.913045+0000 mon.smithi050 (mon.0) 168 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2023-01-04T18:11:20.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:19.912825+0000 mon.smithi050 (mon.0) 169 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2023-01-04T18:11:20.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:19.941916+0000 mon.smithi050 (mon.0) 170 : cluster [INF] mon.smithi050 is new leader, mons smithi050,smithi098 in quorum (ranks 0,1) 2023-01-04T18:11:20.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:19.950011+0000 mon.smithi050 (mon.0) 171 : cluster [DBG] monmap e2: 2 mons at {smithi050=[v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0],smithi098=[v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0]} 2023-01-04T18:11:20.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:19.950068+0000 mon.smithi050 (mon.0) 172 : cluster [DBG] fsmap 2023-01-04T18:11:20.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:19.950101+0000 mon.smithi050 (mon.0) 173 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2023-01-04T18:11:20.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:19.950330+0000 mon.smithi050 (mon.0) 174 : cluster [DBG] mgrmap e17: smithi050.emnywo(active, since 66s) 2023-01-04T18:11:20.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:19.951234+0000 mon.smithi050 (mon.0) 175 : cluster [DBG] Standby manager daemon smithi098.vhfzum started 2023-01-04T18:11:20.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:19.952276+0000 mon.smithi050 (mon.0) 176 : audit [DBG] from='mgr.? 172.21.15.98:0/1683178752' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-01-04T18:11:20.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:19.953890+0000 mon.smithi050 (mon.0) 177 : audit [DBG] from='mgr.? 172.21.15.98:0/1683178752' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.vhfzum/key"}]: dispatch 2023-01-04T18:11:20.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:19.954390+0000 mon.smithi050 (mon.0) 178 : audit [DBG] from='mgr.? 172.21.15.98:0/1683178752' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-01-04T18:11:20.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:19.957373+0000 mon.smithi050 (mon.0) 179 : cluster [INF] overall HEALTH_OK 2023-01-04T18:11:20.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:19.962244+0000 mon.smithi050 (mon.0) 180 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:20.810 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-01-04T18:11:20.810 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph config generate-minimal-conf 2023-01-04T18:11:21.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:19.257941+0000 mgr.smithi050.emnywo (mgr.14162) 42 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:21.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:19.963265+0000 mgr.smithi050.emnywo (mgr.14162) 43 : cephadm [INF] Deploying daemon node-exporter.smithi098 on smithi098 2023-01-04T18:11:21.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:20.011274+0000 mon.smithi050 (mon.0) 181 : cluster [DBG] mgrmap e18: smithi050.emnywo(active, since 66s), standbys: smithi098.vhfzum 2023-01-04T18:11:21.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:20.011430+0000 mon.smithi050 (mon.0) 182 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mgr metadata", "who": "smithi098.vhfzum", "id": "smithi098.vhfzum"}]: dispatch 2023-01-04T18:11:21.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:20.192989+0000 mon.smithi050 (mon.0) 183 : audit [DBG] from='client.? 172.21.15.98:0/2535398537' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-01-04T18:11:21.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:20.913151+0000 mon.smithi050 (mon.0) 184 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2023-01-04T18:11:21.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:19.257941+0000 mgr.smithi050.emnywo (mgr.14162) 42 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:21.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:11:19.963265+0000 mgr.smithi050.emnywo (mgr.14162) 43 : cephadm [INF] Deploying daemon node-exporter.smithi098 on smithi098 2023-01-04T18:11:21.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:20.011274+0000 mon.smithi050 (mon.0) 181 : cluster [DBG] mgrmap e18: smithi050.emnywo(active, since 66s), standbys: smithi098.vhfzum 2023-01-04T18:11:21.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:20.011430+0000 mon.smithi050 (mon.0) 182 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mgr metadata", "who": "smithi098.vhfzum", "id": "smithi098.vhfzum"}]: dispatch 2023-01-04T18:11:21.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:20.192989+0000 mon.smithi050 (mon.0) 183 : audit [DBG] from='client.? 172.21.15.98:0/2535398537' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-01-04T18:11:21.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:20.913151+0000 mon.smithi050 (mon.0) 184 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2023-01-04T18:11:23.132 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:23 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:21.258243+0000 mgr.smithi050.emnywo (mgr.14162) 44 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:23.267 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:21.258243+0000 mgr.smithi050.emnywo (mgr.14162) 44 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.520+0000 7f6fd919b700 1 -- 172.21.15.50:0/1795790696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd40f5410 msgr2=0x7f6fd40f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:11:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.520+0000 7f6fd919b700 1 --2- 172.21.15.50:0/1795790696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd40f5410 0x7f6fd40f5830 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f6fc4009fb0 tx=0x7f6fc4009b30).stop 2023-01-04T18:11:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.520+0000 7f6fd919b700 1 -- 172.21.15.50:0/1795790696 shutdown_connections 2023-01-04T18:11:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.520+0000 7f6fd919b700 1 --2- 172.21.15.50:0/1795790696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd40f5410 0x7f6fd40f5830 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.520+0000 7f6fd919b700 1 -- 172.21.15.50:0/1795790696 >> 172.21.15.50:0/1795790696 conn(0x7f6fd40f0b70 msgr2=0x7f6fd40f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:11:23.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.520+0000 7f6fd919b700 1 -- 172.21.15.50:0/1795790696 shutdown_connections 2023-01-04T18:11:23.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.520+0000 7f6fd919b700 1 -- 172.21.15.50:0/1795790696 wait complete. 2023-01-04T18:11:23.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.521+0000 7f6fd919b700 1 Processor -- start 2023-01-04T18:11:23.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.521+0000 7f6fd919b700 1 -- start start 2023-01-04T18:11:23.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.521+0000 7f6fd919b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fd40f5410 0x7f6fd40fd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:11:23.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.521+0000 7f6fd919b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd40fb820 0x7f6fd40fbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:11:23.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.521+0000 7f6fd919b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd40fc220 con 0x7f6fd40fb820 2023-01-04T18:11:23.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.521+0000 7f6fd919b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd40fc360 con 0x7f6fd40f5410 2023-01-04T18:11:23.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.521+0000 7f6fd259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd40fb820 0x7f6fd40fbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:11:23.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.521+0000 7f6fd259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd40fb820 0x7f6fd40fbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39126/0 (socket says 172.21.15.50:39126) 2023-01-04T18:11:23.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.521+0000 7f6fd259c700 1 -- 172.21.15.50:0/1959130079 learned_addr learned my addr 172.21.15.50:0/1959130079 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:11:23.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.521+0000 7f6fd2d9d700 1 --2- 172.21.15.50:0/1959130079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fd40f5410 0x7f6fd40fd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:11:23.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.522+0000 7f6fd2d9d700 1 -- 172.21.15.50:0/1959130079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fd40f5410 msgr2=0x7f6fd40fd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-01-04T18:11:23.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.522+0000 7f6fd2d9d700 1 -- 172.21.15.50:0/1959130079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fd40f5410 msgr2=0x7f6fd40fd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-01-04T18:11:23.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.522+0000 7f6fd2d9d700 1 --2- 172.21.15.50:0/1959130079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fd40f5410 0x7f6fd40fd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-01-04T18:11:23.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.522+0000 7f6fd2d9d700 1 --2- 172.21.15.50:0/1959130079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fd40f5410 0x7f6fd40fd3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-01-04T18:11:23.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.522+0000 7f6fd259c700 1 -- 172.21.15.50:0/1959130079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fd40f5410 msgr2=0x7f6fd40fd3a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-01-04T18:11:23.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.522+0000 7f6fd259c700 1 --2- 172.21.15.50:0/1959130079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fd40f5410 0x7f6fd40fd3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:23.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.522+0000 7f6fd259c700 1 -- 172.21.15.50:0/1959130079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc4005040 con 0x7f6fd40fb820 2023-01-04T18:11:23.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.522+0000 7f6fd259c700 1 --2- 172.21.15.50:0/1959130079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd40fb820 0x7f6fd40fbca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f6fbc0093c0 tx=0x7f6fbc006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:11:23.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.522+0000 7f6fcb7fe700 1 -- 172.21.15.50:0/1959130079 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fbc00e650 con 0x7f6fd40fb820 2023-01-04T18:11:23.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.522+0000 7f6fcb7fe700 1 -- 172.21.15.50:0/1959130079 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6fbc00ec60 con 0x7f6fd40fb820 2023-01-04T18:11:23.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.522+0000 7f6fd919b700 1 -- 172.21.15.50:0/1959130079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd40fc610 con 0x7f6fd40fb820 2023-01-04T18:11:23.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.522+0000 7f6fcb7fe700 1 -- 172.21.15.50:0/1959130079 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fbc011bf0 con 0x7f6fd40fb820 2023-01-04T18:11:23.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.522+0000 7f6fd919b700 1 -- 172.21.15.50:0/1959130079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd410eba0 con 0x7f6fd40fb820 2023-01-04T18:11:23.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.523+0000 7f6fd919b700 1 -- 172.21.15.50:0/1959130079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd4059100 con 0x7f6fd40fb820 2023-01-04T18:11:23.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.523+0000 7f6fcb7fe700 1 -- 172.21.15.50:0/1959130079 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f6fbc018030 con 0x7f6fd40fb820 2023-01-04T18:11:23.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.524+0000 7f6fcb7fe700 1 --2- 172.21.15.50:0/1959130079 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6fc005c3b0 0x7f6fc005e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:11:23.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.524+0000 7f6fcb7fe700 1 -- 172.21.15.50:0/1959130079 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f6fbc0749f0 con 0x7f6fd40fb820 2023-01-04T18:11:23.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.524+0000 7f6fd2d9d700 1 --2- 172.21.15.50:0/1959130079 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6fc005c3b0 0x7f6fc005e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:11:23.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.524+0000 7f6fd2d9d700 1 --2- 172.21.15.50:0/1959130079 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6fc005c3b0 0x7f6fc005e870 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f6fc4004dd0 tx=0x7f6fc400b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:11:23.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.528+0000 7f6fcb7fe700 1 -- 172.21.15.50:0/1959130079 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f6fbc0452b0 con 0x7f6fd40fb820 2023-01-04T18:11:23.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.689+0000 7f6fd919b700 1 -- 172.21.15.50:0/1959130079 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f6fd4045ad0 con 0x7f6fd40fb820 2023-01-04T18:11:23.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.689+0000 7f6fcb7fe700 1 -- 172.21.15.50:0/1959130079 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v12) v1 ==== 76+0+223 (secure 0 0 0) 0x7f6fbc016020 con 0x7f6fd40fb820 2023-01-04T18:11:23.692 INFO:teuthology.orchestra.run.smithi050.stdout:# minimal ceph.conf for d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:11:23.692 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2023-01-04T18:11:23.693 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:11:23.693 INFO:teuthology.orchestra.run.smithi050.stdout: mon_host = [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2023-01-04T18:11:23.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.691+0000 7f6fd919b700 1 -- 172.21.15.50:0/1959130079 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6fc005c3b0 msgr2=0x7f6fc005e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:11:23.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.691+0000 7f6fd919b700 1 --2- 172.21.15.50:0/1959130079 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6fc005c3b0 0x7f6fc005e870 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f6fc4004dd0 tx=0x7f6fc400b040).stop 2023-01-04T18:11:23.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.691+0000 7f6fd919b700 1 -- 172.21.15.50:0/1959130079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd40fb820 msgr2=0x7f6fd40fbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:11:23.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.691+0000 7f6fd919b700 1 --2- 172.21.15.50:0/1959130079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd40fb820 0x7f6fd40fbca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f6fbc0093c0 tx=0x7f6fbc006ee0).stop 2023-01-04T18:11:23.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.691+0000 7f6fd919b700 1 -- 172.21.15.50:0/1959130079 shutdown_connections 2023-01-04T18:11:23.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.691+0000 7f6fd919b700 1 --2- 172.21.15.50:0/1959130079 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6fc005c3b0 0x7f6fc005e870 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:23.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.691+0000 7f6fd919b700 1 --2- 172.21.15.50:0/1959130079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fd40f5410 0x7f6fd40fd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:23.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.691+0000 7f6fd919b700 1 --2- 172.21.15.50:0/1959130079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fd40fb820 0x7f6fd40fbca0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:23.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.691+0000 7f6fd919b700 1 -- 172.21.15.50:0/1959130079 >> 172.21.15.50:0/1959130079 conn(0x7f6fd40f0b70 msgr2=0x7f6fd405fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:11:23.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.691+0000 7f6fd919b700 1 -- 172.21.15.50:0/1959130079 shutdown_connections 2023-01-04T18:11:23.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:23.691+0000 7f6fd919b700 1 -- 172.21.15.50:0/1959130079 wait complete. 2023-01-04T18:11:24.153 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-01-04T18:11:24.153 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-01-04T18:11:24.153 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.conf 2023-01-04T18:11:24.188 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-01-04T18:11:24.189 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-01-04T18:11:24.258 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-01-04T18:11:24.258 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.conf 2023-01-04T18:11:24.293 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-01-04T18:11:24.293 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-01-04T18:11:24.359 INFO:tasks.cephadm:Deploying OSDs... 2023-01-04T18:11:24.359 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-01-04T18:11:24.359 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2023-01-04T18:11:24.378 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-04T18:11:24.378 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2023-01-04T18:11:24.437 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-04T18:11:24.437 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-04T18:11:24.437 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 408028 Links: 1 2023-01-04T18:11:24.438 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-04T18:11:24.438 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-01-04T18:11:24.438 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-01-04 18:10:51.048964586 +0000 2023-01-04T18:11:24.438 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-01-04 18:04:12.030154280 +0000 2023-01-04T18:11:24.438 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-01-04 18:04:12.030154280 +0000 2023-01-04T18:11:24.438 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-01-04T18:11:24.438 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-04T18:11:24.504 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-01-04T18:11:24.504 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-01-04T18:11:24.505 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 9.8617e-05 s, 5.2 MB/s 2023-01-04T18:11:24.506 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-04T18:11:24.566 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2023-01-04T18:11:24.626 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-04T18:11:24.626 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-04T18:11:24.626 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 402139 Links: 1 2023-01-04T18:11:24.626 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-04T18:11:24.626 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-01-04T18:11:24.626 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-01-04 18:10:51.048964586 +0000 2023-01-04T18:11:24.626 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-01-04 18:04:12.562140793 +0000 2023-01-04T18:11:24.627 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-01-04 18:04:12.562140793 +0000 2023-01-04T18:11:24.627 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-01-04T18:11:24.627 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-04T18:11:24.694 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-01-04T18:11:24.694 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-01-04T18:11:24.694 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000106398 s, 4.8 MB/s 2023-01-04T18:11:24.696 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-04T18:11:24.755 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2023-01-04T18:11:24.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:23.258508+0000 mgr.smithi050.emnywo (mgr.14162) 45 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:24.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:23.564842+0000 mon.smithi050 (mon.0) 185 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:24.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:23.565643+0000 mon.smithi050 (mon.0) 186 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:11:24.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:23.689713+0000 mon.smithi050 (mon.0) 187 : audit [DBG] from='client.? 172.21.15.50:0/1959130079' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:11:24.808 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-04T18:11:24.808 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-04T18:11:24.808 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 408152 Links: 1 2023-01-04T18:11:24.808 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-04T18:11:24.808 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-01-04T18:11:24.809 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-01-04 18:10:51.048964586 +0000 2023-01-04T18:11:24.809 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-01-04 18:04:13.127126469 +0000 2023-01-04T18:11:24.809 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-01-04 18:04:13.127126469 +0000 2023-01-04T18:11:24.809 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-01-04T18:11:24.809 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-04T18:11:24.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:23.258508+0000 mgr.smithi050.emnywo (mgr.14162) 45 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:24.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:23.564842+0000 mon.smithi050 (mon.0) 185 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:24.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:23.565643+0000 mon.smithi050 (mon.0) 186 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:11:24.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:23.689713+0000 mon.smithi050 (mon.0) 187 : audit [DBG] from='client.? 172.21.15.50:0/1959130079' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:11:24.877 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-01-04T18:11:24.877 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-01-04T18:11:24.878 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000104097 s, 4.9 MB/s 2023-01-04T18:11:24.878 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-04T18:11:24.938 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2023-01-04T18:11:24.997 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-04T18:11:24.997 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-04T18:11:24.997 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 412674 Links: 1 2023-01-04T18:11:24.997 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-04T18:11:24.997 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-01-04T18:11:24.997 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-01-04 18:10:51.048964586 +0000 2023-01-04T18:11:24.997 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-01-04 18:04:13.665112830 +0000 2023-01-04T18:11:24.997 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-01-04 18:04:13.665112830 +0000 2023-01-04T18:11:24.997 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-01-04T18:11:24.998 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-04T18:11:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-01-04T18:11:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-01-04T18:11:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000102064 s, 5.0 MB/s 2023-01-04T18:11:25.064 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-04T18:11:25.124 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-01-04T18:11:25.124 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/scratch_devs of=/dev/stdout 2023-01-04T18:11:25.142 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-04T18:11:25.143 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_1 2023-01-04T18:11:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-04T18:11:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-04T18:11:25.200 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 6h/6d Inode: 378919 Links: 1 2023-01-04T18:11:25.200 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-04T18:11:25.201 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2023-01-04T18:11:25.201 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2023-01-04 18:11:20.954057765 +0000 2023-01-04T18:11:25.201 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2023-01-04 18:04:08.668362142 +0000 2023-01-04T18:11:25.201 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2023-01-04 18:04:08.668362142 +0000 2023-01-04T18:11:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2023-01-04T18:11:25.201 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-04T18:11:25.267 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2023-01-04T18:11:25.268 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2023-01-04T18:11:25.268 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000220571 s, 2.3 MB/s 2023-01-04T18:11:25.269 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-04T18:11:25.327 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_2 2023-01-04T18:11:25.385 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-04T18:11:25.385 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-04T18:11:25.385 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 6h/6d Inode: 381026 Links: 1 2023-01-04T18:11:25.385 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-04T18:11:25.386 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2023-01-04T18:11:25.386 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2023-01-04 18:11:20.954057765 +0000 2023-01-04T18:11:25.386 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2023-01-04 18:04:09.187355272 +0000 2023-01-04T18:11:25.386 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2023-01-04 18:04:09.187355272 +0000 2023-01-04T18:11:25.386 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2023-01-04T18:11:25.386 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-04T18:11:25.450 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2023-01-04T18:11:25.450 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2023-01-04T18:11:25.450 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000211112 s, 2.4 MB/s 2023-01-04T18:11:25.451 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-04T18:11:25.509 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_3 2023-01-04T18:11:25.567 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-04T18:11:25.567 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-04T18:11:25.567 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 6h/6d Inode: 381159 Links: 1 2023-01-04T18:11:25.567 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-04T18:11:25.568 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2023-01-04T18:11:25.568 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2023-01-04 18:11:20.954057765 +0000 2023-01-04T18:11:25.568 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2023-01-04 18:04:09.710348348 +0000 2023-01-04T18:11:25.568 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2023-01-04 18:04:09.710348348 +0000 2023-01-04T18:11:25.568 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2023-01-04T18:11:25.568 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-04T18:11:25.633 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2023-01-04T18:11:25.633 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2023-01-04T18:11:25.633 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000208799 s, 2.5 MB/s 2023-01-04T18:11:25.634 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-04T18:11:25.692 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_4 2023-01-04T18:11:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-04T18:11:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-04T18:11:25.750 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 6h/6d Inode: 372231 Links: 1 2023-01-04T18:11:25.750 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-04T18:11:25.750 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2023-01-04T18:11:25.751 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2023-01-04 18:11:20.954057765 +0000 2023-01-04T18:11:25.751 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2023-01-04 18:04:10.229341478 +0000 2023-01-04T18:11:25.751 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2023-01-04 18:04:10.229341478 +0000 2023-01-04T18:11:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2023-01-04T18:11:25.751 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-04T18:11:25.836 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2023-01-04T18:11:25.836 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2023-01-04T18:11:25.836 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000184951 s, 2.8 MB/s 2023-01-04T18:11:25.837 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-04T18:11:25.854 INFO:tasks.cephadm:Deploying osd.0 on smithi050 with /dev/vg_nvme/lv_4... 2023-01-04T18:11:25.854 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-01-04T18:11:26.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:25.258802+0000 mgr.smithi050.emnywo (mgr.14162) 46 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:26.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:26.111721+0000 mon.smithi050 (mon.0) 188 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:26.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:25.258802+0000 mgr.smithi050.emnywo (mgr.14162) 46 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:26.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:26.111721+0000 mon.smithi050 (mon.0) 188 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:27.979 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-01-04T18:11:27.980 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-01-04T18:11:27.980 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10+0 records in 2023-01-04T18:11:27.980 INFO:teuthology.orchestra.run.smithi050.stderr:10+0 records out 2023-01-04T18:11:27.980 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00933227 s, 1.1 GB/s 2023-01-04T18:11:27.980 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping successful for: 2023-01-04T18:11:28.518 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph orch daemon add osd smithi050:vg_nvme/lv_4 2023-01-04T18:11:28.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:27.259054+0000 mgr.smithi050.emnywo (mgr.14162) 47 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:28.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:28.244056+0000 mon.smithi050 (mon.0) 189 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:28.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:27.259054+0000 mgr.smithi050.emnywo (mgr.14162) 47 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:28.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:28.244056+0000 mon.smithi050 (mon.0) 189 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:29.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:28.667711+0000 mon.smithi050 (mon.0) 190 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:29.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:28.669382+0000 mgr.smithi050.emnywo (mgr.14162) 48 : cephadm [INF] Reconfiguring mon.smithi050 (unknown last config time)... 2023-01-04T18:11:29.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:28.669607+0000 mon.smithi050 (mon.0) 191 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-01-04T18:11:29.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:28.670196+0000 mon.smithi050 (mon.0) 192 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-01-04T18:11:29.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:28.670782+0000 mon.smithi050 (mon.0) 193 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:11:29.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:28.671263+0000 mgr.smithi050.emnywo (mgr.14162) 49 : cephadm [INF] Reconfiguring daemon mon.smithi050 on smithi050 2023-01-04T18:11:30.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:28.667711+0000 mon.smithi050 (mon.0) 190 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:30.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:11:28.669382+0000 mgr.smithi050.emnywo (mgr.14162) 48 : cephadm [INF] Reconfiguring mon.smithi050 (unknown last config time)... 2023-01-04T18:11:30.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:28.669607+0000 mon.smithi050 (mon.0) 191 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-01-04T18:11:30.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:28.670196+0000 mon.smithi050 (mon.0) 192 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-01-04T18:11:30.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:28.670782+0000 mon.smithi050 (mon.0) 193 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:11:30.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:11:28.671263+0000 mgr.smithi050.emnywo (mgr.14162) 49 : cephadm [INF] Reconfiguring daemon mon.smithi050 on smithi050 2023-01-04T18:11:30.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.450+0000 7f45e3fbc700 1 -- 172.21.15.50:0/1453657627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0f66e0 msgr2=0x7f45dc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:11:30.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.450+0000 7f45e3fbc700 1 --2- 172.21.15.50:0/1453657627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0f66e0 0x7f45dc0f6b00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f45d8004660 tx=0x7f45d8009b30).stop 2023-01-04T18:11:30.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.450+0000 7f45e3fbc700 1 -- 172.21.15.50:0/1453657627 shutdown_connections 2023-01-04T18:11:30.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.450+0000 7f45e3fbc700 1 --2- 172.21.15.50:0/1453657627 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45dc0f7980 0x7f45dc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:30.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.450+0000 7f45e3fbc700 1 --2- 172.21.15.50:0/1453657627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0f66e0 0x7f45dc0f6b00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:30.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.450+0000 7f45e3fbc700 1 -- 172.21.15.50:0/1453657627 >> 172.21.15.50:0/1453657627 conn(0x7f45dc0f1e40 msgr2=0x7f45dc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:11:30.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.450+0000 7f45e3fbc700 1 -- 172.21.15.50:0/1453657627 shutdown_connections 2023-01-04T18:11:30.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.450+0000 7f45e3fbc700 1 -- 172.21.15.50:0/1453657627 wait complete. 2023-01-04T18:11:30.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.450+0000 7f45e3fbc700 1 Processor -- start 2023-01-04T18:11:30.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.450+0000 7f45e3fbc700 1 -- start start 2023-01-04T18:11:30.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.450+0000 7f45e3fbc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0f66e0 0x7f45dc106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:11:30.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.450+0000 7f45e3fbc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45dc0f7980 0x7f45dc1074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:11:30.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.450+0000 7f45e3fbc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc107a70 con 0x7f45dc0f66e0 2023-01-04T18:11:30.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.450+0000 7f45e3fbc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc107bb0 con 0x7f45dc0f7980 2023-01-04T18:11:30.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.451+0000 7f45e1d58700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0f66e0 0x7f45dc106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:11:30.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.451+0000 7f45e1d58700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0f66e0 0x7f45dc106fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40808/0 (socket says 172.21.15.50:40808) 2023-01-04T18:11:30.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.451+0000 7f45e1d58700 1 -- 172.21.15.50:0/2360925889 learned_addr learned my addr 172.21.15.50:0/2360925889 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:11:30.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.451+0000 7f45e1557700 1 --2- 172.21.15.50:0/2360925889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45dc0f7980 0x7f45dc1074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:11:30.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.451+0000 7f45e1d58700 1 -- 172.21.15.50:0/2360925889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45dc0f7980 msgr2=0x7f45dc1074c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:11:30.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.451+0000 7f45e1d58700 1 --2- 172.21.15.50:0/2360925889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45dc0f7980 0x7f45dc1074c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:30.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.451+0000 7f45e1d58700 1 -- 172.21.15.50:0/2360925889 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d8005040 con 0x7f45dc0f66e0 2023-01-04T18:11:30.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.451+0000 7f45e1557700 1 --2- 172.21.15.50:0/2360925889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45dc0f7980 0x7f45dc1074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:11:30.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.451+0000 7f45e1d58700 1 --2- 172.21.15.50:0/2360925889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0f66e0 0x7f45dc106fd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f45d8004e30 tx=0x7f45d8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:11:30.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.451+0000 7f45d27fc700 1 -- 172.21.15.50:0/2360925889 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45d8018070 con 0x7f45dc0f66e0 2023-01-04T18:11:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.451+0000 7f45e3fbc700 1 -- 172.21.15.50:0/2360925889 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45dc1084f0 con 0x7f45dc0f66e0 2023-01-04T18:11:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.451+0000 7f45d27fc700 1 -- 172.21.15.50:0/2360925889 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f45d8013410 con 0x7f45dc0f66e0 2023-01-04T18:11:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.451+0000 7f45d27fc700 1 -- 172.21.15.50:0/2360925889 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45d801c3c0 con 0x7f45dc0f66e0 2023-01-04T18:11:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.451+0000 7f45e3fbc700 1 -- 172.21.15.50:0/2360925889 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45dc108a50 con 0x7f45dc0f66e0 2023-01-04T18:11:30.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.452+0000 7f45e3fbc700 1 -- 172.21.15.50:0/2360925889 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45dc045ad0 con 0x7f45dc0f66e0 2023-01-04T18:11:30.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.453+0000 7f45d27fc700 1 -- 172.21.15.50:0/2360925889 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f45d801d420 con 0x7f45dc0f66e0 2023-01-04T18:11:30.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.453+0000 7f45d27fc700 1 --2- 172.21.15.50:0/2360925889 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f45c805c2b0 0x7f45c805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:11:30.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.453+0000 7f45d27fc700 1 -- 172.21.15.50:0/2360925889 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f45d8076b50 con 0x7f45dc0f66e0 2023-01-04T18:11:30.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.453+0000 7f45e1557700 1 --2- 172.21.15.50:0/2360925889 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f45c805c2b0 0x7f45c805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:11:30.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.453+0000 7f45e1557700 1 --2- 172.21.15.50:0/2360925889 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f45c805c2b0 0x7f45c805e770 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f45cc009740 tx=0x7f45cc009be0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:11:30.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.457+0000 7f45d27fc700 1 -- 172.21.15.50:0/2360925889 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f45d804a820 con 0x7f45dc0f66e0 2023-01-04T18:11:30.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:30.648+0000 7f45e3fbc700 1 -- 172.21.15.50:0/2360925889 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f45dc0008d0 con 0x7f45c805c2b0 2023-01-04T18:11:31.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:29.259289+0000 mgr.smithi050.emnywo (mgr.14162) 50 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:31.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:30.217452+0000 mon.smithi050 (mon.0) 194 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:31.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:30.218158+0000 mon.smithi050 (mon.0) 195 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi050.emnywo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-01-04T18:11:31.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:30.218846+0000 mon.smithi050 (mon.0) 196 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-01-04T18:11:31.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:30.219433+0000 mon.smithi050 (mon.0) 197 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:11:31.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:30.651526+0000 mon.smithi050 (mon.0) 198 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-01-04T18:11:31.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:30.652966+0000 mon.smithi050 (mon.0) 199 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-01-04T18:11:31.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:30.653546+0000 mon.smithi050 (mon.0) 200 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:11:31.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:29.259289+0000 mgr.smithi050.emnywo (mgr.14162) 50 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:31.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:30.217452+0000 mon.smithi050 (mon.0) 194 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:31.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:30.218158+0000 mon.smithi050 (mon.0) 195 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi050.emnywo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-01-04T18:11:31.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:30.218846+0000 mon.smithi050 (mon.0) 196 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-01-04T18:11:31.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:30.219433+0000 mon.smithi050 (mon.0) 197 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:11:31.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:30.651526+0000 mon.smithi050 (mon.0) 198 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-01-04T18:11:31.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:30.652966+0000 mon.smithi050 (mon.0) 199 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-01-04T18:11:31.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:30.653546+0000 mon.smithi050 (mon.0) 200 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:11:32.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:30.217920+0000 mgr.smithi050.emnywo (mgr.14162) 51 : cephadm [INF] Reconfiguring mgr.smithi050.emnywo (unknown last config time)... 2023-01-04T18:11:32.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:30.220013+0000 mgr.smithi050.emnywo (mgr.14162) 52 : cephadm [INF] Reconfiguring daemon mgr.smithi050.emnywo on smithi050 2023-01-04T18:11:32.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:30.650759+0000 mgr.smithi050.emnywo (mgr.14162) 53 : audit [DBG] from='client.14212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:11:32.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:30.652755+0000 mgr.smithi050.emnywo (mgr.14162) 54 : cephadm [INF] Applying service osd.None on host smithi050... 2023-01-04T18:11:32.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:31.437393+0000 mon.smithi050 (mon.0) 201 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:32.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:11:30.217920+0000 mgr.smithi050.emnywo (mgr.14162) 51 : cephadm [INF] Reconfiguring mgr.smithi050.emnywo (unknown last config time)... 2023-01-04T18:11:32.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:11:30.220013+0000 mgr.smithi050.emnywo (mgr.14162) 52 : cephadm [INF] Reconfiguring daemon mgr.smithi050.emnywo on smithi050 2023-01-04T18:11:32.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:30.650759+0000 mgr.smithi050.emnywo (mgr.14162) 53 : audit [DBG] from='client.14212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:11:32.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:11:30.652755+0000 mgr.smithi050.emnywo (mgr.14162) 54 : cephadm [INF] Applying service osd.None on host smithi050... 2023-01-04T18:11:32.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:31.437393+0000 mon.smithi050 (mon.0) 201 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:32.999 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:31.259640+0000 mgr.smithi050.emnywo (mgr.14162) 55 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:32.999 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:31.437984+0000 mgr.smithi050.emnywo (mgr.14162) 56 : cephadm [INF] Reconfiguring alertmanager.smithi050 (dependencies changed)... 2023-01-04T18:11:32.999 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:31.440197+0000 mgr.smithi050.emnywo (mgr.14162) 57 : cephadm [INF] Reconfiguring daemon alertmanager.smithi050 on smithi050 2023-01-04T18:11:33.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:31.259640+0000 mgr.smithi050.emnywo (mgr.14162) 55 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:33.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:11:31.437984+0000 mgr.smithi050.emnywo (mgr.14162) 56 : cephadm [INF] Reconfiguring alertmanager.smithi050 (dependencies changed)... 2023-01-04T18:11:33.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:11:31.440197+0000 mgr.smithi050.emnywo (mgr.14162) 57 : cephadm [INF] Reconfiguring daemon alertmanager.smithi050 on smithi050 2023-01-04T18:11:34.843 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:33.259978+0000 mgr.smithi050.emnywo (mgr.14162) 58 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:35.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:33.259978+0000 mgr.smithi050.emnywo (mgr.14162) 58 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:36.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:34.981969+0000 mon.smithi050 (mon.0) 202 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:36.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:34.982486+0000 mgr.smithi050.emnywo (mgr.14162) 59 : cephadm [INF] Reconfiguring crash.smithi050 (monmap changed)... 2023-01-04T18:11:36.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:34.982733+0000 mon.smithi050 (mon.0) 203 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi050", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-01-04T18:11:36.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:34.983372+0000 mon.smithi050 (mon.0) 204 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:11:36.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:34.983811+0000 mgr.smithi050.emnywo (mgr.14162) 60 : cephadm [INF] Reconfiguring daemon crash.smithi050 on smithi050 2023-01-04T18:11:36.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:35.937310+0000 mon.smithi050 (mon.0) 205 : audit [INF] from='client.? 172.21.15.50:0/1643041654' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "364b88f0-63eb-4ee0-9961-6d394328fb4a"}]: dispatch 2023-01-04T18:11:36.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:35.940552+0000 mon.smithi050 (mon.0) 206 : audit [INF] from='client.? 172.21.15.50:0/1643041654' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "364b88f0-63eb-4ee0-9961-6d394328fb4a"}]': finished 2023-01-04T18:11:36.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:35.940597+0000 mon.smithi050 (mon.0) 207 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2023-01-04T18:11:36.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:35.940685+0000 mon.smithi050 (mon.0) 208 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-01-04T18:11:36.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:34.981969+0000 mon.smithi050 (mon.0) 202 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:36.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:11:34.982486+0000 mgr.smithi050.emnywo (mgr.14162) 59 : cephadm [INF] Reconfiguring crash.smithi050 (monmap changed)... 2023-01-04T18:11:36.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:34.982733+0000 mon.smithi050 (mon.0) 203 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi050", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-01-04T18:11:36.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:34.983372+0000 mon.smithi050 (mon.0) 204 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:11:36.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:11:34.983811+0000 mgr.smithi050.emnywo (mgr.14162) 60 : cephadm [INF] Reconfiguring daemon crash.smithi050 on smithi050 2023-01-04T18:11:36.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:35.937310+0000 mon.smithi050 (mon.0) 205 : audit [INF] from='client.? 172.21.15.50:0/1643041654' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "364b88f0-63eb-4ee0-9961-6d394328fb4a"}]: dispatch 2023-01-04T18:11:36.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:35.940552+0000 mon.smithi050 (mon.0) 206 : audit [INF] from='client.? 172.21.15.50:0/1643041654' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "364b88f0-63eb-4ee0-9961-6d394328fb4a"}]': finished 2023-01-04T18:11:36.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:35.940597+0000 mon.smithi050 (mon.0) 207 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2023-01-04T18:11:36.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:35.940685+0000 mon.smithi050 (mon.0) 208 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-01-04T18:11:37.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:35.260362+0000 mgr.smithi050.emnywo (mgr.14162) 61 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:37.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:36.360259+0000 mon.smithi050 (mon.0) 209 : audit [DBG] from='client.? 172.21.15.50:0/1430943355' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-01-04T18:11:37.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:35.260362+0000 mgr.smithi050.emnywo (mgr.14162) 61 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:37.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:36.360259+0000 mon.smithi050 (mon.0) 209 : audit [DBG] from='client.? 172.21.15.50:0/1430943355' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-01-04T18:11:39.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:37.260787+0000 mgr.smithi050.emnywo (mgr.14162) 62 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:39.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:37.260787+0000 mgr.smithi050.emnywo (mgr.14162) 62 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:41.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:39.261181+0000 mgr.smithi050.emnywo (mgr.14162) 63 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:41.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:40.921127+0000 mon.smithi050 (mon.0) 210 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:41.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:39.261181+0000 mgr.smithi050.emnywo (mgr.14162) 63 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:41.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:40.921127+0000 mon.smithi050 (mon.0) 210 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:42.253 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:40.921637+0000 mgr.smithi050.emnywo (mgr.14162) 64 : cephadm [INF] Reconfiguring grafana.smithi050 (dependencies changed)... 2023-01-04T18:11:42.253 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:40.925844+0000 mgr.smithi050.emnywo (mgr.14162) 65 : cephadm [INF] Reconfiguring daemon grafana.smithi050 on smithi050 2023-01-04T18:11:42.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:11:40.921637+0000 mgr.smithi050.emnywo (mgr.14162) 64 : cephadm [INF] Reconfiguring grafana.smithi050 (dependencies changed)... 2023-01-04T18:11:42.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:11:40.925844+0000 mgr.smithi050.emnywo (mgr.14162) 65 : cephadm [INF] Reconfiguring daemon grafana.smithi050 on smithi050 2023-01-04T18:11:43.139 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:41.261809+0000 mgr.smithi050.emnywo (mgr.14162) 66 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:43.139 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:42.297701+0000 mon.smithi050 (mon.0) 211 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-01-04T18:11:43.139 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:42.298318+0000 mon.smithi050 (mon.0) 212 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:11:43.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:41.261809+0000 mgr.smithi050.emnywo (mgr.14162) 66 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:43.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:42.297701+0000 mon.smithi050 (mon.0) 211 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-01-04T18:11:43.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:42.298318+0000 mon.smithi050 (mon.0) 212 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:11:44.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:42.298839+0000 mgr.smithi050.emnywo (mgr.14162) 67 : cephadm [INF] Deploying daemon osd.0 on smithi050 2023-01-04T18:11:44.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:11:42.298839+0000 mgr.smithi050.emnywo (mgr.14162) 67 : cephadm [INF] Deploying daemon osd.0 on smithi050 2023-01-04T18:11:45.105 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:43.262139+0000 mgr.smithi050.emnywo (mgr.14162) 68 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:45.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:43.262139+0000 mgr.smithi050.emnywo (mgr.14162) 68 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:46.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:45.262466+0000 mgr.smithi050.emnywo (mgr.14162) 69 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:46.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:45.295696+0000 mon.smithi050 (mon.0) 213 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:46.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:11:45.296314+0000 mgr.smithi050.emnywo (mgr.14162) 70 : cephadm [INF] Reconfiguring prometheus.smithi050 (dependencies changed)... 2023-01-04T18:11:46.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:11:45.298280+0000 mgr.smithi050.emnywo (mgr.14162) 71 : cephadm [INF] Reconfiguring daemon prometheus.smithi050 on smithi050 2023-01-04T18:11:46.595 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:45.262466+0000 mgr.smithi050.emnywo (mgr.14162) 69 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:46.595 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:45.295696+0000 mon.smithi050 (mon.0) 213 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:46.595 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:45.296314+0000 mgr.smithi050.emnywo (mgr.14162) 70 : cephadm [INF] Reconfiguring prometheus.smithi050 (dependencies changed)... 2023-01-04T18:11:46.595 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:45.298280+0000 mgr.smithi050.emnywo (mgr.14162) 71 : cephadm [INF] Reconfiguring daemon prometheus.smithi050 on smithi050 2023-01-04T18:11:48.548 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 0 on host 'smithi050' 2023-01-04T18:11:48.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:48.543+0000 7f45d27fc700 1 -- 172.21.15.50:0/2360925889 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f45dc0008d0 con 0x7f45c805c2b0 2023-01-04T18:11:48.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:48.546+0000 7f45e3fbc700 1 -- 172.21.15.50:0/2360925889 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f45c805c2b0 msgr2=0x7f45c805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:11:48.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:48.546+0000 7f45e3fbc700 1 --2- 172.21.15.50:0/2360925889 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f45c805c2b0 0x7f45c805e770 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f45cc009740 tx=0x7f45cc009be0).stop 2023-01-04T18:11:48.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:48.546+0000 7f45e3fbc700 1 -- 172.21.15.50:0/2360925889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0f66e0 msgr2=0x7f45dc106fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:11:48.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:48.546+0000 7f45e3fbc700 1 --2- 172.21.15.50:0/2360925889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0f66e0 0x7f45dc106fd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f45d8004e30 tx=0x7f45d8009b30).stop 2023-01-04T18:11:48.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:48.547+0000 7f45e3fbc700 1 -- 172.21.15.50:0/2360925889 shutdown_connections 2023-01-04T18:11:48.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:48.547+0000 7f45e3fbc700 1 --2- 172.21.15.50:0/2360925889 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f45c805c2b0 0x7f45c805e770 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:48.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:48.547+0000 7f45e3fbc700 1 --2- 172.21.15.50:0/2360925889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0f66e0 0x7f45dc106fd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:48.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:48.547+0000 7f45e3fbc700 1 --2- 172.21.15.50:0/2360925889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45dc0f7980 0x7f45dc1074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:48.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:48.547+0000 7f45e3fbc700 1 -- 172.21.15.50:0/2360925889 >> 172.21.15.50:0/2360925889 conn(0x7f45dc0f1e40 msgr2=0x7f45dc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:11:48.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:48.547+0000 7f45e3fbc700 1 -- 172.21.15.50:0/2360925889 shutdown_connections 2023-01-04T18:11:48.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:48.547+0000 7f45e3fbc700 1 -- 172.21.15.50:0/2360925889 wait complete. 2023-01-04T18:11:48.575 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:47.262705+0000 mgr.smithi050.emnywo (mgr.14162) 72 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:48.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:47.262705+0000 mgr.smithi050.emnywo (mgr.14162) 72 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:49.277 DEBUG:teuthology.orchestra.run.smithi050:osd.0> sudo journalctl -f -n 0 -u ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.0.service 2023-01-04T18:11:49.280 INFO:tasks.cephadm:Deploying osd.1 on smithi050 with /dev/vg_nvme/lv_3... 2023-01-04T18:11:49.280 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-01-04T18:11:49.312 INFO:journalctl@ceph.osd.0.smithi050.stdout:-- Logs begin at Wed 2023-01-04 17:48:26 UTC. -- 2023-01-04T18:11:49.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:49 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:48.540343+0000 mon.smithi050 (mon.0) 214 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:49.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:49 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:48.544234+0000 mon.smithi050 (mon.0) 215 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:49.831 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:49 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:48.540343+0000 mon.smithi050 (mon.0) 214 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:49.831 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:49 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:48.544234+0000 mon.smithi050 (mon.0) 215 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:50.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:49.263140+0000 mgr.smithi050.emnywo (mgr.14162) 73 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:50.869 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:49.263140+0000 mgr.smithi050.emnywo (mgr.14162) 73 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:51.784 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-01-04T18:11:51.784 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-01-04T18:11:51.785 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10+0 records in 2023-01-04T18:11:51.785 INFO:teuthology.orchestra.run.smithi050.stderr:10+0 records out 2023-01-04T18:11:51.785 INFO:teuthology.orchestra.run.smithi050.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0136301 s, 769 MB/s 2023-01-04T18:11:51.785 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping successful for: 2023-01-04T18:11:52.318 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph orch daemon add osd smithi050:vg_nvme/lv_3 2023-01-04T18:11:52.790 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:11:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.0[143343]: debug 2023-01-04T18:11:52.533+0000 7ff718d26080 -1 osd.0 0 log_to_monitors {default=true} 2023-01-04T18:11:52.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:51.263405+0000 mgr.smithi050.emnywo (mgr.14162) 74 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:52.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:52.300545+0000 mon.smithi050 (mon.0) 216 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:52.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:52.301511+0000 mon.smithi050 (mon.0) 217 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi098", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-01-04T18:11:52.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:52.302355+0000 mon.smithi050 (mon.0) 218 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:11:52.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:52.537993+0000 mon.smithi050 (mon.0) 219 : audit [INF] from='osd.0 [v2:172.21.15.50:6802/2221606938,v1:172.21.15.50:6803/2221606938]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-01-04T18:11:52.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:51.263405+0000 mgr.smithi050.emnywo (mgr.14162) 74 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:52.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:52.300545+0000 mon.smithi050 (mon.0) 216 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:52.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:52.301511+0000 mon.smithi050 (mon.0) 217 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi098", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-01-04T18:11:52.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:52.302355+0000 mon.smithi050 (mon.0) 218 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:11:52.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:52.537993+0000 mon.smithi050 (mon.0) 219 : audit [INF] from='osd.0 [v2:172.21.15.50:6802/2221606938,v1:172.21.15.50:6803/2221606938]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-01-04T18:11:53.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:11:52.301181+0000 mgr.smithi050.emnywo (mgr.14162) 75 : cephadm [INF] Reconfiguring crash.smithi098 (monmap changed)... 2023-01-04T18:11:53.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:11:52.303096+0000 mgr.smithi050.emnywo (mgr.14162) 76 : cephadm [INF] Reconfiguring daemon crash.smithi098 on smithi098 2023-01-04T18:11:53.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:53.301564+0000 mon.smithi050 (mon.0) 220 : audit [INF] from='osd.0 [v2:172.21.15.50:6802/2221606938,v1:172.21.15.50:6803/2221606938]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-01-04T18:11:53.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:53.301617+0000 mon.smithi050 (mon.0) 221 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2023-01-04T18:11:53.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:53.301712+0000 mon.smithi050 (mon.0) 222 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-01-04T18:11:53.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:53.302056+0000 mon.smithi050 (mon.0) 223 : audit [INF] from='osd.0 [v2:172.21.15.50:6802/2221606938,v1:172.21.15.50:6803/2221606938]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-01-04T18:11:53.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:53.385827+0000 mon.smithi050 (mon.0) 224 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:53.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:53.386517+0000 mon.smithi050 (mon.0) 225 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.vhfzum", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-01-04T18:11:53.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:53.387203+0000 mon.smithi050 (mon.0) 226 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-01-04T18:11:53.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:53.387824+0000 mon.smithi050 (mon.0) 227 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:11:53.888 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:52.301181+0000 mgr.smithi050.emnywo (mgr.14162) 75 : cephadm [INF] Reconfiguring crash.smithi098 (monmap changed)... 2023-01-04T18:11:53.889 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:52.303096+0000 mgr.smithi050.emnywo (mgr.14162) 76 : cephadm [INF] Reconfiguring daemon crash.smithi098 on smithi098 2023-01-04T18:11:53.889 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:53.301564+0000 mon.smithi050 (mon.0) 220 : audit [INF] from='osd.0 [v2:172.21.15.50:6802/2221606938,v1:172.21.15.50:6803/2221606938]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-01-04T18:11:53.889 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:53.301617+0000 mon.smithi050 (mon.0) 221 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2023-01-04T18:11:53.889 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:53.301712+0000 mon.smithi050 (mon.0) 222 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-01-04T18:11:53.889 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:53.302056+0000 mon.smithi050 (mon.0) 223 : audit [INF] from='osd.0 [v2:172.21.15.50:6802/2221606938,v1:172.21.15.50:6803/2221606938]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-01-04T18:11:53.889 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:53.385827+0000 mon.smithi050 (mon.0) 224 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:53.889 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:53.386517+0000 mon.smithi050 (mon.0) 225 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.vhfzum", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-01-04T18:11:53.889 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:53.387203+0000 mon.smithi050 (mon.0) 226 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-01-04T18:11:53.890 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:53.387824+0000 mon.smithi050 (mon.0) 227 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:11:54.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.066+0000 7fc0386c1700 1 -- 172.21.15.50:0/1423874376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0300f7980 msgr2=0x7fc0300f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:11:54.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.066+0000 7fc0386c1700 1 --2- 172.21.15.50:0/1423874376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0300f7980 0x7fc0300f7de0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fc02c004660 tx=0x7fc02c009b30).stop 2023-01-04T18:11:54.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.066+0000 7fc0386c1700 1 -- 172.21.15.50:0/1423874376 shutdown_connections 2023-01-04T18:11:54.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.066+0000 7fc0386c1700 1 --2- 172.21.15.50:0/1423874376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0300f7980 0x7fc0300f7de0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:54.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.066+0000 7fc0386c1700 1 --2- 172.21.15.50:0/1423874376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0300f66e0 0x7fc0300f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:54.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.066+0000 7fc0386c1700 1 -- 172.21.15.50:0/1423874376 >> 172.21.15.50:0/1423874376 conn(0x7fc0300f1e40 msgr2=0x7fc0300f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:11:54.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.066+0000 7fc0386c1700 1 -- 172.21.15.50:0/1423874376 shutdown_connections 2023-01-04T18:11:54.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.066+0000 7fc0386c1700 1 -- 172.21.15.50:0/1423874376 wait complete. 2023-01-04T18:11:54.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.067+0000 7fc0386c1700 1 Processor -- start 2023-01-04T18:11:54.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.067+0000 7fc0386c1700 1 -- start start 2023-01-04T18:11:54.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.067+0000 7fc0386c1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0300f66e0 0x7fc030106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:11:54.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.067+0000 7fc0386c1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0300f7980 0x7fc030107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:11:54.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.067+0000 7fc0386c1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc030107a20 con 0x7fc0300f7980 2023-01-04T18:11:54.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.067+0000 7fc0386c1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc030107b60 con 0x7fc0300f66e0 2023-01-04T18:11:54.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.067+0000 7fc035c5c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0300f7980 0x7fc030107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:11:54.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.067+0000 7fc035c5c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0300f7980 0x7fc030107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36638/0 (socket says 172.21.15.50:36638) 2023-01-04T18:11:54.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.067+0000 7fc035c5c700 1 -- 172.21.15.50:0/2906607599 learned_addr learned my addr 172.21.15.50:0/2906607599 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:11:54.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.067+0000 7fc03645d700 1 --2- 172.21.15.50:0/2906607599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0300f66e0 0x7fc030106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:11:54.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.068+0000 7fc035c5c700 1 -- 172.21.15.50:0/2906607599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0300f66e0 msgr2=0x7fc030106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:11:54.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.068+0000 7fc035c5c700 1 --2- 172.21.15.50:0/2906607599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0300f66e0 0x7fc030106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:11:54.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.068+0000 7fc035c5c700 1 -- 172.21.15.50:0/2906607599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02c005040 con 0x7fc0300f7980 2023-01-04T18:11:54.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.068+0000 7fc035c5c700 1 --2- 172.21.15.50:0/2906607599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0300f7980 0x7fc030107470 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fc02c009830 tx=0x7fc02c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:11:54.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.068+0000 7fc026ffd700 1 -- 172.21.15.50:0/2906607599 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc02c018070 con 0x7fc0300f7980 2023-01-04T18:11:54.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.068+0000 7fc026ffd700 1 -- 172.21.15.50:0/2906607599 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc02c013410 con 0x7fc0300f7980 2023-01-04T18:11:54.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.068+0000 7fc0386c1700 1 -- 172.21.15.50:0/2906607599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0301084a0 con 0x7fc0300f7980 2023-01-04T18:11:54.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.068+0000 7fc026ffd700 1 -- 172.21.15.50:0/2906607599 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc02c01c400 con 0x7fc0300f7980 2023-01-04T18:11:54.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.068+0000 7fc0386c1700 1 -- 172.21.15.50:0/2906607599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc030108a00 con 0x7fc0300f7980 2023-01-04T18:11:54.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.069+0000 7fc0386c1700 1 -- 172.21.15.50:0/2906607599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc030045ad0 con 0x7fc0300f7980 2023-01-04T18:11:54.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.069+0000 7fc026ffd700 1 -- 172.21.15.50:0/2906607599 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc02c01d420 con 0x7fc0300f7980 2023-01-04T18:11:54.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.069+0000 7fc026ffd700 1 --2- 172.21.15.50:0/2906607599 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc01c05c2b0 0x7fc01c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:11:54.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.070+0000 7fc026ffd700 1 -- 172.21.15.50:0/2906607599 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1476+0+0 (secure 0 0 0) 0x7fc02c076e00 con 0x7fc0300f7980 2023-01-04T18:11:54.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.070+0000 7fc03645d700 1 --2- 172.21.15.50:0/2906607599 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc01c05c2b0 0x7fc01c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:11:54.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.070+0000 7fc03645d700 1 --2- 172.21.15.50:0/2906607599 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc01c05c2b0 0x7fc01c05e770 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fc0300f77e0 tx=0x7fc020009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:11:54.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.074+0000 7fc026ffd700 1 -- 172.21.15.50:0/2906607599 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc02c04aa00 con 0x7fc0300f7980 2023-01-04T18:11:54.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:11:54.262+0000 7fc0386c1700 1 -- 172.21.15.50:0/2906607599 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0300fefe0 con 0x7fc01c05c2b0 2023-01-04T18:11:54.760 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:11:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.0[143343]: debug 2023-01-04T18:11:54.304+0000 7ff70f297700 -1 osd.0 0 waiting for initial osdmap 2023-01-04T18:11:54.760 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:11:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.0[143343]: debug 2023-01-04T18:11:54.307+0000 7ff70ba13700 -1 osd.0 8 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2023-01-04T18:11:54.760 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:53.263669+0000 mgr.smithi050.emnywo (mgr.14162) 77 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:54.760 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:53.386254+0000 mgr.smithi050.emnywo (mgr.14162) 78 : cephadm [INF] Reconfiguring mgr.smithi098.vhfzum (monmap changed)... 2023-01-04T18:11:54.760 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:53.388321+0000 mgr.smithi050.emnywo (mgr.14162) 79 : cephadm [INF] Reconfiguring daemon mgr.smithi098.vhfzum on smithi098 2023-01-04T18:11:54.760 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:54.264638+0000 mon.smithi050 (mon.0) 228 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-01-04T18:11:54.761 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:54.266031+0000 mon.smithi050 (mon.0) 229 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-01-04T18:11:54.761 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:54.266618+0000 mon.smithi050 (mon.0) 230 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:11:54.761 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:54.302794+0000 mon.smithi050 (mon.0) 231 : audit [INF] from='osd.0 [v2:172.21.15.50:6802/2221606938,v1:172.21.15.50:6803/2221606938]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2023-01-04T18:11:54.761 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:54.302861+0000 mon.smithi050 (mon.0) 232 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2023-01-04T18:11:54.761 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:54.302986+0000 mon.smithi050 (mon.0) 233 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-01-04T18:11:54.761 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:54.305807+0000 mon.smithi050 (mon.0) 234 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-01-04T18:11:54.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:53.263669+0000 mgr.smithi050.emnywo (mgr.14162) 77 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:54.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:11:53.386254+0000 mgr.smithi050.emnywo (mgr.14162) 78 : cephadm [INF] Reconfiguring mgr.smithi098.vhfzum (monmap changed)... 2023-01-04T18:11:54.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:11:53.388321+0000 mgr.smithi050.emnywo (mgr.14162) 79 : cephadm [INF] Reconfiguring daemon mgr.smithi098.vhfzum on smithi098 2023-01-04T18:11:54.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:54.264638+0000 mon.smithi050 (mon.0) 228 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-01-04T18:11:54.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:54.266031+0000 mon.smithi050 (mon.0) 229 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-01-04T18:11:54.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:54.266618+0000 mon.smithi050 (mon.0) 230 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:11:54.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:54.302794+0000 mon.smithi050 (mon.0) 231 : audit [INF] from='osd.0 [v2:172.21.15.50:6802/2221606938,v1:172.21.15.50:6803/2221606938]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2023-01-04T18:11:54.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:54.302861+0000 mon.smithi050 (mon.0) 232 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2023-01-04T18:11:54.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:54.302986+0000 mon.smithi050 (mon.0) 233 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-01-04T18:11:54.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:54.305807+0000 mon.smithi050 (mon.0) 234 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-01-04T18:11:55.730 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:53.534419+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2023-01-04T18:11:55.730 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:53.534558+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2023-01-04T18:11:55.730 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:54.263915+0000 mgr.smithi050.emnywo (mgr.14162) 80 : audit [DBG] from='client.14230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:11:55.730 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:11:54.265796+0000 mgr.smithi050.emnywo (mgr.14162) 81 : cephadm [INF] Applying service osd.None on host smithi050... 2023-01-04T18:11:55.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:54.660088+0000 mon.smithi050 (mon.0) 235 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:55.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:11:54.660567+0000 mgr.smithi050.emnywo (mgr.14162) 82 : cephadm [INF] Reconfiguring mon.smithi098 (monmap changed)... 2023-01-04T18:11:55.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:54.660764+0000 mon.smithi050 (mon.0) 236 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-01-04T18:11:55.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:54.661334+0000 mon.smithi050 (mon.0) 237 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-01-04T18:11:55.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:54.661872+0000 mon.smithi050 (mon.0) 238 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:11:55.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:11:54.662337+0000 mgr.smithi050.emnywo (mgr.14162) 83 : cephadm [INF] Reconfiguring daemon mon.smithi098 on smithi098 2023-01-04T18:11:55.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:55.304602+0000 mon.smithi050 (mon.0) 239 : cluster [INF] osd.0 [v2:172.21.15.50:6802/2221606938,v1:172.21.15.50:6803/2221606938] boot 2023-01-04T18:11:55.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:55.304629+0000 mon.smithi050 (mon.0) 240 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2023-01-04T18:11:55.731 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:55.304731+0000 mon.smithi050 (mon.0) 241 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-01-04T18:11:56.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:53.534419+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2023-01-04T18:11:56.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:53.534558+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2023-01-04T18:11:56.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:54.263915+0000 mgr.smithi050.emnywo (mgr.14162) 80 : audit [DBG] from='client.14230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:11:56.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:54.265796+0000 mgr.smithi050.emnywo (mgr.14162) 81 : cephadm [INF] Applying service osd.None on host smithi050... 2023-01-04T18:11:56.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:54.660088+0000 mon.smithi050 (mon.0) 235 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:56.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:54.660567+0000 mgr.smithi050.emnywo (mgr.14162) 82 : cephadm [INF] Reconfiguring mon.smithi098 (monmap changed)... 2023-01-04T18:11:56.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:54.660764+0000 mon.smithi050 (mon.0) 236 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-01-04T18:11:56.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:54.661334+0000 mon.smithi050 (mon.0) 237 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-01-04T18:11:56.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:54.661872+0000 mon.smithi050 (mon.0) 238 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:11:56.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:11:54.662337+0000 mgr.smithi050.emnywo (mgr.14162) 83 : cephadm [INF] Reconfiguring daemon mon.smithi098 on smithi098 2023-01-04T18:11:56.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:55.304602+0000 mon.smithi050 (mon.0) 239 : cluster [INF] osd.0 [v2:172.21.15.50:6802/2221606938,v1:172.21.15.50:6803/2221606938] boot 2023-01-04T18:11:56.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:55.304629+0000 mon.smithi050 (mon.0) 240 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2023-01-04T18:11:56.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:55.304731+0000 mon.smithi050 (mon.0) 241 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-01-04T18:11:57.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:55.264013+0000 mgr.smithi050.emnywo (mgr.14162) 84 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:57.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:55.724011+0000 mon.smithi050 (mon.0) 242 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:57.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:55.726459+0000 mon.smithi050 (mon.0) 243 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-01-04T18:11:57.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:55.726755+0000 mgr.smithi050.emnywo (mgr.14162) 85 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-01-04T18:11:57.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:56.292597+0000 mon.smithi050 (mon.0) 244 : audit [INF] from='client.? 172.21.15.50:0/3557785261' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e3617b7-4f5a-417f-ac90-d557ed55507f"}]: dispatch 2023-01-04T18:11:57.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:56.296061+0000 mon.smithi050 (mon.0) 245 : audit [INF] from='client.? 172.21.15.50:0/3557785261' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e3617b7-4f5a-417f-ac90-d557ed55507f"}]': finished 2023-01-04T18:11:57.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:56.296113+0000 mon.smithi050 (mon.0) 246 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2023-01-04T18:11:57.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:56.296209+0000 mon.smithi050 (mon.0) 247 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-01-04T18:11:57.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:11:56.707923+0000 mon.smithi050 (mon.0) 248 : audit [DBG] from='client.? 172.21.15.50:0/3927242639' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-01-04T18:11:57.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:55.264013+0000 mgr.smithi050.emnywo (mgr.14162) 84 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-01-04T18:11:57.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:55.724011+0000 mon.smithi050 (mon.0) 242 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:11:57.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:55.726459+0000 mon.smithi050 (mon.0) 243 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-01-04T18:11:57.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:55.726755+0000 mgr.smithi050.emnywo (mgr.14162) 85 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-01-04T18:11:57.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:56.292597+0000 mon.smithi050 (mon.0) 244 : audit [INF] from='client.? 172.21.15.50:0/3557785261' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e3617b7-4f5a-417f-ac90-d557ed55507f"}]: dispatch 2023-01-04T18:11:57.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:56.296061+0000 mon.smithi050 (mon.0) 245 : audit [INF] from='client.? 172.21.15.50:0/3557785261' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e3617b7-4f5a-417f-ac90-d557ed55507f"}]': finished 2023-01-04T18:11:57.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:56.296113+0000 mon.smithi050 (mon.0) 246 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2023-01-04T18:11:57.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:56.296209+0000 mon.smithi050 (mon.0) 247 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-01-04T18:11:57.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:11:56.707923+0000 mon.smithi050 (mon.0) 248 : audit [DBG] from='client.? 172.21.15.50:0/3927242639' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-01-04T18:11:59.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:11:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:57.264510+0000 mgr.smithi050.emnywo (mgr.14162) 86 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-01-04T18:11:59.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:11:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:57.264510+0000 mgr.smithi050.emnywo (mgr.14162) 86 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-01-04T18:12:00.984 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:11:59.264896+0000 mgr.smithi050.emnywo (mgr.14162) 87 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-01-04T18:12:01.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:11:59.264896+0000 mgr.smithi050.emnywo (mgr.14162) 87 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-01-04T18:12:03.010 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:01.265167+0000 mgr.smithi050.emnywo (mgr.14162) 88 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-01-04T18:12:03.010 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:02.290330+0000 mon.smithi050 (mon.0) 249 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-01-04T18:12:03.011 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:02.290973+0000 mon.smithi050 (mon.0) 250 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:12:03.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:01.265167+0000 mgr.smithi050.emnywo (mgr.14162) 88 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-01-04T18:12:03.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:02.290330+0000 mon.smithi050 (mon.0) 249 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-01-04T18:12:03.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:02.290973+0000 mon.smithi050 (mon.0) 250 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:12:03.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:12:02.291542+0000 mgr.smithi050.emnywo (mgr.14162) 89 : cephadm [INF] Deploying daemon osd.1 on smithi050 2023-01-04T18:12:04.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:12:02.291542+0000 mgr.smithi050.emnywo (mgr.14162) 89 : cephadm [INF] Deploying daemon osd.1 on smithi050 2023-01-04T18:12:05.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:03.265552+0000 mgr.smithi050.emnywo (mgr.14162) 90 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-01-04T18:12:05.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:03.265552+0000 mgr.smithi050.emnywo (mgr.14162) 90 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-01-04T18:12:05.810 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 1 on host 'smithi050' 2023-01-04T18:12:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:05.807+0000 7fc026ffd700 1 -- 172.21.15.50:0/2906607599 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc0300fefe0 con 0x7fc01c05c2b0 2023-01-04T18:12:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:05.809+0000 7fc0386c1700 1 -- 172.21.15.50:0/2906607599 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc01c05c2b0 msgr2=0x7fc01c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:12:05.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:05.809+0000 7fc0386c1700 1 --2- 172.21.15.50:0/2906607599 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc01c05c2b0 0x7fc01c05e770 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fc0300f77e0 tx=0x7fc020009040).stop 2023-01-04T18:12:05.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:05.809+0000 7fc0386c1700 1 -- 172.21.15.50:0/2906607599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0300f7980 msgr2=0x7fc030107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:12:05.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:05.809+0000 7fc0386c1700 1 --2- 172.21.15.50:0/2906607599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0300f7980 0x7fc030107470 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fc02c009830 tx=0x7fc02c009b30).stop 2023-01-04T18:12:05.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:05.809+0000 7fc0386c1700 1 -- 172.21.15.50:0/2906607599 shutdown_connections 2023-01-04T18:12:05.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:05.809+0000 7fc0386c1700 1 --2- 172.21.15.50:0/2906607599 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc01c05c2b0 0x7fc01c05e770 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:12:05.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:05.809+0000 7fc0386c1700 1 --2- 172.21.15.50:0/2906607599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0300f66e0 0x7fc030106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:12:05.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:05.809+0000 7fc0386c1700 1 --2- 172.21.15.50:0/2906607599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0300f7980 0x7fc030107470 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:12:05.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:05.809+0000 7fc0386c1700 1 -- 172.21.15.50:0/2906607599 >> 172.21.15.50:0/2906607599 conn(0x7fc0300f1e40 msgr2=0x7fc0300fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:12:05.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:05.809+0000 7fc0386c1700 1 -- 172.21.15.50:0/2906607599 shutdown_connections 2023-01-04T18:12:05.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:05.810+0000 7fc0386c1700 1 -- 172.21.15.50:0/2906607599 wait complete. 2023-01-04T18:12:06.286 DEBUG:teuthology.orchestra.run.smithi050:osd.1> sudo journalctl -f -n 0 -u ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.1.service 2023-01-04T18:12:06.288 INFO:tasks.cephadm:Deploying osd.2 on smithi050 with /dev/vg_nvme/lv_2... 2023-01-04T18:12:06.289 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-01-04T18:12:06.321 INFO:journalctl@ceph.osd.1.smithi050.stdout:-- Logs begin at Wed 2023-01-04 17:48:26 UTC. -- 2023-01-04T18:12:07.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:05.265974+0000 mgr.smithi050.emnywo (mgr.14162) 91 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-01-04T18:12:07.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:05.803333+0000 mon.smithi050 (mon.0) 251 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:07.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:05.806647+0000 mon.smithi050 (mon.0) 252 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:07.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:05.813547+0000 mon.smithi050 (mon.0) 253 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.50:9093"}]: dispatch 2023-01-04T18:12:07.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:05.813864+0000 mgr.smithi050.emnywo (mgr.14162) 92 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.50:9093"}]: dispatch 2023-01-04T18:12:07.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:05.820040+0000 mon.smithi050 (mon.0) 254 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:07.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:05.823863+0000 mon.smithi050 (mon.0) 255 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-01-04T18:12:07.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:05.824193+0000 mgr.smithi050.emnywo (mgr.14162) 93 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-01-04T18:12:07.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:05.828699+0000 mon.smithi050 (mon.0) 256 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.50:3000"}]: dispatch 2023-01-04T18:12:07.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:05.828957+0000 mgr.smithi050.emnywo (mgr.14162) 94 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.50:3000"}]: dispatch 2023-01-04T18:12:07.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:05.832678+0000 mon.smithi050 (mon.0) 257 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:07.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:05.835774+0000 mon.smithi050 (mon.0) 258 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-01-04T18:12:07.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:05.836181+0000 mgr.smithi050.emnywo (mgr.14162) 95 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-01-04T18:12:07.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:05.840556+0000 mon.smithi050 (mon.0) 259 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.50:9095"}]: dispatch 2023-01-04T18:12:07.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:05.840841+0000 mgr.smithi050.emnywo (mgr.14162) 96 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.50:9095"}]: dispatch 2023-01-04T18:12:07.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:05.844521+0000 mon.smithi050 (mon.0) 260 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:07.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:05.845906+0000 mon.smithi050 (mon.0) 261 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:12:07.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:05.265974+0000 mgr.smithi050.emnywo (mgr.14162) 91 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-01-04T18:12:07.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:05.803333+0000 mon.smithi050 (mon.0) 251 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:07.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:05.806647+0000 mon.smithi050 (mon.0) 252 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:07.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:05.813547+0000 mon.smithi050 (mon.0) 253 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.50:9093"}]: dispatch 2023-01-04T18:12:07.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:05.813864+0000 mgr.smithi050.emnywo (mgr.14162) 92 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.50:9093"}]: dispatch 2023-01-04T18:12:07.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:05.820040+0000 mon.smithi050 (mon.0) 254 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:07.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:05.823863+0000 mon.smithi050 (mon.0) 255 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-01-04T18:12:07.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:05.824193+0000 mgr.smithi050.emnywo (mgr.14162) 93 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-01-04T18:12:07.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:05.828699+0000 mon.smithi050 (mon.0) 256 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.50:3000"}]: dispatch 2023-01-04T18:12:07.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:05.828957+0000 mgr.smithi050.emnywo (mgr.14162) 94 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.50:3000"}]: dispatch 2023-01-04T18:12:07.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:05.832678+0000 mon.smithi050 (mon.0) 257 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:07.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:05.835774+0000 mon.smithi050 (mon.0) 258 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-01-04T18:12:07.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:05.836181+0000 mgr.smithi050.emnywo (mgr.14162) 95 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-01-04T18:12:07.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:05.840556+0000 mon.smithi050 (mon.0) 259 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.50:9095"}]: dispatch 2023-01-04T18:12:07.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:05.840841+0000 mgr.smithi050.emnywo (mgr.14162) 96 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.50:9095"}]: dispatch 2023-01-04T18:12:07.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:05.844521+0000 mon.smithi050 (mon.0) 260 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:07.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:05.845906+0000 mon.smithi050 (mon.0) 261 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:12:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-01-04T18:12:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-01-04T18:12:08.270 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10+0 records in 2023-01-04T18:12:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:10+0 records out 2023-01-04T18:12:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00933947 s, 1.1 GB/s 2023-01-04T18:12:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping successful for: 2023-01-04T18:12:08.846 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph orch daemon add osd smithi050:vg_nvme/lv_2 2023-01-04T18:12:09.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:07.266396+0000 mgr.smithi050.emnywo (mgr.14162) 97 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-01-04T18:12:09.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:07.887142+0000 mon.smithi050 (mon.0) 262 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:09.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:07.266396+0000 mgr.smithi050.emnywo (mgr.14162) 97 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-01-04T18:12:09.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:07.887142+0000 mon.smithi050 (mon.0) 262 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:10.152 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:09 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:09.806866+0000 mon.smithi050 (mon.0) 263 : audit [INF] from='osd.1 [v2:172.21.15.50:6810/2500190979,v1:172.21.15.50:6811/2500190979]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-01-04T18:12:10.153 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:12:09 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.1[146792]: debug 2023-01-04T18:12:09.802+0000 7f763e50e080 -1 osd.1 0 log_to_monitors {default=true} 2023-01-04T18:12:10.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:09 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:09.806866+0000 mon.smithi050 (mon.0) 263 : audit [INF] from='osd.1 [v2:172.21.15.50:6810/2500190979,v1:172.21.15.50:6811/2500190979]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-01-04T18:12:10.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.622+0000 7fdc96d5a700 1 -- 172.21.15.50:0/3514006910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc900f6530 msgr2=0x7fdc900f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:12:10.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.622+0000 7fdc96d5a700 1 --2- 172.21.15.50:0/3514006910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc900f6530 0x7fdc900f6950 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fdc8c004660 tx=0x7fdc8c009b30).stop 2023-01-04T18:12:10.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.622+0000 7fdc96d5a700 1 -- 172.21.15.50:0/3514006910 shutdown_connections 2023-01-04T18:12:10.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.622+0000 7fdc96d5a700 1 --2- 172.21.15.50:0/3514006910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc900f77d0 0x7fdc900f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:12:10.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.622+0000 7fdc96d5a700 1 --2- 172.21.15.50:0/3514006910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc900f6530 0x7fdc900f6950 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:12:10.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.622+0000 7fdc96d5a700 1 -- 172.21.15.50:0/3514006910 >> 172.21.15.50:0/3514006910 conn(0x7fdc900f1c90 msgr2=0x7fdc900f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:12:10.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.622+0000 7fdc96d5a700 1 -- 172.21.15.50:0/3514006910 shutdown_connections 2023-01-04T18:12:10.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.622+0000 7fdc96d5a700 1 -- 172.21.15.50:0/3514006910 wait complete. 2023-01-04T18:12:10.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.622+0000 7fdc96d5a700 1 Processor -- start 2023-01-04T18:12:10.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.622+0000 7fdc96d5a700 1 -- start start 2023-01-04T18:12:10.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.623+0000 7fdc96d5a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc900f6530 0x7fdc90106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:12:10.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.623+0000 7fdc96d5a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc900f77d0 0x7fdc90107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:12:10.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.623+0000 7fdc96d5a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc90107910 con 0x7fdc900f6530 2023-01-04T18:12:10.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.623+0000 7fdc96d5a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc90108120 con 0x7fdc900f77d0 2023-01-04T18:12:10.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.623+0000 7fdc95d58700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc900f6530 0x7fdc90106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:12:10.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.623+0000 7fdc95d58700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc900f6530 0x7fdc90106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34022/0 (socket says 172.21.15.50:34022) 2023-01-04T18:12:10.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.623+0000 7fdc95d58700 1 -- 172.21.15.50:0/3643129994 learned_addr learned my addr 172.21.15.50:0/3643129994 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:12:10.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.623+0000 7fdc95557700 1 --2- 172.21.15.50:0/3643129994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc900f77d0 0x7fdc90107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:12:10.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.623+0000 7fdc95d58700 1 -- 172.21.15.50:0/3643129994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc900f77d0 msgr2=0x7fdc90107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:12:10.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.623+0000 7fdc95d58700 1 --2- 172.21.15.50:0/3643129994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc900f77d0 0x7fdc90107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:12:10.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.623+0000 7fdc95d58700 1 -- 172.21.15.50:0/3643129994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c005040 con 0x7fdc900f6530 2023-01-04T18:12:10.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.623+0000 7fdc95557700 1 --2- 172.21.15.50:0/3643129994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc900f77d0 0x7fdc90107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-01-04T18:12:10.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.623+0000 7fdc95d58700 1 --2- 172.21.15.50:0/3643129994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc900f6530 0x7fdc90106e20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fdc8c007a70 tx=0x7fdc8c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:12:10.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.623+0000 7fdc867fc700 1 -- 172.21.15.50:0/3643129994 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc8c018070 con 0x7fdc900f6530 2023-01-04T18:12:10.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.624+0000 7fdc867fc700 1 -- 172.21.15.50:0/3643129994 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdc8c009700 con 0x7fdc900f6530 2023-01-04T18:12:10.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.624+0000 7fdc867fc700 1 -- 172.21.15.50:0/3643129994 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc8c01c620 con 0x7fdc900f6530 2023-01-04T18:12:10.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.624+0000 7fdc96d5a700 1 -- 172.21.15.50:0/3643129994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc90108340 con 0x7fdc900f6530 2023-01-04T18:12:10.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.624+0000 7fdc96d5a700 1 -- 172.21.15.50:0/3643129994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc901088a0 con 0x7fdc900f6530 2023-01-04T18:12:10.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.625+0000 7fdc867fc700 1 -- 172.21.15.50:0/3643129994 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fdc8c01d420 con 0x7fdc900f6530 2023-01-04T18:12:10.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.626+0000 7fdc867fc700 1 --2- 172.21.15.50:0/3643129994 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fdc7c05c2f0 0x7fdc7c05e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:12:10.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.626+0000 7fdc867fc700 1 -- 172.21.15.50:0/3643129994 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2018+0+0 (secure 0 0 0) 0x7fdc8c0770e0 con 0x7fdc900f6530 2023-01-04T18:12:10.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.626+0000 7fdc95557700 1 --2- 172.21.15.50:0/3643129994 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fdc7c05c2f0 0x7fdc7c05e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:12:10.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.626+0000 7fdc95557700 1 --2- 172.21.15.50:0/3643129994 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fdc7c05c2f0 0x7fdc7c05e7b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fdc800041d0 tx=0x7fdc80009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:12:10.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.641+0000 7fdc96d5a700 1 -- 172.21.15.50:0/3643129994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc90059100 con 0x7fdc900f6530 2023-01-04T18:12:10.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.649+0000 7fdc867fc700 1 -- 172.21.15.50:0/3643129994 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fdc8c04aac0 con 0x7fdc900f6530 2023-01-04T18:12:10.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:10.841+0000 7fdc96d5a700 1 -- 172.21.15.50:0/3643129994 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc900fed30 con 0x7fdc7c05c2f0 2023-01-04T18:12:11.290 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:12:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.1[146792]: debug 2023-01-04T18:12:10.895+0000 7f7634a7f700 -1 osd.1 0 waiting for initial osdmap 2023-01-04T18:12:11.290 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:12:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.1[146792]: debug 2023-01-04T18:12:10.900+0000 7f76311fb700 -1 osd.1 12 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2023-01-04T18:12:11.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:09.266662+0000 mgr.smithi050.emnywo (mgr.14162) 98 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-01-04T18:12:11.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:09.892979+0000 mon.smithi050 (mon.0) 264 : audit [INF] from='osd.1 [v2:172.21.15.50:6810/2500190979,v1:172.21.15.50:6811/2500190979]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-01-04T18:12:11.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:09.893050+0000 mon.smithi050 (mon.0) 265 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2023-01-04T18:12:11.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:09.893165+0000 mon.smithi050 (mon.0) 266 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-01-04T18:12:11.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:09.893506+0000 mon.smithi050 (mon.0) 267 : audit [INF] from='osd.1 [v2:172.21.15.50:6810/2500190979,v1:172.21.15.50:6811/2500190979]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-01-04T18:12:11.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:10.844321+0000 mon.smithi050 (mon.0) 268 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-01-04T18:12:11.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:10.845552+0000 mon.smithi050 (mon.0) 269 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-01-04T18:12:11.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:10.846055+0000 mon.smithi050 (mon.0) 270 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:12:11.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:09.266662+0000 mgr.smithi050.emnywo (mgr.14162) 98 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-01-04T18:12:11.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:09.892979+0000 mon.smithi050 (mon.0) 264 : audit [INF] from='osd.1 [v2:172.21.15.50:6810/2500190979,v1:172.21.15.50:6811/2500190979]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-01-04T18:12:11.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:09.893050+0000 mon.smithi050 (mon.0) 265 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2023-01-04T18:12:11.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:09.893165+0000 mon.smithi050 (mon.0) 266 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-01-04T18:12:11.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:09.893506+0000 mon.smithi050 (mon.0) 267 : audit [INF] from='osd.1 [v2:172.21.15.50:6810/2500190979,v1:172.21.15.50:6811/2500190979]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-01-04T18:12:11.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:10.844321+0000 mon.smithi050 (mon.0) 268 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-01-04T18:12:11.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:10.845552+0000 mon.smithi050 (mon.0) 269 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-01-04T18:12:11.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:10.846055+0000 mon.smithi050 (mon.0) 270 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:12:12.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:10.843590+0000 mgr.smithi050.emnywo (mgr.14162) 99 : audit [DBG] from='client.14248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:12:12.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:12:10.845376+0000 mgr.smithi050.emnywo (mgr.14162) 100 : cephadm [INF] Applying service osd.None on host smithi050... 2023-01-04T18:12:12.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:10.894040+0000 mon.smithi050 (mon.0) 271 : audit [INF] from='osd.1 [v2:172.21.15.50:6810/2500190979,v1:172.21.15.50:6811/2500190979]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2023-01-04T18:12:12.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:10.894099+0000 mon.smithi050 (mon.0) 272 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2023-01-04T18:12:12.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:10.894419+0000 mon.smithi050 (mon.0) 273 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-01-04T18:12:12.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:10.897440+0000 mon.smithi050 (mon.0) 274 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-01-04T18:12:12.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:11.202359+0000 mon.smithi050 (mon.0) 275 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:12.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:11.897094+0000 mon.smithi050 (mon.0) 276 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-01-04T18:12:12.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:10.843590+0000 mgr.smithi050.emnywo (mgr.14162) 99 : audit [DBG] from='client.14248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:12:12.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:12:10.845376+0000 mgr.smithi050.emnywo (mgr.14162) 100 : cephadm [INF] Applying service osd.None on host smithi050... 2023-01-04T18:12:12.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:10.894040+0000 mon.smithi050 (mon.0) 271 : audit [INF] from='osd.1 [v2:172.21.15.50:6810/2500190979,v1:172.21.15.50:6811/2500190979]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2023-01-04T18:12:12.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:10.894099+0000 mon.smithi050 (mon.0) 272 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2023-01-04T18:12:12.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:10.894419+0000 mon.smithi050 (mon.0) 273 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-01-04T18:12:12.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:10.897440+0000 mon.smithi050 (mon.0) 274 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-01-04T18:12:12.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:11.202359+0000 mon.smithi050 (mon.0) 275 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:12.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:11.897094+0000 mon.smithi050 (mon.0) 276 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-01-04T18:12:13.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:10.806308+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2023-01-04T18:12:13.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:10.806417+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2023-01-04T18:12:13.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:11.266948+0000 mgr.smithi050.emnywo (mgr.14162) 101 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-01-04T18:12:13.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:11.901965+0000 mon.smithi050 (mon.0) 277 : cluster [INF] osd.1 [v2:172.21.15.50:6810/2500190979,v1:172.21.15.50:6811/2500190979] boot 2023-01-04T18:12:13.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:11.901997+0000 mon.smithi050 (mon.0) 278 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2023-01-04T18:12:13.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:11.902427+0000 mon.smithi050 (mon.0) 279 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-01-04T18:12:13.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:10.806308+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2023-01-04T18:12:13.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:10.806417+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2023-01-04T18:12:13.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:11.266948+0000 mgr.smithi050.emnywo (mgr.14162) 101 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2023-01-04T18:12:13.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:11.901965+0000 mon.smithi050 (mon.0) 277 : cluster [INF] osd.1 [v2:172.21.15.50:6810/2500190979,v1:172.21.15.50:6811/2500190979] boot 2023-01-04T18:12:13.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:11.901997+0000 mon.smithi050 (mon.0) 278 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2023-01-04T18:12:13.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:11.902427+0000 mon.smithi050 (mon.0) 279 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-01-04T18:12:14.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:13.036347+0000 mon.smithi050 (mon.0) 280 : audit [INF] from='client.? 172.21.15.50:0/2669450117' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5fb8cb5-19be-471e-a297-0cfa6721f960"}]: dispatch 2023-01-04T18:12:14.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:13.040150+0000 mon.smithi050 (mon.0) 281 : audit [INF] from='client.? 172.21.15.50:0/2669450117' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5fb8cb5-19be-471e-a297-0cfa6721f960"}]': finished 2023-01-04T18:12:14.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:13.040199+0000 mon.smithi050 (mon.0) 282 : cluster [DBG] osdmap e14: 3 total, 2 up, 3 in 2023-01-04T18:12:14.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:13.040292+0000 mon.smithi050 (mon.0) 283 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-01-04T18:12:14.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:13.405493+0000 mon.smithi050 (mon.0) 284 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:12:14.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:13.405703+0000 mon.smithi050 (mon.0) 285 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:12:14.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:13.466593+0000 mon.smithi050 (mon.0) 286 : audit [DBG] from='client.? 172.21.15.50:0/1641215632' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-01-04T18:12:14.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:13.036347+0000 mon.smithi050 (mon.0) 280 : audit [INF] from='client.? 172.21.15.50:0/2669450117' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5fb8cb5-19be-471e-a297-0cfa6721f960"}]: dispatch 2023-01-04T18:12:14.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:13.040150+0000 mon.smithi050 (mon.0) 281 : audit [INF] from='client.? 172.21.15.50:0/2669450117' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5fb8cb5-19be-471e-a297-0cfa6721f960"}]': finished 2023-01-04T18:12:14.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:13.040199+0000 mon.smithi050 (mon.0) 282 : cluster [DBG] osdmap e14: 3 total, 2 up, 3 in 2023-01-04T18:12:14.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:13.040292+0000 mon.smithi050 (mon.0) 283 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-01-04T18:12:14.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:13.405493+0000 mon.smithi050 (mon.0) 284 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:12:14.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:13.405703+0000 mon.smithi050 (mon.0) 285 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:12:14.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:13.466593+0000 mon.smithi050 (mon.0) 286 : audit [DBG] from='client.? 172.21.15.50:0/1641215632' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-01-04T18:12:15.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:13.267206+0000 mgr.smithi050.emnywo (mgr.14162) 102 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2023-01-04T18:12:15.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:13.267206+0000 mgr.smithi050.emnywo (mgr.14162) 102 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2023-01-04T18:12:16.483 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:15.267550+0000 mgr.smithi050.emnywo (mgr.14162) 103 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2023-01-04T18:12:16.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:15.267550+0000 mgr.smithi050.emnywo (mgr.14162) 103 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2023-01-04T18:12:18.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:17.267817+0000 mgr.smithi050.emnywo (mgr.14162) 104 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2023-01-04T18:12:18.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:17.267817+0000 mgr.smithi050.emnywo (mgr.14162) 104 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2023-01-04T18:12:19.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:12:18.719121+0000 mgr.smithi050.emnywo (mgr.14162) 105 : cephadm [INF] Detected new or changed devices on smithi050 2023-01-04T18:12:19.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:18.723800+0000 mon.smithi050 (mon.0) 287 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:19.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:18.726895+0000 mon.smithi050 (mon.0) 288 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:19.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:18.729223+0000 mon.smithi050 (mon.0) 289 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:12:19.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:19.541531+0000 mon.smithi050 (mon.0) 290 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-01-04T18:12:19.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:19.542202+0000 mon.smithi050 (mon.0) 291 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:12:20.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:12:18.719121+0000 mgr.smithi050.emnywo (mgr.14162) 105 : cephadm [INF] Detected new or changed devices on smithi050 2023-01-04T18:12:20.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:18.723800+0000 mon.smithi050 (mon.0) 287 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:20.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:18.726895+0000 mon.smithi050 (mon.0) 288 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:20.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:18.729223+0000 mon.smithi050 (mon.0) 289 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:12:20.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:19.541531+0000 mon.smithi050 (mon.0) 290 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-01-04T18:12:20.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:19.542202+0000 mon.smithi050 (mon.0) 291 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:12:20.779 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:19.268374+0000 mgr.smithi050.emnywo (mgr.14162) 106 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2023-01-04T18:12:20.779 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:12:19.542729+0000 mgr.smithi050.emnywo (mgr.14162) 107 : cephadm [INF] Deploying daemon osd.2 on smithi050 2023-01-04T18:12:21.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:19.268374+0000 mgr.smithi050.emnywo (mgr.14162) 106 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2023-01-04T18:12:21.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:12:19.542729+0000 mgr.smithi050.emnywo (mgr.14162) 107 : cephadm [INF] Deploying daemon osd.2 on smithi050 2023-01-04T18:12:22.173 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:20.870530+0000 mon.smithi050 (mon.0) 292 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:22.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:20.870530+0000 mon.smithi050 (mon.0) 292 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:23.124 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:21.268633+0000 mgr.smithi050.emnywo (mgr.14162) 108 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2023-01-04T18:12:23.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:23.170+0000 7fdc867fc700 1 -- 172.21.15.50:0/3643129994 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fdc900fed30 con 0x7fdc7c05c2f0 2023-01-04T18:12:23.174 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 2 on host 'smithi050' 2023-01-04T18:12:23.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:23.172+0000 7fdc96d5a700 1 -- 172.21.15.50:0/3643129994 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fdc7c05c2f0 msgr2=0x7fdc7c05e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:12:23.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:23.172+0000 7fdc96d5a700 1 --2- 172.21.15.50:0/3643129994 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fdc7c05c2f0 0x7fdc7c05e7b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fdc800041d0 tx=0x7fdc80009040).stop 2023-01-04T18:12:23.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:23.173+0000 7fdc96d5a700 1 -- 172.21.15.50:0/3643129994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc900f6530 msgr2=0x7fdc90106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:12:23.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:23.173+0000 7fdc96d5a700 1 --2- 172.21.15.50:0/3643129994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc900f6530 0x7fdc90106e20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fdc8c007a70 tx=0x7fdc8c009b30).stop 2023-01-04T18:12:23.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:23.173+0000 7fdc96d5a700 1 -- 172.21.15.50:0/3643129994 shutdown_connections 2023-01-04T18:12:23.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:23.173+0000 7fdc96d5a700 1 --2- 172.21.15.50:0/3643129994 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fdc7c05c2f0 0x7fdc7c05e7b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:12:23.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:23.173+0000 7fdc96d5a700 1 --2- 172.21.15.50:0/3643129994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc900f6530 0x7fdc90106e20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:12:23.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:23.173+0000 7fdc96d5a700 1 --2- 172.21.15.50:0/3643129994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc900f77d0 0x7fdc90107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:12:23.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:23.173+0000 7fdc96d5a700 1 -- 172.21.15.50:0/3643129994 >> 172.21.15.50:0/3643129994 conn(0x7fdc900f1c90 msgr2=0x7fdc900fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:12:23.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:23.173+0000 7fdc96d5a700 1 -- 172.21.15.50:0/3643129994 shutdown_connections 2023-01-04T18:12:23.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:12:23.173+0000 7fdc96d5a700 1 -- 172.21.15.50:0/3643129994 wait complete. 2023-01-04T18:12:23.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:21.268633+0000 mgr.smithi050.emnywo (mgr.14162) 108 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2023-01-04T18:12:23.666 DEBUG:teuthology.orchestra.run.smithi050:osd.2> sudo journalctl -f -n 0 -u ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.2.service 2023-01-04T18:12:23.669 INFO:tasks.cephadm:Deploying osd.3 on smithi098 with /dev/vg_nvme/lv_4... 2023-01-04T18:12:23.669 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-01-04T18:12:23.701 INFO:journalctl@ceph.osd.2.smithi050.stdout:-- Logs begin at Wed 2023-01-04 17:48:26 UTC. -- 2023-01-04T18:12:24.440 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:23.166286+0000 mon.smithi050 (mon.0) 293 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:24.440 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:23.171306+0000 mon.smithi050 (mon.0) 294 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:24.441 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:23.268925+0000 mgr.smithi050.emnywo (mgr.14162) 109 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2023-01-04T18:12:24.441 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:23.951007+0000 mon.smithi050 (mon.0) 295 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:24.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:23.166286+0000 mon.smithi050 (mon.0) 293 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:24.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:23.171306+0000 mon.smithi050 (mon.0) 294 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:24.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:23.268925+0000 mgr.smithi050.emnywo (mgr.14162) 109 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2023-01-04T18:12:24.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:23.951007+0000 mon.smithi050 (mon.0) 295 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:25.532 INFO:teuthology.orchestra.run.smithi098.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-01-04T18:12:25.533 INFO:teuthology.orchestra.run.smithi098.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-01-04T18:12:25.533 INFO:teuthology.orchestra.run.smithi098.stderr: stderr: 10+0 records in 2023-01-04T18:12:25.533 INFO:teuthology.orchestra.run.smithi098.stderr:10+0 records out 2023-01-04T18:12:25.533 INFO:teuthology.orchestra.run.smithi098.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111797 s, 938 MB/s 2023-01-04T18:12:25.533 INFO:teuthology.orchestra.run.smithi098.stderr:--> Zapping successful for: 2023-01-04T18:12:25.997 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph orch daemon add osd smithi098:vg_nvme/lv_4 2023-01-04T18:12:26.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:25.269600+0000 mgr.smithi050.emnywo (mgr.14162) 110 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2023-01-04T18:12:26.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:25.269600+0000 mgr.smithi050.emnywo (mgr.14162) 110 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2023-01-04T18:12:27.540 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:12:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.2[151157]: debug 2023-01-04T18:12:27.104+0000 7f95fd783080 -1 osd.2 0 log_to_monitors {default=true} 2023-01-04T18:12:27.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.584+0000 7f7da90d9700 1 -- 172.21.15.98:0/1550682589 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7da40f6860 msgr2=0x7f7da40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:12:27.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.584+0000 7f7da90d9700 1 --2- 172.21.15.98:0/1550682589 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7da40f6860 0x7f7da40f6cc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f7d98004660 tx=0x7f7d98009b30).stop 2023-01-04T18:12:27.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.584+0000 7f7da90d9700 1 -- 172.21.15.98:0/1550682589 shutdown_connections 2023-01-04T18:12:27.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.584+0000 7f7da90d9700 1 --2- 172.21.15.98:0/1550682589 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7da40f6860 0x7f7da40f6cc0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:12:27.589 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.584+0000 7f7da90d9700 1 --2- 172.21.15.98:0/1550682589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da40f55c0 0x7f7da40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:12:27.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.584+0000 7f7da90d9700 1 -- 172.21.15.98:0/1550682589 >> 172.21.15.98:0/1550682589 conn(0x7f7da40f0d40 msgr2=0x7f7da40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:12:27.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.584+0000 7f7da90d9700 1 -- 172.21.15.98:0/1550682589 shutdown_connections 2023-01-04T18:12:27.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.584+0000 7f7da90d9700 1 -- 172.21.15.98:0/1550682589 wait complete. 2023-01-04T18:12:27.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.585+0000 7f7da90d9700 1 Processor -- start 2023-01-04T18:12:27.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.585+0000 7f7da90d9700 1 -- start start 2023-01-04T18:12:27.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.585+0000 7f7da90d9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7da40f55c0 0x7f7da4105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:12:27.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.585+0000 7f7da90d9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da40f6860 0x7f7da4106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:12:27.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.585+0000 7f7da90d9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da4106920 con 0x7f7da40f6860 2023-01-04T18:12:27.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.585+0000 7f7da90d9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da4107130 con 0x7f7da40f55c0 2023-01-04T18:12:27.590 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.585+0000 7f7da2d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7da40f55c0 0x7f7da4105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:12:27.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.585+0000 7f7da2d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7da40f55c0 0x7f7da4105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51174/0 (socket says 172.21.15.98:51174) 2023-01-04T18:12:27.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.585+0000 7f7da2d9d700 1 -- 172.21.15.98:0/3661671747 learned_addr learned my addr 172.21.15.98:0/3661671747 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-01-04T18:12:27.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.585+0000 7f7da259c700 1 --2- 172.21.15.98:0/3661671747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da40f6860 0x7f7da4106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:12:27.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.586+0000 7f7da2d9d700 1 -- 172.21.15.98:0/3661671747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da40f6860 msgr2=0x7f7da4106320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:12:27.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.586+0000 7f7da2d9d700 1 --2- 172.21.15.98:0/3661671747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da40f6860 0x7f7da4106320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:12:27.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.586+0000 7f7da2d9d700 1 -- 172.21.15.98:0/3661671747 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d98005040 con 0x7f7da40f55c0 2023-01-04T18:12:27.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.586+0000 7f7da2d9d700 1 --2- 172.21.15.98:0/3661671747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7da40f55c0 0x7f7da4105e30 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f7d94004f70 tx=0x7f7d9400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:12:27.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.586+0000 7f7d8b7fe700 1 -- 172.21.15.98:0/3661671747 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d940094c0 con 0x7f7da40f55c0 2023-01-04T18:12:27.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.586+0000 7f7da90d9700 1 -- 172.21.15.98:0/3661671747 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da4107350 con 0x7f7da40f55c0 2023-01-04T18:12:27.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.586+0000 7f7d8b7fe700 1 -- 172.21.15.98:0/3661671747 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7d9400f040 con 0x7f7da40f55c0 2023-01-04T18:12:27.591 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.586+0000 7f7d8b7fe700 1 -- 172.21.15.98:0/3661671747 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d94012b30 con 0x7f7da40f55c0 2023-01-04T18:12:27.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.586+0000 7f7da90d9700 1 -- 172.21.15.98:0/3661671747 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da41078e0 con 0x7f7da40f55c0 2023-01-04T18:12:27.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.587+0000 7f7da90d9700 1 -- 172.21.15.98:0/3661671747 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da40f49b0 con 0x7f7da40f55c0 2023-01-04T18:12:27.592 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.587+0000 7f7d8b7fe700 1 -- 172.21.15.98:0/3661671747 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f7d94018030 con 0x7f7da40f55c0 2023-01-04T18:12:27.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.587+0000 7f7d8b7fe700 1 --2- 172.21.15.98:0/3661671747 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7d8c05c2a0 0x7f7d8c05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:12:27.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.588+0000 7f7d8b7fe700 1 -- 172.21.15.98:0/3661671747 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2429+0+0 (secure 0 0 0) 0x7f7d940773f0 con 0x7f7da40f55c0 2023-01-04T18:12:27.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.588+0000 7f7da259c700 1 --2- 172.21.15.98:0/3661671747 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7d8c05c2a0 0x7f7d8c05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:12:27.593 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.588+0000 7f7da259c700 1 --2- 172.21.15.98:0/3661671747 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7d8c05c2a0 0x7f7d8c05e760 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f7d98004d80 tx=0x7f7d98016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:12:27.594 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.592+0000 7f7d8b7fe700 1 -- 172.21.15.98:0/3661671747 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7d9404ac40 con 0x7f7da40f55c0 2023-01-04T18:12:27.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:27.770+0000 7f7da90d9700 1 -- 172.21.15.98:0/3661671747 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f7da40ff870 con 0x7f7d8c05c2a0 2023-01-04T18:12:28.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:26.982738+0000 mon.smithi050 (mon.0) 296 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:28.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:26.985599+0000 mon.smithi050 (mon.0) 297 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:28.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:26.987801+0000 mon.smithi050 (mon.0) 298 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:12:28.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:27.108374+0000 mon.smithi050 (mon.0) 299 : audit [INF] from='osd.2 [v2:172.21.15.50:6818/1577657554,v1:172.21.15.50:6819/1577657554]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-01-04T18:12:28.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:27.772984+0000 mon.smithi050 (mon.0) 300 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-01-04T18:12:28.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:27.774375+0000 mon.smithi050 (mon.0) 301 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-01-04T18:12:28.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:27.774936+0000 mon.smithi050 (mon.0) 302 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:12:28.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:26.982738+0000 mon.smithi050 (mon.0) 296 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:28.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:26.985599+0000 mon.smithi050 (mon.0) 297 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:28.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:26.987801+0000 mon.smithi050 (mon.0) 298 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:12:28.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:27.108374+0000 mon.smithi050 (mon.0) 299 : audit [INF] from='osd.2 [v2:172.21.15.50:6818/1577657554,v1:172.21.15.50:6819/1577657554]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-01-04T18:12:28.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:27.772984+0000 mon.smithi050 (mon.0) 300 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-01-04T18:12:28.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:27.774375+0000 mon.smithi050 (mon.0) 301 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-01-04T18:12:28.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:27.774936+0000 mon.smithi050 (mon.0) 302 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:12:29.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:27.269927+0000 mgr.smithi050.emnywo (mgr.14162) 111 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2023-01-04T18:12:29.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:27.772200+0000 mgr.smithi050.emnywo (mgr.14162) 112 : audit [DBG] from='client.24135 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:12:29.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:12:27.774138+0000 mgr.smithi050.emnywo (mgr.14162) 113 : cephadm [INF] Applying service osd.None on host smithi098... 2023-01-04T18:12:29.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:27.989314+0000 mon.smithi050 (mon.0) 303 : audit [INF] from='osd.2 [v2:172.21.15.50:6818/1577657554,v1:172.21.15.50:6819/1577657554]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-01-04T18:12:29.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:27.989399+0000 mon.smithi050 (mon.0) 304 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2023-01-04T18:12:29.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:27.989515+0000 mon.smithi050 (mon.0) 305 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-01-04T18:12:29.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:27.989835+0000 mon.smithi050 (mon.0) 306 : audit [INF] from='osd.2 [v2:172.21.15.50:6818/1577657554,v1:172.21.15.50:6819/1577657554]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-01-04T18:12:29.290 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:12:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.2[151157]: debug 2023-01-04T18:12:28.992+0000 7f95f3cf4700 -1 osd.2 0 waiting for initial osdmap 2023-01-04T18:12:29.290 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:12:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.2[151157]: debug 2023-01-04T18:12:28.997+0000 7f95edc6b700 -1 osd.2 16 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2023-01-04T18:12:29.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:27.269927+0000 mgr.smithi050.emnywo (mgr.14162) 111 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2023-01-04T18:12:29.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:27.772200+0000 mgr.smithi050.emnywo (mgr.14162) 112 : audit [DBG] from='client.24135 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:12:29.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:12:27.774138+0000 mgr.smithi050.emnywo (mgr.14162) 113 : cephadm [INF] Applying service osd.None on host smithi098... 2023-01-04T18:12:29.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:27.989314+0000 mon.smithi050 (mon.0) 303 : audit [INF] from='osd.2 [v2:172.21.15.50:6818/1577657554,v1:172.21.15.50:6819/1577657554]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-01-04T18:12:29.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:27.989399+0000 mon.smithi050 (mon.0) 304 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2023-01-04T18:12:29.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:27.989515+0000 mon.smithi050 (mon.0) 305 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-01-04T18:12:29.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:27.989835+0000 mon.smithi050 (mon.0) 306 : audit [INF] from='osd.2 [v2:172.21.15.50:6818/1577657554,v1:172.21.15.50:6819/1577657554]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-01-04T18:12:30.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:28.991013+0000 mon.smithi050 (mon.0) 307 : audit [INF] from='osd.2 [v2:172.21.15.50:6818/1577657554,v1:172.21.15.50:6819/1577657554]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2023-01-04T18:12:30.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:28.991076+0000 mon.smithi050 (mon.0) 308 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2023-01-04T18:12:30.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:28.991384+0000 mon.smithi050 (mon.0) 309 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-01-04T18:12:30.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:28.994797+0000 mon.smithi050 (mon.0) 310 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-01-04T18:12:30.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:29.829448+0000 mon.smithi050 (mon.0) 311 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:30.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:28.991013+0000 mon.smithi050 (mon.0) 307 : audit [INF] from='osd.2 [v2:172.21.15.50:6818/1577657554,v1:172.21.15.50:6819/1577657554]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2023-01-04T18:12:30.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:28.991076+0000 mon.smithi050 (mon.0) 308 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2023-01-04T18:12:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:28.991384+0000 mon.smithi050 (mon.0) 309 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-01-04T18:12:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:28.994797+0000 mon.smithi050 (mon.0) 310 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-01-04T18:12:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:29.829448+0000 mon.smithi050 (mon.0) 311 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:31.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:28.093357+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2023-01-04T18:12:31.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:28.093487+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2023-01-04T18:12:31.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:29.270167+0000 mgr.smithi050.emnywo (mgr.14162) 114 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2023-01-04T18:12:31.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:29.996039+0000 mon.smithi050 (mon.0) 312 : cluster [INF] osd.2 [v2:172.21.15.50:6818/1577657554,v1:172.21.15.50:6819/1577657554] boot 2023-01-04T18:12:31.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:29.996077+0000 mon.smithi050 (mon.0) 313 : cluster [DBG] osdmap e17: 3 total, 3 up, 3 in 2023-01-04T18:12:31.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:29.996479+0000 mon.smithi050 (mon.0) 314 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-01-04T18:12:31.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:30.040189+0000 mon.smithi098 (mon.1) 2 : audit [INF] from='client.? 172.21.15.98:0/2202068914' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ebc8dd52-f41d-4d85-a3bd-16ad8d121436"}]: dispatch 2023-01-04T18:12:31.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:30.040791+0000 mon.smithi050 (mon.0) 315 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ebc8dd52-f41d-4d85-a3bd-16ad8d121436"}]: dispatch 2023-01-04T18:12:31.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:30.044765+0000 mon.smithi050 (mon.0) 316 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ebc8dd52-f41d-4d85-a3bd-16ad8d121436"}]': finished 2023-01-04T18:12:31.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:30.044819+0000 mon.smithi050 (mon.0) 317 : cluster [DBG] osdmap e18: 4 total, 3 up, 4 in 2023-01-04T18:12:31.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:30.044941+0000 mon.smithi050 (mon.0) 318 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:12:31.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:30.466896+0000 mon.smithi098 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.98:0/2652244355' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-01-04T18:12:31.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:28.093357+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2023-01-04T18:12:31.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:28.093487+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2023-01-04T18:12:31.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:29.270167+0000 mgr.smithi050.emnywo (mgr.14162) 114 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2023-01-04T18:12:31.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:29.996039+0000 mon.smithi050 (mon.0) 312 : cluster [INF] osd.2 [v2:172.21.15.50:6818/1577657554,v1:172.21.15.50:6819/1577657554] boot 2023-01-04T18:12:31.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:29.996077+0000 mon.smithi050 (mon.0) 313 : cluster [DBG] osdmap e17: 3 total, 3 up, 3 in 2023-01-04T18:12:31.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:29.996479+0000 mon.smithi050 (mon.0) 314 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-01-04T18:12:31.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:30.040189+0000 mon.smithi098 (mon.1) 2 : audit [INF] from='client.? 172.21.15.98:0/2202068914' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ebc8dd52-f41d-4d85-a3bd-16ad8d121436"}]: dispatch 2023-01-04T18:12:31.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:30.040791+0000 mon.smithi050 (mon.0) 315 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ebc8dd52-f41d-4d85-a3bd-16ad8d121436"}]: dispatch 2023-01-04T18:12:31.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:30.044765+0000 mon.smithi050 (mon.0) 316 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ebc8dd52-f41d-4d85-a3bd-16ad8d121436"}]': finished 2023-01-04T18:12:31.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:30.044819+0000 mon.smithi050 (mon.0) 317 : cluster [DBG] osdmap e18: 4 total, 3 up, 4 in 2023-01-04T18:12:31.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:30.044941+0000 mon.smithi050 (mon.0) 318 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:12:31.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:30.466896+0000 mon.smithi098 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.98:0/2652244355' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-01-04T18:12:32.271 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:31.046261+0000 mon.smithi050 (mon.0) 319 : cluster [DBG] osdmap e19: 4 total, 3 up, 4 in 2023-01-04T18:12:32.272 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:31.046391+0000 mon.smithi050 (mon.0) 320 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:12:32.272 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:31.270429+0000 mgr.smithi050.emnywo (mgr.14162) 115 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-01-04T18:12:32.272 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:31.415507+0000 mon.smithi050 (mon.0) 321 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:32.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:31.046261+0000 mon.smithi050 (mon.0) 319 : cluster [DBG] osdmap e19: 4 total, 3 up, 4 in 2023-01-04T18:12:32.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:31.046391+0000 mon.smithi050 (mon.0) 320 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:12:32.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:31.270429+0000 mgr.smithi050.emnywo (mgr.14162) 115 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-01-04T18:12:32.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:31.415507+0000 mon.smithi050 (mon.0) 321 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:34.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:33.270707+0000 mgr.smithi050.emnywo (mgr.14162) 116 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-01-04T18:12:34.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:34.225763+0000 mon.smithi050 (mon.0) 322 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:34.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:33.270707+0000 mgr.smithi050.emnywo (mgr.14162) 116 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-01-04T18:12:34.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:34.225763+0000 mon.smithi050 (mon.0) 322 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:35.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:34.591829+0000 mon.smithi050 (mon.0) 323 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:36.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:34.591829+0000 mon.smithi050 (mon.0) 323 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:36.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:35.270988+0000 mgr.smithi050.emnywo (mgr.14162) 117 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-01-04T18:12:36.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:36.303761+0000 mon.smithi050 (mon.0) 324 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-01-04T18:12:36.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:36.304725+0000 mon.smithi050 (mon.0) 325 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:12:37.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:35.270988+0000 mgr.smithi050.emnywo (mgr.14162) 117 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-01-04T18:12:37.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:36.303761+0000 mon.smithi050 (mon.0) 324 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-01-04T18:12:37.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:36.304725+0000 mon.smithi050 (mon.0) 325 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:12:37.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:37 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:12:36.305523+0000 mgr.smithi050.emnywo (mgr.14162) 118 : cephadm [INF] Deploying daemon osd.3 on smithi098 2023-01-04T18:12:38.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:37 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:12:36.305523+0000 mgr.smithi050.emnywo (mgr.14162) 118 : cephadm [INF] Deploying daemon osd.3 on smithi098 2023-01-04T18:12:38.873 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:37.271337+0000 mgr.smithi050.emnywo (mgr.14162) 119 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-01-04T18:12:39.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:37.271337+0000 mgr.smithi050.emnywo (mgr.14162) 119 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-01-04T18:12:39.675 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 3 on host 'smithi098' 2023-01-04T18:12:39.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:39.671+0000 7f7d8b7fe700 1 -- 172.21.15.98:0/3661671747 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7da40ff870 con 0x7f7d8c05c2a0 2023-01-04T18:12:39.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:39.674+0000 7f7da90d9700 1 -- 172.21.15.98:0/3661671747 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7d8c05c2a0 msgr2=0x7f7d8c05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:12:39.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:39.674+0000 7f7da90d9700 1 --2- 172.21.15.98:0/3661671747 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7d8c05c2a0 0x7f7d8c05e760 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f7d98004d80 tx=0x7f7d98016040).stop 2023-01-04T18:12:39.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:39.674+0000 7f7da90d9700 1 -- 172.21.15.98:0/3661671747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7da40f55c0 msgr2=0x7f7da4105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:12:39.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:39.674+0000 7f7da90d9700 1 --2- 172.21.15.98:0/3661671747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7da40f55c0 0x7f7da4105e30 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f7d94004f70 tx=0x7f7d9400b040).stop 2023-01-04T18:12:39.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:39.674+0000 7f7da90d9700 1 -- 172.21.15.98:0/3661671747 shutdown_connections 2023-01-04T18:12:39.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:39.674+0000 7f7da90d9700 1 --2- 172.21.15.98:0/3661671747 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7d8c05c2a0 0x7f7d8c05e760 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:12:39.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:39.674+0000 7f7da90d9700 1 --2- 172.21.15.98:0/3661671747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7da40f55c0 0x7f7da4105e30 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:12:39.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:39.674+0000 7f7da90d9700 1 --2- 172.21.15.98:0/3661671747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7da40f6860 0x7f7da4106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:12:39.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:39.674+0000 7f7da90d9700 1 -- 172.21.15.98:0/3661671747 >> 172.21.15.98:0/3661671747 conn(0x7f7da40f0d40 msgr2=0x7f7da40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:12:39.677 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:39.674+0000 7f7da90d9700 1 -- 172.21.15.98:0/3661671747 shutdown_connections 2023-01-04T18:12:39.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:39.674+0000 7f7da90d9700 1 -- 172.21.15.98:0/3661671747 wait complete. 2023-01-04T18:12:40.245 DEBUG:teuthology.orchestra.run.smithi098:osd.3> sudo journalctl -f -n 0 -u ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.3.service 2023-01-04T18:12:40.247 INFO:tasks.cephadm:Deploying osd.4 on smithi098 with /dev/vg_nvme/lv_3... 2023-01-04T18:12:40.248 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-01-04T18:12:40.280 INFO:journalctl@ceph.osd.3.smithi098.stdout:-- Logs begin at Wed 2023-01-04 17:56:23 UTC. -- 2023-01-04T18:12:40.873 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:39.271810+0000 mgr.smithi050.emnywo (mgr.14162) 120 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-01-04T18:12:40.873 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:39.663073+0000 mon.smithi050 (mon.0) 326 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:12:40.873 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:39.666293+0000 mon.smithi050 (mon.0) 327 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:40.873 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:39.671113+0000 mon.smithi050 (mon.0) 328 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:40.873 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:39.676469+0000 mon.smithi050 (mon.0) 329 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2023-01-04T18:12:41.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:39.271810+0000 mgr.smithi050.emnywo (mgr.14162) 120 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-01-04T18:12:41.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:39.663073+0000 mon.smithi050 (mon.0) 326 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:12:41.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:39.666293+0000 mon.smithi050 (mon.0) 327 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:41.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:39.671113+0000 mon.smithi050 (mon.0) 328 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:41.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:39.676469+0000 mon.smithi050 (mon.0) 329 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2023-01-04T18:12:42.000 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:40.672909+0000 mon.smithi050 (mon.0) 330 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2023-01-04T18:12:42.000 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:40.672972+0000 mon.smithi050 (mon.0) 331 : cluster [DBG] osdmap e20: 4 total, 3 up, 4 in 2023-01-04T18:12:42.000 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:40.673093+0000 mon.smithi050 (mon.0) 332 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:12:42.000 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:40.673942+0000 mon.smithi050 (mon.0) 333 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-01-04T18:12:42.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:40.672909+0000 mon.smithi050 (mon.0) 330 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2023-01-04T18:12:42.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:40.672972+0000 mon.smithi050 (mon.0) 331 : cluster [DBG] osdmap e20: 4 total, 3 up, 4 in 2023-01-04T18:12:42.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:40.673093+0000 mon.smithi050 (mon.0) 332 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:12:42.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:40.673942+0000 mon.smithi050 (mon.0) 333 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-01-04T18:12:42.471 INFO:teuthology.orchestra.run.smithi098.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-01-04T18:12:42.472 INFO:teuthology.orchestra.run.smithi098.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-01-04T18:12:42.472 INFO:teuthology.orchestra.run.smithi098.stderr: stderr: 10+0 records in 2023-01-04T18:12:42.472 INFO:teuthology.orchestra.run.smithi098.stderr:10+0 records out 2023-01-04T18:12:42.472 INFO:teuthology.orchestra.run.smithi098.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0143612 s, 730 MB/s 2023-01-04T18:12:42.472 INFO:teuthology.orchestra.run.smithi098.stderr:--> Zapping successful for: 2023-01-04T18:12:42.765 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:41.272146+0000 mgr.smithi050.emnywo (mgr.14162) 121 : cluster [DBG] pgmap v83: 1 pgs: 1 unknown; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-01-04T18:12:42.765 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:41.676736+0000 mon.smithi050 (mon.0) 334 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2023-01-04T18:12:42.765 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:41.676805+0000 mon.smithi050 (mon.0) 335 : cluster [DBG] osdmap e21: 4 total, 3 up, 4 in 2023-01-04T18:12:42.765 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:41.677057+0000 mon.smithi050 (mon.0) 336 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:12:43.011 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph orch daemon add osd smithi098:vg_nvme/lv_3 2023-01-04T18:12:43.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:41.272146+0000 mgr.smithi050.emnywo (mgr.14162) 121 : cluster [DBG] pgmap v83: 1 pgs: 1 unknown; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2023-01-04T18:12:43.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:41.676736+0000 mon.smithi050 (mon.0) 334 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2023-01-04T18:12:43.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:41.676805+0000 mon.smithi050 (mon.0) 335 : cluster [DBG] osdmap e21: 4 total, 3 up, 4 in 2023-01-04T18:12:43.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:41.677057+0000 mon.smithi050 (mon.0) 336 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:12:43.839 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:12:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.3[109061]: debug 2023-01-04T18:12:43.622+0000 7fc8a3f9c080 -1 osd.3 0 log_to_monitors {default=true} 2023-01-04T18:12:43.839 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:42.678159+0000 mon.smithi050 (mon.0) 337 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2023-01-04T18:12:43.840 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:42.678467+0000 mon.smithi050 (mon.0) 338 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:12:43.840 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:43.196835+0000 mon.smithi050 (mon.0) 339 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:43.840 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:43.627275+0000 mon.smithi098 (mon.1) 4 : audit [INF] from='osd.3 [v2:172.21.15.98:6800/4254376132,v1:172.21.15.98:6801/4254376132]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-01-04T18:12:43.840 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:43.627590+0000 mon.smithi050 (mon.0) 340 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-01-04T18:12:44.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:42.678159+0000 mon.smithi050 (mon.0) 337 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2023-01-04T18:12:44.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:42.678467+0000 mon.smithi050 (mon.0) 338 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:12:44.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:43.196835+0000 mon.smithi050 (mon.0) 339 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:44.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:43.627275+0000 mon.smithi098 (mon.1) 4 : audit [INF] from='osd.3 [v2:172.21.15.98:6800/4254376132,v1:172.21.15.98:6801/4254376132]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-01-04T18:12:44.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:43.627590+0000 mon.smithi050 (mon.0) 340 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-01-04T18:12:44.760 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:43.272592+0000 mgr.smithi050.emnywo (mgr.14162) 122 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-01-04T18:12:44.760 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:44.199852+0000 mon.smithi050 (mon.0) 341 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-01-04T18:12:44.760 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:44.199932+0000 mon.smithi050 (mon.0) 342 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2023-01-04T18:12:44.760 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:44.200045+0000 mon.smithi050 (mon.0) 343 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:12:44.760 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:44.201132+0000 mon.smithi098 (mon.1) 5 : audit [INF] from='osd.3 [v2:172.21.15.98:6800/4254376132,v1:172.21.15.98:6801/4254376132]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:12:44.760 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:44.201438+0000 mon.smithi050 (mon.0) 344 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:12:44.760 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:44.205930+0000 mon.smithi050 (mon.0) 345 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:45.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:43.272592+0000 mgr.smithi050.emnywo (mgr.14162) 122 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-01-04T18:12:45.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:44.199852+0000 mon.smithi050 (mon.0) 341 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-01-04T18:12:45.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:44.199932+0000 mon.smithi050 (mon.0) 342 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2023-01-04T18:12:45.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:44.200045+0000 mon.smithi050 (mon.0) 343 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:12:45.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:44.201132+0000 mon.smithi098 (mon.1) 5 : audit [INF] from='osd.3 [v2:172.21.15.98:6800/4254376132,v1:172.21.15.98:6801/4254376132]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:12:45.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:44.201438+0000 mon.smithi050 (mon.0) 344 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:12:45.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:44.205930+0000 mon.smithi050 (mon.0) 345 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:45.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.070+0000 7fede8531700 1 -- 172.21.15.98:0/3075654162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fede00f6860 msgr2=0x7fede00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:12:45.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.070+0000 7fede8531700 1 --2- 172.21.15.98:0/3075654162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fede00f6860 0x7fede00f6cc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7feddc004660 tx=0x7feddc009b30).stop 2023-01-04T18:12:45.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.070+0000 7fede8531700 1 -- 172.21.15.98:0/3075654162 shutdown_connections 2023-01-04T18:12:45.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.070+0000 7fede8531700 1 --2- 172.21.15.98:0/3075654162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fede00f6860 0x7fede00f6cc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:12:45.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.070+0000 7fede8531700 1 --2- 172.21.15.98:0/3075654162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede00f55c0 0x7fede00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-01-04T18:12:45.075 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.070+0000 7fede8531700 1 -- 172.21.15.98:0/3075654162 >> 172.21.15.98:0/3075654162 conn(0x7fede00f0d40 msgr2=0x7fede00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:12:45.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.070+0000 7fede8531700 1 -- 172.21.15.98:0/3075654162 shutdown_connections 2023-01-04T18:12:45.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.070+0000 7fede8531700 1 -- 172.21.15.98:0/3075654162 wait complete. 2023-01-04T18:12:45.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.070+0000 7fede8531700 1 Processor -- start 2023-01-04T18:12:45.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.071+0000 7fede8531700 1 -- start start 2023-01-04T18:12:45.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.071+0000 7fede8531700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fede00f55c0 0x7fede010c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:12:45.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.071+0000 7fede8531700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede00f6860 0x7fede010e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:12:45.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.071+0000 7fede8531700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede00602b0 con 0x7fede00f6860 2023-01-04T18:12:45.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.071+0000 7fede8531700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede00603f0 con 0x7fede00f55c0 2023-01-04T18:12:45.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.071+0000 7fede62cd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fede00f55c0 0x7fede010c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:12:45.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.071+0000 7fede62cd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fede00f55c0 0x7fede010c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39586/0 (socket says 172.21.15.98:39586) 2023-01-04T18:12:45.076 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.071+0000 7fede62cd700 1 -- 172.21.15.98:0/1609040062 learned_addr learned my addr 172.21.15.98:0/1609040062 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-01-04T18:12:45.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.071+0000 7fede62cd700 1 -- 172.21.15.98:0/1609040062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede00f6860 msgr2=0x7fede010e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:12:45.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.071+0000 7fede5acc700 1 --2- 172.21.15.98:0/1609040062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede00f6860 0x7fede010e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:12:45.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.071+0000 7fede62cd700 1 --2- 172.21.15.98:0/1609040062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede00f6860 0x7fede010e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:12:45.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.071+0000 7fede62cd700 1 -- 172.21.15.98:0/1609040062 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc005040 con 0x7fede00f55c0 2023-01-04T18:12:45.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.071+0000 7fede62cd700 1 --2- 172.21.15.98:0/1609040062 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fede00f55c0 0x7fede010c0d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fedd00093f0 tx=0x7fedd0006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:12:45.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.071+0000 7fedd6ffd700 1 -- 172.21.15.98:0/1609040062 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedd0009ea0 con 0x7fede00f55c0 2023-01-04T18:12:45.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.071+0000 7fedd6ffd700 1 -- 172.21.15.98:0/1609040062 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fedd0013af0 con 0x7fede00f55c0 2023-01-04T18:12:45.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.071+0000 7fede8531700 1 -- 172.21.15.98:0/1609040062 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede010eac0 con 0x7fede00f55c0 2023-01-04T18:12:45.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.071+0000 7fedd6ffd700 1 -- 172.21.15.98:0/1609040062 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedd000dad0 con 0x7fede00f55c0 2023-01-04T18:12:45.077 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.072+0000 7fede8531700 1 -- 172.21.15.98:0/1609040062 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede010efa0 con 0x7fede00f55c0 2023-01-04T18:12:45.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.072+0000 7fede8531700 1 -- 172.21.15.98:0/1609040062 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede0045ad0 con 0x7fede00f55c0 2023-01-04T18:12:45.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.073+0000 7fedd6ffd700 1 -- 172.21.15.98:0/1609040062 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fedd001a060 con 0x7fede00f55c0 2023-01-04T18:12:45.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.073+0000 7fedd6ffd700 1 --2- 172.21.15.98:0/1609040062 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fedcc05c2b0 0x7fedcc05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:12:45.078 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.073+0000 7fedd6ffd700 1 -- 172.21.15.98:0/1609040062 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3282+0+0 (secure 0 0 0) 0x7fedd00756a0 con 0x7fede00f55c0 2023-01-04T18:12:45.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.073+0000 7fede5acc700 1 --2- 172.21.15.98:0/1609040062 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fedcc05c2b0 0x7fedcc05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:12:45.079 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.074+0000 7fede5acc700 1 --2- 172.21.15.98:0/1609040062 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fedcc05c2b0 0x7fedcc05e770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7feddc009d60 tx=0x7feddc009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:12:45.080 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.077+0000 7fedd6ffd700 1 -- 172.21.15.98:0/1609040062 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fedd0048b90 con 0x7fede00f55c0 2023-01-04T18:12:45.273 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:45.269+0000 7fede8531700 1 -- 172.21.15.98:0/1609040062 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fede0057f10 con 0x7fedcc05c2b0 2023-01-04T18:12:45.580 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:12:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.3[109061]: debug 2023-01-04T18:12:45.203+0000 7fc89a50d700 -1 osd.3 0 waiting for initial osdmap 2023-01-04T18:12:45.580 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:12:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.3[109061]: debug 2023-01-04T18:12:45.208+0000 7fc893c83700 -1 osd.3 24 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2023-01-04T18:12:46.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:45.202505+0000 mon.smithi050 (mon.0) 346 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2023-01-04T18:12:46.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:45.202619+0000 mon.smithi050 (mon.0) 347 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2023-01-04T18:12:46.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:45.202817+0000 mon.smithi050 (mon.0) 348 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:12:46.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:45.205759+0000 mon.smithi050 (mon.0) 349 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:12:46.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:45.272471+0000 mgr.smithi050.emnywo (mgr.14162) 123 : audit [DBG] from='client.24153 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:12:46.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:45.272888+0000 mgr.smithi050.emnywo (mgr.14162) 124 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-01-04T18:12:46.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:45.273432+0000 mon.smithi050 (mon.0) 350 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-01-04T18:12:46.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:12:45.274772+0000 mgr.smithi050.emnywo (mgr.14162) 125 : cephadm [INF] Applying service osd.None on host smithi098... 2023-01-04T18:12:46.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:45.275065+0000 mon.smithi050 (mon.0) 351 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-01-04T18:12:46.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:45.275854+0000 mon.smithi050 (mon.0) 352 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:12:46.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:45.202505+0000 mon.smithi050 (mon.0) 346 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2023-01-04T18:12:46.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:45.202619+0000 mon.smithi050 (mon.0) 347 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2023-01-04T18:12:46.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:45.202817+0000 mon.smithi050 (mon.0) 348 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:12:46.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:45.205759+0000 mon.smithi050 (mon.0) 349 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:12:46.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:45.272471+0000 mgr.smithi050.emnywo (mgr.14162) 123 : audit [DBG] from='client.24153 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:12:46.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:45.272888+0000 mgr.smithi050.emnywo (mgr.14162) 124 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-01-04T18:12:46.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:45.273432+0000 mon.smithi050 (mon.0) 350 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-01-04T18:12:46.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:12:45.274772+0000 mgr.smithi050.emnywo (mgr.14162) 125 : cephadm [INF] Applying service osd.None on host smithi098... 2023-01-04T18:12:46.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:45.275065+0000 mon.smithi050 (mon.0) 351 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-01-04T18:12:46.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:45.275854+0000 mon.smithi050 (mon.0) 352 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:12:47.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:47 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:44.642044+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2023-01-04T18:12:47.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:47 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:44.642138+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2023-01-04T18:12:47.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:47 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:46.208518+0000 mon.smithi050 (mon.0) 353 : cluster [INF] osd.3 [v2:172.21.15.98:6800/4254376132,v1:172.21.15.98:6801/4254376132] boot 2023-01-04T18:12:47.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:47 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:46.208588+0000 mon.smithi050 (mon.0) 354 : cluster [DBG] osdmap e25: 4 total, 4 up, 4 in 2023-01-04T18:12:47.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:47 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:46.208954+0000 mon.smithi050 (mon.0) 355 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:12:47.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:47 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:47.135707+0000 mon.smithi050 (mon.0) 356 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:47.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:47 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:47.139471+0000 mon.smithi050 (mon.0) 357 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:47.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:47 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:47.142520+0000 mon.smithi050 (mon.0) 358 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:12:47.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:44.642044+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2023-01-04T18:12:47.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:44.642138+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2023-01-04T18:12:47.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:46.208518+0000 mon.smithi050 (mon.0) 353 : cluster [INF] osd.3 [v2:172.21.15.98:6800/4254376132,v1:172.21.15.98:6801/4254376132] boot 2023-01-04T18:12:47.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:46.208588+0000 mon.smithi050 (mon.0) 354 : cluster [DBG] osdmap e25: 4 total, 4 up, 4 in 2023-01-04T18:12:47.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:46.208954+0000 mon.smithi050 (mon.0) 355 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:12:47.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:47.135707+0000 mon.smithi050 (mon.0) 356 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:47.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:47.139471+0000 mon.smithi050 (mon.0) 357 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:47.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:47.142520+0000 mon.smithi050 (mon.0) 358 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:12:48.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:12:47.130741+0000 mgr.smithi050.emnywo (mgr.14162) 126 : cephadm [INF] Detected new or changed devices on smithi098 2023-01-04T18:12:48.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:47.208491+0000 mon.smithi050 (mon.0) 359 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2023-01-04T18:12:48.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:47.273193+0000 mgr.smithi050.emnywo (mgr.14162) 127 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-01-04T18:12:48.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:47.739797+0000 mon.smithi098 (mon.1) 6 : audit [INF] from='client.? 172.21.15.98:0/358517094' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37f00733-dce6-4862-96b7-2eab49821451"}]: dispatch 2023-01-04T18:12:48.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:47.740199+0000 mon.smithi050 (mon.0) 360 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37f00733-dce6-4862-96b7-2eab49821451"}]: dispatch 2023-01-04T18:12:48.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:47.744255+0000 mon.smithi050 (mon.0) 361 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37f00733-dce6-4862-96b7-2eab49821451"}]': finished 2023-01-04T18:12:48.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:47.744335+0000 mon.smithi050 (mon.0) 362 : cluster [DBG] osdmap e27: 5 total, 4 up, 5 in 2023-01-04T18:12:48.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:47.744451+0000 mon.smithi050 (mon.0) 363 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-01-04T18:12:48.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:48.162861+0000 mon.smithi098 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.98:0/3430376879' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-01-04T18:12:48.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:12:47.130741+0000 mgr.smithi050.emnywo (mgr.14162) 126 : cephadm [INF] Detected new or changed devices on smithi098 2023-01-04T18:12:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:47.208491+0000 mon.smithi050 (mon.0) 359 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2023-01-04T18:12:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:47.273193+0000 mgr.smithi050.emnywo (mgr.14162) 127 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-01-04T18:12:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:47.739797+0000 mon.smithi098 (mon.1) 6 : audit [INF] from='client.? 172.21.15.98:0/358517094' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37f00733-dce6-4862-96b7-2eab49821451"}]: dispatch 2023-01-04T18:12:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:47.740199+0000 mon.smithi050 (mon.0) 360 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37f00733-dce6-4862-96b7-2eab49821451"}]: dispatch 2023-01-04T18:12:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:47.744255+0000 mon.smithi050 (mon.0) 361 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37f00733-dce6-4862-96b7-2eab49821451"}]': finished 2023-01-04T18:12:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:47.744335+0000 mon.smithi050 (mon.0) 362 : cluster [DBG] osdmap e27: 5 total, 4 up, 5 in 2023-01-04T18:12:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:47.744451+0000 mon.smithi050 (mon.0) 363 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-01-04T18:12:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:48.162861+0000 mon.smithi098 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.98:0/3430376879' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-01-04T18:12:50.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:49.273528+0000 mgr.smithi050.emnywo (mgr.14162) 128 : cluster [DBG] pgmap v94: 1 pgs: 1 activating; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-01-04T18:12:50.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:49.273528+0000 mgr.smithi050.emnywo (mgr.14162) 128 : cluster [DBG] pgmap v94: 1 pgs: 1 activating; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-01-04T18:12:53.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:51.273835+0000 mgr.smithi050.emnywo (mgr.14162) 129 : cluster [DBG] pgmap v95: 1 pgs: 1 activating; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-01-04T18:12:53.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:51.779664+0000 mon.smithi050 (mon.0) 364 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:53.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:51.782514+0000 mon.smithi050 (mon.0) 365 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:53.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:51.273835+0000 mgr.smithi050.emnywo (mgr.14162) 129 : cluster [DBG] pgmap v95: 1 pgs: 1 activating; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-01-04T18:12:53.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:51.779664+0000 mon.smithi050 (mon.0) 364 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:53.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:51.782514+0000 mon.smithi050 (mon.0) 365 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:55.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:53.274209+0000 mgr.smithi050.emnywo (mgr.14162) 130 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-01-04T18:12:55.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:54.094862+0000 mon.smithi050 (mon.0) 366 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-01-04T18:12:55.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:54.095757+0000 mon.smithi050 (mon.0) 367 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:12:55.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:53.274209+0000 mgr.smithi050.emnywo (mgr.14162) 130 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-01-04T18:12:55.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:54.094862+0000 mon.smithi050 (mon.0) 366 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-01-04T18:12:55.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:54.095757+0000 mon.smithi050 (mon.0) 367 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:12:56.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:12:54.096506+0000 mgr.smithi050.emnywo (mgr.14162) 131 : cephadm [INF] Deploying daemon osd.4 on smithi098 2023-01-04T18:12:56.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:12:54.096506+0000 mgr.smithi050.emnywo (mgr.14162) 131 : cephadm [INF] Deploying daemon osd.4 on smithi098 2023-01-04T18:12:56.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:55.274659+0000 mgr.smithi050.emnywo (mgr.14162) 132 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-01-04T18:12:57.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:55.274659+0000 mgr.smithi050.emnywo (mgr.14162) 132 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-01-04T18:12:57.667 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 4 on host 'smithi098' 2023-01-04T18:12:57.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:57.662+0000 7fedd6ffd700 1 -- 172.21.15.98:0/1609040062 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fede0057f10 con 0x7fedcc05c2b0 2023-01-04T18:12:57.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:57.664+0000 7fede8531700 1 -- 172.21.15.98:0/1609040062 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fedcc05c2b0 msgr2=0x7fedcc05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:12:57.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:57.664+0000 7fede8531700 1 --2- 172.21.15.98:0/1609040062 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fedcc05c2b0 0x7fedcc05e770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7feddc009d60 tx=0x7feddc009b30).stop 2023-01-04T18:12:57.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:57.665+0000 7fede8531700 1 -- 172.21.15.98:0/1609040062 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fede00f55c0 msgr2=0x7fede010c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:12:57.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:57.665+0000 7fede8531700 1 --2- 172.21.15.98:0/1609040062 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fede00f55c0 0x7fede010c0d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fedd00093f0 tx=0x7fedd0006ec0).stop 2023-01-04T18:12:57.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:57.665+0000 7fede8531700 1 -- 172.21.15.98:0/1609040062 shutdown_connections 2023-01-04T18:12:57.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:57.665+0000 7fede8531700 1 --2- 172.21.15.98:0/1609040062 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fedcc05c2b0 0x7fedcc05e770 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:12:57.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:57.665+0000 7fede8531700 1 --2- 172.21.15.98:0/1609040062 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fede00f55c0 0x7fede010c0d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:12:57.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:57.665+0000 7fede8531700 1 --2- 172.21.15.98:0/1609040062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fede00f6860 0x7fede010e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:12:57.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:57.665+0000 7fede8531700 1 -- 172.21.15.98:0/1609040062 >> 172.21.15.98:0/1609040062 conn(0x7fede00f0d40 msgr2=0x7fede00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:12:57.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:57.665+0000 7fede8531700 1 -- 172.21.15.98:0/1609040062 shutdown_connections 2023-01-04T18:12:57.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:12:57.665+0000 7fede8531700 1 -- 172.21.15.98:0/1609040062 wait complete. 2023-01-04T18:12:58.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:57.651259+0000 mon.smithi050 (mon.0) 368 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:12:58.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:57.656459+0000 mon.smithi050 (mon.0) 369 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:58.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:12:57.662796+0000 mon.smithi050 (mon.0) 370 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:58.154 DEBUG:teuthology.orchestra.run.smithi098:osd.4> sudo journalctl -f -n 0 -u ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.4.service 2023-01-04T18:12:58.156 INFO:tasks.cephadm:Deploying osd.5 on smithi098 with /dev/vg_nvme/lv_2... 2023-01-04T18:12:58.156 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-01-04T18:12:58.186 INFO:journalctl@ceph.osd.4.smithi098.stdout:-- Logs begin at Wed 2023-01-04 17:56:23 UTC. -- 2023-01-04T18:12:58.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:57.651259+0000 mon.smithi050 (mon.0) 368 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:12:58.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:57.656459+0000 mon.smithi050 (mon.0) 369 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:58.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:12:57.662796+0000 mon.smithi050 (mon.0) 370 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:12:59.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:12:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:57.275057+0000 mgr.smithi050.emnywo (mgr.14162) 133 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-01-04T18:12:59.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:12:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:57.275057+0000 mgr.smithi050.emnywo (mgr.14162) 133 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-01-04T18:13:00.403 INFO:teuthology.orchestra.run.smithi098.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-01-04T18:13:00.403 INFO:teuthology.orchestra.run.smithi098.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-01-04T18:13:00.403 INFO:teuthology.orchestra.run.smithi098.stderr: stderr: 10+0 records in 2023-01-04T18:13:00.404 INFO:teuthology.orchestra.run.smithi098.stderr:10+0 records out 2023-01-04T18:13:00.404 INFO:teuthology.orchestra.run.smithi098.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0119413 s, 878 MB/s 2023-01-04T18:13:00.404 INFO:teuthology.orchestra.run.smithi098.stderr:--> Zapping successful for: 2023-01-04T18:13:00.896 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph orch daemon add osd smithi098:vg_nvme/lv_2 2023-01-04T18:13:01.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:12:59.275374+0000 mgr.smithi050.emnywo (mgr.14162) 134 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-01-04T18:13:01.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:00.684146+0000 mon.smithi050 (mon.0) 371 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:01.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:12:59.275374+0000 mgr.smithi050.emnywo (mgr.14162) 134 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-01-04T18:13:01.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:00.684146+0000 mon.smithi050 (mon.0) 371 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:02.072 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:13:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.4[112709]: debug 2023-01-04T18:13:01.634+0000 7f6d440fa080 -1 osd.4 0 log_to_monitors {default=true} 2023-01-04T18:13:02.072 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:01.637481+0000 mon.smithi098 (mon.1) 8 : audit [INF] from='osd.4 [v2:172.21.15.98:6808/3371156908,v1:172.21.15.98:6809/3371156908]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-01-04T18:13:02.073 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:01.637838+0000 mon.smithi050 (mon.0) 372 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-01-04T18:13:02.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:01 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:01.637481+0000 mon.smithi098 (mon.1) 8 : audit [INF] from='osd.4 [v2:172.21.15.98:6808/3371156908,v1:172.21.15.98:6809/3371156908]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-01-04T18:13:02.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:01 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:01.637838+0000 mon.smithi050 (mon.0) 372 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-01-04T18:13:03.078 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:01.275685+0000 mgr.smithi050.emnywo (mgr.14162) 135 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-01-04T18:13:03.078 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:01.801614+0000 mon.smithi050 (mon.0) 373 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-01-04T18:13:03.078 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:01.801709+0000 mon.smithi050 (mon.0) 374 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2023-01-04T18:13:03.078 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:01.801828+0000 mon.smithi050 (mon.0) 375 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-01-04T18:13:03.078 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:01.802175+0000 mon.smithi098 (mon.1) 9 : audit [INF] from='osd.4 [v2:172.21.15.98:6808/3371156908,v1:172.21.15.98:6809/3371156908]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:13:03.078 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:01.802522+0000 mon.smithi050 (mon.0) 376 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:13:03.079 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:02.083686+0000 mon.smithi050 (mon.0) 377 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:03.079 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:13:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.4[112709]: debug 2023-01-04T18:13:02.805+0000 7f6d3a66b700 -1 osd.4 0 waiting for initial osdmap 2023-01-04T18:13:03.079 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:13:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.4[112709]: debug 2023-01-04T18:13:02.813+0000 7f6d35de5700 -1 osd.4 29 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2023-01-04T18:13:03.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.207+0000 7f8c772d9700 1 -- 172.21.15.98:0/2348228808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c700f55c0 msgr2=0x7f8c700f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:03.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.207+0000 7f8c772d9700 1 --2- 172.21.15.98:0/2348228808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c700f55c0 0x7f8c700f59e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f8c60004660 tx=0x7f8c60009b30).stop 2023-01-04T18:13:03.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.207+0000 7f8c772d9700 1 -- 172.21.15.98:0/2348228808 shutdown_connections 2023-01-04T18:13:03.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.207+0000 7f8c772d9700 1 --2- 172.21.15.98:0/2348228808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c700f6860 0x7f8c700f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-01-04T18:13:03.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.207+0000 7f8c772d9700 1 --2- 172.21.15.98:0/2348228808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c700f55c0 0x7f8c700f59e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:03.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.207+0000 7f8c772d9700 1 -- 172.21.15.98:0/2348228808 >> 172.21.15.98:0/2348228808 conn(0x7f8c700f0d40 msgr2=0x7f8c700f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:03.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.207+0000 7f8c772d9700 1 -- 172.21.15.98:0/2348228808 shutdown_connections 2023-01-04T18:13:03.210 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.207+0000 7f8c772d9700 1 -- 172.21.15.98:0/2348228808 wait complete. 2023-01-04T18:13:03.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.207+0000 7f8c772d9700 1 Processor -- start 2023-01-04T18:13:03.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.207+0000 7f8c772d9700 1 -- start start 2023-01-04T18:13:03.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.208+0000 7f8c772d9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c700f55c0 0x7f8c70109ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:03.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.208+0000 7f8c772d9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c700f6860 0x7f8c7010c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:03.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.208+0000 7f8c772d9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c70060470 con 0x7f8c700f55c0 2023-01-04T18:13:03.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.208+0000 7f8c772d9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c700605b0 con 0x7f8c700f6860 2023-01-04T18:13:03.212 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.208+0000 7f8c74874700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c700f6860 0x7f8c7010c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:03.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.208+0000 7f8c74874700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c700f6860 0x7f8c7010c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47662/0 (socket says 172.21.15.98:47662) 2023-01-04T18:13:03.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.208+0000 7f8c74874700 1 -- 172.21.15.98:0/1551382973 learned_addr learned my addr 172.21.15.98:0/1551382973 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-01-04T18:13:03.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.208+0000 7f8c75075700 1 --2- 172.21.15.98:0/1551382973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c700f55c0 0x7f8c70109ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:03.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.208+0000 7f8c74874700 1 -- 172.21.15.98:0/1551382973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c700f55c0 msgr2=0x7f8c70109ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:03.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.208+0000 7f8c74874700 1 --2- 172.21.15.98:0/1551382973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c700f55c0 0x7f8c70109ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:03.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.208+0000 7f8c74874700 1 -- 172.21.15.98:0/1551382973 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c60005040 con 0x7f8c700f6860 2023-01-04T18:13:03.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.208+0000 7f8c74874700 1 --2- 172.21.15.98:0/1551382973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c700f6860 0x7f8c7010c1a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8c6c00b410 tx=0x7f8c6c006ef0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:03.213 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.208+0000 7f8c65ffb700 1 -- 172.21.15.98:0/1551382973 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c6c0125f0 con 0x7f8c700f6860 2023-01-04T18:13:03.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.208+0000 7f8c772d9700 1 -- 172.21.15.98:0/1551382973 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7010c800 con 0x7f8c700f6860 2023-01-04T18:13:03.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.209+0000 7f8c65ffb700 1 -- 172.21.15.98:0/1551382973 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8c6c00be30 con 0x7f8c700f6860 2023-01-04T18:13:03.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.209+0000 7f8c65ffb700 1 -- 172.21.15.98:0/1551382973 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c6c002a20 con 0x7f8c700f6860 2023-01-04T18:13:03.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.209+0000 7f8c772d9700 1 -- 172.21.15.98:0/1551382973 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7010cd90 con 0x7f8c700f6860 2023-01-04T18:13:03.214 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.210+0000 7f8c772d9700 1 -- 172.21.15.98:0/1551382973 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c700f49b0 con 0x7f8c700f6860 2023-01-04T18:13:03.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.210+0000 7f8c65ffb700 1 -- 172.21.15.98:0/1551382973 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f8c6c00f030 con 0x7f8c700f6860 2023-01-04T18:13:03.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.210+0000 7f8c65ffb700 1 --2- 172.21.15.98:0/1551382973 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f8c5c05c2b0 0x7f8c5c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:03.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.210+0000 7f8c65ffb700 1 -- 172.21.15.98:0/1551382973 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f8c6c075cf0 con 0x7f8c700f6860 2023-01-04T18:13:03.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.210+0000 7f8c75075700 1 --2- 172.21.15.98:0/1551382973 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f8c5c05c2b0 0x7f8c5c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:03.215 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.211+0000 7f8c75075700 1 --2- 172.21.15.98:0/1551382973 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f8c5c05c2b0 0x7f8c5c05e770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8c70060060 tx=0x7f8c60009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:03.216 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.214+0000 7f8c65ffb700 1 -- 172.21.15.98:0/1551382973 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8c6c048fc0 con 0x7f8c700f6860 2023-01-04T18:13:03.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:01.275685+0000 mgr.smithi050.emnywo (mgr.14162) 135 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-01-04T18:13:03.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:01.801614+0000 mon.smithi050 (mon.0) 373 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-01-04T18:13:03.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:01.801709+0000 mon.smithi050 (mon.0) 374 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2023-01-04T18:13:03.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:01.801828+0000 mon.smithi050 (mon.0) 375 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-01-04T18:13:03.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:01.802175+0000 mon.smithi098 (mon.1) 9 : audit [INF] from='osd.4 [v2:172.21.15.98:6808/3371156908,v1:172.21.15.98:6809/3371156908]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:13:03.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:01.802522+0000 mon.smithi050 (mon.0) 376 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:13:03.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:02.083686+0000 mon.smithi050 (mon.0) 377 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:03.401 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:03.398+0000 7f8c772d9700 1 -- 172.21.15.98:0/1551382973 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c700fdf10 con 0x7f8c5c05c2b0 2023-01-04T18:13:03.911 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:02.803222+0000 mon.smithi050 (mon.0) 378 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2023-01-04T18:13:03.911 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:02.803353+0000 mon.smithi050 (mon.0) 379 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2023-01-04T18:13:03.911 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:02.803885+0000 mon.smithi050 (mon.0) 380 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-01-04T18:13:03.911 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:02.808024+0000 mon.smithi050 (mon.0) 381 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-01-04T18:13:03.911 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:03.401423+0000 mon.smithi050 (mon.0) 382 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-01-04T18:13:03.911 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:03.403244+0000 mon.smithi050 (mon.0) 383 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-01-04T18:13:03.911 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:03.404178+0000 mon.smithi050 (mon.0) 384 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:13:04.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:02.803222+0000 mon.smithi050 (mon.0) 378 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2023-01-04T18:13:04.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:02.803353+0000 mon.smithi050 (mon.0) 379 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2023-01-04T18:13:04.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:02.803885+0000 mon.smithi050 (mon.0) 380 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-01-04T18:13:04.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:02.808024+0000 mon.smithi050 (mon.0) 381 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-01-04T18:13:04.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:03.401423+0000 mon.smithi050 (mon.0) 382 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-01-04T18:13:04.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:03.403244+0000 mon.smithi050 (mon.0) 383 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-01-04T18:13:04.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:03.404178+0000 mon.smithi050 (mon.0) 384 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:13:05.046 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:02.604782+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2023-01-04T18:13:05.047 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:02.605030+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2023-01-04T18:13:05.047 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:03.275987+0000 mgr.smithi050.emnywo (mgr.14162) 136 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-01-04T18:13:05.047 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:03.400477+0000 mgr.smithi050.emnywo (mgr.14162) 137 : audit [DBG] from='client.24171 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:13:05.047 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:13:03.402959+0000 mgr.smithi050.emnywo (mgr.14162) 138 : cephadm [INF] Applying service osd.None on host smithi098... 2023-01-04T18:13:05.047 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:03.805262+0000 mon.smithi050 (mon.0) 385 : cluster [INF] osd.4 [v2:172.21.15.98:6808/3371156908,v1:172.21.15.98:6809/3371156908] boot 2023-01-04T18:13:05.047 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:03.805308+0000 mon.smithi050 (mon.0) 386 : cluster [DBG] osdmap e30: 5 total, 5 up, 5 in 2023-01-04T18:13:05.047 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:03.805448+0000 mon.smithi050 (mon.0) 387 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-01-04T18:13:05.047 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:04.681910+0000 mon.smithi050 (mon.0) 388 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:05.047 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:04.685820+0000 mon.smithi050 (mon.0) 389 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:05.047 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:04.688793+0000 mon.smithi050 (mon.0) 390 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:13:05.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:02.604782+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2023-01-04T18:13:05.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:02.605030+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2023-01-04T18:13:05.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:03.275987+0000 mgr.smithi050.emnywo (mgr.14162) 136 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2023-01-04T18:13:05.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:03.400477+0000 mgr.smithi050.emnywo (mgr.14162) 137 : audit [DBG] from='client.24171 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:13:05.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:13:03.402959+0000 mgr.smithi050.emnywo (mgr.14162) 138 : cephadm [INF] Applying service osd.None on host smithi098... 2023-01-04T18:13:05.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:03.805262+0000 mon.smithi050 (mon.0) 385 : cluster [INF] osd.4 [v2:172.21.15.98:6808/3371156908,v1:172.21.15.98:6809/3371156908] boot 2023-01-04T18:13:05.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:03.805308+0000 mon.smithi050 (mon.0) 386 : cluster [DBG] osdmap e30: 5 total, 5 up, 5 in 2023-01-04T18:13:05.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:03.805448+0000 mon.smithi050 (mon.0) 387 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-01-04T18:13:05.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:04.681910+0000 mon.smithi050 (mon.0) 388 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:05.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:04.685820+0000 mon.smithi050 (mon.0) 389 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:05.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:04.688793+0000 mon.smithi050 (mon.0) 390 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:13:06.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:05 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:13:04.676786+0000 mgr.smithi050.emnywo (mgr.14162) 139 : cephadm [INF] Detected new or changed devices on smithi098 2023-01-04T18:13:06.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:05 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:05.683278+0000 mon.smithi050 (mon.0) 391 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2023-01-04T18:13:06.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:13:04.676786+0000 mgr.smithi050.emnywo (mgr.14162) 139 : cephadm [INF] Detected new or changed devices on smithi098 2023-01-04T18:13:06.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:05.683278+0000 mon.smithi050 (mon.0) 391 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2023-01-04T18:13:07.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:05.276260+0000 mgr.smithi050.emnywo (mgr.14162) 140 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-01-04T18:13:07.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:05.867630+0000 mon.smithi098 (mon.1) 10 : audit [INF] from='client.? 172.21.15.98:0/2029606867' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "773a186f-cbc1-40a2-a7ae-183f3bbdfd9c"}]: dispatch 2023-01-04T18:13:07.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:05.867959+0000 mon.smithi050 (mon.0) 392 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "773a186f-cbc1-40a2-a7ae-183f3bbdfd9c"}]: dispatch 2023-01-04T18:13:07.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:05.871303+0000 mon.smithi050 (mon.0) 393 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "773a186f-cbc1-40a2-a7ae-183f3bbdfd9c"}]': finished 2023-01-04T18:13:07.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:05.871359+0000 mon.smithi050 (mon.0) 394 : cluster [DBG] osdmap e32: 6 total, 5 up, 6 in 2023-01-04T18:13:07.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:05.871480+0000 mon.smithi050 (mon.0) 395 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-01-04T18:13:07.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:06.272976+0000 mon.smithi098 (mon.1) 11 : audit [DBG] from='client.? 172.21.15.98:0/272837681' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-01-04T18:13:07.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:05.276260+0000 mgr.smithi050.emnywo (mgr.14162) 140 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-01-04T18:13:07.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:05.867630+0000 mon.smithi098 (mon.1) 10 : audit [INF] from='client.? 172.21.15.98:0/2029606867' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "773a186f-cbc1-40a2-a7ae-183f3bbdfd9c"}]: dispatch 2023-01-04T18:13:07.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:05.867959+0000 mon.smithi050 (mon.0) 392 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "773a186f-cbc1-40a2-a7ae-183f3bbdfd9c"}]: dispatch 2023-01-04T18:13:07.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:05.871303+0000 mon.smithi050 (mon.0) 393 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "773a186f-cbc1-40a2-a7ae-183f3bbdfd9c"}]': finished 2023-01-04T18:13:07.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:05.871359+0000 mon.smithi050 (mon.0) 394 : cluster [DBG] osdmap e32: 6 total, 5 up, 6 in 2023-01-04T18:13:07.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:05.871480+0000 mon.smithi050 (mon.0) 395 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-01-04T18:13:07.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:06.272976+0000 mon.smithi098 (mon.1) 11 : audit [DBG] from='client.? 172.21.15.98:0/272837681' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-01-04T18:13:09.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:07.276571+0000 mgr.smithi050.emnywo (mgr.14162) 141 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-01-04T18:13:09.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:07.276571+0000 mgr.smithi050.emnywo (mgr.14162) 141 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-01-04T18:13:10.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:09.115052+0000 mon.smithi050 (mon.0) 396 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:10.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:09.118310+0000 mon.smithi050 (mon.0) 397 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:10.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:09.276995+0000 mgr.smithi050.emnywo (mgr.14162) 142 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-01-04T18:13:10.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:09.115052+0000 mon.smithi050 (mon.0) 396 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:10.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:09.118310+0000 mon.smithi050 (mon.0) 397 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:10.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:09.276995+0000 mgr.smithi050.emnywo (mgr.14162) 142 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-01-04T18:13:12.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:11.277420+0000 mgr.smithi050.emnywo (mgr.14162) 143 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-01-04T18:13:12.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:11.277420+0000 mgr.smithi050.emnywo (mgr.14162) 143 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-01-04T18:13:13.509 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:12.455756+0000 mon.smithi050 (mon.0) 398 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-01-04T18:13:13.509 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:12.456716+0000 mon.smithi050 (mon.0) 399 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:13:13.510 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:13:12.457502+0000 mgr.smithi050.emnywo (mgr.14162) 144 : cephadm [INF] Deploying daemon osd.5 on smithi098 2023-01-04T18:13:13.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:12.455756+0000 mon.smithi050 (mon.0) 398 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-01-04T18:13:13.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:12.456716+0000 mon.smithi050 (mon.0) 399 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:13:13.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:13:12.457502+0000 mgr.smithi050.emnywo (mgr.14162) 144 : cephadm [INF] Deploying daemon osd.5 on smithi098 2023-01-04T18:13:14.621 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:13.277743+0000 mgr.smithi050.emnywo (mgr.14162) 145 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-01-04T18:13:14.621 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:13.406929+0000 mon.smithi050 (mon.0) 400 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:13:14.621 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:13.407268+0000 mon.smithi050 (mon.0) 401 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:13:14.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:13.277743+0000 mgr.smithi050.emnywo (mgr.14162) 145 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-01-04T18:13:14.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:13.406929+0000 mon.smithi050 (mon.0) 400 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:13:14.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:13.407268+0000 mon.smithi050 (mon.0) 401 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:13:16.255 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 5 on host 'smithi098' 2023-01-04T18:13:16.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:16.250+0000 7f8c65ffb700 1 -- 172.21.15.98:0/1551382973 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8c700fdf10 con 0x7f8c5c05c2b0 2023-01-04T18:13:16.255 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:16.252+0000 7f8c772d9700 1 -- 172.21.15.98:0/1551382973 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f8c5c05c2b0 msgr2=0x7f8c5c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:16.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:16.252+0000 7f8c772d9700 1 --2- 172.21.15.98:0/1551382973 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f8c5c05c2b0 0x7f8c5c05e770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8c70060060 tx=0x7f8c60009b30).stop 2023-01-04T18:13:16.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:16.252+0000 7f8c772d9700 1 -- 172.21.15.98:0/1551382973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c700f6860 msgr2=0x7f8c7010c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:16.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:16.252+0000 7f8c772d9700 1 --2- 172.21.15.98:0/1551382973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c700f6860 0x7f8c7010c1a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8c6c00b410 tx=0x7f8c6c006ef0).stop 2023-01-04T18:13:16.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:16.252+0000 7f8c772d9700 1 -- 172.21.15.98:0/1551382973 shutdown_connections 2023-01-04T18:13:16.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:16.252+0000 7f8c772d9700 1 --2- 172.21.15.98:0/1551382973 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f8c5c05c2b0 0x7f8c5c05e770 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:16.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:16.252+0000 7f8c772d9700 1 --2- 172.21.15.98:0/1551382973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c700f55c0 0x7f8c70109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:16.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:16.252+0000 7f8c772d9700 1 --2- 172.21.15.98:0/1551382973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c700f6860 0x7f8c7010c1a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:16.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:16.252+0000 7f8c772d9700 1 -- 172.21.15.98:0/1551382973 >> 172.21.15.98:0/1551382973 conn(0x7f8c700f0d40 msgr2=0x7f8c700fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:16.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:16.253+0000 7f8c772d9700 1 -- 172.21.15.98:0/1551382973 shutdown_connections 2023-01-04T18:13:16.256 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:16.253+0000 7f8c772d9700 1 -- 172.21.15.98:0/1551382973 wait complete. 2023-01-04T18:13:16.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:15.278171+0000 mgr.smithi050.emnywo (mgr.14162) 146 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-01-04T18:13:16.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:15.278171+0000 mgr.smithi050.emnywo (mgr.14162) 146 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-01-04T18:13:16.825 DEBUG:teuthology.orchestra.run.smithi098:osd.5> sudo journalctl -f -n 0 -u ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.5.service 2023-01-04T18:13:16.827 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2023-01-04T18:13:16.828 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph osd stat -f json 2023-01-04T18:13:16.857 INFO:journalctl@ceph.osd.5.smithi098.stdout:-- Logs begin at Wed 2023-01-04 17:56:23 UTC. -- 2023-01-04T18:13:17.536 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:17 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:16.241233+0000 mon.smithi050 (mon.0) 402 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:13:17.536 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:17 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:16.245911+0000 mon.smithi050 (mon.0) 403 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:17.536 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:17 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:16.250776+0000 mon.smithi050 (mon.0) 404 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:17.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:17 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:16.241233+0000 mon.smithi050 (mon.0) 402 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:13:17.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:17 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:16.245911+0000 mon.smithi050 (mon.0) 403 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:17.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:17 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:16.250776+0000 mon.smithi050 (mon.0) 404 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:18.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.315+0000 7f34dd4c2700 1 -- 172.21.15.50:0/583910188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d80f5f60 msgr2=0x7f34d80f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:18.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.315+0000 7f34dd4c2700 1 --2- 172.21.15.50:0/583910188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d80f5f60 0x7f34d80f63e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f34cc004660 tx=0x7f34cc009b30).stop 2023-01-04T18:13:18.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.315+0000 7f34dd4c2700 1 -- 172.21.15.50:0/583910188 shutdown_connections 2023-01-04T18:13:18.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.315+0000 7f34dd4c2700 1 --2- 172.21.15.50:0/583910188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d80f5f60 0x7f34d80f63e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:18.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.315+0000 7f34dd4c2700 1 --2- 172.21.15.50:0/583910188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34d80f4d60 0x7f34d80f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:18.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.315+0000 7f34dd4c2700 1 -- 172.21.15.50:0/583910188 >> 172.21.15.50:0/583910188 conn(0x7f34d80f04c0 msgr2=0x7f34d80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:18.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.315+0000 7f34dd4c2700 1 -- 172.21.15.50:0/583910188 shutdown_connections 2023-01-04T18:13:18.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.315+0000 7f34dd4c2700 1 -- 172.21.15.50:0/583910188 wait complete. 2023-01-04T18:13:18.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.316+0000 7f34dd4c2700 1 Processor -- start 2023-01-04T18:13:18.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.316+0000 7f34dd4c2700 1 -- start start 2023-01-04T18:13:18.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.317+0000 7f34dd4c2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34d80f4d60 0x7f34d8109bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:18.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.317+0000 7f34dd4c2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d80f5f60 0x7f34d810c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:18.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.317+0000 7f34dd4c2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d80f7fd0 con 0x7f34d80f5f60 2023-01-04T18:13:18.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.317+0000 7f34dd4c2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d80f8110 con 0x7f34d80f4d60 2023-01-04T18:13:18.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.317+0000 7f34d67fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d80f5f60 0x7f34d810c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:18.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.317+0000 7f34d6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34d80f4d60 0x7f34d8109bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:18.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.317+0000 7f34d67fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d80f5f60 0x7f34d810c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48588/0 (socket says 172.21.15.50:48588) 2023-01-04T18:13:18.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.317+0000 7f34d67fc700 1 -- 172.21.15.50:0/387941209 learned_addr learned my addr 172.21.15.50:0/387941209 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:13:18.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.317+0000 7f34d67fc700 1 -- 172.21.15.50:0/387941209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34d80f4d60 msgr2=0x7f34d8109bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:18.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.317+0000 7f34d67fc700 1 --2- 172.21.15.50:0/387941209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34d80f4d60 0x7f34d8109bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:18.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.317+0000 7f34d67fc700 1 -- 172.21.15.50:0/387941209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34cc005040 con 0x7f34d80f5f60 2023-01-04T18:13:18.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.317+0000 7f34d67fc700 1 --2- 172.21.15.50:0/387941209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d80f5f60 0x7f34d810c0f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f34cc000c00 tx=0x7f34cc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:18.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.317+0000 7f34bf7fe700 1 -- 172.21.15.50:0/387941209 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34cc019070 con 0x7f34d80f5f60 2023-01-04T18:13:18.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.317+0000 7f34dd4c2700 1 -- 172.21.15.50:0/387941209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d810c640 con 0x7f34d80f5f60 2023-01-04T18:13:18.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.317+0000 7f34bf7fe700 1 -- 172.21.15.50:0/387941209 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f34cc007e70 con 0x7f34d80f5f60 2023-01-04T18:13:18.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.317+0000 7f34bf7fe700 1 -- 172.21.15.50:0/387941209 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34cc014c90 con 0x7f34d80f5f60 2023-01-04T18:13:18.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.317+0000 7f34dd4c2700 1 -- 172.21.15.50:0/387941209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d810cba0 con 0x7f34d80f5f60 2023-01-04T18:13:18.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.318+0000 7f34dd4c2700 1 -- 172.21.15.50:0/387941209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d8045ad0 con 0x7f34d80f5f60 2023-01-04T18:13:18.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.319+0000 7f34bf7fe700 1 -- 172.21.15.50:0/387941209 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f34cc025070 con 0x7f34d80f5f60 2023-01-04T18:13:18.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.319+0000 7f34bf7fe700 1 --2- 172.21.15.50:0/387941209 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f34c005c2b0 0x7f34c005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:18.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.319+0000 7f34bf7fe700 1 -- 172.21.15.50:0/387941209 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4235+0+0 (secure 0 0 0) 0x7f34cc076aa0 con 0x7f34d80f5f60 2023-01-04T18:13:18.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.319+0000 7f34d6ffd700 1 --2- 172.21.15.50:0/387941209 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f34c005c2b0 0x7f34c005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:18.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.320+0000 7f34d6ffd700 1 --2- 172.21.15.50:0/387941209 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f34c005c2b0 0x7f34c005e770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f34d80f7c50 tx=0x7f34c800b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:18.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.323+0000 7f34bf7fe700 1 -- 172.21.15.50:0/387941209 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f34cc049be0 con 0x7f34d80f5f60 2023-01-04T18:13:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.484+0000 7f34dd4c2700 1 -- 172.21.15.50:0/387941209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f34d80fd510 con 0x7f34d80f5f60 2023-01-04T18:13:18.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.485+0000 7f34bf7fe700 1 -- 172.21.15.50:0/387941209 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v32) v1 ==== 74+0+130 (secure 0 0 0) 0x7f34cc04d200 con 0x7f34d80f5f60 2023-01-04T18:13:18.487 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:13:18.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.486+0000 7f34dd4c2700 1 -- 172.21.15.50:0/387941209 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f34c005c2b0 msgr2=0x7f34c005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:18.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.486+0000 7f34dd4c2700 1 --2- 172.21.15.50:0/387941209 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f34c005c2b0 0x7f34c005e770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f34d80f7c50 tx=0x7f34c800b040).stop 2023-01-04T18:13:18.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.486+0000 7f34dd4c2700 1 -- 172.21.15.50:0/387941209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d80f5f60 msgr2=0x7f34d810c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:18.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.486+0000 7f34dd4c2700 1 --2- 172.21.15.50:0/387941209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d80f5f60 0x7f34d810c0f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f34cc000c00 tx=0x7f34cc00b040).stop 2023-01-04T18:13:18.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.486+0000 7f34dd4c2700 1 -- 172.21.15.50:0/387941209 shutdown_connections 2023-01-04T18:13:18.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.486+0000 7f34dd4c2700 1 --2- 172.21.15.50:0/387941209 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f34c005c2b0 0x7f34c005e770 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:18.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.486+0000 7f34dd4c2700 1 --2- 172.21.15.50:0/387941209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34d80f4d60 0x7f34d8109bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:18.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.486+0000 7f34dd4c2700 1 --2- 172.21.15.50:0/387941209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d80f5f60 0x7f34d810c0f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:18.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.486+0000 7f34dd4c2700 1 -- 172.21.15.50:0/387941209 >> 172.21.15.50:0/387941209 conn(0x7f34d80f04c0 msgr2=0x7f34d80f26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:18.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.487+0000 7f34dd4c2700 1 -- 172.21.15.50:0/387941209 shutdown_connections 2023-01-04T18:13:18.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:18.487+0000 7f34dd4c2700 1 -- 172.21.15.50:0/387941209 wait complete. 2023-01-04T18:13:18.512 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:17.278506+0000 mgr.smithi050.emnywo (mgr.14162) 147 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-01-04T18:13:18.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:17.278506+0000 mgr.smithi050.emnywo (mgr.14162) 147 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-01-04T18:13:18.946 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":32,"num_osds":6,"num_up_osds":5,"osd_up_since":1672855983,"num_in_osds":6,"osd_in_since":1672855985,"num_remapped_pgs":0} 2023-01-04T18:13:19.537 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:18.485362+0000 mon.smithi050 (mon.0) 405 : audit [DBG] from='client.? 172.21.15.50:0/387941209' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-01-04T18:13:19.537 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:18.838673+0000 mon.smithi050 (mon.0) 406 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:19.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:18.485362+0000 mon.smithi050 (mon.0) 405 : audit [DBG] from='client.? 172.21.15.50:0/387941209' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-01-04T18:13:19.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:18.838673+0000 mon.smithi050 (mon.0) 406 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:19.948 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph osd stat -f json 2023-01-04T18:13:20.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:19.278747+0000 mgr.smithi050.emnywo (mgr.14162) 148 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-01-04T18:13:20.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:20.087921+0000 mon.smithi098 (mon.1) 12 : audit [INF] from='osd.5 [v2:172.21.15.98:6816/764254549,v1:172.21.15.98:6817/764254549]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-01-04T18:13:20.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:20.088264+0000 mon.smithi050 (mon.0) 407 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-01-04T18:13:20.309 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:13:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.5[116368]: debug 2023-01-04T18:13:20.083+0000 7f59b5238080 -1 osd.5 0 log_to_monitors {default=true} 2023-01-04T18:13:20.309 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:19.278747+0000 mgr.smithi050.emnywo (mgr.14162) 148 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-01-04T18:13:20.309 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:20.087921+0000 mon.smithi098 (mon.1) 12 : audit [INF] from='osd.5 [v2:172.21.15.98:6816/764254549,v1:172.21.15.98:6817/764254549]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-01-04T18:13:20.309 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:20.088264+0000 mon.smithi050 (mon.0) 407 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-01-04T18:13:21.459 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:20.220924+0000 mon.smithi050 (mon.0) 408 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-01-04T18:13:21.459 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:20.220987+0000 mon.smithi050 (mon.0) 409 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2023-01-04T18:13:21.459 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:20.221245+0000 mon.smithi050 (mon.0) 410 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-01-04T18:13:21.459 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:20.223104+0000 mon.smithi098 (mon.1) 13 : audit [INF] from='osd.5 [v2:172.21.15.98:6816/764254549,v1:172.21.15.98:6817/764254549]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:13:21.460 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:20.223432+0000 mon.smithi050 (mon.0) 411 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:13:21.542 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:13:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.5[116368]: debug 2023-01-04T18:13:21.229+0000 7f59ab7a9700 -1 osd.5 0 waiting for initial osdmap 2023-01-04T18:13:21.542 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:13:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.5[116368]: debug 2023-01-04T18:13:21.236+0000 7f59a5f21700 -1 osd.5 34 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2023-01-04T18:13:21.542 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:20.220924+0000 mon.smithi050 (mon.0) 408 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-01-04T18:13:21.543 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:20.220987+0000 mon.smithi050 (mon.0) 409 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2023-01-04T18:13:21.543 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:20.221245+0000 mon.smithi050 (mon.0) 410 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-01-04T18:13:21.543 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:20.223104+0000 mon.smithi098 (mon.1) 13 : audit [INF] from='osd.5 [v2:172.21.15.98:6816/764254549,v1:172.21.15.98:6817/764254549]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:13:21.543 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:20.223432+0000 mon.smithi050 (mon.0) 411 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:13:21.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.654+0000 7f74346fe700 1 -- 172.21.15.50:0/1554775899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f742c0f66e0 msgr2=0x7f742c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:21.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.654+0000 7f74346fe700 1 --2- 172.21.15.50:0/1554775899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f742c0f66e0 0x7f742c0f6b00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f7428004660 tx=0x7f7428009b30).stop 2023-01-04T18:13:21.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.654+0000 7f74346fe700 1 -- 172.21.15.50:0/1554775899 shutdown_connections 2023-01-04T18:13:21.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.654+0000 7f74346fe700 1 --2- 172.21.15.50:0/1554775899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f742c0f7980 0x7f742c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:21.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.654+0000 7f74346fe700 1 --2- 172.21.15.50:0/1554775899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f742c0f66e0 0x7f742c0f6b00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:21.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.654+0000 7f74346fe700 1 -- 172.21.15.50:0/1554775899 >> 172.21.15.50:0/1554775899 conn(0x7f742c0f1e40 msgr2=0x7f742c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:21.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.654+0000 7f74346fe700 1 -- 172.21.15.50:0/1554775899 shutdown_connections 2023-01-04T18:13:21.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.654+0000 7f74346fe700 1 -- 172.21.15.50:0/1554775899 wait complete. 2023-01-04T18:13:21.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.655+0000 7f74346fe700 1 Processor -- start 2023-01-04T18:13:21.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.655+0000 7f74346fe700 1 -- start start 2023-01-04T18:13:21.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.655+0000 7f74346fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f742c0f66e0 0x7f742c106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:21.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.655+0000 7f74346fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f742c0f7980 0x7f742c107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:21.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.655+0000 7f74346fe700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c107a20 con 0x7f742c0f7980 2023-01-04T18:13:21.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.655+0000 7f74346fe700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c107b60 con 0x7f742c0f66e0 2023-01-04T18:13:21.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.655+0000 7f7431c99700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f742c0f7980 0x7f742c107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:21.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.655+0000 7f743249a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f742c0f66e0 0x7f742c106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:21.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.655+0000 7f7431c99700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f742c0f7980 0x7f742c107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48600/0 (socket says 172.21.15.50:48600) 2023-01-04T18:13:21.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.655+0000 7f7431c99700 1 -- 172.21.15.50:0/1275083017 learned_addr learned my addr 172.21.15.50:0/1275083017 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:13:21.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.655+0000 7f7431c99700 1 -- 172.21.15.50:0/1275083017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f742c0f66e0 msgr2=0x7f742c106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:21.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.655+0000 7f7431c99700 1 --2- 172.21.15.50:0/1275083017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f742c0f66e0 0x7f742c106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:21.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.655+0000 7f7431c99700 1 -- 172.21.15.50:0/1275083017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7428005040 con 0x7f742c0f7980 2023-01-04T18:13:21.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.655+0000 7f743249a700 1 --2- 172.21.15.50:0/1275083017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f742c0f66e0 0x7f742c106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-01-04T18:13:21.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.656+0000 7f7431c99700 1 --2- 172.21.15.50:0/1275083017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f742c0f7980 0x7f742c107470 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f741c002700 tx=0x7f741c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:21.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.656+0000 7f7422ffd700 1 -- 172.21.15.50:0/1275083017 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f741c009320 con 0x7f742c0f7980 2023-01-04T18:13:21.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.656+0000 7f7422ffd700 1 -- 172.21.15.50:0/1275083017 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f741c00f040 con 0x7f742c0f7980 2023-01-04T18:13:21.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.656+0000 7f74346fe700 1 -- 172.21.15.50:0/1275083017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f742c108500 con 0x7f742c0f7980 2023-01-04T18:13:21.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.656+0000 7f7422ffd700 1 -- 172.21.15.50:0/1275083017 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f741c014870 con 0x7f742c0f7980 2023-01-04T18:13:21.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.656+0000 7f74346fe700 1 -- 172.21.15.50:0/1275083017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742c108ac0 con 0x7f742c0f7980 2023-01-04T18:13:21.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.657+0000 7f74346fe700 1 -- 172.21.15.50:0/1275083017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f742c045ad0 con 0x7f742c0f7980 2023-01-04T18:13:21.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.657+0000 7f7422ffd700 1 -- 172.21.15.50:0/1275083017 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f741c009480 con 0x7f742c0f7980 2023-01-04T18:13:21.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.657+0000 7f7422ffd700 1 --2- 172.21.15.50:0/1275083017 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f741805c2b0 0x7f741805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:21.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.657+0000 7f7422ffd700 1 -- 172.21.15.50:0/1275083017 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4272+0+0 (secure 0 0 0) 0x7f741c075cf0 con 0x7f742c0f7980 2023-01-04T18:13:21.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.658+0000 7f743249a700 1 --2- 172.21.15.50:0/1275083017 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f741805c2b0 0x7f741805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:21.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.658+0000 7f743249a700 1 --2- 172.21.15.50:0/1275083017 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f741805c2b0 0x7f741805e770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f7428009f50 tx=0x7f7428009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:21.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.662+0000 7f7422ffd700 1 -- 172.21.15.50:0/1275083017 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f741c048e10 con 0x7f742c0f7980 2023-01-04T18:13:21.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.819+0000 7f74346fe700 1 -- 172.21.15.50:0/1275083017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f742c027a00 con 0x7f742c0f7980 2023-01-04T18:13:21.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.820+0000 7f7422ffd700 1 -- 172.21.15.50:0/1275083017 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v34) v1 ==== 74+0+130 (secure 0 0 0) 0x7f741c04c430 con 0x7f742c0f7980 2023-01-04T18:13:21.822 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:13:21.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.821+0000 7f74346fe700 1 -- 172.21.15.50:0/1275083017 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f741805c2b0 msgr2=0x7f741805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:21.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.821+0000 7f74346fe700 1 --2- 172.21.15.50:0/1275083017 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f741805c2b0 0x7f741805e770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f7428009f50 tx=0x7f7428009b30).stop 2023-01-04T18:13:21.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.821+0000 7f74346fe700 1 -- 172.21.15.50:0/1275083017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f742c0f7980 msgr2=0x7f742c107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:21.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.821+0000 7f74346fe700 1 --2- 172.21.15.50:0/1275083017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f742c0f7980 0x7f742c107470 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f741c002700 tx=0x7f741c009e00).stop 2023-01-04T18:13:21.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.821+0000 7f74346fe700 1 -- 172.21.15.50:0/1275083017 shutdown_connections 2023-01-04T18:13:21.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.821+0000 7f74346fe700 1 --2- 172.21.15.50:0/1275083017 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f741805c2b0 0x7f741805e770 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:21.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.821+0000 7f74346fe700 1 --2- 172.21.15.50:0/1275083017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f742c0f66e0 0x7f742c106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:21.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.821+0000 7f74346fe700 1 --2- 172.21.15.50:0/1275083017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f742c0f7980 0x7f742c107470 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:21.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.821+0000 7f74346fe700 1 -- 172.21.15.50:0/1275083017 >> 172.21.15.50:0/1275083017 conn(0x7f742c0f1e40 msgr2=0x7f742c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:21.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.822+0000 7f74346fe700 1 -- 172.21.15.50:0/1275083017 shutdown_connections 2023-01-04T18:13:21.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:21.822+0000 7f74346fe700 1 -- 172.21.15.50:0/1275083017 wait complete. 2023-01-04T18:13:22.382 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":34,"num_osds":6,"num_up_osds":5,"osd_up_since":1672855983,"num_in_osds":6,"osd_in_since":1672855985,"num_remapped_pgs":0} 2023-01-04T18:13:22.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:21.222202+0000 mon.smithi050 (mon.0) 412 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2023-01-04T18:13:22.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:21.222282+0000 mon.smithi050 (mon.0) 413 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2023-01-04T18:13:22.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:21.223015+0000 mon.smithi050 (mon.0) 414 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-01-04T18:13:22.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:21.228456+0000 mon.smithi050 (mon.0) 415 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-01-04T18:13:22.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:21.279128+0000 mgr.smithi050.emnywo (mgr.14162) 149 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-01-04T18:13:22.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:21.589519+0000 mon.smithi050 (mon.0) 416 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:22.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:21.820403+0000 mon.smithi050 (mon.0) 417 : audit [DBG] from='client.? 172.21.15.50:0/1275083017' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-01-04T18:13:22.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:13:21.929179+0000 mgr.smithi050.emnywo (mgr.14162) 150 : cephadm [INF] Detected new or changed devices on smithi098 2023-01-04T18:13:22.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:21.933354+0000 mon.smithi050 (mon.0) 418 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:22.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:21.222202+0000 mon.smithi050 (mon.0) 412 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2023-01-04T18:13:22.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:21.222282+0000 mon.smithi050 (mon.0) 413 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2023-01-04T18:13:22.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:21.223015+0000 mon.smithi050 (mon.0) 414 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-01-04T18:13:22.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:21.228456+0000 mon.smithi050 (mon.0) 415 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-01-04T18:13:22.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:21.279128+0000 mgr.smithi050.emnywo (mgr.14162) 149 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2023-01-04T18:13:22.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:21.589519+0000 mon.smithi050 (mon.0) 416 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:22.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:21.820403+0000 mon.smithi050 (mon.0) 417 : audit [DBG] from='client.? 172.21.15.50:0/1275083017' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-01-04T18:13:22.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:13:21.929179+0000 mgr.smithi050.emnywo (mgr.14162) 150 : cephadm [INF] Detected new or changed devices on smithi098 2023-01-04T18:13:22.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:21.933354+0000 mon.smithi050 (mon.0) 418 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:23.384 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph osd stat -f json 2023-01-04T18:13:23.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:23 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:21.050321+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2023-01-04T18:13:23.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:23 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:21.050423+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2023-01-04T18:13:23.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:23 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:22.229366+0000 mon.smithi050 (mon.0) 419 : cluster [INF] osd.5 [v2:172.21.15.98:6816/764254549,v1:172.21.15.98:6817/764254549] boot 2023-01-04T18:13:23.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:23 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:22.229416+0000 mon.smithi050 (mon.0) 420 : cluster [DBG] osdmap e35: 6 total, 6 up, 6 in 2023-01-04T18:13:23.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:23 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:22.229779+0000 mon.smithi050 (mon.0) 421 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-01-04T18:13:23.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:23 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:22.282481+0000 mon.smithi050 (mon.0) 422 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:23.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:23 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:22.285545+0000 mon.smithi050 (mon.0) 423 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:13:23.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:21.050321+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2023-01-04T18:13:23.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:21.050423+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2023-01-04T18:13:23.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:22.229366+0000 mon.smithi050 (mon.0) 419 : cluster [INF] osd.5 [v2:172.21.15.98:6816/764254549,v1:172.21.15.98:6817/764254549] boot 2023-01-04T18:13:23.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:22.229416+0000 mon.smithi050 (mon.0) 420 : cluster [DBG] osdmap e35: 6 total, 6 up, 6 in 2023-01-04T18:13:23.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:22.229779+0000 mon.smithi050 (mon.0) 421 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-01-04T18:13:23.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:22.282481+0000 mon.smithi050 (mon.0) 422 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:23.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:22.285545+0000 mon.smithi050 (mon.0) 423 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:13:24.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:23.279481+0000 mgr.smithi050.emnywo (mgr.14162) 151 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:24.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:23.283817+0000 mon.smithi050 (mon.0) 424 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2023-01-04T18:13:24.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:23.279481+0000 mgr.smithi050.emnywo (mgr.14162) 151 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:24.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:23.283817+0000 mon.smithi050 (mon.0) 424 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2023-01-04T18:13:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.048+0000 7f4919226700 1 -- 172.21.15.50:0/2923087062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49140f6860 msgr2=0x7f49140f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.048+0000 7f4919226700 1 --2- 172.21.15.50:0/2923087062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49140f6860 0x7f49140f6cc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f48fc004660 tx=0x7f48fc009b30).stop 2023-01-04T18:13:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.048+0000 7f4919226700 1 -- 172.21.15.50:0/2923087062 shutdown_connections 2023-01-04T18:13:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.048+0000 7f4919226700 1 --2- 172.21.15.50:0/2923087062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49140f6860 0x7f49140f6cc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.048+0000 7f4919226700 1 --2- 172.21.15.50:0/2923087062 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49140f55c0 0x7f49140f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.048+0000 7f4919226700 1 -- 172.21.15.50:0/2923087062 >> 172.21.15.50:0/2923087062 conn(0x7f49140f0d40 msgr2=0x7f49140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.048+0000 7f4919226700 1 -- 172.21.15.50:0/2923087062 shutdown_connections 2023-01-04T18:13:25.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.048+0000 7f4919226700 1 -- 172.21.15.50:0/2923087062 wait complete. 2023-01-04T18:13:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.048+0000 7f4919226700 1 Processor -- start 2023-01-04T18:13:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.048+0000 7f4919226700 1 -- start start 2023-01-04T18:13:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.049+0000 7f4919226700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49140f55c0 0x7f49140f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.049+0000 7f4919226700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49140f6860 0x7f49140f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.049+0000 7f4919226700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49140f8100 con 0x7f49140f6860 2023-01-04T18:13:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.049+0000 7f4919226700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49140f8240 con 0x7f49140f55c0 2023-01-04T18:13:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.049+0000 7f491259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49140f6860 0x7f49140f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:25.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.049+0000 7f491259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49140f6860 0x7f49140f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48622/0 (socket says 172.21.15.50:48622) 2023-01-04T18:13:25.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.049+0000 7f491259c700 1 -- 172.21.15.50:0/1830055426 learned_addr learned my addr 172.21.15.50:0/1830055426 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:13:25.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.049+0000 7f4912d9d700 1 --2- 172.21.15.50:0/1830055426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49140f55c0 0x7f49140f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:25.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.049+0000 7f491259c700 1 -- 172.21.15.50:0/1830055426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49140f55c0 msgr2=0x7f49140f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:25.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.049+0000 7f491259c700 1 --2- 172.21.15.50:0/1830055426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49140f55c0 0x7f49140f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:25.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.049+0000 7f491259c700 1 -- 172.21.15.50:0/1830055426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc005040 con 0x7f49140f6860 2023-01-04T18:13:25.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.049+0000 7f491259c700 1 --2- 172.21.15.50:0/1830055426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49140f6860 0x7f49140f7ba0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f48fc009f50 tx=0x7f48fc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:25.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.049+0000 7f490b7fe700 1 -- 172.21.15.50:0/1830055426 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48fc018070 con 0x7f49140f6860 2023-01-04T18:13:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.049+0000 7f490b7fe700 1 -- 172.21.15.50:0/1830055426 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f48fc013410 con 0x7f49140f6860 2023-01-04T18:13:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.049+0000 7f4919226700 1 -- 172.21.15.50:0/1830055426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49140f84c0 con 0x7f49140f6860 2023-01-04T18:13:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.049+0000 7f490b7fe700 1 -- 172.21.15.50:0/1830055426 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48fc01c3c0 con 0x7f49140f6860 2023-01-04T18:13:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.050+0000 7f4919226700 1 -- 172.21.15.50:0/1830055426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49140f8a20 con 0x7f49140f6860 2023-01-04T18:13:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.050+0000 7f4919226700 1 -- 172.21.15.50:0/1830055426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4914045ad0 con 0x7f49140f6860 2023-01-04T18:13:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.051+0000 7f490b7fe700 1 -- 172.21.15.50:0/1830055426 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f48fc01d420 con 0x7f49140f6860 2023-01-04T18:13:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.051+0000 7f490b7fe700 1 --2- 172.21.15.50:0/1830055426 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f490005c2b0 0x7f490005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.051+0000 7f490b7fe700 1 -- 172.21.15.50:0/1830055426 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f48fc077800 con 0x7f49140f6860 2023-01-04T18:13:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.051+0000 7f4912d9d700 1 --2- 172.21.15.50:0/1830055426 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f490005c2b0 0x7f490005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.052+0000 7f4912d9d700 1 --2- 172.21.15.50:0/1830055426 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f490005c2b0 0x7f490005e770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f49140f94b0 tx=0x7f4904009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:25.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.055+0000 7f490b7fe700 1 -- 172.21.15.50:0/1830055426 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f48fc04a800 con 0x7f49140f6860 2023-01-04T18:13:25.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.225+0000 7f4919226700 1 -- 172.21.15.50:0/1830055426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f491410f640 con 0x7f49140f6860 2023-01-04T18:13:25.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.225+0000 7f490b7fe700 1 -- 172.21.15.50:0/1830055426 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v36) v1 ==== 74+0+130 (secure 0 0 0) 0x7f48fc04de20 con 0x7f49140f6860 2023-01-04T18:13:25.228 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:13:25.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.227+0000 7f4919226700 1 -- 172.21.15.50:0/1830055426 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f490005c2b0 msgr2=0x7f490005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:25.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.227+0000 7f4919226700 1 --2- 172.21.15.50:0/1830055426 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f490005c2b0 0x7f490005e770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f49140f94b0 tx=0x7f4904009040).stop 2023-01-04T18:13:25.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.227+0000 7f4919226700 1 -- 172.21.15.50:0/1830055426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49140f6860 msgr2=0x7f49140f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:25.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.227+0000 7f4919226700 1 --2- 172.21.15.50:0/1830055426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49140f6860 0x7f49140f7ba0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f48fc009f50 tx=0x7f48fc009b30).stop 2023-01-04T18:13:25.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.227+0000 7f4919226700 1 -- 172.21.15.50:0/1830055426 shutdown_connections 2023-01-04T18:13:25.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.227+0000 7f4919226700 1 --2- 172.21.15.50:0/1830055426 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f490005c2b0 0x7f490005e770 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:25.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.227+0000 7f4919226700 1 --2- 172.21.15.50:0/1830055426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49140f55c0 0x7f49140f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:25.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.227+0000 7f4919226700 1 --2- 172.21.15.50:0/1830055426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49140f6860 0x7f49140f7ba0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:25.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.227+0000 7f4919226700 1 -- 172.21.15.50:0/1830055426 >> 172.21.15.50:0/1830055426 conn(0x7f49140f0d40 msgr2=0x7f491405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:25.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.227+0000 7f4919226700 1 -- 172.21.15.50:0/1830055426 shutdown_connections 2023-01-04T18:13:25.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:25.227+0000 7f4919226700 1 -- 172.21.15.50:0/1830055426 wait complete. 2023-01-04T18:13:25.814 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":36,"num_osds":6,"num_up_osds":6,"osd_up_since":1672856002,"num_in_osds":6,"osd_in_since":1672855985,"num_remapped_pgs":0} 2023-01-04T18:13:25.814 INFO:tasks.cephadm:Setting up client nodes... 2023-01-04T18:13:25.815 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-01-04T18:13:26.504 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:25.225941+0000 mon.smithi050 (mon.0) 425 : audit [DBG] from='client.? 172.21.15.50:0/1830055426' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-01-04T18:13:26.504 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:25.279762+0000 mgr.smithi050.emnywo (mgr.14162) 152 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:26.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:25.225941+0000 mon.smithi050 (mon.0) 425 : audit [DBG] from='client.? 172.21.15.50:0/1830055426' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-01-04T18:13:26.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:25.279762+0000 mgr.smithi050.emnywo (mgr.14162) 152 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:27.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.764+0000 7fa0ddf61700 1 -- 172.21.15.50:0/2826675072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0d80f63b0 msgr2=0x7fa0d80f6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:27.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.764+0000 7fa0ddf61700 1 --2- 172.21.15.50:0/2826675072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0d80f63b0 0x7fa0d80f6810 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fa0c8004660 tx=0x7fa0c8009b30).stop 2023-01-04T18:13:27.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.764+0000 7fa0ddf61700 1 -- 172.21.15.50:0/2826675072 shutdown_connections 2023-01-04T18:13:27.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.764+0000 7fa0ddf61700 1 --2- 172.21.15.50:0/2826675072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0d80f63b0 0x7fa0d80f6810 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:27.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.764+0000 7fa0ddf61700 1 --2- 172.21.15.50:0/2826675072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0d80f5a10 0x7fa0d80f5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-01-04T18:13:27.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.764+0000 7fa0ddf61700 1 -- 172.21.15.50:0/2826675072 >> 172.21.15.50:0/2826675072 conn(0x7fa0d80f0320 msgr2=0x7fa0d80f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:27.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.764+0000 7fa0ddf61700 1 -- 172.21.15.50:0/2826675072 shutdown_connections 2023-01-04T18:13:27.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.764+0000 7fa0ddf61700 1 -- 172.21.15.50:0/2826675072 wait complete. 2023-01-04T18:13:27.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.764+0000 7fa0ddf61700 1 Processor -- start 2023-01-04T18:13:27.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.765+0000 7fa0ddf61700 1 -- start start 2023-01-04T18:13:27.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.765+0000 7fa0ddf61700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0d80f5a10 0x7fa0d8105d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:27.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.765+0000 7fa0ddf61700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0d80f63b0 0x7fa0d8106240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:27.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.765+0000 7fa0ddf61700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d8106880 con 0x7fa0d80f5a10 2023-01-04T18:13:27.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.765+0000 7fa0ddf61700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d8106ff0 con 0x7fa0d80f63b0 2023-01-04T18:13:27.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.765+0000 7fa0dcf5f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0d80f5a10 0x7fa0d8105d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:27.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.765+0000 7fa0dcf5f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0d80f5a10 0x7fa0d8105d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43020/0 (socket says 172.21.15.50:43020) 2023-01-04T18:13:27.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.765+0000 7fa0dcf5f700 1 -- 172.21.15.50:0/4215887349 learned_addr learned my addr 172.21.15.50:0/4215887349 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:13:27.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.765+0000 7fa0d7fff700 1 --2- 172.21.15.50:0/4215887349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0d80f63b0 0x7fa0d8106240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:27.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.765+0000 7fa0dcf5f700 1 -- 172.21.15.50:0/4215887349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0d80f63b0 msgr2=0x7fa0d8106240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:27.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.765+0000 7fa0dcf5f700 1 --2- 172.21.15.50:0/4215887349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0d80f63b0 0x7fa0d8106240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:27.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.765+0000 7fa0dcf5f700 1 -- 172.21.15.50:0/4215887349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c8005040 con 0x7fa0d80f5a10 2023-01-04T18:13:27.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.765+0000 7fa0dcf5f700 1 --2- 172.21.15.50:0/4215887349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0d80f5a10 0x7fa0d8105d50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fa0c00093f0 tx=0x7fa0c0006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:27.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.766+0000 7fa0d57fa700 1 -- 172.21.15.50:0/4215887349 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0c0013640 con 0x7fa0d80f5a10 2023-01-04T18:13:27.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.766+0000 7fa0ddf61700 1 -- 172.21.15.50:0/4215887349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d81072d0 con 0x7fa0d80f5a10 2023-01-04T18:13:27.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.766+0000 7fa0d57fa700 1 -- 172.21.15.50:0/4215887349 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa0c0013c50 con 0x7fa0d80f5a10 2023-01-04T18:13:27.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.766+0000 7fa0d57fa700 1 -- 172.21.15.50:0/4215887349 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0c0012c80 con 0x7fa0d80f5a10 2023-01-04T18:13:27.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.766+0000 7fa0ddf61700 1 -- 172.21.15.50:0/4215887349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d8107890 con 0x7fa0d80f5a10 2023-01-04T18:13:27.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.767+0000 7fa0ddf61700 1 -- 172.21.15.50:0/4215887349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d8045ad0 con 0x7fa0d80f5a10 2023-01-04T18:13:27.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.767+0000 7fa0d57fa700 1 -- 172.21.15.50:0/4215887349 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fa0c001a060 con 0x7fa0d80f5a10 2023-01-04T18:13:27.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.767+0000 7fa0d57fa700 1 --2- 172.21.15.50:0/4215887349 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fa0c405c300 0x7fa0c405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:27.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.767+0000 7fa0d57fa700 1 -- 172.21.15.50:0/4215887349 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fa0c0075b90 con 0x7fa0d80f5a10 2023-01-04T18:13:27.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.767+0000 7fa0d7fff700 1 --2- 172.21.15.50:0/4215887349 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fa0c405c300 0x7fa0c405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:27.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.768+0000 7fa0d7fff700 1 --2- 172.21.15.50:0/4215887349 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fa0c405c300 0x7fa0c405e7c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fa0c8004630 tx=0x7fa0c8009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:27.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.771+0000 7fa0d57fa700 1 -- 172.21.15.50:0/4215887349 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa0c0048b90 con 0x7fa0d80f5a10 2023-01-04T18:13:27.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.992+0000 7fa0ddf61700 1 -- 172.21.15.50:0/4215887349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fa0d80ff700 con 0x7fa0d80f5a10 2023-01-04T18:13:28.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.997+0000 7fa0d57fa700 1 -- 172.21.15.50:0/4215887349 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7fa0c004c1b0 con 0x7fa0d80f5a10 2023-01-04T18:13:28.000 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-01-04T18:13:28.000 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDHwbVjQg8zOxAAoTCH4EWG8x6UEa2IgGLMCQ== 2023-01-04T18:13:28.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.999+0000 7fa0ddf61700 1 -- 172.21.15.50:0/4215887349 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fa0c405c300 msgr2=0x7fa0c405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:28.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.999+0000 7fa0ddf61700 1 --2- 172.21.15.50:0/4215887349 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fa0c405c300 0x7fa0c405e7c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fa0c8004630 tx=0x7fa0c8009b30).stop 2023-01-04T18:13:28.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.999+0000 7fa0ddf61700 1 -- 172.21.15.50:0/4215887349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0d80f5a10 msgr2=0x7fa0d8105d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:28.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:27.999+0000 7fa0ddf61700 1 --2- 172.21.15.50:0/4215887349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0d80f5a10 0x7fa0d8105d50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fa0c00093f0 tx=0x7fa0c0006ec0).stop 2023-01-04T18:13:28.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:28.000+0000 7fa0ddf61700 1 -- 172.21.15.50:0/4215887349 shutdown_connections 2023-01-04T18:13:28.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:28.000+0000 7fa0ddf61700 1 --2- 172.21.15.50:0/4215887349 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fa0c405c300 0x7fa0c405e7c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:28.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:28.000+0000 7fa0ddf61700 1 --2- 172.21.15.50:0/4215887349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0d80f5a10 0x7fa0d8105d50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:28.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:28.000+0000 7fa0ddf61700 1 --2- 172.21.15.50:0/4215887349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0d80f63b0 0x7fa0d8106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:28.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:28.000+0000 7fa0ddf61700 1 -- 172.21.15.50:0/4215887349 >> 172.21.15.50:0/4215887349 conn(0x7fa0d80f0320 msgr2=0x7fa0d80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:28.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:28.000+0000 7fa0ddf61700 1 -- 172.21.15.50:0/4215887349 shutdown_connections 2023-01-04T18:13:28.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:28.000+0000 7fa0ddf61700 1 -- 172.21.15.50:0/4215887349 wait complete. 2023-01-04T18:13:28.493 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-01-04T18:13:28.494 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-01-04T18:13:28.494 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-01-04T18:13:28.535 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-01-04T18:13:28.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:27.280046+0000 mgr.smithi050.emnywo (mgr.14162) 153 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:28.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:27.993042+0000 mon.smithi050 (mon.0) 426 : audit [INF] from='client.? 172.21.15.50:0/4215887349' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-01-04T18:13:28.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:27.995631+0000 mon.smithi050 (mon.0) 427 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:28.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:27.998144+0000 mon.smithi050 (mon.0) 428 : audit [INF] from='client.? 172.21.15.50:0/4215887349' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-01-04T18:13:28.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:28.001452+0000 mon.smithi050 (mon.0) 429 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:28.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:27.280046+0000 mgr.smithi050.emnywo (mgr.14162) 153 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:28.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:27.993042+0000 mon.smithi050 (mon.0) 426 : audit [INF] from='client.? 172.21.15.50:0/4215887349' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-01-04T18:13:28.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:27.995631+0000 mon.smithi050 (mon.0) 427 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:28.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:27.998144+0000 mon.smithi050 (mon.0) 428 : audit [INF] from='client.? 172.21.15.50:0/4215887349' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-01-04T18:13:28.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:28.001452+0000 mon.smithi050 (mon.0) 429 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:13:30.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.172+0000 7fe13d827700 1 -- 172.21.15.98:0/380941979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1380f68e0 msgr2=0x7fe1380f6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:30.176 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.172+0000 7fe13d827700 1 --2- 172.21.15.98:0/380941979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1380f68e0 0x7fe1380f6d40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fe128004660 tx=0x7fe128009b30).stop 2023-01-04T18:13:30.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.172+0000 7fe13d827700 1 -- 172.21.15.98:0/380941979 shutdown_connections 2023-01-04T18:13:30.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.172+0000 7fe13d827700 1 --2- 172.21.15.98:0/380941979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1380f68e0 0x7fe1380f6d40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:30.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.172+0000 7fe13d827700 1 --2- 172.21.15.98:0/380941979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1380f5640 0x7fe1380f5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:30.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.172+0000 7fe13d827700 1 -- 172.21.15.98:0/380941979 >> 172.21.15.98:0/380941979 conn(0x7fe1380f0da0 msgr2=0x7fe1380f31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:30.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.172+0000 7fe13d827700 1 -- 172.21.15.98:0/380941979 shutdown_connections 2023-01-04T18:13:30.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.172+0000 7fe13d827700 1 -- 172.21.15.98:0/380941979 wait complete. 2023-01-04T18:13:30.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.172+0000 7fe13d827700 1 Processor -- start 2023-01-04T18:13:30.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.173+0000 7fe13d827700 1 -- start start 2023-01-04T18:13:30.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.173+0000 7fe13d827700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1380f5640 0x7fe13810c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:30.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.173+0000 7fe13d827700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1380f68e0 0x7fe13810e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:30.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.173+0000 7fe13d827700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1380604f0 con 0x7fe1380f68e0 2023-01-04T18:13:30.177 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.173+0000 7fe13d827700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe138060630 con 0x7fe1380f5640 2023-01-04T18:13:30.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.173+0000 7fe136ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1380f5640 0x7fe13810c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:30.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.173+0000 7fe136ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1380f5640 0x7fe13810c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54074/0 (socket says 172.21.15.98:54074) 2023-01-04T18:13:30.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.173+0000 7fe136ffd700 1 -- 172.21.15.98:0/2724508088 learned_addr learned my addr 172.21.15.98:0/2724508088 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-01-04T18:13:30.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.173+0000 7fe1367fc700 1 --2- 172.21.15.98:0/2724508088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1380f68e0 0x7fe13810e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:30.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.173+0000 7fe136ffd700 1 -- 172.21.15.98:0/2724508088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1380f68e0 msgr2=0x7fe13810e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:30.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.173+0000 7fe136ffd700 1 --2- 172.21.15.98:0/2724508088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1380f68e0 0x7fe13810e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:30.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.173+0000 7fe136ffd700 1 -- 172.21.15.98:0/2724508088 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe128005040 con 0x7fe1380f5640 2023-01-04T18:13:30.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.173+0000 7fe136ffd700 1 --2- 172.21.15.98:0/2724508088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1380f5640 0x7fe13810c000 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fe12c00c530 tx=0x7fe12c007e10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:30.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.173+0000 7fe11f7fe700 1 -- 172.21.15.98:0/2724508088 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe12c00f650 con 0x7fe1380f5640 2023-01-04T18:13:30.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.174+0000 7fe13d827700 1 -- 172.21.15.98:0/2724508088 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe13810e9f0 con 0x7fe1380f5640 2023-01-04T18:13:30.178 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.174+0000 7fe11f7fe700 1 -- 172.21.15.98:0/2724508088 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe12c00fc60 con 0x7fe1380f5640 2023-01-04T18:13:30.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.174+0000 7fe11f7fe700 1 -- 172.21.15.98:0/2724508088 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe12c012d20 con 0x7fe1380f5640 2023-01-04T18:13:30.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.174+0000 7fe13d827700 1 -- 172.21.15.98:0/2724508088 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe13810eed0 con 0x7fe1380f5640 2023-01-04T18:13:30.179 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.175+0000 7fe11f7fe700 1 -- 172.21.15.98:0/2724508088 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fe12c019030 con 0x7fe1380f5640 2023-01-04T18:13:30.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.175+0000 7fe13d827700 1 -- 172.21.15.98:0/2724508088 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe138045ad0 con 0x7fe1380f5640 2023-01-04T18:13:30.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.175+0000 7fe11f7fe700 1 --2- 172.21.15.98:0/2724508088 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe12005c2b0 0x7fe12005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:30.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.175+0000 7fe11f7fe700 1 -- 172.21.15.98:0/2724508088 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fe12c075720 con 0x7fe1380f5640 2023-01-04T18:13:30.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.175+0000 7fe1367fc700 1 --2- 172.21.15.98:0/2724508088 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe12005c2b0 0x7fe12005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:30.180 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.176+0000 7fe1367fc700 1 --2- 172.21.15.98:0/2724508088 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe12005c2b0 0x7fe12005e770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fe128013580 tx=0x7fe128009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:30.181 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.179+0000 7fe11f7fe700 1 -- 172.21.15.98:0/2724508088 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe12c0462b0 con 0x7fe1380f5640 2023-01-04T18:13:30.390 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.387+0000 7fe13d827700 1 -- 172.21.15.98:0/2724508088 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fe1380fde70 con 0x7fe1380f5640 2023-01-04T18:13:30.395 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.392+0000 7fe11f7fe700 1 -- 172.21.15.98:0/2724508088 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7fe12c04c0b0 con 0x7fe1380f5640 2023-01-04T18:13:30.395 INFO:teuthology.orchestra.run.smithi098.stdout:[client.1] 2023-01-04T18:13:30.395 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDKwbVj5pA0FxAAoNEOq8ux5xkXh0pmpdo8vg== 2023-01-04T18:13:30.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.393+0000 7fe13d827700 1 -- 172.21.15.98:0/2724508088 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe12005c2b0 msgr2=0x7fe12005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:30.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.393+0000 7fe13d827700 1 --2- 172.21.15.98:0/2724508088 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe12005c2b0 0x7fe12005e770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fe128013580 tx=0x7fe128009b30).stop 2023-01-04T18:13:30.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.393+0000 7fe13d827700 1 -- 172.21.15.98:0/2724508088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1380f5640 msgr2=0x7fe13810c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:30.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.393+0000 7fe13d827700 1 --2- 172.21.15.98:0/2724508088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1380f5640 0x7fe13810c000 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fe12c00c530 tx=0x7fe12c007e10).stop 2023-01-04T18:13:30.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.393+0000 7fe13d827700 1 -- 172.21.15.98:0/2724508088 shutdown_connections 2023-01-04T18:13:30.396 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.393+0000 7fe13d827700 1 --2- 172.21.15.98:0/2724508088 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe12005c2b0 0x7fe12005e770 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:30.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.393+0000 7fe13d827700 1 --2- 172.21.15.98:0/2724508088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1380f5640 0x7fe13810c000 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:30.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.393+0000 7fe13d827700 1 --2- 172.21.15.98:0/2724508088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1380f68e0 0x7fe13810e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:30.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.393+0000 7fe13d827700 1 -- 172.21.15.98:0/2724508088 >> 172.21.15.98:0/2724508088 conn(0x7fe1380f0da0 msgr2=0x7fe1380fa330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:30.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.393+0000 7fe13d827700 1 -- 172.21.15.98:0/2724508088 shutdown_connections 2023-01-04T18:13:30.397 INFO:teuthology.orchestra.run.smithi098.stderr:2023-01-04T18:13:30.393+0000 7fe13d827700 1 -- 172.21.15.98:0/2724508088 wait complete. 2023-01-04T18:13:30.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:29.280488+0000 mgr.smithi050.emnywo (mgr.14162) 154 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:30.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:29.280488+0000 mgr.smithi050.emnywo (mgr.14162) 154 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:30.851 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-01-04T18:13:30.851 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2023-01-04T18:13:30.851 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-01-04T18:13:30.893 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph osd dump --format=json 2023-01-04T18:13:31.350 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050/config 2023-01-04T18:13:31.611 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:30.388501+0000 mon.smithi098 (mon.1) 14 : audit [INF] from='client.? 172.21.15.98:0/2724508088' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-01-04T18:13:31.611 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:30.389110+0000 mon.smithi050 (mon.0) 430 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-01-04T18:13:31.611 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:30.392518+0000 mon.smithi050 (mon.0) 431 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-01-04T18:13:31.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:30.388501+0000 mon.smithi098 (mon.1) 14 : audit [INF] from='client.? 172.21.15.98:0/2724508088' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-01-04T18:13:31.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:30.389110+0000 mon.smithi050 (mon.0) 430 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-01-04T18:13:31.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:30.392518+0000 mon.smithi050 (mon.0) 431 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-01-04T18:13:32.464 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:31.280965+0000 mgr.smithi050.emnywo (mgr.14162) 155 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:32.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.592+0000 7f2da4920700 1 -- 172.21.15.50:0/203170464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2da00f67b0 msgr2=0x7f2da00f6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.592+0000 7f2da4920700 1 --2- 172.21.15.50:0/203170464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2da00f67b0 0x7f2da00f6c10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f2d94004660 tx=0x7f2d94009b30).stop 2023-01-04T18:13:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.592+0000 7f2da4920700 1 -- 172.21.15.50:0/203170464 shutdown_connections 2023-01-04T18:13:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.592+0000 7f2da4920700 1 --2- 172.21.15.50:0/203170464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2da00f67b0 0x7f2da00f6c10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.592+0000 7f2da4920700 1 --2- 172.21.15.50:0/203170464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2da00f5510 0x7f2da00f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.592+0000 7f2da4920700 1 -- 172.21.15.50:0/203170464 >> 172.21.15.50:0/203170464 conn(0x7f2da00f0c70 msgr2=0x7f2da00f3090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.592+0000 7f2da4920700 1 -- 172.21.15.50:0/203170464 shutdown_connections 2023-01-04T18:13:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.592+0000 7f2da4920700 1 -- 172.21.15.50:0/203170464 wait complete. 2023-01-04T18:13:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.593+0000 7f2da4920700 1 Processor -- start 2023-01-04T18:13:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.593+0000 7f2da4920700 1 -- start start 2023-01-04T18:13:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.593+0000 7f2da4920700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2da00f5510 0x7f2da0106ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.593+0000 7f2da4920700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2da00f67b0 0x7f2da01073d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.593+0000 7f2da4920700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da0107980 con 0x7f2da00f5510 2023-01-04T18:13:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.593+0000 7f2da4920700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da0107ac0 con 0x7f2da00f67b0 2023-01-04T18:13:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.593+0000 7f2d9ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2da00f5510 0x7f2da0106ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.593+0000 7f2d9ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2da00f5510 0x7f2da0106ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43036/0 (socket says 172.21.15.50:43036) 2023-01-04T18:13:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.593+0000 7f2d9ed9d700 1 -- 172.21.15.50:0/3483212348 learned_addr learned my addr 172.21.15.50:0/3483212348 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:13:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.594+0000 7f2d9e59c700 1 --2- 172.21.15.50:0/3483212348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2da00f67b0 0x7f2da01073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.594+0000 7f2d9ed9d700 1 -- 172.21.15.50:0/3483212348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2da00f67b0 msgr2=0x7f2da01073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.594+0000 7f2d9ed9d700 1 --2- 172.21.15.50:0/3483212348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2da00f67b0 0x7f2da01073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.594+0000 7f2d9ed9d700 1 -- 172.21.15.50:0/3483212348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d94005040 con 0x7f2da00f5510 2023-01-04T18:13:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.594+0000 7f2d9e59c700 1 --2- 172.21.15.50:0/3483212348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2da00f67b0 0x7f2da01073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:13:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.594+0000 7f2d9ed9d700 1 --2- 172.21.15.50:0/3483212348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2da00f5510 0x7f2da0106ee0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f2d9000c790 tx=0x7f2d90007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.594+0000 7f2d877fe700 1 -- 172.21.15.50:0/3483212348 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d9000e680 con 0x7f2da00f5510 2023-01-04T18:13:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.594+0000 7f2da4920700 1 -- 172.21.15.50:0/3483212348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da0108460 con 0x7f2da00f5510 2023-01-04T18:13:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.594+0000 7f2d877fe700 1 -- 172.21.15.50:0/3483212348 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2d9000ec90 con 0x7f2da00f5510 2023-01-04T18:13:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.594+0000 7f2d877fe700 1 -- 172.21.15.50:0/3483212348 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d90012cb0 con 0x7f2da00f5510 2023-01-04T18:13:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.594+0000 7f2da4920700 1 -- 172.21.15.50:0/3483212348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da0108a20 con 0x7f2da00f5510 2023-01-04T18:13:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.595+0000 7f2da4920700 1 -- 172.21.15.50:0/3483212348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da0045ad0 con 0x7f2da00f5510 2023-01-04T18:13:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.595+0000 7f2d877fe700 1 -- 172.21.15.50:0/3483212348 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f2d90010070 con 0x7f2da00f5510 2023-01-04T18:13:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.596+0000 7f2d877fe700 1 --2- 172.21.15.50:0/3483212348 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f2d8805c2b0 0x7f2d8805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.596+0000 7f2d877fe700 1 -- 172.21.15.50:0/3483212348 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f2d90075c80 con 0x7f2da00f5510 2023-01-04T18:13:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.596+0000 7f2d9e59c700 1 --2- 172.21.15.50:0/3483212348 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f2d8805c2b0 0x7f2d8805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.596+0000 7f2d9e59c700 1 --2- 172.21.15.50:0/3483212348 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f2d8805c2b0 0x7f2d8805e770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f2d94013580 tx=0x7f2d94009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.600+0000 7f2d877fe700 1 -- 172.21.15.50:0/3483212348 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2d90048c20 con 0x7f2da00f5510 2023-01-04T18:13:32.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.758+0000 7f2da4920700 1 -- 172.21.15.50:0/3483212348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2da0109060 con 0x7f2da00f5510 2023-01-04T18:13:32.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.759+0000 7f2d877fe700 1 -- 172.21.15.50:0/3483212348 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+10883 (secure 0 0 0) 0x7f2d9004c240 con 0x7f2da00f5510 2023-01-04T18:13:32.762 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:13:32.762 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":36,"fsid":"d98671da-8c5a-11ed-821a-001a4aab830c","created":"2023-01-04T18:09:16.009200+0000","modified":"2023-01-04T18:13:23.280950+0000","last_up_change":"2023-01-04T18:13:22.225898+0000","last_in_change":"2023-01-04T18:13:05.868442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-01-04T18:12:40.118167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"364b88f0-63eb-4ee0-9961-6d394328fb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6803","nonce":2221606938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6805","nonce":2221606938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6809","nonce":2221606938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6807","nonce":2221606938}]},"public_addr":"172.21.15.50:6803/2221606938","cluster_addr":"172.21.15.50:6805/2221606938","heartbeat_back_addr":"172.21.15.50:6809/2221606938","heartbeat_front_addr":"172.21.15.50:6807/2221606938","state":["exists","up"]},{"osd":1,"uuid":"2e3617b7-4f5a-417f-ac90-d557ed55507f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6811","nonce":2500190979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6813","nonce":2500190979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6817","nonce":2500190979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6815","nonce":2500190979}]},"public_addr":"172.21.15.50:6811/2500190979","cluster_addr":"172.21.15.50:6813/2500190979","heartbeat_back_addr":"172.21.15.50:6817/2500190979","heartbeat_front_addr":"172.21.15.50:6815/2500190979","state":["exists","up"]},{"osd":2,"uuid":"f5fb8cb5-19be-471e-a297-0cfa6721f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6819","nonce":1577657554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6821","nonce":1577657554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6825","nonce":1577657554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6823","nonce":1577657554}]},"public_addr":"172.21.15.50:6819/1577657554","cluster_addr":"172.21.15.50:6821/1577657554","heartbeat_back_addr":"172.21.15.50:6825/1577657554","heartbeat_front_addr":"172.21.15.50:6823/1577657554","state":["exists","up"]},{"osd":3,"uuid":"ebc8dd52-f41d-4d85-a3bd-16ad8d121436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6801","nonce":4254376132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6803","nonce":4254376132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6807","nonce":4254376132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6805","nonce":4254376132}]},"public_addr":"172.21.15.98:6801/4254376132","cluster_addr":"172.21.15.98:6803/4254376132","heartbeat_back_addr":"172.21.15.98:6807/4254376132","heartbeat_front_addr":"172.21.15.98:6805/4254376132","state":["exists","up"]},{"osd":4,"uuid":"37f00733-dce6-4862-96b7-2eab49821451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6809","nonce":3371156908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6811","nonce":3371156908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6815","nonce":3371156908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6813","nonce":3371156908}]},"public_addr":"172.21.15.98:6809/3371156908","cluster_addr":"172.21.15.98:6811/3371156908","heartbeat_back_addr":"172.21.15.98:6815/3371156908","heartbeat_front_addr":"172.21.15.98:6813/3371156908","state":["exists","up"]},{"osd":5,"uuid":"773a186f-cbc1-40a2-a7ae-183f3bbdfd9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6817","nonce":764254549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6819","nonce":764254549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6823","nonce":764254549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6821","nonce":764254549}]},"public_addr":"172.21.15.98:6817/764254549","cluster_addr":"172.21.15.98:6819/764254549","heartbeat_back_addr":"172.21.15.98:6823/764254549","heartbeat_front_addr":"172.21.15.98:6821/764254549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:11:53.534560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:12:10.806420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:12:28.093489+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:12:44.642140+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:13:02.605039+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:13:21.050426+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/2515216785":"2023-01-05T18:10:13.194077+0000","172.21.15.50:0/878334031":"2023-01-05T18:10:13.194077+0000","172.21.15.50:6801/3751193798":"2023-01-05T18:09:59.360317+0000","172.21.15.50:6801/2515216785":"2023-01-05T18:10:13.194077+0000","172.21.15.50:0/1004257612":"2023-01-05T18:10:13.194077+0000","172.21.15.50:0/1815506343":"2023-01-05T18:09:59.360317+0000","172.21.15.50:0/2856929359":"2023-01-05T18:09:59.360317+0000","172.21.15.50:6800/27207172":"2023-01-05T18:09:35.421204+0000","172.21.15.50:6800/3751193798":"2023-01-05T18:09:59.360317+0000","172.21.15.50:0/2199987942":"2023-01-05T18:09:35.421204+0000","172.21.15.50:6801/27207172":"2023-01-05T18:09:35.421204+0000","172.21.15.50:0/1586567006":"2023-01-05T18:09:35.421204+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-04T18:13:32.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.760+0000 7f2da4920700 1 -- 172.21.15.50:0/3483212348 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f2d8805c2b0 msgr2=0x7f2d8805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:32.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.760+0000 7f2da4920700 1 --2- 172.21.15.50:0/3483212348 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f2d8805c2b0 0x7f2d8805e770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f2d94013580 tx=0x7f2d94009b30).stop 2023-01-04T18:13:32.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.760+0000 7f2da4920700 1 -- 172.21.15.50:0/3483212348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2da00f5510 msgr2=0x7f2da0106ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:32.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.760+0000 7f2da4920700 1 --2- 172.21.15.50:0/3483212348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2da00f5510 0x7f2da0106ee0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f2d9000c790 tx=0x7f2d90007d90).stop 2023-01-04T18:13:32.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.760+0000 7f2da4920700 1 -- 172.21.15.50:0/3483212348 shutdown_connections 2023-01-04T18:13:32.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.760+0000 7f2da4920700 1 --2- 172.21.15.50:0/3483212348 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f2d8805c2b0 0x7f2d8805e770 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:32.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.760+0000 7f2da4920700 1 --2- 172.21.15.50:0/3483212348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2da00f5510 0x7f2da0106ee0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:32.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.761+0000 7f2da4920700 1 --2- 172.21.15.50:0/3483212348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2da00f67b0 0x7f2da01073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:32.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.761+0000 7f2da4920700 1 -- 172.21.15.50:0/3483212348 >> 172.21.15.50:0/3483212348 conn(0x7f2da00f0c70 msgr2=0x7f2da005fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:32.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.761+0000 7f2da4920700 1 -- 172.21.15.50:0/3483212348 shutdown_connections 2023-01-04T18:13:32.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:32.761+0000 7f2da4920700 1 -- 172.21.15.50:0/3483212348 wait complete. 2023-01-04T18:13:32.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:31.280965+0000 mgr.smithi050.emnywo (mgr.14162) 155 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:33.164 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-01-04T18:12:40.118167+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2023-01-04T18:13:33.164 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph osd pool get device_health_metrics pg_num 2023-01-04T18:13:33.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:33 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:32.760098+0000 mon.smithi050 (mon.0) 432 : audit [DBG] from='client.? 172.21.15.50:0/3483212348' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-01-04T18:13:33.612 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050/config 2023-01-04T18:13:33.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:33 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:32.760098+0000 mon.smithi050 (mon.0) 432 : audit [DBG] from='client.? 172.21.15.50:0/3483212348' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-01-04T18:13:34.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:33.281322+0000 mgr.smithi050.emnywo (mgr.14162) 156 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:34.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:33.281322+0000 mgr.smithi050.emnywo (mgr.14162) 156 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:34.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.862+0000 7f716ef92700 1 -- 172.21.15.50:0/2443392628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71680f7490 msgr2=0x7f71680f4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:34.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.862+0000 7f716ef92700 1 --2- 172.21.15.50:0/2443392628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71680f7490 0x7f71680f4720 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f7158004660 tx=0x7f7158009b30).stop 2023-01-04T18:13:34.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.862+0000 7f716ef92700 1 -- 172.21.15.50:0/2443392628 shutdown_connections 2023-01-04T18:13:34.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.862+0000 7f716ef92700 1 --2- 172.21.15.50:0/2443392628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71680f7490 0x7f71680f4720 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:34.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.862+0000 7f716ef92700 1 --2- 172.21.15.50:0/2443392628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71680f6af0 0x7f71680f6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:34.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.862+0000 7f716ef92700 1 -- 172.21.15.50:0/2443392628 >> 172.21.15.50:0/2443392628 conn(0x7f71680f0400 msgr2=0x7f71680f2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:34.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.862+0000 7f716ef92700 1 -- 172.21.15.50:0/2443392628 shutdown_connections 2023-01-04T18:13:34.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.862+0000 7f716ef92700 1 -- 172.21.15.50:0/2443392628 wait complete. 2023-01-04T18:13:34.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.862+0000 7f716ef92700 1 Processor -- start 2023-01-04T18:13:34.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.862+0000 7f716ef92700 1 -- start start 2023-01-04T18:13:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.862+0000 7f716ef92700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71680f6af0 0x7f7168109040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.863+0000 7f716ef92700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71680f7490 0x7f7168109530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.863+0000 7f716ef92700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7168109ae0 con 0x7f71680f6af0 2023-01-04T18:13:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.863+0000 7f716ef92700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7168109c20 con 0x7f71680f7490 2023-01-04T18:13:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.863+0000 7f716df90700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71680f6af0 0x7f7168109040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.863+0000 7f716df90700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71680f6af0 0x7f7168109040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43062/0 (socket says 172.21.15.50:43062) 2023-01-04T18:13:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.863+0000 7f716df90700 1 -- 172.21.15.50:0/3569317546 learned_addr learned my addr 172.21.15.50:0/3569317546 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:13:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.863+0000 7f716d78f700 1 --2- 172.21.15.50:0/3569317546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71680f7490 0x7f7168109530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.863+0000 7f716df90700 1 -- 172.21.15.50:0/3569317546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71680f7490 msgr2=0x7f7168109530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.863+0000 7f716df90700 1 --2- 172.21.15.50:0/3569317546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71680f7490 0x7f7168109530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:34.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.863+0000 7f716df90700 1 -- 172.21.15.50:0/3569317546 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7158005040 con 0x7f71680f6af0 2023-01-04T18:13:34.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.863+0000 7f716d78f700 1 --2- 172.21.15.50:0/3569317546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71680f7490 0x7f7168109530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-01-04T18:13:34.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.863+0000 7f716df90700 1 --2- 172.21.15.50:0/3569317546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71680f6af0 0x7f7168109040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f716400e7f0 tx=0x7f716400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:34.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.863+0000 7f715e7fc700 1 -- 172.21.15.50:0/3569317546 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71640092e0 con 0x7f71680f6af0 2023-01-04T18:13:34.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.863+0000 7f715e7fc700 1 -- 172.21.15.50:0/3569317546 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f716400f040 con 0x7f71680f6af0 2023-01-04T18:13:34.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.863+0000 7f715e7fc700 1 -- 172.21.15.50:0/3569317546 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71640146c0 con 0x7f71680f6af0 2023-01-04T18:13:34.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.863+0000 7f716ef92700 1 -- 172.21.15.50:0/3569317546 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716810a5c0 con 0x7f71680f6af0 2023-01-04T18:13:34.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.863+0000 7f716ef92700 1 -- 172.21.15.50:0/3569317546 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716810ab80 con 0x7f71680f6af0 2023-01-04T18:13:34.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.864+0000 7f716ef92700 1 -- 172.21.15.50:0/3569317546 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7168045ad0 con 0x7f71680f6af0 2023-01-04T18:13:34.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.865+0000 7f715e7fc700 1 -- 172.21.15.50:0/3569317546 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f716401b030 con 0x7f71680f6af0 2023-01-04T18:13:34.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.865+0000 7f715e7fc700 1 --2- 172.21.15.50:0/3569317546 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f715405c2b0 0x7f715405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:34.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.865+0000 7f715e7fc700 1 -- 172.21.15.50:0/3569317546 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f7164075930 con 0x7f71680f6af0 2023-01-04T18:13:34.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.865+0000 7f716d78f700 1 --2- 172.21.15.50:0/3569317546 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f715405c2b0 0x7f715405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:34.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.866+0000 7f716d78f700 1 --2- 172.21.15.50:0/3569317546 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f715405c2b0 0x7f715405e770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f7158000c00 tx=0x7f715800b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:34.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:34.869+0000 7f715e7fc700 1 -- 172.21.15.50:0/3569317546 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7164048980 con 0x7f71680f6af0 2023-01-04T18:13:35.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:35.028+0000 7f716ef92700 1 -- 172.21.15.50:0/3569317546 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7168027a00 con 0x7f71680f6af0 2023-01-04T18:13:35.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:35.028+0000 7f715e7fc700 1 -- 172.21.15.50:0/3569317546 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v36) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7164019020 con 0x7f71680f6af0 2023-01-04T18:13:35.032 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-01-04T18:13:35.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:35.030+0000 7f716ef92700 1 -- 172.21.15.50:0/3569317546 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f715405c2b0 msgr2=0x7f715405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:35.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:35.030+0000 7f716ef92700 1 --2- 172.21.15.50:0/3569317546 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f715405c2b0 0x7f715405e770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f7158000c00 tx=0x7f715800b040).stop 2023-01-04T18:13:35.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:35.030+0000 7f716ef92700 1 -- 172.21.15.50:0/3569317546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71680f6af0 msgr2=0x7f7168109040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:35.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:35.030+0000 7f716ef92700 1 --2- 172.21.15.50:0/3569317546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71680f6af0 0x7f7168109040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f716400e7f0 tx=0x7f716400b040).stop 2023-01-04T18:13:35.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:35.030+0000 7f716ef92700 1 -- 172.21.15.50:0/3569317546 shutdown_connections 2023-01-04T18:13:35.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:35.030+0000 7f716ef92700 1 --2- 172.21.15.50:0/3569317546 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f715405c2b0 0x7f715405e770 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:35.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:35.030+0000 7f716ef92700 1 --2- 172.21.15.50:0/3569317546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71680f6af0 0x7f7168109040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:35.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:35.030+0000 7f716ef92700 1 --2- 172.21.15.50:0/3569317546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71680f7490 0x7f7168109530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:35.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:35.030+0000 7f716ef92700 1 -- 172.21.15.50:0/3569317546 >> 172.21.15.50:0/3569317546 conn(0x7f71680f0400 msgr2=0x7f71680fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:35.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:35.030+0000 7f716ef92700 1 -- 172.21.15.50:0/3569317546 shutdown_connections 2023-01-04T18:13:35.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:35.030+0000 7f716ef92700 1 -- 172.21.15.50:0/3569317546 wait complete. 2023-01-04T18:13:35.512 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-01-04T18:13:35.512 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-01-04T18:13:35.512 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph mgr dump --format=json 2023-01-04T18:13:35.786 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:35.029908+0000 mon.smithi050 (mon.0) 433 : audit [DBG] from='client.? 172.21.15.50:0/3569317546' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2023-01-04T18:13:35.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:35.029908+0000 mon.smithi050 (mon.0) 433 : audit [DBG] from='client.? 172.21.15.50:0/3569317546' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2023-01-04T18:13:35.957 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050/config 2023-01-04T18:13:36.513 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:35.281614+0000 mgr.smithi050.emnywo (mgr.14162) 157 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:36.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:35.281614+0000 mgr.smithi050.emnywo (mgr.14162) 157 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:37.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.225+0000 7f3e40b25700 1 -- 172.21.15.50:0/763695487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e3c0f6960 msgr2=0x7f3e3c0f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:37.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.225+0000 7f3e40b25700 1 --2- 172.21.15.50:0/763695487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e3c0f6960 0x7f3e3c0f6dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f3e24004660 tx=0x7f3e24009b30).stop 2023-01-04T18:13:37.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.225+0000 7f3e40b25700 1 -- 172.21.15.50:0/763695487 shutdown_connections 2023-01-04T18:13:37.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.225+0000 7f3e40b25700 1 --2- 172.21.15.50:0/763695487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e3c0f6960 0x7f3e3c0f6dc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:37.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.225+0000 7f3e40b25700 1 --2- 172.21.15.50:0/763695487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e3c0f56c0 0x7f3e3c0f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:37.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.225+0000 7f3e40b25700 1 -- 172.21.15.50:0/763695487 >> 172.21.15.50:0/763695487 conn(0x7f3e3c0f0e20 msgr2=0x7f3e3c0f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:37.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.225+0000 7f3e40b25700 1 -- 172.21.15.50:0/763695487 shutdown_connections 2023-01-04T18:13:37.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.225+0000 7f3e40b25700 1 -- 172.21.15.50:0/763695487 wait complete. 2023-01-04T18:13:37.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.226+0000 7f3e40b25700 1 Processor -- start 2023-01-04T18:13:37.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.226+0000 7f3e40b25700 1 -- start start 2023-01-04T18:13:37.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.226+0000 7f3e40b25700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e3c0f56c0 0x7f3e3c10c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:37.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.226+0000 7f3e40b25700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e3c0f6960 0x7f3e3c10e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:37.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.226+0000 7f3e40b25700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c060810 con 0x7f3e3c0f6960 2023-01-04T18:13:37.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.226+0000 7f3e40b25700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c060950 con 0x7f3e3c0f56c0 2023-01-04T18:13:37.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.226+0000 7f3e39d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e3c0f6960 0x7f3e3c10e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:37.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.226+0000 7f3e39d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e3c0f6960 0x7f3e3c10e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53908/0 (socket says 172.21.15.50:53908) 2023-01-04T18:13:37.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.226+0000 7f3e39d9b700 1 -- 172.21.15.50:0/1531327454 learned_addr learned my addr 172.21.15.50:0/1531327454 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:13:37.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.226+0000 7f3e3a59c700 1 --2- 172.21.15.50:0/1531327454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e3c0f56c0 0x7f3e3c10c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:37.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.226+0000 7f3e39d9b700 1 -- 172.21.15.50:0/1531327454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e3c0f56c0 msgr2=0x7f3e3c10c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:37.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.226+0000 7f3e39d9b700 1 --2- 172.21.15.50:0/1531327454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e3c0f56c0 0x7f3e3c10c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:37.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.227+0000 7f3e39d9b700 1 -- 172.21.15.50:0/1531327454 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e24005040 con 0x7f3e3c0f6960 2023-01-04T18:13:37.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.227+0000 7f3e39d9b700 1 --2- 172.21.15.50:0/1531327454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e3c0f6960 0x7f3e3c10e640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f3e24000c00 tx=0x7f3e2400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:37.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.227+0000 7f3e32ffd700 1 -- 172.21.15.50:0/1531327454 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e24019070 con 0x7f3e3c0f6960 2023-01-04T18:13:37.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.227+0000 7f3e40b25700 1 -- 172.21.15.50:0/1531327454 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3c10eb30 con 0x7f3e3c0f6960 2023-01-04T18:13:37.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.227+0000 7f3e32ffd700 1 -- 172.21.15.50:0/1531327454 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3e24007e70 con 0x7f3e3c0f6960 2023-01-04T18:13:37.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.227+0000 7f3e32ffd700 1 -- 172.21.15.50:0/1531327454 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e24014d00 con 0x7f3e3c0f6960 2023-01-04T18:13:37.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.227+0000 7f3e40b25700 1 -- 172.21.15.50:0/1531327454 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3c10ef00 con 0x7f3e3c0f6960 2023-01-04T18:13:37.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.228+0000 7f3e40b25700 1 -- 172.21.15.50:0/1531327454 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3c045ad0 con 0x7f3e3c0f6960 2023-01-04T18:13:37.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.228+0000 7f3e32ffd700 1 -- 172.21.15.50:0/1531327454 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f3e24025070 con 0x7f3e3c0f6960 2023-01-04T18:13:37.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.228+0000 7f3e32ffd700 1 --2- 172.21.15.50:0/1531327454 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f3e2805c2a0 0x7f3e2805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:37.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.229+0000 7f3e32ffd700 1 -- 172.21.15.50:0/1531327454 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f3e24076c80 con 0x7f3e3c0f6960 2023-01-04T18:13:37.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.229+0000 7f3e3a59c700 1 --2- 172.21.15.50:0/1531327454 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f3e2805c2a0 0x7f3e2805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:37.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.229+0000 7f3e3a59c700 1 --2- 172.21.15.50:0/1531327454 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f3e2805c2a0 0x7f3e2805e760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f3e3c0605a0 tx=0x7f3e2c00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:37.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.233+0000 7f3e32ffd700 1 -- 172.21.15.50:0/1531327454 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f3e24049bc0 con 0x7f3e3c0f6960 2023-01-04T18:13:37.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.430+0000 7f3e40b25700 1 -- 172.21.15.50:0/1531327454 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f3e3c027a00 con 0x7f3e3c0f6960 2023-01-04T18:13:37.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.433+0000 7f3e32ffd700 1 -- 172.21.15.50:0/1531327454 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v18) v1 ==== 74+0+143500 (secure 0 0 0) 0x7f3e2404d1e0 con 0x7f3e3c0f6960 2023-01-04T18:13:37.438 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:13:37.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.435+0000 7f3e40b25700 1 -- 172.21.15.50:0/1531327454 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f3e2805c2a0 msgr2=0x7f3e2805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:37.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.435+0000 7f3e40b25700 1 --2- 172.21.15.50:0/1531327454 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f3e2805c2a0 0x7f3e2805e760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f3e3c0605a0 tx=0x7f3e2c00b040).stop 2023-01-04T18:13:37.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.435+0000 7f3e40b25700 1 -- 172.21.15.50:0/1531327454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e3c0f6960 msgr2=0x7f3e3c10e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:37.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.435+0000 7f3e40b25700 1 --2- 172.21.15.50:0/1531327454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e3c0f6960 0x7f3e3c10e640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f3e24000c00 tx=0x7f3e2400b040).stop 2023-01-04T18:13:37.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.435+0000 7f3e40b25700 1 -- 172.21.15.50:0/1531327454 shutdown_connections 2023-01-04T18:13:37.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.435+0000 7f3e40b25700 1 --2- 172.21.15.50:0/1531327454 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f3e2805c2a0 0x7f3e2805e760 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:37.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.435+0000 7f3e40b25700 1 --2- 172.21.15.50:0/1531327454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e3c0f56c0 0x7f3e3c10c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:37.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.435+0000 7f3e40b25700 1 --2- 172.21.15.50:0/1531327454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e3c0f6960 0x7f3e3c10e640 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:37.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.435+0000 7f3e40b25700 1 -- 172.21.15.50:0/1531327454 >> 172.21.15.50:0/1531327454 conn(0x7f3e3c0f0e20 msgr2=0x7f3e3c0fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:37.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.435+0000 7f3e40b25700 1 -- 172.21.15.50:0/1531327454 shutdown_connections 2023-01-04T18:13:37.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:37.435+0000 7f3e40b25700 1 -- 172.21.15.50:0/1531327454 wait complete. 2023-01-04T18:13:37.961 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":18,"active_gid":14162,"active_name":"smithi050.emnywo","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2223914843},{"type":"v1","addr":"172.21.15.50:6801","nonce":2223914843}]},"active_addr":"172.21.15.50:6801/2223914843","active_change":"2023-01-04T18:10:13.194347+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[{"gid":14198,"name":"smithi098.vhfzum","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi050.front.sepia.ceph.com:8443/","prometheus":"http://smithi050.front.sepia.ceph.com:9283/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":4,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":2251259553}]},{"addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":1074390409}]}]}} 2023-01-04T18:13:37.965 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-01-04T18:13:37.966 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-01-04T18:13:37.966 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph osd dump --format=json 2023-01-04T18:13:38.413 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050/config 2023-01-04T18:13:38.680 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:37.281931+0000 mgr.smithi050.emnywo (mgr.14162) 158 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:38.680 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:37.432181+0000 mon.smithi050 (mon.0) 434 : audit [DBG] from='client.? 172.21.15.50:0/1531327454' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-01-04T18:13:38.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:37.281931+0000 mgr.smithi050.emnywo (mgr.14162) 158 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:38.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:37.432181+0000 mon.smithi050 (mon.0) 434 : audit [DBG] from='client.? 172.21.15.50:0/1531327454' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-01-04T18:13:39.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.573+0000 7f964f733700 1 -- 172.21.15.50:0/1672440844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96480f9920 msgr2=0x7f96480fbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:39.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.573+0000 7f964f733700 1 --2- 172.21.15.50:0/1672440844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96480f9920 0x7f96480fbd70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f9638004660 tx=0x7f9638009b30).stop 2023-01-04T18:13:39.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.573+0000 7f964f733700 1 -- 172.21.15.50:0/1672440844 shutdown_connections 2023-01-04T18:13:39.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.573+0000 7f964f733700 1 --2- 172.21.15.50:0/1672440844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96480f9920 0x7f96480fbd70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:39.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.573+0000 7f964f733700 1 --2- 172.21.15.50:0/1672440844 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9648060870 0x7f96480f93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-01-04T18:13:39.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.573+0000 7f964f733700 1 -- 172.21.15.50:0/1672440844 >> 172.21.15.50:0/1672440844 conn(0x7f96480f0e20 msgr2=0x7f96480f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:39.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.573+0000 7f964f733700 1 -- 172.21.15.50:0/1672440844 shutdown_connections 2023-01-04T18:13:39.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.573+0000 7f964f733700 1 -- 172.21.15.50:0/1672440844 wait complete. 2023-01-04T18:13:39.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.573+0000 7f964f733700 1 Processor -- start 2023-01-04T18:13:39.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.573+0000 7f964f733700 1 -- start start 2023-01-04T18:13:39.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.574+0000 7f964f733700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9648060870 0x7f9648107090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:39.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.574+0000 7f964f733700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96480f9920 0x7f9648107580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:39.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.574+0000 7f964f733700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9648107bc0 con 0x7f9648060870 2023-01-04T18:13:39.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.574+0000 7f964f733700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9648108470 con 0x7f96480f9920 2023-01-04T18:13:39.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.574+0000 7f964d4cf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9648060870 0x7f9648107090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:39.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.574+0000 7f964d4cf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9648060870 0x7f9648107090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53920/0 (socket says 172.21.15.50:53920) 2023-01-04T18:13:39.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.574+0000 7f964d4cf700 1 -- 172.21.15.50:0/583133433 learned_addr learned my addr 172.21.15.50:0/583133433 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:13:39.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.574+0000 7f964d4cf700 1 -- 172.21.15.50:0/583133433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96480f9920 msgr2=0x7f9648107580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:39.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.574+0000 7f964d4cf700 1 --2- 172.21.15.50:0/583133433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96480f9920 0x7f9648107580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-01-04T18:13:39.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.574+0000 7f964d4cf700 1 -- 172.21.15.50:0/583133433 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9638005040 con 0x7f9648060870 2023-01-04T18:13:39.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.574+0000 7f964d4cf700 1 --2- 172.21.15.50:0/583133433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9648060870 0x7f9648107090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f964400b410 tx=0x7f9644006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:39.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.574+0000 7f963dffb700 1 -- 172.21.15.50:0/583133433 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96440125f0 con 0x7f9648060870 2023-01-04T18:13:39.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.574+0000 7f963dffb700 1 -- 172.21.15.50:0/583133433 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9644012c00 con 0x7f9648060870 2023-01-04T18:13:39.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.574+0000 7f964f733700 1 -- 172.21.15.50:0/583133433 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9648108750 con 0x7f9648060870 2023-01-04T18:13:39.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.574+0000 7f963dffb700 1 -- 172.21.15.50:0/583133433 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9644002aa0 con 0x7f9648060870 2023-01-04T18:13:39.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.575+0000 7f964f733700 1 -- 172.21.15.50:0/583133433 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9648108d10 con 0x7f9648060870 2023-01-04T18:13:39.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.575+0000 7f964f733700 1 -- 172.21.15.50:0/583133433 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9648059100 con 0x7f9648060870 2023-01-04T18:13:39.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.576+0000 7f963dffb700 1 -- 172.21.15.50:0/583133433 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f964400f030 con 0x7f9648060870 2023-01-04T18:13:39.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.576+0000 7f963dffb700 1 --2- 172.21.15.50:0/583133433 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f963405c2a0 0x7f963405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:39.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.576+0000 7f963dffb700 1 -- 172.21.15.50:0/583133433 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f9644076040 con 0x7f9648060870 2023-01-04T18:13:39.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.576+0000 7f964ccce700 1 --2- 172.21.15.50:0/583133433 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f963405c2a0 0x7f963405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:39.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.576+0000 7f964ccce700 1 --2- 172.21.15.50:0/583133433 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f963405c2a0 0x7f963405e760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f9638009f50 tx=0x7f9638009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:39.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.580+0000 7f963dffb700 1 -- 172.21.15.50:0/583133433 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9644049040 con 0x7f9648060870 2023-01-04T18:13:39.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.738+0000 7f964f733700 1 -- 172.21.15.50:0/583133433 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96480ff100 con 0x7f9648060870 2023-01-04T18:13:39.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.739+0000 7f963dffb700 1 -- 172.21.15.50:0/583133433 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+10883 (secure 0 0 0) 0x7f964404c660 con 0x7f9648060870 2023-01-04T18:13:39.742 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:13:39.743 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":36,"fsid":"d98671da-8c5a-11ed-821a-001a4aab830c","created":"2023-01-04T18:09:16.009200+0000","modified":"2023-01-04T18:13:23.280950+0000","last_up_change":"2023-01-04T18:13:22.225898+0000","last_in_change":"2023-01-04T18:13:05.868442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-01-04T18:12:40.118167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"364b88f0-63eb-4ee0-9961-6d394328fb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6803","nonce":2221606938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6805","nonce":2221606938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6809","nonce":2221606938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6807","nonce":2221606938}]},"public_addr":"172.21.15.50:6803/2221606938","cluster_addr":"172.21.15.50:6805/2221606938","heartbeat_back_addr":"172.21.15.50:6809/2221606938","heartbeat_front_addr":"172.21.15.50:6807/2221606938","state":["exists","up"]},{"osd":1,"uuid":"2e3617b7-4f5a-417f-ac90-d557ed55507f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6811","nonce":2500190979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6813","nonce":2500190979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6817","nonce":2500190979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6815","nonce":2500190979}]},"public_addr":"172.21.15.50:6811/2500190979","cluster_addr":"172.21.15.50:6813/2500190979","heartbeat_back_addr":"172.21.15.50:6817/2500190979","heartbeat_front_addr":"172.21.15.50:6815/2500190979","state":["exists","up"]},{"osd":2,"uuid":"f5fb8cb5-19be-471e-a297-0cfa6721f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6819","nonce":1577657554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6821","nonce":1577657554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6825","nonce":1577657554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6823","nonce":1577657554}]},"public_addr":"172.21.15.50:6819/1577657554","cluster_addr":"172.21.15.50:6821/1577657554","heartbeat_back_addr":"172.21.15.50:6825/1577657554","heartbeat_front_addr":"172.21.15.50:6823/1577657554","state":["exists","up"]},{"osd":3,"uuid":"ebc8dd52-f41d-4d85-a3bd-16ad8d121436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6801","nonce":4254376132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6803","nonce":4254376132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6807","nonce":4254376132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6805","nonce":4254376132}]},"public_addr":"172.21.15.98:6801/4254376132","cluster_addr":"172.21.15.98:6803/4254376132","heartbeat_back_addr":"172.21.15.98:6807/4254376132","heartbeat_front_addr":"172.21.15.98:6805/4254376132","state":["exists","up"]},{"osd":4,"uuid":"37f00733-dce6-4862-96b7-2eab49821451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6809","nonce":3371156908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6811","nonce":3371156908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6815","nonce":3371156908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6813","nonce":3371156908}]},"public_addr":"172.21.15.98:6809/3371156908","cluster_addr":"172.21.15.98:6811/3371156908","heartbeat_back_addr":"172.21.15.98:6815/3371156908","heartbeat_front_addr":"172.21.15.98:6813/3371156908","state":["exists","up"]},{"osd":5,"uuid":"773a186f-cbc1-40a2-a7ae-183f3bbdfd9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6817","nonce":764254549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6819","nonce":764254549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6823","nonce":764254549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6821","nonce":764254549}]},"public_addr":"172.21.15.98:6817/764254549","cluster_addr":"172.21.15.98:6819/764254549","heartbeat_back_addr":"172.21.15.98:6823/764254549","heartbeat_front_addr":"172.21.15.98:6821/764254549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:11:53.534560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:12:10.806420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:12:28.093489+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:12:44.642140+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:13:02.605039+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:13:21.050426+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/2515216785":"2023-01-05T18:10:13.194077+0000","172.21.15.50:0/878334031":"2023-01-05T18:10:13.194077+0000","172.21.15.50:6801/3751193798":"2023-01-05T18:09:59.360317+0000","172.21.15.50:6801/2515216785":"2023-01-05T18:10:13.194077+0000","172.21.15.50:0/1004257612":"2023-01-05T18:10:13.194077+0000","172.21.15.50:0/1815506343":"2023-01-05T18:09:59.360317+0000","172.21.15.50:0/2856929359":"2023-01-05T18:09:59.360317+0000","172.21.15.50:6800/27207172":"2023-01-05T18:09:35.421204+0000","172.21.15.50:6800/3751193798":"2023-01-05T18:09:59.360317+0000","172.21.15.50:0/2199987942":"2023-01-05T18:09:35.421204+0000","172.21.15.50:6801/27207172":"2023-01-05T18:09:35.421204+0000","172.21.15.50:0/1586567006":"2023-01-05T18:09:35.421204+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-04T18:13:39.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.741+0000 7f964f733700 1 -- 172.21.15.50:0/583133433 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f963405c2a0 msgr2=0x7f963405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:39.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.741+0000 7f964f733700 1 --2- 172.21.15.50:0/583133433 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f963405c2a0 0x7f963405e760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f9638009f50 tx=0x7f9638009b30).stop 2023-01-04T18:13:39.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.741+0000 7f964f733700 1 -- 172.21.15.50:0/583133433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9648060870 msgr2=0x7f9648107090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:39.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.741+0000 7f964f733700 1 --2- 172.21.15.50:0/583133433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9648060870 0x7f9648107090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f964400b410 tx=0x7f9644006ef0).stop 2023-01-04T18:13:39.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.741+0000 7f964f733700 1 -- 172.21.15.50:0/583133433 shutdown_connections 2023-01-04T18:13:39.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.741+0000 7f964f733700 1 --2- 172.21.15.50:0/583133433 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f963405c2a0 0x7f963405e760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:39.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.741+0000 7f964f733700 1 --2- 172.21.15.50:0/583133433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9648060870 0x7f9648107090 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:39.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.741+0000 7f964f733700 1 --2- 172.21.15.50:0/583133433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96480f9920 0x7f9648107580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-01-04T18:13:39.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.741+0000 7f964f733700 1 -- 172.21.15.50:0/583133433 >> 172.21.15.50:0/583133433 conn(0x7f96480f0e20 msgr2=0x7f96480f3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:39.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.741+0000 7f964f733700 1 -- 172.21.15.50:0/583133433 shutdown_connections 2023-01-04T18:13:39.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:39.741+0000 7f964f733700 1 -- 172.21.15.50:0/583133433 wait complete. 2023-01-04T18:13:40.227 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-01-04T18:13:40.227 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph osd dump --format=json 2023-01-04T18:13:40.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:39.282338+0000 mgr.smithi050.emnywo (mgr.14162) 159 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:40.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:39.740436+0000 mon.smithi050 (mon.0) 435 : audit [DBG] from='client.? 172.21.15.50:0/583133433' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-01-04T18:13:40.674 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050/config 2023-01-04T18:13:40.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:39.282338+0000 mgr.smithi050.emnywo (mgr.14162) 159 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:40.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:39.740436+0000 mon.smithi050 (mon.0) 435 : audit [DBG] from='client.? 172.21.15.50:0/583133433' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-01-04T18:13:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.840+0000 7f9a095db700 1 -- 172.21.15.50:0/390137140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a040f6960 msgr2=0x7f9a040f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.840+0000 7f9a095db700 1 --2- 172.21.15.50:0/390137140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a040f6960 0x7f9a040f6dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f99f4004660 tx=0x7f99f4009b30).stop 2023-01-04T18:13:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.840+0000 7f9a095db700 1 -- 172.21.15.50:0/390137140 shutdown_connections 2023-01-04T18:13:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.840+0000 7f9a095db700 1 --2- 172.21.15.50:0/390137140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a040f6960 0x7f9a040f6dc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.840+0000 7f9a095db700 1 --2- 172.21.15.50:0/390137140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a040f56c0 0x7f9a040f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.840+0000 7f9a095db700 1 -- 172.21.15.50:0/390137140 >> 172.21.15.50:0/390137140 conn(0x7f9a040f0e20 msgr2=0x7f9a040f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.840+0000 7f9a095db700 1 -- 172.21.15.50:0/390137140 shutdown_connections 2023-01-04T18:13:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.840+0000 7f9a095db700 1 -- 172.21.15.50:0/390137140 wait complete. 2023-01-04T18:13:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.841+0000 7f9a095db700 1 Processor -- start 2023-01-04T18:13:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.841+0000 7f9a095db700 1 -- start start 2023-01-04T18:13:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.841+0000 7f9a095db700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a040f56c0 0x7f9a04109d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.841+0000 7f9a095db700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a040f6960 0x7f9a0410c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.841+0000 7f9a095db700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a04060920 con 0x7f9a040f6960 2023-01-04T18:13:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.841+0000 7f9a095db700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a04060a60 con 0x7f9a040f56c0 2023-01-04T18:13:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.842+0000 7f9a027fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a040f6960 0x7f9a0410c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.842+0000 7f9a027fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a040f6960 0x7f9a0410c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53944/0 (socket says 172.21.15.50:53944) 2023-01-04T18:13:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.842+0000 7f9a027fc700 1 -- 172.21.15.50:0/199890529 learned_addr learned my addr 172.21.15.50:0/199890529 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:13:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.842+0000 7f9a02ffd700 1 --2- 172.21.15.50:0/199890529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a040f56c0 0x7f9a04109d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.842+0000 7f9a027fc700 1 -- 172.21.15.50:0/199890529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a040f56c0 msgr2=0x7f9a04109d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.842+0000 7f9a027fc700 1 --2- 172.21.15.50:0/199890529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a040f56c0 0x7f9a04109d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.842+0000 7f9a027fc700 1 -- 172.21.15.50:0/199890529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f4005040 con 0x7f9a040f6960 2023-01-04T18:13:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.842+0000 7f9a027fc700 1 --2- 172.21.15.50:0/199890529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a040f6960 0x7f9a0410c240 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f99f4000c00 tx=0x7f99f400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.842+0000 7f99fb7fe700 1 -- 172.21.15.50:0/199890529 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99f4019070 con 0x7f9a040f6960 2023-01-04T18:13:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.842+0000 7f99fb7fe700 1 -- 172.21.15.50:0/199890529 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f99f4007e70 con 0x7f9a040f6960 2023-01-04T18:13:41.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.842+0000 7f9a095db700 1 -- 172.21.15.50:0/199890529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0410c790 con 0x7f9a040f6960 2023-01-04T18:13:41.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.842+0000 7f99fb7fe700 1 -- 172.21.15.50:0/199890529 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99f4014c90 con 0x7f9a040f6960 2023-01-04T18:13:41.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.842+0000 7f9a095db700 1 -- 172.21.15.50:0/199890529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0410ccc0 con 0x7f9a040f6960 2023-01-04T18:13:41.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.843+0000 7f99fb7fe700 1 -- 172.21.15.50:0/199890529 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f99f4025070 con 0x7f9a040f6960 2023-01-04T18:13:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.843+0000 7f9a095db700 1 -- 172.21.15.50:0/199890529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a04059100 con 0x7f9a040f6960 2023-01-04T18:13:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.844+0000 7f99fb7fe700 1 --2- 172.21.15.50:0/199890529 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f99f005c2a0 0x7f99f005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.844+0000 7f99fb7fe700 1 -- 172.21.15.50:0/199890529 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f99f4076ba0 con 0x7f9a040f6960 2023-01-04T18:13:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.844+0000 7f9a02ffd700 1 --2- 172.21.15.50:0/199890529 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f99f005c2a0 0x7f99f005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.844+0000 7f9a02ffd700 1 --2- 172.21.15.50:0/199890529 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f99f005c2a0 0x7f99f005e760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f9a040605a0 tx=0x7f99ec00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:41.848+0000 7f99fb7fe700 1 -- 172.21.15.50:0/199890529 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f99f4049ba0 con 0x7f9a040f6960 2023-01-04T18:13:42.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:42.006+0000 7f9a095db700 1 -- 172.21.15.50:0/199890529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a04045ad0 con 0x7f9a040f6960 2023-01-04T18:13:42.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:42.006+0000 7f99fb7fe700 1 -- 172.21.15.50:0/199890529 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+10883 (secure 0 0 0) 0x7f99f404d1c0 con 0x7f9a040f6960 2023-01-04T18:13:42.010 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:13:42.010 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":36,"fsid":"d98671da-8c5a-11ed-821a-001a4aab830c","created":"2023-01-04T18:09:16.009200+0000","modified":"2023-01-04T18:13:23.280950+0000","last_up_change":"2023-01-04T18:13:22.225898+0000","last_in_change":"2023-01-04T18:13:05.868442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-01-04T18:12:40.118167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"364b88f0-63eb-4ee0-9961-6d394328fb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6803","nonce":2221606938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6805","nonce":2221606938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6809","nonce":2221606938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6807","nonce":2221606938}]},"public_addr":"172.21.15.50:6803/2221606938","cluster_addr":"172.21.15.50:6805/2221606938","heartbeat_back_addr":"172.21.15.50:6809/2221606938","heartbeat_front_addr":"172.21.15.50:6807/2221606938","state":["exists","up"]},{"osd":1,"uuid":"2e3617b7-4f5a-417f-ac90-d557ed55507f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6811","nonce":2500190979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6813","nonce":2500190979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6817","nonce":2500190979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6815","nonce":2500190979}]},"public_addr":"172.21.15.50:6811/2500190979","cluster_addr":"172.21.15.50:6813/2500190979","heartbeat_back_addr":"172.21.15.50:6817/2500190979","heartbeat_front_addr":"172.21.15.50:6815/2500190979","state":["exists","up"]},{"osd":2,"uuid":"f5fb8cb5-19be-471e-a297-0cfa6721f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6819","nonce":1577657554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6821","nonce":1577657554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6825","nonce":1577657554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6823","nonce":1577657554}]},"public_addr":"172.21.15.50:6819/1577657554","cluster_addr":"172.21.15.50:6821/1577657554","heartbeat_back_addr":"172.21.15.50:6825/1577657554","heartbeat_front_addr":"172.21.15.50:6823/1577657554","state":["exists","up"]},{"osd":3,"uuid":"ebc8dd52-f41d-4d85-a3bd-16ad8d121436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6801","nonce":4254376132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6803","nonce":4254376132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6807","nonce":4254376132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6805","nonce":4254376132}]},"public_addr":"172.21.15.98:6801/4254376132","cluster_addr":"172.21.15.98:6803/4254376132","heartbeat_back_addr":"172.21.15.98:6807/4254376132","heartbeat_front_addr":"172.21.15.98:6805/4254376132","state":["exists","up"]},{"osd":4,"uuid":"37f00733-dce6-4862-96b7-2eab49821451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6809","nonce":3371156908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6811","nonce":3371156908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6815","nonce":3371156908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6813","nonce":3371156908}]},"public_addr":"172.21.15.98:6809/3371156908","cluster_addr":"172.21.15.98:6811/3371156908","heartbeat_back_addr":"172.21.15.98:6815/3371156908","heartbeat_front_addr":"172.21.15.98:6813/3371156908","state":["exists","up"]},{"osd":5,"uuid":"773a186f-cbc1-40a2-a7ae-183f3bbdfd9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6817","nonce":764254549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6819","nonce":764254549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6823","nonce":764254549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6821","nonce":764254549}]},"public_addr":"172.21.15.98:6817/764254549","cluster_addr":"172.21.15.98:6819/764254549","heartbeat_back_addr":"172.21.15.98:6823/764254549","heartbeat_front_addr":"172.21.15.98:6821/764254549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:11:53.534560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:12:10.806420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:12:28.093489+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:12:44.642140+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:13:02.605039+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:13:21.050426+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/2515216785":"2023-01-05T18:10:13.194077+0000","172.21.15.50:0/878334031":"2023-01-05T18:10:13.194077+0000","172.21.15.50:6801/3751193798":"2023-01-05T18:09:59.360317+0000","172.21.15.50:6801/2515216785":"2023-01-05T18:10:13.194077+0000","172.21.15.50:0/1004257612":"2023-01-05T18:10:13.194077+0000","172.21.15.50:0/1815506343":"2023-01-05T18:09:59.360317+0000","172.21.15.50:0/2856929359":"2023-01-05T18:09:59.360317+0000","172.21.15.50:6800/27207172":"2023-01-05T18:09:35.421204+0000","172.21.15.50:6800/3751193798":"2023-01-05T18:09:59.360317+0000","172.21.15.50:0/2199987942":"2023-01-05T18:09:35.421204+0000","172.21.15.50:6801/27207172":"2023-01-05T18:09:35.421204+0000","172.21.15.50:0/1586567006":"2023-01-05T18:09:35.421204+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-04T18:13:42.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:42.008+0000 7f9a095db700 1 -- 172.21.15.50:0/199890529 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f99f005c2a0 msgr2=0x7f99f005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:42.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:42.008+0000 7f9a095db700 1 --2- 172.21.15.50:0/199890529 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f99f005c2a0 0x7f99f005e760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f9a040605a0 tx=0x7f99ec00b040).stop 2023-01-04T18:13:42.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:42.008+0000 7f9a095db700 1 -- 172.21.15.50:0/199890529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a040f6960 msgr2=0x7f9a0410c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:42.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:42.008+0000 7f9a095db700 1 --2- 172.21.15.50:0/199890529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a040f6960 0x7f9a0410c240 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f99f4000c00 tx=0x7f99f400b040).stop 2023-01-04T18:13:42.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:42.008+0000 7f9a095db700 1 -- 172.21.15.50:0/199890529 shutdown_connections 2023-01-04T18:13:42.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:42.008+0000 7f9a095db700 1 --2- 172.21.15.50:0/199890529 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f99f005c2a0 0x7f99f005e760 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:42.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:42.008+0000 7f9a095db700 1 --2- 172.21.15.50:0/199890529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a040f56c0 0x7f9a04109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:42.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:42.008+0000 7f9a095db700 1 --2- 172.21.15.50:0/199890529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a040f6960 0x7f9a0410c240 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:42.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:42.008+0000 7f9a095db700 1 -- 172.21.15.50:0/199890529 >> 172.21.15.50:0/199890529 conn(0x7f9a040f0e20 msgr2=0x7f9a040fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:42.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:42.008+0000 7f9a095db700 1 -- 172.21.15.50:0/199890529 shutdown_connections 2023-01-04T18:13:42.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:42.008+0000 7f9a095db700 1 -- 172.21.15.50:0/199890529 wait complete. 2023-01-04T18:13:42.490 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2023-01-04T18:13:42.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:41.282688+0000 mgr.smithi050.emnywo (mgr.14162) 160 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:42.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:42.007732+0000 mon.smithi050 (mon.0) 436 : audit [DBG] from='client.? 172.21.15.50:0/199890529' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-01-04T18:13:42.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:41.282688+0000 mgr.smithi050.emnywo (mgr.14162) 160 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:42.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:42.007732+0000 mon.smithi050 (mon.0) 436 : audit [DBG] from='client.? 172.21.15.50:0/199890529' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-01-04T18:13:42.936 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050/config 2023-01-04T18:13:44.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.195+0000 7fc14c01a700 1 -- 172.21.15.50:0/3117872437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1440f67c0 msgr2=0x7fc1440f6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:44.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.195+0000 7fc14c01a700 1 --2- 172.21.15.50:0/3117872437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1440f67c0 0x7fc1440f6be0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fc134004660 tx=0x7fc134009b30).stop 2023-01-04T18:13:44.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.195+0000 7fc14c01a700 1 -- 172.21.15.50:0/3117872437 shutdown_connections 2023-01-04T18:13:44.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.195+0000 7fc14c01a700 1 --2- 172.21.15.50:0/3117872437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1440f7a60 0x7fc1440f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:44.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.195+0000 7fc14c01a700 1 --2- 172.21.15.50:0/3117872437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1440f67c0 0x7fc1440f6be0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:44.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.195+0000 7fc14c01a700 1 -- 172.21.15.50:0/3117872437 >> 172.21.15.50:0/3117872437 conn(0x7fc1440f1f20 msgr2=0x7fc1440f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:44.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.195+0000 7fc14c01a700 1 -- 172.21.15.50:0/3117872437 shutdown_connections 2023-01-04T18:13:44.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.195+0000 7fc14c01a700 1 -- 172.21.15.50:0/3117872437 wait complete. 2023-01-04T18:13:44.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.195+0000 7fc14c01a700 1 Processor -- start 2023-01-04T18:13:44.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.195+0000 7fc14c01a700 1 -- start start 2023-01-04T18:13:44.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.196+0000 7fc14c01a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1440f67c0 0x7fc14406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:44.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.196+0000 7fc14c01a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1440f7a60 0x7fc144069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:44.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.196+0000 7fc14c01a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14406a380 con 0x7fc1440f7a60 2023-01-04T18:13:44.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.196+0000 7fc14c01a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14406a4c0 con 0x7fc1440f67c0 2023-01-04T18:13:44.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.196+0000 7fc1495b5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1440f7a60 0x7fc144069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:44.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.196+0000 7fc1495b5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1440f7a60 0x7fc144069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53968/0 (socket says 172.21.15.50:53968) 2023-01-04T18:13:44.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.196+0000 7fc1495b5700 1 -- 172.21.15.50:0/1597564474 learned_addr learned my addr 172.21.15.50:0/1597564474 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:13:44.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.196+0000 7fc149db6700 1 --2- 172.21.15.50:0/1597564474 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1440f67c0 0x7fc14406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:44.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.196+0000 7fc1495b5700 1 -- 172.21.15.50:0/1597564474 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1440f67c0 msgr2=0x7fc14406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:44.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.196+0000 7fc1495b5700 1 --2- 172.21.15.50:0/1597564474 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1440f67c0 0x7fc14406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:44.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.196+0000 7fc1495b5700 1 -- 172.21.15.50:0/1597564474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc134005040 con 0x7fc1440f7a60 2023-01-04T18:13:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.196+0000 7fc1495b5700 1 --2- 172.21.15.50:0/1597564474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1440f7a60 0x7fc144069e20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc1400026d0 tx=0x7fc140009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.196+0000 7fc13a7fc700 1 -- 172.21.15.50:0/1597564474 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1400079c0 con 0x7fc1440f7a60 2023-01-04T18:13:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.196+0000 7fc13a7fc700 1 -- 172.21.15.50:0/1597564474 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc14000f040 con 0x7fc1440f7a60 2023-01-04T18:13:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.196+0000 7fc14c01a700 1 -- 172.21.15.50:0/1597564474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14406a7a0 con 0x7fc1440f7a60 2023-01-04T18:13:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.196+0000 7fc13a7fc700 1 -- 172.21.15.50:0/1597564474 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1400148b0 con 0x7fc1440f7a60 2023-01-04T18:13:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.196+0000 7fc14c01a700 1 -- 172.21.15.50:0/1597564474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14410f0d0 con 0x7fc1440f7a60 2023-01-04T18:13:44.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.197+0000 7fc14c01a700 1 -- 172.21.15.50:0/1597564474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc14405dd30 con 0x7fc1440f7a60 2023-01-04T18:13:44.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.198+0000 7fc13a7fc700 1 -- 172.21.15.50:0/1597564474 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc140007b20 con 0x7fc1440f7a60 2023-01-04T18:13:44.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.198+0000 7fc13a7fc700 1 --2- 172.21.15.50:0/1597564474 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc13005c2a0 0x7fc13005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:44.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.198+0000 7fc13a7fc700 1 -- 172.21.15.50:0/1597564474 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fc140076080 con 0x7fc1440f7a60 2023-01-04T18:13:44.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.198+0000 7fc149db6700 1 --2- 172.21.15.50:0/1597564474 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc13005c2a0 0x7fc13005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:44.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.198+0000 7fc13a7fc700 1 --2- 172.21.15.50:0/1597564474 >> [v2:172.21.15.50:6802/2221606938,v1:172.21.15.50:6803/2221606938] conn(0x7fc130062030 0x7fc130064490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:44.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.198+0000 7fc13a7fc700 1 -- 172.21.15.50:0/1597564474 --> [v2:172.21.15.50:6802/2221606938,v1:172.21.15.50:6803/2221606938] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc130064b10 con 0x7fc130062030 2023-01-04T18:13:44.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.198+0000 7fc13a7fc700 1 -- 172.21.15.50:0/1597564474 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc140076480 con 0x7fc1440f7a60 2023-01-04T18:13:44.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.199+0000 7fc14a5b7700 1 --2- 172.21.15.50:0/1597564474 >> [v2:172.21.15.50:6802/2221606938,v1:172.21.15.50:6803/2221606938] conn(0x7fc130062030 0x7fc130064490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:44.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.199+0000 7fc149db6700 1 --2- 172.21.15.50:0/1597564474 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc13005c2a0 0x7fc13005e760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fc134005010 tx=0x7fc134009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:44.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.199+0000 7fc14a5b7700 1 --2- 172.21.15.50:0/1597564474 >> [v2:172.21.15.50:6802/2221606938,v1:172.21.15.50:6803/2221606938] conn(0x7fc130062030 0x7fc130064490 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:44.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.199+0000 7fc13a7fc700 1 -- 172.21.15.50:0/1597564474 <== osd.0 v2:172.21.15.50:6802/2221606938 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fc130064b10 con 0x7fc130062030 2023-01-04T18:13:44.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.214+0000 7fc14c01a700 1 -- 172.21.15.50:0/1597564474 --> [v2:172.21.15.50:6802/2221606938,v1:172.21.15.50:6803/2221606938] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc144058150 con 0x7fc130062030 2023-01-04T18:13:44.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.214+0000 7fc13a7fc700 1 -- 172.21.15.50:0/1597564474 <== osd.0 v2:172.21.15.50:6802/2221606938 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc144058150 con 0x7fc130062030 2023-01-04T18:13:44.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.214+0000 7fc14c01a700 1 -- 172.21.15.50:0/1597564474 >> [v2:172.21.15.50:6802/2221606938,v1:172.21.15.50:6803/2221606938] conn(0x7fc130062030 msgr2=0x7fc130064490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:44.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.214+0000 7fc14c01a700 1 --2- 172.21.15.50:0/1597564474 >> [v2:172.21.15.50:6802/2221606938,v1:172.21.15.50:6803/2221606938] conn(0x7fc130062030 0x7fc130064490 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:44.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.214+0000 7fc14c01a700 1 -- 172.21.15.50:0/1597564474 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc13005c2a0 msgr2=0x7fc13005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:44.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.214+0000 7fc14c01a700 1 --2- 172.21.15.50:0/1597564474 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc13005c2a0 0x7fc13005e760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fc134005010 tx=0x7fc134009b30).stop 2023-01-04T18:13:44.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.214+0000 7fc14c01a700 1 -- 172.21.15.50:0/1597564474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1440f7a60 msgr2=0x7fc144069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:44.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.214+0000 7fc14c01a700 1 --2- 172.21.15.50:0/1597564474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1440f7a60 0x7fc144069e20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc1400026d0 tx=0x7fc140009de0).stop 2023-01-04T18:13:44.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.214+0000 7fc14c01a700 1 -- 172.21.15.50:0/1597564474 shutdown_connections 2023-01-04T18:13:44.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.214+0000 7fc14c01a700 1 --2- 172.21.15.50:0/1597564474 >> [v2:172.21.15.50:6802/2221606938,v1:172.21.15.50:6803/2221606938] conn(0x7fc130062030 0x7fc130064490 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:44.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.214+0000 7fc14c01a700 1 --2- 172.21.15.50:0/1597564474 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc13005c2a0 0x7fc13005e760 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:44.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.214+0000 7fc14c01a700 1 --2- 172.21.15.50:0/1597564474 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1440f67c0 0x7fc14406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:44.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.214+0000 7fc14c01a700 1 --2- 172.21.15.50:0/1597564474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1440f7a60 0x7fc144069e20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:44.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.214+0000 7fc14c01a700 1 -- 172.21.15.50:0/1597564474 >> 172.21.15.50:0/1597564474 conn(0x7fc1440f1f20 msgr2=0x7fc1440fb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:44.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.215+0000 7fc14c01a700 1 -- 172.21.15.50:0/1597564474 shutdown_connections 2023-01-04T18:13:44.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:44.215+0000 7fc14c01a700 1 -- 172.21.15.50:0/1597564474 wait complete. 2023-01-04T18:13:44.637 INFO:teuthology.orchestra.run.smithi050.stdout:38654705688 2023-01-04T18:13:44.638 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2023-01-04T18:13:44.662 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:43.282987+0000 mgr.smithi050.emnywo (mgr.14162) 161 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:44.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:43.282987+0000 mgr.smithi050.emnywo (mgr.14162) 161 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:45.082 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050/config 2023-01-04T18:13:46.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.273+0000 7f3f5ca94700 1 -- 172.21.15.50:0/3367003957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f580f56c0 msgr2=0x7f3f580f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:46.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.273+0000 7f3f5ca94700 1 --2- 172.21.15.50:0/3367003957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f580f56c0 0x7f3f580f5ae0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f3f48004660 tx=0x7f3f48009b30).stop 2023-01-04T18:13:46.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.273+0000 7f3f5ca94700 1 -- 172.21.15.50:0/3367003957 shutdown_connections 2023-01-04T18:13:46.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.273+0000 7f3f5ca94700 1 --2- 172.21.15.50:0/3367003957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f580f6960 0x7f3f580f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:46.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.273+0000 7f3f5ca94700 1 --2- 172.21.15.50:0/3367003957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f580f56c0 0x7f3f580f5ae0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:46.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.273+0000 7f3f5ca94700 1 -- 172.21.15.50:0/3367003957 >> 172.21.15.50:0/3367003957 conn(0x7f3f580f0e20 msgr2=0x7f3f580f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:46.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.273+0000 7f3f5ca94700 1 -- 172.21.15.50:0/3367003957 shutdown_connections 2023-01-04T18:13:46.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.273+0000 7f3f5ca94700 1 -- 172.21.15.50:0/3367003957 wait complete. 2023-01-04T18:13:46.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.274+0000 7f3f5ca94700 1 Processor -- start 2023-01-04T18:13:46.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.274+0000 7f3f5ca94700 1 -- start start 2023-01-04T18:13:46.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.274+0000 7f3f5ca94700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f580f56c0 0x7f3f580f9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:46.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.274+0000 7f3f5ca94700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f580f6960 0x7f3f580f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:46.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.274+0000 7f3f5ca94700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f580f8200 con 0x7f3f580f56c0 2023-01-04T18:13:46.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.274+0000 7f3f5ca94700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f580f8340 con 0x7f3f580f6960 2023-01-04T18:13:46.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.274+0000 7f3f5659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f580f56c0 0x7f3f580f9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:46.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.274+0000 7f3f5659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f580f56c0 0x7f3f580f9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53988/0 (socket says 172.21.15.50:53988) 2023-01-04T18:13:46.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.274+0000 7f3f5659c700 1 -- 172.21.15.50:0/2587467788 learned_addr learned my addr 172.21.15.50:0/2587467788 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:13:46.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.274+0000 7f3f55d9b700 1 --2- 172.21.15.50:0/2587467788 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f580f6960 0x7f3f580f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:46.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.274+0000 7f3f5659c700 1 -- 172.21.15.50:0/2587467788 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f580f6960 msgr2=0x7f3f580f7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:46.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.274+0000 7f3f5659c700 1 --2- 172.21.15.50:0/2587467788 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f580f6960 0x7f3f580f7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:46.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.274+0000 7f3f5659c700 1 -- 172.21.15.50:0/2587467788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f48005040 con 0x7f3f580f56c0 2023-01-04T18:13:46.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.275+0000 7f3f5659c700 1 --2- 172.21.15.50:0/2587467788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f580f56c0 0x7f3f580f9820 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f3f48004e30 tx=0x7f3f48009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:46.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.275+0000 7f3f4effd700 1 -- 172.21.15.50:0/2587467788 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f48018070 con 0x7f3f580f56c0 2023-01-04T18:13:46.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.275+0000 7f3f5ca94700 1 -- 172.21.15.50:0/2587467788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f580f85c0 con 0x7f3f580f56c0 2023-01-04T18:13:46.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.275+0000 7f3f4effd700 1 -- 172.21.15.50:0/2587467788 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3f48013410 con 0x7f3f580f56c0 2023-01-04T18:13:46.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.275+0000 7f3f5ca94700 1 -- 172.21.15.50:0/2587467788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f580f8b20 con 0x7f3f580f56c0 2023-01-04T18:13:46.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.275+0000 7f3f4effd700 1 -- 172.21.15.50:0/2587467788 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f4801de20 con 0x7f3f580f56c0 2023-01-04T18:13:46.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.276+0000 7f3f5ca94700 1 -- 172.21.15.50:0/2587467788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3f5805dd30 con 0x7f3f580f56c0 2023-01-04T18:13:46.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.276+0000 7f3f4effd700 1 -- 172.21.15.50:0/2587467788 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f3f4801d420 con 0x7f3f580f56c0 2023-01-04T18:13:46.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.276+0000 7f3f4effd700 1 --2- 172.21.15.50:0/2587467788 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f3f4405c2a0 0x7f3f4405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:46.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.276+0000 7f3f4effd700 1 -- 172.21.15.50:0/2587467788 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f3f48077800 con 0x7f3f580f56c0 2023-01-04T18:13:46.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.276+0000 7f3f55d9b700 1 --2- 172.21.15.50:0/2587467788 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f3f4405c2a0 0x7f3f4405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:46.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.277+0000 7f3f4effd700 1 --2- 172.21.15.50:0/2587467788 >> [v2:172.21.15.50:6810/2500190979,v1:172.21.15.50:6811/2500190979] conn(0x7f3f44062030 0x7f3f44064490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:46.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.277+0000 7f3f4effd700 1 -- 172.21.15.50:0/2587467788 --> [v2:172.21.15.50:6810/2500190979,v1:172.21.15.50:6811/2500190979] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3f44064b10 con 0x7f3f44062030 2023-01-04T18:13:46.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.277+0000 7f3f4effd700 1 -- 172.21.15.50:0/2587467788 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f4807c220 con 0x7f3f580f56c0 2023-01-04T18:13:46.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.277+0000 7f3f56d9d700 1 --2- 172.21.15.50:0/2587467788 >> [v2:172.21.15.50:6810/2500190979,v1:172.21.15.50:6811/2500190979] conn(0x7f3f44062030 0x7f3f44064490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:46.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.277+0000 7f3f55d9b700 1 --2- 172.21.15.50:0/2587467788 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f3f4405c2a0 0x7f3f4405e760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f3f40004e20 tx=0x7f3f4000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:46.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.277+0000 7f3f56d9d700 1 --2- 172.21.15.50:0/2587467788 >> [v2:172.21.15.50:6810/2500190979,v1:172.21.15.50:6811/2500190979] conn(0x7f3f44062030 0x7f3f44064490 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:46.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.278+0000 7f3f4effd700 1 -- 172.21.15.50:0/2587467788 <== osd.1 v2:172.21.15.50:6810/2500190979 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f3f44064b10 con 0x7f3f44062030 2023-01-04T18:13:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.292+0000 7f3f5ca94700 1 -- 172.21.15.50:0/2587467788 --> [v2:172.21.15.50:6810/2500190979,v1:172.21.15.50:6811/2500190979] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3f580fb060 con 0x7f3f44062030 2023-01-04T18:13:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.292+0000 7f3f4effd700 1 -- 172.21.15.50:0/2587467788 <== osd.1 v2:172.21.15.50:6810/2500190979 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3f580fb060 con 0x7f3f44062030 2023-01-04T18:13:46.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.293+0000 7f3f5ca94700 1 -- 172.21.15.50:0/2587467788 >> [v2:172.21.15.50:6810/2500190979,v1:172.21.15.50:6811/2500190979] conn(0x7f3f44062030 msgr2=0x7f3f44064490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:46.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.293+0000 7f3f5ca94700 1 --2- 172.21.15.50:0/2587467788 >> [v2:172.21.15.50:6810/2500190979,v1:172.21.15.50:6811/2500190979] conn(0x7f3f44062030 0x7f3f44064490 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:46.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.293+0000 7f3f5ca94700 1 -- 172.21.15.50:0/2587467788 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f3f4405c2a0 msgr2=0x7f3f4405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:46.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.293+0000 7f3f5ca94700 1 --2- 172.21.15.50:0/2587467788 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f3f4405c2a0 0x7f3f4405e760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f3f40004e20 tx=0x7f3f4000b040).stop 2023-01-04T18:13:46.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.293+0000 7f3f5ca94700 1 -- 172.21.15.50:0/2587467788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f580f56c0 msgr2=0x7f3f580f9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:46.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.293+0000 7f3f5ca94700 1 --2- 172.21.15.50:0/2587467788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f580f56c0 0x7f3f580f9820 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f3f48004e30 tx=0x7f3f48009b30).stop 2023-01-04T18:13:46.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.293+0000 7f3f5ca94700 1 -- 172.21.15.50:0/2587467788 shutdown_connections 2023-01-04T18:13:46.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.293+0000 7f3f5ca94700 1 --2- 172.21.15.50:0/2587467788 >> [v2:172.21.15.50:6810/2500190979,v1:172.21.15.50:6811/2500190979] conn(0x7f3f44062030 0x7f3f44064490 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:46.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.293+0000 7f3f5ca94700 1 --2- 172.21.15.50:0/2587467788 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f3f4405c2a0 0x7f3f4405e760 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:46.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.293+0000 7f3f5ca94700 1 --2- 172.21.15.50:0/2587467788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f580f56c0 0x7f3f580f9820 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:46.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.293+0000 7f3f5ca94700 1 --2- 172.21.15.50:0/2587467788 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f580f6960 0x7f3f580f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:46.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.293+0000 7f3f5ca94700 1 -- 172.21.15.50:0/2587467788 >> 172.21.15.50:0/2587467788 conn(0x7f3f580f0e20 msgr2=0x7f3f580603a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:46.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.293+0000 7f3f5ca94700 1 -- 172.21.15.50:0/2587467788 shutdown_connections 2023-01-04T18:13:46.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:46.293+0000 7f3f5ca94700 1 -- 172.21.15.50:0/2587467788 wait complete. 2023-01-04T18:13:46.324 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:45.283280+0000 mgr.smithi050.emnywo (mgr.14162) 162 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:46.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:45.283280+0000 mgr.smithi050.emnywo (mgr.14162) 162 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:46.694 INFO:teuthology.orchestra.run.smithi050.stdout:55834574869 2023-01-04T18:13:46.695 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2023-01-04T18:13:47.182 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050/config 2023-01-04T18:13:48.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.402+0000 7f75c0cfb700 1 -- 172.21.15.50:0/2342770015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75bc0f6960 msgr2=0x7f75bc0f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:48.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.402+0000 7f75c0cfb700 1 --2- 172.21.15.50:0/2342770015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75bc0f6960 0x7f75bc0f6dc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f75a4004660 tx=0x7f75a4009b30).stop 2023-01-04T18:13:48.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.402+0000 7f75c0cfb700 1 -- 172.21.15.50:0/2342770015 shutdown_connections 2023-01-04T18:13:48.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.402+0000 7f75c0cfb700 1 --2- 172.21.15.50:0/2342770015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75bc0f6960 0x7f75bc0f6dc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:48.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.402+0000 7f75c0cfb700 1 --2- 172.21.15.50:0/2342770015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75bc0f56c0 0x7f75bc0f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:48.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.402+0000 7f75c0cfb700 1 -- 172.21.15.50:0/2342770015 >> 172.21.15.50:0/2342770015 conn(0x7f75bc0f0e20 msgr2=0x7f75bc0f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:48.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.402+0000 7f75c0cfb700 1 -- 172.21.15.50:0/2342770015 shutdown_connections 2023-01-04T18:13:48.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.402+0000 7f75c0cfb700 1 -- 172.21.15.50:0/2342770015 wait complete. 2023-01-04T18:13:48.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.403+0000 7f75c0cfb700 1 Processor -- start 2023-01-04T18:13:48.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.403+0000 7f75c0cfb700 1 -- start start 2023-01-04T18:13:48.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.403+0000 7f75c0cfb700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75bc0f56c0 0x7f75bc0f9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:48.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.403+0000 7f75c0cfb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75bc0f6960 0x7f75bc0f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:48.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.403+0000 7f75c0cfb700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0f8200 con 0x7f75bc0f6960 2023-01-04T18:13:48.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.403+0000 7f75c0cfb700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0f8340 con 0x7f75bc0f56c0 2023-01-04T18:13:48.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.403+0000 7f75b9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75bc0f6960 0x7f75bc0f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:48.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.403+0000 7f75b9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75bc0f6960 0x7f75bc0f7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44902/0 (socket says 172.21.15.50:44902) 2023-01-04T18:13:48.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.403+0000 7f75b9d9b700 1 -- 172.21.15.50:0/981152230 learned_addr learned my addr 172.21.15.50:0/981152230 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:13:48.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.403+0000 7f75ba59c700 1 --2- 172.21.15.50:0/981152230 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75bc0f56c0 0x7f75bc0f9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:48.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.403+0000 7f75b9d9b700 1 -- 172.21.15.50:0/981152230 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75bc0f56c0 msgr2=0x7f75bc0f9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:48.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.403+0000 7f75b9d9b700 1 --2- 172.21.15.50:0/981152230 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75bc0f56c0 0x7f75bc0f9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:48.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.403+0000 7f75b9d9b700 1 -- 172.21.15.50:0/981152230 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a4005040 con 0x7f75bc0f6960 2023-01-04T18:13:48.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.403+0000 7f75ba59c700 1 --2- 172.21.15.50:0/981152230 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75bc0f56c0 0x7f75bc0f9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:13:48.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.404+0000 7f75b9d9b700 1 --2- 172.21.15.50:0/981152230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75bc0f6960 0x7f75bc0f7ca0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f75a4009830 tx=0x7f75a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:48.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.404+0000 7f75b2ffd700 1 -- 172.21.15.50:0/981152230 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75a4018070 con 0x7f75bc0f6960 2023-01-04T18:13:48.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.404+0000 7f75b2ffd700 1 -- 172.21.15.50:0/981152230 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f75a4013410 con 0x7f75bc0f6960 2023-01-04T18:13:48.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.404+0000 7f75c0cfb700 1 -- 172.21.15.50:0/981152230 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75bc0f85c0 con 0x7f75bc0f6960 2023-01-04T18:13:48.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.404+0000 7f75b2ffd700 1 -- 172.21.15.50:0/981152230 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75a401c620 con 0x7f75bc0f6960 2023-01-04T18:13:48.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.404+0000 7f75c0cfb700 1 -- 172.21.15.50:0/981152230 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75bc0f8b20 con 0x7f75bc0f6960 2023-01-04T18:13:48.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.404+0000 7f75c0cfb700 1 -- 172.21.15.50:0/981152230 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f75bc05dd30 con 0x7f75bc0f6960 2023-01-04T18:13:48.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.405+0000 7f75b2ffd700 1 -- 172.21.15.50:0/981152230 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f75a401c890 con 0x7f75bc0f6960 2023-01-04T18:13:48.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.405+0000 7f75b2ffd700 1 --2- 172.21.15.50:0/981152230 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f75a805c2a0 0x7f75a805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:48.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.405+0000 7f75b2ffd700 1 -- 172.21.15.50:0/981152230 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f75a4077970 con 0x7f75bc0f6960 2023-01-04T18:13:48.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.406+0000 7f75ba59c700 1 --2- 172.21.15.50:0/981152230 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f75a805c2a0 0x7f75a805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:48.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.406+0000 7f75b2ffd700 1 --2- 172.21.15.50:0/981152230 >> [v2:172.21.15.50:6818/1577657554,v1:172.21.15.50:6819/1577657554] conn(0x7f75a8062030 0x7f75a8064490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:48.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.406+0000 7f75b2ffd700 1 -- 172.21.15.50:0/981152230 --> [v2:172.21.15.50:6818/1577657554,v1:172.21.15.50:6819/1577657554] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75a8064b10 con 0x7f75a8062030 2023-01-04T18:13:48.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.406+0000 7f75b2ffd700 1 -- 172.21.15.50:0/981152230 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75a407c220 con 0x7f75bc0f6960 2023-01-04T18:13:48.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.406+0000 7f75bad9d700 1 --2- 172.21.15.50:0/981152230 >> [v2:172.21.15.50:6818/1577657554,v1:172.21.15.50:6819/1577657554] conn(0x7f75a8062030 0x7f75a8064490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:48.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.406+0000 7f75ba59c700 1 --2- 172.21.15.50:0/981152230 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f75a805c2a0 0x7f75a805e760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f75bc0f95b0 tx=0x7f75ac009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:48.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.406+0000 7f75bad9d700 1 --2- 172.21.15.50:0/981152230 >> [v2:172.21.15.50:6818/1577657554,v1:172.21.15.50:6819/1577657554] conn(0x7f75a8062030 0x7f75a8064490 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:48.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.407+0000 7f75b2ffd700 1 -- 172.21.15.50:0/981152230 <== osd.2 v2:172.21.15.50:6818/1577657554 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f75a8064b10 con 0x7f75a8062030 2023-01-04T18:13:48.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.421+0000 7f75c0cfb700 1 -- 172.21.15.50:0/981152230 --> [v2:172.21.15.50:6818/1577657554,v1:172.21.15.50:6819/1577657554] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f75bc0fafe0 con 0x7f75a8062030 2023-01-04T18:13:48.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.421+0000 7f75b2ffd700 1 -- 172.21.15.50:0/981152230 <== osd.2 v2:172.21.15.50:6818/1577657554 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f75bc0fafe0 con 0x7f75a8062030 2023-01-04T18:13:48.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.422+0000 7f75c0cfb700 1 -- 172.21.15.50:0/981152230 >> [v2:172.21.15.50:6818/1577657554,v1:172.21.15.50:6819/1577657554] conn(0x7f75a8062030 msgr2=0x7f75a8064490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:48.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.422+0000 7f75c0cfb700 1 --2- 172.21.15.50:0/981152230 >> [v2:172.21.15.50:6818/1577657554,v1:172.21.15.50:6819/1577657554] conn(0x7f75a8062030 0x7f75a8064490 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:48.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.422+0000 7f75c0cfb700 1 -- 172.21.15.50:0/981152230 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f75a805c2a0 msgr2=0x7f75a805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:48.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.422+0000 7f75c0cfb700 1 --2- 172.21.15.50:0/981152230 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f75a805c2a0 0x7f75a805e760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f75bc0f95b0 tx=0x7f75ac009040).stop 2023-01-04T18:13:48.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.422+0000 7f75c0cfb700 1 -- 172.21.15.50:0/981152230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75bc0f6960 msgr2=0x7f75bc0f7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:48.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.422+0000 7f75c0cfb700 1 --2- 172.21.15.50:0/981152230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75bc0f6960 0x7f75bc0f7ca0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f75a4009830 tx=0x7f75a4009b30).stop 2023-01-04T18:13:48.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.422+0000 7f75c0cfb700 1 -- 172.21.15.50:0/981152230 shutdown_connections 2023-01-04T18:13:48.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.422+0000 7f75c0cfb700 1 --2- 172.21.15.50:0/981152230 >> [v2:172.21.15.50:6818/1577657554,v1:172.21.15.50:6819/1577657554] conn(0x7f75a8062030 0x7f75a8064490 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.422+0000 7f75c0cfb700 1 --2- 172.21.15.50:0/981152230 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f75a805c2a0 0x7f75a805e760 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.422+0000 7f75c0cfb700 1 --2- 172.21.15.50:0/981152230 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75bc0f56c0 0x7f75bc0f9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.422+0000 7f75c0cfb700 1 --2- 172.21.15.50:0/981152230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75bc0f6960 0x7f75bc0f7ca0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.422+0000 7f75c0cfb700 1 -- 172.21.15.50:0/981152230 >> 172.21.15.50:0/981152230 conn(0x7f75bc0f0e20 msgr2=0x7f75bc0603a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.422+0000 7f75c0cfb700 1 -- 172.21.15.50:0/981152230 shutdown_connections 2023-01-04T18:13:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:48.422+0000 7f75c0cfb700 1 -- 172.21.15.50:0/981152230 wait complete. 2023-01-04T18:13:48.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:47.283689+0000 mgr.smithi050.emnywo (mgr.14162) 163 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:48.795 INFO:teuthology.orchestra.run.smithi050.stdout:73014444050 2023-01-04T18:13:48.795 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2023-01-04T18:13:48.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:47.283689+0000 mgr.smithi050.emnywo (mgr.14162) 163 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:49.241 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050/config 2023-01-04T18:13:50.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.449+0000 7f6c63649700 1 -- 172.21.15.50:0/2379898376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c5c0f7a70 msgr2=0x7f6c5c0f7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:50.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.449+0000 7f6c63649700 1 --2- 172.21.15.50:0/2379898376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c5c0f7a70 0x7f6c5c0f7ed0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f6c4c004660 tx=0x7f6c4c009b30).stop 2023-01-04T18:13:50.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.449+0000 7f6c63649700 1 -- 172.21.15.50:0/2379898376 shutdown_connections 2023-01-04T18:13:50.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.449+0000 7f6c63649700 1 --2- 172.21.15.50:0/2379898376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c5c0f7a70 0x7f6c5c0f7ed0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:50.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.449+0000 7f6c63649700 1 --2- 172.21.15.50:0/2379898376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c5c0f67d0 0x7f6c5c0f6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:50.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.449+0000 7f6c63649700 1 -- 172.21.15.50:0/2379898376 >> 172.21.15.50:0/2379898376 conn(0x7f6c5c0f1f50 msgr2=0x7f6c5c0f4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:50.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.449+0000 7f6c63649700 1 -- 172.21.15.50:0/2379898376 shutdown_connections 2023-01-04T18:13:50.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.449+0000 7f6c63649700 1 -- 172.21.15.50:0/2379898376 wait complete. 2023-01-04T18:13:50.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.450+0000 7f6c63649700 1 Processor -- start 2023-01-04T18:13:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.450+0000 7f6c63649700 1 -- start start 2023-01-04T18:13:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.450+0000 7f6c63649700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c5c0f67d0 0x7f6c5c1070c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.450+0000 7f6c63649700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c5c0f7a70 0x7f6c5c1075b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.450+0000 7f6c63649700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c107b60 con 0x7f6c5c0f67d0 2023-01-04T18:13:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.450+0000 7f6c63649700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c107ca0 con 0x7f6c5c0f7a70 2023-01-04T18:13:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.450+0000 7f6c613e5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c5c0f67d0 0x7f6c5c1070c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.450+0000 7f6c613e5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c5c0f67d0 0x7f6c5c1070c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44924/0 (socket says 172.21.15.50:44924) 2023-01-04T18:13:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.450+0000 7f6c613e5700 1 -- 172.21.15.50:0/4079529764 learned_addr learned my addr 172.21.15.50:0/4079529764 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:13:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.450+0000 7f6c60be4700 1 --2- 172.21.15.50:0/4079529764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c5c0f7a70 0x7f6c5c1075b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.450+0000 7f6c613e5700 1 -- 172.21.15.50:0/4079529764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c5c0f7a70 msgr2=0x7f6c5c1075b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.450+0000 7f6c613e5700 1 --2- 172.21.15.50:0/4079529764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c5c0f7a70 0x7f6c5c1075b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:50.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.450+0000 7f6c613e5700 1 -- 172.21.15.50:0/4079529764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c005040 con 0x7f6c5c0f67d0 2023-01-04T18:13:50.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.450+0000 7f6c613e5700 1 --2- 172.21.15.50:0/4079529764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c5c0f67d0 0x7f6c5c1070c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f6c58002700 tx=0x7f6c58009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:50.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.450+0000 7f6c51ffb700 1 -- 172.21.15.50:0/4079529764 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c580079c0 con 0x7f6c5c0f67d0 2023-01-04T18:13:50.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.451+0000 7f6c51ffb700 1 -- 172.21.15.50:0/4079529764 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6c5800f040 con 0x7f6c5c0f67d0 2023-01-04T18:13:50.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.451+0000 7f6c63649700 1 -- 172.21.15.50:0/4079529764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c5c108640 con 0x7f6c5c0f67d0 2023-01-04T18:13:50.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.451+0000 7f6c51ffb700 1 -- 172.21.15.50:0/4079529764 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c58014860 con 0x7f6c5c0f67d0 2023-01-04T18:13:50.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.451+0000 7f6c63649700 1 -- 172.21.15.50:0/4079529764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c5c108c00 con 0x7f6c5c0f67d0 2023-01-04T18:13:50.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.452+0000 7f6c63649700 1 -- 172.21.15.50:0/4079529764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6c5c05dd10 con 0x7f6c5c0f67d0 2023-01-04T18:13:50.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.452+0000 7f6c51ffb700 1 -- 172.21.15.50:0/4079529764 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f6c5801b060 con 0x7f6c5c0f67d0 2023-01-04T18:13:50.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.452+0000 7f6c51ffb700 1 --2- 172.21.15.50:0/4079529764 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6c4805c2a0 0x7f6c4805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:50.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.452+0000 7f6c51ffb700 1 -- 172.21.15.50:0/4079529764 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f6c58075a00 con 0x7f6c5c0f67d0 2023-01-04T18:13:50.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.452+0000 7f6c60be4700 1 --2- 172.21.15.50:0/4079529764 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6c4805c2a0 0x7f6c4805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:50.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.452+0000 7f6c51ffb700 1 --2- 172.21.15.50:0/4079529764 >> [v2:172.21.15.98:6800/4254376132,v1:172.21.15.98:6801/4254376132] conn(0x7f6c48062030 0x7f6c48064490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:50.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.453+0000 7f6c51ffb700 1 -- 172.21.15.50:0/4079529764 --> [v2:172.21.15.98:6800/4254376132,v1:172.21.15.98:6801/4254376132] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c48064b10 con 0x7f6c48062030 2023-01-04T18:13:50.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.453+0000 7f6c51ffb700 1 -- 172.21.15.50:0/4079529764 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c5807a220 con 0x7f6c5c0f67d0 2023-01-04T18:13:50.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.453+0000 7f6c60be4700 1 --2- 172.21.15.50:0/4079529764 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6c4805c2a0 0x7f6c4805e760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f6c4c009f50 tx=0x7f6c4c009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:50.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.453+0000 7f6c61be6700 1 --2- 172.21.15.50:0/4079529764 >> [v2:172.21.15.98:6800/4254376132,v1:172.21.15.98:6801/4254376132] conn(0x7f6c48062030 0x7f6c48064490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:50.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.453+0000 7f6c61be6700 1 --2- 172.21.15.50:0/4079529764 >> [v2:172.21.15.98:6800/4254376132,v1:172.21.15.98:6801/4254376132] conn(0x7f6c48062030 0x7f6c48064490 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:50.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.454+0000 7f6c51ffb700 1 -- 172.21.15.50:0/4079529764 <== osd.3 v2:172.21.15.98:6800/4254376132 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f6c48064b10 con 0x7f6c48062030 2023-01-04T18:13:50.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.468+0000 7f6c63649700 1 -- 172.21.15.50:0/4079529764 --> [v2:172.21.15.98:6800/4254376132,v1:172.21.15.98:6801/4254376132] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6c5c109140 con 0x7f6c48062030 2023-01-04T18:13:50.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.469+0000 7f6c51ffb700 1 -- 172.21.15.50:0/4079529764 <== osd.3 v2:172.21.15.98:6800/4254376132 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6c5c109140 con 0x7f6c48062030 2023-01-04T18:13:50.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.469+0000 7f6c63649700 1 -- 172.21.15.50:0/4079529764 >> [v2:172.21.15.98:6800/4254376132,v1:172.21.15.98:6801/4254376132] conn(0x7f6c48062030 msgr2=0x7f6c48064490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:50.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.469+0000 7f6c63649700 1 --2- 172.21.15.50:0/4079529764 >> [v2:172.21.15.98:6800/4254376132,v1:172.21.15.98:6801/4254376132] conn(0x7f6c48062030 0x7f6c48064490 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:50.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.469+0000 7f6c63649700 1 -- 172.21.15.50:0/4079529764 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6c4805c2a0 msgr2=0x7f6c4805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:50.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.469+0000 7f6c63649700 1 --2- 172.21.15.50:0/4079529764 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6c4805c2a0 0x7f6c4805e760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f6c4c009f50 tx=0x7f6c4c009b30).stop 2023-01-04T18:13:50.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.469+0000 7f6c63649700 1 -- 172.21.15.50:0/4079529764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c5c0f67d0 msgr2=0x7f6c5c1070c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:50.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.469+0000 7f6c63649700 1 --2- 172.21.15.50:0/4079529764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c5c0f67d0 0x7f6c5c1070c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f6c58002700 tx=0x7f6c58009d80).stop 2023-01-04T18:13:50.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.469+0000 7f6c63649700 1 -- 172.21.15.50:0/4079529764 shutdown_connections 2023-01-04T18:13:50.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.469+0000 7f6c63649700 1 --2- 172.21.15.50:0/4079529764 >> [v2:172.21.15.98:6800/4254376132,v1:172.21.15.98:6801/4254376132] conn(0x7f6c48062030 0x7f6c48064490 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:50.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.469+0000 7f6c63649700 1 --2- 172.21.15.50:0/4079529764 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6c4805c2a0 0x7f6c4805e760 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:50.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.469+0000 7f6c63649700 1 --2- 172.21.15.50:0/4079529764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c5c0f67d0 0x7f6c5c1070c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:50.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.469+0000 7f6c63649700 1 --2- 172.21.15.50:0/4079529764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c5c0f7a70 0x7f6c5c1075b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:50.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.469+0000 7f6c63649700 1 -- 172.21.15.50:0/4079529764 >> 172.21.15.50:0/4079529764 conn(0x7f6c5c0f1f50 msgr2=0x7f6c5c0fb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:50.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.469+0000 7f6c63649700 1 -- 172.21.15.50:0/4079529764 shutdown_connections 2023-01-04T18:13:50.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:50.469+0000 7f6c63649700 1 -- 172.21.15.50:0/4079529764 wait complete. 2023-01-04T18:13:50.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:49.284073+0000 mgr.smithi050.emnywo (mgr.14162) 164 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:50.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:49.284073+0000 mgr.smithi050.emnywo (mgr.14162) 164 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:50.940 INFO:teuthology.orchestra.run.smithi050.stdout:107374182415 2023-01-04T18:13:50.941 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2023-01-04T18:13:51.386 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050/config 2023-01-04T18:13:52.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.681+0000 7fc6d507f700 1 -- 172.21.15.50:0/1115330512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d00f9980 msgr2=0x7fc6d00fbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:52.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.681+0000 7fc6d507f700 1 --2- 172.21.15.50:0/1115330512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d00f9980 0x7fc6d00fbd70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fc6c4004660 tx=0x7fc6c4009b30).stop 2023-01-04T18:13:52.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.682+0000 7fc6d507f700 1 -- 172.21.15.50:0/1115330512 shutdown_connections 2023-01-04T18:13:52.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.682+0000 7fc6d507f700 1 --2- 172.21.15.50:0/1115330512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d00f9980 0x7fc6d00fbd70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:52.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.682+0000 7fc6d507f700 1 --2- 172.21.15.50:0/1115330512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6d0060810 0x7fc6d00f9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:52.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.682+0000 7fc6d507f700 1 -- 172.21.15.50:0/1115330512 >> 172.21.15.50:0/1115330512 conn(0x7fc6d00f0e20 msgr2=0x7fc6d00f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:52.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.682+0000 7fc6d507f700 1 -- 172.21.15.50:0/1115330512 shutdown_connections 2023-01-04T18:13:52.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.682+0000 7fc6d507f700 1 -- 172.21.15.50:0/1115330512 wait complete. 2023-01-04T18:13:52.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.682+0000 7fc6d507f700 1 Processor -- start 2023-01-04T18:13:52.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.682+0000 7fc6d507f700 1 -- start start 2023-01-04T18:13:52.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.682+0000 7fc6d507f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6d0060810 0x7fc6d00f6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:52.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.683+0000 7fc6d507f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d00f9980 0x7fc6d00f5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:52.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.683+0000 7fc6d507f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d00f5860 con 0x7fc6d00f9980 2023-01-04T18:13:52.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.683+0000 7fc6d507f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d00f59a0 con 0x7fc6d0060810 2023-01-04T18:13:52.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.683+0000 7fc6ce59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d00f9980 0x7fc6d00f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:52.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.683+0000 7fc6ce59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d00f9980 0x7fc6d00f5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44950/0 (socket says 172.21.15.50:44950) 2023-01-04T18:13:52.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.683+0000 7fc6ce59c700 1 -- 172.21.15.50:0/682165699 learned_addr learned my addr 172.21.15.50:0/682165699 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:13:52.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.683+0000 7fc6ced9d700 1 --2- 172.21.15.50:0/682165699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6d0060810 0x7fc6d00f6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:52.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.683+0000 7fc6ce59c700 1 -- 172.21.15.50:0/682165699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6d0060810 msgr2=0x7fc6d00f6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:52.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.683+0000 7fc6ce59c700 1 --2- 172.21.15.50:0/682165699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6d0060810 0x7fc6d00f6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:52.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.683+0000 7fc6ce59c700 1 -- 172.21.15.50:0/682165699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c4005040 con 0x7fc6d00f9980 2023-01-04T18:13:52.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.683+0000 7fc6ced9d700 1 --2- 172.21.15.50:0/682165699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6d0060810 0x7fc6d00f6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-01-04T18:13:52.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.683+0000 7fc6ce59c700 1 --2- 172.21.15.50:0/682165699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d00f9980 0x7fc6d00f5300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fc6c4000c00 tx=0x7fc6c400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:52.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.683+0000 7fc6b77fe700 1 -- 172.21.15.50:0/682165699 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6c4019070 con 0x7fc6d00f9980 2023-01-04T18:13:52.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.683+0000 7fc6d507f700 1 -- 172.21.15.50:0/682165699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d00f5c20 con 0x7fc6d00f9980 2023-01-04T18:13:52.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.683+0000 7fc6b77fe700 1 -- 172.21.15.50:0/682165699 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc6c4007e70 con 0x7fc6d00f9980 2023-01-04T18:13:52.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.683+0000 7fc6b77fe700 1 -- 172.21.15.50:0/682165699 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6c4014db0 con 0x7fc6d00f9980 2023-01-04T18:13:52.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.683+0000 7fc6d507f700 1 -- 172.21.15.50:0/682165699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d00f6180 con 0x7fc6d00f9980 2023-01-04T18:13:52.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.684+0000 7fc6d507f700 1 -- 172.21.15.50:0/682165699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc6d005dd30 con 0x7fc6d00f9980 2023-01-04T18:13:52.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.685+0000 7fc6b77fe700 1 -- 172.21.15.50:0/682165699 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc6c4025070 con 0x7fc6d00f9980 2023-01-04T18:13:52.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.685+0000 7fc6b77fe700 1 --2- 172.21.15.50:0/682165699 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc6b805c240 0x7fc6b805e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:52.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.685+0000 7fc6b77fe700 1 -- 172.21.15.50:0/682165699 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fc6c4076b40 con 0x7fc6d00f9980 2023-01-04T18:13:52.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.685+0000 7fc6ced9d700 1 --2- 172.21.15.50:0/682165699 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc6b805c240 0x7fc6b805e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:52.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.685+0000 7fc6b77fe700 1 --2- 172.21.15.50:0/682165699 >> [v2:172.21.15.98:6808/3371156908,v1:172.21.15.98:6809/3371156908] conn(0x7fc6b8061fd0 0x7fc6b8064430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:52.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.685+0000 7fc6b77fe700 1 -- 172.21.15.50:0/682165699 --> [v2:172.21.15.98:6808/3371156908,v1:172.21.15.98:6809/3371156908] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6b8064ab0 con 0x7fc6b8061fd0 2023-01-04T18:13:52.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.685+0000 7fc6b77fe700 1 -- 172.21.15.50:0/682165699 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6c407b220 con 0x7fc6d00f9980 2023-01-04T18:13:52.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.685+0000 7fc6cf59e700 1 --2- 172.21.15.50:0/682165699 >> [v2:172.21.15.98:6808/3371156908,v1:172.21.15.98:6809/3371156908] conn(0x7fc6b8061fd0 0x7fc6b8064430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:52.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.685+0000 7fc6ced9d700 1 --2- 172.21.15.50:0/682165699 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc6b805c240 0x7fc6b805e700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fc6c0009da0 tx=0x7fc6c000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:52.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.686+0000 7fc6cf59e700 1 --2- 172.21.15.50:0/682165699 >> [v2:172.21.15.98:6808/3371156908,v1:172.21.15.98:6809/3371156908] conn(0x7fc6b8061fd0 0x7fc6b8064430 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:52.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.686+0000 7fc6b77fe700 1 -- 172.21.15.50:0/682165699 <== osd.4 v2:172.21.15.98:6808/3371156908 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fc6b8064ab0 con 0x7fc6b8061fd0 2023-01-04T18:13:52.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.701+0000 7fc6d507f700 1 -- 172.21.15.50:0/682165699 --> [v2:172.21.15.98:6808/3371156908,v1:172.21.15.98:6809/3371156908] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc6d0058150 con 0x7fc6b8061fd0 2023-01-04T18:13:52.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.701+0000 7fc6b77fe700 1 -- 172.21.15.50:0/682165699 <== osd.4 v2:172.21.15.98:6808/3371156908 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc6d0058150 con 0x7fc6b8061fd0 2023-01-04T18:13:52.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.702+0000 7fc6d507f700 1 -- 172.21.15.50:0/682165699 >> [v2:172.21.15.98:6808/3371156908,v1:172.21.15.98:6809/3371156908] conn(0x7fc6b8061fd0 msgr2=0x7fc6b8064430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:52.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.702+0000 7fc6d507f700 1 --2- 172.21.15.50:0/682165699 >> [v2:172.21.15.98:6808/3371156908,v1:172.21.15.98:6809/3371156908] conn(0x7fc6b8061fd0 0x7fc6b8064430 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:52.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.702+0000 7fc6d507f700 1 -- 172.21.15.50:0/682165699 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc6b805c240 msgr2=0x7fc6b805e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:52.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.702+0000 7fc6d507f700 1 --2- 172.21.15.50:0/682165699 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc6b805c240 0x7fc6b805e700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fc6c0009da0 tx=0x7fc6c000b040).stop 2023-01-04T18:13:52.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.702+0000 7fc6d507f700 1 -- 172.21.15.50:0/682165699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d00f9980 msgr2=0x7fc6d00f5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:52.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.702+0000 7fc6d507f700 1 --2- 172.21.15.50:0/682165699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d00f9980 0x7fc6d00f5300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fc6c4000c00 tx=0x7fc6c400b040).stop 2023-01-04T18:13:52.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.702+0000 7fc6d507f700 1 -- 172.21.15.50:0/682165699 shutdown_connections 2023-01-04T18:13:52.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.702+0000 7fc6d507f700 1 --2- 172.21.15.50:0/682165699 >> [v2:172.21.15.98:6808/3371156908,v1:172.21.15.98:6809/3371156908] conn(0x7fc6b8061fd0 0x7fc6b8064430 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:52.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.702+0000 7fc6d507f700 1 --2- 172.21.15.50:0/682165699 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc6b805c240 0x7fc6b805e700 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:52.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.702+0000 7fc6d507f700 1 --2- 172.21.15.50:0/682165699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6d0060810 0x7fc6d00f6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:52.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.702+0000 7fc6d507f700 1 --2- 172.21.15.50:0/682165699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d00f9980 0x7fc6d00f5300 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:52.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.702+0000 7fc6d507f700 1 -- 172.21.15.50:0/682165699 >> 172.21.15.50:0/682165699 conn(0x7fc6d00f0e20 msgr2=0x7fc6d00f3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:52.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.702+0000 7fc6d507f700 1 -- 172.21.15.50:0/682165699 shutdown_connections 2023-01-04T18:13:52.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:52.702+0000 7fc6d507f700 1 -- 172.21.15.50:0/682165699 wait complete. 2023-01-04T18:13:52.729 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:51.284392+0000 mgr.smithi050.emnywo (mgr.14162) 165 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:52.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:51.284392+0000 mgr.smithi050.emnywo (mgr.14162) 165 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:53.098 INFO:teuthology.orchestra.run.smithi050.stdout:128849018892 2023-01-04T18:13:53.099 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2023-01-04T18:13:53.543 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050/config 2023-01-04T18:13:54.505 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:53.284701+0000 mgr.smithi050.emnywo (mgr.14162) 166 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:54.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.693+0000 7fc8725b7700 1 -- 172.21.15.50:0/3466576795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc86c0f5510 msgr2=0x7fc86c0f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:54.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.693+0000 7fc8725b7700 1 --2- 172.21.15.50:0/3466576795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc86c0f5510 0x7fc86c0f5930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fc868004660 tx=0x7fc868009b30).stop 2023-01-04T18:13:54.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.694+0000 7fc8725b7700 1 -- 172.21.15.50:0/3466576795 shutdown_connections 2023-01-04T18:13:54.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.694+0000 7fc8725b7700 1 --2- 172.21.15.50:0/3466576795 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc86c0f67b0 0x7fc86c0f6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:54.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.694+0000 7fc8725b7700 1 --2- 172.21.15.50:0/3466576795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc86c0f5510 0x7fc86c0f5930 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:54.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.694+0000 7fc8725b7700 1 -- 172.21.15.50:0/3466576795 >> 172.21.15.50:0/3466576795 conn(0x7fc86c0f0c70 msgr2=0x7fc86c0f3090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:54.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.694+0000 7fc8725b7700 1 -- 172.21.15.50:0/3466576795 shutdown_connections 2023-01-04T18:13:54.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.694+0000 7fc8725b7700 1 -- 172.21.15.50:0/3466576795 wait complete. 2023-01-04T18:13:54.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.694+0000 7fc8725b7700 1 Processor -- start 2023-01-04T18:13:54.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.694+0000 7fc8725b7700 1 -- start start 2023-01-04T18:13:54.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.694+0000 7fc8725b7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc86c0f5510 0x7fc86c109bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:54.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.694+0000 7fc8725b7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc86c0f67b0 0x7fc86c10c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.694+0000 7fc8725b7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c060940 con 0x7fc86c0f5510 2023-01-04T18:13:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.694+0000 7fc8725b7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c060a80 con 0x7fc86c0f67b0 2023-01-04T18:13:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.695+0000 7fc8715b5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc86c0f5510 0x7fc86c109bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.695+0000 7fc8715b5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc86c0f5510 0x7fc86c109bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44968/0 (socket says 172.21.15.50:44968) 2023-01-04T18:13:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.695+0000 7fc8715b5700 1 -- 172.21.15.50:0/3936304648 learned_addr learned my addr 172.21.15.50:0/3936304648 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:13:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.695+0000 7fc870db4700 1 --2- 172.21.15.50:0/3936304648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc86c0f67b0 0x7fc86c10c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.695+0000 7fc8715b5700 1 -- 172.21.15.50:0/3936304648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc86c0f67b0 msgr2=0x7fc86c10c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.695+0000 7fc8715b5700 1 --2- 172.21.15.50:0/3936304648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc86c0f67b0 0x7fc86c10c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.695+0000 7fc8715b5700 1 -- 172.21.15.50:0/3936304648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc868005040 con 0x7fc86c0f5510 2023-01-04T18:13:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.695+0000 7fc8715b5700 1 --2- 172.21.15.50:0/3936304648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc86c0f5510 0x7fc86c109bb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fc868004e30 tx=0x7fc868009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.695+0000 7fc861ffb700 1 -- 172.21.15.50:0/3936304648 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc868018070 con 0x7fc86c0f5510 2023-01-04T18:13:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.695+0000 7fc861ffb700 1 -- 172.21.15.50:0/3936304648 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc868013410 con 0x7fc86c0f5510 2023-01-04T18:13:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.695+0000 7fc8725b7700 1 -- 172.21.15.50:0/3936304648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc86c10c600 con 0x7fc86c0f5510 2023-01-04T18:13:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.695+0000 7fc861ffb700 1 -- 172.21.15.50:0/3936304648 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc86801c3c0 con 0x7fc86c0f5510 2023-01-04T18:13:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.695+0000 7fc8725b7700 1 -- 172.21.15.50:0/3936304648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86c10cb60 con 0x7fc86c0f5510 2023-01-04T18:13:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.696+0000 7fc8725b7700 1 -- 172.21.15.50:0/3936304648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc86c05db80 con 0x7fc86c0f5510 2023-01-04T18:13:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.697+0000 7fc861ffb700 1 -- 172.21.15.50:0/3936304648 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc86801d420 con 0x7fc86c0f5510 2023-01-04T18:13:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.697+0000 7fc861ffb700 1 --2- 172.21.15.50:0/3936304648 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc85805c2b0 0x7fc85805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.697+0000 7fc861ffb700 1 -- 172.21.15.50:0/3936304648 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fc8680778a0 con 0x7fc86c0f5510 2023-01-04T18:13:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.697+0000 7fc870db4700 1 --2- 172.21.15.50:0/3936304648 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc85805c2b0 0x7fc85805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.697+0000 7fc861ffb700 1 --2- 172.21.15.50:0/3936304648 >> [v2:172.21.15.98:6816/764254549,v1:172.21.15.98:6817/764254549] conn(0x7fc858062090 0x7fc8580644f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.697+0000 7fc861ffb700 1 -- 172.21.15.50:0/3936304648 --> [v2:172.21.15.98:6816/764254549,v1:172.21.15.98:6817/764254549] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc858064b70 con 0x7fc858062090 2023-01-04T18:13:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.697+0000 7fc861ffb700 1 -- 172.21.15.50:0/3936304648 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc86807c220 con 0x7fc86c0f5510 2023-01-04T18:13:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.697+0000 7fc871db6700 1 --2- 172.21.15.50:0/3936304648 >> [v2:172.21.15.98:6816/764254549,v1:172.21.15.98:6817/764254549] conn(0x7fc858062090 0x7fc8580644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.697+0000 7fc870db4700 1 --2- 172.21.15.50:0/3936304648 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc85805c2b0 0x7fc85805e770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fc85c009740 tx=0x7fc85c009c60).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.698+0000 7fc871db6700 1 --2- 172.21.15.50:0/3936304648 >> [v2:172.21.15.98:6816/764254549,v1:172.21.15.98:6817/764254549] conn(0x7fc858062090 0x7fc8580644f0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.699+0000 7fc861ffb700 1 -- 172.21.15.50:0/3936304648 <== osd.5 v2:172.21.15.98:6816/764254549 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fc858064b70 con 0x7fc858062090 2023-01-04T18:13:54.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.713+0000 7fc8725b7700 1 -- 172.21.15.50:0/3936304648 --> [v2:172.21.15.98:6816/764254549,v1:172.21.15.98:6817/764254549] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc86c058150 con 0x7fc858062090 2023-01-04T18:13:54.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.713+0000 7fc861ffb700 1 -- 172.21.15.50:0/3936304648 <== osd.5 v2:172.21.15.98:6816/764254549 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc86c058150 con 0x7fc858062090 2023-01-04T18:13:54.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.714+0000 7fc8725b7700 1 -- 172.21.15.50:0/3936304648 >> [v2:172.21.15.98:6816/764254549,v1:172.21.15.98:6817/764254549] conn(0x7fc858062090 msgr2=0x7fc8580644f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:54.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.714+0000 7fc8725b7700 1 --2- 172.21.15.50:0/3936304648 >> [v2:172.21.15.98:6816/764254549,v1:172.21.15.98:6817/764254549] conn(0x7fc858062090 0x7fc8580644f0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:54.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.714+0000 7fc8725b7700 1 -- 172.21.15.50:0/3936304648 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc85805c2b0 msgr2=0x7fc85805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:54.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.714+0000 7fc8725b7700 1 --2- 172.21.15.50:0/3936304648 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc85805c2b0 0x7fc85805e770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fc85c009740 tx=0x7fc85c009c60).stop 2023-01-04T18:13:54.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.714+0000 7fc8725b7700 1 -- 172.21.15.50:0/3936304648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc86c0f5510 msgr2=0x7fc86c109bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:54.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.714+0000 7fc8725b7700 1 --2- 172.21.15.50:0/3936304648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc86c0f5510 0x7fc86c109bb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fc868004e30 tx=0x7fc868009b30).stop 2023-01-04T18:13:54.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.714+0000 7fc8725b7700 1 -- 172.21.15.50:0/3936304648 shutdown_connections 2023-01-04T18:13:54.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.714+0000 7fc8725b7700 1 --2- 172.21.15.50:0/3936304648 >> [v2:172.21.15.98:6816/764254549,v1:172.21.15.98:6817/764254549] conn(0x7fc858062090 0x7fc8580644f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:54.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.714+0000 7fc8725b7700 1 --2- 172.21.15.50:0/3936304648 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc85805c2b0 0x7fc85805e770 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:54.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.714+0000 7fc8725b7700 1 --2- 172.21.15.50:0/3936304648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc86c0f5510 0x7fc86c109bb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:54.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.714+0000 7fc8725b7700 1 --2- 172.21.15.50:0/3936304648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc86c0f67b0 0x7fc86c10c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:54.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.714+0000 7fc8725b7700 1 -- 172.21.15.50:0/3936304648 >> 172.21.15.50:0/3936304648 conn(0x7fc86c0f0c70 msgr2=0x7fc86c0fa200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:54.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.714+0000 7fc8725b7700 1 -- 172.21.15.50:0/3936304648 shutdown_connections 2023-01-04T18:13:54.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:54.714+0000 7fc8725b7700 1 -- 172.21.15.50:0/3936304648 wait complete. 2023-01-04T18:13:54.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:53.284701+0000 mgr.smithi050.emnywo (mgr.14162) 166 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:55.160 INFO:teuthology.orchestra.run.smithi050.stdout:150323855370 2023-01-04T18:13:55.160 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph osd last-stat-seq osd.0 2023-01-04T18:13:55.607 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050/config 2023-01-04T18:13:56.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:55.285009+0000 mgr.smithi050.emnywo (mgr.14162) 167 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:56.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:55.285009+0000 mgr.smithi050.emnywo (mgr.14162) 167 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:56.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.833+0000 7f6d6b59e700 1 -- 172.21.15.50:0/1165698813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d6c0f78b0 msgr2=0x7f6d6c0f7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:56.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.833+0000 7f6d6b59e700 1 --2- 172.21.15.50:0/1165698813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d6c0f78b0 0x7f6d6c0f7d10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f6d60004660 tx=0x7f6d60009b30).stop 2023-01-04T18:13:56.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.833+0000 7f6d6b59e700 1 -- 172.21.15.50:0/1165698813 shutdown_connections 2023-01-04T18:13:56.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.833+0000 7f6d6b59e700 1 --2- 172.21.15.50:0/1165698813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d6c0f78b0 0x7f6d6c0f7d10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:56.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.833+0000 7f6d6b59e700 1 --2- 172.21.15.50:0/1165698813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6d6c0f6610 0x7f6d6c0f6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:56.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.833+0000 7f6d6b59e700 1 -- 172.21.15.50:0/1165698813 >> 172.21.15.50:0/1165698813 conn(0x7f6d6c0f1d70 msgr2=0x7f6d6c0f4190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:56.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.833+0000 7f6d6b59e700 1 -- 172.21.15.50:0/1165698813 shutdown_connections 2023-01-04T18:13:56.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.833+0000 7f6d6b59e700 1 -- 172.21.15.50:0/1165698813 wait complete. 2023-01-04T18:13:56.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.834+0000 7f6d6b59e700 1 Processor -- start 2023-01-04T18:13:56.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.834+0000 7f6d6b59e700 1 -- start start 2023-01-04T18:13:56.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.834+0000 7f6d6b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d6c0f6610 0x7f6d6c106ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:56.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.834+0000 7f6d6b59e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6d6c0f78b0 0x7f6d6c1073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:56.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.834+0000 7f6d6b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c107970 con 0x7f6d6c0f6610 2023-01-04T18:13:56.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.834+0000 7f6d6b59e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c107ab0 con 0x7f6d6c0f78b0 2023-01-04T18:13:56.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.834+0000 7f6d6a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d6c0f6610 0x7f6d6c106ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.834+0000 7f6d6a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d6c0f6610 0x7f6d6c106ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36158/0 (socket says 172.21.15.50:36158) 2023-01-04T18:13:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.834+0000 7f6d6a59c700 1 -- 172.21.15.50:0/2557911535 learned_addr learned my addr 172.21.15.50:0/2557911535 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:13:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.834+0000 7f6d69d9b700 1 --2- 172.21.15.50:0/2557911535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6d6c0f78b0 0x7f6d6c1073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.834+0000 7f6d6a59c700 1 -- 172.21.15.50:0/2557911535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6d6c0f78b0 msgr2=0x7f6d6c1073c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.834+0000 7f6d6a59c700 1 --2- 172.21.15.50:0/2557911535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6d6c0f78b0 0x7f6d6c1073c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.834+0000 7f6d6a59c700 1 -- 172.21.15.50:0/2557911535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d60005040 con 0x7f6d6c0f6610 2023-01-04T18:13:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.834+0000 7f6d6a59c700 1 --2- 172.21.15.50:0/2557911535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d6c0f6610 0x7f6d6c106ed0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f6d5c00c790 tx=0x7f6d5c007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.835+0000 7f6d5affd700 1 -- 172.21.15.50:0/2557911535 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d5c013630 con 0x7f6d6c0f6610 2023-01-04T18:13:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.835+0000 7f6d5affd700 1 -- 172.21.15.50:0/2557911535 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6d5c012860 con 0x7f6d6c0f6610 2023-01-04T18:13:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.835+0000 7f6d6b59e700 1 -- 172.21.15.50:0/2557911535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d6c108450 con 0x7f6d6c0f6610 2023-01-04T18:13:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.835+0000 7f6d5affd700 1 -- 172.21.15.50:0/2557911535 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d5c0027e0 con 0x7f6d6c0f6610 2023-01-04T18:13:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.835+0000 7f6d6b59e700 1 -- 172.21.15.50:0/2557911535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d6c108a10 con 0x7f6d6c0f6610 2023-01-04T18:13:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.836+0000 7f6d6b59e700 1 -- 172.21.15.50:0/2557911535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d6c045ad0 con 0x7f6d6c0f6610 2023-01-04T18:13:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.836+0000 7f6d5affd700 1 -- 172.21.15.50:0/2557911535 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f6d5c010070 con 0x7f6d6c0f6610 2023-01-04T18:13:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.836+0000 7f6d5affd700 1 --2- 172.21.15.50:0/2557911535 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6d5405c2b0 0x7f6d5405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.836+0000 7f6d5affd700 1 -- 172.21.15.50:0/2557911535 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f6d5c075ba0 con 0x7f6d6c0f6610 2023-01-04T18:13:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.836+0000 7f6d69d9b700 1 --2- 172.21.15.50:0/2557911535 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6d5405c2b0 0x7f6d5405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.837+0000 7f6d69d9b700 1 --2- 172.21.15.50:0/2557911535 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6d5405c2b0 0x7f6d5405e770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f6d60004630 tx=0x7f6d60009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.840+0000 7f6d5affd700 1 -- 172.21.15.50:0/2557911535 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f6d5c048bc0 con 0x7f6d6c0f6610 2023-01-04T18:13:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.997+0000 7f6d6b59e700 1 -- 172.21.15.50:0/2557911535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6d6c027a00 con 0x7f6d6c0f6610 2023-01-04T18:13:57.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.997+0000 7f6d5affd700 1 -- 172.21.15.50:0/2557911535 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6d5c04c1e0 con 0x7f6d6c0f6610 2023-01-04T18:13:57.001 INFO:teuthology.orchestra.run.smithi050.stdout:38654705690 2023-01-04T18:13:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.999+0000 7f6d6b59e700 1 -- 172.21.15.50:0/2557911535 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6d5405c2b0 msgr2=0x7f6d5405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.999+0000 7f6d6b59e700 1 --2- 172.21.15.50:0/2557911535 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6d5405c2b0 0x7f6d5405e770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f6d60004630 tx=0x7f6d60009b30).stop 2023-01-04T18:13:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.999+0000 7f6d6b59e700 1 -- 172.21.15.50:0/2557911535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d6c0f6610 msgr2=0x7f6d6c106ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.999+0000 7f6d6b59e700 1 --2- 172.21.15.50:0/2557911535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d6c0f6610 0x7f6d6c106ed0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f6d5c00c790 tx=0x7f6d5c007d90).stop 2023-01-04T18:13:57.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.999+0000 7f6d6b59e700 1 -- 172.21.15.50:0/2557911535 shutdown_connections 2023-01-04T18:13:57.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.999+0000 7f6d6b59e700 1 --2- 172.21.15.50:0/2557911535 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6d5405c2b0 0x7f6d5405e770 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:57.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.999+0000 7f6d6b59e700 1 --2- 172.21.15.50:0/2557911535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d6c0f6610 0x7f6d6c106ed0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:57.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.999+0000 7f6d6b59e700 1 --2- 172.21.15.50:0/2557911535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6d6c0f78b0 0x7f6d6c1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:57.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.999+0000 7f6d6b59e700 1 -- 172.21.15.50:0/2557911535 >> 172.21.15.50:0/2557911535 conn(0x7f6d6c0f1d70 msgr2=0x7f6d6c0fb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:57.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.999+0000 7f6d6b59e700 1 -- 172.21.15.50:0/2557911535 shutdown_connections 2023-01-04T18:13:57.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:56.999+0000 7f6d6b59e700 1 -- 172.21.15.50:0/2557911535 wait complete. 2023-01-04T18:13:57.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:56.998865+0000 mon.smithi050 (mon.0) 437 : audit [DBG] from='client.? 172.21.15.50:0/2557911535' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-01-04T18:13:57.409 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705688 got 38654705690 for osd.0 2023-01-04T18:13:57.409 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph osd last-stat-seq osd.1 2023-01-04T18:13:57.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:56.998865+0000 mon.smithi050 (mon.0) 437 : audit [DBG] from='client.? 172.21.15.50:0/2557911535' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-01-04T18:13:57.856 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050/config 2023-01-04T18:13:58.418 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:57.285367+0000 mgr.smithi050.emnywo (mgr.14162) 168 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:58.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:57.285367+0000 mgr.smithi050.emnywo (mgr.14162) 168 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:13:59.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.126+0000 7fbb49c37700 1 -- 172.21.15.50:0/4235848490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb440f5510 msgr2=0x7fbb440f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:59.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.126+0000 7fbb49c37700 1 --2- 172.21.15.50:0/4235848490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb440f5510 0x7fbb440f5930 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fbb38004660 tx=0x7fbb38009b30).stop 2023-01-04T18:13:59.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.127+0000 7fbb49c37700 1 -- 172.21.15.50:0/4235848490 shutdown_connections 2023-01-04T18:13:59.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.127+0000 7fbb49c37700 1 --2- 172.21.15.50:0/4235848490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb440f67b0 0x7fbb440f6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:59.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.127+0000 7fbb49c37700 1 --2- 172.21.15.50:0/4235848490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb440f5510 0x7fbb440f5930 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:59.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.127+0000 7fbb49c37700 1 -- 172.21.15.50:0/4235848490 >> 172.21.15.50:0/4235848490 conn(0x7fbb440f0c70 msgr2=0x7fbb440f3090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:59.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.127+0000 7fbb49c37700 1 -- 172.21.15.50:0/4235848490 shutdown_connections 2023-01-04T18:13:59.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.127+0000 7fbb49c37700 1 -- 172.21.15.50:0/4235848490 wait complete. 2023-01-04T18:13:59.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.127+0000 7fbb49c37700 1 Processor -- start 2023-01-04T18:13:59.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.127+0000 7fbb49c37700 1 -- start start 2023-01-04T18:13:59.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.128+0000 7fbb49c37700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb440f5510 0x7fbb44109c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:59.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.128+0000 7fbb49c37700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb440f67b0 0x7fbb4410c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:59.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.128+0000 7fbb49c37700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb44060940 con 0x7fbb440f5510 2023-01-04T18:13:59.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.128+0000 7fbb49c37700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb44060a80 con 0x7fbb440f67b0 2023-01-04T18:13:59.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.128+0000 7fbb48c35700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb440f5510 0x7fbb44109c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:59.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.128+0000 7fbb48c35700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb440f5510 0x7fbb44109c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36170/0 (socket says 172.21.15.50:36170) 2023-01-04T18:13:59.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.128+0000 7fbb48c35700 1 -- 172.21.15.50:0/23520116 learned_addr learned my addr 172.21.15.50:0/23520116 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:13:59.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.128+0000 7fbb43fff700 1 --2- 172.21.15.50:0/23520116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb440f67b0 0x7fbb4410c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:59.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.128+0000 7fbb48c35700 1 -- 172.21.15.50:0/23520116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb440f67b0 msgr2=0x7fbb4410c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:59.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.128+0000 7fbb48c35700 1 --2- 172.21.15.50:0/23520116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb440f67b0 0x7fbb4410c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:59.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.128+0000 7fbb48c35700 1 -- 172.21.15.50:0/23520116 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb38005040 con 0x7fbb440f5510 2023-01-04T18:13:59.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.128+0000 7fbb43fff700 1 --2- 172.21.15.50:0/23520116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb440f67b0 0x7fbb4410c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:13:59.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.128+0000 7fbb48c35700 1 --2- 172.21.15.50:0/23520116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb440f5510 0x7fbb44109c00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fbb38004e30 tx=0x7fbb38009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:59.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.128+0000 7fbb417fa700 1 -- 172.21.15.50:0/23520116 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb38018070 con 0x7fbb440f5510 2023-01-04T18:13:59.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.128+0000 7fbb417fa700 1 -- 172.21.15.50:0/23520116 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbb38013410 con 0x7fbb440f5510 2023-01-04T18:13:59.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.128+0000 7fbb49c37700 1 -- 172.21.15.50:0/23520116 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4410c650 con 0x7fbb440f5510 2023-01-04T18:13:59.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.128+0000 7fbb417fa700 1 -- 172.21.15.50:0/23520116 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb3801c3c0 con 0x7fbb440f5510 2023-01-04T18:13:59.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.128+0000 7fbb49c37700 1 -- 172.21.15.50:0/23520116 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4410cbb0 con 0x7fbb440f5510 2023-01-04T18:13:59.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.129+0000 7fbb49c37700 1 -- 172.21.15.50:0/23520116 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb44045ad0 con 0x7fbb440f5510 2023-01-04T18:13:59.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.130+0000 7fbb417fa700 1 -- 172.21.15.50:0/23520116 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fbb3801d420 con 0x7fbb440f5510 2023-01-04T18:13:59.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.130+0000 7fbb417fa700 1 --2- 172.21.15.50:0/23520116 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fbb3405c2b0 0x7fbb3405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:13:59.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.130+0000 7fbb417fa700 1 -- 172.21.15.50:0/23520116 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fbb38077780 con 0x7fbb440f5510 2023-01-04T18:13:59.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.130+0000 7fbb43fff700 1 --2- 172.21.15.50:0/23520116 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fbb3405c2b0 0x7fbb3405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:13:59.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.130+0000 7fbb43fff700 1 --2- 172.21.15.50:0/23520116 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fbb3405c2b0 0x7fbb3405e770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fbb30009740 tx=0x7fbb30009be0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:13:59.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.134+0000 7fbb417fa700 1 -- 172.21.15.50:0/23520116 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fbb3804a780 con 0x7fbb440f5510 2023-01-04T18:13:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.292+0000 7fbb49c37700 1 -- 172.21.15.50:0/23520116 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbb44027a00 con 0x7fbb440f5510 2023-01-04T18:13:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.292+0000 7fbb417fa700 1 -- 172.21.15.50:0/23520116 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb3804dda0 con 0x7fbb440f5510 2023-01-04T18:13:59.295 INFO:teuthology.orchestra.run.smithi050.stdout:55834574871 2023-01-04T18:13:59.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.294+0000 7fbb49c37700 1 -- 172.21.15.50:0/23520116 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fbb3405c2b0 msgr2=0x7fbb3405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:59.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.294+0000 7fbb49c37700 1 --2- 172.21.15.50:0/23520116 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fbb3405c2b0 0x7fbb3405e770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fbb30009740 tx=0x7fbb30009be0).stop 2023-01-04T18:13:59.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.294+0000 7fbb49c37700 1 -- 172.21.15.50:0/23520116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb440f5510 msgr2=0x7fbb44109c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:13:59.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.294+0000 7fbb49c37700 1 --2- 172.21.15.50:0/23520116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb440f5510 0x7fbb44109c00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fbb38004e30 tx=0x7fbb38009b30).stop 2023-01-04T18:13:59.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.294+0000 7fbb49c37700 1 -- 172.21.15.50:0/23520116 shutdown_connections 2023-01-04T18:13:59.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.294+0000 7fbb49c37700 1 --2- 172.21.15.50:0/23520116 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fbb3405c2b0 0x7fbb3405e770 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:59.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.294+0000 7fbb49c37700 1 --2- 172.21.15.50:0/23520116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb440f5510 0x7fbb44109c00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:59.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.294+0000 7fbb49c37700 1 --2- 172.21.15.50:0/23520116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb440f67b0 0x7fbb4410c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:13:59.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.294+0000 7fbb49c37700 1 -- 172.21.15.50:0/23520116 >> 172.21.15.50:0/23520116 conn(0x7fbb440f0c70 msgr2=0x7fbb440fa200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:13:59.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.294+0000 7fbb49c37700 1 -- 172.21.15.50:0/23520116 shutdown_connections 2023-01-04T18:13:59.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:13:59.294+0000 7fbb49c37700 1 -- 172.21.15.50:0/23520116 wait complete. 2023-01-04T18:13:59.749 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:13:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:13:59.292944+0000 mon.smithi050 (mon.0) 438 : audit [DBG] from='client.? 172.21.15.50:0/23520116' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-01-04T18:13:59.769 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574869 got 55834574871 for osd.1 2023-01-04T18:13:59.769 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph osd last-stat-seq osd.2 2023-01-04T18:13:59.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:13:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:13:59.292944+0000 mon.smithi050 (mon.0) 438 : audit [DBG] from='client.? 172.21.15.50:0/23520116' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-01-04T18:14:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050/config 2023-01-04T18:14:00.606 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:13:59.285616+0000 mgr.smithi050.emnywo (mgr.14162) 169 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:00.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:13:59.285616+0000 mgr.smithi050.emnywo (mgr.14162) 169 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:01.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.443+0000 7f2d9909b700 1 -- 172.21.15.50:0/2812448847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d940f67c0 msgr2=0x7f2d940f6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:01.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.443+0000 7f2d9909b700 1 --2- 172.21.15.50:0/2812448847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d940f67c0 0x7f2d940f6be0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f2d84004660 tx=0x7f2d84009b30).stop 2023-01-04T18:14:01.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.443+0000 7f2d9909b700 1 -- 172.21.15.50:0/2812448847 shutdown_connections 2023-01-04T18:14:01.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.443+0000 7f2d9909b700 1 --2- 172.21.15.50:0/2812448847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d940f7a60 0x7f2d940f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:01.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.443+0000 7f2d9909b700 1 --2- 172.21.15.50:0/2812448847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d940f67c0 0x7f2d940f6be0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:01.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.443+0000 7f2d9909b700 1 -- 172.21.15.50:0/2812448847 >> 172.21.15.50:0/2812448847 conn(0x7f2d940f1f20 msgr2=0x7f2d940f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:01.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.443+0000 7f2d9909b700 1 -- 172.21.15.50:0/2812448847 shutdown_connections 2023-01-04T18:14:01.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.443+0000 7f2d9909b700 1 -- 172.21.15.50:0/2812448847 wait complete. 2023-01-04T18:14:01.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.444+0000 7f2d9909b700 1 Processor -- start 2023-01-04T18:14:01.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.444+0000 7f2d9909b700 1 -- start start 2023-01-04T18:14:01.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.444+0000 7f2d9909b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d940f67c0 0x7f2d9406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:01.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.444+0000 7f2d9909b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d940f7a60 0x7f2d94069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:01.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.444+0000 7f2d9909b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9406a380 con 0x7f2d940f7a60 2023-01-04T18:14:01.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.444+0000 7f2d9909b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9406a4c0 con 0x7f2d940f67c0 2023-01-04T18:14:01.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.444+0000 7f2d9259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d940f7a60 0x7f2d94069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:01.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.444+0000 7f2d9259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d940f7a60 0x7f2d94069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36188/0 (socket says 172.21.15.50:36188) 2023-01-04T18:14:01.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.444+0000 7f2d9259c700 1 -- 172.21.15.50:0/1371021180 learned_addr learned my addr 172.21.15.50:0/1371021180 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:01.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.444+0000 7f2d92d9d700 1 --2- 172.21.15.50:0/1371021180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d940f67c0 0x7f2d9406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:01.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.445+0000 7f2d9259c700 1 -- 172.21.15.50:0/1371021180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d940f67c0 msgr2=0x7f2d9406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:01.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.445+0000 7f2d9259c700 1 --2- 172.21.15.50:0/1371021180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d940f67c0 0x7f2d9406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:01.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.445+0000 7f2d9259c700 1 -- 172.21.15.50:0/1371021180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d84005040 con 0x7f2d940f7a60 2023-01-04T18:14:01.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.445+0000 7f2d9259c700 1 --2- 172.21.15.50:0/1371021180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d940f7a60 0x7f2d94069e20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f2d7c00c790 tx=0x7f2d7c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:01.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.445+0000 7f2d8b7fe700 1 -- 172.21.15.50:0/1371021180 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d7c002590 con 0x7f2d940f7a60 2023-01-04T18:14:01.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.445+0000 7f2d9909b700 1 -- 172.21.15.50:0/1371021180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d9406a7a0 con 0x7f2d940f7a60 2023-01-04T18:14:01.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.445+0000 7f2d8b7fe700 1 -- 172.21.15.50:0/1371021180 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2d7c002ba0 con 0x7f2d940f7a60 2023-01-04T18:14:01.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.445+0000 7f2d8b7fe700 1 -- 172.21.15.50:0/1371021180 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d7c013d90 con 0x7f2d940f7a60 2023-01-04T18:14:01.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.445+0000 7f2d9909b700 1 -- 172.21.15.50:0/1371021180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9410f0d0 con 0x7f2d940f7a60 2023-01-04T18:14:01.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.446+0000 7f2d9909b700 1 -- 172.21.15.50:0/1371021180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d94045ad0 con 0x7f2d940f7a60 2023-01-04T18:14:01.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.446+0000 7f2d8b7fe700 1 -- 172.21.15.50:0/1371021180 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f2d7c01a060 con 0x7f2d940f7a60 2023-01-04T18:14:01.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.447+0000 7f2d8b7fe700 1 --2- 172.21.15.50:0/1371021180 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f2d8005c2a0 0x7f2d8005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:01.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.447+0000 7f2d8b7fe700 1 -- 172.21.15.50:0/1371021180 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f2d7c075e20 con 0x7f2d940f7a60 2023-01-04T18:14:01.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.447+0000 7f2d92d9d700 1 --2- 172.21.15.50:0/1371021180 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f2d8005c2a0 0x7f2d8005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:01.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.447+0000 7f2d92d9d700 1 --2- 172.21.15.50:0/1371021180 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f2d8005c2a0 0x7f2d8005e760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f2d9406b730 tx=0x7f2d84009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:01.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.451+0000 7f2d8b7fe700 1 -- 172.21.15.50:0/1371021180 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2d7c048dc0 con 0x7f2d940f7a60 2023-01-04T18:14:01.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.609+0000 7f2d9909b700 1 -- 172.21.15.50:0/1371021180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2d940feff0 con 0x7f2d940f7a60 2023-01-04T18:14:01.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.610+0000 7f2d8b7fe700 1 -- 172.21.15.50:0/1371021180 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2d7c04c3e0 con 0x7f2d940f7a60 2023-01-04T18:14:01.612 INFO:teuthology.orchestra.run.smithi050.stdout:73014444053 2023-01-04T18:14:01.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.611+0000 7f2d9909b700 1 -- 172.21.15.50:0/1371021180 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f2d8005c2a0 msgr2=0x7f2d8005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:01.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.611+0000 7f2d9909b700 1 --2- 172.21.15.50:0/1371021180 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f2d8005c2a0 0x7f2d8005e760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f2d9406b730 tx=0x7f2d84009b30).stop 2023-01-04T18:14:01.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.611+0000 7f2d9909b700 1 -- 172.21.15.50:0/1371021180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d940f7a60 msgr2=0x7f2d94069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:01.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.611+0000 7f2d9909b700 1 --2- 172.21.15.50:0/1371021180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d940f7a60 0x7f2d94069e20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f2d7c00c790 tx=0x7f2d7c007d70).stop 2023-01-04T18:14:01.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.612+0000 7f2d9909b700 1 -- 172.21.15.50:0/1371021180 shutdown_connections 2023-01-04T18:14:01.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.612+0000 7f2d9909b700 1 --2- 172.21.15.50:0/1371021180 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f2d8005c2a0 0x7f2d8005e760 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:01.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.612+0000 7f2d9909b700 1 --2- 172.21.15.50:0/1371021180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d940f67c0 0x7f2d9406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:01.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.612+0000 7f2d9909b700 1 --2- 172.21.15.50:0/1371021180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d940f7a60 0x7f2d94069e20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:01.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.612+0000 7f2d9909b700 1 -- 172.21.15.50:0/1371021180 >> 172.21.15.50:0/1371021180 conn(0x7f2d940f1f20 msgr2=0x7f2d940fb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:01.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.612+0000 7f2d9909b700 1 -- 172.21.15.50:0/1371021180 shutdown_connections 2023-01-04T18:14:01.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:01.612+0000 7f2d9909b700 1 -- 172.21.15.50:0/1371021180 wait complete. 2023-01-04T18:14:02.215 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444050 got 73014444053 for osd.2 2023-01-04T18:14:02.216 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph osd last-stat-seq osd.3 2023-01-04T18:14:02.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:01.285924+0000 mgr.smithi050.emnywo (mgr.14162) 170 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:02.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:01.610526+0000 mon.smithi050 (mon.0) 439 : audit [DBG] from='client.? 172.21.15.50:0/1371021180' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-01-04T18:14:02.665 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050/config 2023-01-04T18:14:02.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:01.285924+0000 mgr.smithi050.emnywo (mgr.14162) 170 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:02.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:01.610526+0000 mon.smithi050 (mon.0) 439 : audit [DBG] from='client.? 172.21.15.50:0/1371021180' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-01-04T18:14:03.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.809+0000 7f2f4a0e9700 1 -- 172.21.15.50:0/2292710018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f440f67d0 msgr2=0x7f2f440f6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:03.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.809+0000 7f2f4a0e9700 1 --2- 172.21.15.50:0/2292710018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f440f67d0 0x7f2f440f6bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f2f34004660 tx=0x7f2f34009b30).stop 2023-01-04T18:14:03.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.809+0000 7f2f4a0e9700 1 -- 172.21.15.50:0/2292710018 shutdown_connections 2023-01-04T18:14:03.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.809+0000 7f2f4a0e9700 1 --2- 172.21.15.50:0/2292710018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f440f7a70 0x7f2f440f7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:03.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.809+0000 7f2f4a0e9700 1 --2- 172.21.15.50:0/2292710018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f440f67d0 0x7f2f440f6bf0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:03.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.809+0000 7f2f4a0e9700 1 -- 172.21.15.50:0/2292710018 >> 172.21.15.50:0/2292710018 conn(0x7f2f440f1f50 msgr2=0x7f2f440f4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:03.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.809+0000 7f2f4a0e9700 1 -- 172.21.15.50:0/2292710018 shutdown_connections 2023-01-04T18:14:03.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.809+0000 7f2f4a0e9700 1 -- 172.21.15.50:0/2292710018 wait complete. 2023-01-04T18:14:03.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.810+0000 7f2f4a0e9700 1 Processor -- start 2023-01-04T18:14:03.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.810+0000 7f2f4a0e9700 1 -- start start 2023-01-04T18:14:03.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.810+0000 7f2f4a0e9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f440f67d0 0x7f2f441070b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:03.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.810+0000 7f2f4a0e9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f440f7a70 0x7f2f441075a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:03.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.810+0000 7f2f4a0e9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f44107b50 con 0x7f2f440f7a70 2023-01-04T18:14:03.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.810+0000 7f2f4a0e9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f44107c90 con 0x7f2f440f67d0 2023-01-04T18:14:03.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.811+0000 7f2f42ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f440f7a70 0x7f2f441075a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:03.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.811+0000 7f2f42ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f440f7a70 0x7f2f441075a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36206/0 (socket says 172.21.15.50:36206) 2023-01-04T18:14:03.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.811+0000 7f2f42ffd700 1 -- 172.21.15.50:0/632685646 learned_addr learned my addr 172.21.15.50:0/632685646 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:03.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.811+0000 7f2f437fe700 1 --2- 172.21.15.50:0/632685646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f440f67d0 0x7f2f441070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:03.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.811+0000 7f2f42ffd700 1 -- 172.21.15.50:0/632685646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f440f67d0 msgr2=0x7f2f441070b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:03.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.811+0000 7f2f42ffd700 1 --2- 172.21.15.50:0/632685646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f440f67d0 0x7f2f441070b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:03.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.811+0000 7f2f42ffd700 1 -- 172.21.15.50:0/632685646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f34005040 con 0x7f2f440f7a70 2023-01-04T18:14:03.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.811+0000 7f2f42ffd700 1 --2- 172.21.15.50:0/632685646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f440f7a70 0x7f2f441075a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f2f2c0026d0 tx=0x7f2f2c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:03.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.811+0000 7f2f3bfff700 1 -- 172.21.15.50:0/632685646 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f2c0079c0 con 0x7f2f440f7a70 2023-01-04T18:14:03.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.811+0000 7f2f4a0e9700 1 -- 172.21.15.50:0/632685646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f44108630 con 0x7f2f440f7a70 2023-01-04T18:14:03.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.811+0000 7f2f3bfff700 1 -- 172.21.15.50:0/632685646 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f2c00f040 con 0x7f2f440f7a70 2023-01-04T18:14:03.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.811+0000 7f2f3bfff700 1 -- 172.21.15.50:0/632685646 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f2c0148b0 con 0x7f2f440f7a70 2023-01-04T18:14:03.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.811+0000 7f2f4a0e9700 1 -- 172.21.15.50:0/632685646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f44108bf0 con 0x7f2f440f7a70 2023-01-04T18:14:03.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.812+0000 7f2f4a0e9700 1 -- 172.21.15.50:0/632685646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f44045ad0 con 0x7f2f440f7a70 2023-01-04T18:14:03.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.812+0000 7f2f3bfff700 1 -- 172.21.15.50:0/632685646 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f2f2c007b20 con 0x7f2f440f7a70 2023-01-04T18:14:03.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.813+0000 7f2f3bfff700 1 --2- 172.21.15.50:0/632685646 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f2f3005c2a0 0x7f2f3005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:03.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.813+0000 7f2f3bfff700 1 -- 172.21.15.50:0/632685646 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f2f2c075b00 con 0x7f2f440f7a70 2023-01-04T18:14:03.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.813+0000 7f2f437fe700 1 --2- 172.21.15.50:0/632685646 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f2f3005c2a0 0x7f2f3005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:03.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.813+0000 7f2f437fe700 1 --2- 172.21.15.50:0/632685646 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f2f3005c2a0 0x7f2f3005e760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f2f34005010 tx=0x7f2f34009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:03.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.817+0000 7f2f3bfff700 1 -- 172.21.15.50:0/632685646 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2f2c048b00 con 0x7f2f440f7a70 2023-01-04T18:14:03.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.976+0000 7f2f4a0e9700 1 -- 172.21.15.50:0/632685646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2f44027a00 con 0x7f2f440f7a70 2023-01-04T18:14:03.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.976+0000 7f2f3bfff700 1 -- 172.21.15.50:0/632685646 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f2c04c120 con 0x7f2f440f7a70 2023-01-04T18:14:03.979 INFO:teuthology.orchestra.run.smithi050.stdout:107374182418 2023-01-04T18:14:03.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.978+0000 7f2f4a0e9700 1 -- 172.21.15.50:0/632685646 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f2f3005c2a0 msgr2=0x7f2f3005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:03.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.978+0000 7f2f4a0e9700 1 --2- 172.21.15.50:0/632685646 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f2f3005c2a0 0x7f2f3005e760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f2f34005010 tx=0x7f2f34009b30).stop 2023-01-04T18:14:03.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.978+0000 7f2f4a0e9700 1 -- 172.21.15.50:0/632685646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f440f7a70 msgr2=0x7f2f441075a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:03.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.978+0000 7f2f4a0e9700 1 --2- 172.21.15.50:0/632685646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f440f7a70 0x7f2f441075a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f2f2c0026d0 tx=0x7f2f2c009de0).stop 2023-01-04T18:14:03.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.978+0000 7f2f4a0e9700 1 -- 172.21.15.50:0/632685646 shutdown_connections 2023-01-04T18:14:03.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.978+0000 7f2f4a0e9700 1 --2- 172.21.15.50:0/632685646 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f2f3005c2a0 0x7f2f3005e760 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:03.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.978+0000 7f2f4a0e9700 1 --2- 172.21.15.50:0/632685646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f440f67d0 0x7f2f441070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:03.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.978+0000 7f2f4a0e9700 1 --2- 172.21.15.50:0/632685646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f440f7a70 0x7f2f441075a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:03.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.978+0000 7f2f4a0e9700 1 -- 172.21.15.50:0/632685646 >> 172.21.15.50:0/632685646 conn(0x7f2f440f1f50 msgr2=0x7f2f440fb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:03.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.978+0000 7f2f4a0e9700 1 -- 172.21.15.50:0/632685646 shutdown_connections 2023-01-04T18:14:03.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:03.978+0000 7f2f4a0e9700 1 -- 172.21.15.50:0/632685646 wait complete. 2023-01-04T18:14:04.377 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182415 got 107374182418 for osd.3 2023-01-04T18:14:04.378 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph osd last-stat-seq osd.4 2023-01-04T18:14:04.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:03.286387+0000 mgr.smithi050.emnywo (mgr.14162) 171 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:04.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:03.977113+0000 mon.smithi050 (mon.0) 440 : audit [DBG] from='client.? 172.21.15.50:0/632685646' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-01-04T18:14:04.825 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050/config 2023-01-04T18:14:04.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:03.286387+0000 mgr.smithi050.emnywo (mgr.14162) 171 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:04.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:03.977113+0000 mon.smithi050 (mon.0) 440 : audit [DBG] from='client.? 172.21.15.50:0/632685646' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-01-04T18:14:06.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.055+0000 7f390152e700 1 -- 172.21.15.50:0/121266553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38fc0f67f0 msgr2=0x7f38fc0f6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:06.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.055+0000 7f390152e700 1 --2- 172.21.15.50:0/121266553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38fc0f67f0 0x7f38fc0f6c50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f38f0004660 tx=0x7f38f0009b30).stop 2023-01-04T18:14:06.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.055+0000 7f390152e700 1 -- 172.21.15.50:0/121266553 shutdown_connections 2023-01-04T18:14:06.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.055+0000 7f390152e700 1 --2- 172.21.15.50:0/121266553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38fc0f67f0 0x7f38fc0f6c50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:06.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.055+0000 7f390152e700 1 --2- 172.21.15.50:0/121266553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38fc0f5550 0x7f38fc0f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-01-04T18:14:06.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.055+0000 7f390152e700 1 -- 172.21.15.50:0/121266553 >> 172.21.15.50:0/121266553 conn(0x7f38fc0f0cb0 msgr2=0x7f38fc0f30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:06.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.055+0000 7f390152e700 1 -- 172.21.15.50:0/121266553 shutdown_connections 2023-01-04T18:14:06.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.055+0000 7f390152e700 1 -- 172.21.15.50:0/121266553 wait complete. 2023-01-04T18:14:06.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.056+0000 7f390152e700 1 Processor -- start 2023-01-04T18:14:06.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.056+0000 7f390152e700 1 -- start start 2023-01-04T18:14:06.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.056+0000 7f390152e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38fc0f5550 0x7f38fc106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:06.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.056+0000 7f390152e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38fc0f67f0 0x7f38fc107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:06.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.056+0000 7f390152e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc107a60 con 0x7f38fc0f67f0 2023-01-04T18:14:06.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.056+0000 7f390152e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc108310 con 0x7f38fc0f5550 2023-01-04T18:14:06.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.057+0000 7f38fa7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38fc0f67f0 0x7f38fc107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:06.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.057+0000 7f38fa7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38fc0f67f0 0x7f38fc107420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36230/0 (socket says 172.21.15.50:36230) 2023-01-04T18:14:06.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.057+0000 7f38fa7fc700 1 -- 172.21.15.50:0/3938396171 learned_addr learned my addr 172.21.15.50:0/3938396171 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:06.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.057+0000 7f38faffd700 1 --2- 172.21.15.50:0/3938396171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38fc0f5550 0x7f38fc106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:06.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.057+0000 7f38fa7fc700 1 -- 172.21.15.50:0/3938396171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38fc0f5550 msgr2=0x7f38fc106f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:06.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.057+0000 7f38fa7fc700 1 --2- 172.21.15.50:0/3938396171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38fc0f5550 0x7f38fc106f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:06.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.057+0000 7f38fa7fc700 1 -- 172.21.15.50:0/3938396171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f0005040 con 0x7f38fc0f67f0 2023-01-04T18:14:06.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.057+0000 7f38fa7fc700 1 --2- 172.21.15.50:0/3938396171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38fc0f67f0 0x7f38fc107420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f38f0009830 tx=0x7f38f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:06.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.057+0000 7f38e37fe700 1 -- 172.21.15.50:0/3938396171 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38f0018070 con 0x7f38fc0f67f0 2023-01-04T18:14:06.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.057+0000 7f390152e700 1 -- 172.21.15.50:0/3938396171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38fc108590 con 0x7f38fc0f67f0 2023-01-04T18:14:06.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.057+0000 7f38e37fe700 1 -- 172.21.15.50:0/3938396171 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f38f0013410 con 0x7f38fc0f67f0 2023-01-04T18:14:06.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.057+0000 7f38e37fe700 1 -- 172.21.15.50:0/3938396171 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38f001c620 con 0x7f38fc0f67f0 2023-01-04T18:14:06.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.057+0000 7f390152e700 1 -- 172.21.15.50:0/3938396171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38fc108af0 con 0x7f38fc0f67f0 2023-01-04T18:14:06.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.058+0000 7f390152e700 1 -- 172.21.15.50:0/3938396171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38fc059100 con 0x7f38fc0f67f0 2023-01-04T18:14:06.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.058+0000 7f38e37fe700 1 -- 172.21.15.50:0/3938396171 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f38f001c8e0 con 0x7f38fc0f67f0 2023-01-04T18:14:06.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.059+0000 7f38e37fe700 1 --2- 172.21.15.50:0/3938396171 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f38e405c2b0 0x7f38e405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:06.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.059+0000 7f38e37fe700 1 -- 172.21.15.50:0/3938396171 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f38f0077a80 con 0x7f38fc0f67f0 2023-01-04T18:14:06.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.059+0000 7f38faffd700 1 --2- 172.21.15.50:0/3938396171 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f38e405c2b0 0x7f38e405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:06.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.059+0000 7f38faffd700 1 --2- 172.21.15.50:0/3938396171 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f38e405c2b0 0x7f38e405e770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f38fc0f6650 tx=0x7f38ec008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:06.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.063+0000 7f38e37fe700 1 -- 172.21.15.50:0/3938396171 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f38f004aa20 con 0x7f38fc0f67f0 2023-01-04T18:14:06.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.225+0000 7f390152e700 1 -- 172.21.15.50:0/3938396171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f38fc045ad0 con 0x7f38fc0f67f0 2023-01-04T18:14:06.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.225+0000 7f38e37fe700 1 -- 172.21.15.50:0/3938396171 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f38f004e040 con 0x7f38fc0f67f0 2023-01-04T18:14:06.228 INFO:teuthology.orchestra.run.smithi050.stdout:128849018895 2023-01-04T18:14:06.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.227+0000 7f390152e700 1 -- 172.21.15.50:0/3938396171 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f38e405c2b0 msgr2=0x7f38e405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:06.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.227+0000 7f390152e700 1 --2- 172.21.15.50:0/3938396171 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f38e405c2b0 0x7f38e405e770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f38fc0f6650 tx=0x7f38ec008040).stop 2023-01-04T18:14:06.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.227+0000 7f390152e700 1 -- 172.21.15.50:0/3938396171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38fc0f67f0 msgr2=0x7f38fc107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:06.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.227+0000 7f390152e700 1 --2- 172.21.15.50:0/3938396171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38fc0f67f0 0x7f38fc107420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f38f0009830 tx=0x7f38f0009b30).stop 2023-01-04T18:14:06.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.227+0000 7f390152e700 1 -- 172.21.15.50:0/3938396171 shutdown_connections 2023-01-04T18:14:06.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.227+0000 7f390152e700 1 --2- 172.21.15.50:0/3938396171 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f38e405c2b0 0x7f38e405e770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:06.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.227+0000 7f390152e700 1 --2- 172.21.15.50:0/3938396171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38fc0f5550 0x7f38fc106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:06.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.227+0000 7f390152e700 1 --2- 172.21.15.50:0/3938396171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38fc0f67f0 0x7f38fc107420 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:06.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.227+0000 7f390152e700 1 -- 172.21.15.50:0/3938396171 >> 172.21.15.50:0/3938396171 conn(0x7f38fc0f0cb0 msgr2=0x7f38fc0603a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:06.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.227+0000 7f390152e700 1 -- 172.21.15.50:0/3938396171 shutdown_connections 2023-01-04T18:14:06.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:06.227+0000 7f390152e700 1 -- 172.21.15.50:0/3938396171 wait complete. 2023-01-04T18:14:06.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:05.286882+0000 mgr.smithi050.emnywo (mgr.14162) 172 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:06.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:05.286882+0000 mgr.smithi050.emnywo (mgr.14162) 172 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:06.627 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018892 got 128849018895 for osd.4 2023-01-04T18:14:06.627 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph osd last-stat-seq osd.5 2023-01-04T18:14:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050/config 2023-01-04T18:14:07.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:06.225749+0000 mon.smithi050 (mon.0) 441 : audit [DBG] from='client.? 172.21.15.50:0/3938396171' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-01-04T18:14:07.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:06.225749+0000 mon.smithi050 (mon.0) 441 : audit [DBG] from='client.? 172.21.15.50:0/3938396171' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-01-04T18:14:08.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.335+0000 7f02e7d08700 1 -- 172.21.15.50:0/4047849300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02e00f67c0 msgr2=0x7f02e00f6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:08.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.335+0000 7f02e7d08700 1 --2- 172.21.15.50:0/4047849300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02e00f67c0 0x7f02e00f6be0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f02d0004660 tx=0x7f02d0009b30).stop 2023-01-04T18:14:08.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.335+0000 7f02e7d08700 1 -- 172.21.15.50:0/4047849300 shutdown_connections 2023-01-04T18:14:08.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.335+0000 7f02e7d08700 1 --2- 172.21.15.50:0/4047849300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02e00f7a60 0x7f02e00f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-01-04T18:14:08.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.335+0000 7f02e7d08700 1 --2- 172.21.15.50:0/4047849300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02e00f67c0 0x7f02e00f6be0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:08.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.335+0000 7f02e7d08700 1 -- 172.21.15.50:0/4047849300 >> 172.21.15.50:0/4047849300 conn(0x7f02e00f1f20 msgr2=0x7f02e00f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:08.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.335+0000 7f02e7d08700 1 -- 172.21.15.50:0/4047849300 shutdown_connections 2023-01-04T18:14:08.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.335+0000 7f02e7d08700 1 -- 172.21.15.50:0/4047849300 wait complete. 2023-01-04T18:14:08.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.336+0000 7f02e7d08700 1 Processor -- start 2023-01-04T18:14:08.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.336+0000 7f02e7d08700 1 -- start start 2023-01-04T18:14:08.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.336+0000 7f02e7d08700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02e00f67c0 0x7f02e006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.336+0000 7f02e7d08700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02e00f7a60 0x7f02e0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.336+0000 7f02e7d08700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e006a410 con 0x7f02e00f67c0 2023-01-04T18:14:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.336+0000 7f02e7d08700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e006a550 con 0x7f02e00f7a60 2023-01-04T18:14:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.336+0000 7f02e5aa4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02e00f67c0 0x7f02e006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.336+0000 7f02e5aa4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02e00f67c0 0x7f02e006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52480/0 (socket says 172.21.15.50:52480) 2023-01-04T18:14:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.336+0000 7f02e5aa4700 1 -- 172.21.15.50:0/1209122780 learned_addr learned my addr 172.21.15.50:0/1209122780 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.336+0000 7f02e52a3700 1 --2- 172.21.15.50:0/1209122780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02e00f7a60 0x7f02e0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.336+0000 7f02e5aa4700 1 -- 172.21.15.50:0/1209122780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02e00f7a60 msgr2=0x7f02e0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.336+0000 7f02e5aa4700 1 --2- 172.21.15.50:0/1209122780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02e00f7a60 0x7f02e0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.336+0000 7f02e5aa4700 1 -- 172.21.15.50:0/1209122780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d0005040 con 0x7f02e00f67c0 2023-01-04T18:14:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.336+0000 7f02e52a3700 1 --2- 172.21.15.50:0/1209122780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02e00f7a60 0x7f02e0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-01-04T18:14:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.336+0000 7f02e5aa4700 1 --2- 172.21.15.50:0/1209122780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02e00f67c0 0x7f02e006b9a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f02d0009f50 tx=0x7f02d0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.337+0000 7f02d67fc700 1 -- 172.21.15.50:0/1209122780 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02d0018070 con 0x7f02e00f67c0 2023-01-04T18:14:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.337+0000 7f02e7d08700 1 -- 172.21.15.50:0/1209122780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e006a7d0 con 0x7f02e00f67c0 2023-01-04T18:14:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.337+0000 7f02d67fc700 1 -- 172.21.15.50:0/1209122780 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f02d0013410 con 0x7f02e00f67c0 2023-01-04T18:14:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.337+0000 7f02d67fc700 1 -- 172.21.15.50:0/1209122780 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02d001c620 con 0x7f02e00f67c0 2023-01-04T18:14:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.337+0000 7f02e7d08700 1 -- 172.21.15.50:0/1209122780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e010f100 con 0x7f02e00f67c0 2023-01-04T18:14:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.338+0000 7f02e7d08700 1 -- 172.21.15.50:0/1209122780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e0045ad0 con 0x7f02e00f67c0 2023-01-04T18:14:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.338+0000 7f02d67fc700 1 -- 172.21.15.50:0/1209122780 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f02d001d420 con 0x7f02e00f67c0 2023-01-04T18:14:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.338+0000 7f02d67fc700 1 --2- 172.21.15.50:0/1209122780 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f02cc05c2a0 0x7f02cc05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.339+0000 7f02d67fc700 1 -- 172.21.15.50:0/1209122780 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f02d0077a40 con 0x7f02e00f67c0 2023-01-04T18:14:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.339+0000 7f02e52a3700 1 --2- 172.21.15.50:0/1209122780 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f02cc05c2a0 0x7f02cc05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:08.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.339+0000 7f02e52a3700 1 --2- 172.21.15.50:0/1209122780 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f02cc05c2a0 0x7f02cc05e760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f02dc00a880 tx=0x7f02dc008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:08.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.342+0000 7f02d67fc700 1 -- 172.21.15.50:0/1209122780 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f02d004aa40 con 0x7f02e00f67c0 2023-01-04T18:14:08.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.501+0000 7f02e7d08700 1 -- 172.21.15.50:0/1209122780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f02e0027a00 con 0x7f02e00f67c0 2023-01-04T18:14:08.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.501+0000 7f02d67fc700 1 -- 172.21.15.50:0/1209122780 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f02d004e060 con 0x7f02e00f67c0 2023-01-04T18:14:08.504 INFO:teuthology.orchestra.run.smithi050.stdout:150323855372 2023-01-04T18:14:08.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.503+0000 7f02e7d08700 1 -- 172.21.15.50:0/1209122780 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f02cc05c2a0 msgr2=0x7f02cc05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:08.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.503+0000 7f02e7d08700 1 --2- 172.21.15.50:0/1209122780 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f02cc05c2a0 0x7f02cc05e760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f02dc00a880 tx=0x7f02dc008040).stop 2023-01-04T18:14:08.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.503+0000 7f02e7d08700 1 -- 172.21.15.50:0/1209122780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02e00f67c0 msgr2=0x7f02e006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:08.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.503+0000 7f02e7d08700 1 --2- 172.21.15.50:0/1209122780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02e00f67c0 0x7f02e006b9a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f02d0009f50 tx=0x7f02d0009b30).stop 2023-01-04T18:14:08.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.503+0000 7f02e7d08700 1 -- 172.21.15.50:0/1209122780 shutdown_connections 2023-01-04T18:14:08.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.503+0000 7f02e7d08700 1 --2- 172.21.15.50:0/1209122780 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f02cc05c2a0 0x7f02cc05e760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:08.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.503+0000 7f02e7d08700 1 --2- 172.21.15.50:0/1209122780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02e00f67c0 0x7f02e006b9a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:08.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.503+0000 7f02e7d08700 1 --2- 172.21.15.50:0/1209122780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02e00f7a60 0x7f02e0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:08.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.503+0000 7f02e7d08700 1 -- 172.21.15.50:0/1209122780 >> 172.21.15.50:0/1209122780 conn(0x7f02e00f1f20 msgr2=0x7f02e00fb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:08.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.503+0000 7f02e7d08700 1 -- 172.21.15.50:0/1209122780 shutdown_connections 2023-01-04T18:14:08.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:08.503+0000 7f02e7d08700 1 -- 172.21.15.50:0/1209122780 wait complete. 2023-01-04T18:14:08.524 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:07.287255+0000 mgr.smithi050.emnywo (mgr.14162) 173 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:08.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:07.287255+0000 mgr.smithi050.emnywo (mgr.14162) 173 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:08.985 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855370 got 150323855372 for osd.5 2023-01-04T18:14:08.986 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-01-04T18:14:08.986 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph pg dump --format=json 2023-01-04T18:14:09.429 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050/config 2023-01-04T18:14:09.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:09 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:08.501961+0000 mon.smithi050 (mon.0) 442 : audit [DBG] from='client.? 172.21.15.50:0/1209122780' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-01-04T18:14:09.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:09 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:08.501961+0000 mon.smithi050 (mon.0) 442 : audit [DBG] from='client.? 172.21.15.50:0/1209122780' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-01-04T18:14:10.504 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:09.287614+0000 mgr.smithi050.emnywo (mgr.14162) 174 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:10.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:09.287614+0000 mgr.smithi050.emnywo (mgr.14162) 174 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:10.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.671+0000 7f38adafa700 1 -- 172.21.15.50:0/2406521140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38a80f9980 msgr2=0x7f38a80fbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:10.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.671+0000 7f38adafa700 1 --2- 172.21.15.50:0/2406521140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38a80f9980 0x7f38a80fbd70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f3890004660 tx=0x7f3890009b30).stop 2023-01-04T18:14:10.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.671+0000 7f38adafa700 1 -- 172.21.15.50:0/2406521140 shutdown_connections 2023-01-04T18:14:10.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.671+0000 7f38adafa700 1 --2- 172.21.15.50:0/2406521140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38a80f9980 0x7f38a80fbd70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:10.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.671+0000 7f38adafa700 1 --2- 172.21.15.50:0/2406521140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38a8060810 0x7f38a80f9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:10.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.671+0000 7f38adafa700 1 -- 172.21.15.50:0/2406521140 >> 172.21.15.50:0/2406521140 conn(0x7f38a80f0e20 msgr2=0x7f38a80f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:10.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.671+0000 7f38adafa700 1 -- 172.21.15.50:0/2406521140 shutdown_connections 2023-01-04T18:14:10.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.671+0000 7f38adafa700 1 -- 172.21.15.50:0/2406521140 wait complete. 2023-01-04T18:14:10.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.672+0000 7f38adafa700 1 Processor -- start 2023-01-04T18:14:10.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.672+0000 7f38adafa700 1 -- start start 2023-01-04T18:14:10.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.672+0000 7f38adafa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38a8060810 0x7f38a80f6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:10.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.672+0000 7f38adafa700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38a80f9980 0x7f38a80f5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:10.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.672+0000 7f38adafa700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a80f5860 con 0x7f38a80f9980 2023-01-04T18:14:10.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.672+0000 7f38adafa700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a80f59a0 con 0x7f38a8060810 2023-01-04T18:14:10.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.672+0000 7f38a6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38a80f9980 0x7f38a80f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:10.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.672+0000 7f38a6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38a80f9980 0x7f38a80f5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52502/0 (socket says 172.21.15.50:52502) 2023-01-04T18:14:10.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.672+0000 7f38a77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38a8060810 0x7f38a80f6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:10.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.672+0000 7f38a6ffd700 1 -- 172.21.15.50:0/2200695792 learned_addr learned my addr 172.21.15.50:0/2200695792 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:10.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.672+0000 7f38a6ffd700 1 -- 172.21.15.50:0/2200695792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38a8060810 msgr2=0x7f38a80f6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:10.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.672+0000 7f38a6ffd700 1 --2- 172.21.15.50:0/2200695792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38a8060810 0x7f38a80f6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:10.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.672+0000 7f38a6ffd700 1 -- 172.21.15.50:0/2200695792 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3890005040 con 0x7f38a80f9980 2023-01-04T18:14:10.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.673+0000 7f38a6ffd700 1 --2- 172.21.15.50:0/2200695792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38a80f9980 0x7f38a80f5300 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f3890004e30 tx=0x7f3890009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:10.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.673+0000 7f389ffff700 1 -- 172.21.15.50:0/2200695792 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3890018070 con 0x7f38a80f9980 2023-01-04T18:14:10.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.673+0000 7f38adafa700 1 -- 172.21.15.50:0/2200695792 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a80f5c20 con 0x7f38a80f9980 2023-01-04T18:14:10.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.673+0000 7f389ffff700 1 -- 172.21.15.50:0/2200695792 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3890013410 con 0x7f38a80f9980 2023-01-04T18:14:10.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.673+0000 7f389ffff700 1 -- 172.21.15.50:0/2200695792 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f389001de20 con 0x7f38a80f9980 2023-01-04T18:14:10.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.673+0000 7f38adafa700 1 -- 172.21.15.50:0/2200695792 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a80f6180 con 0x7f38a80f9980 2023-01-04T18:14:10.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.674+0000 7f38adafa700 1 -- 172.21.15.50:0/2200695792 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a8045ad0 con 0x7f38a80f9980 2023-01-04T18:14:10.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.674+0000 7f389ffff700 1 -- 172.21.15.50:0/2200695792 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f389001d420 con 0x7f38a80f9980 2023-01-04T18:14:10.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.675+0000 7f389ffff700 1 --2- 172.21.15.50:0/2200695792 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f389405c2a0 0x7f389405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:10.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.675+0000 7f389ffff700 1 -- 172.21.15.50:0/2200695792 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f38900777b0 con 0x7f38a80f9980 2023-01-04T18:14:10.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.675+0000 7f38a77fe700 1 --2- 172.21.15.50:0/2200695792 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f389405c2a0 0x7f389405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:10.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.675+0000 7f38a77fe700 1 --2- 172.21.15.50:0/2200695792 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f389405c2a0 0x7f389405e760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f38a80f6c10 tx=0x7f389800b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:10.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.679+0000 7f389ffff700 1 -- 172.21.15.50:0/2200695792 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f389004a7b0 con 0x7f38a80f9980 2023-01-04T18:14:10.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.834+0000 7f38adafa700 1 -- 172.21.15.50:0/2200695792 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38a8057f10 con 0x7f389405c2a0 2023-01-04T18:14:10.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.835+0000 7f389ffff700 1 -- 172.21.15.50:0/2200695792 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27513 (secure 0 0 0) 0x7f38a8057f10 con 0x7f389405c2a0 2023-01-04T18:14:10.839 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:14:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.837+0000 7f38adafa700 1 -- 172.21.15.50:0/2200695792 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f389405c2a0 msgr2=0x7f389405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.837+0000 7f38adafa700 1 --2- 172.21.15.50:0/2200695792 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f389405c2a0 0x7f389405e760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f38a80f6c10 tx=0x7f389800b040).stop 2023-01-04T18:14:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.837+0000 7f38adafa700 1 -- 172.21.15.50:0/2200695792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38a80f9980 msgr2=0x7f38a80f5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.837+0000 7f38adafa700 1 --2- 172.21.15.50:0/2200695792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38a80f9980 0x7f38a80f5300 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f3890004e30 tx=0x7f3890009b30).stop 2023-01-04T18:14:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.837+0000 7f38adafa700 1 -- 172.21.15.50:0/2200695792 shutdown_connections 2023-01-04T18:14:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.837+0000 7f38adafa700 1 --2- 172.21.15.50:0/2200695792 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f389405c2a0 0x7f389405e760 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.837+0000 7f38adafa700 1 --2- 172.21.15.50:0/2200695792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38a8060810 0x7f38a80f6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.837+0000 7f38adafa700 1 --2- 172.21.15.50:0/2200695792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38a80f9980 0x7f38a80f5300 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.837+0000 7f38adafa700 1 -- 172.21.15.50:0/2200695792 >> 172.21.15.50:0/2200695792 conn(0x7f38a80f0e20 msgr2=0x7f38a80f3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.837+0000 7f38adafa700 1 -- 172.21.15.50:0/2200695792 shutdown_connections 2023-01-04T18:14:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:10.837+0000 7f38adafa700 1 -- 172.21.15.50:0/2200695792 wait complete. 2023-01-04T18:14:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-01-04T18:14:11.341 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2023-01-04T18:14:09.287477+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":31000,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":29056,"kb_avail":562439912,"statfs":{"total":575970213888,"available":575938469888,"internally_reserved":0,"allocated":1941504,"data_stored":736062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29753344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":"35","reported_epoch":"35","state":"active+clean","last_fresh":"2023-01-04T18:13:22.233210+0000","last_change":"2023-01-04T18:13:04.352787+0000","last_active":"2023-01-04T18:13:22.233210+0000","last_peered":"2023-01-04T18:13:22.233210+0000","last_clean":"2023-01-04T18:13:22.233210+0000","last_became_active":"2023-01-04T18:13:04.352425+0000","last_became_peered":"2023-01-04T18:13:04.352425+0000","last_unstale":"2023-01-04T18:13:22.233210+0000","last_undegraded":"2023-01-04T18:13:22.233210+0000","last_fullsized":"2023-01-04T18:13:22.233210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-04T18:12:40.669368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-04T18:12:40.669368+0000","last_clean_scrub_stamp":"2023-01-04T18:12:40.669368+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":35,"seq":150323855373,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5060,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93740092,"statfs":{"total":95995035648,"available":95989854208,"internally_reserved":0,"allocated":323584,"data_stored":122677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":4,"up_from":30,"seq":128849018896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5060,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93740092,"statfs":{"total":95995035648,"available":95989854208,"internally_reserved":0,"allocated":323584,"data_stored":122677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 4 18:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.38200000000000001}]},{"osd":1,"last update":"Wed Jan 4 18:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.628}]},{"osd":2,"last update":"Wed Jan 4 18:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.46000000000000002}]},{"osd":3,"last update":"Wed Jan 4 18:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.503},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":3,"up_from":25,"seq":107374182419,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5188,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739964,"statfs":{"total":95995035648,"available":95989723136,"internally_reserved":0,"allocated":323584,"data_stored":122677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 4 18:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.47899999999999998}]},{"osd":1,"last update":"Wed Jan 4 18:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.55100000000000005}]},{"osd":2,"last update":"Wed Jan 4 18:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.49099999999999999}]},{"osd":4,"last update":"Wed Jan 4 18:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]}]},{"osd":2,"up_from":17,"seq":73014444054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5188,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739964,"statfs":{"total":95995035648,"available":95989723136,"internally_reserved":0,"allocated":323584,"data_stored":122677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 4 18:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.58199999999999996}]},{"osd":1,"last update":"Wed Jan 4 18:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.54300000000000004}]},{"osd":3,"last update":"Wed Jan 4 18:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.84499999999999997}]},{"osd":4,"last update":"Wed Jan 4 18:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.85199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705693,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5252,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739900,"statfs":{"total":95995035648,"available":95989657600,"internally_reserved":0,"allocated":323584,"data_stored":122677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 4 18:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.17999999999999999},{"interface":"front","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"last":0.253}]},{"osd":2,"last update":"Wed Jan 4 18:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.23400000000000001}]},{"osd":3,"last update":"Wed Jan 4 18:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.501}]},{"osd":4,"last update":"Wed Jan 4 18:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":5.7480000000000002,"5min":5.7480000000000002,"15min":5.7480000000000002},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5252,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739900,"statfs":{"total":95995035648,"available":95989657600,"internally_reserved":0,"allocated":323584,"data_stored":122677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 4 18:13:17 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.222},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.30499999999999999}]},{"osd":2,"last update":"Wed Jan 4 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.27700000000000002}]},{"osd":3,"last update":"Wed Jan 4 18:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.441}]},{"osd":4,"last update":"Wed Jan 4 18:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":3.2730000000000001,"5min":3.2730000000000001,"15min":3.2730000000000001},"last":0.35999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-04T18:14:11.342 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph pg dump --format=json 2023-01-04T18:14:11.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:10.835759+0000 mgr.smithi050.emnywo (mgr.14162) 175 : audit [DBG] from='client.14390 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-01-04T18:14:11.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:10.835759+0000 mgr.smithi050.emnywo (mgr.14162) 175 : audit [DBG] from='client.14390 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-01-04T18:14:11.786 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050/config 2023-01-04T18:14:12.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:11.287996+0000 mgr.smithi050.emnywo (mgr.14162) 176 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:12.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:11.287996+0000 mgr.smithi050.emnywo (mgr.14162) 176 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:13.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.038+0000 7f28cee1e700 1 -- 172.21.15.50:0/1606468975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c80f7a70 msgr2=0x7f28c80f7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:13.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.038+0000 7f28cee1e700 1 --2- 172.21.15.50:0/1606468975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c80f7a70 0x7f28c80f7ed0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f28b4004660 tx=0x7f28b4009b30).stop 2023-01-04T18:14:13.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.038+0000 7f28cee1e700 1 -- 172.21.15.50:0/1606468975 shutdown_connections 2023-01-04T18:14:13.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.038+0000 7f28cee1e700 1 --2- 172.21.15.50:0/1606468975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c80f7a70 0x7f28c80f7ed0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:13.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.038+0000 7f28cee1e700 1 --2- 172.21.15.50:0/1606468975 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28c80f67d0 0x7f28c80f6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:13.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.038+0000 7f28cee1e700 1 -- 172.21.15.50:0/1606468975 >> 172.21.15.50:0/1606468975 conn(0x7f28c80f1f50 msgr2=0x7f28c80f4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:13.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.038+0000 7f28cee1e700 1 -- 172.21.15.50:0/1606468975 shutdown_connections 2023-01-04T18:14:13.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.038+0000 7f28cee1e700 1 -- 172.21.15.50:0/1606468975 wait complete. 2023-01-04T18:14:13.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.038+0000 7f28cee1e700 1 Processor -- start 2023-01-04T18:14:13.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.038+0000 7f28cee1e700 1 -- start start 2023-01-04T18:14:13.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.039+0000 7f28cee1e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c80f67d0 0x7f28c81070c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:13.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.039+0000 7f28cee1e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28c80f7a70 0x7f28c81075b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:13.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.039+0000 7f28cee1e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c8107b60 con 0x7f28c80f67d0 2023-01-04T18:14:13.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.039+0000 7f28cee1e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c8107ca0 con 0x7f28c80f7a70 2023-01-04T18:14:13.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.039+0000 7f28ccbba700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c80f67d0 0x7f28c81070c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:13.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.039+0000 7f28ccbba700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c80f67d0 0x7f28c81070c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52518/0 (socket says 172.21.15.50:52518) 2023-01-04T18:14:13.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.039+0000 7f28ccbba700 1 -- 172.21.15.50:0/4069796251 learned_addr learned my addr 172.21.15.50:0/4069796251 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:13.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.039+0000 7f28c7fff700 1 --2- 172.21.15.50:0/4069796251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28c80f7a70 0x7f28c81075b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:13.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.039+0000 7f28ccbba700 1 -- 172.21.15.50:0/4069796251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28c80f7a70 msgr2=0x7f28c81075b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:13.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.039+0000 7f28ccbba700 1 --2- 172.21.15.50:0/4069796251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28c80f7a70 0x7f28c81075b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:13.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.039+0000 7f28ccbba700 1 -- 172.21.15.50:0/4069796251 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b4005040 con 0x7f28c80f67d0 2023-01-04T18:14:13.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.039+0000 7f28ccbba700 1 --2- 172.21.15.50:0/4069796251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c80f67d0 0x7f28c81070c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f28bc002700 tx=0x7f28bc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:13.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.039+0000 7f28c57fa700 1 -- 172.21.15.50:0/4069796251 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28bc0079c0 con 0x7f28c80f67d0 2023-01-04T18:14:13.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.039+0000 7f28c57fa700 1 -- 172.21.15.50:0/4069796251 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f28bc00f040 con 0x7f28c80f67d0 2023-01-04T18:14:13.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.039+0000 7f28cee1e700 1 -- 172.21.15.50:0/4069796251 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c8108640 con 0x7f28c80f67d0 2023-01-04T18:14:13.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.039+0000 7f28c57fa700 1 -- 172.21.15.50:0/4069796251 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28bc014860 con 0x7f28c80f67d0 2023-01-04T18:14:13.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.039+0000 7f28cee1e700 1 -- 172.21.15.50:0/4069796251 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c8108c00 con 0x7f28c80f67d0 2023-01-04T18:14:13.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.040+0000 7f28cee1e700 1 -- 172.21.15.50:0/4069796251 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c8045ad0 con 0x7f28c80f67d0 2023-01-04T18:14:13.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.041+0000 7f28c57fa700 1 -- 172.21.15.50:0/4069796251 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f28bc01b060 con 0x7f28c80f67d0 2023-01-04T18:14:13.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.041+0000 7f28c57fa700 1 --2- 172.21.15.50:0/4069796251 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f28b805c2a0 0x7f28b805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:13.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.041+0000 7f28c57fa700 1 -- 172.21.15.50:0/4069796251 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f28bc0759d0 con 0x7f28c80f67d0 2023-01-04T18:14:13.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.041+0000 7f28c7fff700 1 --2- 172.21.15.50:0/4069796251 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f28b805c2a0 0x7f28b805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:13.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.042+0000 7f28c7fff700 1 --2- 172.21.15.50:0/4069796251 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f28b805c2a0 0x7f28b805e760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f28b4009f50 tx=0x7f28b4009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:13.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.045+0000 7f28c57fa700 1 -- 172.21.15.50:0/4069796251 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f28bc0489d0 con 0x7f28c80f67d0 2023-01-04T18:14:13.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.197+0000 7f28cee1e700 1 -- 172.21.15.50:0/4069796251 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28c8108e80 con 0x7f28b805c2a0 2023-01-04T18:14:13.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.199+0000 7f28c57fa700 1 -- 172.21.15.50:0/4069796251 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27498 (secure 0 0 0) 0x7f28c8108e80 con 0x7f28b805c2a0 2023-01-04T18:14:13.202 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:14:13.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.200+0000 7f28cee1e700 1 -- 172.21.15.50:0/4069796251 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f28b805c2a0 msgr2=0x7f28b805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:13.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.200+0000 7f28cee1e700 1 --2- 172.21.15.50:0/4069796251 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f28b805c2a0 0x7f28b805e760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f28b4009f50 tx=0x7f28b4009b30).stop 2023-01-04T18:14:13.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.200+0000 7f28cee1e700 1 -- 172.21.15.50:0/4069796251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c80f67d0 msgr2=0x7f28c81070c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:13.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.200+0000 7f28cee1e700 1 --2- 172.21.15.50:0/4069796251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c80f67d0 0x7f28c81070c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f28bc002700 tx=0x7f28bc009d80).stop 2023-01-04T18:14:13.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.200+0000 7f28cee1e700 1 -- 172.21.15.50:0/4069796251 shutdown_connections 2023-01-04T18:14:13.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.200+0000 7f28cee1e700 1 --2- 172.21.15.50:0/4069796251 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f28b805c2a0 0x7f28b805e760 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:13.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.200+0000 7f28cee1e700 1 --2- 172.21.15.50:0/4069796251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c80f67d0 0x7f28c81070c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:13.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.200+0000 7f28cee1e700 1 --2- 172.21.15.50:0/4069796251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28c80f7a70 0x7f28c81075b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:13.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.200+0000 7f28cee1e700 1 -- 172.21.15.50:0/4069796251 >> 172.21.15.50:0/4069796251 conn(0x7f28c80f1f50 msgr2=0x7f28c80fb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:13.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.200+0000 7f28cee1e700 1 -- 172.21.15.50:0/4069796251 shutdown_connections 2023-01-04T18:14:13.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:13.201+0000 7f28cee1e700 1 -- 172.21.15.50:0/4069796251 wait complete. 2023-01-04T18:14:13.205 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-01-04T18:14:13.599 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2023-01-04T18:14:11.287798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":31000,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":29056,"kb_avail":562439912,"statfs":{"total":575970213888,"available":575938469888,"internally_reserved":0,"allocated":1941504,"data_stored":736062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29753344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":"35","reported_epoch":"35","state":"active+clean","last_fresh":"2023-01-04T18:13:22.233210+0000","last_change":"2023-01-04T18:13:04.352787+0000","last_active":"2023-01-04T18:13:22.233210+0000","last_peered":"2023-01-04T18:13:22.233210+0000","last_clean":"2023-01-04T18:13:22.233210+0000","last_became_active":"2023-01-04T18:13:04.352425+0000","last_became_peered":"2023-01-04T18:13:04.352425+0000","last_unstale":"2023-01-04T18:13:22.233210+0000","last_undegraded":"2023-01-04T18:13:22.233210+0000","last_fullsized":"2023-01-04T18:13:22.233210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-04T18:12:40.669368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-04T18:12:40.669368+0000","last_clean_scrub_stamp":"2023-01-04T18:12:40.669368+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":35,"seq":150323855373,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5060,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93740092,"statfs":{"total":95995035648,"available":95989854208,"internally_reserved":0,"allocated":323584,"data_stored":122677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":4,"up_from":30,"seq":128849018896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5060,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93740092,"statfs":{"total":95995035648,"available":95989854208,"internally_reserved":0,"allocated":323584,"data_stored":122677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 4 18:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.38200000000000001}]},{"osd":1,"last update":"Wed Jan 4 18:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.628}]},{"osd":2,"last update":"Wed Jan 4 18:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.46000000000000002}]},{"osd":3,"last update":"Wed Jan 4 18:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.503},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":3,"up_from":25,"seq":107374182419,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5188,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739964,"statfs":{"total":95995035648,"available":95989723136,"internally_reserved":0,"allocated":323584,"data_stored":122677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 4 18:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.47899999999999998}]},{"osd":1,"last update":"Wed Jan 4 18:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.55100000000000005}]},{"osd":2,"last update":"Wed Jan 4 18:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.49099999999999999}]},{"osd":4,"last update":"Wed Jan 4 18:14:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]}]},{"osd":2,"up_from":17,"seq":73014444055,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5188,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739964,"statfs":{"total":95995035648,"available":95989723136,"internally_reserved":0,"allocated":323584,"data_stored":122677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 4 18:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.31}]},{"osd":1,"last update":"Wed Jan 4 18:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.35099999999999998}]},{"osd":3,"last update":"Wed Jan 4 18:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.54300000000000004}]},{"osd":4,"last update":"Wed Jan 4 18:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.505},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5252,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739900,"statfs":{"total":95995035648,"available":95989657600,"internally_reserved":0,"allocated":323584,"data_stored":122677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 4 18:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.379},{"interface":"front","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"last":0.28599999999999998}]},{"osd":2,"last update":"Wed Jan 4 18:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.33200000000000002}]},{"osd":3,"last update":"Wed Jan 4 18:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.44500000000000001}]},{"osd":4,"last update":"Wed Jan 4 18:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":5.7480000000000002,"5min":5.7480000000000002,"15min":5.7480000000000002},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5252,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739900,"statfs":{"total":95995035648,"available":95989657600,"internally_reserved":0,"allocated":323584,"data_stored":122677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 4 18:13:17 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.222},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.30499999999999999}]},{"osd":2,"last update":"Wed Jan 4 18:13:34 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.27700000000000002}]},{"osd":3,"last update":"Wed Jan 4 18:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.441}]},{"osd":4,"last update":"Wed Jan 4 18:14:05 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":3.2730000000000001,"5min":3.2730000000000001,"15min":3.2730000000000001},"last":0.35999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-04T18:14:13.600 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-01-04T18:14:13.600 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-01-04T18:14:13.600 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-01-04T18:14:13.601 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- ceph health --format=json 2023-01-04T18:14:14.047 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/mon.smithi050/config 2023-01-04T18:14:14.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:13.199281+0000 mgr.smithi050.emnywo (mgr.14162) 177 : audit [DBG] from='client.14394 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-01-04T18:14:14.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:13.288349+0000 mgr.smithi050.emnywo (mgr.14162) 178 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:14.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:13.408599+0000 mon.smithi050 (mon.0) 443 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:14:14.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:13.408778+0000 mon.smithi050 (mon.0) 444 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:14:14.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:13.199281+0000 mgr.smithi050.emnywo (mgr.14162) 177 : audit [DBG] from='client.14394 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-01-04T18:14:14.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:13.288349+0000 mgr.smithi050.emnywo (mgr.14162) 178 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:14.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:13.408599+0000 mon.smithi050 (mon.0) 443 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:14:14.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:13.408778+0000 mon.smithi050 (mon.0) 444 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:14:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.307+0000 7f015aeaa700 1 -- 172.21.15.50:0/1272049656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01540f56c0 msgr2=0x7f01540f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.307+0000 7f015aeaa700 1 --2- 172.21.15.50:0/1272049656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01540f56c0 0x7f01540f5ae0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f0148004660 tx=0x7f0148009b30).stop 2023-01-04T18:14:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.307+0000 7f015aeaa700 1 -- 172.21.15.50:0/1272049656 shutdown_connections 2023-01-04T18:14:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.307+0000 7f015aeaa700 1 --2- 172.21.15.50:0/1272049656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01540f6960 0x7f01540f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.307+0000 7f015aeaa700 1 --2- 172.21.15.50:0/1272049656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01540f56c0 0x7f01540f5ae0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.307+0000 7f015aeaa700 1 -- 172.21.15.50:0/1272049656 >> 172.21.15.50:0/1272049656 conn(0x7f01540f0e20 msgr2=0x7f01540f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.307+0000 7f015aeaa700 1 -- 172.21.15.50:0/1272049656 shutdown_connections 2023-01-04T18:14:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.307+0000 7f015aeaa700 1 -- 172.21.15.50:0/1272049656 wait complete. 2023-01-04T18:14:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.308+0000 7f015aeaa700 1 Processor -- start 2023-01-04T18:14:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.308+0000 7f015aeaa700 1 -- start start 2023-01-04T18:14:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.308+0000 7f015aeaa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01540f56c0 0x7f0154107050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.308+0000 7f015aeaa700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01540f6960 0x7f0154107540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.308+0000 7f015aeaa700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0154107af0 con 0x7f01540f6960 2023-01-04T18:14:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.308+0000 7f015aeaa700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0154107c30 con 0x7f01540f56c0 2023-01-04T18:14:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.308+0000 7f0153fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01540f6960 0x7f0154107540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.308+0000 7f0153fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01540f6960 0x7f0154107540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52534/0 (socket says 172.21.15.50:52534) 2023-01-04T18:14:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.308+0000 7f0153fff700 1 -- 172.21.15.50:0/1166033773 learned_addr learned my addr 172.21.15.50:0/1166033773 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.308+0000 7f0158c46700 1 --2- 172.21.15.50:0/1166033773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01540f56c0 0x7f0154107050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.309+0000 7f0153fff700 1 -- 172.21.15.50:0/1166033773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01540f56c0 msgr2=0x7f0154107050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.309+0000 7f0153fff700 1 --2- 172.21.15.50:0/1166033773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01540f56c0 0x7f0154107050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.309+0000 7f0153fff700 1 -- 172.21.15.50:0/1166033773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0148005040 con 0x7f01540f6960 2023-01-04T18:14:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.309+0000 7f0153fff700 1 --2- 172.21.15.50:0/1166033773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01540f6960 0x7f0154107540 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f014000e7f0 tx=0x7f014000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.309+0000 7f01517fa700 1 -- 172.21.15.50:0/1166033773 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01400092e0 con 0x7f01540f6960 2023-01-04T18:14:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.309+0000 7f01517fa700 1 -- 172.21.15.50:0/1166033773 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f014000f040 con 0x7f01540f6960 2023-01-04T18:14:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.309+0000 7f01517fa700 1 -- 172.21.15.50:0/1166033773 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01400146c0 con 0x7f01540f6960 2023-01-04T18:14:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.309+0000 7f015aeaa700 1 -- 172.21.15.50:0/1166033773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01541085d0 con 0x7f01540f6960 2023-01-04T18:14:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.309+0000 7f015aeaa700 1 -- 172.21.15.50:0/1166033773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0154108b90 con 0x7f01540f6960 2023-01-04T18:14:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.310+0000 7f015aeaa700 1 -- 172.21.15.50:0/1166033773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0154045ad0 con 0x7f01540f6960 2023-01-04T18:14:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.310+0000 7f01517fa700 1 -- 172.21.15.50:0/1166033773 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f014001b030 con 0x7f01540f6960 2023-01-04T18:14:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.311+0000 7f01517fa700 1 --2- 172.21.15.50:0/1166033773 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f014405c2a0 0x7f014405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.311+0000 7f01517fa700 1 -- 172.21.15.50:0/1166033773 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f0140075800 con 0x7f01540f6960 2023-01-04T18:14:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.311+0000 7f0158c46700 1 --2- 172.21.15.50:0/1166033773 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f014405c2a0 0x7f014405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.311+0000 7f0158c46700 1 --2- 172.21.15.50:0/1166033773 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f014405c2a0 0x7f014405e760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f0148005010 tx=0x7f014800b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:15.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.315+0000 7f01517fa700 1 -- 172.21.15.50:0/1166033773 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0140048850 con 0x7f01540f6960 2023-01-04T18:14:15.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.534+0000 7f015aeaa700 1 -- 172.21.15.50:0/1166033773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0154109220 con 0x7f01540f6960 2023-01-04T18:14:15.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.534+0000 7f01517fa700 1 -- 172.21.15.50:0/1166033773 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f0140019080 con 0x7f01540f6960 2023-01-04T18:14:15.538 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:14:15.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.536+0000 7f015aeaa700 1 -- 172.21.15.50:0/1166033773 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f014405c2a0 msgr2=0x7f014405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:15.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.536+0000 7f015aeaa700 1 --2- 172.21.15.50:0/1166033773 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f014405c2a0 0x7f014405e760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f0148005010 tx=0x7f014800b040).stop 2023-01-04T18:14:15.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.536+0000 7f015aeaa700 1 -- 172.21.15.50:0/1166033773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01540f6960 msgr2=0x7f0154107540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:15.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.536+0000 7f015aeaa700 1 --2- 172.21.15.50:0/1166033773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01540f6960 0x7f0154107540 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f014000e7f0 tx=0x7f014000b040).stop 2023-01-04T18:14:15.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.536+0000 7f015aeaa700 1 -- 172.21.15.50:0/1166033773 shutdown_connections 2023-01-04T18:14:15.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.536+0000 7f015aeaa700 1 --2- 172.21.15.50:0/1166033773 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f014405c2a0 0x7f014405e760 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:15.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.536+0000 7f015aeaa700 1 --2- 172.21.15.50:0/1166033773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01540f56c0 0x7f0154107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:15.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.536+0000 7f015aeaa700 1 --2- 172.21.15.50:0/1166033773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01540f6960 0x7f0154107540 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:15.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.536+0000 7f015aeaa700 1 -- 172.21.15.50:0/1166033773 >> 172.21.15.50:0/1166033773 conn(0x7f01540f0e20 msgr2=0x7f01540603a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:15.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.536+0000 7f015aeaa700 1 -- 172.21.15.50:0/1166033773 shutdown_connections 2023-01-04T18:14:15.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:15.536+0000 7f015aeaa700 1 -- 172.21.15.50:0/1166033773 wait complete. 2023-01-04T18:14:15.960 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-01-04T18:14:15.960 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-01-04T18:14:15.960 INFO:tasks.cephadm:Setup complete, yielding 2023-01-04T18:14:15.960 INFO:teuthology.run_tasks:Running task print... 2023-01-04T18:14:15.970 INFO:teuthology.task.print:**** done starting v16.2.4 2023-01-04T18:14:15.970 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-01-04T18:14:15.982 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi050.front.sepia.ceph.com 2023-01-04T18:14:15.983 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- bash -c 'ceph orch status' 2023-01-04T18:14:16.525 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:15.288621+0000 mgr.smithi050.emnywo (mgr.14162) 179 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:16.525 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:15.536123+0000 mon.smithi050 (mon.0) 445 : audit [DBG] from='client.? 172.21.15.50:0/1166033773' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-01-04T18:14:16.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:15.288621+0000 mgr.smithi050.emnywo (mgr.14162) 179 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:16.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:15.536123+0000 mon.smithi050 (mon.0) 445 : audit [DBG] from='client.? 172.21.15.50:0/1166033773' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-01-04T18:14:17.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.549+0000 7f1e01dec700 1 -- 172.21.15.50:0/3993711143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dfc0f66e0 msgr2=0x7f1dfc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:17.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.549+0000 7f1e01dec700 1 --2- 172.21.15.50:0/3993711143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dfc0f66e0 0x7f1dfc0f6b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f1dec004660 tx=0x7f1dec009b30).stop 2023-01-04T18:14:17.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.549+0000 7f1e01dec700 1 -- 172.21.15.50:0/3993711143 shutdown_connections 2023-01-04T18:14:17.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.549+0000 7f1e01dec700 1 --2- 172.21.15.50:0/3993711143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dfc0f7980 0x7f1dfc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:17.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.549+0000 7f1e01dec700 1 --2- 172.21.15.50:0/3993711143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dfc0f66e0 0x7f1dfc0f6b00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:17.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.549+0000 7f1e01dec700 1 -- 172.21.15.50:0/3993711143 >> 172.21.15.50:0/3993711143 conn(0x7f1dfc0f1e40 msgr2=0x7f1dfc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:17.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.549+0000 7f1e01dec700 1 -- 172.21.15.50:0/3993711143 shutdown_connections 2023-01-04T18:14:17.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.549+0000 7f1e01dec700 1 -- 172.21.15.50:0/3993711143 wait complete. 2023-01-04T18:14:17.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.550+0000 7f1e01dec700 1 Processor -- start 2023-01-04T18:14:17.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.550+0000 7f1e01dec700 1 -- start start 2023-01-04T18:14:17.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.550+0000 7f1e01dec700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dfc0f66e0 0x7f1dfc106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:17.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.550+0000 7f1e01dec700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dfc0f7980 0x7f1dfc1074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:17.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.550+0000 7f1e01dec700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc107a70 con 0x7f1dfc0f7980 2023-01-04T18:14:17.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.550+0000 7f1e01dec700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc107bb0 con 0x7f1dfc0f66e0 2023-01-04T18:14:17.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.550+0000 7f1dfaffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dfc0f7980 0x7f1dfc1074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:17.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.550+0000 7f1dfaffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dfc0f7980 0x7f1dfc1074c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51180/0 (socket says 172.21.15.50:51180) 2023-01-04T18:14:17.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.550+0000 7f1dfaffd700 1 -- 172.21.15.50:0/3636964258 learned_addr learned my addr 172.21.15.50:0/3636964258 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:17.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.550+0000 7f1dfb7fe700 1 --2- 172.21.15.50:0/3636964258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dfc0f66e0 0x7f1dfc106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:17.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.551+0000 7f1dfaffd700 1 -- 172.21.15.50:0/3636964258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dfc0f66e0 msgr2=0x7f1dfc106fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:17.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.551+0000 7f1dfaffd700 1 --2- 172.21.15.50:0/3636964258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dfc0f66e0 0x7f1dfc106fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:17.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.551+0000 7f1dfaffd700 1 -- 172.21.15.50:0/3636964258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec005040 con 0x7f1dfc0f7980 2023-01-04T18:14:17.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.551+0000 7f1dfaffd700 1 --2- 172.21.15.50:0/3636964258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dfc0f7980 0x7f1dfc1074c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f1de400c790 tx=0x7f1de4007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:17.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.551+0000 7f1df3fff700 1 -- 172.21.15.50:0/3636964258 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1de4002590 con 0x7f1dfc0f7980 2023-01-04T18:14:17.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.551+0000 7f1e01dec700 1 -- 172.21.15.50:0/3636964258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dfc108550 con 0x7f1dfc0f7980 2023-01-04T18:14:17.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.551+0000 7f1df3fff700 1 -- 172.21.15.50:0/3636964258 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1de4002ba0 con 0x7f1dfc0f7980 2023-01-04T18:14:17.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.551+0000 7f1df3fff700 1 -- 172.21.15.50:0/3636964258 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1de4013d90 con 0x7f1dfc0f7980 2023-01-04T18:14:17.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.551+0000 7f1e01dec700 1 -- 172.21.15.50:0/3636964258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dfc108b10 con 0x7f1dfc0f7980 2023-01-04T18:14:17.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.552+0000 7f1e01dec700 1 -- 172.21.15.50:0/3636964258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dfc045ad0 con 0x7f1dfc0f7980 2023-01-04T18:14:17.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.552+0000 7f1df3fff700 1 -- 172.21.15.50:0/3636964258 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f1de401a060 con 0x7f1dfc0f7980 2023-01-04T18:14:17.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.553+0000 7f1df3fff700 1 --2- 172.21.15.50:0/3636964258 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f1de805c2b0 0x7f1de805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:17.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.553+0000 7f1df3fff700 1 -- 172.21.15.50:0/3636964258 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f1de4075e20 con 0x7f1dfc0f7980 2023-01-04T18:14:17.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.553+0000 7f1dfb7fe700 1 --2- 172.21.15.50:0/3636964258 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f1de805c2b0 0x7f1de805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:17.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.553+0000 7f1dfb7fe700 1 --2- 172.21.15.50:0/3636964258 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f1de805c2b0 0x7f1de805e770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f1dec004630 tx=0x7f1dec009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:17.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.557+0000 7f1df3fff700 1 -- 172.21.15.50:0/3636964258 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f1de404c7f0 con 0x7f1dfc0f7980 2023-01-04T18:14:17.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.748+0000 7f1e01dec700 1 -- 172.21.15.50:0/3636964258 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1dfc0fefe0 con 0x7f1de805c2b0 2023-01-04T18:14:17.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.749+0000 7f1df3fff700 1 -- 172.21.15.50:0/3636964258 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f1dfc0fefe0 con 0x7f1de805c2b0 2023-01-04T18:14:17.752 INFO:teuthology.orchestra.run.smithi050.stdout:Backend: cephadm 2023-01-04T18:14:17.752 INFO:teuthology.orchestra.run.smithi050.stdout:Available: Yes 2023-01-04T18:14:17.752 INFO:teuthology.orchestra.run.smithi050.stdout:Paused: No 2023-01-04T18:14:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.750+0000 7f1e01dec700 1 -- 172.21.15.50:0/3636964258 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f1de805c2b0 msgr2=0x7f1de805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.750+0000 7f1e01dec700 1 --2- 172.21.15.50:0/3636964258 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f1de805c2b0 0x7f1de805e770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f1dec004630 tx=0x7f1dec009b30).stop 2023-01-04T18:14:17.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.750+0000 7f1e01dec700 1 -- 172.21.15.50:0/3636964258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dfc0f7980 msgr2=0x7f1dfc1074c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.750+0000 7f1e01dec700 1 --2- 172.21.15.50:0/3636964258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dfc0f7980 0x7f1dfc1074c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f1de400c790 tx=0x7f1de4007d70).stop 2023-01-04T18:14:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.751+0000 7f1e01dec700 1 -- 172.21.15.50:0/3636964258 shutdown_connections 2023-01-04T18:14:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.751+0000 7f1e01dec700 1 --2- 172.21.15.50:0/3636964258 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f1de805c2b0 0x7f1de805e770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.751+0000 7f1e01dec700 1 --2- 172.21.15.50:0/3636964258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dfc0f66e0 0x7f1dfc106fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.751+0000 7f1e01dec700 1 --2- 172.21.15.50:0/3636964258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dfc0f7980 0x7f1dfc1074c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.751+0000 7f1e01dec700 1 -- 172.21.15.50:0/3636964258 >> 172.21.15.50:0/3636964258 conn(0x7f1dfc0f1e40 msgr2=0x7f1dfc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.751+0000 7f1e01dec700 1 -- 172.21.15.50:0/3636964258 shutdown_connections 2023-01-04T18:14:17.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:17.751+0000 7f1e01dec700 1 -- 172.21.15.50:0/3636964258 wait complete. 2023-01-04T18:14:18.299 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- bash -c 'ceph orch ps' 2023-01-04T18:14:18.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:17.289103+0000 mgr.smithi050.emnywo (mgr.14162) 180 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:18.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:17.750439+0000 mgr.smithi050.emnywo (mgr.14162) 181 : audit [DBG] from='client.14402 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:14:18.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:17.289103+0000 mgr.smithi050.emnywo (mgr.14162) 180 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:18.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:17.750439+0000 mgr.smithi050.emnywo (mgr.14162) 181 : audit [DBG] from='client.14402 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:14:19.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.865+0000 7f7e58d59700 1 -- 172.21.15.50:0/3073561746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e540f6530 msgr2=0x7f7e540f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:19.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.865+0000 7f7e58d59700 1 --2- 172.21.15.50:0/3073561746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e540f6530 0x7f7e540f6950 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f7e44004660 tx=0x7f7e44009b30).stop 2023-01-04T18:14:19.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.865+0000 7f7e58d59700 1 -- 172.21.15.50:0/3073561746 shutdown_connections 2023-01-04T18:14:19.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.865+0000 7f7e58d59700 1 --2- 172.21.15.50:0/3073561746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e540f77d0 0x7f7e540f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:19.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.865+0000 7f7e58d59700 1 --2- 172.21.15.50:0/3073561746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e540f6530 0x7f7e540f6950 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:19.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.865+0000 7f7e58d59700 1 -- 172.21.15.50:0/3073561746 >> 172.21.15.50:0/3073561746 conn(0x7f7e540f1c90 msgr2=0x7f7e540f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:19.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.865+0000 7f7e58d59700 1 -- 172.21.15.50:0/3073561746 shutdown_connections 2023-01-04T18:14:19.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.865+0000 7f7e58d59700 1 -- 172.21.15.50:0/3073561746 wait complete. 2023-01-04T18:14:19.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.865+0000 7f7e58d59700 1 Processor -- start 2023-01-04T18:14:19.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.865+0000 7f7e58d59700 1 -- start start 2023-01-04T18:14:19.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.865+0000 7f7e58d59700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e540f6530 0x7f7e5406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:19.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.866+0000 7f7e58d59700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e540f77d0 0x7f7e54069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:19.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.866+0000 7f7e58d59700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5406a380 con 0x7f7e540f77d0 2023-01-04T18:14:19.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.866+0000 7f7e58d59700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5406a4c0 con 0x7f7e540f6530 2023-01-04T18:14:19.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.866+0000 7f7e52ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e540f77d0 0x7f7e54069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:19.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.866+0000 7f7e52ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e540f77d0 0x7f7e54069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51198/0 (socket says 172.21.15.50:51198) 2023-01-04T18:14:19.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.866+0000 7f7e52ffd700 1 -- 172.21.15.50:0/2278480877 learned_addr learned my addr 172.21.15.50:0/2278480877 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:19.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.866+0000 7f7e537fe700 1 --2- 172.21.15.50:0/2278480877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e540f6530 0x7f7e5406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:19.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.866+0000 7f7e52ffd700 1 -- 172.21.15.50:0/2278480877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e540f6530 msgr2=0x7f7e5406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:19.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.866+0000 7f7e52ffd700 1 --2- 172.21.15.50:0/2278480877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e540f6530 0x7f7e5406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:19.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.866+0000 7f7e52ffd700 1 -- 172.21.15.50:0/2278480877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e44005040 con 0x7f7e540f77d0 2023-01-04T18:14:19.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.866+0000 7f7e537fe700 1 --2- 172.21.15.50:0/2278480877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e540f6530 0x7f7e5406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:14:19.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.866+0000 7f7e52ffd700 1 --2- 172.21.15.50:0/2278480877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e540f77d0 0x7f7e54069e20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f7e4800c530 tx=0x7f7e48007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:19.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.866+0000 7f7e3bfff700 1 -- 172.21.15.50:0/2278480877 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e4800f650 con 0x7f7e540f77d0 2023-01-04T18:14:19.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.866+0000 7f7e58d59700 1 -- 172.21.15.50:0/2278480877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5406a7a0 con 0x7f7e540f77d0 2023-01-04T18:14:19.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.866+0000 7f7e3bfff700 1 -- 172.21.15.50:0/2278480877 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7e4800fc60 con 0x7f7e540f77d0 2023-01-04T18:14:19.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.866+0000 7f7e3bfff700 1 -- 172.21.15.50:0/2278480877 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e48012c80 con 0x7f7e540f77d0 2023-01-04T18:14:19.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.866+0000 7f7e58d59700 1 -- 172.21.15.50:0/2278480877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5410ede0 con 0x7f7e540f77d0 2023-01-04T18:14:19.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.867+0000 7f7e58d59700 1 -- 172.21.15.50:0/2278480877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e54045ad0 con 0x7f7e540f77d0 2023-01-04T18:14:19.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.868+0000 7f7e3bfff700 1 -- 172.21.15.50:0/2278480877 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f7e48010070 con 0x7f7e540f77d0 2023-01-04T18:14:19.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.868+0000 7f7e3bfff700 1 --2- 172.21.15.50:0/2278480877 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7e3c05c300 0x7f7e3c05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:19.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.868+0000 7f7e3bfff700 1 -- 172.21.15.50:0/2278480877 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f7e480758c0 con 0x7f7e540f77d0 2023-01-04T18:14:19.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.868+0000 7f7e537fe700 1 --2- 172.21.15.50:0/2278480877 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7e3c05c300 0x7f7e3c05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:19.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.868+0000 7f7e537fe700 1 --2- 172.21.15.50:0/2278480877 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7e3c05c300 0x7f7e3c05e7c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f7e5406b730 tx=0x7f7e44009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:19.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:19.872+0000 7f7e3bfff700 1 -- 172.21.15.50:0/2278480877 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7e480452b0 con 0x7f7e540f77d0 2023-01-04T18:14:20.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:20.057+0000 7f7e58d59700 1 -- 172.21.15.50:0/2278480877 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e54057f10 con 0x7f7e3c05c300 2023-01-04T18:14:20.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:20.064+0000 7f7e3bfff700 1 -- 172.21.15.50:0/2278480877 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2160 (secure 0 0 0) 0x7f7e54057f10 con 0x7f7e3c05c300 2023-01-04T18:14:20.067 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2023-01-04T18:14:20.067 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager.smithi050 smithi050 *:9093,9094 running (2m) 52s ago 3m 0.20.0 0881eb8f169f b5d3e2678a23 2023-01-04T18:14:20.067 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi050 smithi050 running (3m) 52s ago 3m 16.2.4 8d91d370c2b8 cfe6f2d72ef5 2023-01-04T18:14:20.067 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi098 smithi098 running (3m) 61s ago 3m 16.2.4 8d91d370c2b8 2928008d526c 2023-01-04T18:14:20.068 INFO:teuthology.orchestra.run.smithi050.stdout:grafana.smithi050 smithi050 *:3000 running (2m) 52s ago 3m 6.7.4 557c83e11646 7e5dccbafe78 2023-01-04T18:14:20.068 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi050.emnywo smithi050 *:9283 running (4m) 52s ago 4m 16.2.4 8d91d370c2b8 51f88deda58e 2023-01-04T18:14:20.068 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi098.vhfzum smithi098 *:8443,9283 running (3m) 61s ago 3m 16.2.4 8d91d370c2b8 238015c4e3b1 2023-01-04T18:14:20.068 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi050 smithi050 running (5m) 52s ago 5m 16.2.4 8d91d370c2b8 7ef171ad1e93 2023-01-04T18:14:20.068 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi098 smithi098 running (3m) 61s ago 3m 16.2.4 8d91d370c2b8 e6b6833279a4 2023-01-04T18:14:20.068 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi050 smithi050 *:9100 running (3m) 52s ago 3m 0.18.1 e5a616e4b9cf 88892b2e5e5a 2023-01-04T18:14:20.068 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi098 smithi098 *:9100 running (2m) 61s ago 2m 0.18.1 e5a616e4b9cf 49bcde8331b6 2023-01-04T18:14:20.068 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (2m) 52s ago 2m 16.2.4 8d91d370c2b8 b46676195180 2023-01-04T18:14:20.068 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi050 running (2m) 52s ago 2m 16.2.4 8d91d370c2b8 e4928bcfd146 2023-01-04T18:14:20.068 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi050 running (117s) 52s ago 116s 16.2.4 8d91d370c2b8 babab394b338 2023-01-04T18:14:20.068 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi098 running (100s) 61s ago 100s 16.2.4 8d91d370c2b8 b02df8e3cb23 2023-01-04T18:14:20.068 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi098 running (82s) 61s ago 82s 16.2.4 8d91d370c2b8 92273135ca82 2023-01-04T18:14:20.069 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi098 running (64s) 61s ago 63s 16.2.4 8d91d370c2b8 366d0bfff809 2023-01-04T18:14:20.069 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus.smithi050 smithi050 *:9095 running (2m) 52s ago 3m 2.18.1 de242295e225 6ff859f5958f 2023-01-04T18:14:20.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:20.065+0000 7f7e58d59700 1 -- 172.21.15.50:0/2278480877 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7e3c05c300 msgr2=0x7f7e3c05e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:20.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:20.065+0000 7f7e58d59700 1 --2- 172.21.15.50:0/2278480877 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7e3c05c300 0x7f7e3c05e7c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f7e5406b730 tx=0x7f7e44009b30).stop 2023-01-04T18:14:20.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:20.065+0000 7f7e58d59700 1 -- 172.21.15.50:0/2278480877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e540f77d0 msgr2=0x7f7e54069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:20.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:20.065+0000 7f7e58d59700 1 --2- 172.21.15.50:0/2278480877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e540f77d0 0x7f7e54069e20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f7e4800c530 tx=0x7f7e48007e20).stop 2023-01-04T18:14:20.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:20.065+0000 7f7e58d59700 1 -- 172.21.15.50:0/2278480877 shutdown_connections 2023-01-04T18:14:20.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:20.065+0000 7f7e58d59700 1 --2- 172.21.15.50:0/2278480877 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7e3c05c300 0x7f7e3c05e7c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:20.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:20.065+0000 7f7e58d59700 1 --2- 172.21.15.50:0/2278480877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e540f6530 0x7f7e5406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:20.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:20.065+0000 7f7e58d59700 1 --2- 172.21.15.50:0/2278480877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e540f77d0 0x7f7e54069e20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:20.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:20.065+0000 7f7e58d59700 1 -- 172.21.15.50:0/2278480877 >> 172.21.15.50:0/2278480877 conn(0x7f7e540f1c90 msgr2=0x7f7e540fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:20.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:20.066+0000 7f7e58d59700 1 -- 172.21.15.50:0/2278480877 shutdown_connections 2023-01-04T18:14:20.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:20.066+0000 7f7e58d59700 1 -- 172.21.15.50:0/2278480877 wait complete. 2023-01-04T18:14:20.526 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- bash -c 'ceph orch ls' 2023-01-04T18:14:20.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:19.289407+0000 mgr.smithi050.emnywo (mgr.14162) 182 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:20.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:19.289407+0000 mgr.smithi050.emnywo (mgr.14162) 182 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:21.675 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:20.059359+0000 mgr.smithi050.emnywo (mgr.14162) 183 : audit [DBG] from='client.14406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:14:21.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:20.059359+0000 mgr.smithi050.emnywo (mgr.14162) 183 : audit [DBG] from='client.14406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:14:22.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.094+0000 7f7fea2a7700 1 -- 172.21.15.50:0/2234563156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fe40f55c0 msgr2=0x7f7fe40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:22.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.094+0000 7f7fea2a7700 1 --2- 172.21.15.50:0/2234563156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fe40f55c0 0x7f7fe40f59e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f7fd4004660 tx=0x7f7fd4009b30).stop 2023-01-04T18:14:22.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.094+0000 7f7fea2a7700 1 -- 172.21.15.50:0/2234563156 shutdown_connections 2023-01-04T18:14:22.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.094+0000 7f7fea2a7700 1 --2- 172.21.15.50:0/2234563156 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7fe40f6860 0x7f7fe40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:22.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.094+0000 7f7fea2a7700 1 --2- 172.21.15.50:0/2234563156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fe40f55c0 0x7f7fe40f59e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:22.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.094+0000 7f7fea2a7700 1 -- 172.21.15.50:0/2234563156 >> 172.21.15.50:0/2234563156 conn(0x7f7fe40f0d40 msgr2=0x7f7fe40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:22.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.094+0000 7f7fea2a7700 1 -- 172.21.15.50:0/2234563156 shutdown_connections 2023-01-04T18:14:22.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.094+0000 7f7fea2a7700 1 -- 172.21.15.50:0/2234563156 wait complete. 2023-01-04T18:14:22.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.095+0000 7f7fea2a7700 1 Processor -- start 2023-01-04T18:14:22.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.095+0000 7f7fea2a7700 1 -- start start 2023-01-04T18:14:22.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.095+0000 7f7fea2a7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7fe40f55c0 0x7f7fe4109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:22.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.095+0000 7f7fea2a7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fe40f6860 0x7f7fe410c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:22.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.095+0000 7f7fea2a7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe40603c0 con 0x7f7fe40f6860 2023-01-04T18:14:22.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.095+0000 7f7fea2a7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe4060500 con 0x7f7fe40f55c0 2023-01-04T18:14:22.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.095+0000 7f7fe37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fe40f6860 0x7f7fe410c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:22.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.095+0000 7f7fe37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fe40f6860 0x7f7fe410c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51220/0 (socket says 172.21.15.50:51220) 2023-01-04T18:14:22.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.095+0000 7f7fe37fe700 1 -- 172.21.15.50:0/2025763536 learned_addr learned my addr 172.21.15.50:0/2025763536 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:22.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.095+0000 7f7fe3fff700 1 --2- 172.21.15.50:0/2025763536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7fe40f55c0 0x7f7fe4109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:22.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.096+0000 7f7fe37fe700 1 -- 172.21.15.50:0/2025763536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7fe40f55c0 msgr2=0x7f7fe4109cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:22.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.096+0000 7f7fe37fe700 1 --2- 172.21.15.50:0/2025763536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7fe40f55c0 0x7f7fe4109cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:22.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.096+0000 7f7fe37fe700 1 -- 172.21.15.50:0/2025763536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd4005040 con 0x7f7fe40f6860 2023-01-04T18:14:22.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.096+0000 7f7fe37fe700 1 --2- 172.21.15.50:0/2025763536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fe40f6860 0x7f7fe410c1b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f7fd800c530 tx=0x7f7fd8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:22.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.096+0000 7f7fe0ff9700 1 -- 172.21.15.50:0/2025763536 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fd800f650 con 0x7f7fe40f6860 2023-01-04T18:14:22.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.096+0000 7f7fe0ff9700 1 -- 172.21.15.50:0/2025763536 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7fd800fc60 con 0x7f7fe40f6860 2023-01-04T18:14:22.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.096+0000 7f7fea2a7700 1 -- 172.21.15.50:0/2025763536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe410c760 con 0x7f7fe40f6860 2023-01-04T18:14:22.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.096+0000 7f7fe0ff9700 1 -- 172.21.15.50:0/2025763536 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fd8012c30 con 0x7f7fe40f6860 2023-01-04T18:14:22.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.096+0000 7f7fea2a7700 1 -- 172.21.15.50:0/2025763536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe410ccf0 con 0x7f7fe40f6860 2023-01-04T18:14:22.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.097+0000 7f7fea2a7700 1 -- 172.21.15.50:0/2025763536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe4045ad0 con 0x7f7fe40f6860 2023-01-04T18:14:22.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.097+0000 7f7fe0ff9700 1 -- 172.21.15.50:0/2025763536 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f7fd8010070 con 0x7f7fe40f6860 2023-01-04T18:14:22.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.098+0000 7f7fe0ff9700 1 --2- 172.21.15.50:0/2025763536 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7fcc05c2b0 0x7f7fcc05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:22.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.098+0000 7f7fe0ff9700 1 -- 172.21.15.50:0/2025763536 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f7fd8075810 con 0x7f7fe40f6860 2023-01-04T18:14:22.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.098+0000 7f7fe3fff700 1 --2- 172.21.15.50:0/2025763536 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7fcc05c2b0 0x7f7fcc05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:22.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.098+0000 7f7fe3fff700 1 --2- 172.21.15.50:0/2025763536 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7fcc05c2b0 0x7f7fcc05e770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f7fe4060040 tx=0x7f7fd4009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:22.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.102+0000 7f7fe0ff9700 1 -- 172.21.15.50:0/2025763536 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7fd80452b0 con 0x7f7fe40f6860 2023-01-04T18:14:22.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.284+0000 7f7fea2a7700 1 -- 172.21.15.50:0/2025763536 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fe4057f10 con 0x7f7fcc05c2b0 2023-01-04T18:14:22.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.288+0000 7f7fe0ff9700 1 -- 172.21.15.50:0/2025763536 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1107 (secure 0 0 0) 0x7f7fe4057f10 con 0x7f7fcc05c2b0 2023-01-04T18:14:22.292 INFO:teuthology.orchestra.run.smithi050.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-01-04T18:14:22.292 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager 1/1 54s ago 4m count:1 2023-01-04T18:14:22.292 INFO:teuthology.orchestra.run.smithi050.stdout:crash 2/2 63s ago 4m * 2023-01-04T18:14:22.292 INFO:teuthology.orchestra.run.smithi050.stdout:grafana 1/1 54s ago 4m count:1 2023-01-04T18:14:22.292 INFO:teuthology.orchestra.run.smithi050.stdout:mgr 2/2 63s ago 4m count:2 2023-01-04T18:14:22.292 INFO:teuthology.orchestra.run.smithi050.stdout:mon 2/2 63s ago 3m smithi050:172.21.15.50=smithi050;smithi098:172.21.15.98=smithi098;count:2 2023-01-04T18:14:22.292 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter 2/2 63s ago 4m * 2023-01-04T18:14:22.292 INFO:teuthology.orchestra.run.smithi050.stdout:osd.unmanaged 6/6 63s ago - 2023-01-04T18:14:22.292 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus 1/1 54s ago 4m count:1 2023-01-04T18:14:22.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.290+0000 7f7fea2a7700 1 -- 172.21.15.50:0/2025763536 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7fcc05c2b0 msgr2=0x7f7fcc05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.290+0000 7f7fea2a7700 1 --2- 172.21.15.50:0/2025763536 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7fcc05c2b0 0x7f7fcc05e770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f7fe4060040 tx=0x7f7fd4009b30).stop 2023-01-04T18:14:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.290+0000 7f7fea2a7700 1 -- 172.21.15.50:0/2025763536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fe40f6860 msgr2=0x7f7fe410c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.290+0000 7f7fea2a7700 1 --2- 172.21.15.50:0/2025763536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fe40f6860 0x7f7fe410c1b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f7fd800c530 tx=0x7f7fd8007e20).stop 2023-01-04T18:14:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.290+0000 7f7fea2a7700 1 -- 172.21.15.50:0/2025763536 shutdown_connections 2023-01-04T18:14:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.290+0000 7f7fea2a7700 1 --2- 172.21.15.50:0/2025763536 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7fcc05c2b0 0x7f7fcc05e770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.290+0000 7f7fea2a7700 1 --2- 172.21.15.50:0/2025763536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7fe40f55c0 0x7f7fe4109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.290+0000 7f7fea2a7700 1 --2- 172.21.15.50:0/2025763536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fe40f6860 0x7f7fe410c1b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.290+0000 7f7fea2a7700 1 -- 172.21.15.50:0/2025763536 >> 172.21.15.50:0/2025763536 conn(0x7f7fe40f0d40 msgr2=0x7f7fe40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.290+0000 7f7fea2a7700 1 -- 172.21.15.50:0/2025763536 shutdown_connections 2023-01-04T18:14:22.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:22.290+0000 7f7fea2a7700 1 -- 172.21.15.50:0/2025763536 wait complete. 2023-01-04T18:14:22.745 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:21.289762+0000 mgr.smithi050.emnywo (mgr.14162) 184 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:22.752 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- bash -c 'ceph orch host ls' 2023-01-04T18:14:22.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:21.289762+0000 mgr.smithi050.emnywo (mgr.14162) 184 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:23.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:23 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:22.286661+0000 mgr.smithi050.emnywo (mgr.14162) 185 : audit [DBG] from='client.14410 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:14:23.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:22.286661+0000 mgr.smithi050.emnywo (mgr.14162) 185 : audit [DBG] from='client.14410 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:14:24.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.213+0000 7fb216619700 1 -- 172.21.15.50:0/995131715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2100f7980 msgr2=0x7fb2100f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:24.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.213+0000 7fb216619700 1 --2- 172.21.15.50:0/995131715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2100f7980 0x7fb2100f7de0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fb1f8004660 tx=0x7fb1f8009b30).stop 2023-01-04T18:14:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.213+0000 7fb216619700 1 -- 172.21.15.50:0/995131715 shutdown_connections 2023-01-04T18:14:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.213+0000 7fb216619700 1 --2- 172.21.15.50:0/995131715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2100f7980 0x7fb2100f7de0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.213+0000 7fb216619700 1 --2- 172.21.15.50:0/995131715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2100f66e0 0x7fb2100f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.213+0000 7fb216619700 1 -- 172.21.15.50:0/995131715 >> 172.21.15.50:0/995131715 conn(0x7fb2100f1e40 msgr2=0x7fb2100f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.213+0000 7fb216619700 1 -- 172.21.15.50:0/995131715 shutdown_connections 2023-01-04T18:14:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.213+0000 7fb216619700 1 -- 172.21.15.50:0/995131715 wait complete. 2023-01-04T18:14:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.214+0000 7fb216619700 1 Processor -- start 2023-01-04T18:14:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.214+0000 7fb216619700 1 -- start start 2023-01-04T18:14:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.214+0000 7fb216619700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2100f66e0 0x7fb2101070d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.214+0000 7fb216619700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2101075c0 0x7fb2101084b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.214+0000 7fb216619700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb210107a90 con 0x7fb2100f66e0 2023-01-04T18:14:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.214+0000 7fb216619700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb210107bd0 con 0x7fb2101075c0 2023-01-04T18:14:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.214+0000 7fb20ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2100f66e0 0x7fb2101070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.214+0000 7fb20ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2100f66e0 0x7fb2101070d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51244/0 (socket says 172.21.15.50:51244) 2023-01-04T18:14:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.214+0000 7fb20ffff700 1 -- 172.21.15.50:0/727187540 learned_addr learned my addr 172.21.15.50:0/727187540 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.214+0000 7fb20f7fe700 1 --2- 172.21.15.50:0/727187540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2101075c0 0x7fb2101084b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.215+0000 7fb20ffff700 1 -- 172.21.15.50:0/727187540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2101075c0 msgr2=0x7fb2101084b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.215+0000 7fb20ffff700 1 --2- 172.21.15.50:0/727187540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2101075c0 0x7fb2101084b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.215+0000 7fb20ffff700 1 -- 172.21.15.50:0/727187540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f8005040 con 0x7fb2100f66e0 2023-01-04T18:14:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.215+0000 7fb20ffff700 1 --2- 172.21.15.50:0/727187540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2100f66e0 0x7fb2101070d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fb200002700 tx=0x7fb200009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.215+0000 7fb20cff9700 1 -- 172.21.15.50:0/727187540 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2000079c0 con 0x7fb2100f66e0 2023-01-04T18:14:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.215+0000 7fb20cff9700 1 -- 172.21.15.50:0/727187540 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb20000f040 con 0x7fb2100f66e0 2023-01-04T18:14:24.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.215+0000 7fb216619700 1 -- 172.21.15.50:0/727187540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb210108a60 con 0x7fb2100f66e0 2023-01-04T18:14:24.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.215+0000 7fb20cff9700 1 -- 172.21.15.50:0/727187540 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb200014850 con 0x7fb2100f66e0 2023-01-04T18:14:24.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.215+0000 7fb216619700 1 -- 172.21.15.50:0/727187540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb210109020 con 0x7fb2100f66e0 2023-01-04T18:14:24.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.216+0000 7fb216619700 1 -- 172.21.15.50:0/727187540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2101092a0 con 0x7fb2100f66e0 2023-01-04T18:14:24.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.216+0000 7fb20cff9700 1 -- 172.21.15.50:0/727187540 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fb20001b060 con 0x7fb2100f66e0 2023-01-04T18:14:24.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.216+0000 7fb20cff9700 1 --2- 172.21.15.50:0/727187540 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb1fc05c2b0 0x7fb1fc05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:24.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.217+0000 7fb20cff9700 1 -- 172.21.15.50:0/727187540 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fb200075aa0 con 0x7fb2100f66e0 2023-01-04T18:14:24.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.217+0000 7fb20f7fe700 1 --2- 172.21.15.50:0/727187540 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb1fc05c2b0 0x7fb1fc05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:24.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.217+0000 7fb20f7fe700 1 --2- 172.21.15.50:0/727187540 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb1fc05c2b0 0x7fb1fc05e770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb1f8009040 tx=0x7fb1f8009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:24.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.220+0000 7fb20cff9700 1 -- 172.21.15.50:0/727187540 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb200048aa0 con 0x7fb2100f66e0 2023-01-04T18:14:24.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.403+0000 7fb216619700 1 -- 172.21.15.50:0/727187540 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2100fee70 con 0x7fb1fc05c2b0 2023-01-04T18:14:24.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.404+0000 7fb20cff9700 1 -- 172.21.15.50:0/727187540 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+126 (secure 0 0 0) 0x7fb2100fee70 con 0x7fb1fc05c2b0 2023-01-04T18:14:24.407 INFO:teuthology.orchestra.run.smithi050.stdout:HOST ADDR LABELS STATUS 2023-01-04T18:14:24.407 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050 172.21.15.50 2023-01-04T18:14:24.407 INFO:teuthology.orchestra.run.smithi050.stdout:smithi098 smithi098 2023-01-04T18:14:24.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.406+0000 7fb216619700 1 -- 172.21.15.50:0/727187540 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb1fc05c2b0 msgr2=0x7fb1fc05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:24.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.406+0000 7fb216619700 1 --2- 172.21.15.50:0/727187540 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb1fc05c2b0 0x7fb1fc05e770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb1f8009040 tx=0x7fb1f8009b30).stop 2023-01-04T18:14:24.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.406+0000 7fb216619700 1 -- 172.21.15.50:0/727187540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2100f66e0 msgr2=0x7fb2101070d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:24.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.406+0000 7fb216619700 1 --2- 172.21.15.50:0/727187540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2100f66e0 0x7fb2101070d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fb200002700 tx=0x7fb200009e00).stop 2023-01-04T18:14:24.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.406+0000 7fb216619700 1 -- 172.21.15.50:0/727187540 shutdown_connections 2023-01-04T18:14:24.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.406+0000 7fb216619700 1 --2- 172.21.15.50:0/727187540 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb1fc05c2b0 0x7fb1fc05e770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:24.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.406+0000 7fb216619700 1 --2- 172.21.15.50:0/727187540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2100f66e0 0x7fb2101070d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:24.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.406+0000 7fb216619700 1 --2- 172.21.15.50:0/727187540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2101075c0 0x7fb2101084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:24.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.406+0000 7fb216619700 1 -- 172.21.15.50:0/727187540 >> 172.21.15.50:0/727187540 conn(0x7fb2100f1e40 msgr2=0x7fb2100fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:24.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.406+0000 7fb216619700 1 -- 172.21.15.50:0/727187540 shutdown_connections 2023-01-04T18:14:24.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:24.406+0000 7fb216619700 1 -- 172.21.15.50:0/727187540 wait complete. 2023-01-04T18:14:24.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:23.290124+0000 mgr.smithi050.emnywo (mgr.14162) 186 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:24.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:23.290124+0000 mgr.smithi050.emnywo (mgr.14162) 186 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:24.864 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- bash -c 'ceph orch device ls' 2023-01-04T18:14:25.731 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:24.405171+0000 mgr.smithi050.emnywo (mgr.14162) 187 : audit [DBG] from='client.14414 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:14:25.786 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:24.405171+0000 mgr.smithi050.emnywo (mgr.14162) 187 : audit [DBG] from='client.14414 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:14:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.412+0000 7f2165a95700 1 -- 172.21.15.50:0/1991341848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21600f55c0 msgr2=0x7f21600f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.412+0000 7f2165a95700 1 --2- 172.21.15.50:0/1991341848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21600f55c0 0x7f21600f59e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f21500099e0 tx=0x7f2150004d10).stop 2023-01-04T18:14:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.412+0000 7f2165a95700 1 -- 172.21.15.50:0/1991341848 shutdown_connections 2023-01-04T18:14:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.412+0000 7f2165a95700 1 --2- 172.21.15.50:0/1991341848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21600f6860 0x7f21600f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-01-04T18:14:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.412+0000 7f2165a95700 1 --2- 172.21.15.50:0/1991341848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21600f55c0 0x7f21600f59e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.412+0000 7f2165a95700 1 -- 172.21.15.50:0/1991341848 >> 172.21.15.50:0/1991341848 conn(0x7f21600f0d40 msgr2=0x7f21600f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.412+0000 7f2165a95700 1 -- 172.21.15.50:0/1991341848 shutdown_connections 2023-01-04T18:14:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.412+0000 7f2165a95700 1 -- 172.21.15.50:0/1991341848 wait complete. 2023-01-04T18:14:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.413+0000 7f2165a95700 1 Processor -- start 2023-01-04T18:14:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.413+0000 7f2165a95700 1 -- start start 2023-01-04T18:14:26.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.413+0000 7f2165a95700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21600f55c0 0x7f2160109e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:26.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.413+0000 7f2165a95700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21600f6860 0x7f216010c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:26.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.413+0000 7f2165a95700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2160060470 con 0x7f21600f6860 2023-01-04T18:14:26.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.413+0000 7f2165a95700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21600605b0 con 0x7f21600f55c0 2023-01-04T18:14:26.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.413+0000 7f215effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21600f6860 0x7f216010c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:26.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.414+0000 7f215effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21600f6860 0x7f216010c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51260/0 (socket says 172.21.15.50:51260) 2023-01-04T18:14:26.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.414+0000 7f215effd700 1 -- 172.21.15.50:0/744821077 learned_addr learned my addr 172.21.15.50:0/744821077 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.414+0000 7f215f7fe700 1 --2- 172.21.15.50:0/744821077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21600f55c0 0x7f2160109e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.414+0000 7f215effd700 1 -- 172.21.15.50:0/744821077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21600f55c0 msgr2=0x7f2160109e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.414+0000 7f215effd700 1 --2- 172.21.15.50:0/744821077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21600f55c0 0x7f2160109e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.414+0000 7f215effd700 1 -- 172.21.15.50:0/744821077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2150009640 con 0x7f21600f6860 2023-01-04T18:14:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.414+0000 7f215effd700 1 --2- 172.21.15.50:0/744821077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21600f6860 0x7f216010c350 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f214800b410 tx=0x7f2148006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.414+0000 7f2157fff700 1 -- 172.21.15.50:0/744821077 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21480125f0 con 0x7f21600f6860 2023-01-04T18:14:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.414+0000 7f2165a95700 1 -- 172.21.15.50:0/744821077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216010c9b0 con 0x7f21600f6860 2023-01-04T18:14:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.414+0000 7f2157fff700 1 -- 172.21.15.50:0/744821077 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2148012c00 con 0x7f21600f6860 2023-01-04T18:14:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.414+0000 7f2165a95700 1 -- 172.21.15.50:0/744821077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216010cec0 con 0x7f21600f6860 2023-01-04T18:14:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.414+0000 7f2157fff700 1 -- 172.21.15.50:0/744821077 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2148002aa0 con 0x7f21600f6860 2023-01-04T18:14:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.415+0000 7f2165a95700 1 -- 172.21.15.50:0/744821077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21600f49b0 con 0x7f21600f6860 2023-01-04T18:14:26.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.416+0000 7f2157fff700 1 -- 172.21.15.50:0/744821077 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f214800f030 con 0x7f21600f6860 2023-01-04T18:14:26.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.416+0000 7f2157fff700 1 --2- 172.21.15.50:0/744821077 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f214c05c2b0 0x7f214c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:26.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.416+0000 7f2157fff700 1 -- 172.21.15.50:0/744821077 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f2148076020 con 0x7f21600f6860 2023-01-04T18:14:26.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.416+0000 7f215f7fe700 1 --2- 172.21.15.50:0/744821077 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f214c05c2b0 0x7f214c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:26.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.416+0000 7f215f7fe700 1 --2- 172.21.15.50:0/744821077 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f214c05c2b0 0x7f214c05e770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f215000b620 tx=0x7f2150004d10).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:26.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.420+0000 7f2157fff700 1 -- 172.21.15.50:0/744821077 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2148048fc0 con 0x7f21600f6860 2023-01-04T18:14:26.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:25.290580+0000 mgr.smithi050.emnywo (mgr.14162) 188 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:26.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.606+0000 7f2165a95700 1 -- 172.21.15.50:0/744821077 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f21600fde40 con 0x7f214c05c2b0 2023-01-04T18:14:26.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.607+0000 7f2157fff700 1 -- 172.21.15.50:0/744821077 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+279 (secure 0 0 0) 0x7f21600fde40 con 0x7f214c05c2b0 2023-01-04T18:14:26.610 INFO:teuthology.orchestra.run.smithi050.stdout:Hostname Path Type Serial Size Health Ident Fault Available 2023-01-04T18:14:26.611 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050 /dev/nvme0n1 ssd PHMB7513001F480DGN 480G Unknown N/A N/A No 2023-01-04T18:14:26.611 INFO:teuthology.orchestra.run.smithi050.stdout:smithi098 /dev/nvme0n1 ssd PHFT6204010H400BGN 400G Unknown N/A N/A No 2023-01-04T18:14:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.609+0000 7f2165a95700 1 -- 172.21.15.50:0/744821077 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f214c05c2b0 msgr2=0x7f214c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.609+0000 7f2165a95700 1 --2- 172.21.15.50:0/744821077 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f214c05c2b0 0x7f214c05e770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f215000b620 tx=0x7f2150004d10).stop 2023-01-04T18:14:26.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.609+0000 7f2165a95700 1 -- 172.21.15.50:0/744821077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21600f6860 msgr2=0x7f216010c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.609+0000 7f2165a95700 1 --2- 172.21.15.50:0/744821077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21600f6860 0x7f216010c350 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f214800b410 tx=0x7f2148006ef0).stop 2023-01-04T18:14:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.609+0000 7f2165a95700 1 -- 172.21.15.50:0/744821077 shutdown_connections 2023-01-04T18:14:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.609+0000 7f2165a95700 1 --2- 172.21.15.50:0/744821077 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f214c05c2b0 0x7f214c05e770 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.609+0000 7f2165a95700 1 --2- 172.21.15.50:0/744821077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21600f55c0 0x7f2160109e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.609+0000 7f2165a95700 1 --2- 172.21.15.50:0/744821077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21600f6860 0x7f216010c350 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:26.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.609+0000 7f2165a95700 1 -- 172.21.15.50:0/744821077 >> 172.21.15.50:0/744821077 conn(0x7f21600f0d40 msgr2=0x7f21600fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:26.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.609+0000 7f2165a95700 1 -- 172.21.15.50:0/744821077 shutdown_connections 2023-01-04T18:14:26.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:26.609+0000 7f2165a95700 1 -- 172.21.15.50:0/744821077 wait complete. 2023-01-04T18:14:26.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:25.290580+0000 mgr.smithi050.emnywo (mgr.14162) 188 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:27.080 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-01-04T18:14:27.090 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi050.front.sepia.ceph.com 2023-01-04T18:14:27.090 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- bash -c 'ceph fs volume create cephfs --placement=4' 2023-01-04T18:14:27.621 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:26.608143+0000 mgr.smithi050.emnywo (mgr.14162) 189 : audit [DBG] from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:14:27.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:26.608143+0000 mgr.smithi050.emnywo (mgr.14162) 189 : audit [DBG] from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:14:28.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.650+0000 7f1f379af700 1 -- 172.21.15.50:0/1958319493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f300f7980 msgr2=0x7f1f300f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:28.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.650+0000 7f1f379af700 1 --2- 172.21.15.50:0/1958319493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f300f7980 0x7f1f300f7de0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f1f24004660 tx=0x7f1f24009b30).stop 2023-01-04T18:14:28.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.650+0000 7f1f379af700 1 -- 172.21.15.50:0/1958319493 shutdown_connections 2023-01-04T18:14:28.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.650+0000 7f1f379af700 1 --2- 172.21.15.50:0/1958319493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f300f7980 0x7f1f300f7de0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:28.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.650+0000 7f1f379af700 1 --2- 172.21.15.50:0/1958319493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f300f66e0 0x7f1f300f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:28.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.650+0000 7f1f379af700 1 -- 172.21.15.50:0/1958319493 >> 172.21.15.50:0/1958319493 conn(0x7f1f300f1e40 msgr2=0x7f1f300f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:28.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.650+0000 7f1f379af700 1 -- 172.21.15.50:0/1958319493 shutdown_connections 2023-01-04T18:14:28.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.650+0000 7f1f379af700 1 -- 172.21.15.50:0/1958319493 wait complete. 2023-01-04T18:14:28.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.651+0000 7f1f379af700 1 Processor -- start 2023-01-04T18:14:28.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.651+0000 7f1f379af700 1 -- start start 2023-01-04T18:14:28.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.651+0000 7f1f379af700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f300f66e0 0x7f1f3006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:28.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.651+0000 7f1f379af700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f300f7980 0x7f1f30069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:28.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.651+0000 7f1f379af700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3006a380 con 0x7f1f300f66e0 2023-01-04T18:14:28.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.651+0000 7f1f379af700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3006a4c0 con 0x7f1f300f7980 2023-01-04T18:14:28.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.651+0000 7f1f3574b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f300f66e0 0x7f1f3006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:28.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.651+0000 7f1f3574b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f300f66e0 0x7f1f3006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36904/0 (socket says 172.21.15.50:36904) 2023-01-04T18:14:28.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.651+0000 7f1f3574b700 1 -- 172.21.15.50:0/1080368721 learned_addr learned my addr 172.21.15.50:0/1080368721 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:28.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.651+0000 7f1f34f4a700 1 --2- 172.21.15.50:0/1080368721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f300f7980 0x7f1f30069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:28.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.651+0000 7f1f3574b700 1 -- 172.21.15.50:0/1080368721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f300f7980 msgr2=0x7f1f30069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:28.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.651+0000 7f1f3574b700 1 --2- 172.21.15.50:0/1080368721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f300f7980 0x7f1f30069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:28.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.651+0000 7f1f3574b700 1 -- 172.21.15.50:0/1080368721 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f24005040 con 0x7f1f300f66e0 2023-01-04T18:14:28.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.652+0000 7f1f3574b700 1 --2- 172.21.15.50:0/1080368721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f300f66e0 0x7f1f3006b9a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f1f2c002700 tx=0x7f1f2c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:28.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.652+0000 7f1f21ffb700 1 -- 172.21.15.50:0/1080368721 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f2c0079c0 con 0x7f1f300f66e0 2023-01-04T18:14:28.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.652+0000 7f1f21ffb700 1 -- 172.21.15.50:0/1080368721 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1f2c00f040 con 0x7f1f300f66e0 2023-01-04T18:14:28.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.652+0000 7f1f21ffb700 1 -- 172.21.15.50:0/1080368721 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f2c014850 con 0x7f1f300f66e0 2023-01-04T18:14:28.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.652+0000 7f1f379af700 1 -- 172.21.15.50:0/1080368721 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3006a7a0 con 0x7f1f300f66e0 2023-01-04T18:14:28.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.652+0000 7f1f379af700 1 -- 172.21.15.50:0/1080368721 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3010ef60 con 0x7f1f300f66e0 2023-01-04T18:14:28.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.653+0000 7f1f379af700 1 -- 172.21.15.50:0/1080368721 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f30045ad0 con 0x7f1f300f66e0 2023-01-04T18:14:28.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.653+0000 7f1f21ffb700 1 -- 172.21.15.50:0/1080368721 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f1f2c01b060 con 0x7f1f300f66e0 2023-01-04T18:14:28.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.654+0000 7f1f21ffb700 1 --2- 172.21.15.50:0/1080368721 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f1f1c05c2b0 0x7f1f1c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:28.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.654+0000 7f1f21ffb700 1 -- 172.21.15.50:0/1080368721 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f1f2c075a80 con 0x7f1f300f66e0 2023-01-04T18:14:28.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.654+0000 7f1f34f4a700 1 --2- 172.21.15.50:0/1080368721 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f1f1c05c2b0 0x7f1f1c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:28.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.654+0000 7f1f34f4a700 1 --2- 172.21.15.50:0/1080368721 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f1f1c05c2b0 0x7f1f1c05e770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f1f24009f50 tx=0x7f1f24009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:28.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.658+0000 7f1f21ffb700 1 -- 172.21.15.50:0/1080368721 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f1f2c048a80 con 0x7f1f300f66e0 2023-01-04T18:14:28.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:27.290959+0000 mgr.smithi050.emnywo (mgr.14162) 190 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:28.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:28.004529+0000 mon.smithi050 (mon.0) 446 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:14:28.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:27.290959+0000 mgr.smithi050.emnywo (mgr.14162) 190 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:28.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:28.004529+0000 mon.smithi050 (mon.0) 446 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:14:28.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:28.842+0000 7f1f379af700 1 -- 172.21.15.50:0/1080368721 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f30057f10 con 0x7f1f1c05c2b0 2023-01-04T18:14:29.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:28.375773+0000 mon.smithi050 (mon.0) 447 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:29.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:28.844437+0000 mgr.smithi050.emnywo (mgr.14162) 191 : audit [DBG] from='client.14422 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:14:29.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:28.844945+0000 mon.smithi050 (mon.0) 448 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-01-04T18:14:29.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:28.375773+0000 mon.smithi050 (mon.0) 447 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:29.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:28.844437+0000 mgr.smithi050.emnywo (mgr.14162) 191 : audit [DBG] from='client.14422 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:14:29.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:28.844945+0000 mon.smithi050 (mon.0) 448 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-01-04T18:14:30.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:30.412+0000 7f1f21ffb700 1 -- 172.21.15.50:0/1080368721 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1f30057f10 con 0x7f1f1c05c2b0 2023-01-04T18:14:30.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:30.414+0000 7f1f379af700 1 -- 172.21.15.50:0/1080368721 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f1f1c05c2b0 msgr2=0x7f1f1c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:30.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:30.414+0000 7f1f379af700 1 --2- 172.21.15.50:0/1080368721 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f1f1c05c2b0 0x7f1f1c05e770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f1f24009f50 tx=0x7f1f24009b30).stop 2023-01-04T18:14:30.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:30.414+0000 7f1f379af700 1 -- 172.21.15.50:0/1080368721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f300f66e0 msgr2=0x7f1f3006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:30.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:30.414+0000 7f1f379af700 1 --2- 172.21.15.50:0/1080368721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f300f66e0 0x7f1f3006b9a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f1f2c002700 tx=0x7f1f2c009e00).stop 2023-01-04T18:14:30.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:30.414+0000 7f1f379af700 1 -- 172.21.15.50:0/1080368721 shutdown_connections 2023-01-04T18:14:30.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:30.414+0000 7f1f379af700 1 --2- 172.21.15.50:0/1080368721 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f1f1c05c2b0 0x7f1f1c05e770 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:30.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:30.414+0000 7f1f379af700 1 --2- 172.21.15.50:0/1080368721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f300f66e0 0x7f1f3006b9a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:30.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:30.414+0000 7f1f379af700 1 --2- 172.21.15.50:0/1080368721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f300f7980 0x7f1f30069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:30.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:30.414+0000 7f1f379af700 1 -- 172.21.15.50:0/1080368721 >> 172.21.15.50:0/1080368721 conn(0x7f1f300f1e40 msgr2=0x7f1f300fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:30.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:30.414+0000 7f1f379af700 1 -- 172.21.15.50:0/1080368721 shutdown_connections 2023-01-04T18:14:30.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:30.414+0000 7f1f379af700 1 -- 172.21.15.50:0/1080368721 wait complete. 2023-01-04T18:14:30.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:29.291443+0000 mgr.smithi050.emnywo (mgr.14162) 192 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:30.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:29.380825+0000 mon.smithi050 (mon.0) 449 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-01-04T18:14:30.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:29.380886+0000 mon.smithi050 (mon.0) 450 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2023-01-04T18:14:30.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:29.382424+0000 mon.smithi050 (mon.0) 451 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-01-04T18:14:30.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:14:30.389+0000 7fd7fbc1e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-01-04T18:14:30.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:29.291443+0000 mgr.smithi050.emnywo (mgr.14162) 192 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:30.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:29.380825+0000 mon.smithi050 (mon.0) 449 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-01-04T18:14:30.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:29.380886+0000 mon.smithi050 (mon.0) 450 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2023-01-04T18:14:30.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:29.382424+0000 mon.smithi050 (mon.0) 451 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-01-04T18:14:30.925 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- bash -c 'ceph fs dump' 2023-01-04T18:14:31.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:30.385712+0000 mon.smithi050 (mon.0) 452 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-01-04T18:14:31.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:30.385889+0000 mon.smithi050 (mon.0) 453 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2023-01-04T18:14:31.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:30.390080+0000 mon.smithi050 (mon.0) 454 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-01-04T18:14:31.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:30.390925+0000 mon.smithi050 (mon.0) 455 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-01-04T18:14:31.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:30.390961+0000 mon.smithi050 (mon.0) 456 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-01-04T18:14:31.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:30.399054+0000 mon.smithi050 (mon.0) 457 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2023-01-04T18:14:31.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:30.399511+0000 mon.smithi050 (mon.0) 458 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-01-04T18:14:31.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:30.399591+0000 mon.smithi050 (mon.0) 459 : cluster [DBG] fsmap cephfs:0 2023-01-04T18:14:31.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:14:30.407512+0000 mgr.smithi050.emnywo (mgr.14162) 193 : cephadm [INF] Saving service mds.cephfs spec with placement count:4 2023-01-04T18:14:31.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:30.413027+0000 mon.smithi050 (mon.0) 460 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:31.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:30.413842+0000 mon.smithi050 (mon.0) 461 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:14:31.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:30.424041+0000 mon.smithi050 (mon.0) 462 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:31.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:30.442643+0000 mon.smithi050 (mon.0) 463 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:31.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:30.443436+0000 mon.smithi050 (mon.0) 464 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi050.ezoiwl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-01-04T18:14:31.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:30.446187+0000 mon.smithi050 (mon.0) 465 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi050.ezoiwl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-01-04T18:14:31.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:30.446880+0000 mon.smithi050 (mon.0) 466 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:14:31.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:14:30.447642+0000 mgr.smithi050.emnywo (mgr.14162) 194 : cephadm [INF] Deploying daemon mds.cephfs.smithi050.ezoiwl on smithi050 2023-01-04T18:14:31.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:30.385712+0000 mon.smithi050 (mon.0) 452 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-01-04T18:14:31.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:30.385889+0000 mon.smithi050 (mon.0) 453 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2023-01-04T18:14:31.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:30.390080+0000 mon.smithi050 (mon.0) 454 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-01-04T18:14:31.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:30.390925+0000 mon.smithi050 (mon.0) 455 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-01-04T18:14:31.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:30.390961+0000 mon.smithi050 (mon.0) 456 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-01-04T18:14:31.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:30.399054+0000 mon.smithi050 (mon.0) 457 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2023-01-04T18:14:31.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:30.399511+0000 mon.smithi050 (mon.0) 458 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-01-04T18:14:31.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:30.399591+0000 mon.smithi050 (mon.0) 459 : cluster [DBG] fsmap cephfs:0 2023-01-04T18:14:31.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:14:30.407512+0000 mgr.smithi050.emnywo (mgr.14162) 193 : cephadm [INF] Saving service mds.cephfs spec with placement count:4 2023-01-04T18:14:31.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:30.413027+0000 mon.smithi050 (mon.0) 460 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:31.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:30.413842+0000 mon.smithi050 (mon.0) 461 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:14:31.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:30.424041+0000 mon.smithi050 (mon.0) 462 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:31.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:30.442643+0000 mon.smithi050 (mon.0) 463 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:31.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:30.443436+0000 mon.smithi050 (mon.0) 464 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi050.ezoiwl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-01-04T18:14:31.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:30.446187+0000 mon.smithi050 (mon.0) 465 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi050.ezoiwl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-01-04T18:14:31.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:30.446880+0000 mon.smithi050 (mon.0) 466 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:14:31.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:14:30.447642+0000 mgr.smithi050.emnywo (mgr.14162) 194 : cephadm [INF] Deploying daemon mds.cephfs.smithi050.ezoiwl on smithi050 2023-01-04T18:14:32.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:31.291833+0000 mgr.smithi050.emnywo (mgr.14162) 195 : cluster [DBG] pgmap v157: 65 pgs: 7 creating+peering, 6 active+clean, 52 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:32.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:31.397782+0000 mon.smithi050 (mon.0) 467 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2023-01-04T18:14:32.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:31.291833+0000 mgr.smithi050.emnywo (mgr.14162) 195 : cluster [DBG] pgmap v157: 65 pgs: 7 creating+peering, 6 active+clean, 52 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:32.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:31.397782+0000 mon.smithi050 (mon.0) 467 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2023-01-04T18:14:33.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.003+0000 7fafc2da0700 1 -- 172.21.15.50:0/2532066370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafbc0f66e0 msgr2=0x7fafbc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:33.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.003+0000 7fafc2da0700 1 --2- 172.21.15.50:0/2532066370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafbc0f66e0 0x7fafbc0f6b00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fafb0004660 tx=0x7fafb0009b30).stop 2023-01-04T18:14:33.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.003+0000 7fafc2da0700 1 -- 172.21.15.50:0/2532066370 shutdown_connections 2023-01-04T18:14:33.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.003+0000 7fafc2da0700 1 --2- 172.21.15.50:0/2532066370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafbc0f7980 0x7fafbc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:33.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.003+0000 7fafc2da0700 1 --2- 172.21.15.50:0/2532066370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafbc0f66e0 0x7fafbc0f6b00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:33.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.003+0000 7fafc2da0700 1 -- 172.21.15.50:0/2532066370 >> 172.21.15.50:0/2532066370 conn(0x7fafbc0f1e40 msgr2=0x7fafbc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:33.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.003+0000 7fafc2da0700 1 -- 172.21.15.50:0/2532066370 shutdown_connections 2023-01-04T18:14:33.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.003+0000 7fafc2da0700 1 -- 172.21.15.50:0/2532066370 wait complete. 2023-01-04T18:14:33.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.004+0000 7fafc2da0700 1 Processor -- start 2023-01-04T18:14:33.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.004+0000 7fafc2da0700 1 -- start start 2023-01-04T18:14:33.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.004+0000 7fafc2da0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafbc0f66e0 0x7fafbc106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:33.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.004+0000 7fafc2da0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafbc0f7980 0x7fafbc1074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:33.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.004+0000 7fafc2da0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc107a70 con 0x7fafbc0f7980 2023-01-04T18:14:33.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.004+0000 7fafc2da0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc107bb0 con 0x7fafbc0f66e0 2023-01-04T18:14:33.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.005+0000 7fafbbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafbc0f7980 0x7fafbc1074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:33.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.005+0000 7fafbbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafbc0f7980 0x7fafbc1074c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36912/0 (socket says 172.21.15.50:36912) 2023-01-04T18:14:33.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.005+0000 7fafbbfff700 1 -- 172.21.15.50:0/4271298558 learned_addr learned my addr 172.21.15.50:0/4271298558 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:33.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.005+0000 7fafc0b3c700 1 --2- 172.21.15.50:0/4271298558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafbc0f66e0 0x7fafbc106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:33.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.005+0000 7fafbbfff700 1 -- 172.21.15.50:0/4271298558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafbc0f66e0 msgr2=0x7fafbc106fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:33.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.005+0000 7fafbbfff700 1 --2- 172.21.15.50:0/4271298558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafbc0f66e0 0x7fafbc106fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:33.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.005+0000 7fafbbfff700 1 -- 172.21.15.50:0/4271298558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb0005040 con 0x7fafbc0f7980 2023-01-04T18:14:33.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.005+0000 7fafbbfff700 1 --2- 172.21.15.50:0/4271298558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafbc0f7980 0x7fafbc1074c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fafa80026d0 tx=0x7fafa8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:33.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.005+0000 7fafb97fa700 1 -- 172.21.15.50:0/4271298558 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafa80079c0 con 0x7fafbc0f7980 2023-01-04T18:14:33.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.005+0000 7fafb97fa700 1 -- 172.21.15.50:0/4271298558 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fafa800f040 con 0x7fafbc0f7980 2023-01-04T18:14:33.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.005+0000 7fafc2da0700 1 -- 172.21.15.50:0/4271298558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafbc108550 con 0x7fafbc0f7980 2023-01-04T18:14:33.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.005+0000 7fafb97fa700 1 -- 172.21.15.50:0/4271298558 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafa80148b0 con 0x7fafbc0f7980 2023-01-04T18:14:33.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.005+0000 7fafc2da0700 1 -- 172.21.15.50:0/4271298558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafbc108b10 con 0x7fafbc0f7980 2023-01-04T18:14:33.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.006+0000 7fafc2da0700 1 -- 172.21.15.50:0/4271298558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafbc045ad0 con 0x7fafbc0f7980 2023-01-04T18:14:33.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.007+0000 7fafb97fa700 1 -- 172.21.15.50:0/4271298558 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fafa8007b20 con 0x7fafbc0f7980 2023-01-04T18:14:33.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.007+0000 7fafb97fa700 1 --2- 172.21.15.50:0/4271298558 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fafac05c2b0 0x7fafac05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:33.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.007+0000 7fafb97fa700 1 -- 172.21.15.50:0/4271298558 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fafa8075f00 con 0x7fafbc0f7980 2023-01-04T18:14:33.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.007+0000 7fafc0b3c700 1 --2- 172.21.15.50:0/4271298558 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fafac05c2b0 0x7fafac05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:33.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.008+0000 7fafc0b3c700 1 --2- 172.21.15.50:0/4271298558 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fafac05c2b0 0x7fafac05e770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fafb0009f50 tx=0x7fafb0009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:33.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.011+0000 7fafb97fa700 1 -- 172.21.15.50:0/4271298558 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fafa8048c30 con 0x7fafbc0f7980 2023-01-04T18:14:33.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.218+0000 7fafc2da0700 1 -- 172.21.15.50:0/4271298558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fafbc027a00 con 0x7fafbc0f7980 2023-01-04T18:14:33.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.219+0000 7fafb97fa700 1 -- 172.21.15.50:0/4271298558 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1003 (secure 0 0 0) 0x7fafa804c250 con 0x7fafbc0f7980 2023-01-04T18:14:33.223 INFO:teuthology.orchestra.run.smithi050.stdout:e2 2023-01-04T18:14:33.223 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:14:33.223 INFO:teuthology.orchestra.run.smithi050.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:14:33.223 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-01-04T18:14:33.223 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:14:33.223 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-01-04T18:14:33.224 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-01-04T18:14:33.224 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 2 2023-01-04T18:14:33.224 INFO:teuthology.orchestra.run.smithi050.stdout:flags 12 2023-01-04T18:14:33.224 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:14:33.224 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-01-04T18:14:30.390832+0000 2023-01-04T18:14:33.224 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-01-04T18:14:33.224 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-01-04T18:14:33.224 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 60 2023-01-04T18:14:33.224 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-01-04T18:14:33.224 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-01-04T18:14:33.224 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-01-04T18:14:33.225 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-01-04T18:14:33.225 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 0 2023-01-04T18:14:33.225 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:14:33.225 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 1 2023-01-04T18:14:33.225 INFO:teuthology.orchestra.run.smithi050.stdout:in 2023-01-04T18:14:33.225 INFO:teuthology.orchestra.run.smithi050.stdout:up {} 2023-01-04T18:14:33.225 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-01-04T18:14:33.225 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-01-04T18:14:33.225 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-01-04T18:14:33.225 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-01-04T18:14:33.225 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-01-04T18:14:33.226 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data disabled 2023-01-04T18:14:33.226 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-01-04T18:14:33.226 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 0 2023-01-04T18:14:33.226 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:14:33.226 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:14:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.221+0000 7fafc2da0700 1 -- 172.21.15.50:0/4271298558 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fafac05c2b0 msgr2=0x7fafac05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.221+0000 7fafc2da0700 1 --2- 172.21.15.50:0/4271298558 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fafac05c2b0 0x7fafac05e770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fafb0009f50 tx=0x7fafb0009b30).stop 2023-01-04T18:14:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.221+0000 7fafc2da0700 1 -- 172.21.15.50:0/4271298558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafbc0f7980 msgr2=0x7fafbc1074c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.221+0000 7fafc2da0700 1 --2- 172.21.15.50:0/4271298558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafbc0f7980 0x7fafbc1074c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fafa80026d0 tx=0x7fafa8009de0).stop 2023-01-04T18:14:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.221+0000 7fafc2da0700 1 -- 172.21.15.50:0/4271298558 shutdown_connections 2023-01-04T18:14:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.221+0000 7fafc2da0700 1 --2- 172.21.15.50:0/4271298558 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fafac05c2b0 0x7fafac05e770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.221+0000 7fafc2da0700 1 --2- 172.21.15.50:0/4271298558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafbc0f66e0 0x7fafbc106fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.221+0000 7fafc2da0700 1 --2- 172.21.15.50:0/4271298558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafbc0f7980 0x7fafbc1074c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.221+0000 7fafc2da0700 1 -- 172.21.15.50:0/4271298558 >> 172.21.15.50:0/4271298558 conn(0x7fafbc0f1e40 msgr2=0x7fafbc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.221+0000 7fafc2da0700 1 -- 172.21.15.50:0/4271298558 shutdown_connections 2023-01-04T18:14:33.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:33.221+0000 7fafc2da0700 1 -- 172.21.15.50:0/4271298558 wait complete. 2023-01-04T18:14:33.228 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 2 2023-01-04T18:14:33.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:33 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:32.401913+0000 mon.smithi050 (mon.0) 468 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2023-01-04T18:14:33.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:33 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:33.220434+0000 mon.smithi050 (mon.0) 469 : audit [DBG] from='client.? 172.21.15.50:0/4271298558' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:14:33.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:33 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:33.347259+0000 mon.smithi050 (mon.0) 470 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:33.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:33 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:33.347993+0000 mon.smithi050 (mon.0) 471 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.memais", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-01-04T18:14:33.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:33 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:33.350437+0000 mon.smithi050 (mon.0) 472 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.memais", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-01-04T18:14:33.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:33 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:33.351064+0000 mon.smithi050 (mon.0) 473 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:14:33.681 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-01-04T18:14:33.691 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi050.front.sepia.ceph.com 2023-01-04T18:14:33.692 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- bash -c 'ceph fs set cephfs max_mds 1' 2023-01-04T18:14:33.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:33 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:32.401913+0000 mon.smithi050 (mon.0) 468 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2023-01-04T18:14:33.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:33 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:33.220434+0000 mon.smithi050 (mon.0) 469 : audit [DBG] from='client.? 172.21.15.50:0/4271298558' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:14:33.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:33 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:33.347259+0000 mon.smithi050 (mon.0) 470 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:33.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:33 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:33.347993+0000 mon.smithi050 (mon.0) 471 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.memais", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-01-04T18:14:33.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:33 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:33.350437+0000 mon.smithi050 (mon.0) 472 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.memais", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-01-04T18:14:33.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:33 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:33.351064+0000 mon.smithi050 (mon.0) 473 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:14:34.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:33.292987+0000 mgr.smithi050.emnywo (mgr.14162) 196 : cluster [DBG] pgmap v160: 65 pgs: 7 creating+peering, 46 active+clean, 12 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:34.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:14:33.351635+0000 mgr.smithi050.emnywo (mgr.14162) 197 : cephadm [INF] Deploying daemon mds.cephfs.smithi098.memais on smithi098 2023-01-04T18:14:34.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:33.406926+0000 mon.smithi050 (mon.0) 474 : cluster [DBG] mds.? [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] up:boot 2023-01-04T18:14:34.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:33.406989+0000 mon.smithi050 (mon.0) 475 : cluster [INF] daemon mds.cephfs.smithi050.ezoiwl assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-01-04T18:14:34.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:33.407060+0000 mon.smithi050 (mon.0) 476 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-01-04T18:14:34.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:33.407076+0000 mon.smithi050 (mon.0) 477 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-01-04T18:14:34.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:33.407086+0000 mon.smithi050 (mon.0) 478 : cluster [INF] Cluster is now healthy 2023-01-04T18:14:34.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:33.407242+0000 mon.smithi050 (mon.0) 479 : cluster [DBG] fsmap cephfs:0 1 up:standby 2023-01-04T18:14:34.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:33.407341+0000 mon.smithi050 (mon.0) 480 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi050.ezoiwl"}]: dispatch 2023-01-04T18:14:34.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:33.409666+0000 mon.smithi050 (mon.0) 481 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:creating} 2023-01-04T18:14:34.411 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:33.424739+0000 mon.smithi050 (mon.0) 482 : cluster [INF] daemon mds.cephfs.smithi050.ezoiwl is now active in filesystem cephfs as rank 0 2023-01-04T18:14:34.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:33.292987+0000 mgr.smithi050.emnywo (mgr.14162) 196 : cluster [DBG] pgmap v160: 65 pgs: 7 creating+peering, 46 active+clean, 12 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:34.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:14:33.351635+0000 mgr.smithi050.emnywo (mgr.14162) 197 : cephadm [INF] Deploying daemon mds.cephfs.smithi098.memais on smithi098 2023-01-04T18:14:34.724 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:33.406926+0000 mon.smithi050 (mon.0) 474 : cluster [DBG] mds.? [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] up:boot 2023-01-04T18:14:34.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:33.406989+0000 mon.smithi050 (mon.0) 475 : cluster [INF] daemon mds.cephfs.smithi050.ezoiwl assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-01-04T18:14:34.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:33.407060+0000 mon.smithi050 (mon.0) 476 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-01-04T18:14:34.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:33.407076+0000 mon.smithi050 (mon.0) 477 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-01-04T18:14:34.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:33.407086+0000 mon.smithi050 (mon.0) 478 : cluster [INF] Cluster is now healthy 2023-01-04T18:14:34.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:33.407242+0000 mon.smithi050 (mon.0) 479 : cluster [DBG] fsmap cephfs:0 1 up:standby 2023-01-04T18:14:34.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:33.407341+0000 mon.smithi050 (mon.0) 480 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi050.ezoiwl"}]: dispatch 2023-01-04T18:14:34.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:33.409666+0000 mon.smithi050 (mon.0) 481 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:creating} 2023-01-04T18:14:34.725 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:33.424739+0000 mon.smithi050 (mon.0) 482 : cluster [INF] daemon mds.cephfs.smithi050.ezoiwl is now active in filesystem cephfs as rank 0 2023-01-04T18:14:35.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.191+0000 7f75489d3700 1 -- 172.21.15.50:0/3663601133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75440f55c0 msgr2=0x7f75440f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:35.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.191+0000 7f75489d3700 1 --2- 172.21.15.50:0/3663601133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75440f55c0 0x7f75440f59e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f7534004660 tx=0x7f7534009b30).stop 2023-01-04T18:14:35.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.191+0000 7f75489d3700 1 -- 172.21.15.50:0/3663601133 shutdown_connections 2023-01-04T18:14:35.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.191+0000 7f75489d3700 1 --2- 172.21.15.50:0/3663601133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75440f6860 0x7f75440f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:35.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.191+0000 7f75489d3700 1 --2- 172.21.15.50:0/3663601133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75440f55c0 0x7f75440f59e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:35.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.191+0000 7f75489d3700 1 -- 172.21.15.50:0/3663601133 >> 172.21.15.50:0/3663601133 conn(0x7f75440f0d40 msgr2=0x7f75440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:35.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.191+0000 7f75489d3700 1 -- 172.21.15.50:0/3663601133 shutdown_connections 2023-01-04T18:14:35.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.191+0000 7f75489d3700 1 -- 172.21.15.50:0/3663601133 wait complete. 2023-01-04T18:14:35.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.191+0000 7f75489d3700 1 Processor -- start 2023-01-04T18:14:35.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.192+0000 7f75489d3700 1 -- start start 2023-01-04T18:14:35.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.192+0000 7f75489d3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75440f55c0 0x7f75440f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:35.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.192+0000 7f75489d3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75440f6860 0x7f75440f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:35.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.192+0000 7f75489d3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75440f8100 con 0x7f75440f6860 2023-01-04T18:14:35.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.192+0000 7f75489d3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75440f8240 con 0x7f75440f55c0 2023-01-04T18:14:35.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.192+0000 7f7541d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75440f6860 0x7f75440f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:35.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.192+0000 7f7541d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75440f6860 0x7f75440f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36958/0 (socket says 172.21.15.50:36958) 2023-01-04T18:14:35.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.192+0000 7f7541d9b700 1 -- 172.21.15.50:0/1324985780 learned_addr learned my addr 172.21.15.50:0/1324985780 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:35.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.192+0000 7f754259c700 1 --2- 172.21.15.50:0/1324985780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75440f55c0 0x7f75440f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:35.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.192+0000 7f7541d9b700 1 -- 172.21.15.50:0/1324985780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75440f55c0 msgr2=0x7f75440f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:35.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.192+0000 7f7541d9b700 1 --2- 172.21.15.50:0/1324985780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75440f55c0 0x7f75440f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:35.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.192+0000 7f7541d9b700 1 -- 172.21.15.50:0/1324985780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7534005040 con 0x7f75440f6860 2023-01-04T18:14:35.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.192+0000 7f7541d9b700 1 --2- 172.21.15.50:0/1324985780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75440f6860 0x7f75440f7ba0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f7538002700 tx=0x7f7538009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:35.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.192+0000 7f7532ffd700 1 -- 172.21.15.50:0/1324985780 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7538009320 con 0x7f75440f6860 2023-01-04T18:14:35.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.192+0000 7f7532ffd700 1 -- 172.21.15.50:0/1324985780 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f753800f040 con 0x7f75440f6860 2023-01-04T18:14:35.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.192+0000 7f75489d3700 1 -- 172.21.15.50:0/1324985780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75440f8520 con 0x7f75440f6860 2023-01-04T18:14:35.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.192+0000 7f7532ffd700 1 -- 172.21.15.50:0/1324985780 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7538014870 con 0x7f75440f6860 2023-01-04T18:14:35.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.193+0000 7f75489d3700 1 -- 172.21.15.50:0/1324985780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754410ef40 con 0x7f75440f6860 2023-01-04T18:14:35.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.194+0000 7f75489d3700 1 -- 172.21.15.50:0/1324985780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7544045ad0 con 0x7f75440f6860 2023-01-04T18:14:35.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.194+0000 7f7532ffd700 1 -- 172.21.15.50:0/1324985780 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f7538009480 con 0x7f75440f6860 2023-01-04T18:14:35.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.194+0000 7f7532ffd700 1 --2- 172.21.15.50:0/1324985780 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f752c05c2b0 0x7f752c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:35.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.194+0000 7f7532ffd700 1 -- 172.21.15.50:0/1324985780 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f7538076070 con 0x7f75440f6860 2023-01-04T18:14:35.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.194+0000 7f754259c700 1 --2- 172.21.15.50:0/1324985780 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f752c05c2b0 0x7f752c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:35.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.195+0000 7f754259c700 1 --2- 172.21.15.50:0/1324985780 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f752c05c2b0 0x7f752c05e770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f75440f94b0 tx=0x7f7534009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:35.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.198+0000 7f7532ffd700 1 -- 172.21.15.50:0/1324985780 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7538048db0 con 0x7f75440f6860 2023-01-04T18:14:35.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:35.399+0000 7f75489d3700 1 -- 172.21.15.50:0/1324985780 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f75440f86b0 con 0x7f75440f6860 2023-01-04T18:14:35.649 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:34.411764+0000 mon.smithi050 (mon.0) 483 : cluster [DBG] mds.? [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] up:active 2023-01-04T18:14:35.649 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:34.411807+0000 mon.smithi050 (mon.0) 484 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 2023-01-04T18:14:35.650 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:35.401041+0000 mon.smithi050 (mon.0) 485 : audit [INF] from='client.? 172.21.15.50:0/1324985780' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2023-01-04T18:14:35.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:34.411764+0000 mon.smithi050 (mon.0) 483 : cluster [DBG] mds.? [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] up:active 2023-01-04T18:14:35.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:34.411807+0000 mon.smithi050 (mon.0) 484 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 2023-01-04T18:14:35.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:35.401041+0000 mon.smithi050 (mon.0) 485 : audit [INF] from='client.? 172.21.15.50:0/1324985780' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2023-01-04T18:14:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:36.226+0000 7f7532ffd700 1 -- 172.21.15.50:0/1324985780 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f75440f86b0 con 0x7f75440f6860 2023-01-04T18:14:36.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:36.228+0000 7f75489d3700 1 -- 172.21.15.50:0/1324985780 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f752c05c2b0 msgr2=0x7f752c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:36.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:36.228+0000 7f75489d3700 1 --2- 172.21.15.50:0/1324985780 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f752c05c2b0 0x7f752c05e770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f75440f94b0 tx=0x7f7534009b30).stop 2023-01-04T18:14:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:36.228+0000 7f75489d3700 1 -- 172.21.15.50:0/1324985780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75440f6860 msgr2=0x7f75440f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:36.228+0000 7f75489d3700 1 --2- 172.21.15.50:0/1324985780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75440f6860 0x7f75440f7ba0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f7538002700 tx=0x7f7538009e00).stop 2023-01-04T18:14:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:36.228+0000 7f75489d3700 1 -- 172.21.15.50:0/1324985780 shutdown_connections 2023-01-04T18:14:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:36.228+0000 7f75489d3700 1 --2- 172.21.15.50:0/1324985780 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f752c05c2b0 0x7f752c05e770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:36.228+0000 7f75489d3700 1 --2- 172.21.15.50:0/1324985780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75440f55c0 0x7f75440f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:36.228+0000 7f75489d3700 1 --2- 172.21.15.50:0/1324985780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75440f6860 0x7f75440f7ba0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:36.228+0000 7f75489d3700 1 -- 172.21.15.50:0/1324985780 >> 172.21.15.50:0/1324985780 conn(0x7f75440f0d40 msgr2=0x7f754405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:36.228+0000 7f75489d3700 1 -- 172.21.15.50:0/1324985780 shutdown_connections 2023-01-04T18:14:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:36.228+0000 7f75489d3700 1 -- 172.21.15.50:0/1324985780 wait complete. 2023-01-04T18:14:36.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:35.293386+0000 mgr.smithi050.emnywo (mgr.14162) 198 : cluster [DBG] pgmap v161: 65 pgs: 7 creating+peering, 52 active+clean, 6 unknown; 22 B data, 31 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:36.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:35.721612+0000 mon.smithi050 (mon.0) 486 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:36.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:35.722344+0000 mon.smithi050 (mon.0) 487 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi050.kefmuy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-01-04T18:14:36.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:35.724883+0000 mon.smithi050 (mon.0) 488 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi050.kefmuy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-01-04T18:14:36.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:35.725539+0000 mon.smithi050 (mon.0) 489 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:14:36.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:14:35.726237+0000 mgr.smithi050.emnywo (mgr.14162) 199 : cephadm [INF] Deploying daemon mds.cephfs.smithi050.kefmuy on smithi050 2023-01-04T18:14:36.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:36.227901+0000 mon.smithi050 (mon.0) 490 : audit [INF] from='client.? 172.21.15.50:0/1324985780' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2023-01-04T18:14:36.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:36.227962+0000 mon.smithi050 (mon.0) 491 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 2023-01-04T18:14:36.915 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-01-04T18:14:36.928 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi050.front.sepia.ceph.com 2023-01-04T18:14:36.928 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2023-01-04T18:14:37.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:35.293386+0000 mgr.smithi050.emnywo (mgr.14162) 198 : cluster [DBG] pgmap v161: 65 pgs: 7 creating+peering, 52 active+clean, 6 unknown; 22 B data, 31 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:14:37.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:35.721612+0000 mon.smithi050 (mon.0) 486 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:37.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:35.722344+0000 mon.smithi050 (mon.0) 487 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi050.kefmuy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-01-04T18:14:37.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:35.724883+0000 mon.smithi050 (mon.0) 488 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi050.kefmuy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-01-04T18:14:37.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:35.725539+0000 mon.smithi050 (mon.0) 489 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:14:37.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:14:35.726237+0000 mgr.smithi050.emnywo (mgr.14162) 199 : cephadm [INF] Deploying daemon mds.cephfs.smithi050.kefmuy on smithi050 2023-01-04T18:14:37.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:36.227901+0000 mon.smithi050 (mon.0) 490 : audit [INF] from='client.? 172.21.15.50:0/1324985780' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2023-01-04T18:14:37.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:36.227962+0000 mon.smithi050 (mon.0) 491 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 2023-01-04T18:14:38.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.688+0000 7ffb09788700 1 -- 172.21.15.50:0/2037004885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb040f6860 msgr2=0x7ffb040f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.688+0000 7ffb09788700 1 --2- 172.21.15.50:0/2037004885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb040f6860 0x7ffb040f6cc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7ffaec004660 tx=0x7ffaec009b30).stop 2023-01-04T18:14:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.688+0000 7ffb09788700 1 -- 172.21.15.50:0/2037004885 shutdown_connections 2023-01-04T18:14:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.688+0000 7ffb09788700 1 --2- 172.21.15.50:0/2037004885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb040f6860 0x7ffb040f6cc0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.688+0000 7ffb09788700 1 --2- 172.21.15.50:0/2037004885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb040f55c0 0x7ffb040f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-01-04T18:14:38.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.688+0000 7ffb09788700 1 -- 172.21.15.50:0/2037004885 >> 172.21.15.50:0/2037004885 conn(0x7ffb040f0d40 msgr2=0x7ffb040f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.688+0000 7ffb09788700 1 -- 172.21.15.50:0/2037004885 shutdown_connections 2023-01-04T18:14:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.688+0000 7ffb09788700 1 -- 172.21.15.50:0/2037004885 wait complete. 2023-01-04T18:14:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.689+0000 7ffb09788700 1 Processor -- start 2023-01-04T18:14:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.689+0000 7ffb09788700 1 -- start start 2023-01-04T18:14:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.689+0000 7ffb09788700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb040f55c0 0x7ffb0410c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:38.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.689+0000 7ffb09788700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb040f6860 0x7ffb0410e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:38.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.689+0000 7ffb09788700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb040602b0 con 0x7ffb040f55c0 2023-01-04T18:14:38.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.689+0000 7ffb09788700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb040603f0 con 0x7ffb040f6860 2023-01-04T18:14:38.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.689+0000 7ffb02ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb040f55c0 0x7ffb0410c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:38.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.689+0000 7ffb02ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb040f55c0 0x7ffb0410c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50382/0 (socket says 172.21.15.50:50382) 2023-01-04T18:14:38.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.689+0000 7ffb02ffd700 1 -- 172.21.15.50:0/4004642751 learned_addr learned my addr 172.21.15.50:0/4004642751 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:38.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.690+0000 7ffb027fc700 1 --2- 172.21.15.50:0/4004642751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb040f6860 0x7ffb0410e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:38.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.690+0000 7ffb02ffd700 1 -- 172.21.15.50:0/4004642751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb040f6860 msgr2=0x7ffb0410e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:38.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.690+0000 7ffb02ffd700 1 --2- 172.21.15.50:0/4004642751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb040f6860 0x7ffb0410e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:38.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.690+0000 7ffb02ffd700 1 -- 172.21.15.50:0/4004642751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaec005040 con 0x7ffb040f55c0 2023-01-04T18:14:38.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.690+0000 7ffb027fc700 1 --2- 172.21.15.50:0/4004642751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb040f6860 0x7ffb0410e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-01-04T18:14:38.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.690+0000 7ffb02ffd700 1 --2- 172.21.15.50:0/4004642751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb040f55c0 0x7ffb0410c0f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7ffaf400b790 tx=0x7ffaf40092b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:38.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.690+0000 7ffafb7fe700 1 -- 172.21.15.50:0/4004642751 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaf400d700 con 0x7ffb040f55c0 2023-01-04T18:14:38.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.690+0000 7ffb09788700 1 -- 172.21.15.50:0/4004642751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0410eae0 con 0x7ffb040f55c0 2023-01-04T18:14:38.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.690+0000 7ffafb7fe700 1 -- 172.21.15.50:0/4004642751 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffaf400dd10 con 0x7ffb040f55c0 2023-01-04T18:14:38.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.690+0000 7ffafb7fe700 1 -- 172.21.15.50:0/4004642751 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaf4010e10 con 0x7ffb040f55c0 2023-01-04T18:14:38.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.690+0000 7ffb09788700 1 -- 172.21.15.50:0/4004642751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0410efc0 con 0x7ffb040f55c0 2023-01-04T18:14:38.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.691+0000 7ffb09788700 1 -- 172.21.15.50:0/4004642751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb04045ad0 con 0x7ffb040f55c0 2023-01-04T18:14:38.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.691+0000 7ffafb7fe700 1 -- 172.21.15.50:0/4004642751 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7ffaf40105e0 con 0x7ffb040f55c0 2023-01-04T18:14:38.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.692+0000 7ffafb7fe700 1 --2- 172.21.15.50:0/4004642751 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7ffaf005c2b0 0x7ffaf005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:38.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.692+0000 7ffafb7fe700 1 -- 172.21.15.50:0/4004642751 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7ffaf4076160 con 0x7ffb040f55c0 2023-01-04T18:14:38.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.692+0000 7ffb027fc700 1 --2- 172.21.15.50:0/4004642751 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7ffaf005c2b0 0x7ffaf005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:38.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.692+0000 7ffb027fc700 1 --2- 172.21.15.50:0/4004642751 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7ffaf005c2b0 0x7ffaf005e770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7ffaec009d60 tx=0x7ffaec009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:38.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.696+0000 7ffafb7fe700 1 -- 172.21.15.50:0/4004642751 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ffaf4048e20 con 0x7ffb040f55c0 2023-01-04T18:14:38.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:38.894+0000 7ffb09788700 1 -- 172.21.15.50:0/4004642751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7ffb04027a00 con 0x7ffb040f55c0 2023-01-04T18:14:39.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:37.294906+0000 mgr.smithi050.emnywo (mgr.14162) 200 : cluster [DBG] pgmap v162: 65 pgs: 65 active+clean; 2.1 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 5.0 KiB/s wr, 16 op/s 2023-01-04T18:14:39.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:38.475112+0000 mon.smithi050 (mon.0) 492 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:39.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:38.475928+0000 mon.smithi050 (mon.0) 493 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.laynsk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-01-04T18:14:39.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:38.478509+0000 mon.smithi050 (mon.0) 494 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.laynsk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-01-04T18:14:39.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:38.479136+0000 mon.smithi050 (mon.0) 495 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:14:39.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:37.294906+0000 mgr.smithi050.emnywo (mgr.14162) 200 : cluster [DBG] pgmap v162: 65 pgs: 65 active+clean; 2.1 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 5.0 KiB/s wr, 16 op/s 2023-01-04T18:14:39.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:38.475112+0000 mon.smithi050 (mon.0) 492 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:39.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:38.475928+0000 mon.smithi050 (mon.0) 493 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.laynsk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-01-04T18:14:39.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:38.478509+0000 mon.smithi050 (mon.0) 494 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.laynsk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-01-04T18:14:39.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:38.479136+0000 mon.smithi050 (mon.0) 495 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:14:39.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:39.730+0000 7ffafb7fe700 1 -- 172.21.15.50:0/4004642751 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v7) v1 ==== 121+0+0 (secure 0 0 0) 0x7ffaf40160c0 con 0x7ffb040f55c0 2023-01-04T18:14:39.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:39.733+0000 7ffb09788700 1 -- 172.21.15.50:0/4004642751 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7ffaf005c2b0 msgr2=0x7ffaf005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:39.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:39.733+0000 7ffb09788700 1 --2- 172.21.15.50:0/4004642751 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7ffaf005c2b0 0x7ffaf005e770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7ffaec009d60 tx=0x7ffaec009b30).stop 2023-01-04T18:14:39.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:39.733+0000 7ffb09788700 1 -- 172.21.15.50:0/4004642751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb040f55c0 msgr2=0x7ffb0410c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:39.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:39.733+0000 7ffb09788700 1 --2- 172.21.15.50:0/4004642751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb040f55c0 0x7ffb0410c0f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7ffaf400b790 tx=0x7ffaf40092b0).stop 2023-01-04T18:14:39.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:39.733+0000 7ffb09788700 1 -- 172.21.15.50:0/4004642751 shutdown_connections 2023-01-04T18:14:39.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:39.733+0000 7ffb09788700 1 --2- 172.21.15.50:0/4004642751 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7ffaf005c2b0 0x7ffaf005e770 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:39.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:39.733+0000 7ffb09788700 1 --2- 172.21.15.50:0/4004642751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb040f55c0 0x7ffb0410c0f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:39.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:39.733+0000 7ffb09788700 1 --2- 172.21.15.50:0/4004642751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb040f6860 0x7ffb0410e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:39.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:39.733+0000 7ffb09788700 1 -- 172.21.15.50:0/4004642751 >> 172.21.15.50:0/4004642751 conn(0x7ffb040f0d40 msgr2=0x7ffb040fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:39.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:39.734+0000 7ffb09788700 1 -- 172.21.15.50:0/4004642751 shutdown_connections 2023-01-04T18:14:39.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:39.734+0000 7ffb09788700 1 -- 172.21.15.50:0/4004642751 wait complete. 2023-01-04T18:14:39.866 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:39 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:14:38.479737+0000 mgr.smithi050.emnywo (mgr.14162) 201 : cephadm [INF] Deploying daemon mds.cephfs.smithi098.laynsk on smithi098 2023-01-04T18:14:39.866 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:39 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:38.894553+0000 mon.smithi050 (mon.0) 496 : audit [INF] from='client.? 172.21.15.50:0/4004642751' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-01-04T18:14:40.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:39 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:14:38.479737+0000 mgr.smithi050.emnywo (mgr.14162) 201 : cephadm [INF] Deploying daemon mds.cephfs.smithi098.laynsk on smithi098 2023-01-04T18:14:40.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:39 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:38.894553+0000 mon.smithi050 (mon.0) 496 : audit [INF] from='client.? 172.21.15.50:0/4004642751' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-01-04T18:14:40.154 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-01-04T18:14:40.165 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi050.front.sepia.ceph.com 2023-01-04T18:14:40.165 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2023-01-04T18:14:40.824 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:39.295340+0000 mgr.smithi050.emnywo (mgr.14162) 202 : cluster [DBG] pgmap v163: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 3.0 KiB/s wr, 9 op/s 2023-01-04T18:14:40.824 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:39.730804+0000 mon.smithi050 (mon.0) 497 : audit [INF] from='client.? 172.21.15.50:0/4004642751' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-01-04T18:14:40.825 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:39.730915+0000 mon.smithi050 (mon.0) 498 : cluster [DBG] mds.? [v2:172.21.15.98:6824/1196398070,v1:172.21.15.98:6825/1196398070] up:boot 2023-01-04T18:14:40.825 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:39.731252+0000 mon.smithi050 (mon.0) 499 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 1 up:standby 2023-01-04T18:14:40.825 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:39.731434+0000 mon.smithi050 (mon.0) 500 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.memais"}]: dispatch 2023-01-04T18:14:40.825 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:39.737580+0000 mon.smithi050 (mon.0) 501 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 1 up:standby-replay 2023-01-04T18:14:41.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:39.295340+0000 mgr.smithi050.emnywo (mgr.14162) 202 : cluster [DBG] pgmap v163: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 3.0 KiB/s wr, 9 op/s 2023-01-04T18:14:41.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:39.730804+0000 mon.smithi050 (mon.0) 497 : audit [INF] from='client.? 172.21.15.50:0/4004642751' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-01-04T18:14:41.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:39.730915+0000 mon.smithi050 (mon.0) 498 : cluster [DBG] mds.? [v2:172.21.15.98:6824/1196398070,v1:172.21.15.98:6825/1196398070] up:boot 2023-01-04T18:14:41.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:39.731252+0000 mon.smithi050 (mon.0) 499 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 1 up:standby 2023-01-04T18:14:41.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:39.731434+0000 mon.smithi050 (mon.0) 500 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.memais"}]: dispatch 2023-01-04T18:14:41.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:39.737580+0000 mon.smithi050 (mon.0) 501 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 1 up:standby-replay 2023-01-04T18:14:41.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.758+0000 7fe9266b6700 1 -- 172.21.15.50:0/1561516792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9200f66d0 msgr2=0x7fe9200f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:41.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.758+0000 7fe9266b6700 1 --2- 172.21.15.50:0/1561516792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9200f66d0 0x7fe9200f6b30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fe914004660 tx=0x7fe914009b30).stop 2023-01-04T18:14:41.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.758+0000 7fe9266b6700 1 -- 172.21.15.50:0/1561516792 shutdown_connections 2023-01-04T18:14:41.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.758+0000 7fe9266b6700 1 --2- 172.21.15.50:0/1561516792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9200f66d0 0x7fe9200f6b30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:41.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.758+0000 7fe9266b6700 1 --2- 172.21.15.50:0/1561516792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9200f5430 0x7fe9200f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:41.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.758+0000 7fe9266b6700 1 -- 172.21.15.50:0/1561516792 >> 172.21.15.50:0/1561516792 conn(0x7fe9200f0b90 msgr2=0x7fe9200f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:41.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.759+0000 7fe9266b6700 1 -- 172.21.15.50:0/1561516792 shutdown_connections 2023-01-04T18:14:41.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.759+0000 7fe9266b6700 1 -- 172.21.15.50:0/1561516792 wait complete. 2023-01-04T18:14:41.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.759+0000 7fe9266b6700 1 Processor -- start 2023-01-04T18:14:41.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.759+0000 7fe9266b6700 1 -- start start 2023-01-04T18:14:41.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.759+0000 7fe9266b6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9200f5430 0x7fe9200f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:41.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.759+0000 7fe9266b6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9200f66d0 0x7fe9200f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:41.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.759+0000 7fe9266b6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9200f7f70 con 0x7fe9200f5430 2023-01-04T18:14:41.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.759+0000 7fe9266b6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9200f80b0 con 0x7fe9200f66d0 2023-01-04T18:14:41.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.759+0000 7fe9256b4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9200f5430 0x7fe9200f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:41.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.759+0000 7fe9256b4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9200f5430 0x7fe9200f9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50410/0 (socket says 172.21.15.50:50410) 2023-01-04T18:14:41.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.759+0000 7fe9256b4700 1 -- 172.21.15.50:0/378089119 learned_addr learned my addr 172.21.15.50:0/378089119 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:41.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.760+0000 7fe924eb3700 1 --2- 172.21.15.50:0/378089119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9200f66d0 0x7fe9200f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:41.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.760+0000 7fe9256b4700 1 -- 172.21.15.50:0/378089119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9200f66d0 msgr2=0x7fe9200f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:41.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.760+0000 7fe9256b4700 1 --2- 172.21.15.50:0/378089119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9200f66d0 0x7fe9200f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:41.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.760+0000 7fe9256b4700 1 -- 172.21.15.50:0/378089119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe914005040 con 0x7fe9200f5430 2023-01-04T18:14:41.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.760+0000 7fe924eb3700 1 --2- 172.21.15.50:0/378089119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9200f66d0 0x7fe9200f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:14:41.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.760+0000 7fe9256b4700 1 --2- 172.21.15.50:0/378089119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9200f5430 0x7fe9200f9590 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fe91c00e7c0 tx=0x7fe91c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:41.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.760+0000 7fe911ffb700 1 -- 172.21.15.50:0/378089119 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe91c0092e0 con 0x7fe9200f5430 2023-01-04T18:14:41.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.760+0000 7fe911ffb700 1 -- 172.21.15.50:0/378089119 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe91c00f040 con 0x7fe9200f5430 2023-01-04T18:14:41.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.760+0000 7fe9266b6700 1 -- 172.21.15.50:0/378089119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9200f8390 con 0x7fe9200f5430 2023-01-04T18:14:41.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.760+0000 7fe911ffb700 1 -- 172.21.15.50:0/378089119 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe91c014750 con 0x7fe9200f5430 2023-01-04T18:14:41.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.760+0000 7fe9266b6700 1 -- 172.21.15.50:0/378089119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92010ed20 con 0x7fe9200f5430 2023-01-04T18:14:41.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.761+0000 7fe9266b6700 1 -- 172.21.15.50:0/378089119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe920045ad0 con 0x7fe9200f5430 2023-01-04T18:14:41.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.761+0000 7fe911ffb700 1 -- 172.21.15.50:0/378089119 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fe91c01b030 con 0x7fe9200f5430 2023-01-04T18:14:41.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.762+0000 7fe911ffb700 1 --2- 172.21.15.50:0/378089119 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe90c05c2f0 0x7fe90c05e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:41.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.762+0000 7fe911ffb700 1 -- 172.21.15.50:0/378089119 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fe91c075ea0 con 0x7fe9200f5430 2023-01-04T18:14:41.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.762+0000 7fe924eb3700 1 --2- 172.21.15.50:0/378089119 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe90c05c2f0 0x7fe90c05e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:41.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.762+0000 7fe924eb3700 1 --2- 172.21.15.50:0/378089119 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe90c05c2f0 0x7fe90c05e7b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fe914009720 tx=0x7fe91400b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:41.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.766+0000 7fe911ffb700 1 -- 172.21.15.50:0/378089119 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe91c048b60 con 0x7fe9200f5430 2023-01-04T18:14:41.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:41.985+0000 7fe9266b6700 1 -- 172.21.15.50:0/378089119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe92010f4b0 con 0x7fe9200f5430 2023-01-04T18:14:42.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:40.949311+0000 mon.smithi050 (mon.0) 502 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:42.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:40.949917+0000 mon.smithi050 (mon.0) 503 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:14:42.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:40.949311+0000 mon.smithi050 (mon.0) 502 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:42.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:40.949917+0000 mon.smithi050 (mon.0) 503 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:14:42.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:42.959+0000 7fe911ffb700 1 -- 172.21.15.50:0/378089119 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v9) v1 ==== 168+0+0 (secure 0 0 0) 0x7fe91c019020 con 0x7fe9200f5430 2023-01-04T18:14:42.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:42.975+0000 7fe90b7fe700 1 -- 172.21.15.50:0/378089119 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe90c05c2f0 msgr2=0x7fe90c05e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:42.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:42.975+0000 7fe90b7fe700 1 --2- 172.21.15.50:0/378089119 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe90c05c2f0 0x7fe90c05e7b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fe914009720 tx=0x7fe91400b040).stop 2023-01-04T18:14:42.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:42.975+0000 7fe90b7fe700 1 -- 172.21.15.50:0/378089119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9200f5430 msgr2=0x7fe9200f9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:42.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:42.975+0000 7fe90b7fe700 1 --2- 172.21.15.50:0/378089119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9200f5430 0x7fe9200f9590 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fe91c00e7c0 tx=0x7fe91c00b040).stop 2023-01-04T18:14:42.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:42.975+0000 7fe90b7fe700 1 -- 172.21.15.50:0/378089119 shutdown_connections 2023-01-04T18:14:42.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:42.975+0000 7fe90b7fe700 1 --2- 172.21.15.50:0/378089119 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe90c05c2f0 0x7fe90c05e7b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:42.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:42.975+0000 7fe90b7fe700 1 --2- 172.21.15.50:0/378089119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9200f5430 0x7fe9200f9590 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:42.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:42.975+0000 7fe90b7fe700 1 --2- 172.21.15.50:0/378089119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9200f66d0 0x7fe9200f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:42.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:42.975+0000 7fe90b7fe700 1 -- 172.21.15.50:0/378089119 >> 172.21.15.50:0/378089119 conn(0x7fe9200f0b90 msgr2=0x7fe92005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:42.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:42.975+0000 7fe90b7fe700 1 -- 172.21.15.50:0/378089119 shutdown_connections 2023-01-04T18:14:42.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:42.975+0000 7fe90b7fe700 1 -- 172.21.15.50:0/378089119 wait complete. 2023-01-04T18:14:42.979 INFO:teuthology.orchestra.run.smithi050.stderr:inline data enabled 2023-01-04T18:14:43.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:41.295689+0000 mgr.smithi050.emnywo (mgr.14162) 203 : cluster [DBG] pgmap v164: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 341 B/s rd, 2.0 KiB/s wr, 6 op/s 2023-01-04T18:14:43.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:41.986113+0000 mon.smithi050 (mon.0) 504 : audit [INF] from='client.? 172.21.15.50:0/378089119' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2023-01-04T18:14:43.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:41.295689+0000 mgr.smithi050.emnywo (mgr.14162) 203 : cluster [DBG] pgmap v164: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 341 B/s rd, 2.0 KiB/s wr, 6 op/s 2023-01-04T18:14:43.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:41.986113+0000 mon.smithi050 (mon.0) 504 : audit [INF] from='client.? 172.21.15.50:0/378089119' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2023-01-04T18:14:43.595 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-01-04T18:14:43.605 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi050.front.sepia.ceph.com 2023-01-04T18:14:43.605 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- bash -c 'ceph fs dump' 2023-01-04T18:14:43.958 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:42.953278+0000 mon.smithi050 (mon.0) 505 : cluster [WRN] Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2023-01-04T18:14:43.958 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:42.959571+0000 mon.smithi050 (mon.0) 506 : audit [INF] from='client.? 172.21.15.50:0/378089119' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2023-01-04T18:14:43.959 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:42.959648+0000 mon.smithi050 (mon.0) 507 : cluster [DBG] mds.? [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592] up:boot 2023-01-04T18:14:43.959 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:42.959699+0000 mon.smithi050 (mon.0) 508 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 1 up:standby-replay 1 up:standby 2023-01-04T18:14:44.287 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:42.959813+0000 mon.smithi050 (mon.0) 509 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi050.kefmuy"}]: dispatch 2023-01-04T18:14:44.287 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:43.809115+0000 mon.smithi050 (mon.0) 510 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:44.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:42.953278+0000 mon.smithi050 (mon.0) 505 : cluster [WRN] Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2023-01-04T18:14:44.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:42.959571+0000 mon.smithi050 (mon.0) 506 : audit [INF] from='client.? 172.21.15.50:0/378089119' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2023-01-04T18:14:44.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:42.959648+0000 mon.smithi050 (mon.0) 507 : cluster [DBG] mds.? [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592] up:boot 2023-01-04T18:14:44.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:42.959699+0000 mon.smithi050 (mon.0) 508 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 1 up:standby-replay 1 up:standby 2023-01-04T18:14:44.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:42.959813+0000 mon.smithi050 (mon.0) 509 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi050.kefmuy"}]: dispatch 2023-01-04T18:14:44.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:43.809115+0000 mon.smithi050 (mon.0) 510 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:45.174 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:43.296077+0000 mgr.smithi050.emnywo (mgr.14162) 204 : cluster [DBG] pgmap v165: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2023-01-04T18:14:45.175 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:43.966474+0000 mon.smithi050 (mon.0) 511 : cluster [DBG] mds.? [v2:172.21.15.98:6824/1196398070,v1:172.21.15.98:6825/1196398070] up:standby-replay 2023-01-04T18:14:45.175 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:43.966550+0000 mon.smithi050 (mon.0) 512 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 1 up:standby-replay 1 up:standby 2023-01-04T18:14:45.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:43.296077+0000 mgr.smithi050.emnywo (mgr.14162) 204 : cluster [DBG] pgmap v165: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2023-01-04T18:14:45.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:43.966474+0000 mon.smithi050 (mon.0) 511 : cluster [DBG] mds.? [v2:172.21.15.98:6824/1196398070,v1:172.21.15.98:6825/1196398070] up:standby-replay 2023-01-04T18:14:45.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:43.966550+0000 mon.smithi050 (mon.0) 512 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 1 up:standby-replay 1 up:standby 2023-01-04T18:14:45.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.363+0000 7fba5ac9a700 1 -- 172.21.15.50:0/3326832631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba540f5570 msgr2=0x7fba540f5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:45.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.363+0000 7fba5ac9a700 1 --2- 172.21.15.50:0/3326832631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba540f5570 0x7fba540f5990 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fba48004660 tx=0x7fba48009b30).stop 2023-01-04T18:14:45.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.363+0000 7fba5ac9a700 1 -- 172.21.15.50:0/3326832631 shutdown_connections 2023-01-04T18:14:45.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.363+0000 7fba5ac9a700 1 --2- 172.21.15.50:0/3326832631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba540f6810 0x7fba540f6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:45.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.363+0000 7fba5ac9a700 1 --2- 172.21.15.50:0/3326832631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba540f5570 0x7fba540f5990 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:45.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.363+0000 7fba5ac9a700 1 -- 172.21.15.50:0/3326832631 >> 172.21.15.50:0/3326832631 conn(0x7fba540f0cd0 msgr2=0x7fba540f30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:45.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.363+0000 7fba5ac9a700 1 -- 172.21.15.50:0/3326832631 shutdown_connections 2023-01-04T18:14:45.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.363+0000 7fba5ac9a700 1 -- 172.21.15.50:0/3326832631 wait complete. 2023-01-04T18:14:45.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.363+0000 7fba5ac9a700 1 Processor -- start 2023-01-04T18:14:45.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.363+0000 7fba5ac9a700 1 -- start start 2023-01-04T18:14:45.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.364+0000 7fba5ac9a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba540f5570 0x7fba54109bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:45.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.364+0000 7fba5ac9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba540f6810 0x7fba5410c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:45.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.364+0000 7fba5ac9a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba54060420 con 0x7fba540f6810 2023-01-04T18:14:45.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.364+0000 7fba5ac9a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba54060560 con 0x7fba540f5570 2023-01-04T18:14:45.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.364+0000 7fba53fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba540f6810 0x7fba5410c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:45.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.364+0000 7fba53fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba540f6810 0x7fba5410c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50428/0 (socket says 172.21.15.50:50428) 2023-01-04T18:14:45.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.364+0000 7fba53fff700 1 -- 172.21.15.50:0/3654212420 learned_addr learned my addr 172.21.15.50:0/3654212420 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:45.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.364+0000 7fba58a36700 1 --2- 172.21.15.50:0/3654212420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba540f5570 0x7fba54109bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:45.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.364+0000 7fba53fff700 1 -- 172.21.15.50:0/3654212420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba540f5570 msgr2=0x7fba54109bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:45.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.364+0000 7fba53fff700 1 --2- 172.21.15.50:0/3654212420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba540f5570 0x7fba54109bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:45.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.364+0000 7fba53fff700 1 -- 172.21.15.50:0/3654212420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba48005040 con 0x7fba540f6810 2023-01-04T18:14:45.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.364+0000 7fba53fff700 1 --2- 172.21.15.50:0/3654212420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba540f6810 0x7fba5410c0b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fba4000c530 tx=0x7fba40007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:45.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.365+0000 7fba517fa700 1 -- 172.21.15.50:0/3654212420 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba4000f650 con 0x7fba540f6810 2023-01-04T18:14:45.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.365+0000 7fba517fa700 1 -- 172.21.15.50:0/3654212420 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fba4000fc60 con 0x7fba540f6810 2023-01-04T18:14:45.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.365+0000 7fba5ac9a700 1 -- 172.21.15.50:0/3654212420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba5410c6c0 con 0x7fba540f6810 2023-01-04T18:14:45.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.365+0000 7fba517fa700 1 -- 172.21.15.50:0/3654212420 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba40012c30 con 0x7fba540f6810 2023-01-04T18:14:45.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.365+0000 7fba5ac9a700 1 -- 172.21.15.50:0/3654212420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba5410cc50 con 0x7fba540f6810 2023-01-04T18:14:45.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.366+0000 7fba5ac9a700 1 -- 172.21.15.50:0/3654212420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba540f4960 con 0x7fba540f6810 2023-01-04T18:14:45.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.366+0000 7fba517fa700 1 -- 172.21.15.50:0/3654212420 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fba40010070 con 0x7fba540f6810 2023-01-04T18:14:45.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.366+0000 7fba517fa700 1 --2- 172.21.15.50:0/3654212420 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fba4405c300 0x7fba4405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:45.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.366+0000 7fba517fa700 1 -- 172.21.15.50:0/3654212420 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fba40075b70 con 0x7fba540f6810 2023-01-04T18:14:45.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.367+0000 7fba58a36700 1 --2- 172.21.15.50:0/3654212420 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fba4405c300 0x7fba4405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:45.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.367+0000 7fba58a36700 1 --2- 172.21.15.50:0/3654212420 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fba4405c300 0x7fba4405e7c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fba540600a0 tx=0x7fba48009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:45.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.370+0000 7fba517fa700 1 -- 172.21.15.50:0/3654212420 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fba400452b0 con 0x7fba540f6810 2023-01-04T18:14:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.574+0000 7fba5ac9a700 1 -- 172.21.15.50:0/3654212420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fba540fddc0 con 0x7fba540f6810 2023-01-04T18:14:45.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.574+0000 7fba517fa700 1 -- 172.21.15.50:0/3654212420 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1643 (secure 0 0 0) 0x7fba40048830 con 0x7fba540f6810 2023-01-04T18:14:45.577 INFO:teuthology.orchestra.run.smithi050.stdout:e11 2023-01-04T18:14:45.577 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:14:45.577 INFO:teuthology.orchestra.run.smithi050.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:14:45.577 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-01-04T18:14:45.577 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:14:45.577 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-01-04T18:14:45.577 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-01-04T18:14:45.578 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 10 2023-01-04T18:14:45.578 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 2023-01-04T18:14:45.578 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:14:45.578 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-01-04T18:14:43.958806+0000 2023-01-04T18:14:45.578 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-01-04T18:14:45.578 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-01-04T18:14:45.578 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 60 2023-01-04T18:14:45.578 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-01-04T18:14:45.578 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-01-04T18:14:45.578 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-01-04T18:14:45.578 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-01-04T18:14:45.579 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 0 2023-01-04T18:14:45.579 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:14:45.579 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 1 2023-01-04T18:14:45.579 INFO:teuthology.orchestra.run.smithi050.stdout:in 0 2023-01-04T18:14:45.579 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=14430} 2023-01-04T18:14:45.579 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-01-04T18:14:45.579 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-01-04T18:14:45.579 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-01-04T18:14:45.579 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-01-04T18:14:45.579 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-01-04T18:14:45.579 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data enabled 2023-01-04T18:14:45.579 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-01-04T18:14:45.579 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 1 2023-01-04T18:14:45.580 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.ezoiwl{0:14430} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541]] 2023-01-04T18:14:45.580 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.memais{0:24291} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.98:6824/1196398070,v1:172.21.15.98:6825/1196398070]] 2023-01-04T18:14:45.580 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:14:45.580 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:14:45.580 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2023-01-04T18:14:45.580 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:14:45.580 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.kefmuy{-1:14440} state up:standby seq 2 addr [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592]] 2023-01-04T18:14:45.580 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.laynsk{-1:24297} state up:standby seq 2 addr [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263]] 2023-01-04T18:14:45.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.576+0000 7fba5ac9a700 1 -- 172.21.15.50:0/3654212420 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fba4405c300 msgr2=0x7fba4405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:45.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.576+0000 7fba5ac9a700 1 --2- 172.21.15.50:0/3654212420 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fba4405c300 0x7fba4405e7c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fba540600a0 tx=0x7fba48009b30).stop 2023-01-04T18:14:45.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.576+0000 7fba5ac9a700 1 -- 172.21.15.50:0/3654212420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba540f6810 msgr2=0x7fba5410c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:45.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.576+0000 7fba5ac9a700 1 --2- 172.21.15.50:0/3654212420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba540f6810 0x7fba5410c0b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fba4000c530 tx=0x7fba40007e20).stop 2023-01-04T18:14:45.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.576+0000 7fba5ac9a700 1 -- 172.21.15.50:0/3654212420 shutdown_connections 2023-01-04T18:14:45.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.576+0000 7fba5ac9a700 1 --2- 172.21.15.50:0/3654212420 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fba4405c300 0x7fba4405e7c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:45.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.576+0000 7fba5ac9a700 1 --2- 172.21.15.50:0/3654212420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba540f5570 0x7fba54109bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:45.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.576+0000 7fba5ac9a700 1 --2- 172.21.15.50:0/3654212420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba540f6810 0x7fba5410c0b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:45.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.576+0000 7fba5ac9a700 1 -- 172.21.15.50:0/3654212420 >> 172.21.15.50:0/3654212420 conn(0x7fba540f0cd0 msgr2=0x7fba540fa260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:45.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.576+0000 7fba5ac9a700 1 -- 172.21.15.50:0/3654212420 shutdown_connections 2023-01-04T18:14:45.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:45.576+0000 7fba5ac9a700 1 -- 172.21.15.50:0/3654212420 wait complete. 2023-01-04T18:14:45.582 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 11 2023-01-04T18:14:46.028 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2023-01-04T18:14:46.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:44.970401+0000 mon.smithi050 (mon.0) 513 : cluster [DBG] mds.? [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] up:boot 2023-01-04T18:14:46.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:44.970446+0000 mon.smithi050 (mon.0) 514 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 1 up:standby-replay 2 up:standby 2023-01-04T18:14:46.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:44.970529+0000 mon.smithi050 (mon.0) 515 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.laynsk"}]: dispatch 2023-01-04T18:14:46.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:45.574899+0000 mon.smithi050 (mon.0) 516 : audit [DBG] from='client.? 172.21.15.50:0/3654212420' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:14:46.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:44.970401+0000 mon.smithi050 (mon.0) 513 : cluster [DBG] mds.? [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] up:boot 2023-01-04T18:14:46.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:44.970446+0000 mon.smithi050 (mon.0) 514 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 1 up:standby-replay 2 up:standby 2023-01-04T18:14:46.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:44.970529+0000 mon.smithi050 (mon.0) 515 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.laynsk"}]: dispatch 2023-01-04T18:14:46.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:45.574899+0000 mon.smithi050 (mon.0) 516 : audit [DBG] from='client.? 172.21.15.50:0/3654212420' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:14:47.180 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:45.296431+0000 mgr.smithi050.emnywo (mgr.14162) 205 : cluster [DBG] pgmap v166: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2023-01-04T18:14:47.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:45.296431+0000 mgr.smithi050.emnywo (mgr.14162) 205 : cluster [DBG] pgmap v166: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2023-01-04T18:14:47.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.522+0000 7f18c4567700 1 -- 172.21.15.50:0/1369221371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18bc0f7980 msgr2=0x7f18bc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:47.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.522+0000 7f18c4567700 1 --2- 172.21.15.50:0/1369221371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18bc0f7980 0x7f18bc0f7de0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f18ac004660 tx=0x7f18ac009b30).stop 2023-01-04T18:14:47.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.522+0000 7f18c4567700 1 -- 172.21.15.50:0/1369221371 shutdown_connections 2023-01-04T18:14:47.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.522+0000 7f18c4567700 1 --2- 172.21.15.50:0/1369221371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18bc0f7980 0x7f18bc0f7de0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:47.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.522+0000 7f18c4567700 1 --2- 172.21.15.50:0/1369221371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18bc0f66e0 0x7f18bc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:47.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.522+0000 7f18c4567700 1 -- 172.21.15.50:0/1369221371 >> 172.21.15.50:0/1369221371 conn(0x7f18bc0f1e40 msgr2=0x7f18bc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:47.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.522+0000 7f18c4567700 1 -- 172.21.15.50:0/1369221371 shutdown_connections 2023-01-04T18:14:47.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.522+0000 7f18c4567700 1 -- 172.21.15.50:0/1369221371 wait complete. 2023-01-04T18:14:47.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.522+0000 7f18c4567700 1 Processor -- start 2023-01-04T18:14:47.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.523+0000 7f18c4567700 1 -- start start 2023-01-04T18:14:47.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.523+0000 7f18c4567700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18bc0f66e0 0x7f18bc106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:47.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.523+0000 7f18c4567700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18bc0f7980 0x7f18bc107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:47.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.523+0000 7f18c4567700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc1079d0 con 0x7f18bc0f66e0 2023-01-04T18:14:47.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.523+0000 7f18c4567700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc107b10 con 0x7f18bc0f7980 2023-01-04T18:14:47.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.523+0000 7f18c2303700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18bc0f66e0 0x7f18bc106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:47.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.523+0000 7f18c2303700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18bc0f66e0 0x7f18bc106f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58142/0 (socket says 172.21.15.50:58142) 2023-01-04T18:14:47.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.523+0000 7f18c2303700 1 -- 172.21.15.50:0/2507913778 learned_addr learned my addr 172.21.15.50:0/2507913778 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:47.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.523+0000 7f18c1b02700 1 --2- 172.21.15.50:0/2507913778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18bc0f7980 0x7f18bc107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:47.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.523+0000 7f18c2303700 1 -- 172.21.15.50:0/2507913778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18bc0f7980 msgr2=0x7f18bc107420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:47.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.523+0000 7f18c2303700 1 --2- 172.21.15.50:0/2507913778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18bc0f7980 0x7f18bc107420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:47.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.523+0000 7f18c2303700 1 -- 172.21.15.50:0/2507913778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac005040 con 0x7f18bc0f66e0 2023-01-04T18:14:47.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.523+0000 7f18c2303700 1 --2- 172.21.15.50:0/2507913778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18bc0f66e0 0x7f18bc106f30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f18b8002700 tx=0x7f18b8009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:47.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.523+0000 7f18b2ffd700 1 -- 172.21.15.50:0/2507913778 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18b80079c0 con 0x7f18bc0f66e0 2023-01-04T18:14:47.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.523+0000 7f18c4567700 1 -- 172.21.15.50:0/2507913778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18bc1084b0 con 0x7f18bc0f66e0 2023-01-04T18:14:47.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.523+0000 7f18b2ffd700 1 -- 172.21.15.50:0/2507913778 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f18b800f040 con 0x7f18bc0f66e0 2023-01-04T18:14:47.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.523+0000 7f18b2ffd700 1 -- 172.21.15.50:0/2507913778 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18b8014850 con 0x7f18bc0f66e0 2023-01-04T18:14:47.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.524+0000 7f18c4567700 1 -- 172.21.15.50:0/2507913778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18bc108a70 con 0x7f18bc0f66e0 2023-01-04T18:14:47.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.524+0000 7f18c4567700 1 -- 172.21.15.50:0/2507913778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18bc045ad0 con 0x7f18bc0f66e0 2023-01-04T18:14:47.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.525+0000 7f18b2ffd700 1 -- 172.21.15.50:0/2507913778 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f18b801b060 con 0x7f18bc0f66e0 2023-01-04T18:14:47.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.525+0000 7f18b2ffd700 1 --2- 172.21.15.50:0/2507913778 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f18a805c2b0 0x7f18a805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:47.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.525+0000 7f18b2ffd700 1 -- 172.21.15.50:0/2507913778 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f18b8075de0 con 0x7f18bc0f66e0 2023-01-04T18:14:47.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.525+0000 7f18c1b02700 1 --2- 172.21.15.50:0/2507913778 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f18a805c2b0 0x7f18a805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:47.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.526+0000 7f18c1b02700 1 --2- 172.21.15.50:0/2507913778 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f18a805c2b0 0x7f18a805e770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f18ac009f50 tx=0x7f18ac009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:47.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.529+0000 7f18b2ffd700 1 -- 172.21.15.50:0/2507913778 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f18b8048aa0 con 0x7f18bc0f66e0 2023-01-04T18:14:47.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.729+0000 7f18c4567700 1 -- 172.21.15.50:0/2507913778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18bc0fef70 con 0x7f18bc0f66e0 2023-01-04T18:14:47.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.730+0000 7f18b2ffd700 1 -- 172.21.15.50:0/2507913778 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+3007 (secure 0 0 0) 0x7f18b804c0c0 con 0x7f18bc0f66e0 2023-01-04T18:14:47.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.732+0000 7f18c4567700 1 -- 172.21.15.50:0/2507913778 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f18a805c2b0 msgr2=0x7f18a805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:47.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.732+0000 7f18c4567700 1 --2- 172.21.15.50:0/2507913778 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f18a805c2b0 0x7f18a805e770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f18ac009f50 tx=0x7f18ac009b30).stop 2023-01-04T18:14:47.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.732+0000 7f18c4567700 1 -- 172.21.15.50:0/2507913778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18bc0f66e0 msgr2=0x7f18bc106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:47.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.732+0000 7f18c4567700 1 --2- 172.21.15.50:0/2507913778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18bc0f66e0 0x7f18bc106f30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f18b8002700 tx=0x7f18b8009e00).stop 2023-01-04T18:14:47.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.732+0000 7f18c4567700 1 -- 172.21.15.50:0/2507913778 shutdown_connections 2023-01-04T18:14:47.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.732+0000 7f18c4567700 1 --2- 172.21.15.50:0/2507913778 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f18a805c2b0 0x7f18a805e770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:47.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.732+0000 7f18c4567700 1 --2- 172.21.15.50:0/2507913778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18bc0f66e0 0x7f18bc106f30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:47.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.732+0000 7f18c4567700 1 --2- 172.21.15.50:0/2507913778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18bc0f7980 0x7f18bc107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:47.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.732+0000 7f18c4567700 1 -- 172.21.15.50:0/2507913778 >> 172.21.15.50:0/2507913778 conn(0x7f18bc0f1e40 msgr2=0x7f18bc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:47.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.732+0000 7f18c4567700 1 -- 172.21.15.50:0/2507913778 shutdown_connections 2023-01-04T18:14:47.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:47.732+0000 7f18c4567700 1 -- 172.21.15.50:0/2507913778 wait complete. 2023-01-04T18:14:47.736 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 12 2023-01-04T18:14:47.744 INFO:teuthology.orchestra.run.smithi050.stdout:true 2023-01-04T18:14:48.204 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2023-01-04T18:14:48.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:47.230458+0000 mon.smithi050 (mon.0) 517 : cluster [DBG] mds.? [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592] up:standby 2023-01-04T18:14:48.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:47.230527+0000 mon.smithi050 (mon.0) 518 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 1 up:standby-replay 2 up:standby 2023-01-04T18:14:48.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:47.296920+0000 mgr.smithi050.emnywo (mgr.14162) 206 : cluster [DBG] pgmap v167: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 1023 B/s wr, 5 op/s 2023-01-04T18:14:48.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:47.484945+0000 mon.smithi050 (mon.0) 519 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:48.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:47.488782+0000 mon.smithi050 (mon.0) 520 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:48.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:47.491906+0000 mon.smithi050 (mon.0) 521 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:14:48.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:47.730501+0000 mon.smithi050 (mon.0) 522 : audit [DBG] from='client.? 172.21.15.50:0/2507913778' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-01-04T18:14:48.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:47.230458+0000 mon.smithi050 (mon.0) 517 : cluster [DBG] mds.? [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592] up:standby 2023-01-04T18:14:48.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:47.230527+0000 mon.smithi050 (mon.0) 518 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 1 up:standby-replay 2 up:standby 2023-01-04T18:14:48.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:47.296920+0000 mgr.smithi050.emnywo (mgr.14162) 206 : cluster [DBG] pgmap v167: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 1023 B/s wr, 5 op/s 2023-01-04T18:14:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:47.484945+0000 mon.smithi050 (mon.0) 519 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:47.488782+0000 mon.smithi050 (mon.0) 520 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:47.491906+0000 mon.smithi050 (mon.0) 521 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:14:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:47.730501+0000 mon.smithi050 (mon.0) 522 : audit [DBG] from='client.? 172.21.15.50:0/2507913778' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-01-04T18:14:50.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.066+0000 7f896bc84700 1 -- 172.21.15.50:0/4203512811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89640f66e0 msgr2=0x7f89640f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:50.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.066+0000 7f896bc84700 1 --2- 172.21.15.50:0/4203512811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89640f66e0 0x7f89640f6b00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f8960004660 tx=0x7f8960009b30).stop 2023-01-04T18:14:50.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.066+0000 7f896bc84700 1 -- 172.21.15.50:0/4203512811 shutdown_connections 2023-01-04T18:14:50.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.066+0000 7f896bc84700 1 --2- 172.21.15.50:0/4203512811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89640f7980 0x7f89640f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:50.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.066+0000 7f896bc84700 1 --2- 172.21.15.50:0/4203512811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89640f66e0 0x7f89640f6b00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:50.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.066+0000 7f896bc84700 1 -- 172.21.15.50:0/4203512811 >> 172.21.15.50:0/4203512811 conn(0x7f89640f1e40 msgr2=0x7f89640f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:50.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.066+0000 7f896bc84700 1 -- 172.21.15.50:0/4203512811 shutdown_connections 2023-01-04T18:14:50.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.066+0000 7f896bc84700 1 -- 172.21.15.50:0/4203512811 wait complete. 2023-01-04T18:14:50.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.067+0000 7f896bc84700 1 Processor -- start 2023-01-04T18:14:50.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.067+0000 7f896bc84700 1 -- start start 2023-01-04T18:14:50.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.067+0000 7f896bc84700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89640f66e0 0x7f896406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:50.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.067+0000 7f896bc84700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89640f7980 0x7f8964069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:50.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.067+0000 7f896bc84700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896406a380 con 0x7f89640f7980 2023-01-04T18:14:50.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.067+0000 7f896bc84700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896406a4c0 con 0x7f89640f66e0 2023-01-04T18:14:50.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.067+0000 7f896921f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89640f7980 0x7f8964069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:50.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.067+0000 7f896921f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89640f7980 0x7f8964069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58160/0 (socket says 172.21.15.50:58160) 2023-01-04T18:14:50.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.067+0000 7f896921f700 1 -- 172.21.15.50:0/1754321607 learned_addr learned my addr 172.21.15.50:0/1754321607 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.067+0000 7f8969a20700 1 --2- 172.21.15.50:0/1754321607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89640f66e0 0x7f896406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.067+0000 7f896921f700 1 -- 172.21.15.50:0/1754321607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89640f66e0 msgr2=0x7f896406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.067+0000 7f896921f700 1 --2- 172.21.15.50:0/1754321607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89640f66e0 0x7f896406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.067+0000 7f896921f700 1 -- 172.21.15.50:0/1754321607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8960005040 con 0x7f89640f7980 2023-01-04T18:14:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.067+0000 7f8969a20700 1 --2- 172.21.15.50:0/1754321607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89640f66e0 0x7f896406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:14:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.067+0000 7f896921f700 1 --2- 172.21.15.50:0/1754321607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89640f7980 0x7f8964069e20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f89540026d0 tx=0x7f8954009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.068+0000 7f895a7fc700 1 -- 172.21.15.50:0/1754321607 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8954009320 con 0x7f89640f7980 2023-01-04T18:14:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.068+0000 7f895a7fc700 1 -- 172.21.15.50:0/1754321607 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f895400f040 con 0x7f89640f7980 2023-01-04T18:14:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.068+0000 7f896bc84700 1 -- 172.21.15.50:0/1754321607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f896406a7a0 con 0x7f89640f7980 2023-01-04T18:14:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.068+0000 7f895a7fc700 1 -- 172.21.15.50:0/1754321607 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89540147e0 con 0x7f89640f7980 2023-01-04T18:14:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.068+0000 7f896bc84700 1 -- 172.21.15.50:0/1754321607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896410f000 con 0x7f89640f7980 2023-01-04T18:14:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.069+0000 7f896bc84700 1 -- 172.21.15.50:0/1754321607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8964045ad0 con 0x7f89640f7980 2023-01-04T18:14:50.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.069+0000 7f895a7fc700 1 -- 172.21.15.50:0/1754321607 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f8954009480 con 0x7f89640f7980 2023-01-04T18:14:50.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.069+0000 7f895a7fc700 1 --2- 172.21.15.50:0/1754321607 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f895005c2b0 0x7f895005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:50.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.069+0000 7f895a7fc700 1 -- 172.21.15.50:0/1754321607 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f89540765b0 con 0x7f89640f7980 2023-01-04T18:14:50.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.069+0000 7f8969a20700 1 --2- 172.21.15.50:0/1754321607 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f895005c2b0 0x7f895005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:50.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.070+0000 7f8969a20700 1 --2- 172.21.15.50:0/1754321607 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f895005c2b0 0x7f895005e770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f896406b730 tx=0x7f8960009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:50.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.073+0000 7f895a7fc700 1 -- 172.21.15.50:0/1754321607 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8954049270 con 0x7f89640f7980 2023-01-04T18:14:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.307+0000 7f896bc84700 1 -- 172.21.15.50:0/1754321607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f8964027a00 con 0x7f89640f7980 2023-01-04T18:14:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.308+0000 7f895a7fc700 1 -- 172.21.15.50:0/1754321607 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v13) v1 ==== 78+0+86 (secure 0 0 0) 0x7f895404c890 con 0x7f89640f7980 2023-01-04T18:14:50.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.309+0000 7f896bc84700 1 -- 172.21.15.50:0/1754321607 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f895005c2b0 msgr2=0x7f895005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:50.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.309+0000 7f896bc84700 1 --2- 172.21.15.50:0/1754321607 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f895005c2b0 0x7f895005e770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f896406b730 tx=0x7f8960009b30).stop 2023-01-04T18:14:50.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.309+0000 7f896bc84700 1 -- 172.21.15.50:0/1754321607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89640f7980 msgr2=0x7f8964069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:50.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.309+0000 7f896bc84700 1 --2- 172.21.15.50:0/1754321607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89640f7980 0x7f8964069e20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f89540026d0 tx=0x7f8954009de0).stop 2023-01-04T18:14:50.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.309+0000 7f896bc84700 1 -- 172.21.15.50:0/1754321607 shutdown_connections 2023-01-04T18:14:50.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.309+0000 7f896bc84700 1 --2- 172.21.15.50:0/1754321607 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f895005c2b0 0x7f895005e770 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:50.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.309+0000 7f896bc84700 1 --2- 172.21.15.50:0/1754321607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89640f66e0 0x7f896406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:50.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.309+0000 7f896bc84700 1 --2- 172.21.15.50:0/1754321607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89640f7980 0x7f8964069e20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:50.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.309+0000 7f896bc84700 1 -- 172.21.15.50:0/1754321607 >> 172.21.15.50:0/1754321607 conn(0x7f89640f1e40 msgr2=0x7f89640fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:50.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.310+0000 7f896bc84700 1 -- 172.21.15.50:0/1754321607 shutdown_connections 2023-01-04T18:14:50.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:50.310+0000 7f896bc84700 1 -- 172.21.15.50:0/1754321607 wait complete. 2023-01-04T18:14:50.322 INFO:teuthology.orchestra.run.smithi050.stdout:true 2023-01-04T18:14:50.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:49.235266+0000 mon.smithi050 (mon.0) 523 : cluster [DBG] mds.? [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] up:standby 2023-01-04T18:14:50.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:49.235335+0000 mon.smithi050 (mon.0) 524 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 1 up:standby-replay 2 up:standby 2023-01-04T18:14:50.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:49.297465+0000 mgr.smithi050.emnywo (mgr.14162) 207 : cluster [DBG] pgmap v168: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2023-01-04T18:14:50.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:49.235266+0000 mon.smithi050 (mon.0) 523 : cluster [DBG] mds.? [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] up:standby 2023-01-04T18:14:50.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:49.235335+0000 mon.smithi050 (mon.0) 524 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 1 up:standby-replay 2 up:standby 2023-01-04T18:14:50.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:49.297465+0000 mgr.smithi050.emnywo (mgr.14162) 207 : cluster [DBG] pgmap v168: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2023-01-04T18:14:50.994 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2023-01-04T18:14:51.006 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-04T18:14:51.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.164+0000 7fde456a8700 1 -- 172.21.15.50:0/3807148775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde400f6ab0 msgr2=0x7fde400f6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.164+0000 7fde456a8700 1 --2- 172.21.15.50:0/3807148775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde400f6ab0 0x7fde400f6ed0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fde34004660 tx=0x7fde34009b30).stop 2023-01-04T18:14:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.165+0000 7fde456a8700 1 -- 172.21.15.50:0/3807148775 shutdown_connections 2023-01-04T18:14:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.165+0000 7fde456a8700 1 --2- 172.21.15.50:0/3807148775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde400f50c0 0x7fde400f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.165+0000 7fde456a8700 1 --2- 172.21.15.50:0/3807148775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde400f6ab0 0x7fde400f6ed0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.165+0000 7fde456a8700 1 -- 172.21.15.50:0/3807148775 >> 172.21.15.50:0/3807148775 conn(0x7fde400f0b40 msgr2=0x7fde400f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.165+0000 7fde456a8700 1 -- 172.21.15.50:0/3807148775 shutdown_connections 2023-01-04T18:14:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.165+0000 7fde456a8700 1 -- 172.21.15.50:0/3807148775 wait complete. 2023-01-04T18:14:51.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.165+0000 7fde456a8700 1 Processor -- start 2023-01-04T18:14:51.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.166+0000 7fde456a8700 1 -- start start 2023-01-04T18:14:51.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.166+0000 7fde456a8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde400f50c0 0x7fde40105b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:51.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.166+0000 7fde456a8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde400f6ab0 0x7fde40106020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:51.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.166+0000 7fde456a8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde401065d0 con 0x7fde400f50c0 2023-01-04T18:14:51.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.166+0000 7fde456a8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde40106710 con 0x7fde400f6ab0 2023-01-04T18:14:51.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.166+0000 7fde3effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde400f50c0 0x7fde40105b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:51.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.166+0000 7fde3effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde400f50c0 0x7fde40105b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58174/0 (socket says 172.21.15.50:58174) 2023-01-04T18:14:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.166+0000 7fde3effd700 1 -- 172.21.15.50:0/3245889536 learned_addr learned my addr 172.21.15.50:0/3245889536 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.166+0000 7fde3e7fc700 1 --2- 172.21.15.50:0/3245889536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde400f6ab0 0x7fde40106020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.166+0000 7fde3effd700 1 -- 172.21.15.50:0/3245889536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde400f6ab0 msgr2=0x7fde40106020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.166+0000 7fde3effd700 1 --2- 172.21.15.50:0/3245889536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde400f6ab0 0x7fde40106020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.166+0000 7fde3effd700 1 -- 172.21.15.50:0/3245889536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde34005040 con 0x7fde400f50c0 2023-01-04T18:14:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.166+0000 7fde3e7fc700 1 --2- 172.21.15.50:0/3245889536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde400f6ab0 0x7fde40106020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-01-04T18:14:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.166+0000 7fde3effd700 1 --2- 172.21.15.50:0/3245889536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde400f50c0 0x7fde40105b30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fde34000c00 tx=0x7fde3400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.166+0000 7fde277fe700 1 -- 172.21.15.50:0/3245889536 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde3401b070 con 0x7fde400f50c0 2023-01-04T18:14:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.166+0000 7fde456a8700 1 -- 172.21.15.50:0/3245889536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde4005f290 con 0x7fde400f50c0 2023-01-04T18:14:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.166+0000 7fde277fe700 1 -- 172.21.15.50:0/3245889536 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fde34007e70 con 0x7fde400f50c0 2023-01-04T18:14:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.166+0000 7fde277fe700 1 -- 172.21.15.50:0/3245889536 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde34014db0 con 0x7fde400f50c0 2023-01-04T18:14:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.167+0000 7fde456a8700 1 -- 172.21.15.50:0/3245889536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde4005f850 con 0x7fde400f50c0 2023-01-04T18:14:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.167+0000 7fde456a8700 1 -- 172.21.15.50:0/3245889536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde40046330 con 0x7fde400f50c0 2023-01-04T18:14:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.168+0000 7fde277fe700 1 -- 172.21.15.50:0/3245889536 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fde34027070 con 0x7fde400f50c0 2023-01-04T18:14:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.168+0000 7fde277fe700 1 --2- 172.21.15.50:0/3245889536 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fde2805c310 0x7fde2805e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.168+0000 7fde277fe700 1 -- 172.21.15.50:0/3245889536 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fde34078b90 con 0x7fde400f50c0 2023-01-04T18:14:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.168+0000 7fde3e7fc700 1 --2- 172.21.15.50:0/3245889536 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fde2805c310 0x7fde2805e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.168+0000 7fde3e7fc700 1 --2- 172.21.15.50:0/3245889536 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fde2805c310 0x7fde2805e7d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fde30009da0 tx=0x7fde3000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.172+0000 7fde277fe700 1 -- 172.21.15.50:0/3245889536 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fde3404b850 con 0x7fde400f50c0 2023-01-04T18:14:51.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.351+0000 7fde456a8700 1 -- 172.21.15.50:0/3245889536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde400fdc70 con 0x7fde400f50c0 2023-01-04T18:14:51.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.352+0000 7fde277fe700 1 -- 172.21.15.50:0/3245889536 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+14058 (secure 0 0 0) 0x7fde3404ee70 con 0x7fde400f50c0 2023-01-04T18:14:51.355 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:14:51.355 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":41,"fsid":"d98671da-8c5a-11ed-821a-001a4aab830c","created":"2023-01-04T18:09:16.009200+0000","modified":"2023-01-04T18:14:32.395916+0000","last_up_change":"2023-01-04T18:13:22.225898+0000","last_in_change":"2023-01-04T18:13:05.868442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-01-04T18:12:40.118167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-01-04T18:14:29.272955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-01-04T18:14:29.814288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"364b88f0-63eb-4ee0-9961-6d394328fb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6803","nonce":2221606938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6805","nonce":2221606938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6809","nonce":2221606938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6807","nonce":2221606938}]},"public_addr":"172.21.15.50:6803/2221606938","cluster_addr":"172.21.15.50:6805/2221606938","heartbeat_back_addr":"172.21.15.50:6809/2221606938","heartbeat_front_addr":"172.21.15.50:6807/2221606938","state":["exists","up"]},{"osd":1,"uuid":"2e3617b7-4f5a-417f-ac90-d557ed55507f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6811","nonce":2500190979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6813","nonce":2500190979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6817","nonce":2500190979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6815","nonce":2500190979}]},"public_addr":"172.21.15.50:6811/2500190979","cluster_addr":"172.21.15.50:6813/2500190979","heartbeat_back_addr":"172.21.15.50:6817/2500190979","heartbeat_front_addr":"172.21.15.50:6815/2500190979","state":["exists","up"]},{"osd":2,"uuid":"f5fb8cb5-19be-471e-a297-0cfa6721f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6819","nonce":1577657554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6821","nonce":1577657554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6825","nonce":1577657554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6823","nonce":1577657554}]},"public_addr":"172.21.15.50:6819/1577657554","cluster_addr":"172.21.15.50:6821/1577657554","heartbeat_back_addr":"172.21.15.50:6825/1577657554","heartbeat_front_addr":"172.21.15.50:6823/1577657554","state":["exists","up"]},{"osd":3,"uuid":"ebc8dd52-f41d-4d85-a3bd-16ad8d121436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6801","nonce":4254376132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6803","nonce":4254376132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6807","nonce":4254376132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6805","nonce":4254376132}]},"public_addr":"172.21.15.98:6801/4254376132","cluster_addr":"172.21.15.98:6803/4254376132","heartbeat_back_addr":"172.21.15.98:6807/4254376132","heartbeat_front_addr":"172.21.15.98:6805/4254376132","state":["exists","up"]},{"osd":4,"uuid":"37f00733-dce6-4862-96b7-2eab49821451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6809","nonce":3371156908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6811","nonce":3371156908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6815","nonce":3371156908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6813","nonce":3371156908}]},"public_addr":"172.21.15.98:6809/3371156908","cluster_addr":"172.21.15.98:6811/3371156908","heartbeat_back_addr":"172.21.15.98:6815/3371156908","heartbeat_front_addr":"172.21.15.98:6813/3371156908","state":["exists","up"]},{"osd":5,"uuid":"773a186f-cbc1-40a2-a7ae-183f3bbdfd9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6817","nonce":764254549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6819","nonce":764254549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6823","nonce":764254549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6821","nonce":764254549}]},"public_addr":"172.21.15.98:6817/764254549","cluster_addr":"172.21.15.98:6819/764254549","heartbeat_back_addr":"172.21.15.98:6823/764254549","heartbeat_front_addr":"172.21.15.98:6821/764254549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:11:53.534560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:12:10.806420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:12:28.093489+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:12:44.642140+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:13:02.605039+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:13:21.050426+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/2515216785":"2023-01-05T18:10:13.194077+0000","172.21.15.50:0/878334031":"2023-01-05T18:10:13.194077+0000","172.21.15.50:6801/3751193798":"2023-01-05T18:09:59.360317+0000","172.21.15.50:6801/2515216785":"2023-01-05T18:10:13.194077+0000","172.21.15.50:0/1004257612":"2023-01-05T18:10:13.194077+0000","172.21.15.50:0/1815506343":"2023-01-05T18:09:59.360317+0000","172.21.15.50:0/2856929359":"2023-01-05T18:09:59.360317+0000","172.21.15.50:6800/27207172":"2023-01-05T18:09:35.421204+0000","172.21.15.50:6800/3751193798":"2023-01-05T18:09:59.360317+0000","172.21.15.50:0/2199987942":"2023-01-05T18:09:35.421204+0000","172.21.15.50:6801/27207172":"2023-01-05T18:09:35.421204+0000","172.21.15.50:0/1586567006":"2023-01-05T18:09:35.421204+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-04T18:14:51.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.354+0000 7fde456a8700 1 -- 172.21.15.50:0/3245889536 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fde2805c310 msgr2=0x7fde2805e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:51.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.354+0000 7fde456a8700 1 --2- 172.21.15.50:0/3245889536 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fde2805c310 0x7fde2805e7d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fde30009da0 tx=0x7fde3000b040).stop 2023-01-04T18:14:51.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.354+0000 7fde456a8700 1 -- 172.21.15.50:0/3245889536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde400f50c0 msgr2=0x7fde40105b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:51.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.354+0000 7fde456a8700 1 --2- 172.21.15.50:0/3245889536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde400f50c0 0x7fde40105b30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fde34000c00 tx=0x7fde3400b040).stop 2023-01-04T18:14:51.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.354+0000 7fde456a8700 1 -- 172.21.15.50:0/3245889536 shutdown_connections 2023-01-04T18:14:51.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.354+0000 7fde456a8700 1 --2- 172.21.15.50:0/3245889536 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fde2805c310 0x7fde2805e7d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:51.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.354+0000 7fde456a8700 1 --2- 172.21.15.50:0/3245889536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde400f50c0 0x7fde40105b30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:51.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.354+0000 7fde456a8700 1 --2- 172.21.15.50:0/3245889536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde400f6ab0 0x7fde40106020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:51.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.354+0000 7fde456a8700 1 -- 172.21.15.50:0/3245889536 >> 172.21.15.50:0/3245889536 conn(0x7fde400f0b40 msgr2=0x7fde400fa0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:51.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.354+0000 7fde456a8700 1 -- 172.21.15.50:0/3245889536 shutdown_connections 2023-01-04T18:14:51.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.354+0000 7fde456a8700 1 -- 172.21.15.50:0/3245889536 wait complete. 2023-01-04T18:14:51.370 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-01-04T18:12:40.118167+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-01-04T18:14:29.272955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-01-04T18:14:29.814288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-01-04T18:14:51.370 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-01-04T18:14:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.495+0000 7f04c4830700 1 -- 172.21.15.50:0/1461519085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04c00f7730 msgr2=0x7f04c00f7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.495+0000 7f04c4830700 1 --2- 172.21.15.50:0/1461519085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04c00f7730 0x7f04c00f7b90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f04b4004660 tx=0x7f04b4009b30).stop 2023-01-04T18:14:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.495+0000 7f04c4830700 1 -- 172.21.15.50:0/1461519085 shutdown_connections 2023-01-04T18:14:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.495+0000 7f04c4830700 1 --2- 172.21.15.50:0/1461519085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04c00f7730 0x7f04c00f7b90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.495+0000 7f04c4830700 1 --2- 172.21.15.50:0/1461519085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04c00f6490 0x7f04c00f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.495+0000 7f04c4830700 1 -- 172.21.15.50:0/1461519085 >> 172.21.15.50:0/1461519085 conn(0x7f04c00f1bd0 msgr2=0x7f04c00f4010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:51.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.495+0000 7f04c4830700 1 -- 172.21.15.50:0/1461519085 shutdown_connections 2023-01-04T18:14:51.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.495+0000 7f04c4830700 1 -- 172.21.15.50:0/1461519085 wait complete. 2023-01-04T18:14:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.496+0000 7f04c4830700 1 Processor -- start 2023-01-04T18:14:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.496+0000 7f04c4830700 1 -- start start 2023-01-04T18:14:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.496+0000 7f04c4830700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04c00f6490 0x7f04c0106c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.496+0000 7f04c4830700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04c00f7730 0x7f04c0107110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.496+0000 7f04c4830700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c0107710 con 0x7f04c00f7730 2023-01-04T18:14:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.496+0000 7f04c4830700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c0107850 con 0x7f04c00f6490 2023-01-04T18:14:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.497+0000 7f04bdd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04c00f7730 0x7f04c0107110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.497+0000 7f04bdd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04c00f7730 0x7f04c0107110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58180/0 (socket says 172.21.15.50:58180) 2023-01-04T18:14:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.497+0000 7f04bdd9b700 1 -- 172.21.15.50:0/3349133751 learned_addr learned my addr 172.21.15.50:0/3349133751 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.497+0000 7f04be59c700 1 --2- 172.21.15.50:0/3349133751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04c00f6490 0x7f04c0106c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.497+0000 7f04bdd9b700 1 -- 172.21.15.50:0/3349133751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04c00f6490 msgr2=0x7f04c0106c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.497+0000 7f04bdd9b700 1 --2- 172.21.15.50:0/3349133751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04c00f6490 0x7f04c0106c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.497+0000 7f04bdd9b700 1 -- 172.21.15.50:0/3349133751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b4005040 con 0x7f04c00f7730 2023-01-04T18:14:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.497+0000 7f04be59c700 1 --2- 172.21.15.50:0/3349133751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04c00f6490 0x7f04c0106c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:14:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.497+0000 7f04bdd9b700 1 --2- 172.21.15.50:0/3349133751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04c00f7730 0x7f04c0107110 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f04b4000c00 tx=0x7f04b400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:51.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.497+0000 7f04aeffd700 1 -- 172.21.15.50:0/3349133751 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04b4019070 con 0x7f04c00f7730 2023-01-04T18:14:51.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.497+0000 7f04aeffd700 1 -- 172.21.15.50:0/3349133751 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f04b4007e70 con 0x7f04c00f7730 2023-01-04T18:14:51.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.497+0000 7f04c4830700 1 -- 172.21.15.50:0/3349133751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c010c200 con 0x7f04c00f7730 2023-01-04T18:14:51.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.497+0000 7f04aeffd700 1 -- 172.21.15.50:0/3349133751 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04b4014d00 con 0x7f04c00f7730 2023-01-04T18:14:51.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.497+0000 7f04c4830700 1 -- 172.21.15.50:0/3349133751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c010c760 con 0x7f04c00f7730 2023-01-04T18:14:51.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.498+0000 7f04c4830700 1 -- 172.21.15.50:0/3349133751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c0027a00 con 0x7f04c00f7730 2023-01-04T18:14:51.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.499+0000 7f04aeffd700 1 -- 172.21.15.50:0/3349133751 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f04b4025070 con 0x7f04c00f7730 2023-01-04T18:14:51.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.499+0000 7f04aeffd700 1 --2- 172.21.15.50:0/3349133751 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f04a805c2b0 0x7f04a805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:51.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.499+0000 7f04aeffd700 1 -- 172.21.15.50:0/3349133751 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f04b4076f30 con 0x7f04c00f7730 2023-01-04T18:14:51.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.499+0000 7f04be59c700 1 --2- 172.21.15.50:0/3349133751 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f04a805c2b0 0x7f04a805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:51.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.499+0000 7f04be59c700 1 --2- 172.21.15.50:0/3349133751 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f04a805c2b0 0x7f04a805e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f04c0108110 tx=0x7f04b000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:51.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.503+0000 7f04aeffd700 1 -- 172.21.15.50:0/3349133751 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f04b40a32b0 con 0x7f04c00f7730 2023-01-04T18:14:51.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:50.309339+0000 mon.smithi050 (mon.0) 525 : audit [DBG] from='client.? 172.21.15.50:0/1754321607' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-01-04T18:14:51.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:50.458808+0000 mon.smithi050 (mon.0) 526 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:51.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:51 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:50.309339+0000 mon.smithi050 (mon.0) 525 : audit [DBG] from='client.? 172.21.15.50:0/1754321607' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-01-04T18:14:51.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:51 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:50.458808+0000 mon.smithi050 (mon.0) 526 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.674+0000 7f04c4830700 1 -- 172.21.15.50:0/3349133751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f04c00fec20 con 0x7f04c00f7730 2023-01-04T18:14:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.675+0000 7f04aeffd700 1 -- 172.21.15.50:0/3349133751 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v41) v1 ==== 110+0+10 (secure 0 0 0) 0x7f04b4023030 con 0x7f04c00f7730 2023-01-04T18:14:51.678 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-01-04T18:14:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.676+0000 7f04c4830700 1 -- 172.21.15.50:0/3349133751 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f04a805c2b0 msgr2=0x7f04a805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.676+0000 7f04c4830700 1 --2- 172.21.15.50:0/3349133751 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f04a805c2b0 0x7f04a805e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f04c0108110 tx=0x7f04b000b040).stop 2023-01-04T18:14:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.676+0000 7f04c4830700 1 -- 172.21.15.50:0/3349133751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04c00f7730 msgr2=0x7f04c0107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.677+0000 7f04c4830700 1 --2- 172.21.15.50:0/3349133751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04c00f7730 0x7f04c0107110 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f04b4000c00 tx=0x7f04b400b040).stop 2023-01-04T18:14:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.677+0000 7f04c4830700 1 -- 172.21.15.50:0/3349133751 shutdown_connections 2023-01-04T18:14:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.677+0000 7f04c4830700 1 --2- 172.21.15.50:0/3349133751 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f04a805c2b0 0x7f04a805e770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.677+0000 7f04c4830700 1 --2- 172.21.15.50:0/3349133751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04c00f6490 0x7f04c0106c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.677+0000 7f04c4830700 1 --2- 172.21.15.50:0/3349133751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04c00f7730 0x7f04c0107110 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.677+0000 7f04c4830700 1 -- 172.21.15.50:0/3349133751 >> 172.21.15.50:0/3349133751 conn(0x7f04c00f1bd0 msgr2=0x7f04c00fb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.677+0000 7f04c4830700 1 -- 172.21.15.50:0/3349133751 shutdown_connections 2023-01-04T18:14:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.677+0000 7f04c4830700 1 -- 172.21.15.50:0/3349133751 wait complete. 2023-01-04T18:14:51.692 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-01-04T18:14:51.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.815+0000 7f2535d63700 1 -- 172.21.15.50:0/1001836266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25300f9600 msgr2=0x7f25300fb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:51.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.815+0000 7f2535d63700 1 --2- 172.21.15.50:0/1001836266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25300f9600 0x7f25300fb9f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f25180099e0 tx=0x7f2518004d10).stop 2023-01-04T18:14:51.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.815+0000 7f2535d63700 1 -- 172.21.15.50:0/1001836266 shutdown_connections 2023-01-04T18:14:51.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.815+0000 7f2535d63700 1 --2- 172.21.15.50:0/1001836266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25300f9600 0x7f25300fb9f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:51.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.815+0000 7f2535d63700 1 --2- 172.21.15.50:0/1001836266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f253005fe30 0x7f25300f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:51.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.815+0000 7f2535d63700 1 -- 172.21.15.50:0/1001836266 >> 172.21.15.50:0/1001836266 conn(0x7f25300f0b70 msgr2=0x7f25300f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:51.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.815+0000 7f2535d63700 1 -- 172.21.15.50:0/1001836266 shutdown_connections 2023-01-04T18:14:51.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.815+0000 7f2535d63700 1 -- 172.21.15.50:0/1001836266 wait complete. 2023-01-04T18:14:51.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.815+0000 7f2535d63700 1 Processor -- start 2023-01-04T18:14:51.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.815+0000 7f2535d63700 1 -- start start 2023-01-04T18:14:51.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.816+0000 7f2535d63700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f253005fe30 0x7f25300f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:51.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.816+0000 7f2535d63700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25300f9600 0x7f25300f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:51.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.816+0000 7f2535d63700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25300f6f60 con 0x7f25300f9600 2023-01-04T18:14:51.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.816+0000 7f2535d63700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25300f5500 con 0x7f253005fe30 2023-01-04T18:14:51.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.816+0000 7f252effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25300f9600 0x7f25300f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:51.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.816+0000 7f252effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25300f9600 0x7f25300f5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58210/0 (socket says 172.21.15.50:58210) 2023-01-04T18:14:51.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.816+0000 7f252effd700 1 -- 172.21.15.50:0/1244552009 learned_addr learned my addr 172.21.15.50:0/1244552009 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:51.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.816+0000 7f252f7fe700 1 --2- 172.21.15.50:0/1244552009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f253005fe30 0x7f25300f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:51.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.816+0000 7f252effd700 1 -- 172.21.15.50:0/1244552009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f253005fe30 msgr2=0x7f25300f69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:51.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.816+0000 7f252effd700 1 --2- 172.21.15.50:0/1244552009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f253005fe30 0x7f25300f69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:51.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.816+0000 7f252effd700 1 -- 172.21.15.50:0/1244552009 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2518009640 con 0x7f25300f9600 2023-01-04T18:14:51.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.816+0000 7f252effd700 1 --2- 172.21.15.50:0/1244552009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25300f9600 0x7f25300f5010 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f2518004b70 tx=0x7f2518004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:51.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.816+0000 7f2527fff700 1 -- 172.21.15.50:0/1244552009 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f251800e070 con 0x7f25300f9600 2023-01-04T18:14:51.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.816+0000 7f2527fff700 1 -- 172.21.15.50:0/1244552009 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2518007d10 con 0x7f25300f9600 2023-01-04T18:14:51.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.816+0000 7f2535d63700 1 -- 172.21.15.50:0/1244552009 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25300f5720 con 0x7f25300f9600 2023-01-04T18:14:51.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.816+0000 7f2527fff700 1 -- 172.21.15.50:0/1244552009 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2518018070 con 0x7f25300f9600 2023-01-04T18:14:51.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.816+0000 7f2535d63700 1 -- 172.21.15.50:0/1244552009 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25300f5c00 con 0x7f25300f9600 2023-01-04T18:14:51.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.817+0000 7f2535d63700 1 -- 172.21.15.50:0/1244552009 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2530046330 con 0x7f25300f9600 2023-01-04T18:14:51.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.818+0000 7f2527fff700 1 -- 172.21.15.50:0/1244552009 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f2518024060 con 0x7f25300f9600 2023-01-04T18:14:51.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.818+0000 7f2527fff700 1 --2- 172.21.15.50:0/1244552009 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f251c05c2b0 0x7f251c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:51.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.818+0000 7f2527fff700 1 -- 172.21.15.50:0/1244552009 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f2518077570 con 0x7f25300f9600 2023-01-04T18:14:51.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.818+0000 7f252f7fe700 1 --2- 172.21.15.50:0/1244552009 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f251c05c2b0 0x7f251c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:51.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.818+0000 7f252f7fe700 1 --2- 172.21.15.50:0/1244552009 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f251c05c2b0 0x7f251c05e770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f253005fc00 tx=0x7f252000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:51.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.822+0000 7f2527fff700 1 -- 172.21.15.50:0/1244552009 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f251804a2b0 con 0x7f25300f9600 2023-01-04T18:14:51.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.986+0000 7f2535d63700 1 -- 172.21.15.50:0/1244552009 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f2530027a00 con 0x7f25300f9600 2023-01-04T18:14:51.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.986+0000 7f2527fff700 1 -- 172.21.15.50:0/1244552009 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v41) v1 ==== 107+0+11 (secure 0 0 0) 0x7f251804d8d0 con 0x7f25300f9600 2023-01-04T18:14:51.990 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-01-04T18:14:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.988+0000 7f2535d63700 1 -- 172.21.15.50:0/1244552009 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f251c05c2b0 msgr2=0x7f251c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.988+0000 7f2535d63700 1 --2- 172.21.15.50:0/1244552009 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f251c05c2b0 0x7f251c05e770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f253005fc00 tx=0x7f252000b040).stop 2023-01-04T18:14:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.988+0000 7f2535d63700 1 -- 172.21.15.50:0/1244552009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25300f9600 msgr2=0x7f25300f5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.988+0000 7f2535d63700 1 --2- 172.21.15.50:0/1244552009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25300f9600 0x7f25300f5010 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f2518004b70 tx=0x7f2518004d10).stop 2023-01-04T18:14:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.988+0000 7f2535d63700 1 -- 172.21.15.50:0/1244552009 shutdown_connections 2023-01-04T18:14:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.988+0000 7f2535d63700 1 --2- 172.21.15.50:0/1244552009 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f251c05c2b0 0x7f251c05e770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:51.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.988+0000 7f2535d63700 1 --2- 172.21.15.50:0/1244552009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f253005fe30 0x7f25300f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:51.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.988+0000 7f2535d63700 1 --2- 172.21.15.50:0/1244552009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25300f9600 0x7f25300f5010 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:51.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.988+0000 7f2535d63700 1 -- 172.21.15.50:0/1244552009 >> 172.21.15.50:0/1244552009 conn(0x7f25300f0b70 msgr2=0x7f25300f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:51.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.988+0000 7f2535d63700 1 -- 172.21.15.50:0/1244552009 shutdown_connections 2023-01-04T18:14:51.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:51.988+0000 7f2535d63700 1 -- 172.21.15.50:0/1244552009 wait complete. 2023-01-04T18:14:52.005 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-01-04T18:14:52.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.130+0000 7feaacd6e700 1 -- 172.21.15.50:0/2708051535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa80f5ca0 msgr2=0x7feaa80f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:52.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.130+0000 7feaacd6e700 1 --2- 172.21.15.50:0/2708051535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa80f5ca0 0x7feaa80f66d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fea98004660 tx=0x7fea98009b30).stop 2023-01-04T18:14:52.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.130+0000 7feaacd6e700 1 -- 172.21.15.50:0/2708051535 shutdown_connections 2023-01-04T18:14:52.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.130+0000 7feaacd6e700 1 --2- 172.21.15.50:0/2708051535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa80f5ca0 0x7feaa80f66d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:52.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.130+0000 7feaacd6e700 1 --2- 172.21.15.50:0/2708051535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feaa80f5390 0x7feaa80f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:52.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.130+0000 7feaacd6e700 1 -- 172.21.15.50:0/2708051535 >> 172.21.15.50:0/2708051535 conn(0x7feaa80f0b70 msgr2=0x7feaa80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:52.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.130+0000 7feaacd6e700 1 -- 172.21.15.50:0/2708051535 shutdown_connections 2023-01-04T18:14:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.130+0000 7feaacd6e700 1 -- 172.21.15.50:0/2708051535 wait complete. 2023-01-04T18:14:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.131+0000 7feaacd6e700 1 Processor -- start 2023-01-04T18:14:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.131+0000 7feaacd6e700 1 -- start start 2023-01-04T18:14:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.131+0000 7feaacd6e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feaa80f5390 0x7feaa8105b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.131+0000 7feaacd6e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa80f5ca0 0x7feaa8105ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.131+0000 7feaacd6e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa81065a0 con 0x7feaa80f5ca0 2023-01-04T18:14:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.131+0000 7feaacd6e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa81066e0 con 0x7feaa80f5390 2023-01-04T18:14:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.131+0000 7feaa5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa80f5ca0 0x7feaa8105ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.131+0000 7feaa5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa80f5ca0 0x7feaa8105ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58224/0 (socket says 172.21.15.50:58224) 2023-01-04T18:14:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.131+0000 7feaa5d9b700 1 -- 172.21.15.50:0/2771004387 learned_addr learned my addr 172.21.15.50:0/2771004387 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.131+0000 7feaa659c700 1 --2- 172.21.15.50:0/2771004387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feaa80f5390 0x7feaa8105b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:52.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.131+0000 7feaa659c700 1 -- 172.21.15.50:0/2771004387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa80f5ca0 msgr2=0x7feaa8105ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:52.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.131+0000 7feaa659c700 1 --2- 172.21.15.50:0/2771004387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa80f5ca0 0x7feaa8105ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:52.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.131+0000 7feaa659c700 1 -- 172.21.15.50:0/2771004387 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea98005040 con 0x7feaa80f5390 2023-01-04T18:14:52.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.131+0000 7feaa5d9b700 1 --2- 172.21.15.50:0/2771004387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa80f5ca0 0x7feaa8105ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-01-04T18:14:52.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.131+0000 7feaa659c700 1 --2- 172.21.15.50:0/2771004387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feaa80f5390 0x7feaa8105b00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fea9c00e7c0 tx=0x7fea9c00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:52.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.132+0000 7fea96ffd700 1 -- 172.21.15.50:0/2771004387 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea9c0092e0 con 0x7feaa80f5390 2023-01-04T18:14:52.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.132+0000 7feaacd6e700 1 -- 172.21.15.50:0/2771004387 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa805f240 con 0x7feaa80f5390 2023-01-04T18:14:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.132+0000 7fea96ffd700 1 -- 172.21.15.50:0/2771004387 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fea9c00f040 con 0x7feaa80f5390 2023-01-04T18:14:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.132+0000 7fea96ffd700 1 -- 172.21.15.50:0/2771004387 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea9c014880 con 0x7feaa80f5390 2023-01-04T18:14:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.132+0000 7feaacd6e700 1 -- 172.21.15.50:0/2771004387 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa805f800 con 0x7feaa80f5390 2023-01-04T18:14:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.133+0000 7feaacd6e700 1 -- 172.21.15.50:0/2771004387 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa80fdb50 con 0x7feaa80f5390 2023-01-04T18:14:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.133+0000 7fea96ffd700 1 -- 172.21.15.50:0/2771004387 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fea9c01b030 con 0x7feaa80f5390 2023-01-04T18:14:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.133+0000 7fea96ffd700 1 --2- 172.21.15.50:0/2771004387 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fea9005c2b0 0x7fea9005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.133+0000 7fea96ffd700 1 -- 172.21.15.50:0/2771004387 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fea9c075d00 con 0x7feaa80f5390 2023-01-04T18:14:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.133+0000 7feaa5d9b700 1 --2- 172.21.15.50:0/2771004387 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fea9005c2b0 0x7fea9005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.134+0000 7feaa5d9b700 1 --2- 172.21.15.50:0/2771004387 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fea9005c2b0 0x7fea9005e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fea98009d60 tx=0x7fea98018040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:52.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.137+0000 7fea96ffd700 1 -- 172.21.15.50:0/2771004387 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fea9c079030 con 0x7feaa80f5390 2023-01-04T18:14:52.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:51.297839+0000 mgr.smithi050.emnywo (mgr.14162) 208 : cluster [DBG] pgmap v169: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 2 op/s 2023-01-04T18:14:52.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:51.353083+0000 mon.smithi050 (mon.0) 527 : audit [DBG] from='client.? 172.21.15.50:0/3245889536' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-01-04T18:14:52.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:51.676233+0000 mon.smithi050 (mon.0) 528 : audit [DBG] from='client.? 172.21.15.50:0/3349133751' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2023-01-04T18:14:52.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:51.988004+0000 mon.smithi050 (mon.0) 529 : audit [DBG] from='client.? 172.21.15.50:0/1244552009' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-01-04T18:14:52.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.299+0000 7feaacd6e700 1 -- 172.21.15.50:0/2771004387 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7feaa80ff9d0 con 0x7feaa80f5390 2023-01-04T18:14:52.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.300+0000 7fea96ffd700 1 -- 172.21.15.50:0/2771004387 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v41) v1 ==== 107+0+11 (secure 0 0 0) 0x7fea9c0190b0 con 0x7feaa80f5390 2023-01-04T18:14:52.303 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-01-04T18:14:52.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.302+0000 7feaacd6e700 1 -- 172.21.15.50:0/2771004387 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fea9005c2b0 msgr2=0x7fea9005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:52.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.302+0000 7feaacd6e700 1 --2- 172.21.15.50:0/2771004387 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fea9005c2b0 0x7fea9005e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fea98009d60 tx=0x7fea98018040).stop 2023-01-04T18:14:52.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.303+0000 7feaacd6e700 1 -- 172.21.15.50:0/2771004387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feaa80f5390 msgr2=0x7feaa8105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:52.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.303+0000 7feaacd6e700 1 --2- 172.21.15.50:0/2771004387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feaa80f5390 0x7feaa8105b00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fea9c00e7c0 tx=0x7fea9c00b040).stop 2023-01-04T18:14:52.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.303+0000 7feaacd6e700 1 -- 172.21.15.50:0/2771004387 shutdown_connections 2023-01-04T18:14:52.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.303+0000 7feaacd6e700 1 --2- 172.21.15.50:0/2771004387 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fea9005c2b0 0x7fea9005e770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:52.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.303+0000 7feaacd6e700 1 --2- 172.21.15.50:0/2771004387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feaa80f5390 0x7feaa8105b00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:52.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.303+0000 7feaacd6e700 1 --2- 172.21.15.50:0/2771004387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa80f5ca0 0x7feaa8105ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:52.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.303+0000 7feaacd6e700 1 -- 172.21.15.50:0/2771004387 >> 172.21.15.50:0/2771004387 conn(0x7feaa80f0b70 msgr2=0x7feaa80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:52.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.303+0000 7feaacd6e700 1 -- 172.21.15.50:0/2771004387 shutdown_connections 2023-01-04T18:14:52.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.303+0000 7feaacd6e700 1 -- 172.21.15.50:0/2771004387 wait complete. 2023-01-04T18:14:52.318 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-01-04T18:14:52.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.438+0000 7f375011b700 1 -- 172.21.15.50:0/2576403214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37480f9620 msgr2=0x7f37480fba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:52.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.438+0000 7f375011b700 1 --2- 172.21.15.50:0/2576403214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37480f9620 0x7f37480fba10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f3738004660 tx=0x7f3738009b30).stop 2023-01-04T18:14:52.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.438+0000 7f375011b700 1 -- 172.21.15.50:0/2576403214 shutdown_connections 2023-01-04T18:14:52.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.438+0000 7f375011b700 1 --2- 172.21.15.50:0/2576403214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37480f9620 0x7f37480fba10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:52.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.438+0000 7f375011b700 1 --2- 172.21.15.50:0/2576403214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f374805fe80 0x7f37480f9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:52.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.438+0000 7f375011b700 1 -- 172.21.15.50:0/2576403214 >> 172.21.15.50:0/2576403214 conn(0x7f37480f0bd0 msgr2=0x7f37480f2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:52.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.438+0000 7f375011b700 1 -- 172.21.15.50:0/2576403214 shutdown_connections 2023-01-04T18:14:52.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.438+0000 7f375011b700 1 -- 172.21.15.50:0/2576403214 wait complete. 2023-01-04T18:14:52.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.439+0000 7f375011b700 1 Processor -- start 2023-01-04T18:14:52.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.439+0000 7f375011b700 1 -- start start 2023-01-04T18:14:52.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.439+0000 7f375011b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f374805fe80 0x7f3748106b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:52.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.439+0000 7f375011b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37480f9620 0x7f3748107030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:52.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.439+0000 7f375011b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37481075e0 con 0x7f37480f9620 2023-01-04T18:14:52.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.439+0000 7f375011b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3748107720 con 0x7f374805fe80 2023-01-04T18:14:52.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.439+0000 7f374d6b6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37480f9620 0x7f3748107030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:52.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.439+0000 7f374d6b6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37480f9620 0x7f3748107030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58252/0 (socket says 172.21.15.50:58252) 2023-01-04T18:14:52.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.439+0000 7f374d6b6700 1 -- 172.21.15.50:0/707707295 learned_addr learned my addr 172.21.15.50:0/707707295 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:52.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.439+0000 7f374deb7700 1 --2- 172.21.15.50:0/707707295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f374805fe80 0x7f3748106b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:52.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.439+0000 7f374d6b6700 1 -- 172.21.15.50:0/707707295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f374805fe80 msgr2=0x7f3748106b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:52.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.439+0000 7f374d6b6700 1 --2- 172.21.15.50:0/707707295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f374805fe80 0x7f3748106b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:52.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.439+0000 7f374d6b6700 1 -- 172.21.15.50:0/707707295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3738005040 con 0x7f37480f9620 2023-01-04T18:14:52.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.439+0000 7f374d6b6700 1 --2- 172.21.15.50:0/707707295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37480f9620 0x7f3748107030 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f3738000c00 tx=0x7f373800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:52.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.439+0000 7f373e7fc700 1 -- 172.21.15.50:0/707707295 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3738019070 con 0x7f37480f9620 2023-01-04T18:14:52.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.439+0000 7f373e7fc700 1 -- 172.21.15.50:0/707707295 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3738007e70 con 0x7f37480f9620 2023-01-04T18:14:52.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.440+0000 7f375011b700 1 -- 172.21.15.50:0/707707295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374810c160 con 0x7f37480f9620 2023-01-04T18:14:52.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.440+0000 7f373e7fc700 1 -- 172.21.15.50:0/707707295 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3738014c90 con 0x7f37480f9620 2023-01-04T18:14:52.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.440+0000 7f375011b700 1 -- 172.21.15.50:0/707707295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374810c720 con 0x7f37480f9620 2023-01-04T18:14:52.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.440+0000 7f375011b700 1 -- 172.21.15.50:0/707707295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3748027a00 con 0x7f37480f9620 2023-01-04T18:14:52.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.441+0000 7f373e7fc700 1 -- 172.21.15.50:0/707707295 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f3738025070 con 0x7f37480f9620 2023-01-04T18:14:52.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.441+0000 7f373e7fc700 1 --2- 172.21.15.50:0/707707295 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f373405c370 0x7f373405e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:52.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.442+0000 7f373e7fc700 1 -- 172.21.15.50:0/707707295 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f3738076f20 con 0x7f37480f9620 2023-01-04T18:14:52.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.442+0000 7f374deb7700 1 --2- 172.21.15.50:0/707707295 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f373405c370 0x7f373405e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:52.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.442+0000 7f374deb7700 1 --2- 172.21.15.50:0/707707295 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f373405c370 0x7f373405e830 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f3744009fd0 tx=0x7f374400b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:52.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.446+0000 7f373e7fc700 1 -- 172.21.15.50:0/707707295 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f37380a32b0 con 0x7f37480f9620 2023-01-04T18:14:52.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:51.297839+0000 mgr.smithi050.emnywo (mgr.14162) 208 : cluster [DBG] pgmap v169: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 2 op/s 2023-01-04T18:14:52.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:51.353083+0000 mon.smithi050 (mon.0) 527 : audit [DBG] from='client.? 172.21.15.50:0/3245889536' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-01-04T18:14:52.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:51.676233+0000 mon.smithi050 (mon.0) 528 : audit [DBG] from='client.? 172.21.15.50:0/3349133751' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2023-01-04T18:14:52.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:51.988004+0000 mon.smithi050 (mon.0) 529 : audit [DBG] from='client.? 172.21.15.50:0/1244552009' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-01-04T18:14:52.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.647+0000 7f375011b700 1 -- 172.21.15.50:0/707707295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37480fec50 con 0x7f37480f9620 2023-01-04T18:14:52.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.647+0000 7f373e7fc700 1 -- 172.21.15.50:0/707707295 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3006 (secure 0 0 0) 0x7f3738049be0 con 0x7f37480f9620 2023-01-04T18:14:52.651 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:14:52.651 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14440,"name":"cephfs.smithi050.kefmuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.50:6829/3827606592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3827606592},{"type":"v1","addr":"172.21.15.50:6829","nonce":3827606592}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":12},{"gid":24297,"name":"cephfs.smithi098.laynsk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.98:6827/1785480263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1785480263},{"type":"v1","addr":"172.21.15.98:6827","nonce":1785480263}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":10,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:14:43.958806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14430":{"gid":14430,"name":"cephfs.smithi050.ezoiwl","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.50:6827/4069909541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4069909541},{"type":"v1","addr":"172.21.15.50:6827","nonce":4069909541}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_24291":{"gid":24291,"name":"cephfs.smithi098.memais","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":3,"addr":"172.21.15.98:6825/1196398070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1196398070},{"type":"v1","addr":"172.21.15.98:6825","nonce":1196398070}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:14:52.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.649+0000 7f375011b700 1 -- 172.21.15.50:0/707707295 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f373405c370 msgr2=0x7f373405e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:52.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.649+0000 7f375011b700 1 --2- 172.21.15.50:0/707707295 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f373405c370 0x7f373405e830 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f3744009fd0 tx=0x7f374400b040).stop 2023-01-04T18:14:52.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.649+0000 7f375011b700 1 -- 172.21.15.50:0/707707295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37480f9620 msgr2=0x7f3748107030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:52.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.649+0000 7f375011b700 1 --2- 172.21.15.50:0/707707295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37480f9620 0x7f3748107030 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f3738000c00 tx=0x7f373800b040).stop 2023-01-04T18:14:52.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.649+0000 7f375011b700 1 -- 172.21.15.50:0/707707295 shutdown_connections 2023-01-04T18:14:52.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.649+0000 7f375011b700 1 --2- 172.21.15.50:0/707707295 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f373405c370 0x7f373405e830 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:52.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.649+0000 7f375011b700 1 --2- 172.21.15.50:0/707707295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f374805fe80 0x7f3748106b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:52.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.649+0000 7f375011b700 1 --2- 172.21.15.50:0/707707295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37480f9620 0x7f3748107030 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:52.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.649+0000 7f375011b700 1 -- 172.21.15.50:0/707707295 >> 172.21.15.50:0/707707295 conn(0x7f37480f0bd0 msgr2=0x7f37480f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:52.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.649+0000 7f375011b700 1 -- 172.21.15.50:0/707707295 shutdown_connections 2023-01-04T18:14:52.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:52.649+0000 7f375011b700 1 -- 172.21.15.50:0/707707295 wait complete. 2023-01-04T18:14:52.654 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2023-01-04T18:14:52.664 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 10, 'max_mds': 1, 'flags': 50} 2023-01-04T18:14:52.664 INFO:teuthology.run_tasks:Running task kclient... 2023-01-04T18:14:52.687 INFO:tasks.kclient:Mounting kernel clients... 2023-01-04T18:14:52.687 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-01-04T18:14:52.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:52.688 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-01-04T18:14:52.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:52.707 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-01-04T18:14:52.776 INFO:teuthology.orchestra.run.smithi050.stderr:Cannot find device "ceph-brx" 2023-01-04T18:14:52.777 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-04T18:14:52.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:52.777 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-01-04T18:14:52.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:52.800 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link delete ceph-brx 2023-01-04T18:14:52.878 INFO:teuthology.orchestra.run.smithi098.stderr:Cannot find device "ceph-brx" 2023-01-04T18:14:52.880 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-04T18:14:52.880 INFO:tasks.kclient:client.0 config is {} 2023-01-04T18:14:52.880 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-01-04T18:14:52.880 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-01-04T18:14:52.880 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-01-04T18:14:52.880 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-01-04T18:14:52.881 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-01-04T18:14:52.881 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-01-04T18:14:52.881 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-01-04T18:14:52.881 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-01-04T18:14:52.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:52.881 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-01-04T18:14:52.901 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-01-04T18:14:52.901 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-01-04T18:14:52.901 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-01-04T18:14:52.901 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-01-04T18:14:52.901 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-01-04T18:14:52.901 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-01-04T18:14:52.901 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-01-04T18:14:52.901 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-01-04T18:14:52.901 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-01-04T18:14:52.901 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-01-04T18:14:52.901 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-01-04T18:14:52.901 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-01-04T18:14:52.902 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-01-04T18:14:52.902 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-01-04T18:14:52.902 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-01-04T18:14:52.902 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-01-04T18:14:52.902 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 41646sec preferred_lft 41646sec 2023-01-04T18:14:52.902 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-01-04T18:14:52.902 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-01-04T18:14:52.902 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-01-04T18:14:52.902 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-01-04T18:14:52.902 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-01-04T18:14:52.903 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-01-04T18:14:52.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:52.903 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-01-04T18:14:52.903 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-01-04T18:14:52.903 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2023-01-04T18:14:52.903 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2023-01-04T18:14:52.903 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2023-01-04T18:14:52.903 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-01-04T18:14:52.903 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-01-04T18:14:53.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:53.088 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-01-04T18:14:53.117 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-01-04T18:14:53.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:53.118 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-01-04T18:14:53.197 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-01-04T18:14:53.197 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-01-04T18:14:53.197 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-01-04T18:14:53.197 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-01-04T18:14:53.197 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-01-04T18:14:53.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:53.198 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-01-04T18:14:53.198 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-01-04T18:14:53.198 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-01-04T18:14:53.198 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-01-04T18:14:53.198 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-01-04T18:14:53.198 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-01-04T18:14:53.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:53.461 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-01-04T18:14:53.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:53.479 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2023-01-04T18:14:53.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:53.537 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-01-04T18:14:53.537 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-01-04T18:14:53.537 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-01-04T18:14:53.537 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-01-04T18:14:53.537 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-01-04T18:14:53.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:52.301142+0000 mon.smithi098 (mon.1) 15 : audit [DBG] from='client.? 172.21.15.50:0/2771004387' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-01-04T18:14:53.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:52.648866+0000 mon.smithi050 (mon.0) 530 : audit [DBG] from='client.? 172.21.15.50:0/707707295' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-01-04T18:14:53.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:53.025117+0000 mon.smithi050 (mon.0) 531 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:53.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:53.028848+0000 mon.smithi050 (mon.0) 532 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:53.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:52.301142+0000 mon.smithi098 (mon.1) 15 : audit [DBG] from='client.? 172.21.15.50:0/2771004387' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-01-04T18:14:53.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:52.648866+0000 mon.smithi050 (mon.0) 530 : audit [DBG] from='client.? 172.21.15.50:0/707707295' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-01-04T18:14:53.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:53.025117+0000 mon.smithi050 (mon.0) 531 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:53.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:53.028848+0000 mon.smithi050 (mon.0) 532 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:14:53.596 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-01-04T18:14:53.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:53.596 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-01-04T18:14:53.596 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-01-04T18:14:53.597 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-01-04T18:14:53.597 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-01-04T18:14:53.597 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-01-04T18:14:53.597 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-01-04T18:14:53.597 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-01-04T18:14:53.597 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-01-04T18:14:53.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:53.827 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-01-04T18:14:53.827 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-01-04T18:14:53.827 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-01-04T18:14:53.827 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2023-01-04T18:14:53.828 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-01-04T18:14:53.949 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-04T18:14:54.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.074+0000 7f1078505700 1 -- 172.21.15.50:0/651513047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f107005fe80 msgr2=0x7f10700f9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:54.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.074+0000 7f1078505700 1 --2- 172.21.15.50:0/651513047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f107005fe80 0x7f10700f9130 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f106c004660 tx=0x7f106c009b30).stop 2023-01-04T18:14:54.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.075+0000 7f1078505700 1 -- 172.21.15.50:0/651513047 shutdown_connections 2023-01-04T18:14:54.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.075+0000 7f1078505700 1 --2- 172.21.15.50:0/651513047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10700f9620 0x7f10700fba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:54.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.075+0000 7f1078505700 1 --2- 172.21.15.50:0/651513047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f107005fe80 0x7f10700f9130 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:54.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.075+0000 7f1078505700 1 -- 172.21.15.50:0/651513047 >> 172.21.15.50:0/651513047 conn(0x7f10700f0bd0 msgr2=0x7f10700f2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:54.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.075+0000 7f1078505700 1 -- 172.21.15.50:0/651513047 shutdown_connections 2023-01-04T18:14:54.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.075+0000 7f1078505700 1 -- 172.21.15.50:0/651513047 wait complete. 2023-01-04T18:14:54.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.075+0000 7f1078505700 1 Processor -- start 2023-01-04T18:14:54.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.075+0000 7f1078505700 1 -- start start 2023-01-04T18:14:54.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.076+0000 7f1078505700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f107005fe80 0x7f1070106b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:54.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.076+0000 7f1078505700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10700f9620 0x7f1070107070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:54.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.076+0000 7f1078505700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1070107620 con 0x7f10700f9620 2023-01-04T18:14:54.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.076+0000 7f1078505700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1070107760 con 0x7f107005fe80 2023-01-04T18:14:54.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.076+0000 7f1075aa0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10700f9620 0x7f1070107070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:54.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.076+0000 7f1075aa0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10700f9620 0x7f1070107070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58278/0 (socket says 172.21.15.50:58278) 2023-01-04T18:14:54.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.076+0000 7f1075aa0700 1 -- 172.21.15.50:0/3273492177 learned_addr learned my addr 172.21.15.50:0/3273492177 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:54.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.076+0000 7f10762a1700 1 --2- 172.21.15.50:0/3273492177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f107005fe80 0x7f1070106b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:54.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.076+0000 7f1075aa0700 1 -- 172.21.15.50:0/3273492177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f107005fe80 msgr2=0x7f1070106b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:54.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.076+0000 7f1075aa0700 1 --2- 172.21.15.50:0/3273492177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f107005fe80 0x7f1070106b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:54.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.076+0000 7f1075aa0700 1 -- 172.21.15.50:0/3273492177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c005040 con 0x7f10700f9620 2023-01-04T18:14:54.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.076+0000 7f1075aa0700 1 --2- 172.21.15.50:0/3273492177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10700f9620 0x7f1070107070 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f106000e7f0 tx=0x7f106000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:54.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.076+0000 7f1066ffd700 1 -- 172.21.15.50:0/3273492177 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10600092e0 con 0x7f10700f9620 2023-01-04T18:14:54.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.076+0000 7f1078505700 1 -- 172.21.15.50:0/3273492177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f107010c200 con 0x7f10700f9620 2023-01-04T18:14:54.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.076+0000 7f1066ffd700 1 -- 172.21.15.50:0/3273492177 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f106000f040 con 0x7f10700f9620 2023-01-04T18:14:54.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.076+0000 7f1066ffd700 1 -- 172.21.15.50:0/3273492177 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1060014750 con 0x7f10700f9620 2023-01-04T18:14:54.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.076+0000 7f1078505700 1 -- 172.21.15.50:0/3273492177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107010c7c0 con 0x7f10700f9620 2023-01-04T18:14:54.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.078+0000 7f1078505700 1 -- 172.21.15.50:0/3273492177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1070027a00 con 0x7f10700f9620 2023-01-04T18:14:54.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.078+0000 7f1066ffd700 1 -- 172.21.15.50:0/3273492177 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f106001b030 con 0x7f10700f9620 2023-01-04T18:14:54.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.078+0000 7f1066ffd700 1 --2- 172.21.15.50:0/3273492177 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f105c05c370 0x7f105c05e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:54.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.078+0000 7f1066ffd700 1 -- 172.21.15.50:0/3273492177 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f1060075cb0 con 0x7f10700f9620 2023-01-04T18:14:54.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.078+0000 7f10762a1700 1 --2- 172.21.15.50:0/3273492177 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f105c05c370 0x7f105c05e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:54.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.079+0000 7f10762a1700 1 --2- 172.21.15.50:0/3273492177 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f105c05c370 0x7f105c05e830 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f106c013530 tx=0x7f106c016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:54.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.084+0000 7f1066ffd700 1 -- 172.21.15.50:0/3273492177 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f1060048a20 con 0x7f10700f9620 2023-01-04T18:14:54.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.246+0000 7f1078505700 1 -- 172.21.15.50:0/3273492177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10700fec50 con 0x7f10700f9620 2023-01-04T18:14:54.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.247+0000 7f1066ffd700 1 -- 172.21.15.50:0/3273492177 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+14058 (secure 0 0 0) 0x7f1060019070 con 0x7f10700f9620 2023-01-04T18:14:54.251 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:14:54.251 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":41,"fsid":"d98671da-8c5a-11ed-821a-001a4aab830c","created":"2023-01-04T18:09:16.009200+0000","modified":"2023-01-04T18:14:32.395916+0000","last_up_change":"2023-01-04T18:13:22.225898+0000","last_in_change":"2023-01-04T18:13:05.868442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-01-04T18:12:40.118167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-01-04T18:14:29.272955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-01-04T18:14:29.814288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"364b88f0-63eb-4ee0-9961-6d394328fb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6803","nonce":2221606938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6805","nonce":2221606938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6809","nonce":2221606938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6807","nonce":2221606938}]},"public_addr":"172.21.15.50:6803/2221606938","cluster_addr":"172.21.15.50:6805/2221606938","heartbeat_back_addr":"172.21.15.50:6809/2221606938","heartbeat_front_addr":"172.21.15.50:6807/2221606938","state":["exists","up"]},{"osd":1,"uuid":"2e3617b7-4f5a-417f-ac90-d557ed55507f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6811","nonce":2500190979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6813","nonce":2500190979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6817","nonce":2500190979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6815","nonce":2500190979}]},"public_addr":"172.21.15.50:6811/2500190979","cluster_addr":"172.21.15.50:6813/2500190979","heartbeat_back_addr":"172.21.15.50:6817/2500190979","heartbeat_front_addr":"172.21.15.50:6815/2500190979","state":["exists","up"]},{"osd":2,"uuid":"f5fb8cb5-19be-471e-a297-0cfa6721f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6819","nonce":1577657554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6821","nonce":1577657554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6825","nonce":1577657554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6823","nonce":1577657554}]},"public_addr":"172.21.15.50:6819/1577657554","cluster_addr":"172.21.15.50:6821/1577657554","heartbeat_back_addr":"172.21.15.50:6825/1577657554","heartbeat_front_addr":"172.21.15.50:6823/1577657554","state":["exists","up"]},{"osd":3,"uuid":"ebc8dd52-f41d-4d85-a3bd-16ad8d121436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6801","nonce":4254376132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6803","nonce":4254376132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6807","nonce":4254376132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6805","nonce":4254376132}]},"public_addr":"172.21.15.98:6801/4254376132","cluster_addr":"172.21.15.98:6803/4254376132","heartbeat_back_addr":"172.21.15.98:6807/4254376132","heartbeat_front_addr":"172.21.15.98:6805/4254376132","state":["exists","up"]},{"osd":4,"uuid":"37f00733-dce6-4862-96b7-2eab49821451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6809","nonce":3371156908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6811","nonce":3371156908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6815","nonce":3371156908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6813","nonce":3371156908}]},"public_addr":"172.21.15.98:6809/3371156908","cluster_addr":"172.21.15.98:6811/3371156908","heartbeat_back_addr":"172.21.15.98:6815/3371156908","heartbeat_front_addr":"172.21.15.98:6813/3371156908","state":["exists","up"]},{"osd":5,"uuid":"773a186f-cbc1-40a2-a7ae-183f3bbdfd9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6817","nonce":764254549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6819","nonce":764254549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6823","nonce":764254549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6821","nonce":764254549}]},"public_addr":"172.21.15.98:6817/764254549","cluster_addr":"172.21.15.98:6819/764254549","heartbeat_back_addr":"172.21.15.98:6823/764254549","heartbeat_front_addr":"172.21.15.98:6821/764254549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:11:53.534560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:12:10.806420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:12:28.093489+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:12:44.642140+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:13:02.605039+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:13:21.050426+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/2515216785":"2023-01-05T18:10:13.194077+0000","172.21.15.50:0/878334031":"2023-01-05T18:10:13.194077+0000","172.21.15.50:6801/3751193798":"2023-01-05T18:09:59.360317+0000","172.21.15.50:6801/2515216785":"2023-01-05T18:10:13.194077+0000","172.21.15.50:0/1004257612":"2023-01-05T18:10:13.194077+0000","172.21.15.50:0/1815506343":"2023-01-05T18:09:59.360317+0000","172.21.15.50:0/2856929359":"2023-01-05T18:09:59.360317+0000","172.21.15.50:6800/27207172":"2023-01-05T18:09:35.421204+0000","172.21.15.50:6800/3751193798":"2023-01-05T18:09:59.360317+0000","172.21.15.50:0/2199987942":"2023-01-05T18:09:35.421204+0000","172.21.15.50:6801/27207172":"2023-01-05T18:09:35.421204+0000","172.21.15.50:0/1586567006":"2023-01-05T18:09:35.421204+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-04T18:14:54.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.250+0000 7f1078505700 1 -- 172.21.15.50:0/3273492177 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f105c05c370 msgr2=0x7f105c05e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:54.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.250+0000 7f1078505700 1 --2- 172.21.15.50:0/3273492177 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f105c05c370 0x7f105c05e830 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f106c013530 tx=0x7f106c016040).stop 2023-01-04T18:14:54.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.250+0000 7f1078505700 1 -- 172.21.15.50:0/3273492177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10700f9620 msgr2=0x7f1070107070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:54.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.250+0000 7f1078505700 1 --2- 172.21.15.50:0/3273492177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10700f9620 0x7f1070107070 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f106000e7f0 tx=0x7f106000b040).stop 2023-01-04T18:14:54.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.250+0000 7f1078505700 1 -- 172.21.15.50:0/3273492177 shutdown_connections 2023-01-04T18:14:54.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.250+0000 7f1078505700 1 --2- 172.21.15.50:0/3273492177 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f105c05c370 0x7f105c05e830 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:54.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.250+0000 7f1078505700 1 --2- 172.21.15.50:0/3273492177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f107005fe80 0x7f1070106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:54.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.250+0000 7f1078505700 1 --2- 172.21.15.50:0/3273492177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10700f9620 0x7f1070107070 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:54.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.250+0000 7f1078505700 1 -- 172.21.15.50:0/3273492177 >> 172.21.15.50:0/3273492177 conn(0x7f10700f0bd0 msgr2=0x7f10700f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:54.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.250+0000 7f1078505700 1 -- 172.21.15.50:0/3273492177 shutdown_connections 2023-01-04T18:14:54.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.250+0000 7f1078505700 1 -- 172.21.15.50:0/3273492177 wait complete. 2023-01-04T18:14:54.266 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-01-04T18:12:40.118167+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-01-04T18:14:29.272955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-01-04T18:14:29.814288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-01-04T18:14:54.266 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-01-04T18:14:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.389+0000 7f84ea6e2700 1 -- 172.21.15.50:0/2874270583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e40f7730 msgr2=0x7f84e40f7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.389+0000 7f84ea6e2700 1 --2- 172.21.15.50:0/2874270583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e40f7730 0x7f84e40f7b90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f84d8004660 tx=0x7f84d8009b30).stop 2023-01-04T18:14:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.389+0000 7f84ea6e2700 1 -- 172.21.15.50:0/2874270583 shutdown_connections 2023-01-04T18:14:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.389+0000 7f84ea6e2700 1 --2- 172.21.15.50:0/2874270583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e40f7730 0x7f84e40f7b90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.389+0000 7f84ea6e2700 1 --2- 172.21.15.50:0/2874270583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84e40f6490 0x7f84e40f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.389+0000 7f84ea6e2700 1 -- 172.21.15.50:0/2874270583 >> 172.21.15.50:0/2874270583 conn(0x7f84e40f1bd0 msgr2=0x7f84e40f4010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.389+0000 7f84ea6e2700 1 -- 172.21.15.50:0/2874270583 shutdown_connections 2023-01-04T18:14:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.389+0000 7f84ea6e2700 1 -- 172.21.15.50:0/2874270583 wait complete. 2023-01-04T18:14:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.390+0000 7f84ea6e2700 1 Processor -- start 2023-01-04T18:14:54.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.390+0000 7f84ea6e2700 1 -- start start 2023-01-04T18:14:54.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.390+0000 7f84ea6e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84e40f6490 0x7f84e4106c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:54.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.390+0000 7f84ea6e2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e40f7730 0x7f84e4107130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:54.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.390+0000 7f84ea6e2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e4107730 con 0x7f84e40f6490 2023-01-04T18:14:54.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.390+0000 7f84ea6e2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e4107870 con 0x7f84e40f7730 2023-01-04T18:14:54.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.390+0000 7f84e3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84e40f6490 0x7f84e4106c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:54.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.390+0000 7f84e3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84e40f6490 0x7f84e4106c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58288/0 (socket says 172.21.15.50:58288) 2023-01-04T18:14:54.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.390+0000 7f84e3fff700 1 -- 172.21.15.50:0/3481572899 learned_addr learned my addr 172.21.15.50:0/3481572899 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:54.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.391+0000 7f84e37fe700 1 --2- 172.21.15.50:0/3481572899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e40f7730 0x7f84e4107130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:54.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.391+0000 7f84e3fff700 1 -- 172.21.15.50:0/3481572899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e40f7730 msgr2=0x7f84e4107130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:54.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.391+0000 7f84e3fff700 1 --2- 172.21.15.50:0/3481572899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e40f7730 0x7f84e4107130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:54.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.391+0000 7f84e3fff700 1 -- 172.21.15.50:0/3481572899 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d8005040 con 0x7f84e40f6490 2023-01-04T18:14:54.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.391+0000 7f84e3fff700 1 --2- 172.21.15.50:0/3481572899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84e40f6490 0x7f84e4106c40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f84d400e7c0 tx=0x7f84d400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:54.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.391+0000 7f84e0ff9700 1 -- 172.21.15.50:0/3481572899 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84d40092e0 con 0x7f84e40f6490 2023-01-04T18:14:54.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.391+0000 7f84ea6e2700 1 -- 172.21.15.50:0/3481572899 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e410c280 con 0x7f84e40f6490 2023-01-04T18:14:54.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.391+0000 7f84e0ff9700 1 -- 172.21.15.50:0/3481572899 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f84d400f040 con 0x7f84e40f6490 2023-01-04T18:14:54.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.391+0000 7f84e0ff9700 1 -- 172.21.15.50:0/3481572899 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84d40147c0 con 0x7f84e40f6490 2023-01-04T18:14:54.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.391+0000 7f84ea6e2700 1 -- 172.21.15.50:0/3481572899 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e410c840 con 0x7f84e40f6490 2023-01-04T18:14:54.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.392+0000 7f84ea6e2700 1 -- 172.21.15.50:0/3481572899 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e4027a00 con 0x7f84e40f6490 2023-01-04T18:14:54.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.393+0000 7f84e0ff9700 1 -- 172.21.15.50:0/3481572899 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f84d401b030 con 0x7f84e40f6490 2023-01-04T18:14:54.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.393+0000 7f84e0ff9700 1 --2- 172.21.15.50:0/3481572899 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f84cc05c2b0 0x7f84cc05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:54.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.393+0000 7f84e0ff9700 1 -- 172.21.15.50:0/3481572899 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f84d4075de0 con 0x7f84e40f6490 2023-01-04T18:14:54.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.393+0000 7f84e37fe700 1 --2- 172.21.15.50:0/3481572899 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f84cc05c2b0 0x7f84cc05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:54.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.394+0000 7f84e37fe700 1 --2- 172.21.15.50:0/3481572899 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f84cc05c2b0 0x7f84cc05e770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f84d8005010 tx=0x7f84d8016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:54.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.397+0000 7f84e0ff9700 1 -- 172.21.15.50:0/3481572899 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f84d4048b50 con 0x7f84e40f6490 2023-01-04T18:14:54.508 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:53.298285+0000 mgr.smithi050.emnywo (mgr.14162) 209 : cluster [DBG] pgmap v170: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2023-01-04T18:14:54.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.557+0000 7f84ea6e2700 1 -- 172.21.15.50:0/3481572899 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f84e40fec20 con 0x7f84e40f6490 2023-01-04T18:14:54.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.558+0000 7f84e0ff9700 1 -- 172.21.15.50:0/3481572899 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v41) v1 ==== 110+0+10 (secure 0 0 0) 0x7f84d4019030 con 0x7f84e40f6490 2023-01-04T18:14:54.561 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-01-04T18:14:54.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.559+0000 7f84ea6e2700 1 -- 172.21.15.50:0/3481572899 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f84cc05c2b0 msgr2=0x7f84cc05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:54.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.559+0000 7f84ea6e2700 1 --2- 172.21.15.50:0/3481572899 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f84cc05c2b0 0x7f84cc05e770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f84d8005010 tx=0x7f84d8016040).stop 2023-01-04T18:14:54.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.559+0000 7f84ea6e2700 1 -- 172.21.15.50:0/3481572899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84e40f6490 msgr2=0x7f84e4106c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:54.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.559+0000 7f84ea6e2700 1 --2- 172.21.15.50:0/3481572899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84e40f6490 0x7f84e4106c40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f84d400e7c0 tx=0x7f84d400b040).stop 2023-01-04T18:14:54.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.560+0000 7f84ea6e2700 1 -- 172.21.15.50:0/3481572899 shutdown_connections 2023-01-04T18:14:54.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.560+0000 7f84ea6e2700 1 --2- 172.21.15.50:0/3481572899 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f84cc05c2b0 0x7f84cc05e770 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:54.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.560+0000 7f84ea6e2700 1 --2- 172.21.15.50:0/3481572899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84e40f6490 0x7f84e4106c40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:54.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.560+0000 7f84ea6e2700 1 --2- 172.21.15.50:0/3481572899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e40f7730 0x7f84e4107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:54.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.560+0000 7f84ea6e2700 1 -- 172.21.15.50:0/3481572899 >> 172.21.15.50:0/3481572899 conn(0x7f84e40f1bd0 msgr2=0x7f84e40fb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:54.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.560+0000 7f84ea6e2700 1 -- 172.21.15.50:0/3481572899 shutdown_connections 2023-01-04T18:14:54.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.560+0000 7f84ea6e2700 1 -- 172.21.15.50:0/3481572899 wait complete. 2023-01-04T18:14:54.575 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-01-04T18:14:54.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:53.298285+0000 mgr.smithi050.emnywo (mgr.14162) 209 : cluster [DBG] pgmap v170: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2023-01-04T18:14:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.697+0000 7f18b0c3a700 1 -- 172.21.15.50:0/3786761072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18ac0f9600 msgr2=0x7f18ac0fb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.697+0000 7f18b0c3a700 1 --2- 172.21.15.50:0/3786761072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18ac0f9600 0x7f18ac0fb9f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f18a0004660 tx=0x7f18a0009b30).stop 2023-01-04T18:14:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.697+0000 7f18b0c3a700 1 -- 172.21.15.50:0/3786761072 shutdown_connections 2023-01-04T18:14:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.697+0000 7f18b0c3a700 1 --2- 172.21.15.50:0/3786761072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18ac0f9600 0x7f18ac0fb9f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.697+0000 7f18b0c3a700 1 --2- 172.21.15.50:0/3786761072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18ac05fe30 0x7f18ac0f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.697+0000 7f18b0c3a700 1 -- 172.21.15.50:0/3786761072 >> 172.21.15.50:0/3786761072 conn(0x7f18ac0f0b70 msgr2=0x7f18ac0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.697+0000 7f18b0c3a700 1 -- 172.21.15.50:0/3786761072 shutdown_connections 2023-01-04T18:14:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.697+0000 7f18b0c3a700 1 -- 172.21.15.50:0/3786761072 wait complete. 2023-01-04T18:14:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.697+0000 7f18b0c3a700 1 Processor -- start 2023-01-04T18:14:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.697+0000 7f18b0c3a700 1 -- start start 2023-01-04T18:14:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.698+0000 7f18b0c3a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18ac05fe30 0x7f18ac0f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.698+0000 7f18b0c3a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18ac0f9600 0x7f18ac0f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.698+0000 7f18b0c3a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac0f6f60 con 0x7f18ac05fe30 2023-01-04T18:14:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.698+0000 7f18b0c3a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac0f5500 con 0x7f18ac0f9600 2023-01-04T18:14:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.698+0000 7f18aa59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18ac05fe30 0x7f18ac0f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.698+0000 7f18aa59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18ac05fe30 0x7f18ac0f69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58310/0 (socket says 172.21.15.50:58310) 2023-01-04T18:14:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.698+0000 7f18aa59c700 1 -- 172.21.15.50:0/1754291312 learned_addr learned my addr 172.21.15.50:0/1754291312 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.698+0000 7f18a9d9b700 1 --2- 172.21.15.50:0/1754291312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18ac0f9600 0x7f18ac0f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.698+0000 7f18aa59c700 1 -- 172.21.15.50:0/1754291312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18ac0f9600 msgr2=0x7f18ac0f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.698+0000 7f18aa59c700 1 --2- 172.21.15.50:0/1754291312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18ac0f9600 0x7f18ac0f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.698+0000 7f18aa59c700 1 -- 172.21.15.50:0/1754291312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a0005040 con 0x7f18ac05fe30 2023-01-04T18:14:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.698+0000 7f18aa59c700 1 --2- 172.21.15.50:0/1754291312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18ac05fe30 0x7f18ac0f69b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f189c00e7c0 tx=0x7f189c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.698+0000 7f189affd700 1 -- 172.21.15.50:0/1754291312 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f189c0092e0 con 0x7f18ac05fe30 2023-01-04T18:14:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.698+0000 7f189affd700 1 -- 172.21.15.50:0/1754291312 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f189c00f040 con 0x7f18ac05fe30 2023-01-04T18:14:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.698+0000 7f18b0c3a700 1 -- 172.21.15.50:0/1754291312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ac0f5780 con 0x7f18ac05fe30 2023-01-04T18:14:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.698+0000 7f189affd700 1 -- 172.21.15.50:0/1754291312 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f189c014750 con 0x7f18ac05fe30 2023-01-04T18:14:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.698+0000 7f18b0c3a700 1 -- 172.21.15.50:0/1754291312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ac0f5d40 con 0x7f18ac05fe30 2023-01-04T18:14:54.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.699+0000 7f18b0c3a700 1 -- 172.21.15.50:0/1754291312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18ac046330 con 0x7f18ac05fe30 2023-01-04T18:14:54.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.700+0000 7f189affd700 1 -- 172.21.15.50:0/1754291312 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f189c01b030 con 0x7f18ac05fe30 2023-01-04T18:14:54.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.700+0000 7f189affd700 1 --2- 172.21.15.50:0/1754291312 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f189405c2b0 0x7f189405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:54.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.700+0000 7f189affd700 1 -- 172.21.15.50:0/1754291312 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f189c075fa0 con 0x7f18ac05fe30 2023-01-04T18:14:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.700+0000 7f18a9d9b700 1 --2- 172.21.15.50:0/1754291312 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f189405c2b0 0x7f189405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.701+0000 7f18a9d9b700 1 --2- 172.21.15.50:0/1754291312 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f189405c2b0 0x7f189405e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f18a0004d80 tx=0x7f18a000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:54.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.708+0000 7f189affd700 1 -- 172.21.15.50:0/1754291312 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f189c048c60 con 0x7f18ac05fe30 2023-01-04T18:14:54.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.866+0000 7f18b0c3a700 1 -- 172.21.15.50:0/1754291312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f18ac027a00 con 0x7f18ac05fe30 2023-01-04T18:14:54.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.867+0000 7f189affd700 1 -- 172.21.15.50:0/1754291312 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v41) v1 ==== 107+0+11 (secure 0 0 0) 0x7f189c019020 con 0x7f18ac05fe30 2023-01-04T18:14:54.870 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-01-04T18:14:54.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.868+0000 7f18b0c3a700 1 -- 172.21.15.50:0/1754291312 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f189405c2b0 msgr2=0x7f189405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:54.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.868+0000 7f18b0c3a700 1 --2- 172.21.15.50:0/1754291312 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f189405c2b0 0x7f189405e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f18a0004d80 tx=0x7f18a000b040).stop 2023-01-04T18:14:54.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.868+0000 7f18b0c3a700 1 -- 172.21.15.50:0/1754291312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18ac05fe30 msgr2=0x7f18ac0f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:54.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.868+0000 7f18b0c3a700 1 --2- 172.21.15.50:0/1754291312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18ac05fe30 0x7f18ac0f69b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f189c00e7c0 tx=0x7f189c00b040).stop 2023-01-04T18:14:54.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.869+0000 7f18b0c3a700 1 -- 172.21.15.50:0/1754291312 shutdown_connections 2023-01-04T18:14:54.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.869+0000 7f18b0c3a700 1 --2- 172.21.15.50:0/1754291312 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f189405c2b0 0x7f189405e770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:54.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.869+0000 7f18b0c3a700 1 --2- 172.21.15.50:0/1754291312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18ac05fe30 0x7f18ac0f69b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:54.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.869+0000 7f18b0c3a700 1 --2- 172.21.15.50:0/1754291312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18ac0f9600 0x7f18ac0f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:54.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.869+0000 7f18b0c3a700 1 -- 172.21.15.50:0/1754291312 >> 172.21.15.50:0/1754291312 conn(0x7f18ac0f0b70 msgr2=0x7f18ac0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:54.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.869+0000 7f18b0c3a700 1 -- 172.21.15.50:0/1754291312 shutdown_connections 2023-01-04T18:14:54.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:54.869+0000 7f18b0c3a700 1 -- 172.21.15.50:0/1754291312 wait complete. 2023-01-04T18:14:54.883 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-01-04T18:14:55.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.004+0000 7fd3671bd700 1 -- 172.21.15.50:0/487669731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3600f5cc0 msgr2=0x7fd3600f66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:55.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.004+0000 7fd3671bd700 1 --2- 172.21.15.50:0/487669731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3600f5cc0 0x7fd3600f66f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fd34c004660 tx=0x7fd34c009b30).stop 2023-01-04T18:14:55.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.004+0000 7fd3671bd700 1 -- 172.21.15.50:0/487669731 shutdown_connections 2023-01-04T18:14:55.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.004+0000 7fd3671bd700 1 --2- 172.21.15.50:0/487669731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3600f5cc0 0x7fd3600f66f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.004+0000 7fd3671bd700 1 --2- 172.21.15.50:0/487669731 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3600f53b0 0x7fd3600f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.004+0000 7fd3671bd700 1 -- 172.21.15.50:0/487669731 >> 172.21.15.50:0/487669731 conn(0x7fd3600f0bd0 msgr2=0x7fd3600f2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:55.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.004+0000 7fd3671bd700 1 -- 172.21.15.50:0/487669731 shutdown_connections 2023-01-04T18:14:55.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.004+0000 7fd3671bd700 1 -- 172.21.15.50:0/487669731 wait complete. 2023-01-04T18:14:55.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.004+0000 7fd3671bd700 1 Processor -- start 2023-01-04T18:14:55.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.005+0000 7fd3671bd700 1 -- start start 2023-01-04T18:14:55.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.005+0000 7fd3671bd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3600f53b0 0x7fd36005fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:55.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.005+0000 7fd3671bd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3600f5cc0 0x7fd36010ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:55.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.005+0000 7fd3671bd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36010bf40 con 0x7fd3600f53b0 2023-01-04T18:14:55.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.005+0000 7fd3671bd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36010c080 con 0x7fd3600f5cc0 2023-01-04T18:14:55.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.005+0000 7fd364f59700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3600f53b0 0x7fd36005fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:55.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.005+0000 7fd364f59700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3600f53b0 0x7fd36005fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58334/0 (socket says 172.21.15.50:58334) 2023-01-04T18:14:55.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.005+0000 7fd364f59700 1 -- 172.21.15.50:0/3566899394 learned_addr learned my addr 172.21.15.50:0/3566899394 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:55.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.005+0000 7fd35ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3600f5cc0 0x7fd36010ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:55.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.005+0000 7fd364f59700 1 -- 172.21.15.50:0/3566899394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3600f5cc0 msgr2=0x7fd36010ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:55.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.005+0000 7fd364f59700 1 --2- 172.21.15.50:0/3566899394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3600f5cc0 0x7fd36010ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.005+0000 7fd364f59700 1 -- 172.21.15.50:0/3566899394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c005040 con 0x7fd3600f53b0 2023-01-04T18:14:55.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.006+0000 7fd364f59700 1 --2- 172.21.15.50:0/3566899394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3600f53b0 0x7fd36005fd10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fd35400c530 tx=0x7fd354007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:55.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.006+0000 7fd35d7fa700 1 -- 172.21.15.50:0/3566899394 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd35400f650 con 0x7fd3600f53b0 2023-01-04T18:14:55.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.006+0000 7fd35d7fa700 1 -- 172.21.15.50:0/3566899394 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd35400fc60 con 0x7fd3600f53b0 2023-01-04T18:14:55.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.006+0000 7fd3671bd700 1 -- 172.21.15.50:0/3566899394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36010c2e0 con 0x7fd3600f53b0 2023-01-04T18:14:55.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.006+0000 7fd35d7fa700 1 -- 172.21.15.50:0/3566899394 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd354012c30 con 0x7fd3600f53b0 2023-01-04T18:14:55.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.006+0000 7fd3671bd700 1 -- 172.21.15.50:0/3566899394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36010c870 con 0x7fd3600f53b0 2023-01-04T18:14:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.007+0000 7fd3671bd700 1 -- 172.21.15.50:0/3566899394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd360046330 con 0x7fd3600f53b0 2023-01-04T18:14:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.007+0000 7fd35d7fa700 1 -- 172.21.15.50:0/3566899394 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fd354010070 con 0x7fd3600f53b0 2023-01-04T18:14:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.007+0000 7fd35d7fa700 1 --2- 172.21.15.50:0/3566899394 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fd35005c2b0 0x7fd35005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.008+0000 7fd35d7fa700 1 -- 172.21.15.50:0/3566899394 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fd354075b50 con 0x7fd3600f53b0 2023-01-04T18:14:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.008+0000 7fd35ffff700 1 --2- 172.21.15.50:0/3566899394 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fd35005c2b0 0x7fd35005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.008+0000 7fd35ffff700 1 --2- 172.21.15.50:0/3566899394 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fd35005c2b0 0x7fd35005e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fd34c004630 tx=0x7fd34c009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:55.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.011+0000 7fd35d7fa700 1 -- 172.21.15.50:0/3566899394 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd3540452b0 con 0x7fd3600f53b0 2023-01-04T18:14:55.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.169+0000 7fd3671bd700 1 -- 172.21.15.50:0/3566899394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fd360027a00 con 0x7fd3600f53b0 2023-01-04T18:14:55.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.170+0000 7fd35d7fa700 1 -- 172.21.15.50:0/3566899394 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v41) v1 ==== 107+0+11 (secure 0 0 0) 0x7fd354048810 con 0x7fd3600f53b0 2023-01-04T18:14:55.173 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-01-04T18:14:55.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.171+0000 7fd3671bd700 1 -- 172.21.15.50:0/3566899394 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fd35005c2b0 msgr2=0x7fd35005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:55.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.171+0000 7fd3671bd700 1 --2- 172.21.15.50:0/3566899394 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fd35005c2b0 0x7fd35005e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fd34c004630 tx=0x7fd34c009b30).stop 2023-01-04T18:14:55.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.171+0000 7fd3671bd700 1 -- 172.21.15.50:0/3566899394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3600f53b0 msgr2=0x7fd36005fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:55.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.171+0000 7fd3671bd700 1 --2- 172.21.15.50:0/3566899394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3600f53b0 0x7fd36005fd10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fd35400c530 tx=0x7fd354007e20).stop 2023-01-04T18:14:55.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.172+0000 7fd3671bd700 1 -- 172.21.15.50:0/3566899394 shutdown_connections 2023-01-04T18:14:55.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.172+0000 7fd3671bd700 1 --2- 172.21.15.50:0/3566899394 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fd35005c2b0 0x7fd35005e770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.172+0000 7fd3671bd700 1 --2- 172.21.15.50:0/3566899394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3600f53b0 0x7fd36005fd10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.172+0000 7fd3671bd700 1 --2- 172.21.15.50:0/3566899394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3600f5cc0 0x7fd36010ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.172+0000 7fd3671bd700 1 -- 172.21.15.50:0/3566899394 >> 172.21.15.50:0/3566899394 conn(0x7fd3600f0bd0 msgr2=0x7fd3600fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:55.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.172+0000 7fd3671bd700 1 -- 172.21.15.50:0/3566899394 shutdown_connections 2023-01-04T18:14:55.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.172+0000 7fd3671bd700 1 -- 172.21.15.50:0/3566899394 wait complete. 2023-01-04T18:14:55.187 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2023-01-04T18:14:55.187 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-01-04T18:14:55.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.304+0000 7ffb85588700 1 -- 172.21.15.50:0/3039347179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb800f66d0 msgr2=0x7ffb800f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:55.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.304+0000 7ffb85588700 1 --2- 172.21.15.50:0/3039347179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb800f66d0 0x7ffb800f6b30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7ffb74004660 tx=0x7ffb74009b30).stop 2023-01-04T18:14:55.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.304+0000 7ffb85588700 1 -- 172.21.15.50:0/3039347179 shutdown_connections 2023-01-04T18:14:55.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.304+0000 7ffb85588700 1 --2- 172.21.15.50:0/3039347179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb800f66d0 0x7ffb800f6b30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.304+0000 7ffb85588700 1 --2- 172.21.15.50:0/3039347179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb800f5430 0x7ffb800f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.304+0000 7ffb85588700 1 -- 172.21.15.50:0/3039347179 >> 172.21.15.50:0/3039347179 conn(0x7ffb800f0b90 msgr2=0x7ffb800f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:55.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.304+0000 7ffb85588700 1 -- 172.21.15.50:0/3039347179 shutdown_connections 2023-01-04T18:14:55.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.304+0000 7ffb85588700 1 -- 172.21.15.50:0/3039347179 wait complete. 2023-01-04T18:14:55.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.305+0000 7ffb85588700 1 Processor -- start 2023-01-04T18:14:55.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.305+0000 7ffb85588700 1 -- start start 2023-01-04T18:14:55.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.305+0000 7ffb85588700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb800f5430 0x7ffb80060180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:55.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.305+0000 7ffb85588700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb800f66d0 0x7ffb8010b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:55.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.305+0000 7ffb85588700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8010be90 con 0x7ffb800f66d0 2023-01-04T18:14:55.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.305+0000 7ffb85588700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8010bfd0 con 0x7ffb800f5430 2023-01-04T18:14:55.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.305+0000 7ffb7e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb800f66d0 0x7ffb8010b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:55.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.305+0000 7ffb7e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb800f66d0 0x7ffb8010b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58344/0 (socket says 172.21.15.50:58344) 2023-01-04T18:14:55.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.305+0000 7ffb7e7fc700 1 -- 172.21.15.50:0/3019400127 learned_addr learned my addr 172.21.15.50:0/3019400127 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:55.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.305+0000 7ffb7effd700 1 --2- 172.21.15.50:0/3019400127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb800f5430 0x7ffb80060180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:55.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.305+0000 7ffb7e7fc700 1 -- 172.21.15.50:0/3019400127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb800f5430 msgr2=0x7ffb80060180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:55.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.305+0000 7ffb7e7fc700 1 --2- 172.21.15.50:0/3019400127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb800f5430 0x7ffb80060180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.305+0000 7ffb7e7fc700 1 -- 172.21.15.50:0/3019400127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb74005040 con 0x7ffb800f66d0 2023-01-04T18:14:55.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.306+0000 7ffb7e7fc700 1 --2- 172.21.15.50:0/3019400127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb800f66d0 0x7ffb8010b9a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7ffb74009f50 tx=0x7ffb74009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:55.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.306+0000 7ffb677fe700 1 -- 172.21.15.50:0/3019400127 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb74018070 con 0x7ffb800f66d0 2023-01-04T18:14:55.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.306+0000 7ffb85588700 1 -- 172.21.15.50:0/3019400127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8010c1d0 con 0x7ffb800f66d0 2023-01-04T18:14:55.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.306+0000 7ffb677fe700 1 -- 172.21.15.50:0/3019400127 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffb74013410 con 0x7ffb800f66d0 2023-01-04T18:14:55.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.306+0000 7ffb677fe700 1 -- 172.21.15.50:0/3019400127 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb7401c3c0 con 0x7ffb800f66d0 2023-01-04T18:14:55.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.306+0000 7ffb85588700 1 -- 172.21.15.50:0/3019400127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8010c700 con 0x7ffb800f66d0 2023-01-04T18:14:55.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.307+0000 7ffb85588700 1 -- 172.21.15.50:0/3019400127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb80027a00 con 0x7ffb800f66d0 2023-01-04T18:14:55.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.307+0000 7ffb677fe700 1 -- 172.21.15.50:0/3019400127 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7ffb7401d420 con 0x7ffb800f66d0 2023-01-04T18:14:55.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.308+0000 7ffb677fe700 1 --2- 172.21.15.50:0/3019400127 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7ffb6805c370 0x7ffb6805e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:55.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.308+0000 7ffb677fe700 1 -- 172.21.15.50:0/3019400127 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7ffb74077f50 con 0x7ffb800f66d0 2023-01-04T18:14:55.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.308+0000 7ffb7effd700 1 --2- 172.21.15.50:0/3019400127 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7ffb6805c370 0x7ffb6805e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:55.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.308+0000 7ffb7effd700 1 --2- 172.21.15.50:0/3019400127 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7ffb6805c370 0x7ffb6805e830 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7ffb800f6530 tx=0x7ffb7000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.311+0000 7ffb677fe700 1 -- 172.21.15.50:0/3019400127 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ffb7404ad00 con 0x7ffb800f66d0 2023-01-04T18:14:55.507 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:54.248458+0000 mon.smithi050 (mon.0) 533 : audit [DBG] from='client.? 172.21.15.50:0/3273492177' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-01-04T18:14:55.507 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:54.559163+0000 mon.smithi050 (mon.0) 534 : audit [DBG] from='client.? 172.21.15.50:0/3481572899' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2023-01-04T18:14:55.507 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:54.868291+0000 mon.smithi050 (mon.0) 535 : audit [DBG] from='client.? 172.21.15.50:0/1754291312' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-01-04T18:14:55.507 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:55.171283+0000 mon.smithi050 (mon.0) 536 : audit [DBG] from='client.? 172.21.15.50:0/3566899394' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-01-04T18:14:55.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.515+0000 7ffb85588700 1 -- 172.21.15.50:0/3019400127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb800fdb50 con 0x7ffb800f66d0 2023-01-04T18:14:55.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.515+0000 7ffb677fe700 1 -- 172.21.15.50:0/3019400127 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3006 (secure 0 0 0) 0x7ffb7404e320 con 0x7ffb800f66d0 2023-01-04T18:14:55.518 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:14:55.518 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14440,"name":"cephfs.smithi050.kefmuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.50:6829/3827606592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3827606592},{"type":"v1","addr":"172.21.15.50:6829","nonce":3827606592}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":12},{"gid":24297,"name":"cephfs.smithi098.laynsk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.98:6827/1785480263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1785480263},{"type":"v1","addr":"172.21.15.98:6827","nonce":1785480263}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":10,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:14:43.958806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14430":{"gid":14430,"name":"cephfs.smithi050.ezoiwl","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.50:6827/4069909541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4069909541},{"type":"v1","addr":"172.21.15.50:6827","nonce":4069909541}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_24291":{"gid":24291,"name":"cephfs.smithi098.memais","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":3,"addr":"172.21.15.98:6825/1196398070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1196398070},{"type":"v1","addr":"172.21.15.98:6825","nonce":1196398070}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:14:55.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.517+0000 7ffb85588700 1 -- 172.21.15.50:0/3019400127 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7ffb6805c370 msgr2=0x7ffb6805e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:55.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.517+0000 7ffb85588700 1 --2- 172.21.15.50:0/3019400127 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7ffb6805c370 0x7ffb6805e830 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7ffb800f6530 tx=0x7ffb7000b040).stop 2023-01-04T18:14:55.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.517+0000 7ffb85588700 1 -- 172.21.15.50:0/3019400127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb800f66d0 msgr2=0x7ffb8010b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:55.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.517+0000 7ffb85588700 1 --2- 172.21.15.50:0/3019400127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb800f66d0 0x7ffb8010b9a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7ffb74009f50 tx=0x7ffb74009b30).stop 2023-01-04T18:14:55.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.517+0000 7ffb85588700 1 -- 172.21.15.50:0/3019400127 shutdown_connections 2023-01-04T18:14:55.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.517+0000 7ffb85588700 1 --2- 172.21.15.50:0/3019400127 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7ffb6805c370 0x7ffb6805e830 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.517+0000 7ffb85588700 1 --2- 172.21.15.50:0/3019400127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb800f5430 0x7ffb80060180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.517+0000 7ffb85588700 1 --2- 172.21.15.50:0/3019400127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb800f66d0 0x7ffb8010b9a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.517+0000 7ffb85588700 1 -- 172.21.15.50:0/3019400127 >> 172.21.15.50:0/3019400127 conn(0x7ffb800f0b90 msgr2=0x7ffb800fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:55.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.517+0000 7ffb85588700 1 -- 172.21.15.50:0/3019400127 shutdown_connections 2023-01-04T18:14:55.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.517+0000 7ffb85588700 1 -- 172.21.15.50:0/3019400127 wait complete. 2023-01-04T18:14:55.521 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2023-01-04T18:14:55.531 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 50, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-01-04T18:14:30.390760+0000', 'modified': '2023-01-04T18:14:43.958806+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 14430}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14430': {'gid': 14430, 'name': 'cephfs.smithi050.ezoiwl', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.50:6827/4069909541', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6826', 'nonce': 4069909541}, {'type': 'v1', 'addr': '172.21.15.50:6827', 'nonce': 4069909541}]}, 'join_fscid': 1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}, 'gid_24291': {'gid': 24291, 'name': 'cephfs.smithi098.memais', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 3, 'addr': '172.21.15.98:6825/1196398070', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6824', 'nonce': 1196398070}, {'type': 'v1', 'addr': '172.21.15.98:6825', 'nonce': 1196398070}]}, 'join_fscid': 1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2023-01-04T18:14:55.532 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-01-04T18:14:55.532 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.cephfs.smithi050.ezoiwl status 2023-01-04T18:14:55.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:54.248458+0000 mon.smithi050 (mon.0) 533 : audit [DBG] from='client.? 172.21.15.50:0/3273492177' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-01-04T18:14:55.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:54.559163+0000 mon.smithi050 (mon.0) 534 : audit [DBG] from='client.? 172.21.15.50:0/3481572899' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2023-01-04T18:14:55.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:54.868291+0000 mon.smithi050 (mon.0) 535 : audit [DBG] from='client.? 172.21.15.50:0/1754291312' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-01-04T18:14:55.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:55.171283+0000 mon.smithi050 (mon.0) 536 : audit [DBG] from='client.? 172.21.15.50:0/3566899394' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-01-04T18:14:55.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.650+0000 7fa393ed8700 1 -- 172.21.15.50:0/944344765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa38c05fd70 msgr2=0x7fa38c0f91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:55.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.650+0000 7fa393ed8700 1 --2- 172.21.15.50:0/944344765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa38c05fd70 0x7fa38c0f91d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fa380004690 tx=0x7fa380009b30).stop 2023-01-04T18:14:55.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.650+0000 7fa393ed8700 1 -- 172.21.15.50:0/944344765 shutdown_connections 2023-01-04T18:14:55.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.650+0000 7fa393ed8700 1 --2- 172.21.15.50:0/944344765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa38c0f96c0 0x7fa38c0fbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.650+0000 7fa393ed8700 1 --2- 172.21.15.50:0/944344765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa38c05fd70 0x7fa38c0f91d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.650+0000 7fa393ed8700 1 -- 172.21.15.50:0/944344765 >> 172.21.15.50:0/944344765 conn(0x7fa38c0f0b70 msgr2=0x7fa38c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.650+0000 7fa393ed8700 1 -- 172.21.15.50:0/944344765 shutdown_connections 2023-01-04T18:14:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.650+0000 7fa393ed8700 1 -- 172.21.15.50:0/944344765 wait complete. 2023-01-04T18:14:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.651+0000 7fa393ed8700 1 Processor -- start 2023-01-04T18:14:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.651+0000 7fa393ed8700 1 -- start start 2023-01-04T18:14:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.651+0000 7fa393ed8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa38c05fd70 0x7fa38c106c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.651+0000 7fa393ed8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa38c0f96c0 0x7fa38c107110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.651+0000 7fa393ed8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c107710 con 0x7fa38c05fd70 2023-01-04T18:14:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.651+0000 7fa393ed8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c107850 con 0x7fa38c0f96c0 2023-01-04T18:14:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.651+0000 7fa391c74700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa38c05fd70 0x7fa38c106c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.651+0000 7fa391c74700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa38c05fd70 0x7fa38c106c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58352/0 (socket says 172.21.15.50:58352) 2023-01-04T18:14:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.651+0000 7fa391c74700 1 -- 172.21.15.50:0/2321272881 learned_addr learned my addr 172.21.15.50:0/2321272881 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.651+0000 7fa391473700 1 --2- 172.21.15.50:0/2321272881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa38c0f96c0 0x7fa38c107110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.651+0000 7fa391c74700 1 -- 172.21.15.50:0/2321272881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa38c0f96c0 msgr2=0x7fa38c107110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.651+0000 7fa391c74700 1 --2- 172.21.15.50:0/2321272881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa38c0f96c0 0x7fa38c107110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.651+0000 7fa391c74700 1 -- 172.21.15.50:0/2321272881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa380005040 con 0x7fa38c05fd70 2023-01-04T18:14:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.651+0000 7fa391c74700 1 --2- 172.21.15.50:0/2321272881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa38c05fd70 0x7fa38c106c20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fa380007a40 tx=0x7fa380009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.652+0000 7fa37e7fc700 1 -- 172.21.15.50:0/2321272881 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa380018070 con 0x7fa38c05fd70 2023-01-04T18:14:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.652+0000 7fa393ed8700 1 -- 172.21.15.50:0/2321272881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38c10c200 con 0x7fa38c05fd70 2023-01-04T18:14:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.652+0000 7fa37e7fc700 1 -- 172.21.15.50:0/2321272881 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa380004ed0 con 0x7fa38c05fd70 2023-01-04T18:14:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.652+0000 7fa37e7fc700 1 -- 172.21.15.50:0/2321272881 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa38001c3c0 con 0x7fa38c05fd70 2023-01-04T18:14:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.652+0000 7fa393ed8700 1 -- 172.21.15.50:0/2321272881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38c10c6e0 con 0x7fa38c05fd70 2023-01-04T18:14:55.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.653+0000 7fa37e7fc700 1 -- 172.21.15.50:0/2321272881 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fa38001d420 con 0x7fa38c05fd70 2023-01-04T18:14:55.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.653+0000 7fa37e7fc700 1 --2- 172.21.15.50:0/2321272881 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fa37805c300 0x7fa37805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:55.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.653+0000 7fa37e7fc700 1 -- 172.21.15.50:0/2321272881 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fa380077c50 con 0x7fa38c05fd70 2023-01-04T18:14:55.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.653+0000 7fa391473700 1 --2- 172.21.15.50:0/2321272881 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fa37805c300 0x7fa37805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:55.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.654+0000 7fa391473700 1 --2- 172.21.15.50:0/2321272881 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fa37805c300 0x7fa37805e7c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fa388004ce0 tx=0x7fa38800b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:55.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.655+0000 7fa3a5a99b80 1 Processor -- start 2023-01-04T18:14:55.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.655+0000 7fa3a5a99b80 1 -- start start 2023-01-04T18:14:55.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.655+0000 7fa3a5a99b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d5a821830 0x562d5a9b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:55.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.655+0000 7fa3a5a99b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5a9b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:55.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.655+0000 7fa3a5a99b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d5a8f1cc0 con 0x562d5a9b3500 2023-01-04T18:14:55.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.655+0000 7fa3a5a99b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d5a9058d0 con 0x562d5a821830 2023-01-04T18:14:55.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.656+0000 7fa391473700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5a9b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:55.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.656+0000 7fa391473700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5a9b4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58360/0 (socket says 172.21.15.50:58360) 2023-01-04T18:14:55.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.656+0000 7fa391473700 1 -- 172.21.15.50:0/2987023996 learned_addr learned my addr 172.21.15.50:0/2987023996 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:55.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.656+0000 7fa391c74700 1 --2- 172.21.15.50:0/2987023996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d5a821830 0x562d5a9b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:55.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.656+0000 7fa391473700 1 -- 172.21.15.50:0/2987023996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d5a821830 msgr2=0x562d5a9b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-04T18:14:55.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.656+0000 7fa391473700 1 --2- 172.21.15.50:0/2987023996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d5a821830 0x562d5a9b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.656+0000 7fa391473700 1 -- 172.21.15.50:0/2987023996 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d5a8f4cb0 con 0x562d5a9b3500 2023-01-04T18:14:55.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.656+0000 7fa391473700 1 --2- 172.21.15.50:0/2987023996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5a9b4260 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fa388010ac0 tx=0x7fa388014000).ready entity=mon.0 client_cookie=626a5ba25fa41005 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:55.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.656+0000 7fa36f7fe700 1 -- 172.21.15.50:0/2987023996 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa388015c70 con 0x562d5a9b3500 2023-01-04T18:14:55.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.656+0000 7fa36f7fe700 1 -- 172.21.15.50:0/2987023996 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa38800f040 con 0x562d5a9b3500 2023-01-04T18:14:55.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.656+0000 7fa36f7fe700 1 -- 172.21.15.50:0/2987023996 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa38801f360 con 0x562d5a9b3500 2023-01-04T18:14:55.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.657+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/2987023996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 msgr2=0x562d5a9b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:55.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.657+0000 7fa3a5a99b80 1 --2- 172.21.15.50:0/2987023996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5a9b4260 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fa388010ac0 tx=0x7fa388014000).stop 2023-01-04T18:14:55.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.657+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/2987023996 shutdown_connections 2023-01-04T18:14:55.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.657+0000 7fa3a5a99b80 1 --2- 172.21.15.50:0/2987023996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5a9b4260 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.657+0000 7fa3a5a99b80 1 --2- 172.21.15.50:0/2987023996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d5a821830 0x562d5a9b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.657+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/2987023996 >> 172.21.15.50:0/2987023996 conn(0x562d5a978b50 msgr2=0x562d5a9ae500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.657+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/2987023996 shutdown_connections 2023-01-04T18:14:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.657+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/2987023996 wait complete. 2023-01-04T18:14:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.657+0000 7fa3a5a99b80 1 -- start start 2023-01-04T18:14:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.657+0000 7fa3a5a99b80 1 Processor -- start 2023-01-04T18:14:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.657+0000 7fa3a5a99b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d5a821830 0x562d5a9bbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.657+0000 7fa3a5a99b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5a9bc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.657+0000 7fa3a5a99b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d5a905a10 con 0x562d5a9b3500 2023-01-04T18:14:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.657+0000 7fa3a5a99b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d5a906070 con 0x562d5a821830 2023-01-04T18:14:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.657+0000 7fa3a5a99b80 10 client.0 ll_register_callbacks cb 0x562d5a9728a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-01-04T18:14:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.658+0000 7fa391473700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5a9bc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.658+0000 7fa391473700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5a9bc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58374/0 (socket says 172.21.15.50:58374) 2023-01-04T18:14:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.658+0000 7fa391473700 1 -- 172.21.15.50:0/399364159 learned_addr learned my addr 172.21.15.50:0/399364159 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.658+0000 7fa391c74700 1 --2- 172.21.15.50:0/399364159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d5a821830 0x562d5a9bbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.658+0000 7fa391473700 1 -- 172.21.15.50:0/399364159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d5a821830 msgr2=0x562d5a9bbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-04T18:14:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.658+0000 7fa391473700 1 --2- 172.21.15.50:0/399364159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d5a821830 0x562d5a9bbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.658+0000 7fa391473700 1 -- 172.21.15.50:0/399364159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa388005040 con 0x562d5a9b3500 2023-01-04T18:14:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.658+0000 7fa391473700 1 --2- 172.21.15.50:0/399364159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5a9bc330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fa388004690 tx=0x7fa388014000).ready entity=mon.0 client_cookie=ee8936bc2aafcd28 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.658+0000 7fa36cff9700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-01-04T18:14:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.658+0000 7fa36cff9700 1 -- 172.21.15.50:0/399364159 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa388015c70 con 0x562d5a9b3500 2023-01-04T18:14:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.658+0000 7fa36cff9700 1 -- 172.21.15.50:0/399364159 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fa388015dd0 con 0x562d5a9b3500 2023-01-04T18:14:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.658+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/399364159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562d5a9ad580 con 0x562d5a9b3500 2023-01-04T18:14:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.658+0000 7fa36cff9700 1 -- 172.21.15.50:0/399364159 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa38802b460 con 0x562d5a9b3500 2023-01-04T18:14:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.658+0000 7fa3a5a99b80 10 client.14512 fetch_fsmap learned FSMap version 13 2023-01-04T18:14:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.658+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/399364159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=3+}) v3 -- 0x562d5a7399f0 con 0x562d5a9b3500 2023-01-04T18:14:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.659+0000 7fa36cff9700 1 -- 172.21.15.50:0/399364159 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x562d5a9ad580 con 0x562d5a9b3500 2023-01-04T18:14:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.659+0000 7fa36cff9700 1 -- 172.21.15.50:0/399364159 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 13) v1 ==== 1776+0+0 (secure 0 0 0) 0x7fa388013070 con 0x562d5a9b3500 2023-01-04T18:14:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.659+0000 7fa3a5a99b80 10 client.14512 fetch_fsmap finished waiting for FSMap version 13 2023-01-04T18:14:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.659+0000 7fa3a5a99b80 10 client.14512 resolve_mds: resolved name 'cephfs.smithi050.ezoiwl' to daemon mds.cephfs.smithi050.ezoiwl 2023-01-04T18:14:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.659+0000 7fa3a5a99b80 20 client.14512 populate_metadata read hostname 'smithi050' 2023-01-04T18:14:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.659+0000 7fa3a5a99b80 1 --2- 172.21.15.50:0/399364159 >> [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] conn(0x562d5a9c4a70 0x562d5a9c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.659+0000 7fa3a5a99b80 4 client.14512 mds_command: new command op to 14430 tid=0[{"prefix": "get_command_descriptions"}] 2023-01-04T18:14:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.659+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/399364159 --> [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562d5a8fc180 con 0x562d5a9c4a70 2023-01-04T18:14:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.659+0000 7fa391c74700 1 --2- 172.21.15.50:0/399364159 >> [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] conn(0x562d5a9c4a70 0x562d5a9c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.659+0000 7fa36cff9700 10 client.14512 ms_handle_connect on v2:172.21.15.50:6826/4069909541 2023-01-04T18:14:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.659+0000 7fa391c74700 1 --2- 172.21.15.50:0/399364159 >> [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] conn(0x562d5a9c4a70 0x562d5a9c6e60 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d302e9dd7c875b76 server_cookie=25ad65fd1f509c14 in_seq=0 out_seq=0 2023-01-04T18:14:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.660+0000 7fa36cff9700 1 -- 172.21.15.50:0/399364159 <== mds.0 v2:172.21.15.50:6826/4069909541 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x562d5a8fc180 con 0x562d5a9c4a70 2023-01-04T18:14:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.660+0000 7fa36cff9700 10 client.14512 handle_command_reply: tid=0 2023-01-04T18:14:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.660+0000 7fa3a5a99b80 1 client.14512 shutdown 2023-01-04T18:14:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.660+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/399364159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 msgr2=0x562d5a9bc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.660+0000 7fa3a5a99b80 1 --2- 172.21.15.50:0/399364159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5a9bc330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fa388004690 tx=0x7fa388014000).stop 2023-01-04T18:14:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.660+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/399364159 shutdown_connections 2023-01-04T18:14:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.660+0000 7fa3a5a99b80 1 --2- 172.21.15.50:0/399364159 >> [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] conn(0x562d5a9c4a70 0x562d5a9c6e60 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.660+0000 7fa3a5a99b80 1 --2- 172.21.15.50:0/399364159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d5a821830 0x562d5a9bbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.660+0000 7fa3a5a99b80 1 --2- 172.21.15.50:0/399364159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5a9bc330 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.660+0000 7fa36cff9700 0 client.14512 ms_handle_reset on v2:172.21.15.50:6826/4069909541 2023-01-04T18:14:55.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.660+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/399364159 >> 172.21.15.50:0/399364159 conn(0x562d5a978b50 msgr2=0x562d5a9ae130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:55.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.660+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/399364159 shutdown_connections 2023-01-04T18:14:55.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.660+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/399364159 wait complete. 2023-01-04T18:14:55.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.660+0000 7fa3a5a99b80 20 client.14512 trim_cache size 0 max 16384 2023-01-04T18:14:55.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.676+0000 7fa3a5a99b80 1 Processor -- start 2023-01-04T18:14:55.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.676+0000 7fa3a5a99b80 1 -- start start 2023-01-04T18:14:55.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.677+0000 7fa3a5a99b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d5a821830 0x562d5a9baab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:55.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.677+0000 7fa3a5a99b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5a9bafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:55.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.677+0000 7fa3a5a99b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d5a8d3ac0 con 0x562d5a9b3500 2023-01-04T18:14:55.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.677+0000 7fa3a5a99b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d5a8fc6b0 con 0x562d5a821830 2023-01-04T18:14:55.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.677+0000 7fa391473700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5a9bafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:55.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.677+0000 7fa391473700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5a9bafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58384/0 (socket says 172.21.15.50:58384) 2023-01-04T18:14:55.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.677+0000 7fa391473700 1 -- 172.21.15.50:0/4046903742 learned_addr learned my addr 172.21.15.50:0/4046903742 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:55.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.677+0000 7fa391c74700 1 --2- 172.21.15.50:0/4046903742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d5a821830 0x562d5a9baab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:55.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.677+0000 7fa391473700 1 -- 172.21.15.50:0/4046903742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d5a821830 msgr2=0x562d5a9baab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-04T18:14:55.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.677+0000 7fa391473700 1 --2- 172.21.15.50:0/4046903742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d5a821830 0x562d5a9baab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.677+0000 7fa391473700 1 -- 172.21.15.50:0/4046903742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d5a9b4d00 con 0x562d5a9b3500 2023-01-04T18:14:55.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.677+0000 7fa391c74700 1 --2- 172.21.15.50:0/4046903742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d5a821830 0x562d5a9baab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:14:55.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.677+0000 7fa391473700 1 --2- 172.21.15.50:0/4046903742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5a9bafa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fa388010f90 tx=0x7fa388014000).ready entity=mon.0 client_cookie=5a975848a1ee43a0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:55.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.677+0000 7fa36ffff700 1 -- 172.21.15.50:0/4046903742 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa388004ee0 con 0x562d5a9b3500 2023-01-04T18:14:55.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.677+0000 7fa36ffff700 1 -- 172.21.15.50:0/4046903742 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa38802b460 con 0x562d5a9b3500 2023-01-04T18:14:55.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.677+0000 7fa36ffff700 1 -- 172.21.15.50:0/4046903742 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa38802b810 con 0x562d5a9b3500 2023-01-04T18:14:55.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.678+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/4046903742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 msgr2=0x562d5a9bafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:55.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.678+0000 7fa3a5a99b80 1 --2- 172.21.15.50:0/4046903742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5a9bafa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fa388010f90 tx=0x7fa388014000).stop 2023-01-04T18:14:55.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.678+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/4046903742 shutdown_connections 2023-01-04T18:14:55.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.678+0000 7fa3a5a99b80 1 --2- 172.21.15.50:0/4046903742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5a9bafa0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.678+0000 7fa3a5a99b80 1 --2- 172.21.15.50:0/4046903742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d5a821830 0x562d5a9baab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.678+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/4046903742 >> 172.21.15.50:0/4046903742 conn(0x562d5a978b50 msgr2=0x562d5a9ba3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:55.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.678+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/4046903742 shutdown_connections 2023-01-04T18:14:55.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.678+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/4046903742 wait complete. 2023-01-04T18:14:55.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.678+0000 7fa3a5a99b80 1 -- start start 2023-01-04T18:14:55.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.678+0000 7fa3a5a99b80 1 Processor -- start 2023-01-04T18:14:55.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.678+0000 7fa3a5a99b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d5a821830 0x562d5aa10c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:55.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.678+0000 7fa3a5a99b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5aa11140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:55.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.678+0000 7fa3a5a99b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d5aa116f0 con 0x562d5a9b3500 2023-01-04T18:14:55.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.678+0000 7fa3a5a99b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d5aa11830 con 0x562d5a821830 2023-01-04T18:14:55.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.678+0000 7fa3a5a99b80 10 client.0 ll_register_callbacks cb 0x562d5a9728a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-01-04T18:14:55.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.678+0000 7fa391473700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5aa11140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:55.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.679+0000 7fa391473700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5aa11140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58396/0 (socket says 172.21.15.50:58396) 2023-01-04T18:14:55.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.679+0000 7fa391473700 1 -- 172.21.15.50:0/1667543528 learned_addr learned my addr 172.21.15.50:0/1667543528 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:55.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.679+0000 7fa391c74700 1 --2- 172.21.15.50:0/1667543528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d5a821830 0x562d5aa10c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:55.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.679+0000 7fa391473700 1 -- 172.21.15.50:0/1667543528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d5a821830 msgr2=0x562d5aa10c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-04T18:14:55.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.679+0000 7fa391473700 1 --2- 172.21.15.50:0/1667543528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d5a821830 0x562d5aa10c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.679+0000 7fa391473700 1 -- 172.21.15.50:0/1667543528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d5a7399f0 con 0x562d5a9b3500 2023-01-04T18:14:55.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.679+0000 7fa391473700 1 --2- 172.21.15.50:0/1667543528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5aa11140 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fa388010a10 tx=0x7fa388014000).ready entity=mon.0 client_cookie=9edb068e7fad3f2e server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:55.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.679+0000 7fa36cff9700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-01-04T18:14:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.679+0000 7fa36cff9700 1 -- 172.21.15.50:0/1667543528 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa388004570 con 0x562d5a9b3500 2023-01-04T18:14:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.679+0000 7fa36cff9700 1 -- 172.21.15.50:0/1667543528 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fa38802b810 con 0x562d5a9b3500 2023-01-04T18:14:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.679+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/1667543528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa38800f040 con 0x562d5a9b3500 2023-01-04T18:14:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.679+0000 7fa36cff9700 1 -- 172.21.15.50:0/1667543528 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa38802b9d0 con 0x562d5a9b3500 2023-01-04T18:14:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.679+0000 7fa3a5a99b80 10 client.14516 fetch_fsmap learned FSMap version 13 2023-01-04T18:14:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.679+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/1667543528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=3+}) v3 -- 0x7fa38c10f600 con 0x562d5a9b3500 2023-01-04T18:14:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.679+0000 7fa36cff9700 1 -- 172.21.15.50:0/1667543528 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa38800f040 con 0x562d5a9b3500 2023-01-04T18:14:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.679+0000 7fa36cff9700 1 -- 172.21.15.50:0/1667543528 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 13) v1 ==== 1776+0+0 (secure 0 0 0) 0x7fa388013070 con 0x562d5a9b3500 2023-01-04T18:14:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.679+0000 7fa3a5a99b80 10 client.14516 fetch_fsmap finished waiting for FSMap version 13 2023-01-04T18:14:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.679+0000 7fa3a5a99b80 10 client.14516 resolve_mds: resolved name 'cephfs.smithi050.ezoiwl' to daemon mds.cephfs.smithi050.ezoiwl 2023-01-04T18:14:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.679+0000 7fa3a5a99b80 20 client.14516 populate_metadata read hostname 'smithi050' 2023-01-04T18:14:55.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.679+0000 7fa3a5a99b80 1 --2- 172.21.15.50:0/1667543528 >> [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] conn(0x562d5aa16ec0 0x562d5aa192b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:55.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.679+0000 7fa3a5a99b80 4 client.14516 mds_command: new command op to 14430 tid=0[{"prefix": "status"}] 2023-01-04T18:14:55.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.679+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/1667543528 --> [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562d5a771d00 con 0x562d5aa16ec0 2023-01-04T18:14:55.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.680+0000 7fa391c74700 1 --2- 172.21.15.50:0/1667543528 >> [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] conn(0x562d5aa16ec0 0x562d5aa192b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:55.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.680+0000 7fa36cff9700 10 client.14516 ms_handle_connect on v2:172.21.15.50:6826/4069909541 2023-01-04T18:14:55.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.680+0000 7fa391c74700 1 --2- 172.21.15.50:0/1667543528 >> [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] conn(0x562d5aa16ec0 0x562d5aa192b0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=52f6e982d4dee491 server_cookie=f58c398dbc001b0e in_seq=0 out_seq=0 2023-01-04T18:14:55.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.680+0000 7fa36cff9700 1 -- 172.21.15.50:0/1667543528 <== mds.0 v2:172.21.15.50:6826/4069909541 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x562d5a771d00 con 0x562d5aa16ec0 2023-01-04T18:14:55.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.680+0000 7fa36cff9700 10 client.14516 handle_command_reply: tid=0 2023-01-04T18:14:55.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.680+0000 7fa3a5a99b80 1 client.14516 shutdown 2023-01-04T18:14:55.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.680+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/1667543528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 msgr2=0x562d5aa11140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:55.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.680+0000 7fa3a5a99b80 1 --2- 172.21.15.50:0/1667543528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5aa11140 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fa388010a10 tx=0x7fa388014000).stop 2023-01-04T18:14:55.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.680+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/1667543528 shutdown_connections 2023-01-04T18:14:55.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.680+0000 7fa3a5a99b80 1 --2- 172.21.15.50:0/1667543528 >> [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] conn(0x562d5aa16ec0 0x562d5aa192b0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.680+0000 7fa3a5a99b80 1 --2- 172.21.15.50:0/1667543528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562d5a821830 0x562d5aa10c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.680+0000 7fa3a5a99b80 1 --2- 172.21.15.50:0/1667543528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5a9b3500 0x562d5aa11140 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.680+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/1667543528 >> 172.21.15.50:0/1667543528 conn(0x562d5a978b50 msgr2=0x562d5a9babc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.680+0000 7fa36cff9700 0 client.14516 ms_handle_reset on v2:172.21.15.50:6826/4069909541 2023-01-04T18:14:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.680+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/1667543528 shutdown_connections 2023-01-04T18:14:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.680+0000 7fa3a5a99b80 1 -- 172.21.15.50:0/1667543528 wait complete. 2023-01-04T18:14:55.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.681+0000 7fa3a5a99b80 20 client.14516 trim_cache size 0 max 16384 2023-01-04T18:14:55.690 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:14:55.690 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "d98671da-8c5a-11ed-821a-001a4aab830c", 2023-01-04T18:14:55.690 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-01-04T18:14:55.691 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 14430, 2023-01-04T18:14:55.691 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-01-04T18:14:55.691 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-01-04T18:14:55.691 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-01-04T18:14:55.691 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 22.273694939999999, 2023-01-04T18:14:55.691 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 10, 2023-01-04T18:14:55.691 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 41, 2023-01-04T18:14:55.691 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 41, 2023-01-04T18:14:55.691 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 22.467617313000002 2023-01-04T18:14:55.691 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:14:55.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.681+0000 7fa393ed8700 1 -- 172.21.15.50:0/2321272881 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fa37805c300 msgr2=0x7fa37805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:55.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.681+0000 7fa393ed8700 1 --2- 172.21.15.50:0/2321272881 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fa37805c300 0x7fa37805e7c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fa388004ce0 tx=0x7fa38800b040).stop 2023-01-04T18:14:55.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.681+0000 7fa393ed8700 1 -- 172.21.15.50:0/2321272881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa38c05fd70 msgr2=0x7fa38c106c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:55.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.681+0000 7fa393ed8700 1 --2- 172.21.15.50:0/2321272881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa38c05fd70 0x7fa38c106c20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fa380007a40 tx=0x7fa380009b30).stop 2023-01-04T18:14:55.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.681+0000 7fa393ed8700 1 -- 172.21.15.50:0/2321272881 shutdown_connections 2023-01-04T18:14:55.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.681+0000 7fa393ed8700 1 --2- 172.21.15.50:0/2321272881 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fa37805c300 0x7fa37805e7c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.681+0000 7fa393ed8700 1 --2- 172.21.15.50:0/2321272881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa38c05fd70 0x7fa38c106c20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.681+0000 7fa393ed8700 1 --2- 172.21.15.50:0/2321272881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa38c0f96c0 0x7fa38c107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:55.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.681+0000 7fa393ed8700 1 -- 172.21.15.50:0/2321272881 >> 172.21.15.50:0/2321272881 conn(0x7fa38c0f0b70 msgr2=0x7fa38c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:55.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.681+0000 7fa393ed8700 1 -- 172.21.15.50:0/2321272881 shutdown_connections 2023-01-04T18:14:55.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:55.681+0000 7fa393ed8700 1 -- 172.21.15.50:0/2321272881 wait complete. 2023-01-04T18:14:55.695 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2023-01-04T18:14:55.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:55.696 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-01-04T18:14:55.713 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-01-04T18:14:55.714 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-01-04T18:14:55.812 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-01-04T18:14:55.812 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-01-04T18:14:55.867 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2023-01-04T18:14:55.868 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2023-01-04T18:14:55.870 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-01-04T18:14:55.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:55.871 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-01-04T18:14:55.899 INFO:tasks.kclient:client.1 config is {} 2023-01-04T18:14:55.899 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-01-04T18:14:55.899 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2023-01-04T18:14:55.899 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-01-04T18:14:55.899 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-01-04T18:14:55.899 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-01-04T18:14:55.899 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-01-04T18:14:55.899 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-01-04T18:14:55.899 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-01-04T18:14:55.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:55.900 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2023-01-04T18:14:55.922 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-01-04T18:14:55.922 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-01-04T18:14:55.922 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-01-04T18:14:55.922 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-01-04T18:14:55.923 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-01-04T18:14:55.923 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-01-04T18:14:55.923 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-01-04T18:14:55.923 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2023-01-04T18:14:55.923 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2023-01-04T18:14:55.923 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-01-04T18:14:55.923 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2023-01-04T18:14:55.923 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2023-01-04T18:14:55.923 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-01-04T18:14:55.923 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2023-01-04T18:14:55.923 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-01-04T18:14:55.923 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2023-01-04T18:14:55.924 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-01-04T18:14:55.924 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 42124sec preferred_lft 42124sec 2023-01-04T18:14:55.924 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link 2023-01-04T18:14:55.924 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-01-04T18:14:55.924 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-01-04T18:14:55.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:55.924 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-01-04T18:14:55.924 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-01-04T18:14:55.924 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add name ceph-brx type bridge 2023-01-04T18:14:55.924 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip addr flush dev ceph-brx 2023-01-04T18:14:55.925 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set ceph-brx up 2023-01-04T18:14:55.925 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-01-04T18:14:55.925 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-01-04T18:14:56.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:56.119 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-01-04T18:14:56.147 INFO:teuthology.orchestra.run.smithi098.stdout:1 2023-01-04T18:14:56.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:56.149 DEBUG:teuthology.orchestra.run.smithi098:> route 2023-01-04T18:14:56.230 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2023-01-04T18:14:56.230 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-01-04T18:14:56.230 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-01-04T18:14:56.230 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-01-04T18:14:56.230 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-01-04T18:14:56.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:56.231 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-01-04T18:14:56.231 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-01-04T18:14:56.231 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-01-04T18:14:56.231 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-01-04T18:14:56.231 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-01-04T18:14:56.231 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-01-04T18:14:56.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:55.298637+0000 mgr.smithi050.emnywo (mgr.14162) 210 : cluster [DBG] pgmap v171: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 1 op/s 2023-01-04T18:14:56.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:55.516613+0000 mon.smithi050 (mon.0) 537 : audit [DBG] from='client.? 172.21.15.50:0/3019400127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-01-04T18:14:56.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:56.521 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-01-04T18:14:56.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:56.538 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list-id 2023-01-04T18:14:56.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:55.298637+0000 mgr.smithi050.emnywo (mgr.14162) 210 : cluster [DBG] pgmap v171: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 1 op/s 2023-01-04T18:14:56.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:55.516613+0000 mon.smithi050 (mon.0) 537 : audit [DBG] from='client.? 172.21.15.50:0/3019400127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-01-04T18:14:56.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:56.596 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-01-04T18:14:56.596 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-01-04T18:14:56.596 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-01-04T18:14:56.596 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-01-04T18:14:56.596 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-01-04T18:14:56.692 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-01-04T18:14:56.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:56.692 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-01-04T18:14:56.692 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-01-04T18:14:56.692 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-01-04T18:14:56.692 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-01-04T18:14:56.692 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-01-04T18:14:56.692 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-01-04T18:14:56.693 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-01-04T18:14:56.693 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-01-04T18:14:56.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:56.913 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-01-04T18:14:56.913 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-01-04T18:14:56.913 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2023-01-04T18:14:56.913 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set dev brx.0 master ceph-brx 2023-01-04T18:14:56.913 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-01-04T18:14:57.047 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-04T18:14:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.178+0000 7f8ae5e8a700 1 -- 172.21.15.50:0/398890250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ae00f5cc0 msgr2=0x7f8ae00f66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.178+0000 7f8ae5e8a700 1 --2- 172.21.15.50:0/398890250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ae00f5cc0 0x7f8ae00f66f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f8ad0004660 tx=0x7f8ad0009b30).stop 2023-01-04T18:14:57.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.178+0000 7f8ae5e8a700 1 -- 172.21.15.50:0/398890250 shutdown_connections 2023-01-04T18:14:57.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.178+0000 7f8ae5e8a700 1 --2- 172.21.15.50:0/398890250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ae00f5cc0 0x7f8ae00f66f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:57.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.178+0000 7f8ae5e8a700 1 --2- 172.21.15.50:0/398890250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ae00f53b0 0x7f8ae00f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:57.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.178+0000 7f8ae5e8a700 1 -- 172.21.15.50:0/398890250 >> 172.21.15.50:0/398890250 conn(0x7f8ae00f0bd0 msgr2=0x7f8ae00f2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:57.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.178+0000 7f8ae5e8a700 1 -- 172.21.15.50:0/398890250 shutdown_connections 2023-01-04T18:14:57.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.178+0000 7f8ae5e8a700 1 -- 172.21.15.50:0/398890250 wait complete. 2023-01-04T18:14:57.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.178+0000 7f8ae5e8a700 1 Processor -- start 2023-01-04T18:14:57.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.179+0000 7f8ae5e8a700 1 -- start start 2023-01-04T18:14:57.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.179+0000 7f8ae5e8a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ae00f53b0 0x7f8ae0105a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:57.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.179+0000 7f8ae5e8a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ae00f5cc0 0x7f8ae0105f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:57.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.179+0000 7f8ae5e8a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0106500 con 0x7f8ae00f5cc0 2023-01-04T18:14:57.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.179+0000 7f8ae5e8a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0106640 con 0x7f8ae00f53b0 2023-01-04T18:14:57.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.179+0000 7f8adeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ae00f5cc0 0x7f8ae0105f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:57.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.179+0000 7f8adeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ae00f5cc0 0x7f8ae0105f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38696/0 (socket says 172.21.15.50:38696) 2023-01-04T18:14:57.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.179+0000 7f8adf7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ae00f53b0 0x7f8ae0105a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:57.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.179+0000 7f8adeffd700 1 -- 172.21.15.50:0/2921644447 learned_addr learned my addr 172.21.15.50:0/2921644447 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:57.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.179+0000 7f8adeffd700 1 -- 172.21.15.50:0/2921644447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ae00f53b0 msgr2=0x7f8ae0105a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:57.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.179+0000 7f8adeffd700 1 --2- 172.21.15.50:0/2921644447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ae00f53b0 0x7f8ae0105a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:57.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.179+0000 7f8adeffd700 1 -- 172.21.15.50:0/2921644447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad0005040 con 0x7f8ae00f5cc0 2023-01-04T18:14:57.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.179+0000 7f8adeffd700 1 --2- 172.21.15.50:0/2921644447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ae00f5cc0 0x7f8ae0105f50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f8ad0000c00 tx=0x7f8ad000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:57.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.179+0000 7f8ac7fff700 1 -- 172.21.15.50:0/2921644447 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ad0019070 con 0x7f8ae00f5cc0 2023-01-04T18:14:57.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.179+0000 7f8ac7fff700 1 -- 172.21.15.50:0/2921644447 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8ad0007e70 con 0x7f8ae00f5cc0 2023-01-04T18:14:57.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.179+0000 7f8ae5e8a700 1 -- 172.21.15.50:0/2921644447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae010b080 con 0x7f8ae00f5cc0 2023-01-04T18:14:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.179+0000 7f8ac7fff700 1 -- 172.21.15.50:0/2921644447 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ad0014c90 con 0x7f8ae00f5cc0 2023-01-04T18:14:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.180+0000 7f8ae5e8a700 1 -- 172.21.15.50:0/2921644447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae010b640 con 0x7f8ae00f5cc0 2023-01-04T18:14:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.181+0000 7f8ae5e8a700 1 -- 172.21.15.50:0/2921644447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae0027a00 con 0x7f8ae00f5cc0 2023-01-04T18:14:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.181+0000 7f8ac7fff700 1 -- 172.21.15.50:0/2921644447 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f8ad0025070 con 0x7f8ae00f5cc0 2023-01-04T18:14:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.181+0000 7f8ac7fff700 1 --2- 172.21.15.50:0/2921644447 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f8ac805c370 0x7f8ac805e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.181+0000 7f8ac7fff700 1 -- 172.21.15.50:0/2921644447 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f8ad0076f20 con 0x7f8ae00f5cc0 2023-01-04T18:14:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.181+0000 7f8adf7fe700 1 --2- 172.21.15.50:0/2921644447 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f8ac805c370 0x7f8ac805e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:57.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.182+0000 7f8adf7fe700 1 --2- 172.21.15.50:0/2921644447 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f8ac805c370 0x7f8ac805e830 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f8ad4009fd0 tx=0x7f8ad400b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:57.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.185+0000 7f8ac7fff700 1 -- 172.21.15.50:0/2921644447 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8ad00a32b0 con 0x7f8ae00f5cc0 2023-01-04T18:14:57.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.345+0000 7f8ae5e8a700 1 -- 172.21.15.50:0/2921644447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ae00fdb70 con 0x7f8ae00f5cc0 2023-01-04T18:14:57.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.346+0000 7f8ac7fff700 1 -- 172.21.15.50:0/2921644447 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+14058 (secure 0 0 0) 0x7f8ad0049be0 con 0x7f8ae00f5cc0 2023-01-04T18:14:57.349 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:14:57.349 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":41,"fsid":"d98671da-8c5a-11ed-821a-001a4aab830c","created":"2023-01-04T18:09:16.009200+0000","modified":"2023-01-04T18:14:32.395916+0000","last_up_change":"2023-01-04T18:13:22.225898+0000","last_in_change":"2023-01-04T18:13:05.868442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-01-04T18:12:40.118167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-01-04T18:14:29.272955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-01-04T18:14:29.814288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"364b88f0-63eb-4ee0-9961-6d394328fb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6803","nonce":2221606938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6805","nonce":2221606938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6809","nonce":2221606938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2221606938},{"type":"v1","addr":"172.21.15.50:6807","nonce":2221606938}]},"public_addr":"172.21.15.50:6803/2221606938","cluster_addr":"172.21.15.50:6805/2221606938","heartbeat_back_addr":"172.21.15.50:6809/2221606938","heartbeat_front_addr":"172.21.15.50:6807/2221606938","state":["exists","up"]},{"osd":1,"uuid":"2e3617b7-4f5a-417f-ac90-d557ed55507f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6811","nonce":2500190979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6813","nonce":2500190979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6817","nonce":2500190979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2500190979},{"type":"v1","addr":"172.21.15.50:6815","nonce":2500190979}]},"public_addr":"172.21.15.50:6811/2500190979","cluster_addr":"172.21.15.50:6813/2500190979","heartbeat_back_addr":"172.21.15.50:6817/2500190979","heartbeat_front_addr":"172.21.15.50:6815/2500190979","state":["exists","up"]},{"osd":2,"uuid":"f5fb8cb5-19be-471e-a297-0cfa6721f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6819","nonce":1577657554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6821","nonce":1577657554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6825","nonce":1577657554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1577657554},{"type":"v1","addr":"172.21.15.50:6823","nonce":1577657554}]},"public_addr":"172.21.15.50:6819/1577657554","cluster_addr":"172.21.15.50:6821/1577657554","heartbeat_back_addr":"172.21.15.50:6825/1577657554","heartbeat_front_addr":"172.21.15.50:6823/1577657554","state":["exists","up"]},{"osd":3,"uuid":"ebc8dd52-f41d-4d85-a3bd-16ad8d121436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6801","nonce":4254376132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6803","nonce":4254376132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6807","nonce":4254376132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":4254376132},{"type":"v1","addr":"172.21.15.98:6805","nonce":4254376132}]},"public_addr":"172.21.15.98:6801/4254376132","cluster_addr":"172.21.15.98:6803/4254376132","heartbeat_back_addr":"172.21.15.98:6807/4254376132","heartbeat_front_addr":"172.21.15.98:6805/4254376132","state":["exists","up"]},{"osd":4,"uuid":"37f00733-dce6-4862-96b7-2eab49821451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6809","nonce":3371156908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6811","nonce":3371156908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6815","nonce":3371156908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3371156908},{"type":"v1","addr":"172.21.15.98:6813","nonce":3371156908}]},"public_addr":"172.21.15.98:6809/3371156908","cluster_addr":"172.21.15.98:6811/3371156908","heartbeat_back_addr":"172.21.15.98:6815/3371156908","heartbeat_front_addr":"172.21.15.98:6813/3371156908","state":["exists","up"]},{"osd":5,"uuid":"773a186f-cbc1-40a2-a7ae-183f3bbdfd9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6817","nonce":764254549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6819","nonce":764254549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6823","nonce":764254549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":764254549},{"type":"v1","addr":"172.21.15.98:6821","nonce":764254549}]},"public_addr":"172.21.15.98:6817/764254549","cluster_addr":"172.21.15.98:6819/764254549","heartbeat_back_addr":"172.21.15.98:6823/764254549","heartbeat_front_addr":"172.21.15.98:6821/764254549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:11:53.534560+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:12:10.806420+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:12:28.093489+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:12:44.642140+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:13:02.605039+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:13:21.050426+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/2515216785":"2023-01-05T18:10:13.194077+0000","172.21.15.50:0/878334031":"2023-01-05T18:10:13.194077+0000","172.21.15.50:6801/3751193798":"2023-01-05T18:09:59.360317+0000","172.21.15.50:6801/2515216785":"2023-01-05T18:10:13.194077+0000","172.21.15.50:0/1004257612":"2023-01-05T18:10:13.194077+0000","172.21.15.50:0/1815506343":"2023-01-05T18:09:59.360317+0000","172.21.15.50:0/2856929359":"2023-01-05T18:09:59.360317+0000","172.21.15.50:6800/27207172":"2023-01-05T18:09:35.421204+0000","172.21.15.50:6800/3751193798":"2023-01-05T18:09:59.360317+0000","172.21.15.50:0/2199987942":"2023-01-05T18:09:35.421204+0000","172.21.15.50:6801/27207172":"2023-01-05T18:09:35.421204+0000","172.21.15.50:0/1586567006":"2023-01-05T18:09:35.421204+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-04T18:14:57.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.348+0000 7f8ae5e8a700 1 -- 172.21.15.50:0/2921644447 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f8ac805c370 msgr2=0x7f8ac805e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:57.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.348+0000 7f8ae5e8a700 1 --2- 172.21.15.50:0/2921644447 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f8ac805c370 0x7f8ac805e830 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f8ad4009fd0 tx=0x7f8ad400b040).stop 2023-01-04T18:14:57.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.348+0000 7f8ae5e8a700 1 -- 172.21.15.50:0/2921644447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ae00f5cc0 msgr2=0x7f8ae0105f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:57.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.348+0000 7f8ae5e8a700 1 --2- 172.21.15.50:0/2921644447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ae00f5cc0 0x7f8ae0105f50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f8ad0000c00 tx=0x7f8ad000b040).stop 2023-01-04T18:14:57.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.348+0000 7f8ae5e8a700 1 -- 172.21.15.50:0/2921644447 shutdown_connections 2023-01-04T18:14:57.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.348+0000 7f8ae5e8a700 1 --2- 172.21.15.50:0/2921644447 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f8ac805c370 0x7f8ac805e830 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:57.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.348+0000 7f8ae5e8a700 1 --2- 172.21.15.50:0/2921644447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ae00f53b0 0x7f8ae0105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:57.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.348+0000 7f8ae5e8a700 1 --2- 172.21.15.50:0/2921644447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ae00f5cc0 0x7f8ae0105f50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:57.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.348+0000 7f8ae5e8a700 1 -- 172.21.15.50:0/2921644447 >> 172.21.15.50:0/2921644447 conn(0x7f8ae00f0bd0 msgr2=0x7f8ae00fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:57.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.348+0000 7f8ae5e8a700 1 -- 172.21.15.50:0/2921644447 shutdown_connections 2023-01-04T18:14:57.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.348+0000 7f8ae5e8a700 1 -- 172.21.15.50:0/2921644447 wait complete. 2023-01-04T18:14:57.363 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-01-04T18:12:40.118167+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-01-04T18:14:29.272955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-01-04T18:14:29.814288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-01-04T18:14:57.364 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-01-04T18:14:57.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.483+0000 7f7f617ee700 1 -- 172.21.15.50:0/3045989107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f5c0f9600 msgr2=0x7f7f5c0fb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:57.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.483+0000 7f7f617ee700 1 --2- 172.21.15.50:0/3045989107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f5c0f9600 0x7f7f5c0fb9f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f7f4c004660 tx=0x7f7f4c009b30).stop 2023-01-04T18:14:57.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.483+0000 7f7f617ee700 1 -- 172.21.15.50:0/3045989107 shutdown_connections 2023-01-04T18:14:57.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.483+0000 7f7f617ee700 1 --2- 172.21.15.50:0/3045989107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f5c0f9600 0x7f7f5c0fb9f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:57.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.483+0000 7f7f617ee700 1 --2- 172.21.15.50:0/3045989107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f5c05fe30 0x7f7f5c0f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:57.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.483+0000 7f7f617ee700 1 -- 172.21.15.50:0/3045989107 >> 172.21.15.50:0/3045989107 conn(0x7f7f5c0f0b70 msgr2=0x7f7f5c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:57.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.483+0000 7f7f617ee700 1 -- 172.21.15.50:0/3045989107 shutdown_connections 2023-01-04T18:14:57.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.483+0000 7f7f617ee700 1 -- 172.21.15.50:0/3045989107 wait complete. 2023-01-04T18:14:57.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.483+0000 7f7f617ee700 1 Processor -- start 2023-01-04T18:14:57.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.484+0000 7f7f617ee700 1 -- start start 2023-01-04T18:14:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.484+0000 7f7f617ee700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f5c05fe30 0x7f7f5c106bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.484+0000 7f7f617ee700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f5c0f9600 0x7f7f5c1070c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.484+0000 7f7f617ee700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c107670 con 0x7f7f5c0f9600 2023-01-04T18:14:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.484+0000 7f7f617ee700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c1077b0 con 0x7f7f5c05fe30 2023-01-04T18:14:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.484+0000 7f7f5a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f5c0f9600 0x7f7f5c1070c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.484+0000 7f7f5a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f5c0f9600 0x7f7f5c1070c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38704/0 (socket says 172.21.15.50:38704) 2023-01-04T18:14:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.484+0000 7f7f5a7fc700 1 -- 172.21.15.50:0/88569364 learned_addr learned my addr 172.21.15.50:0/88569364 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.484+0000 7f7f5affd700 1 --2- 172.21.15.50:0/88569364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f5c05fe30 0x7f7f5c106bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.484+0000 7f7f5a7fc700 1 -- 172.21.15.50:0/88569364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f5c05fe30 msgr2=0x7f7f5c106bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.484+0000 7f7f5a7fc700 1 --2- 172.21.15.50:0/88569364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f5c05fe30 0x7f7f5c106bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.484+0000 7f7f5a7fc700 1 -- 172.21.15.50:0/88569364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f4c005040 con 0x7f7f5c0f9600 2023-01-04T18:14:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.484+0000 7f7f5a7fc700 1 --2- 172.21.15.50:0/88569364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f5c0f9600 0x7f7f5c1070c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f7f4c000c00 tx=0x7f7f4c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:57.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.484+0000 7f7f437fe700 1 -- 172.21.15.50:0/88569364 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f4c019070 con 0x7f7f5c0f9600 2023-01-04T18:14:57.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.484+0000 7f7f437fe700 1 -- 172.21.15.50:0/88569364 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7f4c007e70 con 0x7f7f5c0f9600 2023-01-04T18:14:57.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.484+0000 7f7f617ee700 1 -- 172.21.15.50:0/88569364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5c10c1f0 con 0x7f7f5c0f9600 2023-01-04T18:14:57.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.484+0000 7f7f437fe700 1 -- 172.21.15.50:0/88569364 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f4c014c90 con 0x7f7f5c0f9600 2023-01-04T18:14:57.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.484+0000 7f7f617ee700 1 -- 172.21.15.50:0/88569364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5c10c7b0 con 0x7f7f5c0f9600 2023-01-04T18:14:57.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.485+0000 7f7f617ee700 1 -- 172.21.15.50:0/88569364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5c027a00 con 0x7f7f5c0f9600 2023-01-04T18:14:57.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.486+0000 7f7f437fe700 1 -- 172.21.15.50:0/88569364 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f7f4c025070 con 0x7f7f5c0f9600 2023-01-04T18:14:57.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.486+0000 7f7f437fe700 1 --2- 172.21.15.50:0/88569364 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7f4405c2b0 0x7f7f4405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:57.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.486+0000 7f7f437fe700 1 -- 172.21.15.50:0/88569364 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f7f4c076f20 con 0x7f7f5c0f9600 2023-01-04T18:14:57.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.486+0000 7f7f5affd700 1 --2- 172.21.15.50:0/88569364 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7f4405c2b0 0x7f7f4405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:57.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.487+0000 7f7f5affd700 1 --2- 172.21.15.50:0/88569364 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7f4405c2b0 0x7f7f4405e770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f7f50009fd0 tx=0x7f7f5000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:57.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.490+0000 7f7f437fe700 1 -- 172.21.15.50:0/88569364 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7f4c0a32b0 con 0x7f7f5c0f9600 2023-01-04T18:14:57.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:57.346956+0000 mon.smithi050 (mon.0) 538 : audit [DBG] from='client.? 172.21.15.50:0/2921644447' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-01-04T18:14:57.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.646+0000 7f7f617ee700 1 -- 172.21.15.50:0/88569364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7f5c0fec30 con 0x7f7f5c0f9600 2023-01-04T18:14:57.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.647+0000 7f7f437fe700 1 -- 172.21.15.50:0/88569364 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v41) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7f4c049be0 con 0x7f7f5c0f9600 2023-01-04T18:14:57.650 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-01-04T18:14:57.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.649+0000 7f7f617ee700 1 -- 172.21.15.50:0/88569364 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7f4405c2b0 msgr2=0x7f7f4405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:57.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.649+0000 7f7f617ee700 1 --2- 172.21.15.50:0/88569364 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7f4405c2b0 0x7f7f4405e770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f7f50009fd0 tx=0x7f7f5000b040).stop 2023-01-04T18:14:57.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.649+0000 7f7f617ee700 1 -- 172.21.15.50:0/88569364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f5c0f9600 msgr2=0x7f7f5c1070c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:57.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.649+0000 7f7f617ee700 1 --2- 172.21.15.50:0/88569364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f5c0f9600 0x7f7f5c1070c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f7f4c000c00 tx=0x7f7f4c00b040).stop 2023-01-04T18:14:57.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.649+0000 7f7f617ee700 1 -- 172.21.15.50:0/88569364 shutdown_connections 2023-01-04T18:14:57.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.649+0000 7f7f617ee700 1 --2- 172.21.15.50:0/88569364 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f7f4405c2b0 0x7f7f4405e770 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:57.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.649+0000 7f7f617ee700 1 --2- 172.21.15.50:0/88569364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f5c05fe30 0x7f7f5c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:57.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.649+0000 7f7f617ee700 1 --2- 172.21.15.50:0/88569364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f5c0f9600 0x7f7f5c1070c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:57.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.649+0000 7f7f617ee700 1 -- 172.21.15.50:0/88569364 >> 172.21.15.50:0/88569364 conn(0x7f7f5c0f0b70 msgr2=0x7f7f5c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:57.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.649+0000 7f7f617ee700 1 -- 172.21.15.50:0/88569364 shutdown_connections 2023-01-04T18:14:57.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.649+0000 7f7f617ee700 1 -- 172.21.15.50:0/88569364 wait complete. 2023-01-04T18:14:57.662 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:57.346956+0000 mon.smithi050 (mon.0) 538 : audit [DBG] from='client.? 172.21.15.50:0/2921644447' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-01-04T18:14:57.663 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-01-04T18:14:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.783+0000 7fe4474f9700 1 -- 172.21.15.50:0/779803223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4400f9640 msgr2=0x7fe4400fba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.783+0000 7fe4474f9700 1 --2- 172.21.15.50:0/779803223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4400f9640 0x7fe4400fba30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fe43c004660 tx=0x7fe43c009b30).stop 2023-01-04T18:14:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.783+0000 7fe4474f9700 1 -- 172.21.15.50:0/779803223 shutdown_connections 2023-01-04T18:14:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.783+0000 7fe4474f9700 1 --2- 172.21.15.50:0/779803223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4400f9640 0x7fe4400fba30 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.783+0000 7fe4474f9700 1 --2- 172.21.15.50:0/779803223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe44005fdf0 0x7fe4400f9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.783+0000 7fe4474f9700 1 -- 172.21.15.50:0/779803223 >> 172.21.15.50:0/779803223 conn(0x7fe4400f0b70 msgr2=0x7fe4400f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.783+0000 7fe4474f9700 1 -- 172.21.15.50:0/779803223 shutdown_connections 2023-01-04T18:14:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.783+0000 7fe4474f9700 1 -- 172.21.15.50:0/779803223 wait complete. 2023-01-04T18:14:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.784+0000 7fe4474f9700 1 Processor -- start 2023-01-04T18:14:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.784+0000 7fe4474f9700 1 -- start start 2023-01-04T18:14:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.784+0000 7fe4474f9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44005fdf0 0x7fe440106c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.784+0000 7fe4474f9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4400f9640 0x7fe440107120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.784+0000 7fe4474f9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe440107720 con 0x7fe44005fdf0 2023-01-04T18:14:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.784+0000 7fe4474f9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe440107860 con 0x7fe4400f9640 2023-01-04T18:14:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.784+0000 7fe445295700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44005fdf0 0x7fe440106c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.784+0000 7fe445295700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44005fdf0 0x7fe440106c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38728/0 (socket says 172.21.15.50:38728) 2023-01-04T18:14:57.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.784+0000 7fe445295700 1 -- 172.21.15.50:0/3786426954 learned_addr learned my addr 172.21.15.50:0/3786426954 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:57.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.784+0000 7fe444a94700 1 --2- 172.21.15.50:0/3786426954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4400f9640 0x7fe440107120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:57.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.784+0000 7fe445295700 1 -- 172.21.15.50:0/3786426954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4400f9640 msgr2=0x7fe440107120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:57.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.784+0000 7fe445295700 1 --2- 172.21.15.50:0/3786426954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4400f9640 0x7fe440107120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:57.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.784+0000 7fe445295700 1 -- 172.21.15.50:0/3786426954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43c005040 con 0x7fe44005fdf0 2023-01-04T18:14:57.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.784+0000 7fe445295700 1 --2- 172.21.15.50:0/3786426954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44005fdf0 0x7fe440106c30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fe430002700 tx=0x7fe430009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:57.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.785+0000 7fe435ffb700 1 -- 172.21.15.50:0/3786426954 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4300079c0 con 0x7fe44005fdf0 2023-01-04T18:14:57.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.785+0000 7fe435ffb700 1 -- 172.21.15.50:0/3786426954 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe43000f040 con 0x7fe44005fdf0 2023-01-04T18:14:57.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.785+0000 7fe4474f9700 1 -- 172.21.15.50:0/3786426954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44010c270 con 0x7fe44005fdf0 2023-01-04T18:14:57.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.785+0000 7fe435ffb700 1 -- 172.21.15.50:0/3786426954 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe430014850 con 0x7fe44005fdf0 2023-01-04T18:14:57.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.785+0000 7fe4474f9700 1 -- 172.21.15.50:0/3786426954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44010c830 con 0x7fe44005fdf0 2023-01-04T18:14:57.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.786+0000 7fe4474f9700 1 -- 172.21.15.50:0/3786426954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe440027a00 con 0x7fe44005fdf0 2023-01-04T18:14:57.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.786+0000 7fe435ffb700 1 -- 172.21.15.50:0/3786426954 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fe43001b060 con 0x7fe44005fdf0 2023-01-04T18:14:57.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.786+0000 7fe435ffb700 1 --2- 172.21.15.50:0/3786426954 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe42c05c2b0 0x7fe42c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:57.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.787+0000 7fe435ffb700 1 -- 172.21.15.50:0/3786426954 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fe430075ea0 con 0x7fe44005fdf0 2023-01-04T18:14:57.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.787+0000 7fe444a94700 1 --2- 172.21.15.50:0/3786426954 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe42c05c2b0 0x7fe42c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:57.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.787+0000 7fe444a94700 1 --2- 172.21.15.50:0/3786426954 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe42c05c2b0 0x7fe42c05e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fe43c009f50 tx=0x7fe43c009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:57.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.791+0000 7fe435ffb700 1 -- 172.21.15.50:0/3786426954 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe430048aa0 con 0x7fe44005fdf0 2023-01-04T18:14:57.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.946+0000 7fe4474f9700 1 -- 172.21.15.50:0/3786426954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fe4400fec40 con 0x7fe44005fdf0 2023-01-04T18:14:57.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.946+0000 7fe435ffb700 1 -- 172.21.15.50:0/3786426954 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v41) v1 ==== 107+0+11 (secure 0 0 0) 0x7fe43004c0c0 con 0x7fe44005fdf0 2023-01-04T18:14:57.950 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-01-04T18:14:57.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.948+0000 7fe4474f9700 1 -- 172.21.15.50:0/3786426954 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe42c05c2b0 msgr2=0x7fe42c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:57.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.948+0000 7fe4474f9700 1 --2- 172.21.15.50:0/3786426954 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe42c05c2b0 0x7fe42c05e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fe43c009f50 tx=0x7fe43c009b30).stop 2023-01-04T18:14:57.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.948+0000 7fe4474f9700 1 -- 172.21.15.50:0/3786426954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44005fdf0 msgr2=0x7fe440106c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:57.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.948+0000 7fe4474f9700 1 --2- 172.21.15.50:0/3786426954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44005fdf0 0x7fe440106c30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fe430002700 tx=0x7fe430009e00).stop 2023-01-04T18:14:57.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.948+0000 7fe4474f9700 1 -- 172.21.15.50:0/3786426954 shutdown_connections 2023-01-04T18:14:57.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.948+0000 7fe4474f9700 1 --2- 172.21.15.50:0/3786426954 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fe42c05c2b0 0x7fe42c05e770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:57.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.948+0000 7fe4474f9700 1 --2- 172.21.15.50:0/3786426954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe44005fdf0 0x7fe440106c30 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:57.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.948+0000 7fe4474f9700 1 --2- 172.21.15.50:0/3786426954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4400f9640 0x7fe440107120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:57.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.948+0000 7fe4474f9700 1 -- 172.21.15.50:0/3786426954 >> 172.21.15.50:0/3786426954 conn(0x7fe4400f0b70 msgr2=0x7fe4400f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:57.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.948+0000 7fe4474f9700 1 -- 172.21.15.50:0/3786426954 shutdown_connections 2023-01-04T18:14:57.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:57.948+0000 7fe4474f9700 1 -- 172.21.15.50:0/3786426954 wait complete. 2023-01-04T18:14:57.963 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-01-04T18:14:58.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.081+0000 7f3faa961700 1 -- 172.21.15.50:0/3023013646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fa40f5390 msgr2=0x7f3fa40f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:58.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.081+0000 7f3faa961700 1 --2- 172.21.15.50:0/3023013646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fa40f5390 0x7f3fa40f57b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f3f94004660 tx=0x7f3f94009b30).stop 2023-01-04T18:14:58.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.081+0000 7f3faa961700 1 -- 172.21.15.50:0/3023013646 shutdown_connections 2023-01-04T18:14:58.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.081+0000 7f3faa961700 1 --2- 172.21.15.50:0/3023013646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3fa40f5ca0 0x7f3fa40f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.081+0000 7f3faa961700 1 --2- 172.21.15.50:0/3023013646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fa40f5390 0x7f3fa40f57b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.081+0000 7f3faa961700 1 -- 172.21.15.50:0/3023013646 >> 172.21.15.50:0/3023013646 conn(0x7f3fa40f0b70 msgr2=0x7f3fa40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.082+0000 7f3faa961700 1 -- 172.21.15.50:0/3023013646 shutdown_connections 2023-01-04T18:14:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.082+0000 7f3faa961700 1 -- 172.21.15.50:0/3023013646 wait complete. 2023-01-04T18:14:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.082+0000 7f3faa961700 1 Processor -- start 2023-01-04T18:14:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.082+0000 7f3faa961700 1 -- start start 2023-01-04T18:14:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.083+0000 7f3faa961700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3fa40f5390 0x7f3fa4105a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.083+0000 7f3faa961700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fa40f5ca0 0x7f3fa4105f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.083+0000 7f3faa961700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa4106510 con 0x7f3fa40f5ca0 2023-01-04T18:14:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.083+0000 7f3faa961700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa4106650 con 0x7f3fa40f5390 2023-01-04T18:14:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.083+0000 7f3fa37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fa40f5ca0 0x7f3fa4105f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.083+0000 7f3fa37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fa40f5ca0 0x7f3fa4105f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38744/0 (socket says 172.21.15.50:38744) 2023-01-04T18:14:58.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.083+0000 7f3fa37fe700 1 -- 172.21.15.50:0/1544032490 learned_addr learned my addr 172.21.15.50:0/1544032490 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:58.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.083+0000 7f3fa3fff700 1 --2- 172.21.15.50:0/1544032490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3fa40f5390 0x7f3fa4105a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:58.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.083+0000 7f3fa37fe700 1 -- 172.21.15.50:0/1544032490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3fa40f5390 msgr2=0x7f3fa4105a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:58.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.083+0000 7f3fa37fe700 1 --2- 172.21.15.50:0/1544032490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3fa40f5390 0x7f3fa4105a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.083+0000 7f3fa37fe700 1 -- 172.21.15.50:0/1544032490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f94005040 con 0x7f3fa40f5ca0 2023-01-04T18:14:58.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.083+0000 7f3fa37fe700 1 --2- 172.21.15.50:0/1544032490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fa40f5ca0 0x7f3fa4105f60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f3f8c00e7f0 tx=0x7f3f8c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:58.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.083+0000 7f3fa0ff9700 1 -- 172.21.15.50:0/1544032490 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f8c0092e0 con 0x7f3fa40f5ca0 2023-01-04T18:14:58.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.083+0000 7f3faa961700 1 -- 172.21.15.50:0/1544032490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa410b0f0 con 0x7f3fa40f5ca0 2023-01-04T18:14:58.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.084+0000 7f3fa0ff9700 1 -- 172.21.15.50:0/1544032490 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3f8c00f040 con 0x7f3fa40f5ca0 2023-01-04T18:14:58.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.084+0000 7f3fa0ff9700 1 -- 172.21.15.50:0/1544032490 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f8c014750 con 0x7f3fa40f5ca0 2023-01-04T18:14:58.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.084+0000 7f3faa961700 1 -- 172.21.15.50:0/1544032490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa410b6b0 con 0x7f3fa40f5ca0 2023-01-04T18:14:58.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.084+0000 7f3faa961700 1 -- 172.21.15.50:0/1544032490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa4027a00 con 0x7f3fa40f5ca0 2023-01-04T18:14:58.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.085+0000 7f3fa0ff9700 1 -- 172.21.15.50:0/1544032490 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f3f8c01b030 con 0x7f3fa40f5ca0 2023-01-04T18:14:58.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.085+0000 7f3fa0ff9700 1 --2- 172.21.15.50:0/1544032490 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f3f9005c2b0 0x7f3f9005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:58.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.085+0000 7f3fa0ff9700 1 -- 172.21.15.50:0/1544032490 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f3f8c075cd0 con 0x7f3fa40f5ca0 2023-01-04T18:14:58.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.085+0000 7f3fa3fff700 1 --2- 172.21.15.50:0/1544032490 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f3f9005c2b0 0x7f3f9005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:58.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.086+0000 7f3fa3fff700 1 --2- 172.21.15.50:0/1544032490 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f3f9005c2b0 0x7f3f9005e770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f3f94005010 tx=0x7f3f94016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:58.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.089+0000 7f3fa0ff9700 1 -- 172.21.15.50:0/1544032490 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f3f8c0489e0 con 0x7f3fa40f5ca0 2023-01-04T18:14:58.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.246+0000 7f3faa961700 1 -- 172.21.15.50:0/1544032490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f3fa40586e0 con 0x7f3fa40f5ca0 2023-01-04T18:14:58.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.247+0000 7f3fa0ff9700 1 -- 172.21.15.50:0/1544032490 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v41) v1 ==== 107+0+11 (secure 0 0 0) 0x7f3f8c019020 con 0x7f3fa40f5ca0 2023-01-04T18:14:58.250 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-01-04T18:14:58.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.248+0000 7f3faa961700 1 -- 172.21.15.50:0/1544032490 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f3f9005c2b0 msgr2=0x7f3f9005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:58.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.248+0000 7f3faa961700 1 --2- 172.21.15.50:0/1544032490 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f3f9005c2b0 0x7f3f9005e770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f3f94005010 tx=0x7f3f94016040).stop 2023-01-04T18:14:58.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.248+0000 7f3faa961700 1 -- 172.21.15.50:0/1544032490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fa40f5ca0 msgr2=0x7f3fa4105f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:58.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.248+0000 7f3faa961700 1 --2- 172.21.15.50:0/1544032490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fa40f5ca0 0x7f3fa4105f60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f3f8c00e7f0 tx=0x7f3f8c00b040).stop 2023-01-04T18:14:58.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.248+0000 7f3faa961700 1 -- 172.21.15.50:0/1544032490 shutdown_connections 2023-01-04T18:14:58.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.248+0000 7f3faa961700 1 --2- 172.21.15.50:0/1544032490 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f3f9005c2b0 0x7f3f9005e770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.248+0000 7f3faa961700 1 --2- 172.21.15.50:0/1544032490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3fa40f5390 0x7f3fa4105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.248+0000 7f3faa961700 1 --2- 172.21.15.50:0/1544032490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fa40f5ca0 0x7f3fa4105f60 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.248+0000 7f3faa961700 1 -- 172.21.15.50:0/1544032490 >> 172.21.15.50:0/1544032490 conn(0x7f3fa40f0b70 msgr2=0x7f3fa40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:58.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.248+0000 7f3faa961700 1 -- 172.21.15.50:0/1544032490 shutdown_connections 2023-01-04T18:14:58.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.248+0000 7f3faa961700 1 -- 172.21.15.50:0/1544032490 wait complete. 2023-01-04T18:14:58.263 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2023-01-04T18:14:58.263 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-01-04T18:14:58.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.379+0000 7f9854c6b700 1 -- 172.21.15.50:0/2013959335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98500f53b0 msgr2=0x7f98500f57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:58.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.379+0000 7f9854c6b700 1 --2- 172.21.15.50:0/2013959335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98500f53b0 0x7f98500f57d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f9840004660 tx=0x7f9840009b30).stop 2023-01-04T18:14:58.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.379+0000 7f9854c6b700 1 -- 172.21.15.50:0/2013959335 shutdown_connections 2023-01-04T18:14:58.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.379+0000 7f9854c6b700 1 --2- 172.21.15.50:0/2013959335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98500f5cc0 0x7f98500f66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.379+0000 7f9854c6b700 1 --2- 172.21.15.50:0/2013959335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98500f53b0 0x7f98500f57d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.379+0000 7f9854c6b700 1 -- 172.21.15.50:0/2013959335 >> 172.21.15.50:0/2013959335 conn(0x7f98500f0bd0 msgr2=0x7f98500f2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:58.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.379+0000 7f9854c6b700 1 -- 172.21.15.50:0/2013959335 shutdown_connections 2023-01-04T18:14:58.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.379+0000 7f9854c6b700 1 -- 172.21.15.50:0/2013959335 wait complete. 2023-01-04T18:14:58.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.380+0000 7f9854c6b700 1 Processor -- start 2023-01-04T18:14:58.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.380+0000 7f9854c6b700 1 -- start start 2023-01-04T18:14:58.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.380+0000 7f9854c6b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98500f53b0 0x7f985005fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:58.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.380+0000 7f9854c6b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98500f5cc0 0x7f985010b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:58.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.380+0000 7f9854c6b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985010beb0 con 0x7f98500f53b0 2023-01-04T18:14:58.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.380+0000 7f9854c6b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985010bff0 con 0x7f98500f5cc0 2023-01-04T18:14:58.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.380+0000 7f984e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98500f53b0 0x7f985005fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:58.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.380+0000 7f984e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98500f53b0 0x7f985005fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38770/0 (socket says 172.21.15.50:38770) 2023-01-04T18:14:58.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.380+0000 7f984e59c700 1 -- 172.21.15.50:0/4077451501 learned_addr learned my addr 172.21.15.50:0/4077451501 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:58.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.380+0000 7f984dd9b700 1 --2- 172.21.15.50:0/4077451501 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98500f5cc0 0x7f985010b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.380+0000 7f984e59c700 1 -- 172.21.15.50:0/4077451501 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98500f5cc0 msgr2=0x7f985010b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.380+0000 7f984e59c700 1 --2- 172.21.15.50:0/4077451501 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98500f5cc0 0x7f985010b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.380+0000 7f984e59c700 1 -- 172.21.15.50:0/4077451501 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9840005040 con 0x7f98500f53b0 2023-01-04T18:14:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.380+0000 7f984e59c700 1 --2- 172.21.15.50:0/4077451501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98500f53b0 0x7f985005fd00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f9840009830 tx=0x7f9840009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.380+0000 7f9846ffd700 1 -- 172.21.15.50:0/4077451501 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9840018070 con 0x7f98500f53b0 2023-01-04T18:14:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.380+0000 7f9846ffd700 1 -- 172.21.15.50:0/4077451501 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9840013410 con 0x7f98500f53b0 2023-01-04T18:14:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.380+0000 7f9854c6b700 1 -- 172.21.15.50:0/4077451501 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985010c1f0 con 0x7f98500f53b0 2023-01-04T18:14:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.381+0000 7f9846ffd700 1 -- 172.21.15.50:0/4077451501 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f984001c3c0 con 0x7f98500f53b0 2023-01-04T18:14:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.381+0000 7f9854c6b700 1 -- 172.21.15.50:0/4077451501 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985010c750 con 0x7f98500f53b0 2023-01-04T18:14:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.381+0000 7f9854c6b700 1 -- 172.21.15.50:0/4077451501 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9850027a00 con 0x7f98500f53b0 2023-01-04T18:14:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.382+0000 7f9846ffd700 1 -- 172.21.15.50:0/4077451501 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f984001d420 con 0x7f98500f53b0 2023-01-04T18:14:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.382+0000 7f9846ffd700 1 --2- 172.21.15.50:0/4077451501 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f983c05c370 0x7f983c05e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.382+0000 7f9846ffd700 1 -- 172.21.15.50:0/4077451501 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f9840077a70 con 0x7f98500f53b0 2023-01-04T18:14:58.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.382+0000 7f984dd9b700 1 --2- 172.21.15.50:0/4077451501 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f983c05c370 0x7f983c05e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:58.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.383+0000 7f984dd9b700 1 --2- 172.21.15.50:0/4077451501 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f983c05c370 0x7f983c05e830 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f9838004c40 tx=0x7f983800b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:58.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.386+0000 7f9846ffd700 1 -- 172.21.15.50:0/4077451501 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f984004a7b0 con 0x7f98500f53b0 2023-01-04T18:14:58.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:57.299045+0000 mgr.smithi050.emnywo (mgr.14162) 211 : cluster [DBG] pgmap v172: 65 pgs: 65 active+clean; 2.5 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2023-01-04T18:14:58.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:57.648558+0000 mon.smithi050 (mon.0) 539 : audit [DBG] from='client.? 172.21.15.50:0/88569364' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2023-01-04T18:14:58.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:57.948022+0000 mon.smithi050 (mon.0) 540 : audit [DBG] from='client.? 172.21.15.50:0/3786426954' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-01-04T18:14:58.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:58.248363+0000 mon.smithi050 (mon.0) 541 : audit [DBG] from='client.? 172.21.15.50:0/1544032490' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-01-04T18:14:58.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:57.299045+0000 mgr.smithi050.emnywo (mgr.14162) 211 : cluster [DBG] pgmap v172: 65 pgs: 65 active+clean; 2.5 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2023-01-04T18:14:58.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:57.648558+0000 mon.smithi050 (mon.0) 539 : audit [DBG] from='client.? 172.21.15.50:0/88569364' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2023-01-04T18:14:58.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:57.948022+0000 mon.smithi050 (mon.0) 540 : audit [DBG] from='client.? 172.21.15.50:0/3786426954' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-01-04T18:14:58.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:58.248363+0000 mon.smithi050 (mon.0) 541 : audit [DBG] from='client.? 172.21.15.50:0/1544032490' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-01-04T18:14:58.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.584+0000 7f9854c6b700 1 -- 172.21.15.50:0/4077451501 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98500fdb70 con 0x7f98500f53b0 2023-01-04T18:14:58.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.585+0000 7f9846ffd700 1 -- 172.21.15.50:0/4077451501 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3006 (secure 0 0 0) 0x7f9840077e60 con 0x7f98500f53b0 2023-01-04T18:14:58.588 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:14:58.588 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14440,"name":"cephfs.smithi050.kefmuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.50:6829/3827606592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3827606592},{"type":"v1","addr":"172.21.15.50:6829","nonce":3827606592}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":12},{"gid":24297,"name":"cephfs.smithi098.laynsk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.98:6827/1785480263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1785480263},{"type":"v1","addr":"172.21.15.98:6827","nonce":1785480263}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":13}],"filesystems":[{"mdsmap":{"epoch":10,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:14:43.958806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14430":{"gid":14430,"name":"cephfs.smithi050.ezoiwl","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.50:6827/4069909541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4069909541},{"type":"v1","addr":"172.21.15.50:6827","nonce":4069909541}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_24291":{"gid":24291,"name":"cephfs.smithi098.memais","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":3,"addr":"172.21.15.98:6825/1196398070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1196398070},{"type":"v1","addr":"172.21.15.98:6825","nonce":1196398070}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:14:58.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.586+0000 7f9854c6b700 1 -- 172.21.15.50:0/4077451501 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f983c05c370 msgr2=0x7f983c05e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:58.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.586+0000 7f9854c6b700 1 --2- 172.21.15.50:0/4077451501 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f983c05c370 0x7f983c05e830 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f9838004c40 tx=0x7f983800b040).stop 2023-01-04T18:14:58.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.586+0000 7f9854c6b700 1 -- 172.21.15.50:0/4077451501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98500f53b0 msgr2=0x7f985005fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:58.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.586+0000 7f9854c6b700 1 --2- 172.21.15.50:0/4077451501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98500f53b0 0x7f985005fd00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f9840009830 tx=0x7f9840009b30).stop 2023-01-04T18:14:58.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.587+0000 7f9854c6b700 1 -- 172.21.15.50:0/4077451501 shutdown_connections 2023-01-04T18:14:58.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.587+0000 7f9854c6b700 1 --2- 172.21.15.50:0/4077451501 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f983c05c370 0x7f983c05e830 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.587+0000 7f9854c6b700 1 --2- 172.21.15.50:0/4077451501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98500f53b0 0x7f985005fd00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.587+0000 7f9854c6b700 1 --2- 172.21.15.50:0/4077451501 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98500f5cc0 0x7f985010b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.587+0000 7f9854c6b700 1 -- 172.21.15.50:0/4077451501 >> 172.21.15.50:0/4077451501 conn(0x7f98500f0bd0 msgr2=0x7f98500fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:58.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.587+0000 7f9854c6b700 1 -- 172.21.15.50:0/4077451501 shutdown_connections 2023-01-04T18:14:58.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.587+0000 7f9854c6b700 1 -- 172.21.15.50:0/4077451501 wait complete. 2023-01-04T18:14:58.592 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2023-01-04T18:14:58.601 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 50, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-01-04T18:14:30.390760+0000', 'modified': '2023-01-04T18:14:43.958806+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 14430}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14430': {'gid': 14430, 'name': 'cephfs.smithi050.ezoiwl', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.50:6827/4069909541', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6826', 'nonce': 4069909541}, {'type': 'v1', 'addr': '172.21.15.50:6827', 'nonce': 4069909541}]}, 'join_fscid': 1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}, 'gid_24291': {'gid': 24291, 'name': 'cephfs.smithi098.memais', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 3, 'addr': '172.21.15.98:6825/1196398070', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6824', 'nonce': 1196398070}, {'type': 'v1', 'addr': '172.21.15.98:6825', 'nonce': 1196398070}]}, 'join_fscid': 1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2023-01-04T18:14:58.602 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-01-04T18:14:58.602 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.cephfs.smithi050.ezoiwl status 2023-01-04T18:14:58.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.719+0000 7f9bd7ca6700 1 -- 172.21.15.50:0/375052283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd00f5ca0 msgr2=0x7f9bd00f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:58.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.719+0000 7f9bd7ca6700 1 --2- 172.21.15.50:0/375052283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd00f5ca0 0x7f9bd00f66d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f9bc4004660 tx=0x7f9bc4009b30).stop 2023-01-04T18:14:58.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.719+0000 7f9bd7ca6700 1 -- 172.21.15.50:0/375052283 shutdown_connections 2023-01-04T18:14:58.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.719+0000 7f9bd7ca6700 1 --2- 172.21.15.50:0/375052283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd00f5ca0 0x7f9bd00f66d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.719+0000 7f9bd7ca6700 1 --2- 172.21.15.50:0/375052283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bd00f5390 0x7f9bd00f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.719+0000 7f9bd7ca6700 1 -- 172.21.15.50:0/375052283 >> 172.21.15.50:0/375052283 conn(0x7f9bd00f0b70 msgr2=0x7f9bd00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:58.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.719+0000 7f9bd7ca6700 1 -- 172.21.15.50:0/375052283 shutdown_connections 2023-01-04T18:14:58.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.720+0000 7f9bd7ca6700 1 -- 172.21.15.50:0/375052283 wait complete. 2023-01-04T18:14:58.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.720+0000 7f9bd7ca6700 1 Processor -- start 2023-01-04T18:14:58.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.720+0000 7f9bd7ca6700 1 -- start start 2023-01-04T18:14:58.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.720+0000 7f9bd7ca6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bd00f5390 0x7f9bd0105af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:58.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.720+0000 7f9bd7ca6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd00f5ca0 0x7f9bd0105fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:58.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.720+0000 7f9bd7ca6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd0106590 con 0x7f9bd00f5ca0 2023-01-04T18:14:58.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.720+0000 7f9bd7ca6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd01066d0 con 0x7f9bd00f5390 2023-01-04T18:14:58.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.721+0000 7f9bd5241700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd00f5ca0 0x7f9bd0105fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:58.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.721+0000 7f9bd5241700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd00f5ca0 0x7f9bd0105fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38776/0 (socket says 172.21.15.50:38776) 2023-01-04T18:14:58.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.721+0000 7f9bd5241700 1 -- 172.21.15.50:0/672868039 learned_addr learned my addr 172.21.15.50:0/672868039 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:58.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.721+0000 7f9bd5a42700 1 --2- 172.21.15.50:0/672868039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bd00f5390 0x7f9bd0105af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:58.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.721+0000 7f9bd5241700 1 -- 172.21.15.50:0/672868039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bd00f5390 msgr2=0x7f9bd0105af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:58.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.721+0000 7f9bd5241700 1 --2- 172.21.15.50:0/672868039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bd00f5390 0x7f9bd0105af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.721+0000 7f9bd5241700 1 -- 172.21.15.50:0/672868039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc4005040 con 0x7f9bd00f5ca0 2023-01-04T18:14:58.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.721+0000 7f9bd5241700 1 --2- 172.21.15.50:0/672868039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd00f5ca0 0x7f9bd0105fe0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f9bc4000c00 tx=0x7f9bc400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:58.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.721+0000 7f9bc27fc700 1 -- 172.21.15.50:0/672868039 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bc4019070 con 0x7f9bd00f5ca0 2023-01-04T18:14:58.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.721+0000 7f9bc27fc700 1 -- 172.21.15.50:0/672868039 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9bc4007e70 con 0x7f9bd00f5ca0 2023-01-04T18:14:58.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.721+0000 7f9bd7ca6700 1 -- 172.21.15.50:0/672868039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd010b110 con 0x7f9bd00f5ca0 2023-01-04T18:14:58.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.721+0000 7f9bc27fc700 1 -- 172.21.15.50:0/672868039 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bc4014c90 con 0x7f9bd00f5ca0 2023-01-04T18:14:58.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.721+0000 7f9bd7ca6700 1 -- 172.21.15.50:0/672868039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd010b6d0 con 0x7f9bd00f5ca0 2023-01-04T18:14:58.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.722+0000 7f9bc27fc700 1 -- 172.21.15.50:0/672868039 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f9bc4025070 con 0x7f9bd00f5ca0 2023-01-04T18:14:58.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.723+0000 7f9bc27fc700 1 --2- 172.21.15.50:0/672868039 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f9bbc05c2b0 0x7f9bbc05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:58.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.723+0000 7f9bc27fc700 1 -- 172.21.15.50:0/672868039 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f9bc4076fe0 con 0x7f9bd00f5ca0 2023-01-04T18:14:58.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.723+0000 7f9bd5a42700 1 --2- 172.21.15.50:0/672868039 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f9bbc05c2b0 0x7f9bbc05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:58.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.723+0000 7f9bd5a42700 1 --2- 172.21.15.50:0/672868039 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f9bbc05c2b0 0x7f9bbc05e770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f9bcc009fd0 tx=0x7f9bcc00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:58.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.725+0000 7f9be9867b80 1 Processor -- start 2023-01-04T18:14:58.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.725+0000 7f9be9867b80 1 -- start start 2023-01-04T18:14:58.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.725+0000 7f9be9867b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5557f11a7830 0x5557f1339010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:58.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.725+0000 7f9be9867b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f1339500 0x5557f133a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:58.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.725+0000 7f9be9867b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557f1277cc0 con 0x5557f1339500 2023-01-04T18:14:58.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.725+0000 7f9be9867b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557f128b8d0 con 0x5557f11a7830 2023-01-04T18:14:58.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.725+0000 7f9bd5241700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f1339500 0x5557f133a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:58.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.725+0000 7f9bd5241700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f1339500 0x5557f133a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38792/0 (socket says 172.21.15.50:38792) 2023-01-04T18:14:58.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.725+0000 7f9bd5241700 1 -- 172.21.15.50:0/900693650 learned_addr learned my addr 172.21.15.50:0/900693650 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:58.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.725+0000 7f9bd5a42700 1 --2- 172.21.15.50:0/900693650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5557f11a7830 0x5557f1339010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:58.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.725+0000 7f9bd5241700 1 -- 172.21.15.50:0/900693650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5557f11a7830 msgr2=0x5557f1339010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-04T18:14:58.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.725+0000 7f9bd5241700 1 --2- 172.21.15.50:0/900693650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5557f11a7830 0x5557f1339010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.725+0000 7f9bd5241700 1 -- 172.21.15.50:0/900693650 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557f127acb0 con 0x5557f1339500 2023-01-04T18:14:58.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.726+0000 7f9bd5241700 1 --2- 172.21.15.50:0/900693650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f1339500 0x5557f133a260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f9bc4004540 tx=0x7f9bc40098b0).ready entity=mon.0 client_cookie=63f80574d07ddff6 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:58.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.726+0000 7f9bb37fe700 1 -- 172.21.15.50:0/900693650 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bc4049fb0 con 0x5557f1339500 2023-01-04T18:14:58.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.726+0000 7f9bb37fe700 1 -- 172.21.15.50:0/900693650 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9bc404a110 con 0x5557f1339500 2023-01-04T18:14:58.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.726+0000 7f9bb37fe700 1 -- 172.21.15.50:0/900693650 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bc40759e0 con 0x5557f1339500 2023-01-04T18:14:58.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.726+0000 7f9be9867b80 1 -- 172.21.15.50:0/900693650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f1339500 msgr2=0x5557f133a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:58.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.726+0000 7f9be9867b80 1 --2- 172.21.15.50:0/900693650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f1339500 0x5557f133a260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f9bc4004540 tx=0x7f9bc40098b0).stop 2023-01-04T18:14:58.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.726+0000 7f9be9867b80 1 -- 172.21.15.50:0/900693650 shutdown_connections 2023-01-04T18:14:58.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.726+0000 7f9be9867b80 1 --2- 172.21.15.50:0/900693650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f1339500 0x5557f133a260 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.726+0000 7f9be9867b80 1 --2- 172.21.15.50:0/900693650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5557f11a7830 0x5557f1339010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.726+0000 7f9be9867b80 1 -- 172.21.15.50:0/900693650 >> 172.21.15.50:0/900693650 conn(0x5557f12feb50 msgr2=0x5557f1334500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:58.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.726+0000 7f9be9867b80 1 -- 172.21.15.50:0/900693650 shutdown_connections 2023-01-04T18:14:58.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.726+0000 7f9be9867b80 1 -- 172.21.15.50:0/900693650 wait complete. 2023-01-04T18:14:58.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.727+0000 7f9be9867b80 1 -- start start 2023-01-04T18:14:58.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.727+0000 7f9be9867b80 1 Processor -- start 2023-01-04T18:14:58.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.727+0000 7f9be9867b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5557f11a7830 0x5557f1341f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:58.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.727+0000 7f9be9867b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f1339500 0x5557f1342410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:58.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.727+0000 7f9be9867b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557f128ba10 con 0x5557f1339500 2023-01-04T18:14:58.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.727+0000 7f9be9867b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557f128c070 con 0x5557f11a7830 2023-01-04T18:14:58.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.727+0000 7f9be9867b80 10 client.0 ll_register_callbacks cb 0x5557f12f88a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-01-04T18:14:58.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.727+0000 7f9bd5241700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f1339500 0x5557f1342410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:58.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.727+0000 7f9bd5241700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f1339500 0x5557f1342410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38808/0 (socket says 172.21.15.50:38808) 2023-01-04T18:14:58.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.727+0000 7f9bd5241700 1 -- 172.21.15.50:0/731120534 learned_addr learned my addr 172.21.15.50:0/731120534 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:58.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.727+0000 7f9bd5a42700 1 --2- 172.21.15.50:0/731120534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5557f11a7830 0x5557f1341f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:58.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.727+0000 7f9bd5241700 1 -- 172.21.15.50:0/731120534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5557f11a7830 msgr2=0x5557f1341f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-04T18:14:58.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.727+0000 7f9bd5241700 1 --2- 172.21.15.50:0/731120534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5557f11a7830 0x5557f1341f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.727+0000 7f9bd5241700 1 -- 172.21.15.50:0/731120534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd010b6d0 con 0x5557f1339500 2023-01-04T18:14:58.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.727+0000 7f9bd5241700 1 --2- 172.21.15.50:0/731120534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f1339500 0x5557f1342410 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f9bc4014870 tx=0x7f9bc4020040).ready entity=mon.0 client_cookie=c91936a28842513d server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:58.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.727+0000 7f9bb0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-01-04T18:14:58.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.728+0000 7f9bb0ff9700 1 -- 172.21.15.50:0/731120534 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bc4035070 con 0x5557f1339500 2023-01-04T18:14:58.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.728+0000 7f9be9867b80 1 -- 172.21.15.50:0/731120534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557f1333580 con 0x5557f1339500 2023-01-04T18:14:58.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.728+0000 7f9bb0ff9700 1 -- 172.21.15.50:0/731120534 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f9bc4007bd0 con 0x5557f1339500 2023-01-04T18:14:58.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.728+0000 7f9bb0ff9700 1 -- 172.21.15.50:0/731120534 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bc40759e0 con 0x5557f1339500 2023-01-04T18:14:58.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.728+0000 7f9be9867b80 10 client.14544 fetch_fsmap learned FSMap version 13 2023-01-04T18:14:58.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.728+0000 7f9be9867b80 1 -- 172.21.15.50:0/731120534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=3+}) v3 -- 0x5557f10bf9f0 con 0x5557f1339500 2023-01-04T18:14:58.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.728+0000 7f9bb0ff9700 1 -- 172.21.15.50:0/731120534 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x5557f1333580 con 0x5557f1339500 2023-01-04T18:14:58.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.728+0000 7f9bb0ff9700 1 -- 172.21.15.50:0/731120534 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 13) v1 ==== 1776+0+0 (secure 0 0 0) 0x7f9bc400f030 con 0x5557f1339500 2023-01-04T18:14:58.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.728+0000 7f9be9867b80 10 client.14544 fetch_fsmap finished waiting for FSMap version 13 2023-01-04T18:14:58.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.728+0000 7f9be9867b80 10 client.14544 resolve_mds: resolved name 'cephfs.smithi050.ezoiwl' to daemon mds.cephfs.smithi050.ezoiwl 2023-01-04T18:14:58.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.728+0000 7f9be9867b80 20 client.14544 populate_metadata read hostname 'smithi050' 2023-01-04T18:14:58.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.728+0000 7f9be9867b80 1 --2- 172.21.15.50:0/731120534 >> [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] conn(0x5557f134ab20 0x5557f134cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:58.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.728+0000 7f9be9867b80 4 client.14544 mds_command: new command op to 14430 tid=0[{"prefix": "get_command_descriptions"}] 2023-01-04T18:14:58.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.728+0000 7f9be9867b80 1 -- 172.21.15.50:0/731120534 --> [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557f1282180 con 0x5557f134ab20 2023-01-04T18:14:58.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.728+0000 7f9bd5a42700 1 --2- 172.21.15.50:0/731120534 >> [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] conn(0x5557f134ab20 0x5557f134cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:58.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.728+0000 7f9bb0ff9700 10 client.14544 ms_handle_connect on v2:172.21.15.50:6826/4069909541 2023-01-04T18:14:58.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.728+0000 7f9bd5a42700 1 --2- 172.21.15.50:0/731120534 >> [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] conn(0x5557f134ab20 0x5557f134cf10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7805128d49f788d server_cookie=c47eeed5c0ee767 in_seq=0 out_seq=0 2023-01-04T18:14:58.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.729+0000 7f9bb0ff9700 1 -- 172.21.15.50:0/731120534 <== mds.0 v2:172.21.15.50:6826/4069909541 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x5557f1282180 con 0x5557f134ab20 2023-01-04T18:14:58.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.729+0000 7f9bb0ff9700 10 client.14544 handle_command_reply: tid=0 2023-01-04T18:14:58.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.729+0000 7f9be9867b80 1 client.14544 shutdown 2023-01-04T18:14:58.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.729+0000 7f9be9867b80 1 -- 172.21.15.50:0/731120534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f1339500 msgr2=0x5557f1342410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:58.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.729+0000 7f9be9867b80 1 --2- 172.21.15.50:0/731120534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f1339500 0x5557f1342410 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f9bc4014870 tx=0x7f9bc4020040).stop 2023-01-04T18:14:58.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.729+0000 7f9be9867b80 1 -- 172.21.15.50:0/731120534 shutdown_connections 2023-01-04T18:14:58.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.729+0000 7f9be9867b80 1 --2- 172.21.15.50:0/731120534 >> [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] conn(0x5557f134ab20 0x5557f134cf10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.729+0000 7f9be9867b80 1 --2- 172.21.15.50:0/731120534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5557f11a7830 0x5557f1341f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.729+0000 7f9be9867b80 1 --2- 172.21.15.50:0/731120534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f1339500 0x5557f1342410 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.729+0000 7f9be9867b80 1 -- 172.21.15.50:0/731120534 >> 172.21.15.50:0/731120534 conn(0x5557f12feb50 msgr2=0x5557f13340d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:58.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.729+0000 7f9bb0ff9700 0 client.14544 ms_handle_reset on v2:172.21.15.50:6826/4069909541 2023-01-04T18:14:58.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.729+0000 7f9be9867b80 1 -- 172.21.15.50:0/731120534 shutdown_connections 2023-01-04T18:14:58.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.729+0000 7f9be9867b80 1 -- 172.21.15.50:0/731120534 wait complete. 2023-01-04T18:14:58.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.729+0000 7f9be9867b80 20 client.14544 trim_cache size 0 max 16384 2023-01-04T18:14:58.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.746+0000 7f9be9867b80 1 Processor -- start 2023-01-04T18:14:58.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.746+0000 7f9be9867b80 1 -- start start 2023-01-04T18:14:58.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.746+0000 7f9be9867b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f11a7830 0x5557f1334740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:58.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.746+0000 7f9be9867b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5557f1339500 0x5557f1331520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:58.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.746+0000 7f9be9867b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557f1259ac0 con 0x5557f11a7830 2023-01-04T18:14:58.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.746+0000 7f9be9867b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557f1341dc0 con 0x5557f1339500 2023-01-04T18:14:58.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.746+0000 7f9bd5a42700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f11a7830 0x5557f1334740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:58.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.746+0000 7f9bd5a42700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f11a7830 0x5557f1334740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38818/0 (socket says 172.21.15.50:38818) 2023-01-04T18:14:58.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.746+0000 7f9bd5a42700 1 -- 172.21.15.50:0/2314987890 learned_addr learned my addr 172.21.15.50:0/2314987890 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:58.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.746+0000 7f9bd5a42700 1 -- 172.21.15.50:0/2314987890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5557f1339500 msgr2=0x5557f1331520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-04T18:14:58.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.746+0000 7f9bd5a42700 1 --2- 172.21.15.50:0/2314987890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5557f1339500 0x5557f1331520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-01-04T18:14:58.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.746+0000 7f9bd5a42700 1 -- 172.21.15.50:0/2314987890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557f133a0c0 con 0x5557f11a7830 2023-01-04T18:14:58.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.746+0000 7f9bd5a42700 1 --2- 172.21.15.50:0/2314987890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f11a7830 0x5557f1334740 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x5557f134d6d0 tx=0x7f9bcc015000).ready entity=mon.0 client_cookie=58ef9a59d1400dd7 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:58.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.747+0000 7f9bb3fff700 1 -- 172.21.15.50:0/2314987890 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bcc028070 con 0x5557f11a7830 2023-01-04T18:14:58.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.747+0000 7f9bb3fff700 1 -- 172.21.15.50:0/2314987890 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9bcc00f040 con 0x5557f11a7830 2023-01-04T18:14:58.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.747+0000 7f9bb3fff700 1 -- 172.21.15.50:0/2314987890 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bcc00e030 con 0x5557f11a7830 2023-01-04T18:14:58.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.747+0000 7f9be9867b80 1 -- 172.21.15.50:0/2314987890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f11a7830 msgr2=0x5557f1334740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:58.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.747+0000 7f9be9867b80 1 --2- 172.21.15.50:0/2314987890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f11a7830 0x5557f1334740 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x5557f134d6d0 tx=0x7f9bcc015000).stop 2023-01-04T18:14:58.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.747+0000 7f9be9867b80 1 -- 172.21.15.50:0/2314987890 shutdown_connections 2023-01-04T18:14:58.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.747+0000 7f9be9867b80 1 --2- 172.21.15.50:0/2314987890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5557f1339500 0x5557f1331520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-01-04T18:14:58.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.747+0000 7f9be9867b80 1 --2- 172.21.15.50:0/2314987890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f11a7830 0x5557f1334740 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.747+0000 7f9be9867b80 1 -- 172.21.15.50:0/2314987890 >> 172.21.15.50:0/2314987890 conn(0x5557f12feb50 msgr2=0x5557f1340c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:58.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.747+0000 7f9be9867b80 1 -- 172.21.15.50:0/2314987890 shutdown_connections 2023-01-04T18:14:58.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.747+0000 7f9be9867b80 1 -- 172.21.15.50:0/2314987890 wait complete. 2023-01-04T18:14:58.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.747+0000 7f9be9867b80 1 -- start start 2023-01-04T18:14:58.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.748+0000 7f9be9867b80 1 Processor -- start 2023-01-04T18:14:58.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.748+0000 7f9be9867b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5557f11a7830 0x5557f1397000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:58.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.748+0000 7f9be9867b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f1339500 0x5557f13974f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:58.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.748+0000 7f9be9867b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557f1397aa0 con 0x5557f1339500 2023-01-04T18:14:58.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.748+0000 7f9be9867b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557f1397be0 con 0x5557f11a7830 2023-01-04T18:14:58.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.748+0000 7f9be9867b80 10 client.0 ll_register_callbacks cb 0x5557f12f88a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-01-04T18:14:58.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.748+0000 7f9bd5241700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f1339500 0x5557f13974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:58.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.748+0000 7f9bd5241700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f1339500 0x5557f13974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38820/0 (socket says 172.21.15.50:38820) 2023-01-04T18:14:58.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.748+0000 7f9bd5241700 1 -- 172.21.15.50:0/2506049655 learned_addr learned my addr 172.21.15.50:0/2506049655 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:14:58.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.748+0000 7f9bd5a42700 1 --2- 172.21.15.50:0/2506049655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5557f11a7830 0x5557f1397000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:58.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.748+0000 7f9bd5241700 1 -- 172.21.15.50:0/2506049655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5557f11a7830 msgr2=0x5557f1397000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-04T18:14:58.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.748+0000 7f9bd5241700 1 --2- 172.21.15.50:0/2506049655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5557f11a7830 0x5557f1397000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.748+0000 7f9bd5241700 1 -- 172.21.15.50:0/2506049655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bcc005040 con 0x5557f1339500 2023-01-04T18:14:58.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.748+0000 7f9bd5a42700 1 --2- 172.21.15.50:0/2506049655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5557f11a7830 0x5557f1397000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-01-04T18:14:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.748+0000 7f9bd5241700 1 --2- 172.21.15.50:0/2506049655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f1339500 0x5557f13974f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f9bc4004540 tx=0x7f9bc4020040).ready entity=mon.0 client_cookie=1a329eb7f9da65b6 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:14:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.748+0000 7f9bb0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-01-04T18:14:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.749+0000 7f9bb0ff9700 1 -- 172.21.15.50:0/2506049655 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bc4035070 con 0x5557f1339500 2023-01-04T18:14:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.749+0000 7f9bb0ff9700 1 -- 172.21.15.50:0/2506049655 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f9bc40759a0 con 0x5557f1339500 2023-01-04T18:14:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.749+0000 7f9be9867b80 1 -- 172.21.15.50:0/2506049655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9bc404a110 con 0x5557f1339500 2023-01-04T18:14:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.749+0000 7f9bb0ff9700 1 -- 172.21.15.50:0/2506049655 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bc4049fb0 con 0x5557f1339500 2023-01-04T18:14:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.749+0000 7f9be9867b80 10 client.14548 fetch_fsmap learned FSMap version 13 2023-01-04T18:14:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.749+0000 7f9be9867b80 1 -- 172.21.15.50:0/2506049655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=3+}) v3 -- 0x5557f134d270 con 0x5557f1339500 2023-01-04T18:14:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.749+0000 7f9bb0ff9700 1 -- 172.21.15.50:0/2506049655 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9bc404a110 con 0x5557f1339500 2023-01-04T18:14:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.749+0000 7f9bb0ff9700 1 -- 172.21.15.50:0/2506049655 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 13) v1 ==== 1776+0+0 (secure 0 0 0) 0x7f9bc400f040 con 0x5557f1339500 2023-01-04T18:14:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.749+0000 7f9be9867b80 10 client.14548 fetch_fsmap finished waiting for FSMap version 13 2023-01-04T18:14:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.749+0000 7f9be9867b80 10 client.14548 resolve_mds: resolved name 'cephfs.smithi050.ezoiwl' to daemon mds.cephfs.smithi050.ezoiwl 2023-01-04T18:14:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.749+0000 7f9be9867b80 20 client.14548 populate_metadata read hostname 'smithi050' 2023-01-04T18:14:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.749+0000 7f9be9867b80 1 --2- 172.21.15.50:0/2506049655 >> [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] conn(0x5557f139d150 0x5557f139f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-01-04T18:14:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.749+0000 7f9be9867b80 4 client.14548 mds_command: new command op to 14430 tid=0[{"prefix": "status"}] 2023-01-04T18:14:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.749+0000 7f9be9867b80 1 -- 172.21.15.50:0/2506049655 --> [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5557f10f7d00 con 0x5557f139d150 2023-01-04T18:14:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.749+0000 7f9bd5a42700 1 --2- 172.21.15.50:0/2506049655 >> [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] conn(0x5557f139d150 0x5557f139f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:14:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.750+0000 7f9bd5a42700 1 --2- 172.21.15.50:0/2506049655 >> [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] conn(0x5557f139d150 0x5557f139f540 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=79c6fa6585a816ff server_cookie=226c72ee7229a967 in_seq=0 out_seq=0 2023-01-04T18:14:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.750+0000 7f9bb0ff9700 10 client.14548 ms_handle_connect on v2:172.21.15.50:6826/4069909541 2023-01-04T18:14:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.750+0000 7f9bb0ff9700 1 -- 172.21.15.50:0/2506049655 <== mds.0 v2:172.21.15.50:6826/4069909541 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5557f10f7d00 con 0x5557f139d150 2023-01-04T18:14:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.750+0000 7f9bb0ff9700 10 client.14548 handle_command_reply: tid=0 2023-01-04T18:14:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.750+0000 7f9be9867b80 1 client.14548 shutdown 2023-01-04T18:14:58.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.750+0000 7f9be9867b80 1 -- 172.21.15.50:0/2506049655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f1339500 msgr2=0x5557f13974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:58.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.750+0000 7f9be9867b80 1 --2- 172.21.15.50:0/2506049655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f1339500 0x5557f13974f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f9bc4004540 tx=0x7f9bc4020040).stop 2023-01-04T18:14:58.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.750+0000 7f9be9867b80 1 -- 172.21.15.50:0/2506049655 shutdown_connections 2023-01-04T18:14:58.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.750+0000 7f9be9867b80 1 --2- 172.21.15.50:0/2506049655 >> [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] conn(0x5557f139d150 0x5557f139f540 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.750+0000 7f9be9867b80 1 --2- 172.21.15.50:0/2506049655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5557f11a7830 0x5557f1397000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.750+0000 7f9be9867b80 1 --2- 172.21.15.50:0/2506049655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557f1339500 0x5557f13974f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.750+0000 7f9bb0ff9700 0 client.14548 ms_handle_reset on v2:172.21.15.50:6826/4069909541 2023-01-04T18:14:58.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.750+0000 7f9be9867b80 1 -- 172.21.15.50:0/2506049655 >> 172.21.15.50:0/2506049655 conn(0x5557f12feb50 msgr2=0x5557f1335540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:58.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.750+0000 7f9be9867b80 1 -- 172.21.15.50:0/2506049655 shutdown_connections 2023-01-04T18:14:58.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.750+0000 7f9be9867b80 1 -- 172.21.15.50:0/2506049655 wait complete. 2023-01-04T18:14:58.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.750+0000 7f9be9867b80 20 client.14548 trim_cache size 0 max 16384 2023-01-04T18:14:58.761 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:14:58.761 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "d98671da-8c5a-11ed-821a-001a4aab830c", 2023-01-04T18:14:58.761 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-01-04T18:14:58.761 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 14430, 2023-01-04T18:14:58.761 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-01-04T18:14:58.761 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-01-04T18:14:58.761 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-01-04T18:14:58.761 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 25.34323869, 2023-01-04T18:14:58.761 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 10, 2023-01-04T18:14:58.762 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 41, 2023-01-04T18:14:58.762 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 41, 2023-01-04T18:14:58.762 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 25.537160799999999 2023-01-04T18:14:58.762 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:14:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.750+0000 7f9bd7ca6700 1 -- 172.21.15.50:0/672868039 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f9bbc05c2b0 msgr2=0x7f9bbc05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.750+0000 7f9bd7ca6700 1 --2- 172.21.15.50:0/672868039 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f9bbc05c2b0 0x7f9bbc05e770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f9bcc009fd0 tx=0x7f9bcc00b040).stop 2023-01-04T18:14:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.750+0000 7f9bd7ca6700 1 -- 172.21.15.50:0/672868039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd00f5ca0 msgr2=0x7f9bd0105fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:14:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.750+0000 7f9bd7ca6700 1 --2- 172.21.15.50:0/672868039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd00f5ca0 0x7f9bd0105fe0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f9bc4000c00 tx=0x7f9bc400b040).stop 2023-01-04T18:14:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.751+0000 7f9bd7ca6700 1 -- 172.21.15.50:0/672868039 shutdown_connections 2023-01-04T18:14:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.751+0000 7f9bd7ca6700 1 --2- 172.21.15.50:0/672868039 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f9bbc05c2b0 0x7f9bbc05e770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.751+0000 7f9bd7ca6700 1 --2- 172.21.15.50:0/672868039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bd00f5390 0x7f9bd0105af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.751+0000 7f9bd7ca6700 1 --2- 172.21.15.50:0/672868039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bd00f5ca0 0x7f9bd0105fe0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:14:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.751+0000 7f9bd7ca6700 1 -- 172.21.15.50:0/672868039 >> 172.21.15.50:0/672868039 conn(0x7f9bd00f0b70 msgr2=0x7f9bd00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:14:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.751+0000 7f9bd7ca6700 1 -- 172.21.15.50:0/672868039 shutdown_connections 2023-01-04T18:14:58.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:14:58.751+0000 7f9bd7ca6700 1 -- 172.21.15.50:0/672868039 wait complete. 2023-01-04T18:14:58.765 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2023-01-04T18:14:58.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:58.765 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-01-04T18:14:58.784 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-01-04T18:14:58.784 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2023-01-04T18:14:58.914 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2023-01-04T18:14:58.915 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,name=1,norbytes" will pass to kernel. 2023-01-04T18:14:58.970 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,norbytes 2023-01-04T18:14:58.970 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,name=1,norbytes" will pass to kernel. 2023-01-04T18:14:58.972 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-01-04T18:14:58.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:14:58.973 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-01-04T18:14:58.999 INFO:teuthology.run_tasks:Running task print... 2023-01-04T18:14:59.013 INFO:teuthology.task.print:**** done client 2023-01-04T18:14:59.013 INFO:teuthology.run_tasks:Running task parallel... 2023-01-04T18:14:59.023 INFO:teuthology.task.parallel:starting parallel... 2023-01-04T18:14:59.024 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-01-04T18:14:59.025 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-01-04T18:14:59.025 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi050.front.sepia.ceph.com 2023-01-04T18:14:59.026 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -e sha1=f2bb1478686242c0f68882a9cf8df4e0f8363116 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-01-04T18:14:59.026 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-01-04T18:14:59.026 INFO:teuthology.task.sequential:In sequential, running task workunit... 2023-01-04T18:14:59.030 INFO:tasks.workunit:Pulling workunits from ref f2bb1478686242c0f68882a9cf8df4e0f8363116 2023-01-04T18:14:59.031 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-01-04T18:14:59.031 INFO:tasks.workunit:timeout=3h 2023-01-04T18:14:59.031 INFO:tasks.workunit:cleanup=True 2023-01-04T18:14:59.031 DEBUG:teuthology.orchestra.run.smithi050:> stat -- /home/ubuntu/cephtest/mnt.0 2023-01-04T18:14:59.052 INFO:teuthology.orchestra.run.smithi050.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-01-04T18:14:59.052 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-01-04T18:14:59.052 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 99h/153d Inode: 1 Links: 2 2023-01-04T18:14:59.052 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-04T18:14:59.052 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:cephfs_t:s0 2023-01-04T18:14:59.052 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-01-04T18:14:59.052 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-01-04 18:14:33.408745226 +0000 2023-01-04T18:14:59.052 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-01-04 18:14:55.894820649 +0000 2023-01-04T18:14:59.052 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2023-01-04 18:14:33.408745226 +0000 2023-01-04T18:14:59.053 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-01-04T18:14:59.053 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-01-04T18:14:59.125 DEBUG:teuthology.orchestra.run.smithi098:> stat -- /home/ubuntu/cephtest/mnt.1 2023-01-04T18:14:59.144 INFO:teuthology.orchestra.run.smithi098.stdout: File: /home/ubuntu/cephtest/mnt.1 2023-01-04T18:14:59.144 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2023-01-04T18:14:59.145 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 78h/120d Inode: 1 Links: 3 2023-01-04T18:14:59.145 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-04T18:14:59.145 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:cephfs_t:s0 2023-01-04T18:14:59.145 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-01-04T18:14:59.145 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2023-01-04 18:14:59.117739744 +0000 2023-01-04T18:14:59.145 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2023-01-04 18:14:59.117739744 +0000 2023-01-04T18:14:59.146 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2023-01-04 18:14:33.408745226 +0000 2023-01-04T18:14:59.146 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2023-01-04T18:14:59.146 DEBUG:teuthology.orchestra.run.smithi098:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2023-01-04T18:14:59.215 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f2bb1478686242c0f68882a9cf8df4e0f8363116 2023-01-04T18:14:59.216 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout f2bb1478686242c0f68882a9cf8df4e0f8363116 2023-01-04T18:14:59.236 INFO:tasks.workunit.client.0.smithi050.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-01-04T18:14:59.274 INFO:tasks.workunit.client.1.smithi098.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2023-01-04T18:14:59.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:14:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:14:58.586157+0000 mon.smithi050 (mon.0) 542 : audit [DBG] from='client.? 172.21.15.50:0/4077451501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-01-04T18:14:59.657 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:14:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:14:58.586157+0000 mon.smithi050 (mon.0) 542 : audit [DBG] from='client.? 172.21.15.50:0/4077451501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-01-04T18:15:00.467 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:14:59.299417+0000 mgr.smithi050.emnywo (mgr.14162) 212 : cluster [DBG] pgmap v173: 65 pgs: 65 active+clean; 2.5 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2023-01-04T18:15:00.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.602+0000 7f989a23f700 1 -- 172.21.15.50:0/2692233846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98940f7980 msgr2=0x7f98940f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:00.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.602+0000 7f989a23f700 1 --2- 172.21.15.50:0/2692233846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98940f7980 0x7f98940f7de0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f987c004660 tx=0x7f987c009b30).stop 2023-01-04T18:15:00.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.602+0000 7f989a23f700 1 -- 172.21.15.50:0/2692233846 shutdown_connections 2023-01-04T18:15:00.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.602+0000 7f989a23f700 1 --2- 172.21.15.50:0/2692233846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98940f7980 0x7f98940f7de0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:00.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.602+0000 7f989a23f700 1 --2- 172.21.15.50:0/2692233846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98940f66e0 0x7f98940f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:00.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.602+0000 7f989a23f700 1 -- 172.21.15.50:0/2692233846 >> 172.21.15.50:0/2692233846 conn(0x7f98940f1e40 msgr2=0x7f98940f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:00.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.602+0000 7f989a23f700 1 -- 172.21.15.50:0/2692233846 shutdown_connections 2023-01-04T18:15:00.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.602+0000 7f989a23f700 1 -- 172.21.15.50:0/2692233846 wait complete. 2023-01-04T18:15:00.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.603+0000 7f989a23f700 1 Processor -- start 2023-01-04T18:15:00.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.603+0000 7f989a23f700 1 -- start start 2023-01-04T18:15:00.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.603+0000 7f989a23f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98940f66e0 0x7f9894106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:00.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.603+0000 7f989a23f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98940f7980 0x7f9894107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:00.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.603+0000 7f989a23f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9894107a20 con 0x7f98940f7980 2023-01-04T18:15:00.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.603+0000 7f989a23f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9894107b60 con 0x7f98940f66e0 2023-01-04T18:15:00.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.604+0000 7f9892ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98940f7980 0x7f9894107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:00.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.604+0000 7f9892ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98940f7980 0x7f9894107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38828/0 (socket says 172.21.15.50:38828) 2023-01-04T18:15:00.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.604+0000 7f9892ffd700 1 -- 172.21.15.50:0/686217498 learned_addr learned my addr 172.21.15.50:0/686217498 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:15:00.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.604+0000 7f98937fe700 1 --2- 172.21.15.50:0/686217498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98940f66e0 0x7f9894106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:00.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.604+0000 7f9892ffd700 1 -- 172.21.15.50:0/686217498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98940f66e0 msgr2=0x7f9894106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:00.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.604+0000 7f9892ffd700 1 --2- 172.21.15.50:0/686217498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98940f66e0 0x7f9894106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:00.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.604+0000 7f9892ffd700 1 -- 172.21.15.50:0/686217498 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987c005040 con 0x7f98940f7980 2023-01-04T18:15:00.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.604+0000 7f9892ffd700 1 --2- 172.21.15.50:0/686217498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98940f7980 0x7f9894107470 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f987c009f50 tx=0x7f987c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:00.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.604+0000 7f988bfff700 1 -- 172.21.15.50:0/686217498 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f987c018070 con 0x7f98940f7980 2023-01-04T18:15:00.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.604+0000 7f988bfff700 1 -- 172.21.15.50:0/686217498 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f987c013410 con 0x7f98940f7980 2023-01-04T18:15:00.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.604+0000 7f989a23f700 1 -- 172.21.15.50:0/686217498 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98941084a0 con 0x7f98940f7980 2023-01-04T18:15:00.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.604+0000 7f988bfff700 1 -- 172.21.15.50:0/686217498 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f987c01c3c0 con 0x7f98940f7980 2023-01-04T18:15:00.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.604+0000 7f989a23f700 1 -- 172.21.15.50:0/686217498 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9894108a00 con 0x7f98940f7980 2023-01-04T18:15:00.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.605+0000 7f989a23f700 1 -- 172.21.15.50:0/686217498 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9894045ad0 con 0x7f98940f7980 2023-01-04T18:15:00.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.606+0000 7f988bfff700 1 -- 172.21.15.50:0/686217498 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f987c01d420 con 0x7f98940f7980 2023-01-04T18:15:00.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.606+0000 7f988bfff700 1 --2- 172.21.15.50:0/686217498 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f988005c2b0 0x7f988005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:00.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.606+0000 7f988bfff700 1 -- 172.21.15.50:0/686217498 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f987c077b40 con 0x7f98940f7980 2023-01-04T18:15:00.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.606+0000 7f98937fe700 1 --2- 172.21.15.50:0/686217498 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f988005c2b0 0x7f988005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:00.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.607+0000 7f98937fe700 1 --2- 172.21.15.50:0/686217498 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f988005c2b0 0x7f988005e770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f98940f77e0 tx=0x7f988400b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:00.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.610+0000 7f988bfff700 1 -- 172.21.15.50:0/686217498 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f987c04a800 con 0x7f98940f7980 2023-01-04T18:15:00.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.767+0000 7f989a23f700 1 -- 172.21.15.50:0/686217498 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f98940fef10 con 0x7f98940f7980 2023-01-04T18:15:00.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.767+0000 7f988bfff700 1 -- 172.21.15.50:0/686217498 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v16)=0 v16) v1 ==== 155+0+0 (secure 0 0 0) 0x7f987c04de20 con 0x7f98940f7980 2023-01-04T18:15:00.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.769+0000 7f989a23f700 1 -- 172.21.15.50:0/686217498 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f988005c2b0 msgr2=0x7f988005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:00.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.769+0000 7f989a23f700 1 --2- 172.21.15.50:0/686217498 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f988005c2b0 0x7f988005e770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f98940f77e0 tx=0x7f988400b040).stop 2023-01-04T18:15:00.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.769+0000 7f989a23f700 1 -- 172.21.15.50:0/686217498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98940f7980 msgr2=0x7f9894107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:00.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.769+0000 7f989a23f700 1 --2- 172.21.15.50:0/686217498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98940f7980 0x7f9894107470 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f987c009f50 tx=0x7f987c009b30).stop 2023-01-04T18:15:00.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.769+0000 7f989a23f700 1 -- 172.21.15.50:0/686217498 shutdown_connections 2023-01-04T18:15:00.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.769+0000 7f989a23f700 1 --2- 172.21.15.50:0/686217498 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f988005c2b0 0x7f988005e770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:00.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.769+0000 7f989a23f700 1 --2- 172.21.15.50:0/686217498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98940f66e0 0x7f9894106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:00.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.769+0000 7f989a23f700 1 --2- 172.21.15.50:0/686217498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98940f7980 0x7f9894107470 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:00.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.769+0000 7f989a23f700 1 -- 172.21.15.50:0/686217498 >> 172.21.15.50:0/686217498 conn(0x7f98940f1e40 msgr2=0x7f98940fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:00.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.769+0000 7f989a23f700 1 -- 172.21.15.50:0/686217498 shutdown_connections 2023-01-04T18:15:00.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:00.769+0000 7f989a23f700 1 -- 172.21.15.50:0/686217498 wait complete. 2023-01-04T18:15:00.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:14:59.299417+0000 mgr.smithi050.emnywo (mgr.14162) 212 : cluster [DBG] pgmap v173: 65 pgs: 65 active+clean; 2.5 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2023-01-04T18:15:01.271 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -e sha1=f2bb1478686242c0f68882a9cf8df4e0f8363116 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-01-04T18:15:02.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:01.299804+0000 mgr.smithi050.emnywo (mgr.14162) 213 : cluster [DBG] pgmap v174: 65 pgs: 65 active+clean; 2.5 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2023-01-04T18:15:02.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:01.299804+0000 mgr.smithi050.emnywo (mgr.14162) 213 : cluster [DBG] pgmap v174: 65 pgs: 65 active+clean; 2.5 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2023-01-04T18:15:02.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.887+0000 7fec438d8700 1 -- 172.21.15.50:0/1549239021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec3c0f7980 msgr2=0x7fec3c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:02.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.887+0000 7fec438d8700 1 --2- 172.21.15.50:0/1549239021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec3c0f7980 0x7fec3c0f7de0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fec30004660 tx=0x7fec30009b30).stop 2023-01-04T18:15:02.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.888+0000 7fec438d8700 1 -- 172.21.15.50:0/1549239021 shutdown_connections 2023-01-04T18:15:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.888+0000 7fec438d8700 1 --2- 172.21.15.50:0/1549239021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec3c0f7980 0x7fec3c0f7de0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.888+0000 7fec438d8700 1 --2- 172.21.15.50:0/1549239021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec3c0f66e0 0x7fec3c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.888+0000 7fec438d8700 1 -- 172.21.15.50:0/1549239021 >> 172.21.15.50:0/1549239021 conn(0x7fec3c0f1e40 msgr2=0x7fec3c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.888+0000 7fec438d8700 1 -- 172.21.15.50:0/1549239021 shutdown_connections 2023-01-04T18:15:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.888+0000 7fec438d8700 1 -- 172.21.15.50:0/1549239021 wait complete. 2023-01-04T18:15:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.888+0000 7fec438d8700 1 Processor -- start 2023-01-04T18:15:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.888+0000 7fec438d8700 1 -- start start 2023-01-04T18:15:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.888+0000 7fec438d8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec3c0f66e0 0x7fec3c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.888+0000 7fec438d8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec3c0f7980 0x7fec3c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.888+0000 7fec438d8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c06a380 con 0x7fec3c0f66e0 2023-01-04T18:15:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.888+0000 7fec438d8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c06a4c0 con 0x7fec3c0f7980 2023-01-04T18:15:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.889+0000 7fec41674700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec3c0f66e0 0x7fec3c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.889+0000 7fec41674700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec3c0f66e0 0x7fec3c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38842/0 (socket says 172.21.15.50:38842) 2023-01-04T18:15:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.889+0000 7fec41674700 1 -- 172.21.15.50:0/3858928609 learned_addr learned my addr 172.21.15.50:0/3858928609 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:15:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.889+0000 7fec41674700 1 -- 172.21.15.50:0/3858928609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec3c0f7980 msgr2=0x7fec3c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.889+0000 7fec40e73700 1 --2- 172.21.15.50:0/3858928609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec3c0f7980 0x7fec3c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.889+0000 7fec41674700 1 --2- 172.21.15.50:0/3858928609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec3c0f7980 0x7fec3c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.889+0000 7fec41674700 1 -- 172.21.15.50:0/3858928609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec30005040 con 0x7fec3c0f66e0 2023-01-04T18:15:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.889+0000 7fec41674700 1 --2- 172.21.15.50:0/3858928609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec3c0f66e0 0x7fec3c06b9a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fec38002700 tx=0x7fec38009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.889+0000 7fec2dffb700 1 -- 172.21.15.50:0/3858928609 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec38009320 con 0x7fec3c0f66e0 2023-01-04T18:15:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.889+0000 7fec438d8700 1 -- 172.21.15.50:0/3858928609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec3c06a7a0 con 0x7fec3c0f66e0 2023-01-04T18:15:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.889+0000 7fec2dffb700 1 -- 172.21.15.50:0/3858928609 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fec3800f040 con 0x7fec3c0f66e0 2023-01-04T18:15:02.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.889+0000 7fec2dffb700 1 -- 172.21.15.50:0/3858928609 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec38014900 con 0x7fec3c0f66e0 2023-01-04T18:15:02.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.889+0000 7fec438d8700 1 -- 172.21.15.50:0/3858928609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec3c10efb0 con 0x7fec3c0f66e0 2023-01-04T18:15:02.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.890+0000 7fec438d8700 1 -- 172.21.15.50:0/3858928609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec3c045ad0 con 0x7fec3c0f66e0 2023-01-04T18:15:02.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.891+0000 7fec2dffb700 1 -- 172.21.15.50:0/3858928609 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fec38009480 con 0x7fec3c0f66e0 2023-01-04T18:15:02.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.891+0000 7fec2dffb700 1 --2- 172.21.15.50:0/3858928609 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fec2805c2b0 0x7fec2805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:02.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.891+0000 7fec2dffb700 1 -- 172.21.15.50:0/3858928609 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fec38076210 con 0x7fec3c0f66e0 2023-01-04T18:15:02.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.891+0000 7fec40e73700 1 --2- 172.21.15.50:0/3858928609 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fec2805c2b0 0x7fec2805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:02.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.892+0000 7fec40e73700 1 --2- 172.21.15.50:0/3858928609 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fec2805c2b0 0x7fec2805e770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fec30009d60 tx=0x7fec30009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:02.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:02.895+0000 7fec2dffb700 1 -- 172.21.15.50:0/3858928609 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fec38048ed0 con 0x7fec3c0f66e0 2023-01-04T18:15:03.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:03.053+0000 7fec438d8700 1 -- 172.21.15.50:0/3858928609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fec3c027a00 con 0x7fec3c0f66e0 2023-01-04T18:15:03.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:03.054+0000 7fec2dffb700 1 -- 172.21.15.50:0/3858928609 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v16)=0 v16) v1 ==== 163+0+0 (secure 0 0 0) 0x7fec3804c4f0 con 0x7fec3c0f66e0 2023-01-04T18:15:03.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:03.055+0000 7fec438d8700 1 -- 172.21.15.50:0/3858928609 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fec2805c2b0 msgr2=0x7fec2805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:03.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:03.055+0000 7fec438d8700 1 --2- 172.21.15.50:0/3858928609 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fec2805c2b0 0x7fec2805e770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fec30009d60 tx=0x7fec30009b30).stop 2023-01-04T18:15:03.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:03.055+0000 7fec438d8700 1 -- 172.21.15.50:0/3858928609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec3c0f66e0 msgr2=0x7fec3c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:03.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:03.055+0000 7fec438d8700 1 --2- 172.21.15.50:0/3858928609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec3c0f66e0 0x7fec3c06b9a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fec38002700 tx=0x7fec38009d80).stop 2023-01-04T18:15:03.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:03.056+0000 7fec438d8700 1 -- 172.21.15.50:0/3858928609 shutdown_connections 2023-01-04T18:15:03.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:03.056+0000 7fec438d8700 1 --2- 172.21.15.50:0/3858928609 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fec2805c2b0 0x7fec2805e770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:03.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:03.056+0000 7fec438d8700 1 --2- 172.21.15.50:0/3858928609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec3c0f66e0 0x7fec3c06b9a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:03.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:03.056+0000 7fec438d8700 1 --2- 172.21.15.50:0/3858928609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec3c0f7980 0x7fec3c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:03.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:03.056+0000 7fec438d8700 1 -- 172.21.15.50:0/3858928609 >> 172.21.15.50:0/3858928609 conn(0x7fec3c0f1e40 msgr2=0x7fec3c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:03.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:03.056+0000 7fec438d8700 1 -- 172.21.15.50:0/3858928609 shutdown_connections 2023-01-04T18:15:03.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:03.056+0000 7fec438d8700 1 -- 172.21.15.50:0/3858928609 wait complete. 2023-01-04T18:15:03.727 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -e sha1=f2bb1478686242c0f68882a9cf8df4e0f8363116 -- bash -c 'ceph config set global log_to_journald false --force' 2023-01-04T18:15:04.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:03.300468+0000 mgr.smithi050.emnywo (mgr.14162) 214 : cluster [DBG] pgmap v175: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 3 op/s 2023-01-04T18:15:04.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:03.300468+0000 mgr.smithi050.emnywo (mgr.14162) 214 : cluster [DBG] pgmap v175: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 3 op/s 2023-01-04T18:15:05.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.302+0000 7f49ca433700 1 -- 172.21.15.50:0/34212645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49c40f5710 msgr2=0x7f49c40f5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:05.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.302+0000 7f49ca433700 1 --2- 172.21.15.50:0/34212645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49c40f5710 0x7f49c40f5b90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f49b4004660 tx=0x7f49b4009b30).stop 2023-01-04T18:15:05.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.302+0000 7f49ca433700 1 -- 172.21.15.50:0/34212645 shutdown_connections 2023-01-04T18:15:05.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.302+0000 7f49ca433700 1 --2- 172.21.15.50:0/34212645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49c40f5710 0x7f49c40f5b90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:05.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.302+0000 7f49ca433700 1 --2- 172.21.15.50:0/34212645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49c40f6a10 0x7f49c40f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:05.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.302+0000 7f49ca433700 1 -- 172.21.15.50:0/34212645 >> 172.21.15.50:0/34212645 conn(0x7f49c40f0320 msgr2=0x7f49c40f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:05.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.303+0000 7f49ca433700 1 -- 172.21.15.50:0/34212645 shutdown_connections 2023-01-04T18:15:05.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.303+0000 7f49ca433700 1 -- 172.21.15.50:0/34212645 wait complete. 2023-01-04T18:15:05.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.303+0000 7f49ca433700 1 Processor -- start 2023-01-04T18:15:05.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.303+0000 7f49ca433700 1 -- start start 2023-01-04T18:15:05.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.303+0000 7f49ca433700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49c40f5710 0x7f49c4105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:05.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.303+0000 7f49ca433700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49c40f6a10 0x7f49c41061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:05.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.303+0000 7f49ca433700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c4106760 con 0x7f49c40f5710 2023-01-04T18:15:05.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.303+0000 7f49ca433700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c4106f60 con 0x7f49c40f6a10 2023-01-04T18:15:05.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.303+0000 7f49c9431700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49c40f5710 0x7f49c4105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:05.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.303+0000 7f49c9431700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49c40f5710 0x7f49c4105cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38858/0 (socket says 172.21.15.50:38858) 2023-01-04T18:15:05.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.303+0000 7f49c9431700 1 -- 172.21.15.50:0/72028523 learned_addr learned my addr 172.21.15.50:0/72028523 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:15:05.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.303+0000 7f49c8c30700 1 --2- 172.21.15.50:0/72028523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49c40f6a10 0x7f49c41061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:05.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.304+0000 7f49c9431700 1 -- 172.21.15.50:0/72028523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49c40f6a10 msgr2=0x7f49c41061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:05.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.304+0000 7f49c9431700 1 --2- 172.21.15.50:0/72028523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49c40f6a10 0x7f49c41061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:05.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.304+0000 7f49c9431700 1 -- 172.21.15.50:0/72028523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b4005040 con 0x7f49c40f5710 2023-01-04T18:15:05.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.304+0000 7f49c8c30700 1 --2- 172.21.15.50:0/72028523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49c40f6a10 0x7f49c41061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-01-04T18:15:05.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.304+0000 7f49c9431700 1 --2- 172.21.15.50:0/72028523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49c40f5710 0x7f49c4105cc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f49c00109d0 tx=0x7f49c000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:05.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.304+0000 7f49b9ffb700 1 -- 172.21.15.50:0/72028523 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49c00092e0 con 0x7f49c40f5710 2023-01-04T18:15:05.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.304+0000 7f49ca433700 1 -- 172.21.15.50:0/72028523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c41071e0 con 0x7f49c40f5710 2023-01-04T18:15:05.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.304+0000 7f49b9ffb700 1 -- 172.21.15.50:0/72028523 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f49c0009440 con 0x7f49c40f5710 2023-01-04T18:15:05.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.304+0000 7f49b9ffb700 1 -- 172.21.15.50:0/72028523 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49c0007d40 con 0x7f49c40f5710 2023-01-04T18:15:05.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.304+0000 7f49ca433700 1 -- 172.21.15.50:0/72028523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c4107750 con 0x7f49c40f5710 2023-01-04T18:15:05.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.305+0000 7f49ca433700 1 -- 172.21.15.50:0/72028523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c4059100 con 0x7f49c40f5710 2023-01-04T18:15:05.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.306+0000 7f49b9ffb700 1 -- 172.21.15.50:0/72028523 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f49c0018030 con 0x7f49c40f5710 2023-01-04T18:15:05.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.306+0000 7f49b9ffb700 1 --2- 172.21.15.50:0/72028523 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f49b005c300 0x7f49b005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:05.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.306+0000 7f49b9ffb700 1 -- 172.21.15.50:0/72028523 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f49c0078440 con 0x7f49c40f5710 2023-01-04T18:15:05.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.306+0000 7f49c8c30700 1 --2- 172.21.15.50:0/72028523 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f49b005c300 0x7f49b005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:05.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.306+0000 7f49c8c30700 1 --2- 172.21.15.50:0/72028523 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f49b005c300 0x7f49b005e7c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f49b4013530 tx=0x7f49b4016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:05.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.310+0000 7f49b9ffb700 1 -- 172.21.15.50:0/72028523 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f49c004b100 con 0x7f49c40f5710 2023-01-04T18:15:05.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.482+0000 7f49ca433700 1 -- 172.21.15.50:0/72028523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f49c40fdc30 con 0x7f49c40f5710 2023-01-04T18:15:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.488+0000 7f49b9ffb700 1 -- 172.21.15.50:0/72028523 <== mon.0 v2:172.21.15.50:3300/0 7 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f49c004b100 con 0x7f49c40f5710 2023-01-04T18:15:05.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.488+0000 7f49b9ffb700 1 -- 172.21.15.50:0/72028523 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v17)=0 v17) v1 ==== 135+0+0 (secure 0 0 0) 0x7f49c0016020 con 0x7f49c40f5710 2023-01-04T18:15:05.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.490+0000 7f49ca433700 1 -- 172.21.15.50:0/72028523 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f49b005c300 msgr2=0x7f49b005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:05.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.490+0000 7f49ca433700 1 --2- 172.21.15.50:0/72028523 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f49b005c300 0x7f49b005e7c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f49b4013530 tx=0x7f49b4016040).stop 2023-01-04T18:15:05.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.490+0000 7f49ca433700 1 -- 172.21.15.50:0/72028523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49c40f5710 msgr2=0x7f49c4105cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:05.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.490+0000 7f49ca433700 1 --2- 172.21.15.50:0/72028523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49c40f5710 0x7f49c4105cc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f49c00109d0 tx=0x7f49c000b040).stop 2023-01-04T18:15:05.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.490+0000 7f49ca433700 1 -- 172.21.15.50:0/72028523 shutdown_connections 2023-01-04T18:15:05.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.490+0000 7f49ca433700 1 --2- 172.21.15.50:0/72028523 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f49b005c300 0x7f49b005e7c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:05.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.490+0000 7f49ca433700 1 --2- 172.21.15.50:0/72028523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49c40f5710 0x7f49c4105cc0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:05.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.490+0000 7f49ca433700 1 --2- 172.21.15.50:0/72028523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49c40f6a10 0x7f49c41061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:05.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.490+0000 7f49ca433700 1 -- 172.21.15.50:0/72028523 >> 172.21.15.50:0/72028523 conn(0x7f49c40f0320 msgr2=0x7f49c40fa170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:05.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.490+0000 7f49ca433700 1 -- 172.21.15.50:0/72028523 shutdown_connections 2023-01-04T18:15:05.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:05.490+0000 7f49ca433700 1 -- 172.21.15.50:0/72028523 wait complete. 2023-01-04T18:15:05.958 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -e sha1=f2bb1478686242c0f68882a9cf8df4e0f8363116 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2023-01-04T18:15:06.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:05.300868+0000 mgr.smithi050.emnywo (mgr.14162) 215 : cluster [DBG] pgmap v176: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2023-01-04T18:15:06.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:05.488445+0000 mon.smithi050 (mon.0) 543 : audit [INF] from='client.? 172.21.15.50:0/72028523' entity='client.admin' 2023-01-04T18:15:06.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:05.491847+0000 mon.smithi050 (mon.0) 544 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:15:06.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:05.497506+0000 mon.smithi050 (mon.0) 545 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:15:06.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:05.300868+0000 mgr.smithi050.emnywo (mgr.14162) 215 : cluster [DBG] pgmap v176: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2023-01-04T18:15:06.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:05.488445+0000 mon.smithi050 (mon.0) 543 : audit [INF] from='client.? 172.21.15.50:0/72028523' entity='client.admin' 2023-01-04T18:15:06.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:05.491847+0000 mon.smithi050 (mon.0) 544 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:15:06.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:05.497506+0000 mon.smithi050 (mon.0) 545 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:15:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.524+0000 7fea81521700 1 -- 172.21.15.50:0/3471333214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea7c0f96d0 msgr2=0x7fea7c0fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.524+0000 7fea81521700 1 --2- 172.21.15.50:0/3471333214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea7c0f96d0 0x7fea7c0fbae0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fea70004660 tx=0x7fea70009b30).stop 2023-01-04T18:15:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.524+0000 7fea81521700 1 -- 172.21.15.50:0/3471333214 shutdown_connections 2023-01-04T18:15:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.524+0000 7fea81521700 1 --2- 172.21.15.50:0/3471333214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea7c0f96d0 0x7fea7c0fbae0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.524+0000 7fea81521700 1 --2- 172.21.15.50:0/3471333214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea7c0602d0 0x7fea7c0f9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.524+0000 7fea81521700 1 -- 172.21.15.50:0/3471333214 >> 172.21.15.50:0/3471333214 conn(0x7fea7c0f0b90 msgr2=0x7fea7c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.524+0000 7fea81521700 1 -- 172.21.15.50:0/3471333214 shutdown_connections 2023-01-04T18:15:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.524+0000 7fea81521700 1 -- 172.21.15.50:0/3471333214 wait complete. 2023-01-04T18:15:07.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.525+0000 7fea81521700 1 Processor -- start 2023-01-04T18:15:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.525+0000 7fea81521700 1 -- start start 2023-01-04T18:15:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.525+0000 7fea81521700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea7c0602d0 0x7fea7c0f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.525+0000 7fea81521700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea7c0f96d0 0x7fea7c0f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.525+0000 7fea81521700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c0f55b0 con 0x7fea7c0f96d0 2023-01-04T18:15:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.525+0000 7fea81521700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c0f56f0 con 0x7fea7c0602d0 2023-01-04T18:15:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.525+0000 7fea7b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea7c0f96d0 0x7fea7c0f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.526+0000 7fea7bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea7c0602d0 0x7fea7c0f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.526+0000 7fea7b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea7c0f96d0 0x7fea7c0f5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35568/0 (socket says 172.21.15.50:35568) 2023-01-04T18:15:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.526+0000 7fea7b7fe700 1 -- 172.21.15.50:0/2886162750 learned_addr learned my addr 172.21.15.50:0/2886162750 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:15:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.526+0000 7fea7bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea7c0602d0 0x7fea7c0f6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.50:53954/0 (socket says 172.21.15.50:53954) 2023-01-04T18:15:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.526+0000 7fea7b7fe700 1 -- 172.21.15.50:0/2886162750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea7c0602d0 msgr2=0x7fea7c0f6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.526+0000 7fea7b7fe700 1 --2- 172.21.15.50:0/2886162750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea7c0602d0 0x7fea7c0f6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.526+0000 7fea7b7fe700 1 -- 172.21.15.50:0/2886162750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea70005040 con 0x7fea7c0f96d0 2023-01-04T18:15:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.526+0000 7fea7bfff700 1 --2- 172.21.15.50:0/2886162750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea7c0602d0 0x7fea7c0f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-01-04T18:15:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.526+0000 7fea7b7fe700 1 --2- 172.21.15.50:0/2886162750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea7c0f96d0 0x7fea7c0f5050 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fea70014040 tx=0x7fea7000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.526+0000 7fea78ff9700 1 -- 172.21.15.50:0/2886162750 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea70019070 con 0x7fea7c0f96d0 2023-01-04T18:15:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.526+0000 7fea78ff9700 1 -- 172.21.15.50:0/2886162750 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fea7001e420 con 0x7fea7c0f96d0 2023-01-04T18:15:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.526+0000 7fea78ff9700 1 -- 172.21.15.50:0/2886162750 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea70014620 con 0x7fea7c0f96d0 2023-01-04T18:15:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.526+0000 7fea81521700 1 -- 172.21.15.50:0/2886162750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea7c0f5970 con 0x7fea7c0f96d0 2023-01-04T18:15:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.526+0000 7fea81521700 1 -- 172.21.15.50:0/2886162750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7c0f5e50 con 0x7fea7c0f96d0 2023-01-04T18:15:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.527+0000 7fea81521700 1 -- 172.21.15.50:0/2886162750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea7c045ad0 con 0x7fea7c0f96d0 2023-01-04T18:15:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.528+0000 7fea78ff9700 1 -- 172.21.15.50:0/2886162750 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fea7001e9e0 con 0x7fea7c0f96d0 2023-01-04T18:15:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.528+0000 7fea78ff9700 1 --2- 172.21.15.50:0/2886162750 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fea6405c300 0x7fea6405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.528+0000 7fea78ff9700 1 -- 172.21.15.50:0/2886162750 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fea700771b0 con 0x7fea7c0f96d0 2023-01-04T18:15:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.528+0000 7fea7bfff700 1 --2- 172.21.15.50:0/2886162750 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fea6405c300 0x7fea6405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.529+0000 7fea7bfff700 1 --2- 172.21.15.50:0/2886162750 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fea6405c300 0x7fea6405e7c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fea7c0f6960 tx=0x7fea6c00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:07.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.532+0000 7fea78ff9700 1 -- 172.21.15.50:0/2886162750 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fea70049ef0 con 0x7fea7c0f96d0 2023-01-04T18:15:07.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.738+0000 7fea81521700 1 -- 172.21.15.50:0/2886162750 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f2bb1478686242c0f68882a9cf8df4e0f8363116", "target": ["mon-mgr", ""]}) v1 -- 0x7fea7c058070 con 0x7fea6405c300 2023-01-04T18:15:07.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.743+0000 7fea78ff9700 1 -- 172.21.15.50:0/2886162750 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fea7c058070 con 0x7fea6405c300 2023-01-04T18:15:07.746 INFO:teuthology.orchestra.run.smithi050.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f2bb1478686242c0f68882a9cf8df4e0f8363116 2023-01-04T18:15:07.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.745+0000 7fea81521700 1 -- 172.21.15.50:0/2886162750 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fea6405c300 msgr2=0x7fea6405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:07.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.745+0000 7fea81521700 1 --2- 172.21.15.50:0/2886162750 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fea6405c300 0x7fea6405e7c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fea7c0f6960 tx=0x7fea6c00b040).stop 2023-01-04T18:15:07.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.745+0000 7fea81521700 1 -- 172.21.15.50:0/2886162750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea7c0f96d0 msgr2=0x7fea7c0f5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:07.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.745+0000 7fea81521700 1 --2- 172.21.15.50:0/2886162750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea7c0f96d0 0x7fea7c0f5050 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fea70014040 tx=0x7fea7000b040).stop 2023-01-04T18:15:07.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.745+0000 7fea81521700 1 -- 172.21.15.50:0/2886162750 shutdown_connections 2023-01-04T18:15:07.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.745+0000 7fea81521700 1 --2- 172.21.15.50:0/2886162750 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fea6405c300 0x7fea6405e7c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:07.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.745+0000 7fea81521700 1 --2- 172.21.15.50:0/2886162750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea7c0602d0 0x7fea7c0f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:07.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.745+0000 7fea81521700 1 --2- 172.21.15.50:0/2886162750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea7c0f96d0 0x7fea7c0f5050 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:07.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.745+0000 7fea81521700 1 -- 172.21.15.50:0/2886162750 >> 172.21.15.50:0/2886162750 conn(0x7fea7c0f0b90 msgr2=0x7fea7c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:07.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.745+0000 7fea81521700 1 -- 172.21.15.50:0/2886162750 shutdown_connections 2023-01-04T18:15:07.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:07.746+0000 7fea81521700 1 -- 172.21.15.50:0/2886162750 wait complete. 2023-01-04T18:15:08.190 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-01-04T18:15:08.191 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi050.front.sepia.ceph.com 2023-01-04T18:15:08.191 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -e sha1=f2bb1478686242c0f68882a9cf8df4e0f8363116 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; sleep 30 ; done' 2023-01-04T18:15:09.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:07.301271+0000 mgr.smithi050.emnywo (mgr.14162) 216 : cluster [DBG] pgmap v177: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 3 op/s 2023-01-04T18:15:09.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:07.740751+0000 mgr.smithi050.emnywo (mgr.14162) 217 : audit [DBG] from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f2bb1478686242c0f68882a9cf8df4e0f8363116", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:15:09.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:15:07.741349+0000 mgr.smithi050.emnywo (mgr.14162) 218 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f2bb1478686242c0f68882a9cf8df4e0f8363116 2023-01-04T18:15:09.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:07.744604+0000 mon.smithi050 (mon.0) 546 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:15:09.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:07.745415+0000 mon.smithi050 (mon.0) 547 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:15:09.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:07.751002+0000 mon.smithi050 (mon.0) 548 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:15:09.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:15:07.754485+0000 mgr.smithi050.emnywo (mgr.14162) 219 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f2bb1478686242c0f68882a9cf8df4e0f8363116 2023-01-04T18:15:09.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:07.301271+0000 mgr.smithi050.emnywo (mgr.14162) 216 : cluster [DBG] pgmap v177: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 3 op/s 2023-01-04T18:15:09.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:07.740751+0000 mgr.smithi050.emnywo (mgr.14162) 217 : audit [DBG] from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f2bb1478686242c0f68882a9cf8df4e0f8363116", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:15:09.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:15:07.741349+0000 mgr.smithi050.emnywo (mgr.14162) 218 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f2bb1478686242c0f68882a9cf8df4e0f8363116 2023-01-04T18:15:09.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:07.744604+0000 mon.smithi050 (mon.0) 546 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:15:09.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:07.745415+0000 mon.smithi050 (mon.0) 547 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:15:09.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:07.751002+0000 mon.smithi050 (mon.0) 548 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:15:09.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:15:07.754485+0000 mgr.smithi050.emnywo (mgr.14162) 219 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f2bb1478686242c0f68882a9cf8df4e0f8363116 2023-01-04T18:15:10.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.086+0000 7f66123a0700 1 -- 172.21.15.50:0/554111516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f660c0f77d0 msgr2=0x7f660c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:10.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.086+0000 7f66123a0700 1 --2- 172.21.15.50:0/554111516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f660c0f77d0 0x7f660c0f7c30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f65fc004660 tx=0x7f65fc009b30).stop 2023-01-04T18:15:10.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.087+0000 7f66123a0700 1 -- 172.21.15.50:0/554111516 shutdown_connections 2023-01-04T18:15:10.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.087+0000 7f66123a0700 1 --2- 172.21.15.50:0/554111516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f660c0f77d0 0x7f660c0f7c30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:10.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.087+0000 7f66123a0700 1 --2- 172.21.15.50:0/554111516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f660c0f6530 0x7f660c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:10.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.087+0000 7f66123a0700 1 -- 172.21.15.50:0/554111516 >> 172.21.15.50:0/554111516 conn(0x7f660c0f1c90 msgr2=0x7f660c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:10.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.087+0000 7f66123a0700 1 -- 172.21.15.50:0/554111516 shutdown_connections 2023-01-04T18:15:10.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.087+0000 7f66123a0700 1 -- 172.21.15.50:0/554111516 wait complete. 2023-01-04T18:15:10.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.087+0000 7f66123a0700 1 Processor -- start 2023-01-04T18:15:10.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.087+0000 7f66123a0700 1 -- start start 2023-01-04T18:15:10.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.088+0000 7f66123a0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f660c0f6530 0x7f660c106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:10.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.088+0000 7f66123a0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f660c0f77d0 0x7f660c107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:10.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.088+0000 7f66123a0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c107850 con 0x7f660c0f6530 2023-01-04T18:15:10.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.088+0000 7f66123a0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c108060 con 0x7f660c0f77d0 2023-01-04T18:15:10.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.088+0000 7f661139e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f660c0f6530 0x7f660c106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:10.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.088+0000 7f661139e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f660c0f6530 0x7f660c106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35576/0 (socket says 172.21.15.50:35576) 2023-01-04T18:15:10.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.088+0000 7f661139e700 1 -- 172.21.15.50:0/861109988 learned_addr learned my addr 172.21.15.50:0/861109988 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:15:10.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.088+0000 7f6610b9d700 1 --2- 172.21.15.50:0/861109988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f660c0f77d0 0x7f660c107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:10.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.088+0000 7f661139e700 1 -- 172.21.15.50:0/861109988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f660c0f77d0 msgr2=0x7f660c107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:10.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.088+0000 7f661139e700 1 --2- 172.21.15.50:0/861109988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f660c0f77d0 0x7f660c107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:10.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.088+0000 7f661139e700 1 -- 172.21.15.50:0/861109988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65fc005040 con 0x7f660c0f6530 2023-01-04T18:15:10.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.088+0000 7f661139e700 1 --2- 172.21.15.50:0/861109988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f660c0f6530 0x7f660c106d60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f660800e7c0 tx=0x7f660800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:10.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.088+0000 7f6601ffb700 1 -- 172.21.15.50:0/861109988 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66080092e0 con 0x7f660c0f6530 2023-01-04T18:15:10.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.089+0000 7f66123a0700 1 -- 172.21.15.50:0/861109988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660c1082e0 con 0x7f660c0f6530 2023-01-04T18:15:10.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.089+0000 7f6601ffb700 1 -- 172.21.15.50:0/861109988 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f660800f040 con 0x7f660c0f6530 2023-01-04T18:15:10.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.089+0000 7f6601ffb700 1 -- 172.21.15.50:0/861109988 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66080147e0 con 0x7f660c0f6530 2023-01-04T18:15:10.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.089+0000 7f66123a0700 1 -- 172.21.15.50:0/861109988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660c108820 con 0x7f660c0f6530 2023-01-04T18:15:10.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.090+0000 7f66123a0700 1 -- 172.21.15.50:0/861109988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660c059100 con 0x7f660c0f6530 2023-01-04T18:15:10.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.091+0000 7f6601ffb700 1 -- 172.21.15.50:0/861109988 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f660801b030 con 0x7f660c0f6530 2023-01-04T18:15:10.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.091+0000 7f6601ffb700 1 --2- 172.21.15.50:0/861109988 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f65f805c2f0 0x7f65f805e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:10.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.091+0000 7f6601ffb700 1 -- 172.21.15.50:0/861109988 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f6608075da0 con 0x7f660c0f6530 2023-01-04T18:15:10.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.091+0000 7f6610b9d700 1 --2- 172.21.15.50:0/861109988 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f65f805c2f0 0x7f65f805e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:10.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.092+0000 7f6610b9d700 1 --2- 172.21.15.50:0/861109988 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f65f805c2f0 0x7f65f805e7b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f65fc005010 tx=0x7f65fc016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:10.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.098+0000 7f6601ffb700 1 -- 172.21.15.50:0/861109988 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f6608048a60 con 0x7f660c0f6530 2023-01-04T18:15:10.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.395+0000 7f66123a0700 1 -- 172.21.15.50:0/861109988 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f660c0feda0 con 0x7f65f805c2f0 2023-01-04T18:15:10.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.397+0000 7f6601ffb700 1 -- 172.21.15.50:0/861109988 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+278 (secure 0 0 0) 0x7f660c0feda0 con 0x7f65f805c2f0 2023-01-04T18:15:10.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.399+0000 7f66123a0700 1 -- 172.21.15.50:0/861109988 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f65f805c2f0 msgr2=0x7f65f805e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:10.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.399+0000 7f66123a0700 1 --2- 172.21.15.50:0/861109988 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f65f805c2f0 0x7f65f805e7b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f65fc005010 tx=0x7f65fc016040).stop 2023-01-04T18:15:10.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.399+0000 7f66123a0700 1 -- 172.21.15.50:0/861109988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f660c0f6530 msgr2=0x7f660c106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:10.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.399+0000 7f66123a0700 1 --2- 172.21.15.50:0/861109988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f660c0f6530 0x7f660c106d60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f660800e7c0 tx=0x7f660800b040).stop 2023-01-04T18:15:10.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.401+0000 7f66123a0700 1 -- 172.21.15.50:0/861109988 shutdown_connections 2023-01-04T18:15:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.401+0000 7f66123a0700 1 --2- 172.21.15.50:0/861109988 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f65f805c2f0 0x7f65f805e7b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.401+0000 7f66123a0700 1 --2- 172.21.15.50:0/861109988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f660c0f6530 0x7f660c106d60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.401+0000 7f66123a0700 1 --2- 172.21.15.50:0/861109988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f660c0f77d0 0x7f660c107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.401+0000 7f66123a0700 1 -- 172.21.15.50:0/861109988 >> 172.21.15.50:0/861109988 conn(0x7f660c0f1c90 msgr2=0x7f660c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:10.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.402+0000 7f66123a0700 1 -- 172.21.15.50:0/861109988 shutdown_connections 2023-01-04T18:15:10.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.402+0000 7f66123a0700 1 -- 172.21.15.50:0/861109988 wait complete. 2023-01-04T18:15:10.421 INFO:teuthology.orchestra.run.smithi050.stdout:true 2023-01-04T18:15:10.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.544+0000 7f6616d9e700 1 -- 172.21.15.50:0/539808920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66100f66e0 msgr2=0x7f66100f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:10.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.544+0000 7f6616d9e700 1 --2- 172.21.15.50:0/539808920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66100f66e0 0x7f66100f6b40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f6600004660 tx=0x7f6600009b30).stop 2023-01-04T18:15:10.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.544+0000 7f6616d9e700 1 -- 172.21.15.50:0/539808920 shutdown_connections 2023-01-04T18:15:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.544+0000 7f6616d9e700 1 --2- 172.21.15.50:0/539808920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66100f66e0 0x7f66100f6b40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.544+0000 7f6616d9e700 1 --2- 172.21.15.50:0/539808920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66100f5440 0x7f66100f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.544+0000 7f6616d9e700 1 -- 172.21.15.50:0/539808920 >> 172.21.15.50:0/539808920 conn(0x7f66100f0ba0 msgr2=0x7f66100f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.544+0000 7f6616d9e700 1 -- 172.21.15.50:0/539808920 shutdown_connections 2023-01-04T18:15:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.544+0000 7f6616d9e700 1 -- 172.21.15.50:0/539808920 wait complete. 2023-01-04T18:15:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.545+0000 7f6616d9e700 1 Processor -- start 2023-01-04T18:15:10.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.545+0000 7f6616d9e700 1 -- start start 2023-01-04T18:15:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.545+0000 7f6616d9e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66100f5440 0x7f661010bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.545+0000 7f6616d9e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66100f66e0 0x7f661010e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.545+0000 7f6616d9e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66100602b0 con 0x7f66100f5440 2023-01-04T18:15:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.545+0000 7f6616d9e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66100603f0 con 0x7f66100f66e0 2023-01-04T18:15:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.545+0000 7f6615d9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66100f5440 0x7f661010bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.545+0000 7f6615d9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66100f5440 0x7f661010bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35596/0 (socket says 172.21.15.50:35596) 2023-01-04T18:15:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.545+0000 7f6615d9c700 1 -- 172.21.15.50:0/782327641 learned_addr learned my addr 172.21.15.50:0/782327641 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:15:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.545+0000 7f661559b700 1 --2- 172.21.15.50:0/782327641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66100f66e0 0x7f661010e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.546+0000 7f6615d9c700 1 -- 172.21.15.50:0/782327641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66100f66e0 msgr2=0x7f661010e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.546+0000 7f6615d9c700 1 --2- 172.21.15.50:0/782327641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66100f66e0 0x7f661010e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.546+0000 7f6615d9c700 1 -- 172.21.15.50:0/782327641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6600005040 con 0x7f66100f5440 2023-01-04T18:15:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.546+0000 7f6615d9c700 1 --2- 172.21.15.50:0/782327641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66100f5440 0x7f661010bdc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f660c00e7c0 tx=0x7f660c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.546+0000 7f66067fc700 1 -- 172.21.15.50:0/782327641 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f660c0092e0 con 0x7f66100f5440 2023-01-04T18:15:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.546+0000 7f66067fc700 1 -- 172.21.15.50:0/782327641 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f660c00f040 con 0x7f66100f5440 2023-01-04T18:15:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.546+0000 7f6616d9e700 1 -- 172.21.15.50:0/782327641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f661010e7b0 con 0x7f66100f5440 2023-01-04T18:15:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.546+0000 7f66067fc700 1 -- 172.21.15.50:0/782327641 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f660c014810 con 0x7f66100f5440 2023-01-04T18:15:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.546+0000 7f6616d9e700 1 -- 172.21.15.50:0/782327641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661010ebb0 con 0x7f66100f5440 2023-01-04T18:15:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.547+0000 7f6616d9e700 1 -- 172.21.15.50:0/782327641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6610045ad0 con 0x7f66100f5440 2023-01-04T18:15:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.548+0000 7f66067fc700 1 -- 172.21.15.50:0/782327641 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f660c01b030 con 0x7f66100f5440 2023-01-04T18:15:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.548+0000 7f66067fc700 1 --2- 172.21.15.50:0/782327641 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f65fc05c300 0x7f65fc05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.548+0000 7f66067fc700 1 -- 172.21.15.50:0/782327641 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f660c075bd0 con 0x7f66100f5440 2023-01-04T18:15:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.549+0000 7f661559b700 1 --2- 172.21.15.50:0/782327641 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f65fc05c300 0x7f65fc05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.549+0000 7f661559b700 1 --2- 172.21.15.50:0/782327641 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f65fc05c300 0x7f65fc05e7c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f6600009720 tx=0x7f6600016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:10.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.556+0000 7f66067fc700 1 -- 172.21.15.50:0/782327641 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f660c048940 con 0x7f66100f5440 2023-01-04T18:15:10.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.861+0000 7f6616d9e700 1 -- 172.21.15.50:0/782327641 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6610057f10 con 0x7f65fc05c300 2023-01-04T18:15:10.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.862+0000 7f66067fc700 1 -- 172.21.15.50:0/782327641 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+278 (secure 0 0 0) 0x7f6610057f10 con 0x7f65fc05c300 2023-01-04T18:15:10.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.869+0000 7f6616d9e700 1 -- 172.21.15.50:0/782327641 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f65fc05c300 msgr2=0x7f65fc05e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:10.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.869+0000 7f6616d9e700 1 --2- 172.21.15.50:0/782327641 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f65fc05c300 0x7f65fc05e7c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f6600009720 tx=0x7f6600016040).stop 2023-01-04T18:15:10.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.869+0000 7f6616d9e700 1 -- 172.21.15.50:0/782327641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66100f5440 msgr2=0x7f661010bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:10.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.869+0000 7f6616d9e700 1 --2- 172.21.15.50:0/782327641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66100f5440 0x7f661010bdc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f660c00e7c0 tx=0x7f660c00b040).stop 2023-01-04T18:15:10.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.869+0000 7f6616d9e700 1 -- 172.21.15.50:0/782327641 shutdown_connections 2023-01-04T18:15:10.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.869+0000 7f6616d9e700 1 --2- 172.21.15.50:0/782327641 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f65fc05c300 0x7f65fc05e7c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:10.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.869+0000 7f6616d9e700 1 --2- 172.21.15.50:0/782327641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66100f5440 0x7f661010bdc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:10.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.869+0000 7f6616d9e700 1 --2- 172.21.15.50:0/782327641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66100f66e0 0x7f661010e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:10.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.869+0000 7f6616d9e700 1 -- 172.21.15.50:0/782327641 >> 172.21.15.50:0/782327641 conn(0x7f66100f0ba0 msgr2=0x7f66100fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:10.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.869+0000 7f6616d9e700 1 -- 172.21.15.50:0/782327641 shutdown_connections 2023-01-04T18:15:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:10.869+0000 7f6616d9e700 1 -- 172.21.15.50:0/782327641 wait complete. 2023-01-04T18:15:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.024+0000 7f6beb59e700 1 -- 172.21.15.50:0/1268880134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bec0f6530 msgr2=0x7f6bec0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.024+0000 7f6beb59e700 1 --2- 172.21.15.50:0/1268880134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bec0f6530 0x7f6bec0f6950 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f6bdc004660 tx=0x7f6bdc009b30).stop 2023-01-04T18:15:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.024+0000 7f6beb59e700 1 -- 172.21.15.50:0/1268880134 shutdown_connections 2023-01-04T18:15:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.024+0000 7f6beb59e700 1 --2- 172.21.15.50:0/1268880134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bec0f77d0 0x7f6bec0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.024+0000 7f6beb59e700 1 --2- 172.21.15.50:0/1268880134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bec0f6530 0x7f6bec0f6950 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.024+0000 7f6beb59e700 1 -- 172.21.15.50:0/1268880134 >> 172.21.15.50:0/1268880134 conn(0x7f6bec0f1c90 msgr2=0x7f6bec0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.024+0000 7f6beb59e700 1 -- 172.21.15.50:0/1268880134 shutdown_connections 2023-01-04T18:15:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.024+0000 7f6beb59e700 1 -- 172.21.15.50:0/1268880134 wait complete. 2023-01-04T18:15:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.025+0000 7f6beb59e700 1 Processor -- start 2023-01-04T18:15:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.025+0000 7f6beb59e700 1 -- start start 2023-01-04T18:15:11.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.026+0000 7f6beb59e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bec0f6530 0x7f6bec108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:11.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.026+0000 7f6beb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bec0f77d0 0x7f6bec109440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:11.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.026+0000 7f6beb59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec1099f0 con 0x7f6bec0f77d0 2023-01-04T18:15:11.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.026+0000 7f6beb59e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec109b30 con 0x7f6bec0f6530 2023-01-04T18:15:11.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.026+0000 7f6be9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bec0f77d0 0x7f6bec109440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:11.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.026+0000 7f6bea59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bec0f6530 0x7f6bec108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:11.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.026+0000 7f6bea59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bec0f6530 0x7f6bec108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.50:54028/0 (socket says 172.21.15.50:54028) 2023-01-04T18:15:11.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.026+0000 7f6be9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bec0f77d0 0x7f6bec109440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35616/0 (socket says 172.21.15.50:35616) 2023-01-04T18:15:11.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.026+0000 7f6bea59c700 1 -- 172.21.15.50:0/2504585250 learned_addr learned my addr 172.21.15.50:0/2504585250 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:15:11.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.026+0000 7f6bea59c700 1 -- 172.21.15.50:0/2504585250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bec0f77d0 msgr2=0x7f6bec109440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:11.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.026+0000 7f6bea59c700 1 --2- 172.21.15.50:0/2504585250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bec0f77d0 0x7f6bec109440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:11.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.026+0000 7f6bea59c700 1 -- 172.21.15.50:0/2504585250 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc005040 con 0x7f6bec0f6530 2023-01-04T18:15:11.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.026+0000 7f6be9d9b700 1 --2- 172.21.15.50:0/2504585250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bec0f77d0 0x7f6bec109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-01-04T18:15:11.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.026+0000 7f6bea59c700 1 --2- 172.21.15.50:0/2504585250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bec0f6530 0x7f6bec108f50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6bdc014040 tx=0x7f6bdc00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:11.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.027+0000 7f6bdaffd700 1 -- 172.21.15.50:0/2504585250 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bdc019070 con 0x7f6bec0f6530 2023-01-04T18:15:11.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.027+0000 7f6bdaffd700 1 -- 172.21.15.50:0/2504585250 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6bdc01e420 con 0x7f6bec0f6530 2023-01-04T18:15:11.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.027+0000 7f6bdaffd700 1 -- 172.21.15.50:0/2504585250 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bdc014620 con 0x7f6bec0f6530 2023-01-04T18:15:11.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.027+0000 7f6beb59e700 1 -- 172.21.15.50:0/2504585250 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bec10a470 con 0x7f6bec0f6530 2023-01-04T18:15:11.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.027+0000 7f6beb59e700 1 -- 172.21.15.50:0/2504585250 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bec10a950 con 0x7f6bec0f6530 2023-01-04T18:15:11.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.029+0000 7f6bdaffd700 1 -- 172.21.15.50:0/2504585250 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f6bdc0079c0 con 0x7f6bec0f6530 2023-01-04T18:15:11.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.029+0000 7f6bdaffd700 1 --2- 172.21.15.50:0/2504585250 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6bd405c300 0x7f6bd405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:11.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.029+0000 7f6bdaffd700 1 -- 172.21.15.50:0/2504585250 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f6bdc0771a0 con 0x7f6bec0f6530 2023-01-04T18:15:11.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.029+0000 7f6be9d9b700 1 --2- 172.21.15.50:0/2504585250 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6bd405c300 0x7f6bd405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:11.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.030+0000 7f6be9d9b700 1 --2- 172.21.15.50:0/2504585250 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6bd405c300 0x7f6bd405e7c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f6be0009fd0 tx=0x7f6be000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:11.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.031+0000 7f6beb59e700 1 -- 172.21.15.50:0/2504585250 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bec059100 con 0x7f6bec0f6530 2023-01-04T18:15:11.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.035+0000 7f6bdaffd700 1 -- 172.21.15.50:0/2504585250 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f6bdc049ee0 con 0x7f6bec0f6530 2023-01-04T18:15:11.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:09.301738+0000 mgr.smithi050.emnywo (mgr.14162) 220 : cluster [DBG] pgmap v178: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 597 B/s wr, 2 op/s 2023-01-04T18:15:11.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:09.301738+0000 mgr.smithi050.emnywo (mgr.14162) 220 : cluster [DBG] pgmap v178: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 597 B/s wr, 2 op/s 2023-01-04T18:15:11.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.295+0000 7f6beb59e700 1 -- 172.21.15.50:0/2504585250 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bec0fed80 con 0x7f6bd405c300 2023-01-04T18:15:11.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.308+0000 7f6bdaffd700 1 -- 172.21.15.50:0/2504585250 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2728 (secure 0 0 0) 0x7f6bec0fed80 con 0x7f6bd405c300 2023-01-04T18:15:11.311 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2023-01-04T18:15:11.311 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager.smithi050 smithi050 *:9093,9094 running (3m) 18s ago 4m 0.20.0 0881eb8f169f b5d3e2678a23 2023-01-04T18:15:11.311 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi050 smithi050 running (4m) 18s ago 4m 16.2.4 8d91d370c2b8 cfe6f2d72ef5 2023-01-04T18:15:11.311 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi098 smithi098 running (4m) 20s ago 4m 16.2.4 8d91d370c2b8 2928008d526c 2023-01-04T18:15:11.311 INFO:teuthology.orchestra.run.smithi050.stdout:grafana.smithi050 smithi050 *:3000 running (3m) 18s ago 4m 6.7.4 557c83e11646 7e5dccbafe78 2023-01-04T18:15:11.311 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.ezoiwl smithi050 running (38s) 18s ago 37s 16.2.4 8d91d370c2b8 6c5c5f2be8b9 2023-01-04T18:15:11.312 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.kefmuy smithi050 running (33s) 18s ago 32s 16.2.4 8d91d370c2b8 58cace913b55 2023-01-04T18:15:11.312 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.laynsk smithi098 running (30s) 20s ago 30s 16.2.4 8d91d370c2b8 8ff8af70b989 2023-01-04T18:15:11.312 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.memais smithi098 running (36s) 20s ago 35s 16.2.4 8d91d370c2b8 d59d9b4dbf7d 2023-01-04T18:15:11.312 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi050.emnywo smithi050 *:9283 running (5m) 18s ago 5m 16.2.4 8d91d370c2b8 51f88deda58e 2023-01-04T18:15:11.312 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi098.vhfzum smithi098 *:8443,9283 running (4m) 20s ago 4m 16.2.4 8d91d370c2b8 238015c4e3b1 2023-01-04T18:15:11.312 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi050 smithi050 running (5m) 18s ago 5m 16.2.4 8d91d370c2b8 7ef171ad1e93 2023-01-04T18:15:11.312 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi098 smithi098 running (3m) 20s ago 3m 16.2.4 8d91d370c2b8 e6b6833279a4 2023-01-04T18:15:11.312 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi050 smithi050 *:9100 running (4m) 18s ago 4m 0.18.1 e5a616e4b9cf 88892b2e5e5a 2023-01-04T18:15:11.312 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi098 smithi098 *:9100 running (3m) 20s ago 3m 0.18.1 e5a616e4b9cf 49bcde8331b6 2023-01-04T18:15:11.312 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (3m) 18s ago 3m 16.2.4 8d91d370c2b8 b46676195180 2023-01-04T18:15:11.313 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi050 running (3m) 18s ago 3m 16.2.4 8d91d370c2b8 e4928bcfd146 2023-01-04T18:15:11.313 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi050 running (2m) 18s ago 2m 16.2.4 8d91d370c2b8 babab394b338 2023-01-04T18:15:11.313 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi098 running (2m) 20s ago 2m 16.2.4 8d91d370c2b8 b02df8e3cb23 2023-01-04T18:15:11.313 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi098 running (2m) 20s ago 2m 16.2.4 8d91d370c2b8 92273135ca82 2023-01-04T18:15:11.313 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi098 running (115s) 20s ago 115s 16.2.4 8d91d370c2b8 366d0bfff809 2023-01-04T18:15:11.313 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus.smithi050 smithi050 *:9095 running (3m) 18s ago 4m 2.18.1 de242295e225 6ff859f5958f 2023-01-04T18:15:11.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.312+0000 7f6beb59e700 1 -- 172.21.15.50:0/2504585250 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6bd405c300 msgr2=0x7f6bd405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:11.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.312+0000 7f6beb59e700 1 --2- 172.21.15.50:0/2504585250 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6bd405c300 0x7f6bd405e7c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f6be0009fd0 tx=0x7f6be000b040).stop 2023-01-04T18:15:11.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.312+0000 7f6beb59e700 1 -- 172.21.15.50:0/2504585250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bec0f6530 msgr2=0x7f6bec108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:11.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.312+0000 7f6beb59e700 1 --2- 172.21.15.50:0/2504585250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bec0f6530 0x7f6bec108f50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6bdc014040 tx=0x7f6bdc00b040).stop 2023-01-04T18:15:11.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.312+0000 7f6beb59e700 1 -- 172.21.15.50:0/2504585250 shutdown_connections 2023-01-04T18:15:11.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.312+0000 7f6beb59e700 1 --2- 172.21.15.50:0/2504585250 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f6bd405c300 0x7f6bd405e7c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:11.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.312+0000 7f6beb59e700 1 --2- 172.21.15.50:0/2504585250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bec0f6530 0x7f6bec108f50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:11.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.312+0000 7f6beb59e700 1 --2- 172.21.15.50:0/2504585250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bec0f77d0 0x7f6bec109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:11.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.312+0000 7f6beb59e700 1 -- 172.21.15.50:0/2504585250 >> 172.21.15.50:0/2504585250 conn(0x7f6bec0f1c90 msgr2=0x7f6bec0f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:11.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.316+0000 7f6beb59e700 1 -- 172.21.15.50:0/2504585250 shutdown_connections 2023-01-04T18:15:11.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.316+0000 7f6beb59e700 1 -- 172.21.15.50:0/2504585250 wait complete. 2023-01-04T18:15:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.467+0000 7f76a4da3700 1 -- 172.21.15.50:0/3761088900 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76a00f5430 msgr2=0x7f76a00f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.467+0000 7f76a4da3700 1 --2- 172.21.15.50:0/3761088900 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76a00f5430 0x7f76a00f5850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7690004660 tx=0x7f7690009b30).stop 2023-01-04T18:15:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.467+0000 7f76a4da3700 1 -- 172.21.15.50:0/3761088900 shutdown_connections 2023-01-04T18:15:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.467+0000 7f76a4da3700 1 --2- 172.21.15.50:0/3761088900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76a00f66d0 0x7f76a00f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-01-04T18:15:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.467+0000 7f76a4da3700 1 --2- 172.21.15.50:0/3761088900 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76a00f5430 0x7f76a00f5850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.467+0000 7f76a4da3700 1 -- 172.21.15.50:0/3761088900 >> 172.21.15.50:0/3761088900 conn(0x7f76a00f0b90 msgr2=0x7f76a00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.467+0000 7f76a4da3700 1 -- 172.21.15.50:0/3761088900 shutdown_connections 2023-01-04T18:15:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.467+0000 7f76a4da3700 1 -- 172.21.15.50:0/3761088900 wait complete. 2023-01-04T18:15:11.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.468+0000 7f76a4da3700 1 Processor -- start 2023-01-04T18:15:11.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.468+0000 7f76a4da3700 1 -- start start 2023-01-04T18:15:11.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.469+0000 7f76a4da3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76a00f5430 0x7f76a00fd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:11.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.469+0000 7f76a4da3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76a00f66d0 0x7f76a00fba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:11.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.469+0000 7f76a4da3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a010aaf0 con 0x7f76a00f66d0 2023-01-04T18:15:11.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.469+0000 7f76a4da3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a010ac30 con 0x7f76a00f5430 2023-01-04T18:15:11.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.469+0000 7f769effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76a00f66d0 0x7f76a00fba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:11.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.469+0000 7f769effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76a00f66d0 0x7f76a00fba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35632/0 (socket says 172.21.15.50:35632) 2023-01-04T18:15:11.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.469+0000 7f769effd700 1 -- 172.21.15.50:0/2241587517 learned_addr learned my addr 172.21.15.50:0/2241587517 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:15:11.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.469+0000 7f769f7fe700 1 --2- 172.21.15.50:0/2241587517 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76a00f5430 0x7f76a00fd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:11.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.469+0000 7f769f7fe700 1 -- 172.21.15.50:0/2241587517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76a00f66d0 msgr2=0x7f76a00fba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:11.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.469+0000 7f769f7fe700 1 --2- 172.21.15.50:0/2241587517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76a00f66d0 0x7f76a00fba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:11.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.469+0000 7f769f7fe700 1 -- 172.21.15.50:0/2241587517 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7690005040 con 0x7f76a00f5430 2023-01-04T18:15:11.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.469+0000 7f769effd700 1 --2- 172.21.15.50:0/2241587517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76a00f66d0 0x7f76a00fba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-01-04T18:15:11.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.470+0000 7f769f7fe700 1 --2- 172.21.15.50:0/2241587517 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76a00f5430 0x7f76a00fd5b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7690004660 tx=0x7f7690009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:11.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.470+0000 7f7687fff700 1 -- 172.21.15.50:0/2241587517 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7690018070 con 0x7f76a00f5430 2023-01-04T18:15:11.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.470+0000 7f7687fff700 1 -- 172.21.15.50:0/2241587517 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7690007e80 con 0x7f76a00f5430 2023-01-04T18:15:11.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.470+0000 7f7687fff700 1 -- 172.21.15.50:0/2241587517 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f769001c560 con 0x7f76a00f5430 2023-01-04T18:15:11.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.473+0000 7f76a4da3700 1 -- 172.21.15.50:0/2241587517 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a00fc010 con 0x7f76a00f5430 2023-01-04T18:15:11.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.473+0000 7f76a4da3700 1 -- 172.21.15.50:0/2241587517 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a00fc540 con 0x7f76a00f5430 2023-01-04T18:15:11.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.475+0000 7f7687fff700 1 -- 172.21.15.50:0/2241587517 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f769001dac0 con 0x7f76a00f5430 2023-01-04T18:15:11.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.475+0000 7f7687fff700 1 --2- 172.21.15.50:0/2241587517 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f768805c2f0 0x7f768805e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:11.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.475+0000 7f7687fff700 1 -- 172.21.15.50:0/2241587517 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f76900777a0 con 0x7f76a00f5430 2023-01-04T18:15:11.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.476+0000 7f769effd700 1 --2- 172.21.15.50:0/2241587517 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f768805c2f0 0x7f768805e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:11.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.476+0000 7f76a4da3700 1 -- 172.21.15.50:0/2241587517 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a0059100 con 0x7f76a00f5430 2023-01-04T18:15:11.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.476+0000 7f769effd700 1 --2- 172.21.15.50:0/2241587517 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f768805c2f0 0x7f768805e7b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f7694009e20 tx=0x7f7694006ef0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:11.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.480+0000 7f7687fff700 1 -- 172.21.15.50:0/2241587517 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f769004a480 con 0x7f76a00f5430 2023-01-04T18:15:11.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.836+0000 7f76a4da3700 1 -- 172.21.15.50:0/2241587517 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f76a0045ad0 con 0x7f76a00f5430 2023-01-04T18:15:11.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.837+0000 7f7687fff700 1 -- 172.21.15.50:0/2241587517 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+573 (secure 0 0 0) 0x7f769004daa0 con 0x7f76a00f5430 2023-01-04T18:15:11.840 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:15:11.840 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": { 2023-01-04T18:15:11.841 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-01-04T18:15:11.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:15:11.841 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": { 2023-01-04T18:15:11.841 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-01-04T18:15:11.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:15:11.841 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": { 2023-01-04T18:15:11.841 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2023-01-04T18:15:11.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:15:11.841 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2023-01-04T18:15:11.841 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-01-04T18:15:11.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:15:11.842 INFO:teuthology.orchestra.run.smithi050.stdout: "overall": { 2023-01-04T18:15:11.842 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 14 2023-01-04T18:15:11.842 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-01-04T18:15:11.842 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:15:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.839+0000 7f76a4da3700 1 -- 172.21.15.50:0/2241587517 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f768805c2f0 msgr2=0x7f768805e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.839+0000 7f76a4da3700 1 --2- 172.21.15.50:0/2241587517 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f768805c2f0 0x7f768805e7b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f7694009e20 tx=0x7f7694006ef0).stop 2023-01-04T18:15:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.839+0000 7f76a4da3700 1 -- 172.21.15.50:0/2241587517 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76a00f5430 msgr2=0x7f76a00fd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.839+0000 7f76a4da3700 1 --2- 172.21.15.50:0/2241587517 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76a00f5430 0x7f76a00fd5b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7690004660 tx=0x7f7690009b30).stop 2023-01-04T18:15:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.840+0000 7f76a4da3700 1 -- 172.21.15.50:0/2241587517 shutdown_connections 2023-01-04T18:15:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.840+0000 7f76a4da3700 1 --2- 172.21.15.50:0/2241587517 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f768805c2f0 0x7f768805e7b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.840+0000 7f76a4da3700 1 --2- 172.21.15.50:0/2241587517 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76a00f5430 0x7f76a00fd5b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.840+0000 7f76a4da3700 1 --2- 172.21.15.50:0/2241587517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76a00f66d0 0x7f76a00fba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.840+0000 7f76a4da3700 1 -- 172.21.15.50:0/2241587517 >> 172.21.15.50:0/2241587517 conn(0x7f76a00f0b90 msgr2=0x7f76a00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:11.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.840+0000 7f76a4da3700 1 -- 172.21.15.50:0/2241587517 shutdown_connections 2023-01-04T18:15:11.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.840+0000 7f76a4da3700 1 -- 172.21.15.50:0/2241587517 wait complete. 2023-01-04T18:15:11.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.995+0000 7f4256944700 1 -- 172.21.15.50:0/3468891197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42500f77d0 msgr2=0x7f42500f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:11.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.995+0000 7f4256944700 1 --2- 172.21.15.50:0/3468891197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42500f77d0 0x7f42500f7c30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f4240004660 tx=0x7f4240009b30).stop 2023-01-04T18:15:11.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.995+0000 7f4256944700 1 -- 172.21.15.50:0/3468891197 shutdown_connections 2023-01-04T18:15:11.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.995+0000 7f4256944700 1 --2- 172.21.15.50:0/3468891197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42500f77d0 0x7f42500f7c30 secure :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0x7f4240004660 tx=0x7f4240009b30).stop 2023-01-04T18:15:11.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.995+0000 7f4256944700 1 --2- 172.21.15.50:0/3468891197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42500f6530 0x7f42500f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:11.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.995+0000 7f4256944700 1 -- 172.21.15.50:0/3468891197 >> 172.21.15.50:0/3468891197 conn(0x7f42500f1c90 msgr2=0x7f42500f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:12.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.997+0000 7f4256944700 1 -- 172.21.15.50:0/3468891197 shutdown_connections 2023-01-04T18:15:12.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.997+0000 7f4256944700 1 -- 172.21.15.50:0/3468891197 wait complete. 2023-01-04T18:15:12.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.997+0000 7f4256944700 1 Processor -- start 2023-01-04T18:15:12.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.997+0000 7f4256944700 1 -- start start 2023-01-04T18:15:12.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.997+0000 7f4256944700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42500f6530 0x7f425006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:12.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.997+0000 7f4256944700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4250069e20 0x7f425006a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:12.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.998+0000 7f4256944700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425006a790 con 0x7f42500f6530 2023-01-04T18:15:12.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.998+0000 7f4256944700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425006a8d0 con 0x7f4250069e20 2023-01-04T18:15:12.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.998+0000 7f4255942700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42500f6530 0x7f425006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:12.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.998+0000 7f4255942700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42500f6530 0x7f425006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35654/0 (socket says 172.21.15.50:35654) 2023-01-04T18:15:12.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.998+0000 7f4255942700 1 -- 172.21.15.50:0/2270939994 learned_addr learned my addr 172.21.15.50:0/2270939994 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:15:12.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.998+0000 7f4255141700 1 --2- 172.21.15.50:0/2270939994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4250069e20 0x7f425006a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:12.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.998+0000 7f4255942700 1 -- 172.21.15.50:0/2270939994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4250069e20 msgr2=0x7f425006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:12.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.998+0000 7f4255942700 1 --2- 172.21.15.50:0/2270939994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4250069e20 0x7f425006a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:12.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.998+0000 7f4255942700 1 -- 172.21.15.50:0/2270939994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4240005040 con 0x7f42500f6530 2023-01-04T18:15:12.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.998+0000 7f4255942700 1 --2- 172.21.15.50:0/2270939994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42500f6530 0x7f425006b9a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f424c00e7c0 tx=0x7f424c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:12.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.999+0000 7f42467fc700 1 -- 172.21.15.50:0/2270939994 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f424c0092e0 con 0x7f42500f6530 2023-01-04T18:15:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.999+0000 7f42467fc700 1 -- 172.21.15.50:0/2270939994 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f424c00f040 con 0x7f42500f6530 2023-01-04T18:15:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.999+0000 7f42467fc700 1 -- 172.21.15.50:0/2270939994 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f424c014810 con 0x7f42500f6530 2023-01-04T18:15:12.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:11.999+0000 7f4256944700 1 -- 172.21.15.50:0/2270939994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f425006ab80 con 0x7f42500f6530 2023-01-04T18:15:12.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.000+0000 7f4256944700 1 -- 172.21.15.50:0/2270939994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f425010f190 con 0x7f42500f6530 2023-01-04T18:15:12.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.001+0000 7f4256944700 1 -- 172.21.15.50:0/2270939994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4250045ad0 con 0x7f42500f6530 2023-01-04T18:15:12.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.002+0000 7f42467fc700 1 -- 172.21.15.50:0/2270939994 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f424c01b030 con 0x7f42500f6530 2023-01-04T18:15:12.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.003+0000 7f42467fc700 1 --2- 172.21.15.50:0/2270939994 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f423c05c350 0x7f423c05e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:12.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.003+0000 7f42467fc700 1 -- 172.21.15.50:0/2270939994 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f424c0761d0 con 0x7f42500f6530 2023-01-04T18:15:12.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.005+0000 7f4255141700 1 --2- 172.21.15.50:0/2270939994 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f423c05c350 0x7f423c05e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:12.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.006+0000 7f4255141700 1 --2- 172.21.15.50:0/2270939994 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f423c05c350 0x7f423c05e810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f4240000c00 tx=0x7f4240009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:12.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.008+0000 7f42467fc700 1 -- 172.21.15.50:0/2270939994 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f424c048f10 con 0x7f42500f6530 2023-01-04T18:15:12.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:10.397807+0000 mgr.smithi050.emnywo (mgr.14162) 221 : audit [DBG] from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:15:12.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:10.863625+0000 mgr.smithi050.emnywo (mgr.14162) 222 : audit [DBG] from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:15:12.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:10.397807+0000 mgr.smithi050.emnywo (mgr.14162) 221 : audit [DBG] from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:15:12.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:10.863625+0000 mgr.smithi050.emnywo (mgr.14162) 222 : audit [DBG] from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:15:12.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.349+0000 7f4256944700 1 -- 172.21.15.50:0/2270939994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f42500fecc0 con 0x7f42500f6530 2023-01-04T18:15:12.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.351+0000 7f42467fc700 1 -- 172.21.15.50:0/2270939994 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1669 (secure 0 0 0) 0x7f424c019070 con 0x7f42500f6530 2023-01-04T18:15:12.354 INFO:teuthology.orchestra.run.smithi050.stdout:e13 2023-01-04T18:15:12.354 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:15:12.355 INFO:teuthology.orchestra.run.smithi050.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:15:12.355 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-01-04T18:15:12.355 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:15:12.355 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-01-04T18:15:12.355 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-01-04T18:15:12.355 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 10 2023-01-04T18:15:12.355 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 2023-01-04T18:15:12.356 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:15:12.356 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-01-04T18:14:43.958806+0000 2023-01-04T18:15:12.356 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-01-04T18:15:12.356 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-01-04T18:15:12.356 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 60 2023-01-04T18:15:12.356 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-01-04T18:15:12.356 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-01-04T18:15:12.357 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-01-04T18:15:12.357 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-01-04T18:15:12.357 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 0 2023-01-04T18:15:12.357 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:15:12.357 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 1 2023-01-04T18:15:12.357 INFO:teuthology.orchestra.run.smithi050.stdout:in 0 2023-01-04T18:15:12.357 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=14430} 2023-01-04T18:15:12.358 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-01-04T18:15:12.358 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-01-04T18:15:12.358 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-01-04T18:15:12.358 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-01-04T18:15:12.358 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-01-04T18:15:12.358 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data enabled 2023-01-04T18:15:12.359 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-01-04T18:15:12.359 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 1 2023-01-04T18:15:12.359 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.ezoiwl{0:14430} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541]] 2023-01-04T18:15:12.359 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.memais{0:24291} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.98:6824/1196398070,v1:172.21.15.98:6825/1196398070]] 2023-01-04T18:15:12.359 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:15:12.359 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:15:12.359 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2023-01-04T18:15:12.359 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:15:12.359 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.kefmuy{-1:14440} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592]] 2023-01-04T18:15:12.359 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.laynsk{-1:24297} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263]] 2023-01-04T18:15:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.354+0000 7f4256944700 1 -- 172.21.15.50:0/2270939994 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f423c05c350 msgr2=0x7f423c05e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.354+0000 7f4256944700 1 --2- 172.21.15.50:0/2270939994 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f423c05c350 0x7f423c05e810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f4240000c00 tx=0x7f4240009b30).stop 2023-01-04T18:15:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.354+0000 7f4256944700 1 -- 172.21.15.50:0/2270939994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42500f6530 msgr2=0x7f425006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.354+0000 7f4256944700 1 --2- 172.21.15.50:0/2270939994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42500f6530 0x7f425006b9a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f424c00e7c0 tx=0x7f424c00b040).stop 2023-01-04T18:15:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.355+0000 7f4256944700 1 -- 172.21.15.50:0/2270939994 shutdown_connections 2023-01-04T18:15:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.355+0000 7f4256944700 1 --2- 172.21.15.50:0/2270939994 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f423c05c350 0x7f423c05e810 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.355+0000 7f4256944700 1 --2- 172.21.15.50:0/2270939994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42500f6530 0x7f425006b9a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.355+0000 7f4256944700 1 --2- 172.21.15.50:0/2270939994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4250069e20 0x7f425006a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.355+0000 7f4256944700 1 -- 172.21.15.50:0/2270939994 >> 172.21.15.50:0/2270939994 conn(0x7f42500f1c90 msgr2=0x7f42500fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.355+0000 7f4256944700 1 -- 172.21.15.50:0/2270939994 shutdown_connections 2023-01-04T18:15:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.355+0000 7f4256944700 1 -- 172.21.15.50:0/2270939994 wait complete. 2023-01-04T18:15:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2023-01-04T18:15:12.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.530+0000 7fc9a1d19700 1 -- 172.21.15.50:0/2737309935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc99c0f4d60 msgr2=0x7fc99c0f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:12.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.530+0000 7fc9a1d19700 1 --2- 172.21.15.50:0/2737309935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc99c0f4d60 0x7fc99c0f5180 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fc98c004770 tx=0x7fc98c00ac40).stop 2023-01-04T18:15:12.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.530+0000 7fc9a1d19700 1 -- 172.21.15.50:0/2737309935 shutdown_connections 2023-01-04T18:15:12.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.530+0000 7fc9a1d19700 1 --2- 172.21.15.50:0/2737309935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc99c0f5f60 0x7fc99c0f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:12.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.530+0000 7fc9a1d19700 1 --2- 172.21.15.50:0/2737309935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc99c0f4d60 0x7fc99c0f5180 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:12.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.530+0000 7fc9a1d19700 1 -- 172.21.15.50:0/2737309935 >> 172.21.15.50:0/2737309935 conn(0x7fc99c0f04c0 msgr2=0x7fc99c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:12.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.530+0000 7fc9a1d19700 1 -- 172.21.15.50:0/2737309935 shutdown_connections 2023-01-04T18:15:12.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.530+0000 7fc9a1d19700 1 -- 172.21.15.50:0/2737309935 wait complete. 2023-01-04T18:15:12.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.531+0000 7fc9a1d19700 1 Processor -- start 2023-01-04T18:15:12.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.531+0000 7fc9a1d19700 1 -- start start 2023-01-04T18:15:12.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.531+0000 7fc9a1d19700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc99c0f4d60 0x7fc99c1065c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:12.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.531+0000 7fc9a1d19700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc99c0f5f60 0x7fc99c104a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:12.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.532+0000 7fc9a1d19700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c104fa0 con 0x7fc99c0f5f60 2023-01-04T18:15:12.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.532+0000 7fc9a1d19700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c1050e0 con 0x7fc99c0f4d60 2023-01-04T18:15:12.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.532+0000 7fc99b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc99c0f4d60 0x7fc99c1065c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:12.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.532+0000 7fc99b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc99c0f4d60 0x7fc99c1065c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.50:54086/0 (socket says 172.21.15.50:54086) 2023-01-04T18:15:12.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.532+0000 7fc99b7fe700 1 -- 172.21.15.50:0/250234455 learned_addr learned my addr 172.21.15.50:0/250234455 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:15:12.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.532+0000 7fc99b7fe700 1 -- 172.21.15.50:0/250234455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc99c0f5f60 msgr2=0x7fc99c104a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:12.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.532+0000 7fc99b7fe700 1 --2- 172.21.15.50:0/250234455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc99c0f5f60 0x7fc99c104a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-01-04T18:15:12.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.532+0000 7fc99b7fe700 1 -- 172.21.15.50:0/250234455 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc990005040 con 0x7fc99c0f4d60 2023-01-04T18:15:12.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.532+0000 7fc99b7fe700 1 --2- 172.21.15.50:0/250234455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc99c0f4d60 0x7fc99c1065c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fc98c00aaa0 tx=0x7fc98c00ac40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:12.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.532+0000 7fc983fff700 1 -- 172.21.15.50:0/250234455 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc98c00f030 con 0x7fc99c0f4d60 2023-01-04T18:15:12.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.532+0000 7fc983fff700 1 -- 172.21.15.50:0/250234455 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc98c00a8e0 con 0x7fc99c0f4d60 2023-01-04T18:15:12.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.532+0000 7fc983fff700 1 -- 172.21.15.50:0/250234455 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc98c019070 con 0x7fc99c0f4d60 2023-01-04T18:15:12.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.533+0000 7fc9a1d19700 1 -- 172.21.15.50:0/250234455 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc98c005040 con 0x7fc99c0f4d60 2023-01-04T18:15:12.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.533+0000 7fc9a1d19700 1 -- 172.21.15.50:0/250234455 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99c1056b0 con 0x7fc99c0f4d60 2023-01-04T18:15:12.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.534+0000 7fc983fff700 1 -- 172.21.15.50:0/250234455 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc98c008460 con 0x7fc99c0f4d60 2023-01-04T18:15:12.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.534+0000 7fc9a1d19700 1 -- 172.21.15.50:0/250234455 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99c0f4150 con 0x7fc99c0f4d60 2023-01-04T18:15:12.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.534+0000 7fc983fff700 1 --2- 172.21.15.50:0/250234455 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc98405c2b0 0x7fc98405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:12.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.534+0000 7fc983fff700 1 -- 172.21.15.50:0/250234455 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fc98c077820 con 0x7fc99c0f4d60 2023-01-04T18:15:12.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.535+0000 7fc99affd700 1 --2- 172.21.15.50:0/250234455 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc98405c2b0 0x7fc98405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:12.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.535+0000 7fc99affd700 1 --2- 172.21.15.50:0/250234455 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc98405c2b0 0x7fc98405e770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fc990007ec0 tx=0x7fc990009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:12.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.538+0000 7fc983fff700 1 -- 172.21.15.50:0/250234455 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc98c04a560 con 0x7fc99c0f4d60 2023-01-04T18:15:12.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.809+0000 7fc9a1d19700 1 -- 172.21.15.50:0/250234455 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc99c0008d0 con 0x7fc98405c2b0 2023-01-04T18:15:12.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.810+0000 7fc983fff700 1 -- 172.21.15.50:0/250234455 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+278 (secure 0 0 0) 0x7fc99c0008d0 con 0x7fc98405c2b0 2023-01-04T18:15:12.813 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:15:12.813 INFO:teuthology.orchestra.run.smithi050.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f2bb1478686242c0f68882a9cf8df4e0f8363116", 2023-01-04T18:15:12.813 INFO:teuthology.orchestra.run.smithi050.stdout: "in_progress": true, 2023-01-04T18:15:12.813 INFO:teuthology.orchestra.run.smithi050.stdout: "services_complete": [], 2023-01-04T18:15:12.813 INFO:teuthology.orchestra.run.smithi050.stdout: "progress": "", 2023-01-04T18:15:12.814 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:f2bb1478686242c0f68882a9cf8df4e0f8363116 image" 2023-01-04T18:15:12.814 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:15:12.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.812+0000 7fc9a1d19700 1 -- 172.21.15.50:0/250234455 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc98405c2b0 msgr2=0x7fc98405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:12.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.812+0000 7fc9a1d19700 1 --2- 172.21.15.50:0/250234455 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc98405c2b0 0x7fc98405e770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fc990007ec0 tx=0x7fc990009b30).stop 2023-01-04T18:15:12.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.812+0000 7fc9a1d19700 1 -- 172.21.15.50:0/250234455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc99c0f4d60 msgr2=0x7fc99c1065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:12.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.812+0000 7fc9a1d19700 1 --2- 172.21.15.50:0/250234455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc99c0f4d60 0x7fc99c1065c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fc98c00aaa0 tx=0x7fc98c00ac40).stop 2023-01-04T18:15:12.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.812+0000 7fc9a1d19700 1 -- 172.21.15.50:0/250234455 shutdown_connections 2023-01-04T18:15:12.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.812+0000 7fc9a1d19700 1 --2- 172.21.15.50:0/250234455 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc98405c2b0 0x7fc98405e770 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0x7fc990007ec0 tx=0x7fc990009b30).stop 2023-01-04T18:15:12.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.812+0000 7fc9a1d19700 1 --2- 172.21.15.50:0/250234455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc99c0f4d60 0x7fc99c1065c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:12.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.812+0000 7fc9a1d19700 1 --2- 172.21.15.50:0/250234455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc99c0f5f60 0x7fc99c104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-01-04T18:15:12.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.812+0000 7fc9a1d19700 1 -- 172.21.15.50:0/250234455 >> 172.21.15.50:0/250234455 conn(0x7fc99c0f04c0 msgr2=0x7fc99c0f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:12.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.814+0000 7fc9a1d19700 1 -- 172.21.15.50:0/250234455 shutdown_connections 2023-01-04T18:15:12.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:12.814+0000 7fc9a1d19700 1 -- 172.21.15.50:0/250234455 wait complete. 2023-01-04T18:15:13.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:11.297497+0000 mgr.smithi050.emnywo (mgr.14162) 223 : audit [DBG] from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:15:13.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:11.302196+0000 mgr.smithi050.emnywo (mgr.14162) 224 : cluster [DBG] pgmap v179: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 597 B/s wr, 2 op/s 2023-01-04T18:15:13.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:11.838487+0000 mon.smithi098 (mon.1) 16 : audit [DBG] from='client.? 172.21.15.50:0/2241587517' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:15:13.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:12.352397+0000 mon.smithi050 (mon.0) 549 : audit [DBG] from='client.? 172.21.15.50:0/2270939994' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:15:13.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:11.297497+0000 mgr.smithi050.emnywo (mgr.14162) 223 : audit [DBG] from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:15:13.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:11.302196+0000 mgr.smithi050.emnywo (mgr.14162) 224 : cluster [DBG] pgmap v179: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 597 B/s wr, 2 op/s 2023-01-04T18:15:13.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:11.838487+0000 mon.smithi098 (mon.1) 16 : audit [DBG] from='client.? 172.21.15.50:0/2241587517' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:15:13.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:12.352397+0000 mon.smithi050 (mon.0) 549 : audit [DBG] from='client.? 172.21.15.50:0/2270939994' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:15:14.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:12.811273+0000 mgr.smithi050.emnywo (mgr.14162) 225 : audit [DBG] from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:15:14.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:13.418825+0000 mon.smithi050 (mon.0) 550 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:15:14.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:13.419077+0000 mon.smithi050 (mon.0) 551 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:15:14.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:12.811273+0000 mgr.smithi050.emnywo (mgr.14162) 225 : audit [DBG] from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:15:14.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:13.418825+0000 mon.smithi050 (mon.0) 550 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:15:14.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:13.419077+0000 mon.smithi050 (mon.0) 551 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:15:15.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:13.302699+0000 mgr.smithi050.emnywo (mgr.14162) 226 : cluster [DBG] pgmap v180: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 597 B/s wr, 3 op/s 2023-01-04T18:15:15.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:13.302699+0000 mgr.smithi050.emnywo (mgr.14162) 226 : cluster [DBG] pgmap v180: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 597 B/s wr, 3 op/s 2023-01-04T18:15:16.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:15.303112+0000 mgr.smithi050.emnywo (mgr.14162) 227 : cluster [DBG] pgmap v181: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2023-01-04T18:15:16.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:15.303112+0000 mgr.smithi050.emnywo (mgr.14162) 227 : cluster [DBG] pgmap v181: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2023-01-04T18:15:18.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:17.303523+0000 mgr.smithi050.emnywo (mgr.14162) 228 : cluster [DBG] pgmap v182: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2023-01-04T18:15:18.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:17.303523+0000 mgr.smithi050.emnywo (mgr.14162) 228 : cluster [DBG] pgmap v182: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2023-01-04T18:15:20.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:19.303981+0000 mgr.smithi050.emnywo (mgr.14162) 229 : cluster [DBG] pgmap v183: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2023-01-04T18:15:20.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:19.303981+0000 mgr.smithi050.emnywo (mgr.14162) 229 : cluster [DBG] pgmap v183: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2023-01-04T18:15:22.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:21.304445+0000 mgr.smithi050.emnywo (mgr.14162) 230 : cluster [DBG] pgmap v184: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:15:22.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:21.304445+0000 mgr.smithi050.emnywo (mgr.14162) 230 : cluster [DBG] pgmap v184: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:15:24.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:23.305619+0000 mgr.smithi050.emnywo (mgr.14162) 231 : cluster [DBG] pgmap v185: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:15:24.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:23.305619+0000 mgr.smithi050.emnywo (mgr.14162) 231 : cluster [DBG] pgmap v185: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:15:26.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:25.306035+0000 mgr.smithi050.emnywo (mgr.14162) 232 : cluster [DBG] pgmap v186: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:15:26.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:25.306035+0000 mgr.smithi050.emnywo (mgr.14162) 232 : cluster [DBG] pgmap v186: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:15:28.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:27.306532+0000 mgr.smithi050.emnywo (mgr.14162) 233 : cluster [DBG] pgmap v187: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:15:28.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:27.306532+0000 mgr.smithi050.emnywo (mgr.14162) 233 : cluster [DBG] pgmap v187: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:15:30.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:29.307021+0000 mgr.smithi050.emnywo (mgr.14162) 234 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:15:30.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:29.307021+0000 mgr.smithi050.emnywo (mgr.14162) 234 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:15:32.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:31.307464+0000 mgr.smithi050.emnywo (mgr.14162) 235 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:15:32.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:31.307464+0000 mgr.smithi050.emnywo (mgr.14162) 235 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:15:35.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:33.307909+0000 mgr.smithi050.emnywo (mgr.14162) 236 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2023-01-04T18:15:35.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:33.733692+0000 mon.smithi050 (mon.0) 552 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:15:35.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:15:33.734286+0000 mgr.smithi050.emnywo (mgr.14162) 237 : cephadm [INF] Upgrade: Target is version 16.2.10-1543-gf2bb1478 (pacific) 2023-01-04T18:15:35.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:15:33.734380+0000 mgr.smithi050.emnywo (mgr.14162) 238 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308, digests ['quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308'] 2023-01-04T18:15:35.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:33.735357+0000 mon.smithi050 (mon.0) 553 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:15:35.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:15:33.736693+0000 mgr.smithi050.emnywo (mgr.14162) 239 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi050.emnywo) 2023-01-04T18:15:35.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:33.307909+0000 mgr.smithi050.emnywo (mgr.14162) 236 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2023-01-04T18:15:35.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:33.733692+0000 mon.smithi050 (mon.0) 552 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:15:35.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:15:33.734286+0000 mgr.smithi050.emnywo (mgr.14162) 237 : cephadm [INF] Upgrade: Target is version 16.2.10-1543-gf2bb1478 (pacific) 2023-01-04T18:15:35.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:15:33.734380+0000 mgr.smithi050.emnywo (mgr.14162) 238 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308, digests ['quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308'] 2023-01-04T18:15:35.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:33.735357+0000 mon.smithi050 (mon.0) 553 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:15:35.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:15:33.736693+0000 mgr.smithi050.emnywo (mgr.14162) 239 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi050.emnywo) 2023-01-04T18:15:36.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:15:34.187456+0000 mgr.smithi050.emnywo (mgr.14162) 240 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308 on smithi098 2023-01-04T18:15:36.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:15:34.187456+0000 mgr.smithi050.emnywo (mgr.14162) 240 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308 on smithi098 2023-01-04T18:15:37.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:35.308352+0000 mgr.smithi050.emnywo (mgr.14162) 241 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2023-01-04T18:15:37.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:35.308352+0000 mgr.smithi050.emnywo (mgr.14162) 241 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 9.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2023-01-04T18:15:39.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:37.308743+0000 mgr.smithi050.emnywo (mgr.14162) 242 : cluster [DBG] pgmap v192: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2023-01-04T18:15:39.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:37.308743+0000 mgr.smithi050.emnywo (mgr.14162) 242 : cluster [DBG] pgmap v192: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2023-01-04T18:15:40.776 INFO:tasks.workunit.client.1.smithi098.stderr:Updating files: 89% (10496/11684) Updating files: 90% (10516/11684) Updating files: 91% (10633/11684) Updating files: 92% (10750/11684) Updating files: 93% (10867/11684) Updating files: 94% (10983/11684) Updating files: 95% (11100/11684) Updating files: 96% (11217/11684) Updating files: 97% (11334/11684) Updating files: 98% (11451/11684) Updating files: 99% (11568/11684) Updating files: 100% (11684/11684) Updating files: 100% (11684/11684), done. 2023-01-04T18:15:41.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:39.309210+0000 mgr.smithi050.emnywo (mgr.14162) 243 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2023-01-04T18:15:41.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:39.309210+0000 mgr.smithi050.emnywo (mgr.14162) 243 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2023-01-04T18:15:41.867 INFO:tasks.workunit.client.1.smithi098.stderr:Note: switching to 'f2bb1478686242c0f68882a9cf8df4e0f8363116'. 2023-01-04T18:15:41.867 INFO:tasks.workunit.client.1.smithi098.stderr: 2023-01-04T18:15:41.867 INFO:tasks.workunit.client.1.smithi098.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-01-04T18:15:41.868 INFO:tasks.workunit.client.1.smithi098.stderr:changes and commit them, and you can discard any commits you make in this 2023-01-04T18:15:41.868 INFO:tasks.workunit.client.1.smithi098.stderr:state without impacting any branches by switching back to a branch. 2023-01-04T18:15:41.868 INFO:tasks.workunit.client.1.smithi098.stderr: 2023-01-04T18:15:41.868 INFO:tasks.workunit.client.1.smithi098.stderr:If you want to create a new branch to retain commits you create, you may 2023-01-04T18:15:41.868 INFO:tasks.workunit.client.1.smithi098.stderr:do so (now or later) by using -c with the switch command. Example: 2023-01-04T18:15:41.868 INFO:tasks.workunit.client.1.smithi098.stderr: 2023-01-04T18:15:41.868 INFO:tasks.workunit.client.1.smithi098.stderr: git switch -c 2023-01-04T18:15:41.868 INFO:tasks.workunit.client.1.smithi098.stderr: 2023-01-04T18:15:41.868 INFO:tasks.workunit.client.1.smithi098.stderr:Or undo this operation with: 2023-01-04T18:15:41.868 INFO:tasks.workunit.client.1.smithi098.stderr: 2023-01-04T18:15:41.869 INFO:tasks.workunit.client.1.smithi098.stderr: git switch - 2023-01-04T18:15:41.869 INFO:tasks.workunit.client.1.smithi098.stderr: 2023-01-04T18:15:41.869 INFO:tasks.workunit.client.1.smithi098.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-01-04T18:15:41.869 INFO:tasks.workunit.client.1.smithi098.stderr: 2023-01-04T18:15:41.869 INFO:tasks.workunit.client.1.smithi098.stderr:HEAD is now at f2bb1478686 qa: switch back to git protocol for qemu-xfstests 2023-01-04T18:15:41.872 DEBUG:teuthology.orchestra.run.smithi098:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2023-01-04T18:15:41.971 INFO:tasks.workunit.client.1.smithi098.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-01-04T18:15:41.973 INFO:tasks.workunit.client.1.smithi098.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-01-04T18:15:41.973 INFO:tasks.workunit.client.1.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-01-04T18:15:42.471 INFO:tasks.workunit.client.1.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-01-04T18:15:42.534 INFO:tasks.workunit.client.1.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-01-04T18:15:42.572 INFO:tasks.workunit.client.1.smithi098.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-01-04T18:15:42.573 INFO:tasks.workunit.client.1.smithi098.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-01-04T18:15:42.574 INFO:tasks.workunit.client.1.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-01-04T18:15:42.612 INFO:tasks.workunit.client.1.smithi098.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-01-04T18:15:42.615 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-01-04T18:15:42.615 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2023-01-04T18:15:42.632 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2023-01-04T18:15:42.633 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-01-04T18:15:42.633 DEBUG:teuthology.orchestra.run.smithi098:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f2bb1478686242c0f68882a9cf8df4e0f8363116 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2023-01-04T18:15:42.697 INFO:tasks.workunit.client.1.smithi098.stderr:+ mkdir -p fsstress 2023-01-04T18:15:42.699 INFO:tasks.workunit.client.1.smithi098.stderr:+ pushd fsstress 2023-01-04T18:15:42.699 INFO:tasks.workunit.client.1.smithi098.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-01-04T18:15:42.700 INFO:tasks.workunit.client.1.smithi098.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-01-04T18:15:42.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.925+0000 7f075d690700 1 -- 172.21.15.50:0/3909553041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07580f5ef0 msgr2=0x7f07580f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:42.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.925+0000 7f075d690700 1 --2- 172.21.15.50:0/3909553041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07580f5ef0 0x7f07580f6920 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f074c004660 tx=0x7f074c009b30).stop 2023-01-04T18:15:42.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.925+0000 7f075d690700 1 -- 172.21.15.50:0/3909553041 shutdown_connections 2023-01-04T18:15:42.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.925+0000 7f075d690700 1 --2- 172.21.15.50:0/3909553041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07580f5ef0 0x7f07580f6920 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:42.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.925+0000 7f075d690700 1 --2- 172.21.15.50:0/3909553041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07580f55e0 0x7f07580f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:42.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.925+0000 7f075d690700 1 -- 172.21.15.50:0/3909553041 >> 172.21.15.50:0/3909553041 conn(0x7f07580f0de0 msgr2=0x7f07580f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.925+0000 7f075d690700 1 -- 172.21.15.50:0/3909553041 shutdown_connections 2023-01-04T18:15:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.925+0000 7f075d690700 1 -- 172.21.15.50:0/3909553041 wait complete. 2023-01-04T18:15:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.926+0000 7f075d690700 1 Processor -- start 2023-01-04T18:15:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.926+0000 7f075d690700 1 -- start start 2023-01-04T18:15:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.927+0000 7f075d690700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07580f55e0 0x7f0758109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.927+0000 7f075d690700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07580f5ef0 0x7f075810c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.927+0000 7f075d690700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07580604e0 con 0x7f07580f55e0 2023-01-04T18:15:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.927+0000 7f075d690700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0758060620 con 0x7f07580f5ef0 2023-01-04T18:15:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.927+0000 7f0756ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07580f55e0 0x7f0758109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.927+0000 7f0756ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07580f55e0 0x7f0758109c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57766/0 (socket says 172.21.15.50:57766) 2023-01-04T18:15:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.927+0000 7f0756ffd700 1 -- 172.21.15.50:0/249350946 learned_addr learned my addr 172.21.15.50:0/249350946 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:15:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.927+0000 7f07567fc700 1 --2- 172.21.15.50:0/249350946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07580f5ef0 0x7f075810c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.927+0000 7f0756ffd700 1 -- 172.21.15.50:0/249350946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07580f5ef0 msgr2=0x7f075810c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.927+0000 7f0756ffd700 1 --2- 172.21.15.50:0/249350946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07580f5ef0 0x7f075810c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.927+0000 7f0756ffd700 1 -- 172.21.15.50:0/249350946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c005040 con 0x7f07580f55e0 2023-01-04T18:15:42.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.927+0000 7f0756ffd700 1 --2- 172.21.15.50:0/249350946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07580f55e0 0x7f0758109c30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f074800e7f0 tx=0x7f074800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:42.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.927+0000 7f073f7fe700 1 -- 172.21.15.50:0/249350946 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07480092e0 con 0x7f07580f55e0 2023-01-04T18:15:42.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.927+0000 7f073f7fe700 1 -- 172.21.15.50:0/249350946 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f074800f040 con 0x7f07580f55e0 2023-01-04T18:15:42.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.927+0000 7f075d690700 1 -- 172.21.15.50:0/249350946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075810c6e0 con 0x7f07580f55e0 2023-01-04T18:15:42.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.927+0000 7f073f7fe700 1 -- 172.21.15.50:0/249350946 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07480147e0 con 0x7f07580f55e0 2023-01-04T18:15:42.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.927+0000 7f075d690700 1 -- 172.21.15.50:0/249350946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075810cbf0 con 0x7f07580f55e0 2023-01-04T18:15:42.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.929+0000 7f075d690700 1 -- 172.21.15.50:0/249350946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07580f4a70 con 0x7f07580f55e0 2023-01-04T18:15:42.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.929+0000 7f073f7fe700 1 -- 172.21.15.50:0/249350946 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f074801b030 con 0x7f07580f55e0 2023-01-04T18:15:42.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.929+0000 7f073f7fe700 1 --2- 172.21.15.50:0/249350946 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f074005c2b0 0x7f074005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:42.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.929+0000 7f073f7fe700 1 -- 172.21.15.50:0/249350946 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f0748075cb0 con 0x7f07580f55e0 2023-01-04T18:15:42.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.929+0000 7f07567fc700 1 --2- 172.21.15.50:0/249350946 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f074005c2b0 0x7f074005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:42.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.930+0000 7f07567fc700 1 --2- 172.21.15.50:0/249350946 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f074005c2b0 0x7f074005e770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f074c009720 tx=0x7f074c016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:42.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:42.934+0000 7f073f7fe700 1 -- 172.21.15.50:0/249350946 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0748048a20 con 0x7f07580f55e0 2023-01-04T18:15:43.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:41.309622+0000 mgr.smithi050.emnywo (mgr.14162) 244 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2023-01-04T18:15:43.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:41.309622+0000 mgr.smithi050.emnywo (mgr.14162) 244 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2023-01-04T18:15:43.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.130+0000 7f075d690700 1 -- 172.21.15.50:0/249350946 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07580fdf20 con 0x7f074005c2b0 2023-01-04T18:15:43.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.131+0000 7f073f7fe700 1 -- 172.21.15.50:0/249350946 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+372 (secure 0 0 0) 0x7f07580fdf20 con 0x7f074005c2b0 2023-01-04T18:15:43.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.133+0000 7f075d690700 1 -- 172.21.15.50:0/249350946 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f074005c2b0 msgr2=0x7f074005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:43.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.133+0000 7f075d690700 1 --2- 172.21.15.50:0/249350946 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f074005c2b0 0x7f074005e770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f074c009720 tx=0x7f074c016040).stop 2023-01-04T18:15:43.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.133+0000 7f075d690700 1 -- 172.21.15.50:0/249350946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07580f55e0 msgr2=0x7f0758109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:43.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.133+0000 7f075d690700 1 --2- 172.21.15.50:0/249350946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07580f55e0 0x7f0758109c30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f074800e7f0 tx=0x7f074800b040).stop 2023-01-04T18:15:43.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.133+0000 7f075d690700 1 -- 172.21.15.50:0/249350946 shutdown_connections 2023-01-04T18:15:43.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.133+0000 7f075d690700 1 --2- 172.21.15.50:0/249350946 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f074005c2b0 0x7f074005e770 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:43.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.133+0000 7f075d690700 1 --2- 172.21.15.50:0/249350946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07580f55e0 0x7f0758109c30 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:43.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.133+0000 7f075d690700 1 --2- 172.21.15.50:0/249350946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07580f5ef0 0x7f075810c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:43.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.133+0000 7f075d690700 1 -- 172.21.15.50:0/249350946 >> 172.21.15.50:0/249350946 conn(0x7f07580f0de0 msgr2=0x7f07580fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:43.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.133+0000 7f075d690700 1 -- 172.21.15.50:0/249350946 shutdown_connections 2023-01-04T18:15:43.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.133+0000 7f075d690700 1 -- 172.21.15.50:0/249350946 wait complete. 2023-01-04T18:15:43.146 INFO:teuthology.orchestra.run.smithi050.stdout:true 2023-01-04T18:15:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.238+0000 7fbf15296700 1 -- 172.21.15.50:0/531426375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf100f96f0 msgr2=0x7fbf100fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.238+0000 7fbf15296700 1 --2- 172.21.15.50:0/531426375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf100f96f0 0x7fbf100fbae0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fbf04004660 tx=0x7fbf04009b30).stop 2023-01-04T18:15:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.238+0000 7fbf15296700 1 -- 172.21.15.50:0/531426375 shutdown_connections 2023-01-04T18:15:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.238+0000 7fbf15296700 1 --2- 172.21.15.50:0/531426375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf100f96f0 0x7fbf100fbae0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.238+0000 7fbf15296700 1 --2- 172.21.15.50:0/531426375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf100602b0 0x7fbf100f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.238+0000 7fbf15296700 1 -- 172.21.15.50:0/531426375 >> 172.21.15.50:0/531426375 conn(0x7fbf100f0b90 msgr2=0x7fbf100f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.238+0000 7fbf15296700 1 -- 172.21.15.50:0/531426375 shutdown_connections 2023-01-04T18:15:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.238+0000 7fbf15296700 1 -- 172.21.15.50:0/531426375 wait complete. 2023-01-04T18:15:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.238+0000 7fbf15296700 1 Processor -- start 2023-01-04T18:15:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.239+0000 7fbf15296700 1 -- start start 2023-01-04T18:15:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.239+0000 7fbf15296700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf100602b0 0x7fbf10106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.239+0000 7fbf15296700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf100f96f0 0x7fbf10107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.239+0000 7fbf15296700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf10107840 con 0x7fbf100f96f0 2023-01-04T18:15:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.239+0000 7fbf15296700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf10108050 con 0x7fbf100602b0 2023-01-04T18:15:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.239+0000 7fbf0f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf100f96f0 0x7fbf10107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.239+0000 7fbf0ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf100602b0 0x7fbf10106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.239+0000 7fbf0f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf100f96f0 0x7fbf10107240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57786/0 (socket says 172.21.15.50:57786) 2023-01-04T18:15:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.239+0000 7fbf0f7fe700 1 -- 172.21.15.50:0/3755434224 learned_addr learned my addr 172.21.15.50:0/3755434224 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:15:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.239+0000 7fbf0ffff700 1 -- 172.21.15.50:0/3755434224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf100f96f0 msgr2=0x7fbf10107240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.239+0000 7fbf0ffff700 1 --2- 172.21.15.50:0/3755434224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf100f96f0 0x7fbf10107240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.239+0000 7fbf0ffff700 1 -- 172.21.15.50:0/3755434224 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf04005040 con 0x7fbf100602b0 2023-01-04T18:15:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.239+0000 7fbf0f7fe700 1 --2- 172.21.15.50:0/3755434224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf100f96f0 0x7fbf10107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-01-04T18:15:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.239+0000 7fbf0ffff700 1 --2- 172.21.15.50:0/3755434224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf100602b0 0x7fbf10106d50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fbf0000e7c0 tx=0x7fbf0000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.240+0000 7fbf0cff9700 1 -- 172.21.15.50:0/3755434224 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf000092e0 con 0x7fbf100602b0 2023-01-04T18:15:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.240+0000 7fbf0cff9700 1 -- 172.21.15.50:0/3755434224 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbf0000f040 con 0x7fbf100602b0 2023-01-04T18:15:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.240+0000 7fbf15296700 1 -- 172.21.15.50:0/3755434224 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf101082d0 con 0x7fbf100602b0 2023-01-04T18:15:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.240+0000 7fbf0cff9700 1 -- 172.21.15.50:0/3755434224 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf00014920 con 0x7fbf100602b0 2023-01-04T18:15:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.240+0000 7fbf15296700 1 -- 172.21.15.50:0/3755434224 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf10108810 con 0x7fbf100602b0 2023-01-04T18:15:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.241+0000 7fbf15296700 1 -- 172.21.15.50:0/3755434224 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf10059100 con 0x7fbf100602b0 2023-01-04T18:15:43.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.241+0000 7fbf0cff9700 1 -- 172.21.15.50:0/3755434224 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fbf0001b030 con 0x7fbf100602b0 2023-01-04T18:15:43.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.241+0000 7fbf0cff9700 1 --2- 172.21.15.50:0/3755434224 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fbef805c300 0x7fbef805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:43.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.242+0000 7fbf0cff9700 1 -- 172.21.15.50:0/3755434224 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fbf00075da0 con 0x7fbf100602b0 2023-01-04T18:15:43.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.242+0000 7fbf0f7fe700 1 --2- 172.21.15.50:0/3755434224 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fbef805c300 0x7fbef805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:43.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.242+0000 7fbf0f7fe700 1 --2- 172.21.15.50:0/3755434224 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fbef805c300 0x7fbef805e7c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fbf04009720 tx=0x7fbf04016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.248+0000 7fbf0cff9700 1 -- 172.21.15.50:0/3755434224 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fbf00048a60 con 0x7fbf100602b0 2023-01-04T18:15:43.430 INFO:tasks.workunit.client.1.smithi098.stderr:+ tar xzf ltp-full.tgz 2023-01-04T18:15:43.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.442+0000 7fbf15296700 1 -- 172.21.15.50:0/3755434224 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf100008d0 con 0x7fbef805c300 2023-01-04T18:15:43.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.443+0000 7fbf0cff9700 1 -- 172.21.15.50:0/3755434224 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+372 (secure 0 0 0) 0x7fbf100008d0 con 0x7fbef805c300 2023-01-04T18:15:43.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.445+0000 7fbf15296700 1 -- 172.21.15.50:0/3755434224 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fbef805c300 msgr2=0x7fbef805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:43.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.445+0000 7fbf15296700 1 --2- 172.21.15.50:0/3755434224 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fbef805c300 0x7fbef805e7c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fbf04009720 tx=0x7fbf04016040).stop 2023-01-04T18:15:43.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.445+0000 7fbf15296700 1 -- 172.21.15.50:0/3755434224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf100602b0 msgr2=0x7fbf10106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:43.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.445+0000 7fbf15296700 1 --2- 172.21.15.50:0/3755434224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf100602b0 0x7fbf10106d50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fbf0000e7c0 tx=0x7fbf0000b040).stop 2023-01-04T18:15:43.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.445+0000 7fbf15296700 1 -- 172.21.15.50:0/3755434224 shutdown_connections 2023-01-04T18:15:43.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.445+0000 7fbf15296700 1 --2- 172.21.15.50:0/3755434224 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fbef805c300 0x7fbef805e7c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.445+0000 7fbf15296700 1 --2- 172.21.15.50:0/3755434224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf100602b0 0x7fbf10106d50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.445+0000 7fbf15296700 1 --2- 172.21.15.50:0/3755434224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf100f96f0 0x7fbf10107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.445+0000 7fbf15296700 1 -- 172.21.15.50:0/3755434224 >> 172.21.15.50:0/3755434224 conn(0x7fbf100f0b90 msgr2=0x7fbf100f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.445+0000 7fbf15296700 1 -- 172.21.15.50:0/3755434224 shutdown_connections 2023-01-04T18:15:43.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.445+0000 7fbf15296700 1 -- 172.21.15.50:0/3755434224 wait complete. 2023-01-04T18:15:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.551+0000 7fd4d8bef700 1 -- 172.21.15.50:0/2020374834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d40f66e0 msgr2=0x7fd4d40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:43.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.551+0000 7fd4d8bef700 1 --2- 172.21.15.50:0/2020374834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d40f66e0 0x7fd4d40f6b00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fd4c4004660 tx=0x7fd4c4009b30).stop 2023-01-04T18:15:43.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.551+0000 7fd4d8bef700 1 -- 172.21.15.50:0/2020374834 shutdown_connections 2023-01-04T18:15:43.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.551+0000 7fd4d8bef700 1 --2- 172.21.15.50:0/2020374834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4d40f7980 0x7fd4d40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:43.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.551+0000 7fd4d8bef700 1 --2- 172.21.15.50:0/2020374834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d40f66e0 0x7fd4d40f6b00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:43.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.551+0000 7fd4d8bef700 1 -- 172.21.15.50:0/2020374834 >> 172.21.15.50:0/2020374834 conn(0x7fd4d40f1e40 msgr2=0x7fd4d40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:43.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.551+0000 7fd4d8bef700 1 -- 172.21.15.50:0/2020374834 shutdown_connections 2023-01-04T18:15:43.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.551+0000 7fd4d8bef700 1 -- 172.21.15.50:0/2020374834 wait complete. 2023-01-04T18:15:43.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.552+0000 7fd4d8bef700 1 Processor -- start 2023-01-04T18:15:43.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.552+0000 7fd4d8bef700 1 -- start start 2023-01-04T18:15:43.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.552+0000 7fd4d8bef700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4d40f66e0 0x7fd4d406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:43.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.552+0000 7fd4d8bef700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d40f7980 0x7fd4d4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:43.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.552+0000 7fd4d8bef700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d406a380 con 0x7fd4d40f7980 2023-01-04T18:15:43.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.552+0000 7fd4d8bef700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d406a4c0 con 0x7fd4d40f66e0 2023-01-04T18:15:43.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.552+0000 7fd4d1d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d40f7980 0x7fd4d4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:43.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.552+0000 7fd4d259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4d40f66e0 0x7fd4d406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:43.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.552+0000 7fd4d259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4d40f66e0 0x7fd4d406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.50:54368/0 (socket says 172.21.15.50:54368) 2023-01-04T18:15:43.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.552+0000 7fd4d1d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d40f7980 0x7fd4d4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57798/0 (socket says 172.21.15.50:57798) 2023-01-04T18:15:43.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.552+0000 7fd4d259c700 1 -- 172.21.15.50:0/3958356868 learned_addr learned my addr 172.21.15.50:0/3958356868 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:15:43.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.553+0000 7fd4d1d9b700 1 -- 172.21.15.50:0/3958356868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4d40f66e0 msgr2=0x7fd4d406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:43.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.553+0000 7fd4d1d9b700 1 --2- 172.21.15.50:0/3958356868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4d40f66e0 0x7fd4d406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:43.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.553+0000 7fd4d1d9b700 1 -- 172.21.15.50:0/3958356868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c4005040 con 0x7fd4d40f7980 2023-01-04T18:15:43.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.553+0000 7fd4d1d9b700 1 --2- 172.21.15.50:0/3958356868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d40f7980 0x7fd4d4069e20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fd4c800e7c0 tx=0x7fd4c800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:43.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.553+0000 7fd4c2ffd700 1 -- 172.21.15.50:0/3958356868 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4c80092e0 con 0x7fd4d40f7980 2023-01-04T18:15:43.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.553+0000 7fd4d8bef700 1 -- 172.21.15.50:0/3958356868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d406a7a0 con 0x7fd4d40f7980 2023-01-04T18:15:43.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.553+0000 7fd4c2ffd700 1 -- 172.21.15.50:0/3958356868 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd4c800f040 con 0x7fd4d40f7980 2023-01-04T18:15:43.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.553+0000 7fd4c2ffd700 1 -- 172.21.15.50:0/3958356868 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4c8014920 con 0x7fd4d40f7980 2023-01-04T18:15:43.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.553+0000 7fd4d8bef700 1 -- 172.21.15.50:0/3958356868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d410efb0 con 0x7fd4d40f7980 2023-01-04T18:15:43.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.554+0000 7fd4c2ffd700 1 -- 172.21.15.50:0/3958356868 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fd4c801b030 con 0x7fd4d40f7980 2023-01-04T18:15:43.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.555+0000 7fd4c2ffd700 1 --2- 172.21.15.50:0/3958356868 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fd4bc05c2b0 0x7fd4bc05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:43.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.555+0000 7fd4c2ffd700 1 -- 172.21.15.50:0/3958356868 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fd4c8075dd0 con 0x7fd4d40f7980 2023-01-04T18:15:43.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.555+0000 7fd4d259c700 1 --2- 172.21.15.50:0/3958356868 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fd4bc05c2b0 0x7fd4bc05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:43.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.555+0000 7fd4d8bef700 1 -- 172.21.15.50:0/3958356868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d40f5ad0 con 0x7fd4d40f7980 2023-01-04T18:15:43.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.555+0000 7fd4d259c700 1 --2- 172.21.15.50:0/3958356868 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fd4bc05c2b0 0x7fd4bc05e770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fd4c4009720 tx=0x7fd4c4016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.559+0000 7fd4c2ffd700 1 -- 172.21.15.50:0/3958356868 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd4c8019080 con 0x7fd4d40f7980 2023-01-04T18:15:43.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.755+0000 7fd4d8bef700 1 -- 172.21.15.50:0/3958356868 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4d40fef40 con 0x7fd4bc05c2b0 2023-01-04T18:15:43.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.766+0000 7fd4c2ffd700 1 -- 172.21.15.50:0/3958356868 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2684 (secure 0 0 0) 0x7fd4d40fef40 con 0x7fd4bc05c2b0 2023-01-04T18:15:43.770 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2023-01-04T18:15:43.770 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager.smithi050 smithi050 *:9093,9094 running (4m) 50s ago 5m 0.20.0 0881eb8f169f b5d3e2678a23 2023-01-04T18:15:43.770 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi050 smithi050 running (5m) 50s ago 5m 16.2.4 8d91d370c2b8 cfe6f2d72ef5 2023-01-04T18:15:43.770 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi098 smithi098 running (4m) 53s ago 4m 16.2.4 8d91d370c2b8 2928008d526c 2023-01-04T18:15:43.770 INFO:teuthology.orchestra.run.smithi050.stdout:grafana.smithi050 smithi050 *:3000 running (3m) 50s ago 5m 6.7.4 557c83e11646 7e5dccbafe78 2023-01-04T18:15:43.770 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.ezoiwl smithi050 running (70s) 50s ago 70s 16.2.4 8d91d370c2b8 6c5c5f2be8b9 2023-01-04T18:15:43.770 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.kefmuy smithi050 running (65s) 50s ago 65s 16.2.4 8d91d370c2b8 58cace913b55 2023-01-04T18:15:43.770 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.laynsk smithi098 running (63s) 53s ago 62s 16.2.4 8d91d370c2b8 8ff8af70b989 2023-01-04T18:15:43.770 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.memais smithi098 running (68s) 53s ago 68s 16.2.4 8d91d370c2b8 d59d9b4dbf7d 2023-01-04T18:15:43.771 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi050.emnywo smithi050 *:9283 running (6m) 50s ago 6m 16.2.4 8d91d370c2b8 51f88deda58e 2023-01-04T18:15:43.771 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi098.vhfzum smithi098 *:8443,9283 running (4m) 53s ago 4m 16.2.4 8d91d370c2b8 238015c4e3b1 2023-01-04T18:15:43.771 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi050 smithi050 running (6m) 50s ago 6m 16.2.4 8d91d370c2b8 7ef171ad1e93 2023-01-04T18:15:43.771 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi098 smithi098 running (4m) 53s ago 4m 16.2.4 8d91d370c2b8 e6b6833279a4 2023-01-04T18:15:43.771 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi050 smithi050 *:9100 running (4m) 50s ago 4m 0.18.1 e5a616e4b9cf 88892b2e5e5a 2023-01-04T18:15:43.771 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi098 smithi098 *:9100 running (4m) 53s ago 4m 0.18.1 e5a616e4b9cf 49bcde8331b6 2023-01-04T18:15:43.771 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (3m) 50s ago 3m 16.2.4 8d91d370c2b8 b46676195180 2023-01-04T18:15:43.771 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi050 running (3m) 50s ago 3m 16.2.4 8d91d370c2b8 e4928bcfd146 2023-01-04T18:15:43.771 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi050 running (3m) 50s ago 3m 16.2.4 8d91d370c2b8 babab394b338 2023-01-04T18:15:43.771 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi098 running (3m) 53s ago 3m 16.2.4 8d91d370c2b8 b02df8e3cb23 2023-01-04T18:15:43.771 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi098 running (2m) 53s ago 2m 16.2.4 8d91d370c2b8 92273135ca82 2023-01-04T18:15:43.772 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi098 running (2m) 53s ago 2m 16.2.4 8d91d370c2b8 366d0bfff809 2023-01-04T18:15:43.772 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus.smithi050 smithi050 *:9095 running (3m) 50s ago 4m 2.18.1 de242295e225 6ff859f5958f 2023-01-04T18:15:43.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.768+0000 7fd4d8bef700 1 -- 172.21.15.50:0/3958356868 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fd4bc05c2b0 msgr2=0x7fd4bc05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:43.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.768+0000 7fd4d8bef700 1 --2- 172.21.15.50:0/3958356868 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fd4bc05c2b0 0x7fd4bc05e770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fd4c4009720 tx=0x7fd4c4016040).stop 2023-01-04T18:15:43.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.768+0000 7fd4d8bef700 1 -- 172.21.15.50:0/3958356868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d40f7980 msgr2=0x7fd4d4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:43.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.768+0000 7fd4d8bef700 1 --2- 172.21.15.50:0/3958356868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d40f7980 0x7fd4d4069e20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fd4c800e7c0 tx=0x7fd4c800b040).stop 2023-01-04T18:15:43.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.768+0000 7fd4d8bef700 1 -- 172.21.15.50:0/3958356868 shutdown_connections 2023-01-04T18:15:43.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.768+0000 7fd4d8bef700 1 --2- 172.21.15.50:0/3958356868 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fd4bc05c2b0 0x7fd4bc05e770 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:43.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.768+0000 7fd4d8bef700 1 --2- 172.21.15.50:0/3958356868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4d40f66e0 0x7fd4d406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:43.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.769+0000 7fd4d8bef700 1 --2- 172.21.15.50:0/3958356868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d40f7980 0x7fd4d4069e20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:43.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.769+0000 7fd4d8bef700 1 -- 172.21.15.50:0/3958356868 >> 172.21.15.50:0/3958356868 conn(0x7fd4d40f1e40 msgr2=0x7fd4d40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:43.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.769+0000 7fd4d8bef700 1 -- 172.21.15.50:0/3958356868 shutdown_connections 2023-01-04T18:15:43.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.769+0000 7fd4d8bef700 1 -- 172.21.15.50:0/3958356868 wait complete. 2023-01-04T18:15:43.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.873+0000 7fc3627f2700 1 -- 172.21.15.50:0/3150784469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc35c0f7980 msgr2=0x7fc35c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:43.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.873+0000 7fc3627f2700 1 --2- 172.21.15.50:0/3150784469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc35c0f7980 0x7fc35c0f7de0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fc350004660 tx=0x7fc350009b30).stop 2023-01-04T18:15:43.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.873+0000 7fc3627f2700 1 -- 172.21.15.50:0/3150784469 shutdown_connections 2023-01-04T18:15:43.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.873+0000 7fc3627f2700 1 --2- 172.21.15.50:0/3150784469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc35c0f7980 0x7fc35c0f7de0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:43.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.873+0000 7fc3627f2700 1 --2- 172.21.15.50:0/3150784469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc35c0f66e0 0x7fc35c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:43.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.873+0000 7fc3627f2700 1 -- 172.21.15.50:0/3150784469 >> 172.21.15.50:0/3150784469 conn(0x7fc35c0f1e40 msgr2=0x7fc35c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:43.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.874+0000 7fc3627f2700 1 -- 172.21.15.50:0/3150784469 shutdown_connections 2023-01-04T18:15:43.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.874+0000 7fc3627f2700 1 -- 172.21.15.50:0/3150784469 wait complete. 2023-01-04T18:15:43.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.874+0000 7fc3627f2700 1 Processor -- start 2023-01-04T18:15:43.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.874+0000 7fc3627f2700 1 -- start start 2023-01-04T18:15:43.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.875+0000 7fc3627f2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc35c0f66e0 0x7fc35c106f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:43.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.875+0000 7fc3627f2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc35c0f7980 0x7fc35c1073f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:43.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.875+0000 7fc3627f2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c1079a0 con 0x7fc35c0f66e0 2023-01-04T18:15:43.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.875+0000 7fc3627f2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c107ae0 con 0x7fc35c0f7980 2023-01-04T18:15:43.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.875+0000 7fc35bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc35c0f66e0 0x7fc35c106f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:43.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.875+0000 7fc35bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc35c0f66e0 0x7fc35c106f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57804/0 (socket says 172.21.15.50:57804) 2023-01-04T18:15:43.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.875+0000 7fc35bfff700 1 -- 172.21.15.50:0/3504686489 learned_addr learned my addr 172.21.15.50:0/3504686489 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:15:43.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.875+0000 7fc35b7fe700 1 --2- 172.21.15.50:0/3504686489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc35c0f7980 0x7fc35c1073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:43.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.875+0000 7fc35bfff700 1 -- 172.21.15.50:0/3504686489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc35c0f7980 msgr2=0x7fc35c1073f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:43.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.875+0000 7fc35bfff700 1 --2- 172.21.15.50:0/3504686489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc35c0f7980 0x7fc35c1073f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:43.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.875+0000 7fc35bfff700 1 -- 172.21.15.50:0/3504686489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc350005040 con 0x7fc35c0f66e0 2023-01-04T18:15:43.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.875+0000 7fc35bfff700 1 --2- 172.21.15.50:0/3504686489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc35c0f66e0 0x7fc35c106f00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fc34c00e7c0 tx=0x7fc34c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:43.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.875+0000 7fc358ff9700 1 -- 172.21.15.50:0/3504686489 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc34c0092e0 con 0x7fc35c0f66e0 2023-01-04T18:15:43.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.875+0000 7fc3627f2700 1 -- 172.21.15.50:0/3504686489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35c108480 con 0x7fc35c0f66e0 2023-01-04T18:15:43.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.875+0000 7fc358ff9700 1 -- 172.21.15.50:0/3504686489 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc34c00f040 con 0x7fc35c0f66e0 2023-01-04T18:15:43.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.875+0000 7fc358ff9700 1 -- 172.21.15.50:0/3504686489 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc34c014810 con 0x7fc35c0f66e0 2023-01-04T18:15:43.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.875+0000 7fc3627f2700 1 -- 172.21.15.50:0/3504686489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35c1089c0 con 0x7fc35c0f66e0 2023-01-04T18:15:43.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.876+0000 7fc3627f2700 1 -- 172.21.15.50:0/3504686489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35c045ad0 con 0x7fc35c0f66e0 2023-01-04T18:15:43.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.877+0000 7fc358ff9700 1 -- 172.21.15.50:0/3504686489 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc34c01b030 con 0x7fc35c0f66e0 2023-01-04T18:15:43.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.878+0000 7fc358ff9700 1 --2- 172.21.15.50:0/3504686489 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc34405c2b0 0x7fc34405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:43.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.878+0000 7fc358ff9700 1 -- 172.21.15.50:0/3504686489 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fc34c075e20 con 0x7fc35c0f66e0 2023-01-04T18:15:43.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.878+0000 7fc35b7fe700 1 --2- 172.21.15.50:0/3504686489 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc34405c2b0 0x7fc34405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:43.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.878+0000 7fc35b7fe700 1 --2- 172.21.15.50:0/3504686489 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc34405c2b0 0x7fc34405e770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fc350009720 tx=0x7fc350016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:43.885+0000 7fc358ff9700 1 -- 172.21.15.50:0/3504686489 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc34c048ae0 con 0x7fc35c0f66e0 2023-01-04T18:15:44.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.109+0000 7fc3627f2700 1 -- 172.21.15.50:0/3504686489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc35c0fef40 con 0x7fc35c0f66e0 2023-01-04T18:15:44.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.109+0000 7fc358ff9700 1 -- 172.21.15.50:0/3504686489 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+573 (secure 0 0 0) 0x7fc34c019020 con 0x7fc35c0f66e0 2023-01-04T18:15:44.113 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:15:44.113 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": { 2023-01-04T18:15:44.113 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-01-04T18:15:44.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:15:44.113 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": { 2023-01-04T18:15:44.113 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-01-04T18:15:44.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:15:44.113 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": { 2023-01-04T18:15:44.113 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2023-01-04T18:15:44.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:15:44.114 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2023-01-04T18:15:44.114 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-01-04T18:15:44.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:15:44.114 INFO:teuthology.orchestra.run.smithi050.stdout: "overall": { 2023-01-04T18:15:44.114 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 14 2023-01-04T18:15:44.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-01-04T18:15:44.114 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:15:44.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.111+0000 7fc3627f2700 1 -- 172.21.15.50:0/3504686489 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc34405c2b0 msgr2=0x7fc34405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:44.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.111+0000 7fc3627f2700 1 --2- 172.21.15.50:0/3504686489 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc34405c2b0 0x7fc34405e770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fc350009720 tx=0x7fc350016040).stop 2023-01-04T18:15:44.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.111+0000 7fc3627f2700 1 -- 172.21.15.50:0/3504686489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc35c0f66e0 msgr2=0x7fc35c106f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:44.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.111+0000 7fc3627f2700 1 --2- 172.21.15.50:0/3504686489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc35c0f66e0 0x7fc35c106f00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fc34c00e7c0 tx=0x7fc34c00b040).stop 2023-01-04T18:15:44.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.111+0000 7fc3627f2700 1 -- 172.21.15.50:0/3504686489 shutdown_connections 2023-01-04T18:15:44.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.111+0000 7fc3627f2700 1 --2- 172.21.15.50:0/3504686489 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fc34405c2b0 0x7fc34405e770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:44.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.111+0000 7fc3627f2700 1 --2- 172.21.15.50:0/3504686489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc35c0f66e0 0x7fc35c106f00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:44.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.111+0000 7fc3627f2700 1 --2- 172.21.15.50:0/3504686489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc35c0f7980 0x7fc35c1073f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:44.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.111+0000 7fc3627f2700 1 -- 172.21.15.50:0/3504686489 >> 172.21.15.50:0/3504686489 conn(0x7fc35c0f1e40 msgr2=0x7fc35c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:44.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.112+0000 7fc3627f2700 1 -- 172.21.15.50:0/3504686489 shutdown_connections 2023-01-04T18:15:44.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.112+0000 7fc3627f2700 1 -- 172.21.15.50:0/3504686489 wait complete. 2023-01-04T18:15:44.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.215+0000 7f325e49c700 1 -- 172.21.15.50:0/4280417558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3258060310 msgr2=0x7f32580f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:44.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.215+0000 7f325e49c700 1 --2- 172.21.15.50:0/4280417558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3258060310 0x7f32580f9110 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f3254004660 tx=0x7f3254009b30).stop 2023-01-04T18:15:44.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.215+0000 7f325e49c700 1 -- 172.21.15.50:0/4280417558 shutdown_connections 2023-01-04T18:15:44.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.215+0000 7f325e49c700 1 --2- 172.21.15.50:0/4280417558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32580f9690 0x7f32580fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:44.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.215+0000 7f325e49c700 1 --2- 172.21.15.50:0/4280417558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3258060310 0x7f32580f9110 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:44.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.215+0000 7f325e49c700 1 -- 172.21.15.50:0/4280417558 >> 172.21.15.50:0/4280417558 conn(0x7f32580f0b90 msgr2=0x7f32580f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:44.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.215+0000 7f325e49c700 1 -- 172.21.15.50:0/4280417558 shutdown_connections 2023-01-04T18:15:44.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.215+0000 7f325e49c700 1 -- 172.21.15.50:0/4280417558 wait complete. 2023-01-04T18:15:44.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.216+0000 7f325e49c700 1 Processor -- start 2023-01-04T18:15:44.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.216+0000 7f325e49c700 1 -- start start 2023-01-04T18:15:44.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.216+0000 7f325e49c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3258060310 0x7f3258106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:44.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.216+0000 7f325e49c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32580f9690 0x7f3258107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:44.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.216+0000 7f325e49c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3258107850 con 0x7f3258060310 2023-01-04T18:15:44.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.216+0000 7f325e49c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3258108060 con 0x7f32580f9690 2023-01-04T18:15:44.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.216+0000 7f325d49a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3258060310 0x7f3258106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:44.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.216+0000 7f325d49a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3258060310 0x7f3258106d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57820/0 (socket says 172.21.15.50:57820) 2023-01-04T18:15:44.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.217+0000 7f325d49a700 1 -- 172.21.15.50:0/1519962068 learned_addr learned my addr 172.21.15.50:0/1519962068 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:15:44.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.217+0000 7f325cc99700 1 --2- 172.21.15.50:0/1519962068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32580f9690 0x7f3258107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:44.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.217+0000 7f325d49a700 1 -- 172.21.15.50:0/1519962068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32580f9690 msgr2=0x7f3258107250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:44.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.217+0000 7f325d49a700 1 --2- 172.21.15.50:0/1519962068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32580f9690 0x7f3258107250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:44.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.217+0000 7f325d49a700 1 -- 172.21.15.50:0/1519962068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3254005040 con 0x7f3258060310 2023-01-04T18:15:44.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.217+0000 7f325cc99700 1 --2- 172.21.15.50:0/1519962068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32580f9690 0x7f3258107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-01-04T18:15:44.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.217+0000 7f325d49a700 1 --2- 172.21.15.50:0/1519962068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3258060310 0x7f3258106d60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f3254004d80 tx=0x7f325400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:44.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.217+0000 7f324dffb700 1 -- 172.21.15.50:0/1519962068 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3254019070 con 0x7f3258060310 2023-01-04T18:15:44.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.217+0000 7f324dffb700 1 -- 172.21.15.50:0/1519962068 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f325401e420 con 0x7f3258060310 2023-01-04T18:15:44.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.217+0000 7f325e49c700 1 -- 172.21.15.50:0/1519962068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3258108280 con 0x7f3258060310 2023-01-04T18:15:44.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.217+0000 7f324dffb700 1 -- 172.21.15.50:0/1519962068 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3254014660 con 0x7f3258060310 2023-01-04T18:15:44.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.217+0000 7f325e49c700 1 -- 172.21.15.50:0/1519962068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3258108760 con 0x7f3258060310 2023-01-04T18:15:44.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.218+0000 7f325e49c700 1 -- 172.21.15.50:0/1519962068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3258059100 con 0x7f3258060310 2023-01-04T18:15:44.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.219+0000 7f324dffb700 1 -- 172.21.15.50:0/1519962068 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f325401e590 con 0x7f3258060310 2023-01-04T18:15:44.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.219+0000 7f324dffb700 1 --2- 172.21.15.50:0/1519962068 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f324405c300 0x7f324405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:44.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.219+0000 7f324dffb700 1 -- 172.21.15.50:0/1519962068 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f3254077380 con 0x7f3258060310 2023-01-04T18:15:44.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.219+0000 7f325cc99700 1 --2- 172.21.15.50:0/1519962068 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f324405c300 0x7f324405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:44.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.220+0000 7f325cc99700 1 --2- 172.21.15.50:0/1519962068 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f324405c300 0x7f324405e7c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f3248009fd0 tx=0x7f324800b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:44.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.223+0000 7f324dffb700 1 -- 172.21.15.50:0/1519962068 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f325404a040 con 0x7f3258060310 2023-01-04T18:15:44.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.443+0000 7f325e49c700 1 -- 172.21.15.50:0/1519962068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3258045ad0 con 0x7f3258060310 2023-01-04T18:15:44.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.444+0000 7f324dffb700 1 -- 172.21.15.50:0/1519962068 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1669 (secure 0 0 0) 0x7f325404d660 con 0x7f3258060310 2023-01-04T18:15:44.447 INFO:teuthology.orchestra.run.smithi050.stdout:e13 2023-01-04T18:15:44.447 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:15:44.447 INFO:teuthology.orchestra.run.smithi050.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:15:44.448 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-01-04T18:15:44.448 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:15:44.448 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-01-04T18:15:44.448 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-01-04T18:15:44.448 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 10 2023-01-04T18:15:44.448 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 2023-01-04T18:15:44.448 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:15:44.448 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-01-04T18:14:43.958806+0000 2023-01-04T18:15:44.448 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-01-04T18:15:44.448 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-01-04T18:15:44.449 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 60 2023-01-04T18:15:44.449 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-01-04T18:15:44.449 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-01-04T18:15:44.449 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-01-04T18:15:44.449 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-01-04T18:15:44.449 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 0 2023-01-04T18:15:44.449 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:15:44.449 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 1 2023-01-04T18:15:44.449 INFO:teuthology.orchestra.run.smithi050.stdout:in 0 2023-01-04T18:15:44.449 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=14430} 2023-01-04T18:15:44.449 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-01-04T18:15:44.450 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-01-04T18:15:44.450 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-01-04T18:15:44.450 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-01-04T18:15:44.450 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-01-04T18:15:44.450 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data enabled 2023-01-04T18:15:44.450 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-01-04T18:15:44.450 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 1 2023-01-04T18:15:44.450 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.ezoiwl{0:14430} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541]] 2023-01-04T18:15:44.450 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.memais{0:24291} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.98:6824/1196398070,v1:172.21.15.98:6825/1196398070]] 2023-01-04T18:15:44.450 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:15:44.450 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:15:44.450 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2023-01-04T18:15:44.450 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:15:44.451 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.kefmuy{-1:14440} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592]] 2023-01-04T18:15:44.451 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.laynsk{-1:24297} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263]] 2023-01-04T18:15:44.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.446+0000 7f325e49c700 1 -- 172.21.15.50:0/1519962068 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f324405c300 msgr2=0x7f324405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:44.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.446+0000 7f325e49c700 1 --2- 172.21.15.50:0/1519962068 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f324405c300 0x7f324405e7c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f3248009fd0 tx=0x7f324800b040).stop 2023-01-04T18:15:44.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.446+0000 7f325e49c700 1 -- 172.21.15.50:0/1519962068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3258060310 msgr2=0x7f3258106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:44.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.446+0000 7f325e49c700 1 --2- 172.21.15.50:0/1519962068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3258060310 0x7f3258106d60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f3254004d80 tx=0x7f325400b040).stop 2023-01-04T18:15:44.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.446+0000 7f325e49c700 1 -- 172.21.15.50:0/1519962068 shutdown_connections 2023-01-04T18:15:44.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.446+0000 7f325e49c700 1 --2- 172.21.15.50:0/1519962068 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7f324405c300 0x7f324405e7c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:44.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.446+0000 7f325e49c700 1 --2- 172.21.15.50:0/1519962068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3258060310 0x7f3258106d60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:44.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.446+0000 7f325e49c700 1 --2- 172.21.15.50:0/1519962068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32580f9690 0x7f3258107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:44.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.446+0000 7f325e49c700 1 -- 172.21.15.50:0/1519962068 >> 172.21.15.50:0/1519962068 conn(0x7f32580f0b90 msgr2=0x7f32580f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:44.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.446+0000 7f325e49c700 1 -- 172.21.15.50:0/1519962068 shutdown_connections 2023-01-04T18:15:44.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.446+0000 7f325e49c700 1 -- 172.21.15.50:0/1519962068 wait complete. 2023-01-04T18:15:44.452 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2023-01-04T18:15:44.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.559+0000 7fb714e8a700 1 -- 172.21.15.50:0/4041383008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7100f4bc0 msgr2=0x7fb7100f4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:44.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.559+0000 7fb714e8a700 1 --2- 172.21.15.50:0/4041383008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7100f4bc0 0x7fb7100f4fe0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fb700004660 tx=0x7fb700009b30).stop 2023-01-04T18:15:44.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.559+0000 7fb714e8a700 1 -- 172.21.15.50:0/4041383008 shutdown_connections 2023-01-04T18:15:44.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.559+0000 7fb714e8a700 1 --2- 172.21.15.50:0/4041383008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb7100f5e60 0x7fb7100f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:44.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.559+0000 7fb714e8a700 1 --2- 172.21.15.50:0/4041383008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7100f4bc0 0x7fb7100f4fe0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:44.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.559+0000 7fb714e8a700 1 -- 172.21.15.50:0/4041383008 >> 172.21.15.50:0/4041383008 conn(0x7fb7100f0320 msgr2=0x7fb7100f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:44.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.559+0000 7fb714e8a700 1 -- 172.21.15.50:0/4041383008 shutdown_connections 2023-01-04T18:15:44.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.559+0000 7fb714e8a700 1 -- 172.21.15.50:0/4041383008 wait complete. 2023-01-04T18:15:44.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.560+0000 7fb714e8a700 1 Processor -- start 2023-01-04T18:15:44.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.560+0000 7fb714e8a700 1 -- start start 2023-01-04T18:15:44.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.560+0000 7fb714e8a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7100f4bc0 0x7fb710105d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:44.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.560+0000 7fb714e8a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb7100f5e60 0x7fb710106210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:44.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.560+0000 7fb714e8a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7101067c0 con 0x7fb7100f4bc0 2023-01-04T18:15:44.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.560+0000 7fb714e8a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb710106fc0 con 0x7fb7100f5e60 2023-01-04T18:15:44.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.560+0000 7fb70f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7100f4bc0 0x7fb710105d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:44.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.560+0000 7fb70f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7100f4bc0 0x7fb710105d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57830/0 (socket says 172.21.15.50:57830) 2023-01-04T18:15:44.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.560+0000 7fb70f7fe700 1 -- 172.21.15.50:0/4076655982 learned_addr learned my addr 172.21.15.50:0/4076655982 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:15:44.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.561+0000 7fb70effd700 1 --2- 172.21.15.50:0/4076655982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb7100f5e60 0x7fb710106210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:44.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.561+0000 7fb70f7fe700 1 -- 172.21.15.50:0/4076655982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb7100f5e60 msgr2=0x7fb710106210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:44.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.561+0000 7fb70f7fe700 1 --2- 172.21.15.50:0/4076655982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb7100f5e60 0x7fb710106210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:44.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.561+0000 7fb70f7fe700 1 -- 172.21.15.50:0/4076655982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb700005040 con 0x7fb7100f4bc0 2023-01-04T18:15:44.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.561+0000 7fb70f7fe700 1 --2- 172.21.15.50:0/4076655982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7100f4bc0 0x7fb710105d20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fb700009f50 tx=0x7fb700009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:44.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.561+0000 7fb6f7fff700 1 -- 172.21.15.50:0/4076655982 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb70001a070 con 0x7fb7100f4bc0 2023-01-04T18:15:44.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.561+0000 7fb714e8a700 1 -- 172.21.15.50:0/4076655982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb710107240 con 0x7fb7100f4bc0 2023-01-04T18:15:44.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.561+0000 7fb6f7fff700 1 -- 172.21.15.50:0/4076655982 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb700012a90 con 0x7fb7100f4bc0 2023-01-04T18:15:44.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.561+0000 7fb6f7fff700 1 -- 172.21.15.50:0/4076655982 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb70001f7b0 con 0x7fb7100f4bc0 2023-01-04T18:15:44.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.562+0000 7fb714e8a700 1 -- 172.21.15.50:0/4076655982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7101077a0 con 0x7fb7100f4bc0 2023-01-04T18:15:44.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.563+0000 7fb714e8a700 1 -- 172.21.15.50:0/4076655982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb710059100 con 0x7fb7100f4bc0 2023-01-04T18:15:44.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.563+0000 7fb6f7fff700 1 -- 172.21.15.50:0/4076655982 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fb700012c00 con 0x7fb7100f4bc0 2023-01-04T18:15:44.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.564+0000 7fb6f7fff700 1 --2- 172.21.15.50:0/4076655982 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb6f805c300 0x7fb6f805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:15:44.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.564+0000 7fb6f7fff700 1 -- 172.21.15.50:0/4076655982 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fb700079f50 con 0x7fb7100f4bc0 2023-01-04T18:15:44.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.564+0000 7fb70effd700 1 --2- 172.21.15.50:0/4076655982 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb6f805c300 0x7fb6f805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:15:44.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.564+0000 7fb70effd700 1 --2- 172.21.15.50:0/4076655982 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb6f805c300 0x7fb6f805e7c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fb704004c40 tx=0x7fb70400b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:15:44.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.570+0000 7fb6f7fff700 1 -- 172.21.15.50:0/4076655982 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb7000a62b0 con 0x7fb7100f4bc0 2023-01-04T18:15:44.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.791+0000 7fb714e8a700 1 -- 172.21.15.50:0/4076655982 --> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7100fa8b0 con 0x7fb6f805c300 2023-01-04T18:15:44.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.793+0000 7fb6f7fff700 1 -- 172.21.15.50:0/4076655982 <== mgr.14162 v2:172.21.15.50:6800/2223914843 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+372 (secure 0 0 0) 0x7fb7100fa8b0 con 0x7fb6f805c300 2023-01-04T18:15:44.796 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:15:44.796 INFO:teuthology.orchestra.run.smithi050.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308", 2023-01-04T18:15:44.796 INFO:teuthology.orchestra.run.smithi050.stdout: "in_progress": true, 2023-01-04T18:15:44.796 INFO:teuthology.orchestra.run.smithi050.stdout: "services_complete": [], 2023-01-04T18:15:44.796 INFO:teuthology.orchestra.run.smithi050.stdout: "progress": "0/21 ceph daemons upgraded", 2023-01-04T18:15:44.796 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308 image on host smithi098" 2023-01-04T18:15:44.796 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:15:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.794+0000 7fb714e8a700 1 -- 172.21.15.50:0/4076655982 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb6f805c300 msgr2=0x7fb6f805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.794+0000 7fb714e8a700 1 --2- 172.21.15.50:0/4076655982 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb6f805c300 0x7fb6f805e7c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fb704004c40 tx=0x7fb70400b040).stop 2023-01-04T18:15:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.794+0000 7fb714e8a700 1 -- 172.21.15.50:0/4076655982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7100f4bc0 msgr2=0x7fb710105d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:15:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.794+0000 7fb714e8a700 1 --2- 172.21.15.50:0/4076655982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7100f4bc0 0x7fb710105d20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fb700009f50 tx=0x7fb700009b30).stop 2023-01-04T18:15:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.794+0000 7fb714e8a700 1 -- 172.21.15.50:0/4076655982 shutdown_connections 2023-01-04T18:15:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.794+0000 7fb714e8a700 1 --2- 172.21.15.50:0/4076655982 >> [v2:172.21.15.50:6800/2223914843,v1:172.21.15.50:6801/2223914843] conn(0x7fb6f805c300 0x7fb6f805e7c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.794+0000 7fb714e8a700 1 --2- 172.21.15.50:0/4076655982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7100f4bc0 0x7fb710105d20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.794+0000 7fb714e8a700 1 --2- 172.21.15.50:0/4076655982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb7100f5e60 0x7fb710106210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:15:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.794+0000 7fb714e8a700 1 -- 172.21.15.50:0/4076655982 >> 172.21.15.50:0/4076655982 conn(0x7fb7100f0320 msgr2=0x7fb7100fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:15:44.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.795+0000 7fb714e8a700 1 -- 172.21.15.50:0/4076655982 shutdown_connections 2023-01-04T18:15:44.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:15:44.795+0000 7fb714e8a700 1 -- 172.21.15.50:0/4076655982 wait complete. 2023-01-04T18:15:45.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:43.132141+0000 mgr.smithi050.emnywo (mgr.14162) 245 : audit [DBG] from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:15:45.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:43.310175+0000 mgr.smithi050.emnywo (mgr.14162) 246 : cluster [DBG] pgmap v195: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2023-01-04T18:15:45.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:43.444293+0000 mgr.smithi050.emnywo (mgr.14162) 247 : audit [DBG] from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:15:45.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:43.756939+0000 mgr.smithi050.emnywo (mgr.14162) 248 : audit [DBG] from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:15:45.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:44.110974+0000 mon.smithi050 (mon.0) 554 : audit [DBG] from='client.? 172.21.15.50:0/3504686489' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:15:45.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:44.445407+0000 mon.smithi050 (mon.0) 555 : audit [DBG] from='client.? 172.21.15.50:0/1519962068' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:15:45.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:43.132141+0000 mgr.smithi050.emnywo (mgr.14162) 245 : audit [DBG] from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:15:45.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:43.310175+0000 mgr.smithi050.emnywo (mgr.14162) 246 : cluster [DBG] pgmap v195: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2023-01-04T18:15:45.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:43.444293+0000 mgr.smithi050.emnywo (mgr.14162) 247 : audit [DBG] from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:15:45.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:43.756939+0000 mgr.smithi050.emnywo (mgr.14162) 248 : audit [DBG] from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:15:45.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:44.110974+0000 mon.smithi050 (mon.0) 554 : audit [DBG] from='client.? 172.21.15.50:0/3504686489' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:15:45.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:44.445407+0000 mon.smithi050 (mon.0) 555 : audit [DBG] from='client.? 172.21.15.50:0/1519962068' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:15:45.514 INFO:tasks.workunit.client.0.smithi050.stderr:Updating files: 90% (10581/11684) Updating files: 91% (10633/11684) Updating files: 92% (10750/11684) Updating files: 93% (10867/11684) Updating files: 94% (10983/11684) Updating files: 95% (11100/11684) Updating files: 96% (11217/11684) Updating files: 97% (11334/11684) Updating files: 98% (11451/11684) Updating files: 99% (11568/11684) Updating files: 100% (11684/11684) Updating files: 100% (11684/11684), done. 2023-01-04T18:15:46.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:44.793881+0000 mgr.smithi050.emnywo (mgr.14162) 249 : audit [DBG] from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:15:46.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:44.793881+0000 mgr.smithi050.emnywo (mgr.14162) 249 : audit [DBG] from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:15:46.452 INFO:tasks.workunit.client.0.smithi050.stderr:Note: switching to 'f2bb1478686242c0f68882a9cf8df4e0f8363116'. 2023-01-04T18:15:46.452 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-01-04T18:15:46.452 INFO:tasks.workunit.client.0.smithi050.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-01-04T18:15:46.452 INFO:tasks.workunit.client.0.smithi050.stderr:changes and commit them, and you can discard any commits you make in this 2023-01-04T18:15:46.452 INFO:tasks.workunit.client.0.smithi050.stderr:state without impacting any branches by switching back to a branch. 2023-01-04T18:15:46.452 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-01-04T18:15:46.452 INFO:tasks.workunit.client.0.smithi050.stderr:If you want to create a new branch to retain commits you create, you may 2023-01-04T18:15:46.453 INFO:tasks.workunit.client.0.smithi050.stderr:do so (now or later) by using -c with the switch command. Example: 2023-01-04T18:15:46.453 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-01-04T18:15:46.453 INFO:tasks.workunit.client.0.smithi050.stderr: git switch -c 2023-01-04T18:15:46.453 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-01-04T18:15:46.453 INFO:tasks.workunit.client.0.smithi050.stderr:Or undo this operation with: 2023-01-04T18:15:46.453 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-01-04T18:15:46.453 INFO:tasks.workunit.client.0.smithi050.stderr: git switch - 2023-01-04T18:15:46.453 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-01-04T18:15:46.453 INFO:tasks.workunit.client.0.smithi050.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-01-04T18:15:46.453 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-01-04T18:15:46.453 INFO:tasks.workunit.client.0.smithi050.stderr:HEAD is now at f2bb1478686 qa: switch back to git protocol for qemu-xfstests 2023-01-04T18:15:46.459 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-01-04T18:15:46.487 INFO:tasks.workunit.client.0.smithi050.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-01-04T18:15:46.489 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-01-04T18:15:46.490 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-01-04T18:15:47.013 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-01-04T18:15:47.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:45.310621+0000 mgr.smithi050.emnywo (mgr.14162) 250 : cluster [DBG] pgmap v196: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2023-01-04T18:15:47.071 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-01-04T18:15:47.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:45.310621+0000 mgr.smithi050.emnywo (mgr.14162) 250 : cluster [DBG] pgmap v196: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2023-01-04T18:15:47.113 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-01-04T18:15:47.115 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-01-04T18:15:47.115 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-01-04T18:15:47.154 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-01-04T18:15:47.157 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-01-04T18:15:47.157 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-01-04T18:15:47.229 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2023-01-04T18:15:47.230 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-01-04T18:15:47.230 DEBUG:teuthology.orchestra.run.smithi050:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f2bb1478686242c0f68882a9cf8df4e0f8363116 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2023-01-04T18:15:47.293 INFO:tasks.workunit.client.0.smithi050.stderr:+ mkdir -p fsstress 2023-01-04T18:15:47.295 INFO:tasks.workunit.client.0.smithi050.stderr:+ pushd fsstress 2023-01-04T18:15:47.295 INFO:tasks.workunit.client.0.smithi050.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-01-04T18:15:47.296 INFO:tasks.workunit.client.0.smithi050.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-01-04T18:15:49.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:47.311050+0000 mgr.smithi050.emnywo (mgr.14162) 251 : cluster [DBG] pgmap v197: 65 pgs: 65 active+clean; 4.0 MiB data, 36 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 341 KiB/s wr, 3 op/s 2023-01-04T18:15:49.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:47.311050+0000 mgr.smithi050.emnywo (mgr.14162) 251 : cluster [DBG] pgmap v197: 65 pgs: 65 active+clean; 4.0 MiB data, 36 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 341 KiB/s wr, 3 op/s 2023-01-04T18:15:51.017 INFO:tasks.workunit.client.0.smithi050.stderr:+ tar xzf ltp-full.tgz 2023-01-04T18:15:51.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:49.311554+0000 mgr.smithi050.emnywo (mgr.14162) 252 : cluster [DBG] pgmap v198: 65 pgs: 65 active+clean; 12 MiB data, 77 MiB used, 536 GiB / 536 GiB avail; 604 KiB/s rd, 1.0 MiB/s wr, 67 op/s 2023-01-04T18:15:51.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:49.311554+0000 mgr.smithi050.emnywo (mgr.14162) 252 : cluster [DBG] pgmap v198: 65 pgs: 65 active+clean; 12 MiB data, 77 MiB used, 536 GiB / 536 GiB avail; 604 KiB/s rd, 1.0 MiB/s wr, 67 op/s 2023-01-04T18:15:53.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:51.311970+0000 mgr.smithi050.emnywo (mgr.14162) 253 : cluster [DBG] pgmap v199: 65 pgs: 65 active+clean; 21 MiB data, 120 MiB used, 536 GiB / 536 GiB avail; 751 KiB/s rd, 1.8 MiB/s wr, 176 op/s 2023-01-04T18:15:53.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:51.311970+0000 mgr.smithi050.emnywo (mgr.14162) 253 : cluster [DBG] pgmap v199: 65 pgs: 65 active+clean; 21 MiB data, 120 MiB used, 536 GiB / 536 GiB avail; 751 KiB/s rd, 1.8 MiB/s wr, 176 op/s 2023-01-04T18:15:55.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:53.312451+0000 mgr.smithi050.emnywo (mgr.14162) 254 : cluster [DBG] pgmap v200: 65 pgs: 65 active+clean; 43 MiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 305 op/s 2023-01-04T18:15:55.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:53.312451+0000 mgr.smithi050.emnywo (mgr.14162) 254 : cluster [DBG] pgmap v200: 65 pgs: 65 active+clean; 43 MiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 305 op/s 2023-01-04T18:15:56.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:55.312832+0000 mgr.smithi050.emnywo (mgr.14162) 255 : cluster [DBG] pgmap v201: 65 pgs: 65 active+clean; 56 MiB data, 237 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.9 MiB/s wr, 387 op/s 2023-01-04T18:15:56.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:55.312832+0000 mgr.smithi050.emnywo (mgr.14162) 255 : cluster [DBG] pgmap v201: 65 pgs: 65 active+clean; 56 MiB data, 237 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.9 MiB/s wr, 387 op/s 2023-01-04T18:15:58.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:57.313269+0000 mgr.smithi050.emnywo (mgr.14162) 256 : cluster [DBG] pgmap v202: 65 pgs: 65 active+clean; 78 MiB data, 286 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 6.8 MiB/s wr, 447 op/s 2023-01-04T18:15:58.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:57.313269+0000 mgr.smithi050.emnywo (mgr.14162) 256 : cluster [DBG] pgmap v202: 65 pgs: 65 active+clean; 78 MiB data, 286 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 6.8 MiB/s wr, 447 op/s 2023-01-04T18:15:59.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:15:58.402750+0000 mgr.smithi050.emnywo (mgr.14162) 257 : cephadm [INF] Upgrade: Updating mgr.smithi098.vhfzum 2023-01-04T18:15:59.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:58.408445+0000 mon.smithi050 (mon.0) 556 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:15:59.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:58.410635+0000 mon.smithi050 (mon.0) 557 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.vhfzum", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-01-04T18:15:59.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:58.425504+0000 mon.smithi050 (mon.0) 558 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-01-04T18:15:59.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:15:58.426225+0000 mon.smithi050 (mon.0) 559 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:15:59.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:15:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:15:58.427212+0000 mgr.smithi050.emnywo (mgr.14162) 258 : cephadm [INF] Deploying daemon mgr.smithi098.vhfzum on smithi098 2023-01-04T18:15:59.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:15:58.402750+0000 mgr.smithi050.emnywo (mgr.14162) 257 : cephadm [INF] Upgrade: Updating mgr.smithi098.vhfzum 2023-01-04T18:15:59.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:58.408445+0000 mon.smithi050 (mon.0) 556 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:15:59.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:58.410635+0000 mon.smithi050 (mon.0) 557 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.vhfzum", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-01-04T18:15:59.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:58.425504+0000 mon.smithi050 (mon.0) 558 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-01-04T18:15:59.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:15:58.426225+0000 mon.smithi050 (mon.0) 559 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:15:59.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:15:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:15:58.427212+0000 mgr.smithi050.emnywo (mgr.14162) 258 : cephadm [INF] Deploying daemon mgr.smithi098.vhfzum on smithi098 2023-01-04T18:16:00.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:15:59.313784+0000 mgr.smithi050.emnywo (mgr.14162) 259 : cluster [DBG] pgmap v203: 65 pgs: 65 active+clean; 78 MiB data, 312 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 6.5 MiB/s wr, 452 op/s 2023-01-04T18:16:00.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:15:59.313784+0000 mgr.smithi050.emnywo (mgr.14162) 259 : cluster [DBG] pgmap v203: 65 pgs: 65 active+clean; 78 MiB data, 312 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 6.5 MiB/s wr, 452 op/s 2023-01-04T18:16:02.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:01.220256+0000 mon.smithi050 (mon.0) 560 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:16:02.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:01.220998+0000 mon.smithi050 (mon.0) 561 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:16:02.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:01.314163+0000 mgr.smithi050.emnywo (mgr.14162) 260 : cluster [DBG] pgmap v204: 65 pgs: 65 active+clean; 81 MiB data, 329 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 6.0 MiB/s wr, 388 op/s 2023-01-04T18:16:02.564 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:01.220256+0000 mon.smithi050 (mon.0) 560 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:16:02.564 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:01.220998+0000 mon.smithi050 (mon.0) 561 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:16:02.564 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:01.314163+0000 mgr.smithi050.emnywo (mgr.14162) 260 : cluster [DBG] pgmap v204: 65 pgs: 65 active+clean; 81 MiB data, 329 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 6.0 MiB/s wr, 388 op/s 2023-01-04T18:16:04.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:03.314622+0000 mgr.smithi050.emnywo (mgr.14162) 261 : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 85 MiB data, 345 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 5.6 MiB/s wr, 288 op/s 2023-01-04T18:16:04.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:03.314622+0000 mgr.smithi050.emnywo (mgr.14162) 261 : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 85 MiB data, 345 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 5.6 MiB/s wr, 288 op/s 2023-01-04T18:16:06.253 INFO:tasks.workunit.client.1.smithi098.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-01-04T18:16:06.253 INFO:tasks.workunit.client.1.smithi098.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-01-04T18:16:06.253 INFO:tasks.workunit.client.1.smithi098.stderr:+ make 2023-01-04T18:16:06.452 INFO:tasks.workunit.client.1.smithi098.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-01-04T18:16:06.711 INFO:tasks.workunit.client.1.smithi098.stderr:++ readlink -f fsstress 2023-01-04T18:16:06.711 INFO:tasks.workunit.client.1.smithi098.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-01-04T18:16:06.711 INFO:tasks.workunit.client.1.smithi098.stderr:+ popd 2023-01-04T18:16:06.712 INFO:tasks.workunit.client.1.smithi098.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-01-04T18:16:06.712 INFO:tasks.workunit.client.1.smithi098.stderr:+ popd 2023-01-04T18:16:06.712 INFO:tasks.workunit.client.1.smithi098.stdout:~/cephtest/mnt.1/client.1/tmp 2023-01-04T18:16:06.712 INFO:tasks.workunit.client.1.smithi098.stderr:++ mktemp -d -p . 2023-01-04T18:16:06.714 INFO:tasks.workunit.client.1.smithi098.stderr:+ T=./tmp.iPu29PosZV 2023-01-04T18:16:06.714 INFO:tasks.workunit.client.1.smithi098.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.iPu29PosZV -l 1 -n 1000 -p 10 -v 2023-01-04T18:16:06.715 INFO:tasks.workunit.client.1.smithi098.stdout:seed = 1673471877 2023-01-04T18:16:06.718 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:05.314995+0000 mgr.smithi050.emnywo (mgr.14162) 262 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 93 MiB data, 359 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 229 op/s 2023-01-04T18:16:06.718 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:05.452361+0000 mon.smithi050 (mon.0) 562 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:16:06.718 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:05.843891+0000 mon.smithi050 (mon.0) 563 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:16:06.718 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:05.847734+0000 mon.smithi050 (mon.0) 564 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:16:06.719 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:16:05.848717+0000 mgr.smithi050.emnywo (mgr.14162) 263 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi050.emnywo) 2023-01-04T18:16:06.719 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:16:05.851506+0000 mgr.smithi050.emnywo (mgr.14162) 264 : cephadm [INF] Failing over to other MGR 2023-01-04T18:16:06.719 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:05.851738+0000 mon.smithi050 (mon.0) 565 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mgr fail", "who": "smithi050.emnywo"}]: dispatch 2023-01-04T18:16:06.719 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:05.855130+0000 mon.smithi050 (mon.0) 566 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2023-01-04T18:16:06.720 INFO:tasks.workunit.client.1.smithi098.stdout:1/0: dread - no filename 2023-01-04T18:16:06.721 INFO:tasks.workunit.client.1.smithi098.stdout:0/0: creat f0 x:0 0 0 2023-01-04T18:16:06.721 INFO:tasks.workunit.client.1.smithi098.stdout:0/1: truncate f0 602356 0 2023-01-04T18:16:06.724 INFO:tasks.workunit.client.1.smithi098.stdout:1/1: creat f0 x:0 0 0 2023-01-04T18:16:06.724 INFO:tasks.workunit.client.1.smithi098.stdout:1/2: rmdir - no directory 2023-01-04T18:16:06.725 INFO:tasks.workunit.client.1.smithi098.stdout:0/2: creat f1 x:0 0 0 2023-01-04T18:16:06.726 INFO:tasks.workunit.client.1.smithi098.stdout:3/0: rmdir - no directory 2023-01-04T18:16:06.726 INFO:tasks.workunit.client.1.smithi098.stdout:3/1: write - no filename 2023-01-04T18:16:06.727 INFO:tasks.workunit.client.1.smithi098.stdout:2/0: mknod c0 0 2023-01-04T18:16:06.727 INFO:tasks.workunit.client.1.smithi098.stdout:2/1: dwrite - no filename 2023-01-04T18:16:06.727 INFO:tasks.workunit.client.1.smithi098.stdout:2/2: truncate - no filename 2023-01-04T18:16:06.727 INFO:tasks.workunit.client.1.smithi098.stdout:2/3: readlink - no filename 2023-01-04T18:16:06.727 INFO:tasks.workunit.client.1.smithi098.stdout:2/4: readlink - no filename 2023-01-04T18:16:06.727 INFO:tasks.workunit.client.1.smithi098.stdout:2/5: rmdir - no directory 2023-01-04T18:16:06.728 INFO:tasks.workunit.client.1.smithi098.stdout:1/3: mkdir d1 0 2023-01-04T18:16:06.729 INFO:tasks.workunit.client.1.smithi098.stdout:0/3: symlink l2 0 2023-01-04T18:16:06.730 INFO:tasks.workunit.client.1.smithi098.stdout:4/0: truncate - no filename 2023-01-04T18:16:06.731 INFO:tasks.workunit.client.1.smithi098.stdout:3/2: symlink l0 0 2023-01-04T18:16:06.731 INFO:tasks.workunit.client.1.smithi098.stdout:3/3: write - no filename 2023-01-04T18:16:06.732 INFO:tasks.workunit.client.1.smithi098.stdout:3/4: rmdir - no directory 2023-01-04T18:16:06.733 INFO:tasks.workunit.client.1.smithi098.stdout:2/6: rename c0 to c1 0 2023-01-04T18:16:06.733 INFO:tasks.workunit.client.1.smithi098.stdout:2/7: write - no filename 2023-01-04T18:16:06.733 INFO:tasks.workunit.client.1.smithi098.stdout:2/8: chown c1 36 1 2023-01-04T18:16:06.734 INFO:tasks.workunit.client.1.smithi098.stdout:0/4: creat f3 x:0 0 0 2023-01-04T18:16:06.734 INFO:tasks.workunit.client.1.smithi098.stdout:0/5: readlink l2 0 2023-01-04T18:16:06.734 INFO:tasks.workunit.client.1.smithi098.stdout:0/6: dread - f3 zero size 2023-01-04T18:16:06.734 INFO:tasks.workunit.client.1.smithi098.stdout:0/7: dread - f3 zero size 2023-01-04T18:16:06.734 INFO:tasks.workunit.client.1.smithi098.stdout:0/8: chown f3 95483088 1 2023-01-04T18:16:06.735 INFO:tasks.workunit.client.1.smithi098.stdout:0/9: dread - f3 zero size 2023-01-04T18:16:06.735 INFO:tasks.workunit.client.1.smithi098.stdout:5/0: chown . 3122 1 2023-01-04T18:16:06.735 INFO:tasks.workunit.client.1.smithi098.stdout:5/1: stat - no entries 2023-01-04T18:16:06.735 INFO:tasks.workunit.client.1.smithi098.stdout:5/2: truncate - no filename 2023-01-04T18:16:06.735 INFO:tasks.workunit.client.1.smithi098.stdout:5/3: dwrite - no filename 2023-01-04T18:16:06.735 INFO:tasks.workunit.client.1.smithi098.stdout:5/4: write - no filename 2023-01-04T18:16:06.736 INFO:tasks.workunit.client.1.smithi098.stdout:5/5: dread - no filename 2023-01-04T18:16:06.738 INFO:tasks.workunit.client.1.smithi098.stdout:3/5: creat f1 x:0 0 0 2023-01-04T18:16:06.738 INFO:tasks.workunit.client.1.smithi098.stdout:3/6: truncate f1 960483 0 2023-01-04T18:16:06.739 INFO:tasks.workunit.client.1.smithi098.stdout:2/9: creat f2 x:0 0 0 2023-01-04T18:16:06.739 INFO:tasks.workunit.client.1.smithi098.stdout:2/10: chown c1 287378 1 2023-01-04T18:16:06.740 INFO:tasks.workunit.client.1.smithi098.stdout:0/10: mknod c4 0 2023-01-04T18:16:06.743 INFO:tasks.workunit.client.1.smithi098.stdout:0/11: creat f5 x:0 0 0 2023-01-04T18:16:06.743 INFO:tasks.workunit.client.1.smithi098.stdout:6/0: link - no file 2023-01-04T18:16:06.743 INFO:tasks.workunit.client.1.smithi098.stdout:6/1: write - no filename 2023-01-04T18:16:06.743 INFO:tasks.workunit.client.1.smithi098.stdout:6/2: read - no filename 2023-01-04T18:16:06.744 INFO:tasks.workunit.client.1.smithi098.stdout:6/3: write - no filename 2023-01-04T18:16:06.744 INFO:tasks.workunit.client.1.smithi098.stdout:6/4: chown . 21065 1 2023-01-04T18:16:06.744 INFO:tasks.workunit.client.1.smithi098.stdout:6/5: dread - no filename 2023-01-04T18:16:06.749 INFO:tasks.workunit.client.1.smithi098.stdout:0/12: symlink l6 0 2023-01-04T18:16:06.749 INFO:tasks.workunit.client.1.smithi098.stdout:0/13: dread - f3 zero size 2023-01-04T18:16:06.760 INFO:tasks.workunit.client.1.smithi098.stdout:7/0: mknod c0 0 2023-01-04T18:16:06.760 INFO:tasks.workunit.client.1.smithi098.stdout:6/6: symlink l0 0 2023-01-04T18:16:06.764 INFO:tasks.workunit.client.1.smithi098.stdout:0/14: symlink l7 0 2023-01-04T18:16:06.765 INFO:tasks.workunit.client.1.smithi098.stdout:8/0: dread - no filename 2023-01-04T18:16:06.766 INFO:tasks.workunit.client.1.smithi098.stdout:7/1: mkdir d1 0 2023-01-04T18:16:06.766 INFO:tasks.workunit.client.1.smithi098.stdout:7/2: write - no filename 2023-01-04T18:16:06.766 INFO:tasks.workunit.client.1.smithi098.stdout:7/3: write - no filename 2023-01-04T18:16:06.767 INFO:tasks.workunit.client.1.smithi098.stdout:7/4: fdatasync - no filename 2023-01-04T18:16:06.767 INFO:tasks.workunit.client.1.smithi098.stdout:7/5: getdents d1 0 2023-01-04T18:16:06.778 INFO:tasks.workunit.client.1.smithi098.stdout:6/7: link l0 l1 0 2023-01-04T18:16:06.780 INFO:tasks.workunit.client.1.smithi098.stdout:8/1: mknod c0 0 2023-01-04T18:16:06.780 INFO:tasks.workunit.client.1.smithi098.stdout:8/2: dread - no filename 2023-01-04T18:16:06.781 INFO:tasks.workunit.client.1.smithi098.stdout:8/3: write - no filename 2023-01-04T18:16:06.781 INFO:tasks.workunit.client.1.smithi098.stdout:8/4: dread - no filename 2023-01-04T18:16:06.781 INFO:tasks.workunit.client.1.smithi098.stdout:9/0: dwrite - no filename 2023-01-04T18:16:06.781 INFO:tasks.workunit.client.1.smithi098.stdout:9/1: stat - no entries 2023-01-04T18:16:06.781 INFO:tasks.workunit.client.1.smithi098.stdout:9/2: rename - no filename 2023-01-04T18:16:06.781 INFO:tasks.workunit.client.1.smithi098.stdout:9/3: write - no filename 2023-01-04T18:16:06.781 INFO:tasks.workunit.client.1.smithi098.stdout:9/4: chown . 8056771 1 2023-01-04T18:16:06.787 INFO:tasks.workunit.client.1.smithi098.stdout:0/15: mknod c8 0 2023-01-04T18:16:06.787 INFO:tasks.workunit.client.1.smithi098.stdout:7/6: creat d1/f2 x:0 0 0 2023-01-04T18:16:06.789 INFO:tasks.workunit.client.1.smithi098.stdout:6/8: stat l1 0 2023-01-04T18:16:06.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:05.314995+0000 mgr.smithi050.emnywo (mgr.14162) 262 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 93 MiB data, 359 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 229 op/s 2023-01-04T18:16:06.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:05.452361+0000 mon.smithi050 (mon.0) 562 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:16:06.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:05.843891+0000 mon.smithi050 (mon.0) 563 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' 2023-01-04T18:16:06.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:05.847734+0000 mon.smithi050 (mon.0) 564 : audit [DBG] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:16:06.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:16:05.848717+0000 mgr.smithi050.emnywo (mgr.14162) 263 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi050.emnywo) 2023-01-04T18:16:06.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:16:05.851506+0000 mgr.smithi050.emnywo (mgr.14162) 264 : cephadm [INF] Failing over to other MGR 2023-01-04T18:16:06.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:05.851738+0000 mon.smithi050 (mon.0) 565 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mgr fail", "who": "smithi050.emnywo"}]: dispatch 2023-01-04T18:16:06.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:05.855130+0000 mon.smithi050 (mon.0) 566 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2023-01-04T18:16:06.792 INFO:tasks.workunit.client.1.smithi098.stdout:8/5: unlink c0 0 2023-01-04T18:16:06.801 INFO:tasks.workunit.client.1.smithi098.stdout:9/5: creat f0 x:0 0 0 2023-01-04T18:16:06.801 INFO:tasks.workunit.client.1.smithi098.stdout:9/6: chown f0 3226 1 2023-01-04T18:16:06.806 INFO:tasks.workunit.client.1.smithi098.stdout:7/7: mkdir d1/d3 0 2023-01-04T18:16:06.807 INFO:tasks.workunit.client.1.smithi098.stdout:8/6: creat f1 x:0 0 0 2023-01-04T18:16:06.807 INFO:tasks.workunit.client.1.smithi098.stdout:8/7: dread - f1 zero size 2023-01-04T18:16:06.813 INFO:tasks.workunit.client.1.smithi098.stdout:7/8: rename d1/d3 to d1/d4 0 2023-01-04T18:16:06.813 INFO:tasks.workunit.client.1.smithi098.stdout:7/9: write d1/f2 [167852,106526] 0 2023-01-04T18:16:06.813 INFO:tasks.workunit.client.1.smithi098.stdout:9/7: link f0 f1 0 2023-01-04T18:16:06.813 INFO:tasks.workunit.client.1.smithi098.stdout:9/8: readlink - no filename 2023-01-04T18:16:06.815 INFO:tasks.workunit.client.1.smithi098.stdout:8/8: rename f1 to f2 0 2023-01-04T18:16:06.815 INFO:tasks.workunit.client.1.smithi098.stdout:8/9: dread - f2 zero size 2023-01-04T18:16:06.815 INFO:tasks.workunit.client.1.smithi098.stdout:8/10: write f2 [231484,62312] 0 2023-01-04T18:16:06.815 INFO:tasks.workunit.client.1.smithi098.stdout:8/11: chown f2 77 1 2023-01-04T18:16:07.105 INFO:tasks.workunit.client.1.smithi098.stdout:2/11: dwrite f2 [0,4194304] 0 2023-01-04T18:16:07.233 INFO:tasks.workunit.client.1.smithi098.stdout:3/7: dwrite f1 [0,4194304] 0 2023-01-04T18:16:07.233 INFO:tasks.workunit.client.1.smithi098.stdout:3/8: stat f1 0 2023-01-04T18:16:07.849 INFO:tasks.workunit.client.1.smithi098.stdout:3/9: write f1 [467680,125787] 0 2023-01-04T18:16:07.923 INFO:tasks.workunit.client.1.smithi098.stdout:2/12: dwrite f2 [0,4194304] 0 2023-01-04T18:16:07.932 INFO:tasks.workunit.client.1.smithi098.stdout:0/16: dwrite f5 [0,4194304] 0 2023-01-04T18:16:07.983 INFO:tasks.workunit.client.1.smithi098.stdout:0/17: dwrite f3 [0,4194304] 0 2023-01-04T18:16:08.013 INFO:tasks.workunit.client.1.smithi098.stdout:8/12: write f2 [203759,26578] 0 2023-01-04T18:16:08.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:06.864134+0000 mon.smithi050 (mon.0) 567 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "mgr fail", "who": "smithi050.emnywo"}]': finished 2023-01-04T18:16:08.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:06.864223+0000 mon.smithi050 (mon.0) 568 : cluster [DBG] Standby manager daemon smithi050.emnywo started 2023-01-04T18:16:08.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:06.864432+0000 mon.smithi050 (mon.0) 569 : cluster [DBG] mgrmap e19: smithi098.vhfzum(active, starting, since 1.01216s) 2023-01-04T18:16:08.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:07.712333+0000 mon.smithi050 (mon.0) 570 : cluster [INF] Active manager daemon smithi098.vhfzum restarted 2023-01-04T18:16:08.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:07.712816+0000 mon.smithi098 (mon.1) 17 : audit [DBG] from='mgr.? 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.vhfzum/crt"}]: dispatch 2023-01-04T18:16:08.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:07.713584+0000 mon.smithi050 (mon.0) 571 : cluster [INF] Activating manager daemon smithi098.vhfzum 2023-01-04T18:16:08.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:07.716930+0000 mon.smithi098 (mon.1) 18 : audit [DBG] from='mgr.? 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-01-04T18:16:08.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:07.722818+0000 mon.smithi050 (mon.0) 572 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2023-01-04T18:16:08.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:07.735197+0000 mon.smithi098 (mon.1) 19 : audit [DBG] from='mgr.? 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.vhfzum/key"}]: dispatch 2023-01-04T18:16:08.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:07.735789+0000 mon.smithi098 (mon.1) 20 : audit [DBG] from='mgr.? 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-01-04T18:16:08.174 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:06.864134+0000 mon.smithi050 (mon.0) 567 : audit [INF] from='mgr.14162 172.21.15.50:0/1287672645' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "mgr fail", "who": "smithi050.emnywo"}]': finished 2023-01-04T18:16:08.174 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:06.864223+0000 mon.smithi050 (mon.0) 568 : cluster [DBG] Standby manager daemon smithi050.emnywo started 2023-01-04T18:16:08.174 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:06.864432+0000 mon.smithi050 (mon.0) 569 : cluster [DBG] mgrmap e19: smithi098.vhfzum(active, starting, since 1.01216s) 2023-01-04T18:16:08.174 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:07.712333+0000 mon.smithi050 (mon.0) 570 : cluster [INF] Active manager daemon smithi098.vhfzum restarted 2023-01-04T18:16:08.174 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:07.712816+0000 mon.smithi098 (mon.1) 17 : audit [DBG] from='mgr.? 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.vhfzum/crt"}]: dispatch 2023-01-04T18:16:08.174 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:07.713584+0000 mon.smithi050 (mon.0) 571 : cluster [INF] Activating manager daemon smithi098.vhfzum 2023-01-04T18:16:08.174 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:07.716930+0000 mon.smithi098 (mon.1) 18 : audit [DBG] from='mgr.? 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-01-04T18:16:08.175 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:07.722818+0000 mon.smithi050 (mon.0) 572 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2023-01-04T18:16:08.175 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:07.735197+0000 mon.smithi098 (mon.1) 19 : audit [DBG] from='mgr.? 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.vhfzum/key"}]: dispatch 2023-01-04T18:16:08.175 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:07.735789+0000 mon.smithi098 (mon.1) 20 : audit [DBG] from='mgr.? 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-01-04T18:16:08.215 INFO:tasks.workunit.client.1.smithi098.stdout:9/9: getdents . 0 2023-01-04T18:16:08.215 INFO:tasks.workunit.client.1.smithi098.stdout:9/10: write f1 [785591,125437] 0 2023-01-04T18:16:08.250 INFO:tasks.workunit.client.1.smithi098.stdout:7/10: dwrite d1/f2 [0,4194304] 0 2023-01-04T18:16:08.250 INFO:tasks.workunit.client.1.smithi098.stdout:7/11: truncate d1/f2 4543914 0 2023-01-04T18:16:09.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:07.893895+0000 mon.smithi050 (mon.0) 573 : cluster [DBG] mgrmap e20: smithi098.vhfzum(active, starting, since 0.18055s), standbys: smithi050.emnywo 2023-01-04T18:16:09.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:07.899720+0000 mon.smithi098 (mon.1) 21 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mon metadata", "id": "smithi050"}]: dispatch 2023-01-04T18:16:09.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:07.899852+0000 mon.smithi098 (mon.1) 22 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2023-01-04T18:16:09.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:07.900970+0000 mon.smithi098 (mon.1) 23 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi050.ezoiwl"}]: dispatch 2023-01-04T18:16:09.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:07.901180+0000 mon.smithi098 (mon.1) 24 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi050.kefmuy"}]: dispatch 2023-01-04T18:16:09.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:07.901332+0000 mon.smithi098 (mon.1) 25 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.memais"}]: dispatch 2023-01-04T18:16:09.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:07.901430+0000 mon.smithi098 (mon.1) 26 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.laynsk"}]: dispatch 2023-01-04T18:16:09.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:07.905094+0000 mon.smithi098 (mon.1) 27 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mgr metadata", "who": "smithi098.vhfzum", "id": "smithi098.vhfzum"}]: dispatch 2023-01-04T18:16:09.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:07.905289+0000 mon.smithi098 (mon.1) 28 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mgr metadata", "who": "smithi050.emnywo", "id": "smithi050.emnywo"}]: dispatch 2023-01-04T18:16:09.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:07.905436+0000 mon.smithi098 (mon.1) 29 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-01-04T18:16:09.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:07.905628+0000 mon.smithi098 (mon.1) 30 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-01-04T18:16:09.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:07.905784+0000 mon.smithi098 (mon.1) 31 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-01-04T18:16:09.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:07.905974+0000 mon.smithi098 (mon.1) 32 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:16:09.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:07.906121+0000 mon.smithi098 (mon.1) 33 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-01-04T18:16:09.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:07.906287+0000 mon.smithi098 (mon.1) 34 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-01-04T18:16:09.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:07.909691+0000 mon.smithi098 (mon.1) 35 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-01-04T18:16:09.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:07.910055+0000 mon.smithi098 (mon.1) 36 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-01-04T18:16:09.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:07.910512+0000 mon.smithi098 (mon.1) 37 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-01-04T18:16:09.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:07.948015+0000 mon.smithi050 (mon.0) 574 : cluster [INF] Manager daemon smithi098.vhfzum is now available 2023-01-04T18:16:09.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:08.107260+0000 mon.smithi098 (mon.1) 38 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:16:09.293 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:08.108946+0000 mon.smithi098 (mon.1) 39 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:16:09.293 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:08.132538+0000 mon.smithi050 (mon.0) 575 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:16:09.293 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:08.160245+0000 mon.smithi050 (mon.0) 576 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:16:09.293 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:08.165218+0000 mon.smithi098 (mon.1) 40 : audit [INF] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.vhfzum/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:16:09.293 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:08.171675+0000 mon.smithi050 (mon.0) 577 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.vhfzum/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:16:09.293 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:08.175565+0000 mon.smithi098 (mon.1) 41 : audit [INF] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.vhfzum/trash_purge_schedule"}]: dispatch 2023-01-04T18:16:09.293 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:08.178718+0000 mon.smithi050 (mon.0) 578 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.vhfzum/trash_purge_schedule"}]: dispatch 2023-01-04T18:16:09.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:07.893895+0000 mon.smithi050 (mon.0) 573 : cluster [DBG] mgrmap e20: smithi098.vhfzum(active, starting, since 0.18055s), standbys: smithi050.emnywo 2023-01-04T18:16:09.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:07.899720+0000 mon.smithi098 (mon.1) 21 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mon metadata", "id": "smithi050"}]: dispatch 2023-01-04T18:16:09.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:07.899852+0000 mon.smithi098 (mon.1) 22 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2023-01-04T18:16:09.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:07.900970+0000 mon.smithi098 (mon.1) 23 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi050.ezoiwl"}]: dispatch 2023-01-04T18:16:09.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:07.901180+0000 mon.smithi098 (mon.1) 24 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi050.kefmuy"}]: dispatch 2023-01-04T18:16:09.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:07.901332+0000 mon.smithi098 (mon.1) 25 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.memais"}]: dispatch 2023-01-04T18:16:09.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:07.901430+0000 mon.smithi098 (mon.1) 26 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.laynsk"}]: dispatch 2023-01-04T18:16:09.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:07.905094+0000 mon.smithi098 (mon.1) 27 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mgr metadata", "who": "smithi098.vhfzum", "id": "smithi098.vhfzum"}]: dispatch 2023-01-04T18:16:09.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:07.905289+0000 mon.smithi098 (mon.1) 28 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mgr metadata", "who": "smithi050.emnywo", "id": "smithi050.emnywo"}]: dispatch 2023-01-04T18:16:09.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:07.905436+0000 mon.smithi098 (mon.1) 29 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-01-04T18:16:09.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:07.905628+0000 mon.smithi098 (mon.1) 30 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-01-04T18:16:09.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:07.905784+0000 mon.smithi098 (mon.1) 31 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-01-04T18:16:09.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:07.905974+0000 mon.smithi098 (mon.1) 32 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:16:09.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:07.906121+0000 mon.smithi098 (mon.1) 33 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-01-04T18:16:09.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:07.906287+0000 mon.smithi098 (mon.1) 34 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-01-04T18:16:09.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:07.909691+0000 mon.smithi098 (mon.1) 35 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-01-04T18:16:09.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:07.910055+0000 mon.smithi098 (mon.1) 36 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-01-04T18:16:09.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:07.910512+0000 mon.smithi098 (mon.1) 37 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-01-04T18:16:09.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:07.948015+0000 mon.smithi050 (mon.0) 574 : cluster [INF] Manager daemon smithi098.vhfzum is now available 2023-01-04T18:16:09.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:08.107260+0000 mon.smithi098 (mon.1) 38 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:16:09.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:08.108946+0000 mon.smithi098 (mon.1) 39 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:16:09.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:08.132538+0000 mon.smithi050 (mon.0) 575 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:16:09.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:08.160245+0000 mon.smithi050 (mon.0) 576 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:16:09.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:08.165218+0000 mon.smithi098 (mon.1) 40 : audit [INF] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.vhfzum/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:16:09.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:08.171675+0000 mon.smithi050 (mon.0) 577 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.vhfzum/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:16:09.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:08.175565+0000 mon.smithi098 (mon.1) 41 : audit [INF] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.vhfzum/trash_purge_schedule"}]: dispatch 2023-01-04T18:16:09.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:08.178718+0000 mon.smithi050 (mon.0) 578 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.vhfzum/trash_purge_schedule"}]: dispatch 2023-01-04T18:16:10.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:09 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:08.898527+0000 mon.smithi050 (mon.0) 579 : cluster [DBG] mgrmap e21: smithi098.vhfzum(active, since 1.18518s), standbys: smithi050.emnywo 2023-01-04T18:16:10.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:09 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:08.911518+0000 mgr.smithi098.vhfzum (mgr.24455) 1 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 180 MiB data, 769 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:16:10.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:09 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:08.898527+0000 mon.smithi050 (mon.0) 579 : cluster [DBG] mgrmap e21: smithi098.vhfzum(active, since 1.18518s), standbys: smithi050.emnywo 2023-01-04T18:16:10.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:09 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:08.911518+0000 mgr.smithi098.vhfzum (mgr.24455) 1 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 180 MiB data, 769 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:16:11.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:09.908121+0000 mgr.smithi098.vhfzum (mgr.24455) 2 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 180 MiB data, 769 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:16:11.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:09.908383+0000 mon.smithi050 (mon.0) 580 : cluster [DBG] mgrmap e22: smithi098.vhfzum(active, since 2s), standbys: smithi050.emnywo 2023-01-04T18:16:11.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:09.908121+0000 mgr.smithi098.vhfzum (mgr.24455) 2 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 180 MiB data, 769 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:16:11.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:09.908383+0000 mon.smithi050 (mon.0) 580 : cluster [DBG] mgrmap e22: smithi098.vhfzum(active, since 2s), standbys: smithi050.emnywo 2023-01-04T18:16:12.825 INFO:tasks.workunit.client.1.smithi098.stdout:3/10: symlink l2 0 2023-01-04T18:16:12.828 INFO:tasks.workunit.client.1.smithi098.stdout:3/11: fdatasync f1 0 2023-01-04T18:16:12.828 INFO:tasks.workunit.client.1.smithi098.stdout:3/12: chown l2 163535 1 2023-01-04T18:16:13.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:11.908538+0000 mgr.smithi098.vhfzum (mgr.24455) 3 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 180 MiB data, 769 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:16:13.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:11.908538+0000 mgr.smithi098.vhfzum (mgr.24455) 3 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 180 MiB data, 769 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:16:13.929 INFO:tasks.workunit.client.1.smithi098.stdout:2/13: creat f3 x:0 0 0 2023-01-04T18:16:14.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:13.403003+0000 mon.smithi050 (mon.0) 581 : cluster [DBG] Standby manager daemon smithi050.emnywo restarted 2023-01-04T18:16:14.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:13.403121+0000 mon.smithi050 (mon.0) 582 : cluster [DBG] Standby manager daemon smithi050.emnywo started 2023-01-04T18:16:14.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:13.409011+0000 mon.smithi098 (mon.1) 42 : audit [DBG] from='mgr.? 172.21.15.50:0/1937014347' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi050.emnywo/crt"}]: dispatch 2023-01-04T18:16:14.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:13.409450+0000 mon.smithi098 (mon.1) 43 : audit [DBG] from='mgr.? 172.21.15.50:0/1937014347' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-01-04T18:16:14.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:13.410722+0000 mon.smithi098 (mon.1) 44 : audit [DBG] from='mgr.? 172.21.15.50:0/1937014347' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi050.emnywo/key"}]: dispatch 2023-01-04T18:16:14.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:13.411067+0000 mon.smithi098 (mon.1) 45 : audit [DBG] from='mgr.? 172.21.15.50:0/1937014347' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-01-04T18:16:14.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:13.403003+0000 mon.smithi050 (mon.0) 581 : cluster [DBG] Standby manager daemon smithi050.emnywo restarted 2023-01-04T18:16:14.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:13.403121+0000 mon.smithi050 (mon.0) 582 : cluster [DBG] Standby manager daemon smithi050.emnywo started 2023-01-04T18:16:14.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:13.409011+0000 mon.smithi098 (mon.1) 42 : audit [DBG] from='mgr.? 172.21.15.50:0/1937014347' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi050.emnywo/crt"}]: dispatch 2023-01-04T18:16:14.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:13.409450+0000 mon.smithi098 (mon.1) 43 : audit [DBG] from='mgr.? 172.21.15.50:0/1937014347' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-01-04T18:16:14.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:13.410722+0000 mon.smithi098 (mon.1) 44 : audit [DBG] from='mgr.? 172.21.15.50:0/1937014347' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi050.emnywo/key"}]: dispatch 2023-01-04T18:16:14.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:13.411067+0000 mon.smithi098 (mon.1) 45 : audit [DBG] from='mgr.? 172.21.15.50:0/1937014347' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-01-04T18:16:14.353 INFO:tasks.workunit.client.1.smithi098.stdout:0/18: link l7 l9 0 2023-01-04T18:16:14.355 INFO:tasks.workunit.client.1.smithi098.stdout:0/19: write f5 [2653138,89525] 0 2023-01-04T18:16:14.355 INFO:tasks.workunit.client.1.smithi098.stdout:0/20: readlink l2 0 2023-01-04T18:16:14.355 INFO:tasks.workunit.client.1.smithi098.stdout:0/21: write f0 [1070715,68456] 0 2023-01-04T18:16:14.355 INFO:tasks.workunit.client.1.smithi098.stdout:0/22: chown l6 2315 1 2023-01-04T18:16:14.656 INFO:tasks.workunit.client.1.smithi098.stdout:8/13: symlink l3 0 2023-01-04T18:16:14.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.908+0000 7f0de8e4d700 1 -- 172.21.15.50:0/1350599624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0de40f5260 msgr2=0x7f0de40fbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:14.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.908+0000 7f0de8e4d700 1 --2- 172.21.15.50:0/1350599624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0de40f5260 0x7f0de40fbb70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f0dd8004660 tx=0x7f0dd8009b30).stop 2023-01-04T18:16:14.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.908+0000 7f0de8e4d700 1 -- 172.21.15.50:0/1350599624 shutdown_connections 2023-01-04T18:16:14.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.908+0000 7f0de8e4d700 1 --2- 172.21.15.50:0/1350599624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0de40f5260 0x7f0de40fbb70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:14.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.908+0000 7f0de8e4d700 1 --2- 172.21.15.50:0/1350599624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0de40f48c0 0x7f0de40f4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:14.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.908+0000 7f0de8e4d700 1 -- 172.21.15.50:0/1350599624 >> 172.21.15.50:0/1350599624 conn(0x7f0de40f0320 msgr2=0x7f0de40f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:14.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.908+0000 7f0de8e4d700 1 -- 172.21.15.50:0/1350599624 shutdown_connections 2023-01-04T18:16:14.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.908+0000 7f0de8e4d700 1 -- 172.21.15.50:0/1350599624 wait complete. 2023-01-04T18:16:14.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.909+0000 7f0de8e4d700 1 Processor -- start 2023-01-04T18:16:14.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.909+0000 7f0de8e4d700 1 -- start start 2023-01-04T18:16:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.910+0000 7f0de8e4d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0de40f48c0 0x7f0de40f7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.910+0000 7f0de8e4d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0de40f5260 0x7f0de40f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.910+0000 7f0de8e4d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de40f5e70 con 0x7f0de40f5260 2023-01-04T18:16:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.910+0000 7f0de8e4d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de40f5fb0 con 0x7f0de40f48c0 2023-01-04T18:16:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.910+0000 7f0de2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0de40f5260 0x7f0de40f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.910+0000 7f0de2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0de40f5260 0x7f0de40f5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51528/0 (socket says 172.21.15.50:51528) 2023-01-04T18:16:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.910+0000 7f0de2ffd700 1 -- 172.21.15.50:0/1058618199 learned_addr learned my addr 172.21.15.50:0/1058618199 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:16:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.910+0000 7f0de37fe700 1 --2- 172.21.15.50:0/1058618199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0de40f48c0 0x7f0de40f7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.910+0000 7f0de2ffd700 1 -- 172.21.15.50:0/1058618199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0de40f48c0 msgr2=0x7f0de40f7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.910+0000 7f0de2ffd700 1 --2- 172.21.15.50:0/1058618199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0de40f48c0 0x7f0de40f7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.910+0000 7f0de2ffd700 1 -- 172.21.15.50:0/1058618199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd8005040 con 0x7f0de40f5260 2023-01-04T18:16:14.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.911+0000 7f0de2ffd700 1 --2- 172.21.15.50:0/1058618199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0de40f5260 0x7f0de40f5930 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f0dd8004e30 tx=0x7f0dd8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:14.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.911+0000 7f0dcbfff700 1 -- 172.21.15.50:0/1058618199 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dd8018070 con 0x7f0de40f5260 2023-01-04T18:16:14.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.911+0000 7f0dcbfff700 1 -- 172.21.15.50:0/1058618199 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0dd8009630 con 0x7f0de40f5260 2023-01-04T18:16:14.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.911+0000 7f0de8e4d700 1 -- 172.21.15.50:0/1058618199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de40f6200 con 0x7f0de40f5260 2023-01-04T18:16:14.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.911+0000 7f0dcbfff700 1 -- 172.21.15.50:0/1058618199 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dd801c3c0 con 0x7f0de40f5260 2023-01-04T18:16:14.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.911+0000 7f0de8e4d700 1 -- 172.21.15.50:0/1058618199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de40f6760 con 0x7f0de40f5260 2023-01-04T18:16:14.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.912+0000 7f0de8e4d700 1 -- 172.21.15.50:0/1058618199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de4045ad0 con 0x7f0de40f5260 2023-01-04T18:16:14.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.913+0000 7f0dcbfff700 1 -- 172.21.15.50:0/1058618199 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 23) v1 ==== 74625+0+0 (secure 0 0 0) 0x7f0dd801d420 con 0x7f0de40f5260 2023-01-04T18:16:14.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.913+0000 7f0dcbfff700 1 --2- 172.21.15.50:0/1058618199 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f0dcc05e810 0x7f0dcc060cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:14.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.913+0000 7f0dcbfff700 1 -- 172.21.15.50:0/1058618199 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f0dd807aa00 con 0x7f0de40f5260 2023-01-04T18:16:14.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.914+0000 7f0de37fe700 1 --2- 172.21.15.50:0/1058618199 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f0dcc05e810 0x7f0dcc060cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:14.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.914+0000 7f0de37fe700 1 --2- 172.21.15.50:0/1058618199 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f0dcc05e810 0x7f0dcc060cd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f0de40f71f0 tx=0x7f0dd400b040).ready entity=mgr.24455 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:14.921+0000 7f0dcbfff700 1 -- 172.21.15.50:0/1058618199 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161783 (secure 0 0 0) 0x7f0dd804b0f0 con 0x7f0de40f5260 2023-01-04T18:16:15.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.172+0000 7f0de8e4d700 1 -- 172.21.15.50:0/1058618199 --> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0de4057f10 con 0x7f0dcc05e810 2023-01-04T18:16:15.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.174+0000 7f0dcbfff700 1 -- 172.21.15.50:0/1058618199 <== mgr.24455 v2:172.21.15.98:6828/3052541756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f0de4057f10 con 0x7f0dcc05e810 2023-01-04T18:16:15.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.177+0000 7f0de8e4d700 1 -- 172.21.15.50:0/1058618199 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f0dcc05e810 msgr2=0x7f0dcc060cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:15.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.177+0000 7f0de8e4d700 1 --2- 172.21.15.50:0/1058618199 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f0dcc05e810 0x7f0dcc060cd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f0de40f71f0 tx=0x7f0dd400b040).stop 2023-01-04T18:16:15.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.177+0000 7f0de8e4d700 1 -- 172.21.15.50:0/1058618199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0de40f5260 msgr2=0x7f0de40f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:15.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.177+0000 7f0de8e4d700 1 --2- 172.21.15.50:0/1058618199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0de40f5260 0x7f0de40f5930 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f0dd8004e30 tx=0x7f0dd8009b30).stop 2023-01-04T18:16:15.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.177+0000 7f0de8e4d700 1 -- 172.21.15.50:0/1058618199 shutdown_connections 2023-01-04T18:16:15.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.177+0000 7f0de8e4d700 1 --2- 172.21.15.50:0/1058618199 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f0dcc05e810 0x7f0dcc060cd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:15.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.177+0000 7f0de8e4d700 1 --2- 172.21.15.50:0/1058618199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0de40f48c0 0x7f0de40f7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:15.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.177+0000 7f0de8e4d700 1 --2- 172.21.15.50:0/1058618199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0de40f5260 0x7f0de40f5930 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:15.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.177+0000 7f0de8e4d700 1 -- 172.21.15.50:0/1058618199 >> 172.21.15.50:0/1058618199 conn(0x7f0de40f0320 msgr2=0x7f0de40f8370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:15.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.177+0000 7f0de8e4d700 1 -- 172.21.15.50:0/1058618199 shutdown_connections 2023-01-04T18:16:15.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.177+0000 7f0de8e4d700 1 -- 172.21.15.50:0/1058618199 wait complete. 2023-01-04T18:16:15.191 INFO:teuthology.orchestra.run.smithi050.stdout:true 2023-01-04T18:16:15.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:13.908983+0000 mgr.smithi098.vhfzum (mgr.24455) 4 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 188 MiB data, 794 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 32 op/s 2023-01-04T18:16:15.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:13.929489+0000 mon.smithi050 (mon.0) 583 : cluster [DBG] mgrmap e23: smithi098.vhfzum(active, since 6s), standbys: smithi050.emnywo 2023-01-04T18:16:15.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.293+0000 7fe0b98af700 1 -- 172.21.15.50:0/3648827547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0b40f4810 msgr2=0x7fe0b40f4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:15.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.293+0000 7fe0b98af700 1 --2- 172.21.15.50:0/3648827547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0b40f4810 0x7fe0b40f4c30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fe0a4004660 tx=0x7fe0a4009b30).stop 2023-01-04T18:16:15.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.293+0000 7fe0b98af700 1 -- 172.21.15.50:0/3648827547 shutdown_connections 2023-01-04T18:16:15.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.293+0000 7fe0b98af700 1 --2- 172.21.15.50:0/3648827547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0b40f51b0 0x7fe0b40f7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:15.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.293+0000 7fe0b98af700 1 --2- 172.21.15.50:0/3648827547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0b40f4810 0x7fe0b40f4c30 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:15.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.293+0000 7fe0b98af700 1 -- 172.21.15.50:0/3648827547 >> 172.21.15.50:0/3648827547 conn(0x7fe0b40f0330 msgr2=0x7fe0b40f2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:15.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.293+0000 7fe0b98af700 1 -- 172.21.15.50:0/3648827547 shutdown_connections 2023-01-04T18:16:15.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.293+0000 7fe0b98af700 1 -- 172.21.15.50:0/3648827547 wait complete. 2023-01-04T18:16:15.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.294+0000 7fe0b98af700 1 Processor -- start 2023-01-04T18:16:15.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.294+0000 7fe0b98af700 1 -- start start 2023-01-04T18:16:15.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.295+0000 7fe0b98af700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0b40f4810 0x7fe0b4106e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:15.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.295+0000 7fe0b98af700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0b40f51b0 0x7fe0b4107320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:15.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.295+0000 7fe0b98af700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b4107920 con 0x7fe0b40f4810 2023-01-04T18:16:15.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.295+0000 7fe0b98af700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b4108130 con 0x7fe0b40f51b0 2023-01-04T18:16:15.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.295+0000 7fe0b2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0b40f4810 0x7fe0b4106e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:15.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.295+0000 7fe0b2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0b40f4810 0x7fe0b4106e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51548/0 (socket says 172.21.15.50:51548) 2023-01-04T18:16:15.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.295+0000 7fe0b2ffd700 1 -- 172.21.15.50:0/2042188056 learned_addr learned my addr 172.21.15.50:0/2042188056 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:16:15.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.295+0000 7fe0b27fc700 1 --2- 172.21.15.50:0/2042188056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0b40f51b0 0x7fe0b4107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:15.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.295+0000 7fe0b2ffd700 1 -- 172.21.15.50:0/2042188056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0b40f51b0 msgr2=0x7fe0b4107320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:15.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.295+0000 7fe0b2ffd700 1 --2- 172.21.15.50:0/2042188056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0b40f51b0 0x7fe0b4107320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:15.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.295+0000 7fe0b2ffd700 1 -- 172.21.15.50:0/2042188056 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a4005040 con 0x7fe0b40f4810 2023-01-04T18:16:15.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.295+0000 7fe0b2ffd700 1 --2- 172.21.15.50:0/2042188056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0b40f4810 0x7fe0b4106e30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fe0a4009f50 tx=0x7fe0a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:15.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.295+0000 7fe09b7fe700 1 -- 172.21.15.50:0/2042188056 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0a4018070 con 0x7fe0b40f4810 2023-01-04T18:16:15.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.296+0000 7fe0b98af700 1 -- 172.21.15.50:0/2042188056 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b4108350 con 0x7fe0b40f4810 2023-01-04T18:16:15.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.296+0000 7fe09b7fe700 1 -- 172.21.15.50:0/2042188056 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe0a401d8e0 con 0x7fe0b40f4810 2023-01-04T18:16:15.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.296+0000 7fe09b7fe700 1 -- 172.21.15.50:0/2042188056 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0a401c440 con 0x7fe0b40f4810 2023-01-04T18:16:15.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.296+0000 7fe0b98af700 1 -- 172.21.15.50:0/2042188056 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b41088b0 con 0x7fe0b40f4810 2023-01-04T18:16:15.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.297+0000 7fe0b98af700 1 -- 172.21.15.50:0/2042188056 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe094004fa0 con 0x7fe0b40f4810 2023-01-04T18:16:15.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.297+0000 7fe09b7fe700 1 -- 172.21.15.50:0/2042188056 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 23) v1 ==== 74625+0+0 (secure 0 0 0) 0x7fe0a401d420 con 0x7fe0b40f4810 2023-01-04T18:16:15.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.297+0000 7fe09b7fe700 1 --2- 172.21.15.50:0/2042188056 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fe09c05e810 0x7fe09c060cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:15.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.297+0000 7fe09b7fe700 1 -- 172.21.15.50:0/2042188056 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fe0a407abf0 con 0x7fe0b40f4810 2023-01-04T18:16:15.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.298+0000 7fe0b27fc700 1 --2- 172.21.15.50:0/2042188056 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fe09c05e810 0x7fe09c060cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:15.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.298+0000 7fe0b27fc700 1 --2- 172.21.15.50:0/2042188056 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fe09c05e810 0x7fe09c060cd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fe0a8007fd0 tx=0x7fe0a8009040).ready entity=mgr.24455 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:15.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.306+0000 7fe09b7fe700 1 -- 172.21.15.50:0/2042188056 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161783 (secure 0 0 0) 0x7fe0a404b2e0 con 0x7fe0b40f4810 2023-01-04T18:16:15.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:13.908983+0000 mgr.smithi098.vhfzum (mgr.24455) 4 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 188 MiB data, 794 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 32 op/s 2023-01-04T18:16:15.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:13.929489+0000 mon.smithi050 (mon.0) 583 : cluster [DBG] mgrmap e23: smithi098.vhfzum(active, since 6s), standbys: smithi050.emnywo 2023-01-04T18:16:15.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.518+0000 7fe0b98af700 1 -- 172.21.15.50:0/2042188056 --> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe094000bc0 con 0x7fe09c05e810 2023-01-04T18:16:15.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.520+0000 7fe09b7fe700 1 -- 172.21.15.50:0/2042188056 <== mgr.24455 v2:172.21.15.98:6828/3052541756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fe094000bc0 con 0x7fe09c05e810 2023-01-04T18:16:15.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.522+0000 7fe0b98af700 1 -- 172.21.15.50:0/2042188056 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fe09c05e810 msgr2=0x7fe09c060cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:15.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.522+0000 7fe0b98af700 1 --2- 172.21.15.50:0/2042188056 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fe09c05e810 0x7fe09c060cd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fe0a8007fd0 tx=0x7fe0a8009040).stop 2023-01-04T18:16:15.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.522+0000 7fe0b98af700 1 -- 172.21.15.50:0/2042188056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0b40f4810 msgr2=0x7fe0b4106e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:15.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.522+0000 7fe0b98af700 1 --2- 172.21.15.50:0/2042188056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0b40f4810 0x7fe0b4106e30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fe0a4009f50 tx=0x7fe0a4009b30).stop 2023-01-04T18:16:15.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.522+0000 7fe0b98af700 1 -- 172.21.15.50:0/2042188056 shutdown_connections 2023-01-04T18:16:15.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.522+0000 7fe0b98af700 1 --2- 172.21.15.50:0/2042188056 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fe09c05e810 0x7fe09c060cd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:15.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.522+0000 7fe0b98af700 1 --2- 172.21.15.50:0/2042188056 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0b40f4810 0x7fe0b4106e30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:15.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.522+0000 7fe0b98af700 1 --2- 172.21.15.50:0/2042188056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0b40f51b0 0x7fe0b4107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:15.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.522+0000 7fe0b98af700 1 -- 172.21.15.50:0/2042188056 >> 172.21.15.50:0/2042188056 conn(0x7fe0b40f0330 msgr2=0x7fe0b40fb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:15.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.522+0000 7fe0b98af700 1 -- 172.21.15.50:0/2042188056 shutdown_connections 2023-01-04T18:16:15.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.522+0000 7fe0b98af700 1 -- 172.21.15.50:0/2042188056 wait complete. 2023-01-04T18:16:15.581 INFO:tasks.workunit.client.1.smithi098.stdout:9/11: mkdir d2 0 2023-01-04T18:16:15.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.656+0000 7f78b69c2700 1 -- 172.21.15.50:0/3193517889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b00f66e0 msgr2=0x7f78b00f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:15.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.656+0000 7f78b69c2700 1 --2- 172.21.15.50:0/3193517889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b00f66e0 0x7f78b00f6b40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f78a0004660 tx=0x7f78a0009b30).stop 2023-01-04T18:16:15.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.656+0000 7f78b69c2700 1 -- 172.21.15.50:0/3193517889 shutdown_connections 2023-01-04T18:16:15.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.656+0000 7f78b69c2700 1 --2- 172.21.15.50:0/3193517889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b00f66e0 0x7f78b00f6b40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:15.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.656+0000 7f78b69c2700 1 --2- 172.21.15.50:0/3193517889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78b00f5440 0x7f78b00f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:15.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.656+0000 7f78b69c2700 1 -- 172.21.15.50:0/3193517889 >> 172.21.15.50:0/3193517889 conn(0x7f78b00f0ba0 msgr2=0x7f78b00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:15.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.656+0000 7f78b69c2700 1 -- 172.21.15.50:0/3193517889 shutdown_connections 2023-01-04T18:16:15.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.657+0000 7f78b69c2700 1 -- 172.21.15.50:0/3193517889 wait complete. 2023-01-04T18:16:15.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.657+0000 7f78b69c2700 1 Processor -- start 2023-01-04T18:16:15.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.657+0000 7f78b69c2700 1 -- start start 2023-01-04T18:16:15.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.657+0000 7f78b69c2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78b00f5440 0x7f78b0105cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:15.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.657+0000 7f78b69c2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b00f66e0 0x7f78b01061e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:15.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.657+0000 7f78b69c2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b0106790 con 0x7f78b00f66e0 2023-01-04T18:16:15.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.657+0000 7f78b69c2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b0106f90 con 0x7f78b00f5440 2023-01-04T18:16:15.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.657+0000 7f78b51bf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b00f66e0 0x7f78b01061e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:15.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.657+0000 7f78b51bf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b00f66e0 0x7f78b01061e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51560/0 (socket says 172.21.15.50:51560) 2023-01-04T18:16:15.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.657+0000 7f78b51bf700 1 -- 172.21.15.50:0/352638512 learned_addr learned my addr 172.21.15.50:0/352638512 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:16:15.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.658+0000 7f78b59c0700 1 --2- 172.21.15.50:0/352638512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78b00f5440 0x7f78b0105cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:15.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.658+0000 7f78b51bf700 1 -- 172.21.15.50:0/352638512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78b00f5440 msgr2=0x7f78b0105cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:15.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.658+0000 7f78b51bf700 1 --2- 172.21.15.50:0/352638512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78b00f5440 0x7f78b0105cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:15.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.658+0000 7f78b51bf700 1 -- 172.21.15.50:0/352638512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a0005040 con 0x7f78b00f66e0 2023-01-04T18:16:15.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.658+0000 7f78b51bf700 1 --2- 172.21.15.50:0/352638512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b00f66e0 0x7f78b01061e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f78a0009830 tx=0x7f78a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:15.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.658+0000 7f78a67fc700 1 -- 172.21.15.50:0/352638512 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78a0018070 con 0x7f78b00f66e0 2023-01-04T18:16:15.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.658+0000 7f78a67fc700 1 -- 172.21.15.50:0/352638512 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f78a001d8e0 con 0x7f78b00f66e0 2023-01-04T18:16:15.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.658+0000 7f78b69c2700 1 -- 172.21.15.50:0/352638512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b0107210 con 0x7f78b00f66e0 2023-01-04T18:16:15.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.658+0000 7f78a67fc700 1 -- 172.21.15.50:0/352638512 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78a001c540 con 0x7f78b00f66e0 2023-01-04T18:16:15.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.658+0000 7f78b69c2700 1 -- 172.21.15.50:0/352638512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b0107770 con 0x7f78b00f66e0 2023-01-04T18:16:15.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.660+0000 7f78b69c2700 1 -- 172.21.15.50:0/352638512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b0059100 con 0x7f78b00f66e0 2023-01-04T18:16:15.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.660+0000 7f78a67fc700 1 -- 172.21.15.50:0/352638512 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 23) v1 ==== 74625+0+0 (secure 0 0 0) 0x7f78a001da50 con 0x7f78b00f66e0 2023-01-04T18:16:15.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.661+0000 7f78a67fc700 1 --2- 172.21.15.50:0/352638512 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f789c062c30 0x7f789c0650f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:15.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.661+0000 7f78a67fc700 1 -- 172.21.15.50:0/352638512 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f78a007acb0 con 0x7f78b00f66e0 2023-01-04T18:16:15.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.661+0000 7f78b59c0700 1 --2- 172.21.15.50:0/352638512 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f789c062c30 0x7f789c0650f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:15.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.662+0000 7f78b59c0700 1 --2- 172.21.15.50:0/352638512 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f789c062c30 0x7f789c0650f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f78ac007fd0 tx=0x7f78ac009040).ready entity=mgr.24455 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:15.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.667+0000 7f78a67fc700 1 -- 172.21.15.50:0/352638512 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161783 (secure 0 0 0) 0x7f78a004ee50 con 0x7f78b00f66e0 2023-01-04T18:16:15.903 INFO:tasks.workunit.client.1.smithi098.stdout:7/12: rmdir d1 39 2023-01-04T18:16:15.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.901+0000 7f78b69c2700 1 -- 172.21.15.50:0/352638512 --> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f78b005f620 con 0x7f789c062c30 2023-01-04T18:16:15.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.913+0000 7f78a67fc700 1 -- 172.21.15.50:0/352638512 <== mgr.24455 v2:172.21.15.98:6828/3052541756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f78b005f620 con 0x7f789c062c30 2023-01-04T18:16:15.916 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-01-04T18:16:15.916 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager.smithi050 smithi050 *:9093,9094 running (4m) 82s ago 5m 18.1M - 0.20.0 0881eb8f169f b5d3e2678a23 2023-01-04T18:16:15.917 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi050 smithi050 running (5m) 82s ago 5m 7037k - 16.2.4 8d91d370c2b8 cfe6f2d72ef5 2023-01-04T18:16:15.917 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi098 smithi098 running (5m) 10s ago 5m 7155k - 16.2.4 8d91d370c2b8 2928008d526c 2023-01-04T18:16:15.917 INFO:teuthology.orchestra.run.smithi050.stdout:grafana.smithi050 smithi050 *:3000 running (4m) 82s ago 5m 28.9M - 6.7.4 557c83e11646 7e5dccbafe78 2023-01-04T18:16:15.917 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.ezoiwl smithi050 running (103s) 82s ago 102s 16.1M - 16.2.4 8d91d370c2b8 6c5c5f2be8b9 2023-01-04T18:16:15.917 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.kefmuy smithi050 running (97s) 82s ago 97s 15.7M - 16.2.4 8d91d370c2b8 58cace913b55 2023-01-04T18:16:15.917 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.laynsk smithi098 running (95s) 10s ago 94s 13.7M - 16.2.4 8d91d370c2b8 8ff8af70b989 2023-01-04T18:16:15.917 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.memais smithi098 running (100s) 10s ago 100s 216M - 16.2.4 8d91d370c2b8 d59d9b4dbf7d 2023-01-04T18:16:15.917 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi050.emnywo smithi050 *:9283 running (6m) 82s ago 6m 426M - 16.2.4 8d91d370c2b8 51f88deda58e 2023-01-04T18:16:15.918 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi098.vhfzum smithi098 *:8443,9283 running (15s) 10s ago 5m 50.1M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 5ec7d7719033 2023-01-04T18:16:15.918 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi050 smithi050 running (6m) 82s ago 6m 92.0M 2048M 16.2.4 8d91d370c2b8 7ef171ad1e93 2023-01-04T18:16:15.918 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi098 smithi098 running (5m) 10s ago 5m 103M 2048M 16.2.4 8d91d370c2b8 e6b6833279a4 2023-01-04T18:16:15.918 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi050 smithi050 *:9100 running (5m) 82s ago 5m 18.2M - 0.18.1 e5a616e4b9cf 88892b2e5e5a 2023-01-04T18:16:15.918 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi098 smithi098 *:9100 running (4m) 10s ago 4m 18.3M - 0.18.1 e5a616e4b9cf 49bcde8331b6 2023-01-04T18:16:15.918 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (4m) 82s ago 4m 48.0M 4096M 16.2.4 8d91d370c2b8 b46676195180 2023-01-04T18:16:15.918 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi050 running (4m) 82s ago 4m 49.2M 4096M 16.2.4 8d91d370c2b8 e4928bcfd146 2023-01-04T18:16:15.919 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi050 running (3m) 82s ago 3m 48.5M 4096M 16.2.4 8d91d370c2b8 babab394b338 2023-01-04T18:16:15.919 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi098 running (3m) 10s ago 3m 142M 4096M 16.2.4 8d91d370c2b8 b02df8e3cb23 2023-01-04T18:16:15.919 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi098 running (3m) 10s ago 3m 121M 4096M 16.2.4 8d91d370c2b8 92273135ca82 2023-01-04T18:16:15.919 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi098 running (3m) 10s ago 2m 129M 4096M 16.2.4 8d91d370c2b8 366d0bfff809 2023-01-04T18:16:15.919 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus.smithi050 smithi050 *:9095 running (4m) 82s ago 5m 32.5M - 2.18.1 de242295e225 6ff859f5958f 2023-01-04T18:16:15.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.915+0000 7f78b69c2700 1 -- 172.21.15.50:0/352638512 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f789c062c30 msgr2=0x7f789c0650f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:15.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.915+0000 7f78b69c2700 1 --2- 172.21.15.50:0/352638512 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f789c062c30 0x7f789c0650f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f78ac007fd0 tx=0x7f78ac009040).stop 2023-01-04T18:16:15.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.915+0000 7f78b69c2700 1 -- 172.21.15.50:0/352638512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b00f66e0 msgr2=0x7f78b01061e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:15.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.915+0000 7f78b69c2700 1 --2- 172.21.15.50:0/352638512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b00f66e0 0x7f78b01061e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f78a0009830 tx=0x7f78a0009b30).stop 2023-01-04T18:16:15.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.916+0000 7f78b69c2700 1 -- 172.21.15.50:0/352638512 shutdown_connections 2023-01-04T18:16:15.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.916+0000 7f78b69c2700 1 --2- 172.21.15.50:0/352638512 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f789c062c30 0x7f789c0650f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:15.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.916+0000 7f78b69c2700 1 --2- 172.21.15.50:0/352638512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78b00f5440 0x7f78b0105cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:15.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.916+0000 7f78b69c2700 1 --2- 172.21.15.50:0/352638512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b00f66e0 0x7f78b01061e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:15.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.916+0000 7f78b69c2700 1 -- 172.21.15.50:0/352638512 >> 172.21.15.50:0/352638512 conn(0x7f78b00f0ba0 msgr2=0x7f78b00fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:15.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.921+0000 7f78b69c2700 1 -- 172.21.15.50:0/352638512 shutdown_connections 2023-01-04T18:16:15.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:15.921+0000 7f78b69c2700 1 -- 172.21.15.50:0/352638512 wait complete. 2023-01-04T18:16:16.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.040+0000 7fb439c98700 1 -- 172.21.15.50:0/349503663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4340f5e60 msgr2=0x7fb4340f62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:16.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.040+0000 7fb439c98700 1 --2- 172.21.15.50:0/349503663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4340f5e60 0x7fb4340f62c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fb420004660 tx=0x7fb420009b30).stop 2023-01-04T18:16:16.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.040+0000 7fb439c98700 1 -- 172.21.15.50:0/349503663 shutdown_connections 2023-01-04T18:16:16.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.041+0000 7fb439c98700 1 --2- 172.21.15.50:0/349503663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4340f5e60 0x7fb4340f62c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:16.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.041+0000 7fb439c98700 1 --2- 172.21.15.50:0/349503663 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4340f4bc0 0x7fb4340f4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-01-04T18:16:16.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.041+0000 7fb439c98700 1 -- 172.21.15.50:0/349503663 >> 172.21.15.50:0/349503663 conn(0x7fb4340f0320 msgr2=0x7fb4340f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:16.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.041+0000 7fb439c98700 1 -- 172.21.15.50:0/349503663 shutdown_connections 2023-01-04T18:16:16.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.042+0000 7fb439c98700 1 -- 172.21.15.50:0/349503663 wait complete. 2023-01-04T18:16:16.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.042+0000 7fb439c98700 1 Processor -- start 2023-01-04T18:16:16.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.042+0000 7fb439c98700 1 -- start start 2023-01-04T18:16:16.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.043+0000 7fb439c98700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4340f4bc0 0x7fb434109b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:16.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.043+0000 7fb439c98700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4340f5e60 0x7fb43410c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:16.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.043+0000 7fb439c98700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4340f7eb0 con 0x7fb4340f5e60 2023-01-04T18:16:16.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.043+0000 7fb439c98700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4340f7ff0 con 0x7fb4340f4bc0 2023-01-04T18:16:16.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.043+0000 7fb438c96700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4340f4bc0 0x7fb434109b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:16.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.043+0000 7fb438c96700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4340f4bc0 0x7fb434109b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.50:45448/0 (socket says 172.21.15.50:45448) 2023-01-04T18:16:16.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.043+0000 7fb438c96700 1 -- 172.21.15.50:0/1166518410 learned_addr learned my addr 172.21.15.50:0/1166518410 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:16:16.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.043+0000 7fb433fff700 1 --2- 172.21.15.50:0/1166518410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4340f5e60 0x7fb43410c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:16.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.043+0000 7fb433fff700 1 -- 172.21.15.50:0/1166518410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4340f4bc0 msgr2=0x7fb434109b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:16.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.043+0000 7fb433fff700 1 --2- 172.21.15.50:0/1166518410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4340f4bc0 0x7fb434109b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:16.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.043+0000 7fb433fff700 1 -- 172.21.15.50:0/1166518410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb420005040 con 0x7fb4340f5e60 2023-01-04T18:16:16.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.043+0000 7fb433fff700 1 --2- 172.21.15.50:0/1166518410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4340f5e60 0x7fb43410c060 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fb420009830 tx=0x7fb420009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:16.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.044+0000 7fb4317fa700 1 -- 172.21.15.50:0/1166518410 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb420018070 con 0x7fb4340f5e60 2023-01-04T18:16:16.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.044+0000 7fb4317fa700 1 -- 172.21.15.50:0/1166518410 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb420007c70 con 0x7fb4340f5e60 2023-01-04T18:16:16.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.044+0000 7fb4317fa700 1 -- 172.21.15.50:0/1166518410 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb42001c3c0 con 0x7fb4340f5e60 2023-01-04T18:16:16.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.044+0000 7fb439c98700 1 -- 172.21.15.50:0/1166518410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43410c610 con 0x7fb4340f5e60 2023-01-04T18:16:16.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.044+0000 7fb439c98700 1 -- 172.21.15.50:0/1166518410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43410cb70 con 0x7fb4340f5e60 2023-01-04T18:16:16.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.046+0000 7fb439c98700 1 -- 172.21.15.50:0/1166518410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb434045ad0 con 0x7fb4340f5e60 2023-01-04T18:16:16.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.046+0000 7fb4317fa700 1 -- 172.21.15.50:0/1166518410 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 23) v1 ==== 74625+0+0 (secure 0 0 0) 0x7fb42001d420 con 0x7fb4340f5e60 2023-01-04T18:16:16.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.046+0000 7fb4317fa700 1 --2- 172.21.15.50:0/1166518410 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fb42405e810 0x7fb424060cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:16.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.046+0000 7fb4317fa700 1 -- 172.21.15.50:0/1166518410 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fb42007aa50 con 0x7fb4340f5e60 2023-01-04T18:16:16.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.047+0000 7fb438c96700 1 --2- 172.21.15.50:0/1166518410 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fb42405e810 0x7fb424060cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:16.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.047+0000 7fb438c96700 1 --2- 172.21.15.50:0/1166518410 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fb42405e810 0x7fb424060cd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fb4340f7aa0 tx=0x7fb428008040).ready entity=mgr.24455 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:16.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.051+0000 7fb4317fa700 1 -- 172.21.15.50:0/1166518410 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161783 (secure 0 0 0) 0x7fb42004b1c0 con 0x7fb4340f5e60 2023-01-04T18:16:16.064 INFO:tasks.workunit.client.1.smithi098.stdout:3/13: creat f3 x:0 0 0 2023-01-04T18:16:16.064 INFO:tasks.workunit.client.1.smithi098.stdout:3/14: fsync f1 0 2023-01-04T18:16:16.064 INFO:tasks.workunit.client.1.smithi098.stdout:3/15: dread - f3 zero size 2023-01-04T18:16:16.071 INFO:tasks.workunit.client.1.smithi098.stdout:2/14: rename f2 to f4 0 2023-01-04T18:16:16.071 INFO:tasks.workunit.client.1.smithi098.stdout:3/16: dread f1 [0,4194304] 0 2023-01-04T18:16:16.076 INFO:tasks.workunit.client.1.smithi098.stdout:0/23: symlink la 0 2023-01-04T18:16:16.086 INFO:tasks.workunit.client.1.smithi098.stdout:8/14: mknod c4 0 2023-01-04T18:16:16.090 INFO:tasks.workunit.client.1.smithi098.stdout:7/13: creat d1/f5 x:0 0 0 2023-01-04T18:16:16.092 INFO:tasks.workunit.client.1.smithi098.stdout:9/12: dread f1 [0,4194304] 0 2023-01-04T18:16:16.101 INFO:tasks.workunit.client.1.smithi098.stdout:0/24: rename l6 to lb 0 2023-01-04T18:16:16.108 INFO:tasks.workunit.client.1.smithi098.stdout:7/14: symlink d1/l6 0 2023-01-04T18:16:16.110 INFO:tasks.workunit.client.1.smithi098.stdout:9/13: creat d2/f3 x:0 0 0 2023-01-04T18:16:16.110 INFO:tasks.workunit.client.1.smithi098.stdout:9/14: fdatasync f1 0 2023-01-04T18:16:16.114 INFO:tasks.workunit.client.1.smithi098.stdout:8/15: dread f2 [0,4194304] 0 2023-01-04T18:16:16.115 INFO:tasks.workunit.client.1.smithi098.stdout:9/15: dread f0 [0,4194304] 0 2023-01-04T18:16:16.121 INFO:tasks.workunit.client.1.smithi098.stdout:0/25: dwrite f1 [0,4194304] 0 2023-01-04T18:16:16.131 INFO:tasks.workunit.client.1.smithi098.stdout:9/16: symlink d2/l4 0 2023-01-04T18:16:16.131 INFO:tasks.workunit.client.1.smithi098.stdout:0/26: dread f3 [0,4194304] 0 2023-01-04T18:16:16.131 INFO:tasks.workunit.client.1.smithi098.stdout:9/17: write f1 [966304,49807] 0 2023-01-04T18:16:16.131 INFO:tasks.workunit.client.1.smithi098.stdout:9/18: read - d2/f3 zero size 2023-01-04T18:16:16.134 INFO:tasks.workunit.client.1.smithi098.stdout:9/19: mkdir d2/d5 0 2023-01-04T18:16:16.134 INFO:tasks.workunit.client.1.smithi098.stdout:9/20: chown f0 15424 1 2023-01-04T18:16:16.134 INFO:tasks.workunit.client.1.smithi098.stdout:9/21: dread - d2/f3 zero size 2023-01-04T18:16:16.136 INFO:tasks.workunit.client.1.smithi098.stdout:9/22: link f0 d2/d5/f6 0 2023-01-04T18:16:16.136 INFO:tasks.workunit.client.1.smithi098.stdout:9/23: truncate d2/d5/f6 1485761 0 2023-01-04T18:16:16.137 INFO:tasks.workunit.client.1.smithi098.stdout:9/24: chown d2/l4 580627431 1 2023-01-04T18:16:16.139 INFO:tasks.workunit.client.1.smithi098.stdout:8/16: dwrite f2 [0,4194304] 0 2023-01-04T18:16:16.139 INFO:tasks.workunit.client.1.smithi098.stdout:8/17: fsync f2 0 2023-01-04T18:16:16.139 INFO:tasks.workunit.client.1.smithi098.stdout:9/25: creat d2/f7 x:0 0 0 2023-01-04T18:16:16.143 INFO:tasks.workunit.client.1.smithi098.stdout:9/26: link f1 d2/f8 0 2023-01-04T18:16:16.341 INFO:tasks.workunit.client.1.smithi098.stdout:2/15: rename f4 to f5 0 2023-01-04T18:16:16.341 INFO:tasks.workunit.client.1.smithi098.stdout:2/16: fdatasync f5 0 2023-01-04T18:16:16.346 INFO:tasks.workunit.client.1.smithi098.stdout:7/15: truncate d1/f2 542720 0 2023-01-04T18:16:16.346 INFO:tasks.workunit.client.1.smithi098.stdout:7/16: readlink d1/l6 0 2023-01-04T18:16:16.346 INFO:tasks.workunit.client.1.smithi098.stdout:0/27: write f1 [4956058,24845] 0 2023-01-04T18:16:16.349 INFO:tasks.workunit.client.1.smithi098.stdout:2/17: mkdir d6 0 2023-01-04T18:16:16.349 INFO:tasks.workunit.client.1.smithi098.stdout:2/18: write f3 [951153,98402] 0 2023-01-04T18:16:16.350 INFO:tasks.workunit.client.1.smithi098.stdout:9/27: getdents d2 0 2023-01-04T18:16:16.350 INFO:tasks.workunit.client.1.smithi098.stdout:9/28: fdatasync d2/d5/f6 0 2023-01-04T18:16:16.350 INFO:tasks.workunit.client.1.smithi098.stdout:9/29: write d2/f8 [1985028,115398] 0 2023-01-04T18:16:16.350 INFO:tasks.workunit.client.1.smithi098.stdout:9/30: readlink d2/l4 0 2023-01-04T18:16:16.354 INFO:tasks.workunit.client.1.smithi098.stdout:0/28: link l7 lc 0 2023-01-04T18:16:16.357 INFO:tasks.workunit.client.1.smithi098.stdout:9/31: mknod d2/c9 0 2023-01-04T18:16:16.357 INFO:tasks.workunit.client.1.smithi098.stdout:9/32: chown d2/l4 949597011 1 2023-01-04T18:16:16.360 INFO:tasks.workunit.client.1.smithi098.stdout:7/17: rename d1/f2 to d1/f7 0 2023-01-04T18:16:16.360 INFO:tasks.workunit.client.1.smithi098.stdout:7/18: chown d1/f7 103 1 2023-01-04T18:16:16.361 INFO:tasks.workunit.client.1.smithi098.stdout:7/19: chown d1/f5 1448 1 2023-01-04T18:16:16.378 INFO:tasks.workunit.client.1.smithi098.stdout:2/19: dwrite f3 [0,4194304] 0 2023-01-04T18:16:16.388 INFO:tasks.workunit.client.1.smithi098.stdout:2/20: write f3 [4599203,43314] 0 2023-01-04T18:16:16.397 INFO:tasks.workunit.client.1.smithi098.stdout:0/29: dwrite f5 [4194304,4194304] 0 2023-01-04T18:16:16.398 INFO:tasks.workunit.client.1.smithi098.stdout:7/20: dwrite d1/f7 [0,4194304] 0 2023-01-04T18:16:16.399 INFO:tasks.workunit.client.1.smithi098.stdout:9/33: dwrite d2/f7 [0,4194304] 0 2023-01-04T18:16:16.399 INFO:tasks.workunit.client.1.smithi098.stdout:9/34: dread - d2/f3 zero size 2023-01-04T18:16:16.399 INFO:tasks.workunit.client.1.smithi098.stdout:9/35: chown d2/d5/f6 2 1 2023-01-04T18:16:16.403 INFO:tasks.workunit.client.1.smithi098.stdout:7/21: rename d1/l6 to d1/d4/l8 0 2023-01-04T18:16:16.408 INFO:tasks.workunit.client.1.smithi098.stdout:9/36: getdents d2/d5 0 2023-01-04T18:16:16.412 INFO:tasks.workunit.client.1.smithi098.stdout:7/22: symlink d1/l9 0 2023-01-04T18:16:16.413 INFO:tasks.workunit.client.1.smithi098.stdout:2/21: dwrite f3 [0,4194304] 0 2023-01-04T18:16:16.413 INFO:tasks.workunit.client.1.smithi098.stdout:2/22: write f5 [4987350,101605] 0 2023-01-04T18:16:16.413 INFO:tasks.workunit.client.1.smithi098.stdout:2/23: write f5 [5356144,43480] 0 2023-01-04T18:16:16.420 INFO:tasks.workunit.client.1.smithi098.stdout:9/37: symlink d2/la 0 2023-01-04T18:16:16.424 INFO:tasks.workunit.client.1.smithi098.stdout:7/23: mkdir d1/da 0 2023-01-04T18:16:16.425 INFO:tasks.workunit.client.1.smithi098.stdout:2/24: creat d6/f7 x:0 0 0 2023-01-04T18:16:16.426 INFO:tasks.workunit.client.1.smithi098.stdout:9/38: creat d2/d5/fb x:0 0 0 2023-01-04T18:16:16.427 INFO:tasks.workunit.client.1.smithi098.stdout:7/24: truncate d1/f7 1376126 0 2023-01-04T18:16:16.427 INFO:tasks.workunit.client.1.smithi098.stdout:7/25: truncate d1/f5 731830 0 2023-01-04T18:16:16.429 INFO:tasks.workunit.client.1.smithi098.stdout:9/39: write d2/f7 [2223323,87382] 0 2023-01-04T18:16:16.429 INFO:tasks.workunit.client.1.smithi098.stdout:2/25: creat d6/f8 x:0 0 0 2023-01-04T18:16:16.429 INFO:tasks.workunit.client.1.smithi098.stdout:2/26: truncate d6/f8 488631 0 2023-01-04T18:16:16.429 INFO:tasks.workunit.client.1.smithi098.stdout:2/27: stat d6 0 2023-01-04T18:16:16.429 INFO:tasks.workunit.client.1.smithi098.stdout:2/28: dread - d6/f7 zero size 2023-01-04T18:16:16.429 INFO:tasks.workunit.client.1.smithi098.stdout:2/29: write d6/f7 [990901,66540] 0 2023-01-04T18:16:16.433 INFO:tasks.workunit.client.1.smithi098.stdout:2/30: creat d6/f9 x:0 0 0 2023-01-04T18:16:16.439 INFO:tasks.workunit.client.1.smithi098.stdout:2/31: fdatasync d6/f7 0 2023-01-04T18:16:16.440 INFO:tasks.workunit.client.1.smithi098.stdout:2/32: creat d6/fa x:0 0 0 2023-01-04T18:16:16.446 INFO:tasks.workunit.client.1.smithi098.stdout:2/33: getdents d6 0 2023-01-04T18:16:16.448 INFO:tasks.workunit.client.1.smithi098.stdout:2/34: creat d6/fb x:0 0 0 2023-01-04T18:16:16.449 INFO:tasks.workunit.client.1.smithi098.stdout:9/40: dwrite d2/f3 [0,4194304] 0 2023-01-04T18:16:16.449 INFO:tasks.workunit.client.1.smithi098.stdout:9/41: fsync d2/d5/fb 0 2023-01-04T18:16:16.449 INFO:tasks.workunit.client.1.smithi098.stdout:9/42: chown d2/l4 179 1 2023-01-04T18:16:16.449 INFO:tasks.workunit.client.1.smithi098.stdout:9/43: read f1 [1617472,101546] 0 2023-01-04T18:16:16.450 INFO:tasks.workunit.client.1.smithi098.stdout:2/35: mkdir d6/dc 0 2023-01-04T18:16:16.453 INFO:tasks.workunit.client.1.smithi098.stdout:9/44: link d2/la d2/d5/lc 0 2023-01-04T18:16:16.453 INFO:tasks.workunit.client.1.smithi098.stdout:9/45: readlink d2/d5/lc 0 2023-01-04T18:16:16.455 INFO:tasks.workunit.client.1.smithi098.stdout:2/36: mknod d6/dc/cd 0 2023-01-04T18:16:16.455 INFO:tasks.workunit.client.1.smithi098.stdout:9/46: stat d2/d5/lc 0 2023-01-04T18:16:16.458 INFO:tasks.workunit.client.1.smithi098.stdout:9/47: unlink d2/f3 0 2023-01-04T18:16:16.458 INFO:tasks.workunit.client.1.smithi098.stdout:9/48: chown d2/l4 257764602 1 2023-01-04T18:16:16.464 INFO:tasks.workunit.client.1.smithi098.stdout:2/37: rmdir d6 39 2023-01-04T18:16:16.465 INFO:tasks.workunit.client.1.smithi098.stdout:2/38: creat d6/dc/fe x:0 0 0 2023-01-04T18:16:16.470 INFO:tasks.workunit.client.1.smithi098.stdout:9/49: dwrite f1 [0,4194304] 0 2023-01-04T18:16:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.467+0000 7fb439c98700 1 -- 172.21.15.50:0/1166518410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb4340fd3f0 con 0x7fb4340f5e60 2023-01-04T18:16:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.467+0000 7fb4317fa700 1 -- 172.21.15.50:0/1166518410 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+793 (secure 0 0 0) 0x7fb42004e7e0 con 0x7fb4340f5e60 2023-01-04T18:16:16.471 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:16:16.471 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": { 2023-01-04T18:16:16.471 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-01-04T18:16:16.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:16:16.472 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": { 2023-01-04T18:16:16.472 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 1, 2023-01-04T18:16:16.472 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 1 2023-01-04T18:16:16.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:16:16.472 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": { 2023-01-04T18:16:16.472 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2023-01-04T18:16:16.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:16:16.472 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2023-01-04T18:16:16.473 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-01-04T18:16:16.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:16:16.473 INFO:teuthology.orchestra.run.smithi050.stdout: "overall": { 2023-01-04T18:16:16.473 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 1, 2023-01-04T18:16:16.473 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 13 2023-01-04T18:16:16.473 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-01-04T18:16:16.473 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:16:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.469+0000 7fb439c98700 1 -- 172.21.15.50:0/1166518410 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fb42405e810 msgr2=0x7fb424060cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.469+0000 7fb439c98700 1 --2- 172.21.15.50:0/1166518410 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fb42405e810 0x7fb424060cd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fb4340f7aa0 tx=0x7fb428008040).stop 2023-01-04T18:16:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.469+0000 7fb439c98700 1 -- 172.21.15.50:0/1166518410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4340f5e60 msgr2=0x7fb43410c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.469+0000 7fb439c98700 1 --2- 172.21.15.50:0/1166518410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4340f5e60 0x7fb43410c060 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fb420009830 tx=0x7fb420009b30).stop 2023-01-04T18:16:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.469+0000 7fb439c98700 1 -- 172.21.15.50:0/1166518410 shutdown_connections 2023-01-04T18:16:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.469+0000 7fb439c98700 1 --2- 172.21.15.50:0/1166518410 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fb42405e810 0x7fb424060cd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.469+0000 7fb439c98700 1 --2- 172.21.15.50:0/1166518410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4340f4bc0 0x7fb434109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.469+0000 7fb439c98700 1 --2- 172.21.15.50:0/1166518410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4340f5e60 0x7fb43410c060 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:16.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.470+0000 7fb439c98700 1 -- 172.21.15.50:0/1166518410 >> 172.21.15.50:0/1166518410 conn(0x7fb4340f0320 msgr2=0x7fb4340fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:16.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.470+0000 7fb439c98700 1 -- 172.21.15.50:0/1166518410 shutdown_connections 2023-01-04T18:16:16.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.470+0000 7fb439c98700 1 -- 172.21.15.50:0/1166518410 wait complete. 2023-01-04T18:16:16.475 INFO:tasks.workunit.client.1.smithi098.stdout:9/50: symlink d2/d5/ld 0 2023-01-04T18:16:16.475 INFO:tasks.workunit.client.1.smithi098.stdout:2/39: getdents d6/dc 0 2023-01-04T18:16:16.475 INFO:tasks.workunit.client.1.smithi098.stdout:9/51: write d2/f7 [982996,112588] 0 2023-01-04T18:16:16.476 INFO:tasks.workunit.client.1.smithi098.stdout:2/40: creat d6/dc/ff x:0 0 0 2023-01-04T18:16:16.477 INFO:tasks.workunit.client.1.smithi098.stdout:9/52: mknod d2/d5/ce 0 2023-01-04T18:16:16.491 INFO:tasks.workunit.client.1.smithi098.stdout:2/41: dwrite d6/f8 [0,4194304] 0 2023-01-04T18:16:16.494 INFO:tasks.workunit.client.1.smithi098.stdout:2/42: write d6/f7 [1242598,14237] 0 2023-01-04T18:16:16.495 INFO:tasks.workunit.client.1.smithi098.stdout:2/43: truncate d6/dc/fe 497721 0 2023-01-04T18:16:16.498 INFO:tasks.workunit.client.1.smithi098.stdout:2/44: creat d6/f10 x:0 0 0 2023-01-04T18:16:16.501 INFO:tasks.workunit.client.1.smithi098.stdout:9/53: dwrite d2/f7 [0,4194304] 0 2023-01-04T18:16:16.502 INFO:tasks.workunit.client.1.smithi098.stdout:2/45: creat d6/f11 x:0 0 0 2023-01-04T18:16:16.504 INFO:tasks.workunit.client.1.smithi098.stdout:2/46: dread - d6/f9 zero size 2023-01-04T18:16:16.504 INFO:tasks.workunit.client.1.smithi098.stdout:2/47: truncate d6/fb 858664 0 2023-01-04T18:16:16.506 INFO:tasks.workunit.client.1.smithi098.stdout:2/48: creat d6/dc/f12 x:0 0 0 2023-01-04T18:16:16.506 INFO:tasks.workunit.client.1.smithi098.stdout:2/49: fsync f3 0 2023-01-04T18:16:16.506 INFO:tasks.workunit.client.1.smithi098.stdout:2/50: chown d6/f9 27934839 1 2023-01-04T18:16:16.510 INFO:tasks.workunit.client.1.smithi098.stdout:2/51: write d6/fa [424927,103259] 0 2023-01-04T18:16:16.517 INFO:tasks.workunit.client.1.smithi098.stdout:2/52: dread f3 [0,4194304] 0 2023-01-04T18:16:16.518 INFO:tasks.workunit.client.1.smithi098.stdout:9/54: dread d2/f7 [0,4194304] 0 2023-01-04T18:16:16.518 INFO:tasks.workunit.client.1.smithi098.stdout:9/55: dread - d2/d5/fb zero size 2023-01-04T18:16:16.520 INFO:tasks.workunit.client.1.smithi098.stdout:2/53: truncate d6/f8 3924706 0 2023-01-04T18:16:16.534 INFO:tasks.workunit.client.1.smithi098.stdout:2/54: dwrite f5 [4194304,4194304] 0 2023-01-04T18:16:16.538 INFO:tasks.workunit.client.1.smithi098.stdout:2/55: mknod d6/dc/c13 0 2023-01-04T18:16:16.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:15.174873+0000 mgr.smithi098.vhfzum (mgr.24455) 5 : audit [DBG] from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:16:16.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:15.521288+0000 mgr.smithi098.vhfzum (mgr.24455) 6 : audit [DBG] from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:16:16.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:15.903343+0000 mgr.smithi098.vhfzum (mgr.24455) 7 : audit [DBG] from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:16:16.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:15.909358+0000 mgr.smithi098.vhfzum (mgr.24455) 8 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 192 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 24 op/s 2023-01-04T18:16:16.543 INFO:tasks.workunit.client.1.smithi098.stdout:2/56: rename d6/f9 to d6/dc/f14 0 2023-01-04T18:16:16.547 INFO:tasks.workunit.client.1.smithi098.stdout:2/57: creat d6/f15 x:0 0 0 2023-01-04T18:16:16.549 INFO:tasks.workunit.client.1.smithi098.stdout:2/58: creat d6/f16 x:0 0 0 2023-01-04T18:16:16.552 INFO:tasks.workunit.client.1.smithi098.stdout:2/59: dread f3 [0,4194304] 0 2023-01-04T18:16:16.553 INFO:tasks.workunit.client.1.smithi098.stdout:2/60: creat d6/f17 x:0 0 0 2023-01-04T18:16:16.553 INFO:tasks.workunit.client.1.smithi098.stdout:2/61: chown c1 5390 1 2023-01-04T18:16:16.566 INFO:tasks.workunit.client.1.smithi098.stdout:2/62: dwrite d6/f17 [0,4194304] 0 2023-01-04T18:16:16.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:15.174873+0000 mgr.smithi098.vhfzum (mgr.24455) 5 : audit [DBG] from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:16:16.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:15.521288+0000 mgr.smithi098.vhfzum (mgr.24455) 6 : audit [DBG] from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:16:16.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:15.903343+0000 mgr.smithi098.vhfzum (mgr.24455) 7 : audit [DBG] from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:16:16.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:15.909358+0000 mgr.smithi098.vhfzum (mgr.24455) 8 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 192 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 24 op/s 2023-01-04T18:16:16.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.603+0000 7f87220ce700 1 -- 172.21.15.50:0/1916515555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f871c0f49a0 msgr2=0x7f871c0f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:16.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.603+0000 7f87220ce700 1 --2- 172.21.15.50:0/1916515555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f871c0f49a0 0x7f871c0f4dc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f870c004660 tx=0x7f870c009b30).stop 2023-01-04T18:16:16.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.603+0000 7f87220ce700 1 -- 172.21.15.50:0/1916515555 shutdown_connections 2023-01-04T18:16:16.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.603+0000 7f87220ce700 1 --2- 172.21.15.50:0/1916515555 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f871c0f5340 0x7f871c0f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:16.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.603+0000 7f87220ce700 1 --2- 172.21.15.50:0/1916515555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f871c0f49a0 0x7f871c0f4dc0 secure :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0x7f870c004660 tx=0x7f870c009b30).stop 2023-01-04T18:16:16.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.603+0000 7f87220ce700 1 -- 172.21.15.50:0/1916515555 >> 172.21.15.50:0/1916515555 conn(0x7f871c0f04c0 msgr2=0x7f871c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:16.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.604+0000 7f87220ce700 1 -- 172.21.15.50:0/1916515555 shutdown_connections 2023-01-04T18:16:16.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.604+0000 7f87220ce700 1 -- 172.21.15.50:0/1916515555 wait complete. 2023-01-04T18:16:16.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.605+0000 7f87220ce700 1 Processor -- start 2023-01-04T18:16:16.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.605+0000 7f87220ce700 1 -- start start 2023-01-04T18:16:16.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.605+0000 7f87220ce700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f871c0f5340 0x7f871c10d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:16.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.605+0000 7f87220ce700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f871c10dca0 0x7f871c10eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:16.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.605+0000 7f87220ce700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c10e170 con 0x7f871c0f5340 2023-01-04T18:16:16.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.605+0000 7f87220ce700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c10e2b0 con 0x7f871c10dca0 2023-01-04T18:16:16.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.606+0000 7f871b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f871c0f5340 0x7f871c10d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:16.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.606+0000 7f871b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f871c0f5340 0x7f871c10d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50076/0 (socket says 172.21.15.50:50076) 2023-01-04T18:16:16.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.606+0000 7f871b7fe700 1 -- 172.21.15.50:0/4067196584 learned_addr learned my addr 172.21.15.50:0/4067196584 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:16:16.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.606+0000 7f871affd700 1 --2- 172.21.15.50:0/4067196584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f871c10dca0 0x7f871c10eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:16.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.606+0000 7f871b7fe700 1 -- 172.21.15.50:0/4067196584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f871c10dca0 msgr2=0x7f871c10eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:16.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.606+0000 7f871b7fe700 1 --2- 172.21.15.50:0/4067196584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f871c10dca0 0x7f871c10eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:16.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.606+0000 7f871b7fe700 1 -- 172.21.15.50:0/4067196584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c005040 con 0x7f871c0f5340 2023-01-04T18:16:16.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.606+0000 7f871affd700 1 --2- 172.21.15.50:0/4067196584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f871c10dca0 0x7f871c10eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-01-04T18:16:16.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.606+0000 7f871b7fe700 1 --2- 172.21.15.50:0/4067196584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f871c0f5340 0x7f871c10d7b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f870c011000 tx=0x7f870c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:16.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.607+0000 7f8703fff700 1 -- 172.21.15.50:0/4067196584 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f870c007990 con 0x7f871c0f5340 2023-01-04T18:16:16.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.607+0000 7f87220ce700 1 -- 172.21.15.50:0/4067196584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871c10f0e0 con 0x7f871c0f5340 2023-01-04T18:16:16.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.607+0000 7f8703fff700 1 -- 172.21.15.50:0/4067196584 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f870c007af0 con 0x7f871c0f5340 2023-01-04T18:16:16.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.607+0000 7f8703fff700 1 -- 172.21.15.50:0/4067196584 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f870c014420 con 0x7f871c0f5340 2023-01-04T18:16:16.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.607+0000 7f87220ce700 1 -- 172.21.15.50:0/4067196584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871c10f5c0 con 0x7f871c0f5340 2023-01-04T18:16:16.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.608+0000 7f87220ce700 1 -- 172.21.15.50:0/4067196584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871c0f4150 con 0x7f871c0f5340 2023-01-04T18:16:16.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.609+0000 7f8703fff700 1 -- 172.21.15.50:0/4067196584 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 23) v1 ==== 74625+0+0 (secure 0 0 0) 0x7f870c025060 con 0x7f871c0f5340 2023-01-04T18:16:16.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.609+0000 7f8703fff700 1 --2- 172.21.15.50:0/4067196584 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f870405e7c0 0x7f8704060c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:16.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.609+0000 7f8703fff700 1 -- 172.21.15.50:0/4067196584 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f870c07a370 con 0x7f871c0f5340 2023-01-04T18:16:16.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.610+0000 7f871affd700 1 --2- 172.21.15.50:0/4067196584 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f870405e7c0 0x7f8704060c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:16.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.610+0000 7f871affd700 1 --2- 172.21.15.50:0/4067196584 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f870405e7c0 0x7f8704060c80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f8710009da0 tx=0x7f871000b040).ready entity=mgr.24455 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:16.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.615+0000 7f8703fff700 1 -- 172.21.15.50:0/4067196584 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161783 (secure 0 0 0) 0x7f870c04e490 con 0x7f871c0f5340 2023-01-04T18:16:16.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.890+0000 7f87220ce700 1 -- 172.21.15.50:0/4067196584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f871c10f8b0 con 0x7f871c0f5340 2023-01-04T18:16:16.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.890+0000 7f8703fff700 1 -- 172.21.15.50:0/4067196584 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1669 (secure 0 0 0) 0x7f870c04e080 con 0x7f871c0f5340 2023-01-04T18:16:16.894 INFO:teuthology.orchestra.run.smithi050.stdout:e13 2023-01-04T18:16:16.895 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:16:16.895 INFO:teuthology.orchestra.run.smithi050.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:16:16.895 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-01-04T18:16:16.895 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:16:16.895 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-01-04T18:16:16.895 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-01-04T18:16:16.895 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 10 2023-01-04T18:16:16.896 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 2023-01-04T18:16:16.896 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:16:16.896 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-01-04T18:14:43.958806+0000 2023-01-04T18:16:16.896 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-01-04T18:16:16.896 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-01-04T18:16:16.896 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 60 2023-01-04T18:16:16.896 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-01-04T18:16:16.896 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-01-04T18:16:16.897 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-01-04T18:16:16.897 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-01-04T18:16:16.897 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 0 2023-01-04T18:16:16.897 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:16:16.897 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 1 2023-01-04T18:16:16.897 INFO:teuthology.orchestra.run.smithi050.stdout:in 0 2023-01-04T18:16:16.897 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=14430} 2023-01-04T18:16:16.897 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-01-04T18:16:16.898 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-01-04T18:16:16.898 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-01-04T18:16:16.898 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-01-04T18:16:16.898 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-01-04T18:16:16.898 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data enabled 2023-01-04T18:16:16.898 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-01-04T18:16:16.899 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 1 2023-01-04T18:16:16.899 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.ezoiwl{0:14430} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541]] 2023-01-04T18:16:16.899 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.memais{0:24291} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.98:6824/1196398070,v1:172.21.15.98:6825/1196398070]] 2023-01-04T18:16:16.899 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:16:16.899 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:16:16.899 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2023-01-04T18:16:16.899 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:16:16.899 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.kefmuy{-1:14440} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592]] 2023-01-04T18:16:16.899 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.laynsk{-1:24297} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263]] 2023-01-04T18:16:16.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.892+0000 7f87220ce700 1 -- 172.21.15.50:0/4067196584 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f870405e7c0 msgr2=0x7f8704060c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:16.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.892+0000 7f87220ce700 1 --2- 172.21.15.50:0/4067196584 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f870405e7c0 0x7f8704060c80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f8710009da0 tx=0x7f871000b040).stop 2023-01-04T18:16:16.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.892+0000 7f87220ce700 1 -- 172.21.15.50:0/4067196584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f871c0f5340 msgr2=0x7f871c10d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:16.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.892+0000 7f87220ce700 1 --2- 172.21.15.50:0/4067196584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f871c0f5340 0x7f871c10d7b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f870c011000 tx=0x7f870c009b30).stop 2023-01-04T18:16:16.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.892+0000 7f87220ce700 1 -- 172.21.15.50:0/4067196584 shutdown_connections 2023-01-04T18:16:16.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.892+0000 7f87220ce700 1 --2- 172.21.15.50:0/4067196584 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f870405e7c0 0x7f8704060c80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:16.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.892+0000 7f87220ce700 1 --2- 172.21.15.50:0/4067196584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f871c0f5340 0x7f871c10d7b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:16.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.892+0000 7f87220ce700 1 --2- 172.21.15.50:0/4067196584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f871c10dca0 0x7f871c10eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:16.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.892+0000 7f87220ce700 1 -- 172.21.15.50:0/4067196584 >> 172.21.15.50:0/4067196584 conn(0x7f871c0f04c0 msgr2=0x7f871c0ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:16.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.892+0000 7f87220ce700 1 -- 172.21.15.50:0/4067196584 shutdown_connections 2023-01-04T18:16:16.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:16.893+0000 7f87220ce700 1 -- 172.21.15.50:0/4067196584 wait complete. 2023-01-04T18:16:16.901 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2023-01-04T18:16:17.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.020+0000 7f8f70f33700 1 -- 172.21.15.50:0/1967676836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f6c0f6860 msgr2=0x7f8f6c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:17.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.020+0000 7f8f70f33700 1 --2- 172.21.15.50:0/1967676836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f6c0f6860 0x7f8f6c0f6cc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f8f60004660 tx=0x7f8f60009b30).stop 2023-01-04T18:16:17.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.020+0000 7f8f70f33700 1 -- 172.21.15.50:0/1967676836 shutdown_connections 2023-01-04T18:16:17.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.020+0000 7f8f70f33700 1 --2- 172.21.15.50:0/1967676836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f6c0f6860 0x7f8f6c0f6cc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:17.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.020+0000 7f8f70f33700 1 --2- 172.21.15.50:0/1967676836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f6c0f55c0 0x7f8f6c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:17.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.020+0000 7f8f70f33700 1 -- 172.21.15.50:0/1967676836 >> 172.21.15.50:0/1967676836 conn(0x7f8f6c0f0d40 msgr2=0x7f8f6c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:17.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.020+0000 7f8f70f33700 1 -- 172.21.15.50:0/1967676836 shutdown_connections 2023-01-04T18:16:17.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.020+0000 7f8f70f33700 1 -- 172.21.15.50:0/1967676836 wait complete. 2023-01-04T18:16:17.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.021+0000 7f8f70f33700 1 Processor -- start 2023-01-04T18:16:17.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.021+0000 7f8f70f33700 1 -- start start 2023-01-04T18:16:17.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.021+0000 7f8f70f33700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f6c0f55c0 0x7f8f6c109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:17.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.022+0000 7f8f70f33700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f6c0f6860 0x7f8f6c10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:17.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.022+0000 7f8f70f33700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c0603c0 con 0x7f8f6c0f6860 2023-01-04T18:16:17.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.022+0000 7f8f70f33700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c060500 con 0x7f8f6c0f55c0 2023-01-04T18:16:17.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.022+0000 7f8f69d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f6c0f6860 0x7f8f6c10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:17.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.022+0000 7f8f69d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f6c0f6860 0x7f8f6c10c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50090/0 (socket says 172.21.15.50:50090) 2023-01-04T18:16:17.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.022+0000 7f8f69d9b700 1 -- 172.21.15.50:0/2282794547 learned_addr learned my addr 172.21.15.50:0/2282794547 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:16:17.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.022+0000 7f8f6a59c700 1 --2- 172.21.15.50:0/2282794547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f6c0f55c0 0x7f8f6c109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:17.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.022+0000 7f8f69d9b700 1 -- 172.21.15.50:0/2282794547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f6c0f55c0 msgr2=0x7f8f6c109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:17.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.022+0000 7f8f69d9b700 1 --2- 172.21.15.50:0/2282794547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f6c0f55c0 0x7f8f6c109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:17.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.022+0000 7f8f69d9b700 1 -- 172.21.15.50:0/2282794547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f60005040 con 0x7f8f6c0f6860 2023-01-04T18:16:17.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.022+0000 7f8f69d9b700 1 --2- 172.21.15.50:0/2282794547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f6c0f6860 0x7f8f6c10c190 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f8f60009f50 tx=0x7f8f60009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:17.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.022+0000 7f8f5affd700 1 -- 172.21.15.50:0/2282794547 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f60018070 con 0x7f8f6c0f6860 2023-01-04T18:16:17.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.022+0000 7f8f5affd700 1 -- 172.21.15.50:0/2282794547 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8f60009630 con 0x7f8f6c0f6860 2023-01-04T18:16:17.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.022+0000 7f8f70f33700 1 -- 172.21.15.50:0/2282794547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6c10c6e0 con 0x7f8f6c0f6860 2023-01-04T18:16:17.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.022+0000 7f8f5affd700 1 -- 172.21.15.50:0/2282794547 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f6001c3c0 con 0x7f8f6c0f6860 2023-01-04T18:16:17.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.022+0000 7f8f70f33700 1 -- 172.21.15.50:0/2282794547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6c10cc10 con 0x7f8f6c0f6860 2023-01-04T18:16:17.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.023+0000 7f8f70f33700 1 -- 172.21.15.50:0/2282794547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6c0f49b0 con 0x7f8f6c0f6860 2023-01-04T18:16:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.024+0000 7f8f5affd700 1 -- 172.21.15.50:0/2282794547 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 23) v1 ==== 74625+0+0 (secure 0 0 0) 0x7f8f6001c520 con 0x7f8f6c0f6860 2023-01-04T18:16:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.024+0000 7f8f5affd700 1 --2- 172.21.15.50:0/2282794547 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f8f5405e820 0x7f8f54060ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.024+0000 7f8f5affd700 1 -- 172.21.15.50:0/2282794547 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f8f6001d480 con 0x7f8f6c0f6860 2023-01-04T18:16:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.024+0000 7f8f6a59c700 1 --2- 172.21.15.50:0/2282794547 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f8f5405e820 0x7f8f54060ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.025+0000 7f8f6a59c700 1 --2- 172.21.15.50:0/2282794547 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f8f5405e820 0x7f8f54060ce0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8f6c060040 tx=0x7f8f5c00b040).ready entity=mgr.24455 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:17.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.029+0000 7f8f5affd700 1 -- 172.21.15.50:0/2282794547 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161783 (secure 0 0 0) 0x7f8f6004b6c0 con 0x7f8f6c0f6860 2023-01-04T18:16:17.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.246+0000 7f8f70f33700 1 -- 172.21.15.50:0/2282794547 --> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f6c0fded0 con 0x7f8f5405e820 2023-01-04T18:16:17.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.249+0000 7f8f5affd700 1 -- 172.21.15.50:0/2282794547 <== mgr.24455 v2:172.21.15.98:6828/3052541756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f8f6c0fded0 con 0x7f8f5405e820 2023-01-04T18:16:17.252 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:16:17.252 INFO:teuthology.orchestra.run.smithi050.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308", 2023-01-04T18:16:17.252 INFO:teuthology.orchestra.run.smithi050.stdout: "in_progress": true, 2023-01-04T18:16:17.252 INFO:teuthology.orchestra.run.smithi050.stdout: "which": "Upgrading all daemon types on all hosts", 2023-01-04T18:16:17.253 INFO:teuthology.orchestra.run.smithi050.stdout: "services_complete": [], 2023-01-04T18:16:17.253 INFO:teuthology.orchestra.run.smithi050.stdout: "progress": "1/21 daemons upgraded", 2023-01-04T18:16:17.253 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "", 2023-01-04T18:16:17.253 INFO:teuthology.orchestra.run.smithi050.stdout: "is_paused": false 2023-01-04T18:16:17.253 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:16:17.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.251+0000 7f8f70f33700 1 -- 172.21.15.50:0/2282794547 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f8f5405e820 msgr2=0x7f8f54060ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:17.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.251+0000 7f8f70f33700 1 --2- 172.21.15.50:0/2282794547 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f8f5405e820 0x7f8f54060ce0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8f6c060040 tx=0x7f8f5c00b040).stop 2023-01-04T18:16:17.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.251+0000 7f8f70f33700 1 -- 172.21.15.50:0/2282794547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f6c0f6860 msgr2=0x7f8f6c10c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:17.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.251+0000 7f8f70f33700 1 --2- 172.21.15.50:0/2282794547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f6c0f6860 0x7f8f6c10c190 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f8f60009f50 tx=0x7f8f60009b30).stop 2023-01-04T18:16:17.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.251+0000 7f8f70f33700 1 -- 172.21.15.50:0/2282794547 shutdown_connections 2023-01-04T18:16:17.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.251+0000 7f8f70f33700 1 --2- 172.21.15.50:0/2282794547 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f8f5405e820 0x7f8f54060ce0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:17.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.251+0000 7f8f70f33700 1 --2- 172.21.15.50:0/2282794547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f6c0f55c0 0x7f8f6c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:17.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.251+0000 7f8f70f33700 1 --2- 172.21.15.50:0/2282794547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f6c0f6860 0x7f8f6c10c190 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:17.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.251+0000 7f8f70f33700 1 -- 172.21.15.50:0/2282794547 >> 172.21.15.50:0/2282794547 conn(0x7f8f6c0f0d40 msgr2=0x7f8f6c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:17.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.252+0000 7f8f70f33700 1 -- 172.21.15.50:0/2282794547 shutdown_connections 2023-01-04T18:16:17.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:17.252+0000 7f8f70f33700 1 -- 172.21.15.50:0/2282794547 wait complete. 2023-01-04T18:16:17.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:17 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:16.468901+0000 mon.smithi050 (mon.0) 584 : audit [DBG] from='client.? 172.21.15.50:0/1166518410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:16:17.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:17 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:16.891862+0000 mon.smithi050 (mon.0) 585 : audit [DBG] from='client.? 172.21.15.50:0/4067196584' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:16:17.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:17 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:16.468901+0000 mon.smithi050 (mon.0) 584 : audit [DBG] from='client.? 172.21.15.50:0/1166518410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:16:17.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:17 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:16.891862+0000 mon.smithi050 (mon.0) 585 : audit [DBG] from='client.? 172.21.15.50:0/4067196584' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:16:19.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:17.248657+0000 mgr.smithi098.vhfzum (mgr.24455) 9 : audit [DBG] from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:16:19.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:17.671077+0000 mon.smithi050 (mon.0) 586 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:16:19.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:17.909843+0000 mgr.smithi098.vhfzum (mgr.24455) 10 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 192 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 19 op/s 2023-01-04T18:16:19.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:17.248657+0000 mgr.smithi098.vhfzum (mgr.24455) 9 : audit [DBG] from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:16:19.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:17.671077+0000 mon.smithi050 (mon.0) 586 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:16:19.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:17.909843+0000 mgr.smithi098.vhfzum (mgr.24455) 10 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 192 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 19 op/s 2023-01-04T18:16:21.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:19.910622+0000 mgr.smithi098.vhfzum (mgr.24455) 11 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 244 MiB data, 957 MiB used, 535 GiB / 536 GiB avail; 4.1 MiB/s rd, 7.0 MiB/s wr, 41 op/s 2023-01-04T18:16:21.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:19.910622+0000 mgr.smithi098.vhfzum (mgr.24455) 11 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 244 MiB data, 957 MiB used, 535 GiB / 536 GiB avail; 4.1 MiB/s rd, 7.0 MiB/s wr, 41 op/s 2023-01-04T18:16:22.854 INFO:tasks.workunit.client.0.smithi050.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-01-04T18:16:22.854 INFO:tasks.workunit.client.0.smithi050.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-01-04T18:16:22.854 INFO:tasks.workunit.client.0.smithi050.stderr:+ make 2023-01-04T18:16:23.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:21.911104+0000 mgr.smithi098.vhfzum (mgr.24455) 12 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 244 MiB data, 957 MiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s rd, 6.4 MiB/s wr, 37 op/s 2023-01-04T18:16:23.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:21.911104+0000 mgr.smithi098.vhfzum (mgr.24455) 12 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 244 MiB data, 957 MiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s rd, 6.4 MiB/s wr, 37 op/s 2023-01-04T18:16:23.557 INFO:tasks.workunit.client.0.smithi050.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-01-04T18:16:23.819 INFO:tasks.workunit.client.0.smithi050.stderr:++ readlink -f fsstress 2023-01-04T18:16:23.820 INFO:tasks.workunit.client.0.smithi050.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-01-04T18:16:23.820 INFO:tasks.workunit.client.0.smithi050.stderr:+ popd 2023-01-04T18:16:23.821 INFO:tasks.workunit.client.0.smithi050.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-01-04T18:16:23.821 INFO:tasks.workunit.client.0.smithi050.stdout:~/cephtest/mnt.0/client.0/tmp 2023-01-04T18:16:23.821 INFO:tasks.workunit.client.0.smithi050.stderr:+ popd 2023-01-04T18:16:23.821 INFO:tasks.workunit.client.0.smithi050.stderr:++ mktemp -d -p . 2023-01-04T18:16:23.822 INFO:tasks.workunit.client.0.smithi050.stderr:+ T=./tmp.xOX7L42WvC 2023-01-04T18:16:23.822 INFO:tasks.workunit.client.0.smithi050.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.xOX7L42WvC -l 1 -n 1000 -p 10 -v 2023-01-04T18:16:23.824 INFO:tasks.workunit.client.0.smithi050.stdout:seed = 1673088982 2023-01-04T18:16:23.830 INFO:tasks.workunit.client.0.smithi050.stdout:0/0: mkdir d0 0 2023-01-04T18:16:23.830 INFO:tasks.workunit.client.0.smithi050.stdout:0/1: stat d0 0 2023-01-04T18:16:23.832 INFO:tasks.workunit.client.0.smithi050.stdout:2/0: stat - no entries 2023-01-04T18:16:23.832 INFO:tasks.workunit.client.0.smithi050.stdout:2/1: readlink - no filename 2023-01-04T18:16:23.832 INFO:tasks.workunit.client.0.smithi050.stdout:2/2: chown . 4027658 1 2023-01-04T18:16:23.832 INFO:tasks.workunit.client.0.smithi050.stdout:2/3: dread - no filename 2023-01-04T18:16:23.832 INFO:tasks.workunit.client.0.smithi050.stdout:2/4: write - no filename 2023-01-04T18:16:23.832 INFO:tasks.workunit.client.0.smithi050.stdout:2/5: write - no filename 2023-01-04T18:16:23.832 INFO:tasks.workunit.client.0.smithi050.stdout:2/6: getdents . 0 2023-01-04T18:16:23.832 INFO:tasks.workunit.client.0.smithi050.stdout:2/7: unlink - no file 2023-01-04T18:16:23.832 INFO:tasks.workunit.client.0.smithi050.stdout:2/8: fsync - no filename 2023-01-04T18:16:23.833 INFO:tasks.workunit.client.0.smithi050.stdout:2/9: rename - no filename 2023-01-04T18:16:23.833 INFO:tasks.workunit.client.0.smithi050.stdout:2/10: dwrite - no filename 2023-01-04T18:16:23.833 INFO:tasks.workunit.client.0.smithi050.stdout:2/11: unlink - no file 2023-01-04T18:16:23.833 INFO:tasks.workunit.client.0.smithi050.stdout:2/12: dwrite - no filename 2023-01-04T18:16:23.833 INFO:tasks.workunit.client.0.smithi050.stdout:2/13: dread - no filename 2023-01-04T18:16:23.833 INFO:tasks.workunit.client.0.smithi050.stdout:2/14: read - no filename 2023-01-04T18:16:23.833 INFO:tasks.workunit.client.0.smithi050.stdout:2/15: readlink - no filename 2023-01-04T18:16:23.833 INFO:tasks.workunit.client.0.smithi050.stdout:2/16: dwrite - no filename 2023-01-04T18:16:23.834 INFO:tasks.workunit.client.0.smithi050.stdout:1/0: creat f0 x:0 0 0 2023-01-04T18:16:23.834 INFO:tasks.workunit.client.0.smithi050.stdout:1/1: write f0 [459348,89764] 0 2023-01-04T18:16:23.834 INFO:tasks.workunit.client.0.smithi050.stdout:0/2: mknod d0/c1 0 2023-01-04T18:16:23.834 INFO:tasks.workunit.client.0.smithi050.stdout:0/3: fdatasync - no filename 2023-01-04T18:16:23.835 INFO:tasks.workunit.client.0.smithi050.stdout:0/4: readlink - no filename 2023-01-04T18:16:23.835 INFO:tasks.workunit.client.0.smithi050.stdout:0/5: chown d0 1 1 2023-01-04T18:16:23.835 INFO:tasks.workunit.client.0.smithi050.stdout:0/6: write - no filename 2023-01-04T18:16:23.835 INFO:tasks.workunit.client.0.smithi050.stdout:0/7: stat d0/c1 0 2023-01-04T18:16:23.835 INFO:tasks.workunit.client.0.smithi050.stdout:0/8: chown d0 62 1 2023-01-04T18:16:23.837 INFO:tasks.workunit.client.0.smithi050.stdout:2/17: creat f0 x:0 0 0 2023-01-04T18:16:23.838 INFO:tasks.workunit.client.0.smithi050.stdout:1/2: creat f1 x:0 0 0 2023-01-04T18:16:23.840 INFO:tasks.workunit.client.0.smithi050.stdout:0/9: symlink d0/l2 0 2023-01-04T18:16:23.840 INFO:tasks.workunit.client.0.smithi050.stdout:0/10: fdatasync - no filename 2023-01-04T18:16:23.850 INFO:tasks.workunit.client.0.smithi050.stdout:1/3: mknod c2 0 2023-01-04T18:16:23.850 INFO:tasks.workunit.client.0.smithi050.stdout:1/4: creat f3 x:0 0 0 2023-01-04T18:16:23.850 INFO:tasks.workunit.client.0.smithi050.stdout:1/5: rmdir - no directory 2023-01-04T18:16:23.850 INFO:tasks.workunit.client.0.smithi050.stdout:2/18: mkdir d1 0 2023-01-04T18:16:23.853 INFO:tasks.workunit.client.0.smithi050.stdout:1/6: mknod c4 0 2023-01-04T18:16:23.853 INFO:tasks.workunit.client.0.smithi050.stdout:1/7: chown f3 30862800 1 2023-01-04T18:16:23.853 INFO:tasks.workunit.client.0.smithi050.stdout:1/8: readlink - no filename 2023-01-04T18:16:23.856 INFO:tasks.workunit.client.0.smithi050.stdout:2/19: rename f0 to d1/f2 0 2023-01-04T18:16:23.856 INFO:tasks.workunit.client.0.smithi050.stdout:2/20: readlink - no filename 2023-01-04T18:16:23.860 INFO:tasks.workunit.client.0.smithi050.stdout:1/9: creat f5 x:0 0 0 2023-01-04T18:16:23.865 INFO:tasks.workunit.client.0.smithi050.stdout:1/10: rename f5 to f6 0 2023-01-04T18:16:23.872 INFO:tasks.workunit.client.0.smithi050.stdout:1/11: creat f7 x:0 0 0 2023-01-04T18:16:23.881 INFO:tasks.workunit.client.0.smithi050.stdout:1/12: mkdir d8 0 2023-01-04T18:16:23.881 INFO:tasks.workunit.client.0.smithi050.stdout:1/13: fdatasync f3 0 2023-01-04T18:16:23.890 INFO:tasks.workunit.client.0.smithi050.stdout:1/14: creat d8/f9 x:0 0 0 2023-01-04T18:16:23.966 INFO:tasks.workunit.client.0.smithi050.stdout:6/0: write - no filename 2023-01-04T18:16:23.967 INFO:tasks.workunit.client.0.smithi050.stdout:6/1: dread - no filename 2023-01-04T18:16:23.967 INFO:tasks.workunit.client.0.smithi050.stdout:6/2: dread - no filename 2023-01-04T18:16:23.967 INFO:tasks.workunit.client.0.smithi050.stdout:6/3: dwrite - no filename 2023-01-04T18:16:23.967 INFO:tasks.workunit.client.0.smithi050.stdout:6/4: write - no filename 2023-01-04T18:16:23.967 INFO:tasks.workunit.client.0.smithi050.stdout:5/0: dwrite - no filename 2023-01-04T18:16:23.968 INFO:tasks.workunit.client.0.smithi050.stdout:7/0: rename - no filename 2023-01-04T18:16:23.968 INFO:tasks.workunit.client.0.smithi050.stdout:9/0: link - no file 2023-01-04T18:16:23.968 INFO:tasks.workunit.client.0.smithi050.stdout:9/1: fdatasync - no filename 2023-01-04T18:16:23.977 INFO:tasks.workunit.client.0.smithi050.stdout:1/15: dwrite f3 [0,4194304] 0 2023-01-04T18:16:23.977 INFO:tasks.workunit.client.0.smithi050.stdout:1/16: write f0 [1467077,127153] 0 2023-01-04T18:16:24.163 INFO:tasks.workunit.client.0.smithi050.stdout:2/21: link d1/f2 d1/f3 0 2023-01-04T18:16:24.163 INFO:tasks.workunit.client.0.smithi050.stdout:2/22: truncate d1/f3 161103 0 2023-01-04T18:16:24.163 INFO:tasks.workunit.client.0.smithi050.stdout:2/23: rename d1 to d1/d4 22 2023-01-04T18:16:24.345 INFO:tasks.workunit.client.0.smithi050.stdout:4/0: creat f0 x:0 0 0 2023-01-04T18:16:24.345 INFO:tasks.workunit.client.0.smithi050.stdout:4/1: dread - f0 zero size 2023-01-04T18:16:24.346 INFO:tasks.workunit.client.0.smithi050.stdout:6/5: mkdir d0 0 2023-01-04T18:16:24.347 INFO:tasks.workunit.client.0.smithi050.stdout:5/1: symlink l0 0 2023-01-04T18:16:24.347 INFO:tasks.workunit.client.0.smithi050.stdout:5/2: write - no filename 2023-01-04T18:16:24.349 INFO:tasks.workunit.client.0.smithi050.stdout:7/1: mknod c0 0 2023-01-04T18:16:24.349 INFO:tasks.workunit.client.0.smithi050.stdout:7/2: readlink - no filename 2023-01-04T18:16:24.349 INFO:tasks.workunit.client.0.smithi050.stdout:7/3: fsync - no filename 2023-01-04T18:16:24.349 INFO:tasks.workunit.client.0.smithi050.stdout:7/4: dread - no filename 2023-01-04T18:16:24.350 INFO:tasks.workunit.client.0.smithi050.stdout:9/2: symlink l0 0 2023-01-04T18:16:24.350 INFO:tasks.workunit.client.0.smithi050.stdout:9/3: chown l0 3 1 2023-01-04T18:16:24.351 INFO:tasks.workunit.client.0.smithi050.stdout:9/4: readlink l0 0 2023-01-04T18:16:24.351 INFO:tasks.workunit.client.0.smithi050.stdout:9/5: truncate - no filename 2023-01-04T18:16:24.351 INFO:tasks.workunit.client.0.smithi050.stdout:9/6: dread - no filename 2023-01-04T18:16:24.351 INFO:tasks.workunit.client.0.smithi050.stdout:9/7: write - no filename 2023-01-04T18:16:24.351 INFO:tasks.workunit.client.0.smithi050.stdout:9/8: dread - no filename 2023-01-04T18:16:24.351 INFO:tasks.workunit.client.0.smithi050.stdout:9/9: write - no filename 2023-01-04T18:16:24.352 INFO:tasks.workunit.client.0.smithi050.stdout:8/0: creat f0 x:0 0 0 2023-01-04T18:16:24.358 INFO:tasks.workunit.client.0.smithi050.stdout:4/2: dwrite f0 [0,4194304] 0 2023-01-04T18:16:24.758 INFO:tasks.workunit.client.1.smithi098.stdout:6/9: sync 2023-01-04T18:16:24.758 INFO:tasks.workunit.client.1.smithi098.stdout:6/10: dwrite - no filename 2023-01-04T18:16:24.758 INFO:tasks.workunit.client.1.smithi098.stdout:9/56: sync 2023-01-04T18:16:24.758 INFO:tasks.workunit.client.1.smithi098.stdout:8/18: sync 2023-01-04T18:16:24.758 INFO:tasks.workunit.client.1.smithi098.stdout:7/26: sync 2023-01-04T18:16:24.759 INFO:tasks.workunit.client.1.smithi098.stdout:9/57: readlink d2/d5/ld 0 2023-01-04T18:16:24.759 INFO:tasks.workunit.client.1.smithi098.stdout:0/30: sync 2023-01-04T18:16:24.759 INFO:tasks.workunit.client.1.smithi098.stdout:3/17: sync 2023-01-04T18:16:24.759 INFO:tasks.workunit.client.1.smithi098.stdout:5/6: sync 2023-01-04T18:16:24.759 INFO:tasks.workunit.client.1.smithi098.stdout:5/7: dread - no filename 2023-01-04T18:16:24.759 INFO:tasks.workunit.client.1.smithi098.stdout:3/18: stat f1 0 2023-01-04T18:16:24.759 INFO:tasks.workunit.client.1.smithi098.stdout:1/4: sync 2023-01-04T18:16:24.759 INFO:tasks.workunit.client.1.smithi098.stdout:5/8: chown . 0 1 2023-01-04T18:16:24.759 INFO:tasks.workunit.client.1.smithi098.stdout:5/9: dread - no filename 2023-01-04T18:16:24.759 INFO:tasks.workunit.client.1.smithi098.stdout:3/19: stat l0 0 2023-01-04T18:16:24.759 INFO:tasks.workunit.client.1.smithi098.stdout:5/10: unlink - no file 2023-01-04T18:16:24.760 INFO:tasks.workunit.client.1.smithi098.stdout:5/11: rename - no filename 2023-01-04T18:16:24.760 INFO:tasks.workunit.client.1.smithi098.stdout:5/12: rename - no filename 2023-01-04T18:16:24.760 INFO:tasks.workunit.client.1.smithi098.stdout:5/13: fdatasync - no filename 2023-01-04T18:16:24.760 INFO:tasks.workunit.client.1.smithi098.stdout:5/14: truncate - no filename 2023-01-04T18:16:24.760 INFO:tasks.workunit.client.1.smithi098.stdout:1/5: stat f0 0 2023-01-04T18:16:24.760 INFO:tasks.workunit.client.1.smithi098.stdout:5/15: chown . 222622 1 2023-01-04T18:16:24.760 INFO:tasks.workunit.client.1.smithi098.stdout:5/16: dread - no filename 2023-01-04T18:16:24.760 INFO:tasks.workunit.client.1.smithi098.stdout:5/17: rmdir - no directory 2023-01-04T18:16:24.760 INFO:tasks.workunit.client.1.smithi098.stdout:3/20: dread - f3 zero size 2023-01-04T18:16:24.760 INFO:tasks.workunit.client.1.smithi098.stdout:5/18: dread - no filename 2023-01-04T18:16:24.760 INFO:tasks.workunit.client.1.smithi098.stdout:4/1: sync 2023-01-04T18:16:24.760 INFO:tasks.workunit.client.1.smithi098.stdout:3/21: stat l2 0 2023-01-04T18:16:24.761 INFO:tasks.workunit.client.1.smithi098.stdout:2/63: sync 2023-01-04T18:16:24.761 INFO:tasks.workunit.client.1.smithi098.stdout:6/11: rename l1 to l2 0 2023-01-04T18:16:24.761 INFO:tasks.workunit.client.1.smithi098.stdout:8/19: mknod c5 0 2023-01-04T18:16:24.761 INFO:tasks.workunit.client.1.smithi098.stdout:8/20: fsync f2 0 2023-01-04T18:16:24.762 INFO:tasks.workunit.client.1.smithi098.stdout:9/58: symlink d2/d5/lf 0 2023-01-04T18:16:24.769 INFO:tasks.workunit.client.1.smithi098.stdout:5/19: mknod c0 0 2023-01-04T18:16:24.769 INFO:tasks.workunit.client.1.smithi098.stdout:5/20: write - no filename 2023-01-04T18:16:24.769 INFO:tasks.workunit.client.1.smithi098.stdout:5/21: dread - no filename 2023-01-04T18:16:24.769 INFO:tasks.workunit.client.1.smithi098.stdout:1/6: creat d1/f2 x:0 0 0 2023-01-04T18:16:24.769 INFO:tasks.workunit.client.1.smithi098.stdout:4/2: symlink l0 0 2023-01-04T18:16:24.769 INFO:tasks.workunit.client.1.smithi098.stdout:4/3: dwrite - no filename 2023-01-04T18:16:24.770 INFO:tasks.workunit.client.1.smithi098.stdout:4/4: dwrite - no filename 2023-01-04T18:16:24.774 INFO:tasks.workunit.client.1.smithi098.stdout:3/22: dwrite f1 [4194304,4194304] 0 2023-01-04T18:16:24.774 INFO:tasks.workunit.client.1.smithi098.stdout:2/64: rmdir d6/dc 39 2023-01-04T18:16:24.774 INFO:tasks.workunit.client.1.smithi098.stdout:8/21: unlink c4 0 2023-01-04T18:16:24.775 INFO:tasks.workunit.client.1.smithi098.stdout:9/59: rename d2/f8 to d2/f10 0 2023-01-04T18:16:24.775 INFO:tasks.workunit.client.1.smithi098.stdout:9/60: fsync d2/d5/fb 0 2023-01-04T18:16:24.781 INFO:tasks.workunit.client.1.smithi098.stdout:8/22: dread f2 [0,4194304] 0 2023-01-04T18:16:24.781 INFO:tasks.workunit.client.1.smithi098.stdout:8/23: chown f2 10 1 2023-01-04T18:16:24.798 INFO:tasks.workunit.client.1.smithi098.stdout:6/12: getdents . 0 2023-01-04T18:16:24.798 INFO:tasks.workunit.client.1.smithi098.stdout:6/13: dread - no filename 2023-01-04T18:16:24.802 INFO:tasks.workunit.client.1.smithi098.stdout:5/22: mkdir d1 0 2023-01-04T18:16:24.802 INFO:tasks.workunit.client.1.smithi098.stdout:5/23: chown d1 3587 1 2023-01-04T18:16:24.802 INFO:tasks.workunit.client.1.smithi098.stdout:5/24: readlink - no filename 2023-01-04T18:16:24.803 INFO:tasks.workunit.client.1.smithi098.stdout:0/31: write f5 [2156193,94589] 0 2023-01-04T18:16:24.804 INFO:tasks.workunit.client.1.smithi098.stdout:1/7: symlink d1/l3 0 2023-01-04T18:16:24.805 INFO:tasks.workunit.client.1.smithi098.stdout:4/5: rename l0 to l1 0 2023-01-04T18:16:24.807 INFO:tasks.workunit.client.1.smithi098.stdout:3/23: creat f4 x:0 0 0 2023-01-04T18:16:24.810 INFO:tasks.workunit.client.1.smithi098.stdout:0/32: dread f1 [0,4194304] 0 2023-01-04T18:16:24.810 INFO:tasks.workunit.client.1.smithi098.stdout:9/61: mknod d2/c11 0 2023-01-04T18:16:24.812 INFO:tasks.workunit.client.1.smithi098.stdout:6/14: link l0 l3 0 2023-01-04T18:16:24.812 INFO:tasks.workunit.client.1.smithi098.stdout:6/15: fsync - no filename 2023-01-04T18:16:24.812 INFO:tasks.workunit.client.1.smithi098.stdout:6/16: dwrite - no filename 2023-01-04T18:16:24.812 INFO:tasks.workunit.client.1.smithi098.stdout:6/17: dwrite - no filename 2023-01-04T18:16:24.812 INFO:tasks.workunit.client.1.smithi098.stdout:6/18: dwrite - no filename 2023-01-04T18:16:24.812 INFO:tasks.workunit.client.1.smithi098.stdout:7/27: dread d1/f5 [0,4194304] 0 2023-01-04T18:16:24.814 INFO:tasks.workunit.client.1.smithi098.stdout:7/28: read d1/f7 [1144066,112248] 0 2023-01-04T18:16:24.814 INFO:tasks.workunit.client.1.smithi098.stdout:7/29: fsync d1/f5 0 2023-01-04T18:16:24.816 INFO:tasks.workunit.client.1.smithi098.stdout:5/25: mkdir d1/d2 0 2023-01-04T18:16:24.817 INFO:tasks.workunit.client.1.smithi098.stdout:5/26: dread - no filename 2023-01-04T18:16:24.817 INFO:tasks.workunit.client.1.smithi098.stdout:8/24: getdents . 0 2023-01-04T18:16:24.820 INFO:tasks.workunit.client.1.smithi098.stdout:1/8: creat d1/f4 x:0 0 0 2023-01-04T18:16:24.820 INFO:tasks.workunit.client.1.smithi098.stdout:1/9: write f0 [372013,14038] 0 2023-01-04T18:16:24.821 INFO:tasks.workunit.client.1.smithi098.stdout:4/6: link l1 l2 0 2023-01-04T18:16:24.822 INFO:tasks.workunit.client.1.smithi098.stdout:4/7: chown l2 573 1 2023-01-04T18:16:24.822 INFO:tasks.workunit.client.1.smithi098.stdout:4/8: write - no filename 2023-01-04T18:16:24.822 INFO:tasks.workunit.client.1.smithi098.stdout:4/9: dwrite - no filename 2023-01-04T18:16:24.822 INFO:tasks.workunit.client.1.smithi098.stdout:3/24: symlink l5 0 2023-01-04T18:16:24.823 INFO:tasks.workunit.client.1.smithi098.stdout:3/25: read - f4 zero size 2023-01-04T18:16:24.824 INFO:tasks.workunit.client.1.smithi098.stdout:2/65: mknod d6/dc/c18 0 2023-01-04T18:16:24.827 INFO:tasks.workunit.client.1.smithi098.stdout:0/33: getdents . 0 2023-01-04T18:16:24.828 INFO:tasks.workunit.client.1.smithi098.stdout:0/34: stat la 0 2023-01-04T18:16:24.828 INFO:tasks.workunit.client.1.smithi098.stdout:6/19: creat f4 x:0 0 0 2023-01-04T18:16:24.831 INFO:tasks.workunit.client.1.smithi098.stdout:7/30: symlink d1/da/lb 0 2023-01-04T18:16:24.835 INFO:tasks.workunit.client.1.smithi098.stdout:9/62: dread f0 [0,4194304] 0 2023-01-04T18:16:24.836 INFO:tasks.workunit.client.1.smithi098.stdout:5/27: creat d1/d2/f3 x:0 0 0 2023-01-04T18:16:24.836 INFO:tasks.workunit.client.1.smithi098.stdout:4/10: mknod c3 0 2023-01-04T18:16:24.836 INFO:tasks.workunit.client.1.smithi098.stdout:4/11: dwrite - no filename 2023-01-04T18:16:24.836 INFO:tasks.workunit.client.1.smithi098.stdout:4/12: dwrite - no filename 2023-01-04T18:16:24.836 INFO:tasks.workunit.client.1.smithi098.stdout:4/13: chown c3 56184946 1 2023-01-04T18:16:24.837 INFO:tasks.workunit.client.1.smithi098.stdout:7/31: read d1/f7 [280505,47970] 0 2023-01-04T18:16:24.837 INFO:tasks.workunit.client.1.smithi098.stdout:7/32: truncate d1/f5 994189 0 2023-01-04T18:16:24.839 INFO:tasks.workunit.client.1.smithi098.stdout:9/63: dread d2/f10 [0,4194304] 0 2023-01-04T18:16:24.839 INFO:tasks.workunit.client.1.smithi098.stdout:9/64: chown d2/la 219352094 1 2023-01-04T18:16:24.839 INFO:tasks.workunit.client.1.smithi098.stdout:0/35: rename lb to ld 0 2023-01-04T18:16:24.841 INFO:tasks.workunit.client.1.smithi098.stdout:0/36: write f1 [3355683,58051] 0 2023-01-04T18:16:24.841 INFO:tasks.workunit.client.1.smithi098.stdout:0/37: readlink l7 0 2023-01-04T18:16:24.841 INFO:tasks.workunit.client.1.smithi098.stdout:0/38: write f1 [5786206,64872] 0 2023-01-04T18:16:24.841 INFO:tasks.workunit.client.1.smithi098.stdout:0/39: chown c4 0 1 2023-01-04T18:16:24.841 INFO:tasks.workunit.client.1.smithi098.stdout:0/40: chown l9 345022 1 2023-01-04T18:16:24.841 INFO:tasks.workunit.client.1.smithi098.stdout:0/41: readlink l2 0 2023-01-04T18:16:24.842 INFO:tasks.workunit.client.1.smithi098.stdout:0/42: chown c8 1142 1 2023-01-04T18:16:24.842 INFO:tasks.workunit.client.1.smithi098.stdout:6/20: unlink l2 0 2023-01-04T18:16:24.842 INFO:tasks.workunit.client.1.smithi098.stdout:6/21: chown l3 195895 1 2023-01-04T18:16:24.842 INFO:tasks.workunit.client.1.smithi098.stdout:6/22: write f4 [692165,102520] 0 2023-01-04T18:16:24.842 INFO:tasks.workunit.client.1.smithi098.stdout:6/23: truncate f4 1027505 0 2023-01-04T18:16:24.842 INFO:tasks.workunit.client.1.smithi098.stdout:7/33: read d1/f7 [239029,60068] 0 2023-01-04T18:16:24.842 INFO:tasks.workunit.client.1.smithi098.stdout:7/34: chown d1/l9 25 1 2023-01-04T18:16:24.843 INFO:tasks.workunit.client.1.smithi098.stdout:7/35: readlink d1/da/lb 0 2023-01-04T18:16:24.843 INFO:tasks.workunit.client.1.smithi098.stdout:4/14: creat f4 x:0 0 0 2023-01-04T18:16:24.844 INFO:tasks.workunit.client.1.smithi098.stdout:2/66: symlink d6/dc/l19 0 2023-01-04T18:16:24.846 INFO:tasks.workunit.client.1.smithi098.stdout:0/43: rename c8 to ce 0 2023-01-04T18:16:24.847 INFO:tasks.workunit.client.1.smithi098.stdout:6/24: creat f5 x:0 0 0 2023-01-04T18:16:24.847 INFO:tasks.workunit.client.1.smithi098.stdout:6/25: chown l0 3760 1 2023-01-04T18:16:24.847 INFO:tasks.workunit.client.1.smithi098.stdout:6/26: rmdir - no directory 2023-01-04T18:16:24.848 INFO:tasks.workunit.client.1.smithi098.stdout:8/25: dwrite f2 [4194304,4194304] 0 2023-01-04T18:16:24.848 INFO:tasks.workunit.client.1.smithi098.stdout:8/26: chown c5 4 1 2023-01-04T18:16:24.848 INFO:tasks.workunit.client.1.smithi098.stdout:6/27: read f4 [918236,2040] 0 2023-01-04T18:16:24.848 INFO:tasks.workunit.client.1.smithi098.stdout:6/28: chown l3 1624900 1 2023-01-04T18:16:24.849 INFO:tasks.workunit.client.1.smithi098.stdout:3/26: dwrite f3 [0,4194304] 0 2023-01-04T18:16:24.849 INFO:tasks.workunit.client.1.smithi098.stdout:8/27: write f2 [4099889,99225] 0 2023-01-04T18:16:24.850 INFO:tasks.workunit.client.1.smithi098.stdout:3/27: write f3 [3974412,5087] 0 2023-01-04T18:16:24.850 INFO:tasks.workunit.client.1.smithi098.stdout:3/28: dread - f4 zero size 2023-01-04T18:16:24.855 INFO:tasks.workunit.client.1.smithi098.stdout:7/36: write d1/f5 [1843422,37273] 0 2023-01-04T18:16:24.858 INFO:tasks.workunit.client.1.smithi098.stdout:0/44: mkdir df 0 2023-01-04T18:16:24.860 INFO:tasks.workunit.client.1.smithi098.stdout:6/29: mknod c6 0 2023-01-04T18:16:24.862 INFO:tasks.workunit.client.1.smithi098.stdout:7/37: dread d1/f5 [0,4194304] 0 2023-01-04T18:16:24.867 INFO:tasks.workunit.client.1.smithi098.stdout:2/67: mknod d6/c1a 0 2023-01-04T18:16:24.867 INFO:tasks.workunit.client.1.smithi098.stdout:2/68: dread - d6/f10 zero size 2023-01-04T18:16:24.869 INFO:tasks.workunit.client.1.smithi098.stdout:6/30: symlink l7 0 2023-01-04T18:16:24.870 INFO:tasks.workunit.client.1.smithi098.stdout:7/38: mknod d1/da/cc 0 2023-01-04T18:16:24.873 INFO:tasks.workunit.client.1.smithi098.stdout:6/31: rename l3 to l8 0 2023-01-04T18:16:24.873 INFO:tasks.workunit.client.1.smithi098.stdout:6/32: read f4 [120609,40788] 0 2023-01-04T18:16:24.873 INFO:tasks.workunit.client.1.smithi098.stdout:6/33: dread - f5 zero size 2023-01-04T18:16:24.874 INFO:tasks.workunit.client.1.smithi098.stdout:7/39: mkdir d1/dd 0 2023-01-04T18:16:24.874 INFO:tasks.workunit.client.0.smithi050.stdout:6/6: mknod d0/c1 0 2023-01-04T18:16:24.876 INFO:tasks.workunit.client.1.smithi098.stdout:7/40: rename d1/da/lb to d1/le 0 2023-01-04T18:16:24.877 INFO:tasks.workunit.client.0.smithi050.stdout:5/3: unlink l0 0 2023-01-04T18:16:24.877 INFO:tasks.workunit.client.0.smithi050.stdout:5/4: dwrite - no filename 2023-01-04T18:16:24.877 INFO:tasks.workunit.client.0.smithi050.stdout:5/5: rename - no filename 2023-01-04T18:16:24.878 INFO:tasks.workunit.client.1.smithi098.stdout:0/45: dwrite f5 [0,4194304] 0 2023-01-04T18:16:24.878 INFO:tasks.workunit.client.0.smithi050.stdout:7/5: mknod c1 0 2023-01-04T18:16:24.878 INFO:tasks.workunit.client.0.smithi050.stdout:7/6: dread - no filename 2023-01-04T18:16:24.878 INFO:tasks.workunit.client.0.smithi050.stdout:7/7: dwrite - no filename 2023-01-04T18:16:24.879 INFO:tasks.workunit.client.0.smithi050.stdout:7/8: truncate - no filename 2023-01-04T18:16:24.879 INFO:tasks.workunit.client.0.smithi050.stdout:7/9: truncate - no filename 2023-01-04T18:16:24.879 INFO:tasks.workunit.client.0.smithi050.stdout:7/10: fsync - no filename 2023-01-04T18:16:24.879 INFO:tasks.workunit.client.0.smithi050.stdout:7/11: fdatasync - no filename 2023-01-04T18:16:24.879 INFO:tasks.workunit.client.1.smithi098.stdout:7/41: read d1/f7 [1344684,118431] 0 2023-01-04T18:16:24.880 INFO:tasks.workunit.client.0.smithi050.stdout:9/10: mkdir d1 0 2023-01-04T18:16:24.880 INFO:tasks.workunit.client.0.smithi050.stdout:9/11: read - no filename 2023-01-04T18:16:24.880 INFO:tasks.workunit.client.0.smithi050.stdout:9/12: chown l0 19 1 2023-01-04T18:16:24.880 INFO:tasks.workunit.client.0.smithi050.stdout:9/13: truncate - no filename 2023-01-04T18:16:24.880 INFO:tasks.workunit.client.0.smithi050.stdout:9/14: dwrite - no filename 2023-01-04T18:16:24.881 INFO:tasks.workunit.client.0.smithi050.stdout:9/15: dwrite - no filename 2023-01-04T18:16:24.881 INFO:tasks.workunit.client.0.smithi050.stdout:9/16: truncate - no filename 2023-01-04T18:16:24.881 INFO:tasks.workunit.client.0.smithi050.stdout:9/17: chown l0 35107973 1 2023-01-04T18:16:24.881 INFO:tasks.workunit.client.0.smithi050.stdout:9/18: chown l0 58002 1 2023-01-04T18:16:24.881 INFO:tasks.workunit.client.0.smithi050.stdout:9/19: chown l0 1345 1 2023-01-04T18:16:24.881 INFO:tasks.workunit.client.0.smithi050.stdout:9/20: dwrite - no filename 2023-01-04T18:16:24.881 INFO:tasks.workunit.client.0.smithi050.stdout:9/21: stat l0 0 2023-01-04T18:16:24.881 INFO:tasks.workunit.client.0.smithi050.stdout:9/22: read - no filename 2023-01-04T18:16:24.881 INFO:tasks.workunit.client.0.smithi050.stdout:9/23: chown l0 1186267 1 2023-01-04T18:16:24.881 INFO:tasks.workunit.client.0.smithi050.stdout:8/1: getdents . 0 2023-01-04T18:16:24.881 INFO:tasks.workunit.client.0.smithi050.stdout:8/2: readlink - no filename 2023-01-04T18:16:24.882 INFO:tasks.workunit.client.1.smithi098.stdout:7/42: truncate d1/f7 1337088 0 2023-01-04T18:16:24.883 INFO:tasks.workunit.client.0.smithi050.stdout:2/24: dread d1/f2 [0,4194304] 0 2023-01-04T18:16:24.883 INFO:tasks.workunit.client.0.smithi050.stdout:2/25: chown d1/f2 111980 1 2023-01-04T18:16:24.883 INFO:tasks.workunit.client.0.smithi050.stdout:2/26: write d1/f3 [429479,28033] 0 2023-01-04T18:16:24.883 INFO:tasks.workunit.client.0.smithi050.stdout:2/27: write d1/f2 [768212,11619] 0 2023-01-04T18:16:24.883 INFO:tasks.workunit.client.0.smithi050.stdout:2/28: truncate d1/f3 1789753 0 2023-01-04T18:16:24.883 INFO:tasks.workunit.client.0.smithi050.stdout:6/7: rmdir d0 39 2023-01-04T18:16:24.883 INFO:tasks.workunit.client.0.smithi050.stdout:6/8: write - no filename 2023-01-04T18:16:24.883 INFO:tasks.workunit.client.0.smithi050.stdout:6/9: read - no filename 2023-01-04T18:16:24.884 INFO:tasks.workunit.client.0.smithi050.stdout:6/10: truncate - no filename 2023-01-04T18:16:24.885 INFO:tasks.workunit.client.0.smithi050.stdout:5/6: creat f1 x:0 0 0 2023-01-04T18:16:24.885 INFO:tasks.workunit.client.0.smithi050.stdout:5/7: truncate f1 944391 0 2023-01-04T18:16:24.886 INFO:tasks.workunit.client.0.smithi050.stdout:7/12: creat f2 x:0 0 0 2023-01-04T18:16:24.886 INFO:tasks.workunit.client.0.smithi050.stdout:7/13: chown c1 1567 1 2023-01-04T18:16:24.886 INFO:tasks.workunit.client.0.smithi050.stdout:7/14: write f2 [996210,17122] 0 2023-01-04T18:16:24.887 INFO:tasks.workunit.client.0.smithi050.stdout:9/24: mknod d1/c2 0 2023-01-04T18:16:24.887 INFO:tasks.workunit.client.0.smithi050.stdout:7/15: write f2 [704736,100956] 0 2023-01-04T18:16:24.887 INFO:tasks.workunit.client.0.smithi050.stdout:7/16: readlink - no filename 2023-01-04T18:16:24.888 INFO:tasks.workunit.client.0.smithi050.stdout:8/3: symlink l1 0 2023-01-04T18:16:24.890 INFO:tasks.workunit.client.0.smithi050.stdout:6/11: unlink d0/c1 0 2023-01-04T18:16:24.890 INFO:tasks.workunit.client.0.smithi050.stdout:6/12: dwrite - no filename 2023-01-04T18:16:24.890 INFO:tasks.workunit.client.0.smithi050.stdout:6/13: write - no filename 2023-01-04T18:16:24.890 INFO:tasks.workunit.client.0.smithi050.stdout:6/14: write - no filename 2023-01-04T18:16:24.890 INFO:tasks.workunit.client.0.smithi050.stdout:6/15: readlink - no filename 2023-01-04T18:16:24.890 INFO:tasks.workunit.client.0.smithi050.stdout:5/8: rename f1 to f2 0 2023-01-04T18:16:24.892 INFO:tasks.workunit.client.0.smithi050.stdout:9/25: mkdir d1/d3 0 2023-01-04T18:16:24.892 INFO:tasks.workunit.client.0.smithi050.stdout:8/4: chown f0 1600051 1 2023-01-04T18:16:24.892 INFO:tasks.workunit.client.0.smithi050.stdout:8/5: write f0 [389222,49939] 0 2023-01-04T18:16:24.893 INFO:tasks.workunit.client.0.smithi050.stdout:6/16: mknod d0/c2 0 2023-01-04T18:16:24.893 INFO:tasks.workunit.client.0.smithi050.stdout:6/17: dwrite - no filename 2023-01-04T18:16:24.893 INFO:tasks.workunit.client.0.smithi050.stdout:6/18: dread - no filename 2023-01-04T18:16:24.894 INFO:tasks.workunit.client.0.smithi050.stdout:9/26: creat d1/d3/f4 x:0 0 0 2023-01-04T18:16:24.894 INFO:tasks.workunit.client.0.smithi050.stdout:9/27: dread - d1/d3/f4 zero size 2023-01-04T18:16:24.894 INFO:tasks.workunit.client.0.smithi050.stdout:9/28: truncate d1/d3/f4 15606 0 2023-01-04T18:16:24.895 INFO:tasks.workunit.client.0.smithi050.stdout:8/6: unlink f0 0 2023-01-04T18:16:24.895 INFO:tasks.workunit.client.0.smithi050.stdout:8/7: chown l1 165830663 1 2023-01-04T18:16:24.895 INFO:tasks.workunit.client.0.smithi050.stdout:8/8: write - no filename 2023-01-04T18:16:24.895 INFO:tasks.workunit.client.0.smithi050.stdout:6/19: mknod d0/c3 0 2023-01-04T18:16:24.896 INFO:tasks.workunit.client.0.smithi050.stdout:9/29: creat d1/f5 x:0 0 0 2023-01-04T18:16:24.897 INFO:tasks.workunit.client.0.smithi050.stdout:7/17: dread f2 [0,4194304] 0 2023-01-04T18:16:24.897 INFO:tasks.workunit.client.0.smithi050.stdout:7/18: rmdir - no directory 2023-01-04T18:16:24.897 INFO:tasks.workunit.client.0.smithi050.stdout:6/20: rename d0/c2 to d0/c4 0 2023-01-04T18:16:24.897 INFO:tasks.workunit.client.0.smithi050.stdout:6/21: write - no filename 2023-01-04T18:16:24.898 INFO:tasks.workunit.client.0.smithi050.stdout:9/30: symlink d1/l6 0 2023-01-04T18:16:24.898 INFO:tasks.workunit.client.0.smithi050.stdout:8/9: mknod c2 0 2023-01-04T18:16:24.900 INFO:tasks.workunit.client.0.smithi050.stdout:7/19: unlink c1 0 2023-01-04T18:16:24.900 INFO:tasks.workunit.client.0.smithi050.stdout:7/20: write f2 [1710197,5871] 0 2023-01-04T18:16:24.900 INFO:tasks.workunit.client.0.smithi050.stdout:6/22: mknod d0/c5 0 2023-01-04T18:16:24.900 INFO:tasks.workunit.client.0.smithi050.stdout:6/23: write - no filename 2023-01-04T18:16:24.901 INFO:tasks.workunit.client.1.smithi098.stdout:0/46: dwrite f0 [0,4194304] 0 2023-01-04T18:16:24.901 INFO:tasks.workunit.client.0.smithi050.stdout:9/31: mkdir d1/d3/d7 0 2023-01-04T18:16:24.901 INFO:tasks.workunit.client.0.smithi050.stdout:9/32: truncate d1/f5 37944 0 2023-01-04T18:16:24.902 INFO:tasks.workunit.client.0.smithi050.stdout:7/21: symlink l3 0 2023-01-04T18:16:24.903 INFO:tasks.workunit.client.0.smithi050.stdout:6/24: mknod d0/c6 0 2023-01-04T18:16:24.904 INFO:tasks.workunit.client.0.smithi050.stdout:6/25: chown d0 103208 1 2023-01-04T18:16:24.904 INFO:tasks.workunit.client.0.smithi050.stdout:6/26: dwrite - no filename 2023-01-04T18:16:24.904 INFO:tasks.workunit.client.0.smithi050.stdout:6/27: write - no filename 2023-01-04T18:16:24.905 INFO:tasks.workunit.client.0.smithi050.stdout:9/33: unlink d1/l6 0 2023-01-04T18:16:24.905 INFO:tasks.workunit.client.0.smithi050.stdout:8/10: mkdir d3 0 2023-01-04T18:16:24.906 INFO:tasks.workunit.client.1.smithi098.stdout:1/10: dwrite d1/f2 [0,4194304] 0 2023-01-04T18:16:24.907 INFO:tasks.workunit.client.0.smithi050.stdout:6/28: creat d0/f7 x:0 0 0 2023-01-04T18:16:24.909 INFO:tasks.workunit.client.0.smithi050.stdout:8/11: mknod d3/c4 0 2023-01-04T18:16:24.910 INFO:tasks.workunit.client.0.smithi050.stdout:8/12: chown d3/c4 503 1 2023-01-04T18:16:24.910 INFO:tasks.workunit.client.0.smithi050.stdout:8/13: dread - no filename 2023-01-04T18:16:24.910 INFO:tasks.workunit.client.0.smithi050.stdout:7/22: dread f2 [0,4194304] 0 2023-01-04T18:16:24.910 INFO:tasks.workunit.client.0.smithi050.stdout:7/23: write f2 [2673182,127800] 0 2023-01-04T18:16:24.911 INFO:tasks.workunit.client.1.smithi098.stdout:1/11: mknod d1/c5 0 2023-01-04T18:16:24.914 INFO:tasks.workunit.client.0.smithi050.stdout:8/14: rmdir d3 39 2023-01-04T18:16:24.914 INFO:tasks.workunit.client.0.smithi050.stdout:8/15: truncate - no filename 2023-01-04T18:16:24.916 INFO:tasks.workunit.client.1.smithi098.stdout:4/15: getdents . 0 2023-01-04T18:16:24.917 INFO:tasks.workunit.client.1.smithi098.stdout:4/16: readlink l2 0 2023-01-04T18:16:24.917 INFO:tasks.workunit.client.1.smithi098.stdout:4/17: dread - f4 zero size 2023-01-04T18:16:24.917 INFO:tasks.workunit.client.1.smithi098.stdout:4/18: write f4 [664308,44450] 0 2023-01-04T18:16:24.918 INFO:tasks.workunit.client.1.smithi098.stdout:1/12: creat d1/f6 x:0 0 0 2023-01-04T18:16:24.918 INFO:tasks.workunit.client.1.smithi098.stdout:1/13: write f0 [637292,88853] 0 2023-01-04T18:16:24.919 INFO:tasks.workunit.client.1.smithi098.stdout:1/14: chown d1/f4 1 1 2023-01-04T18:16:24.920 INFO:tasks.workunit.client.0.smithi050.stdout:8/16: mkdir d3/d5 0 2023-01-04T18:16:24.920 INFO:tasks.workunit.client.0.smithi050.stdout:8/17: write - no filename 2023-01-04T18:16:24.921 INFO:tasks.workunit.client.1.smithi098.stdout:1/15: write d1/f2 [2941923,130234] 0 2023-01-04T18:16:24.921 INFO:tasks.workunit.client.1.smithi098.stdout:1/16: rename d1 to d1/d7 22 2023-01-04T18:16:24.922 INFO:tasks.workunit.client.1.smithi098.stdout:1/17: readlink d1/l3 0 2023-01-04T18:16:24.922 INFO:tasks.workunit.client.1.smithi098.stdout:4/19: mkdir d5 0 2023-01-04T18:16:24.922 INFO:tasks.workunit.client.0.smithi050.stdout:8/18: unlink l1 0 2023-01-04T18:16:24.924 INFO:tasks.workunit.client.0.smithi050.stdout:8/19: mknod d3/c6 0 2023-01-04T18:16:24.924 INFO:tasks.workunit.client.0.smithi050.stdout:8/20: dread - no filename 2023-01-04T18:16:24.925 INFO:tasks.workunit.client.0.smithi050.stdout:8/21: dwrite - no filename 2023-01-04T18:16:24.925 INFO:tasks.workunit.client.0.smithi050.stdout:8/22: dwrite - no filename 2023-01-04T18:16:24.925 INFO:tasks.workunit.client.0.smithi050.stdout:8/23: rename c2 to d3/c7 0 2023-01-04T18:16:24.925 INFO:tasks.workunit.client.0.smithi050.stdout:8/24: dread - no filename 2023-01-04T18:16:24.926 INFO:tasks.workunit.client.1.smithi098.stdout:1/18: mkdir d1/d8 0 2023-01-04T18:16:24.926 INFO:tasks.workunit.client.1.smithi098.stdout:4/20: write f4 [31336,57625] 0 2023-01-04T18:16:24.926 INFO:tasks.workunit.client.0.smithi050.stdout:8/25: rename d3/c4 to d3/c8 0 2023-01-04T18:16:24.927 INFO:tasks.workunit.client.1.smithi098.stdout:1/19: rename d1/l3 to d1/d8/l9 0 2023-01-04T18:16:24.928 INFO:tasks.workunit.client.1.smithi098.stdout:1/20: mkdir d1/d8/da 0 2023-01-04T18:16:24.929 INFO:tasks.workunit.client.1.smithi098.stdout:1/21: fsync d1/f4 0 2023-01-04T18:16:24.929 INFO:tasks.workunit.client.1.smithi098.stdout:1/22: mknod d1/d8/da/cb 0 2023-01-04T18:16:24.943 INFO:tasks.workunit.client.1.smithi098.stdout:1/23: dwrite d1/f4 [0,4194304] 0 2023-01-04T18:16:24.943 INFO:tasks.workunit.client.1.smithi098.stdout:1/24: fsync d1/f4 0 2023-01-04T18:16:24.952 INFO:tasks.workunit.client.1.smithi098.stdout:8/28: dwrite f2 [4194304,4194304] 0 2023-01-04T18:16:24.954 INFO:tasks.workunit.client.1.smithi098.stdout:6/34: truncate f4 13050 0 2023-01-04T18:16:24.963 INFO:tasks.workunit.client.1.smithi098.stdout:8/29: dread f2 [0,4194304] 0 2023-01-04T18:16:24.963 INFO:tasks.workunit.client.0.smithi050.stdout:5/9: unlink f2 0 2023-01-04T18:16:24.967 INFO:tasks.workunit.client.0.smithi050.stdout:9/34: fsync d1/f5 0 2023-01-04T18:16:24.973 INFO:tasks.workunit.client.0.smithi050.stdout:8/26: rmdir d3 39 2023-01-04T18:16:24.975 INFO:tasks.workunit.client.1.smithi098.stdout:0/47: truncate f5 5918800 0 2023-01-04T18:16:24.976 INFO:tasks.workunit.client.0.smithi050.stdout:5/10: symlink l3 0 2023-01-04T18:16:24.979 INFO:tasks.workunit.client.0.smithi050.stdout:9/35: symlink d1/d3/l8 0 2023-01-04T18:16:24.980 INFO:tasks.workunit.client.0.smithi050.stdout:9/36: getdents d1/d3/d7 0 2023-01-04T18:16:24.982 INFO:tasks.workunit.client.0.smithi050.stdout:6/29: dwrite d0/f7 [0,4194304] 0 2023-01-04T18:16:24.982 INFO:tasks.workunit.client.0.smithi050.stdout:6/30: readlink - no filename 2023-01-04T18:16:24.982 INFO:tasks.workunit.client.0.smithi050.stdout:6/31: fsync d0/f7 0 2023-01-04T18:16:24.984 INFO:tasks.workunit.client.0.smithi050.stdout:8/27: mknod d3/c9 0 2023-01-04T18:16:24.984 INFO:tasks.workunit.client.0.smithi050.stdout:8/28: dread - no filename 2023-01-04T18:16:24.984 INFO:tasks.workunit.client.0.smithi050.stdout:8/29: write - no filename 2023-01-04T18:16:24.984 INFO:tasks.workunit.client.0.smithi050.stdout:8/30: write - no filename 2023-01-04T18:16:24.985 INFO:tasks.workunit.client.0.smithi050.stdout:8/31: dwrite - no filename 2023-01-04T18:16:24.985 INFO:tasks.workunit.client.0.smithi050.stdout:8/32: dread - no filename 2023-01-04T18:16:24.985 INFO:tasks.workunit.client.0.smithi050.stdout:8/33: truncate - no filename 2023-01-04T18:16:24.985 INFO:tasks.workunit.client.0.smithi050.stdout:8/34: fsync - no filename 2023-01-04T18:16:24.985 INFO:tasks.workunit.client.0.smithi050.stdout:8/35: chown d3/c8 2555 1 2023-01-04T18:16:24.986 INFO:tasks.workunit.client.1.smithi098.stdout:0/48: symlink df/l10 0 2023-01-04T18:16:24.986 INFO:tasks.workunit.client.1.smithi098.stdout:0/49: stat l7 0 2023-01-04T18:16:24.986 INFO:tasks.workunit.client.0.smithi050.stdout:5/11: symlink l4 0 2023-01-04T18:16:24.986 INFO:tasks.workunit.client.0.smithi050.stdout:5/12: dread - no filename 2023-01-04T18:16:24.986 INFO:tasks.workunit.client.0.smithi050.stdout:9/37: dread d1/f5 [0,4194304] 0 2023-01-04T18:16:24.987 INFO:tasks.workunit.client.1.smithi098.stdout:0/50: creat df/f11 x:0 0 0 2023-01-04T18:16:24.988 INFO:tasks.workunit.client.0.smithi050.stdout:8/36: mknod d3/d5/ca 0 2023-01-04T18:16:24.988 INFO:tasks.workunit.client.0.smithi050.stdout:8/37: fdatasync - no filename 2023-01-04T18:16:24.989 INFO:tasks.workunit.client.0.smithi050.stdout:7/24: dread f2 [0,4194304] 0 2023-01-04T18:16:24.990 INFO:tasks.workunit.client.1.smithi098.stdout:0/51: rename c4 to df/c12 0 2023-01-04T18:16:24.990 INFO:tasks.workunit.client.1.smithi098.stdout:0/52: fdatasync df/f11 0 2023-01-04T18:16:24.990 INFO:tasks.workunit.client.0.smithi050.stdout:5/13: symlink l5 0 2023-01-04T18:16:24.990 INFO:tasks.workunit.client.0.smithi050.stdout:5/14: chown l5 227044 1 2023-01-04T18:16:24.990 INFO:tasks.workunit.client.0.smithi050.stdout:5/15: write - no filename 2023-01-04T18:16:24.991 INFO:tasks.workunit.client.0.smithi050.stdout:5/16: write - no filename 2023-01-04T18:16:24.991 INFO:tasks.workunit.client.0.smithi050.stdout:5/17: dread - no filename 2023-01-04T18:16:24.991 INFO:tasks.workunit.client.0.smithi050.stdout:5/18: readlink l3 0 2023-01-04T18:16:24.991 INFO:tasks.workunit.client.0.smithi050.stdout:5/19: fsync - no filename 2023-01-04T18:16:24.991 INFO:tasks.workunit.client.0.smithi050.stdout:5/20: chown l3 1782 1 2023-01-04T18:16:24.991 INFO:tasks.workunit.client.0.smithi050.stdout:9/38: unlink l0 0 2023-01-04T18:16:24.992 INFO:tasks.workunit.client.0.smithi050.stdout:7/25: link l3 l4 0 2023-01-04T18:16:24.993 INFO:tasks.workunit.client.1.smithi098.stdout:9/65: dwrite d2/f10 [0,4194304] 0 2023-01-04T18:16:24.994 INFO:tasks.workunit.client.1.smithi098.stdout:4/21: dwrite f4 [0,4194304] 0 2023-01-04T18:16:24.994 INFO:tasks.workunit.client.1.smithi098.stdout:1/25: dwrite f0 [0,4194304] 0 2023-01-04T18:16:24.995 INFO:tasks.workunit.client.0.smithi050.stdout:5/21: rename l5 to l6 0 2023-01-04T18:16:24.996 INFO:tasks.workunit.client.1.smithi098.stdout:2/69: dwrite f5 [4194304,4194304] 0 2023-01-04T18:16:24.996 INFO:tasks.workunit.client.0.smithi050.stdout:9/39: dread d1/f5 [0,4194304] 0 2023-01-04T18:16:24.996 INFO:tasks.workunit.client.0.smithi050.stdout:9/40: chown d1/d3/l8 1583401847 1 2023-01-04T18:16:24.999 INFO:tasks.workunit.client.0.smithi050.stdout:5/22: unlink l3 0 2023-01-04T18:16:24.999 INFO:tasks.workunit.client.0.smithi050.stdout:5/23: chown l6 260165496 1 2023-01-04T18:16:25.000 INFO:tasks.workunit.client.1.smithi098.stdout:6/35: dread f4 [0,4194304] 0 2023-01-04T18:16:25.002 INFO:tasks.workunit.client.1.smithi098.stdout:2/70: dread d6/f7 [0,4194304] 0 2023-01-04T18:16:25.003 INFO:tasks.workunit.client.1.smithi098.stdout:2/71: stat d6/f10 0 2023-01-04T18:16:25.003 INFO:tasks.workunit.client.1.smithi098.stdout:9/66: dread f1 [0,4194304] 0 2023-01-04T18:16:25.003 INFO:tasks.workunit.client.1.smithi098.stdout:9/67: dread - d2/d5/fb zero size 2023-01-04T18:16:25.003 INFO:tasks.workunit.client.1.smithi098.stdout:8/30: truncate f2 5020361 0 2023-01-04T18:16:25.006 INFO:tasks.workunit.client.1.smithi098.stdout:4/22: chown l2 117 1 2023-01-04T18:16:25.006 INFO:tasks.workunit.client.0.smithi050.stdout:6/32: truncate d0/f7 496391 0 2023-01-04T18:16:25.007 INFO:tasks.workunit.client.1.smithi098.stdout:4/23: write f4 [2105679,68303] 0 2023-01-04T18:16:25.008 INFO:tasks.workunit.client.1.smithi098.stdout:1/26: unlink d1/d8/l9 0 2023-01-04T18:16:25.009 INFO:tasks.workunit.client.0.smithi050.stdout:8/38: getdents d3/d5 0 2023-01-04T18:16:25.011 INFO:tasks.workunit.client.1.smithi098.stdout:0/53: rename df/c12 to df/c13 0 2023-01-04T18:16:25.013 INFO:tasks.workunit.client.0.smithi050.stdout:5/24: rename l6 to l7 0 2023-01-04T18:16:25.013 INFO:tasks.workunit.client.0.smithi050.stdout:5/25: write - no filename 2023-01-04T18:16:25.013 INFO:tasks.workunit.client.0.smithi050.stdout:5/26: write - no filename 2023-01-04T18:16:25.014 INFO:tasks.workunit.client.0.smithi050.stdout:5/27: read - no filename 2023-01-04T18:16:25.016 INFO:tasks.workunit.client.1.smithi098.stdout:4/24: dread f4 [0,4194304] 0 2023-01-04T18:16:25.019 INFO:tasks.workunit.client.0.smithi050.stdout:6/33: mkdir d0/d8 0 2023-01-04T18:16:25.020 INFO:tasks.workunit.client.1.smithi098.stdout:9/68: mkdir d2/d12 0 2023-01-04T18:16:25.020 INFO:tasks.workunit.client.1.smithi098.stdout:9/69: stat d2 0 2023-01-04T18:16:25.020 INFO:tasks.workunit.client.1.smithi098.stdout:9/70: read d2/d5/f6 [3529300,5003] 0 2023-01-04T18:16:25.021 INFO:tasks.workunit.client.0.smithi050.stdout:8/39: creat d3/d5/fb x:0 0 0 2023-01-04T18:16:25.022 INFO:tasks.workunit.client.0.smithi050.stdout:5/28: creat f8 x:0 0 0 2023-01-04T18:16:25.022 INFO:tasks.workunit.client.0.smithi050.stdout:5/29: dread - f8 zero size 2023-01-04T18:16:25.022 INFO:tasks.workunit.client.0.smithi050.stdout:5/30: chown l4 1139395533 1 2023-01-04T18:16:25.023 INFO:tasks.workunit.client.1.smithi098.stdout:0/54: dread f5 [0,4194304] 0 2023-01-04T18:16:25.024 INFO:tasks.workunit.client.1.smithi098.stdout:1/27: dwrite f0 [0,4194304] 0 2023-01-04T18:16:25.024 INFO:tasks.workunit.client.0.smithi050.stdout:9/41: rmdir d1/d3/d7 0 2023-01-04T18:16:25.025 INFO:tasks.workunit.client.0.smithi050.stdout:8/40: mkdir d3/dc 0 2023-01-04T18:16:25.026 INFO:tasks.workunit.client.0.smithi050.stdout:6/34: write d0/f7 [514435,64775] 0 2023-01-04T18:16:25.026 INFO:tasks.workunit.client.0.smithi050.stdout:6/35: stat d0/c3 0 2023-01-04T18:16:25.029 INFO:tasks.workunit.client.1.smithi098.stdout:2/72: rename d6/fb to d6/dc/f1b 0 2023-01-04T18:16:25.029 INFO:tasks.workunit.client.1.smithi098.stdout:2/73: stat d6/dc/f14 0 2023-01-04T18:16:25.032 INFO:tasks.workunit.client.1.smithi098.stdout:0/55: creat df/f14 x:0 0 0 2023-01-04T18:16:25.032 INFO:tasks.workunit.client.1.smithi098.stdout:0/56: readlink ld 0 2023-01-04T18:16:25.033 INFO:tasks.workunit.client.0.smithi050.stdout:5/31: link l7 l9 0 2023-01-04T18:16:25.033 INFO:tasks.workunit.client.1.smithi098.stdout:2/74: dread f3 [0,4194304] 0 2023-01-04T18:16:25.033 INFO:tasks.workunit.client.1.smithi098.stdout:2/75: write d6/f15 [123656,125963] 0 2023-01-04T18:16:25.035 INFO:tasks.workunit.client.0.smithi050.stdout:8/41: creat d3/fd x:0 0 0 2023-01-04T18:16:25.038 INFO:tasks.workunit.client.1.smithi098.stdout:8/31: dwrite f2 [0,4194304] 0 2023-01-04T18:16:25.039 INFO:tasks.workunit.client.1.smithi098.stdout:1/28: creat d1/fc x:0 0 0 2023-01-04T18:16:25.040 INFO:tasks.workunit.client.0.smithi050.stdout:6/36: mkdir d0/d9 0 2023-01-04T18:16:25.040 INFO:tasks.workunit.client.0.smithi050.stdout:6/37: write d0/f7 [509515,1167] 0 2023-01-04T18:16:25.041 INFO:tasks.workunit.client.1.smithi098.stdout:4/25: truncate f4 2784742 0 2023-01-04T18:16:25.042 INFO:tasks.workunit.client.0.smithi050.stdout:5/32: unlink l7 0 2023-01-04T18:16:25.042 INFO:tasks.workunit.client.0.smithi050.stdout:5/33: read - f8 zero size 2023-01-04T18:16:25.043 INFO:tasks.workunit.client.0.smithi050.stdout:8/42: creat d3/d5/fe x:0 0 0 2023-01-04T18:16:25.044 INFO:tasks.workunit.client.0.smithi050.stdout:5/34: mknod ca 0 2023-01-04T18:16:25.045 INFO:tasks.workunit.client.0.smithi050.stdout:5/35: stat ca 0 2023-01-04T18:16:25.046 INFO:tasks.workunit.client.0.smithi050.stdout:8/43: symlink d3/lf 0 2023-01-04T18:16:25.046 INFO:tasks.workunit.client.1.smithi098.stdout:8/32: mkdir d6 0 2023-01-04T18:16:25.047 INFO:tasks.workunit.client.1.smithi098.stdout:0/57: creat df/f15 x:0 0 0 2023-01-04T18:16:25.047 INFO:tasks.workunit.client.0.smithi050.stdout:5/36: rename f8 to fb 0 2023-01-04T18:16:25.048 INFO:tasks.workunit.client.1.smithi098.stdout:1/29: dread d1/f4 [0,4194304] 0 2023-01-04T18:16:25.048 INFO:tasks.workunit.client.1.smithi098.stdout:4/26: mknod d5/c6 0 2023-01-04T18:16:25.056 INFO:tasks.workunit.client.1.smithi098.stdout:1/30: symlink d1/d8/ld 0 2023-01-04T18:16:25.056 INFO:tasks.workunit.client.1.smithi098.stdout:0/58: rename ce to df/c16 0 2023-01-04T18:16:25.057 INFO:tasks.workunit.client.1.smithi098.stdout:0/59: dread - df/f14 zero size 2023-01-04T18:16:25.057 INFO:tasks.workunit.client.1.smithi098.stdout:0/60: truncate f0 4644935 0 2023-01-04T18:16:25.057 INFO:tasks.workunit.client.1.smithi098.stdout:2/76: dread d6/dc/f1b [0,4194304] 0 2023-01-04T18:16:25.058 INFO:tasks.workunit.client.1.smithi098.stdout:0/61: mkdir df/d17 0 2023-01-04T18:16:25.059 INFO:tasks.workunit.client.1.smithi098.stdout:9/71: dwrite d2/d5/f6 [4194304,4194304] 0 2023-01-04T18:16:25.062 INFO:tasks.workunit.client.1.smithi098.stdout:8/33: dread f2 [0,4194304] 0 2023-01-04T18:16:25.062 INFO:tasks.workunit.client.1.smithi098.stdout:2/77: mkdir d6/dc/d1c 0 2023-01-04T18:16:25.067 INFO:tasks.workunit.client.1.smithi098.stdout:2/78: mknod d6/c1d 0 2023-01-04T18:16:25.068 INFO:tasks.workunit.client.1.smithi098.stdout:2/79: chown d6 54105 1 2023-01-04T18:16:25.068 INFO:tasks.workunit.client.1.smithi098.stdout:2/80: fdatasync d6/dc/f12 0 2023-01-04T18:16:25.068 INFO:tasks.workunit.client.1.smithi098.stdout:2/81: truncate d6/f17 1222264 0 2023-01-04T18:16:25.071 INFO:tasks.workunit.client.0.smithi050.stdout:6/38: dread d0/f7 [0,4194304] 0 2023-01-04T18:16:25.071 INFO:tasks.workunit.client.1.smithi098.stdout:2/82: mkdir d6/dc/d1e 0 2023-01-04T18:16:25.073 INFO:tasks.workunit.client.0.smithi050.stdout:6/39: creat d0/d9/fa x:0 0 0 2023-01-04T18:16:25.073 INFO:tasks.workunit.client.1.smithi098.stdout:2/83: rmdir d6 39 2023-01-04T18:16:25.074 INFO:tasks.workunit.client.0.smithi050.stdout:6/40: rename d0/c3 to d0/d9/cb 0 2023-01-04T18:16:25.075 INFO:tasks.workunit.client.0.smithi050.stdout:6/41: mknod d0/d9/cc 0 2023-01-04T18:16:25.076 INFO:tasks.workunit.client.0.smithi050.stdout:6/42: creat d0/d8/fd x:0 0 0 2023-01-04T18:16:25.076 INFO:tasks.workunit.client.0.smithi050.stdout:6/43: write d0/f7 [610155,86013] 0 2023-01-04T18:16:25.076 INFO:tasks.workunit.client.0.smithi050.stdout:6/44: truncate d0/f7 1108182 0 2023-01-04T18:16:25.080 INFO:tasks.workunit.client.1.smithi098.stdout:2/84: dread d6/dc/fe [0,4194304] 0 2023-01-04T18:16:25.081 INFO:tasks.workunit.client.0.smithi050.stdout:9/42: dwrite d1/f5 [0,4194304] 0 2023-01-04T18:16:25.082 INFO:tasks.workunit.client.0.smithi050.stdout:5/37: dwrite fb [0,4194304] 0 2023-01-04T18:16:25.083 INFO:tasks.workunit.client.1.smithi098.stdout:1/31: dwrite d1/f6 [0,4194304] 0 2023-01-04T18:16:25.083 INFO:tasks.workunit.client.1.smithi098.stdout:0/62: dwrite f1 [4194304,4194304] 0 2023-01-04T18:16:25.085 INFO:tasks.workunit.client.0.smithi050.stdout:9/43: write d1/f5 [3936486,112783] 0 2023-01-04T18:16:25.085 INFO:tasks.workunit.client.0.smithi050.stdout:9/44: stat d1/d3 0 2023-01-04T18:16:25.086 INFO:tasks.workunit.client.0.smithi050.stdout:9/45: chown d1 6 1 2023-01-04T18:16:25.086 INFO:tasks.workunit.client.0.smithi050.stdout:9/46: stat d1/d3/f4 0 2023-01-04T18:16:25.086 INFO:tasks.workunit.client.0.smithi050.stdout:9/47: write d1/d3/f4 [459421,115659] 0 2023-01-04T18:16:25.086 INFO:tasks.workunit.client.0.smithi050.stdout:9/48: write d1/f5 [3579707,3385] 0 2023-01-04T18:16:25.089 INFO:tasks.workunit.client.1.smithi098.stdout:4/27: dread f4 [0,4194304] 0 2023-01-04T18:16:25.090 INFO:tasks.workunit.client.0.smithi050.stdout:8/44: rmdir d3/d5 39 2023-01-04T18:16:25.090 INFO:tasks.workunit.client.0.smithi050.stdout:8/45: dread - d3/d5/fb zero size 2023-01-04T18:16:25.093 INFO:tasks.workunit.client.1.smithi098.stdout:0/63: symlink df/l18 0 2023-01-04T18:16:25.094 INFO:tasks.workunit.client.1.smithi098.stdout:8/34: truncate f2 861349 0 2023-01-04T18:16:25.096 INFO:tasks.workunit.client.1.smithi098.stdout:1/32: creat d1/d8/da/fe x:0 0 0 2023-01-04T18:16:25.097 INFO:tasks.workunit.client.0.smithi050.stdout:5/38: fsync fb 0 2023-01-04T18:16:25.099 INFO:tasks.workunit.client.1.smithi098.stdout:2/85: dwrite d6/f7 [0,4194304] 0 2023-01-04T18:16:25.105 INFO:tasks.workunit.client.1.smithi098.stdout:4/28: rename l2 to d5/l7 0 2023-01-04T18:16:25.105 INFO:tasks.workunit.client.1.smithi098.stdout:4/29: fdatasync f4 0 2023-01-04T18:16:25.105 INFO:tasks.workunit.client.1.smithi098.stdout:4/30: write f4 [2811682,13571] 0 2023-01-04T18:16:25.108 INFO:tasks.workunit.client.1.smithi098.stdout:1/33: mknod d1/d8/da/cf 0 2023-01-04T18:16:25.108 INFO:tasks.workunit.client.0.smithi050.stdout:9/49: symlink d1/d3/l9 0 2023-01-04T18:16:25.110 INFO:tasks.workunit.client.1.smithi098.stdout:4/31: dread f4 [0,4194304] 0 2023-01-04T18:16:25.110 INFO:tasks.workunit.client.0.smithi050.stdout:6/45: rmdir d0/d8 39 2023-01-04T18:16:25.112 INFO:tasks.workunit.client.1.smithi098.stdout:4/32: dread f4 [0,4194304] 0 2023-01-04T18:16:25.113 INFO:tasks.workunit.client.1.smithi098.stdout:4/33: write f4 [1104291,75188] 0 2023-01-04T18:16:25.113 INFO:tasks.workunit.client.1.smithi098.stdout:4/34: write f4 [323387,29057] 0 2023-01-04T18:16:25.118 INFO:tasks.workunit.client.1.smithi098.stdout:2/86: mkdir d6/dc/d1c/d1f 0 2023-01-04T18:16:25.120 INFO:tasks.workunit.client.1.smithi098.stdout:8/35: dread f2 [0,4194304] 0 2023-01-04T18:16:25.121 INFO:tasks.workunit.client.1.smithi098.stdout:8/36: chown l3 7214468 1 2023-01-04T18:16:25.121 INFO:tasks.workunit.client.1.smithi098.stdout:8/37: fdatasync f2 0 2023-01-04T18:16:25.121 INFO:tasks.workunit.client.1.smithi098.stdout:8/38: chown d6 3 1 2023-01-04T18:16:25.122 INFO:tasks.workunit.client.1.smithi098.stdout:0/64: rename l2 to df/l19 0 2023-01-04T18:16:25.122 INFO:tasks.workunit.client.1.smithi098.stdout:0/65: truncate f3 4225511 0 2023-01-04T18:16:25.125 INFO:tasks.workunit.client.0.smithi050.stdout:9/50: symlink d1/la 0 2023-01-04T18:16:25.127 INFO:tasks.workunit.client.1.smithi098.stdout:1/34: creat d1/d8/f10 x:0 0 0 2023-01-04T18:16:25.127 INFO:tasks.workunit.client.1.smithi098.stdout:4/35: dread f4 [0,4194304] 0 2023-01-04T18:16:25.128 INFO:tasks.workunit.client.0.smithi050.stdout:5/39: mknod cc 0 2023-01-04T18:16:25.128 INFO:tasks.workunit.client.0.smithi050.stdout:9/51: rename d1/d3/l8 to d1/d3/lb 0 2023-01-04T18:16:25.129 INFO:tasks.workunit.client.1.smithi098.stdout:8/39: mkdir d6/d7 0 2023-01-04T18:16:25.130 INFO:tasks.workunit.client.1.smithi098.stdout:8/40: write f2 [352080,38760] 0 2023-01-04T18:16:25.130 INFO:tasks.workunit.client.1.smithi098.stdout:8/41: chown d6/d7 191393831 1 2023-01-04T18:16:25.130 INFO:tasks.workunit.client.1.smithi098.stdout:0/66: symlink df/l1a 0 2023-01-04T18:16:25.131 INFO:tasks.workunit.client.1.smithi098.stdout:2/87: dwrite d6/f11 [0,4194304] 0 2023-01-04T18:16:25.132 INFO:tasks.workunit.client.0.smithi050.stdout:5/40: mknod cd 0 2023-01-04T18:16:25.133 INFO:tasks.workunit.client.1.smithi098.stdout:4/36: readlink l1 0 2023-01-04T18:16:25.134 INFO:tasks.workunit.client.0.smithi050.stdout:9/52: write d1/f5 [1502754,64017] 0 2023-01-04T18:16:25.134 INFO:tasks.workunit.client.1.smithi098.stdout:0/67: mknod df/d17/c1b 0 2023-01-04T18:16:25.136 INFO:tasks.workunit.client.1.smithi098.stdout:8/42: dread f2 [0,4194304] 0 2023-01-04T18:16:25.136 INFO:tasks.workunit.client.1.smithi098.stdout:8/43: chown d6/d7 1 1 2023-01-04T18:16:25.136 INFO:tasks.workunit.client.0.smithi050.stdout:9/53: mknod d1/cc 0 2023-01-04T18:16:25.136 INFO:tasks.workunit.client.0.smithi050.stdout:9/54: write d1/d3/f4 [1181909,45217] 0 2023-01-04T18:16:25.138 INFO:tasks.workunit.client.1.smithi098.stdout:2/88: rmdir d6 39 2023-01-04T18:16:25.139 INFO:tasks.workunit.client.1.smithi098.stdout:2/89: write d6/fa [284691,130618] 0 2023-01-04T18:16:25.139 INFO:tasks.workunit.client.1.smithi098.stdout:2/90: getdents d6/dc/d1c/d1f 0 2023-01-04T18:16:25.146 INFO:tasks.workunit.client.0.smithi050.stdout:6/46: dwrite d0/d8/fd [0,4194304] 0 2023-01-04T18:16:25.146 INFO:tasks.workunit.client.0.smithi050.stdout:6/47: chown d0/c6 388360 1 2023-01-04T18:16:25.146 INFO:tasks.workunit.client.0.smithi050.stdout:6/48: dread - d0/d9/fa zero size 2023-01-04T18:16:25.146 INFO:tasks.workunit.client.1.smithi098.stdout:4/37: creat d5/f8 x:0 0 0 2023-01-04T18:16:25.147 INFO:tasks.workunit.client.0.smithi050.stdout:9/55: rmdir d1/d3 39 2023-01-04T18:16:25.151 INFO:tasks.workunit.client.1.smithi098.stdout:0/68: mkdir df/d17/d1c 0 2023-01-04T18:16:25.152 INFO:tasks.workunit.client.1.smithi098.stdout:1/35: dwrite d1/d8/f10 [0,4194304] 0 2023-01-04T18:16:25.152 INFO:tasks.workunit.client.1.smithi098.stdout:1/36: write d1/fc [882563,2219] 0 2023-01-04T18:16:25.155 INFO:tasks.workunit.client.1.smithi098.stdout:8/44: mknod d6/c8 0 2023-01-04T18:16:25.156 INFO:tasks.workunit.client.1.smithi098.stdout:4/38: fsync d5/f8 0 2023-01-04T18:16:25.157 INFO:tasks.workunit.client.0.smithi050.stdout:6/49: creat d0/fe x:0 0 0 2023-01-04T18:16:25.159 INFO:tasks.workunit.client.1.smithi098.stdout:0/69: creat df/d17/f1d x:0 0 0 2023-01-04T18:16:25.159 INFO:tasks.workunit.client.0.smithi050.stdout:5/41: dread fb [0,4194304] 0 2023-01-04T18:16:25.160 INFO:tasks.workunit.client.0.smithi050.stdout:9/56: unlink d1/f5 0 2023-01-04T18:16:25.161 INFO:tasks.workunit.client.0.smithi050.stdout:6/50: mkdir d0/d9/df 0 2023-01-04T18:16:25.161 INFO:tasks.workunit.client.0.smithi050.stdout:6/51: write d0/fe [359142,61814] 0 2023-01-04T18:16:25.161 INFO:tasks.workunit.client.0.smithi050.stdout:5/42: chown ca 94 1 2023-01-04T18:16:25.162 INFO:tasks.workunit.client.1.smithi098.stdout:1/37: creat d1/d8/da/f11 x:0 0 0 2023-01-04T18:16:25.163 INFO:tasks.workunit.client.1.smithi098.stdout:1/38: chown d1/d8/f10 568454 1 2023-01-04T18:16:25.163 INFO:tasks.workunit.client.1.smithi098.stdout:2/91: dwrite d6/f16 [0,4194304] 0 2023-01-04T18:16:25.163 INFO:tasks.workunit.client.0.smithi050.stdout:9/57: creat d1/fd x:0 0 0 2023-01-04T18:16:25.163 INFO:tasks.workunit.client.0.smithi050.stdout:9/58: dread - d1/fd zero size 2023-01-04T18:16:25.164 INFO:tasks.workunit.client.0.smithi050.stdout:9/59: read d1/d3/f4 [1194364,120528] 0 2023-01-04T18:16:25.164 INFO:tasks.workunit.client.0.smithi050.stdout:9/60: write d1/d3/f4 [2008421,130611] 0 2023-01-04T18:16:25.164 INFO:tasks.workunit.client.1.smithi098.stdout:8/45: getdents d6 0 2023-01-04T18:16:25.164 INFO:tasks.workunit.client.1.smithi098.stdout:8/46: write f2 [1289608,67688] 0 2023-01-04T18:16:25.166 INFO:tasks.workunit.client.0.smithi050.stdout:5/43: unlink fb 0 2023-01-04T18:16:25.168 INFO:tasks.workunit.client.1.smithi098.stdout:0/70: stat df/l19 0 2023-01-04T18:16:25.174 INFO:tasks.workunit.client.0.smithi050.stdout:5/44: mknod ce 0 2023-01-04T18:16:25.174 INFO:tasks.workunit.client.0.smithi050.stdout:5/45: truncate - no filename 2023-01-04T18:16:25.176 INFO:tasks.workunit.client.1.smithi098.stdout:2/92: creat d6/f20 x:0 0 0 2023-01-04T18:16:25.176 INFO:tasks.workunit.client.1.smithi098.stdout:2/93: fsync d6/f8 0 2023-01-04T18:16:25.177 INFO:tasks.workunit.client.0.smithi050.stdout:5/46: chown l9 130 1 2023-01-04T18:16:25.177 INFO:tasks.workunit.client.0.smithi050.stdout:5/47: dwrite - no filename 2023-01-04T18:16:25.177 INFO:tasks.workunit.client.0.smithi050.stdout:5/48: dread - no filename 2023-01-04T18:16:25.178 INFO:tasks.workunit.client.1.smithi098.stdout:8/47: rename f2 to d6/f9 0 2023-01-04T18:16:25.179 INFO:tasks.workunit.client.1.smithi098.stdout:0/71: creat df/d17/d1c/f1e x:0 0 0 2023-01-04T18:16:25.179 INFO:tasks.workunit.client.1.smithi098.stdout:0/72: chown ld 50114105 1 2023-01-04T18:16:25.180 INFO:tasks.workunit.client.1.smithi098.stdout:8/48: mknod d6/d7/ca 0 2023-01-04T18:16:25.181 INFO:tasks.workunit.client.0.smithi050.stdout:5/49: rename l4 to lf 0 2023-01-04T18:16:25.182 INFO:tasks.workunit.client.0.smithi050.stdout:5/50: chown ce 1901268591 1 2023-01-04T18:16:25.182 INFO:tasks.workunit.client.0.smithi050.stdout:5/51: write - no filename 2023-01-04T18:16:25.182 INFO:tasks.workunit.client.0.smithi050.stdout:5/52: write - no filename 2023-01-04T18:16:25.182 INFO:tasks.workunit.client.0.smithi050.stdout:5/53: dread - no filename 2023-01-04T18:16:25.183 INFO:tasks.workunit.client.0.smithi050.stdout:5/54: symlink l10 0 2023-01-04T18:16:25.184 INFO:tasks.workunit.client.0.smithi050.stdout:5/55: stat cd 0 2023-01-04T18:16:25.184 INFO:tasks.workunit.client.0.smithi050.stdout:5/56: truncate - no filename 2023-01-04T18:16:25.185 INFO:tasks.workunit.client.0.smithi050.stdout:5/57: creat f11 x:0 0 0 2023-01-04T18:16:25.185 INFO:tasks.workunit.client.0.smithi050.stdout:5/58: rmdir - no directory 2023-01-04T18:16:25.186 INFO:tasks.workunit.client.0.smithi050.stdout:5/59: link cd c12 0 2023-01-04T18:16:25.187 INFO:tasks.workunit.client.0.smithi050.stdout:5/60: mkdir d13 0 2023-01-04T18:16:25.187 INFO:tasks.workunit.client.0.smithi050.stdout:5/61: chown d13 18656662 1 2023-01-04T18:16:25.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:23.911731+0000 mgr.smithi098.vhfzum (mgr.24455) 13 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 244 MiB data, 957 MiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s rd, 6.4 MiB/s wr, 37 op/s 2023-01-04T18:16:25.296 INFO:tasks.workunit.client.0.smithi050.stdout:6/52: dwrite d0/f7 [0,4194304] 0 2023-01-04T18:16:25.296 INFO:tasks.workunit.client.0.smithi050.stdout:6/53: rename d0/d9 to d0/d9/df/d10 22 2023-01-04T18:16:25.297 INFO:tasks.workunit.client.1.smithi098.stdout:1/39: dwrite d1/d8/da/f11 [0,4194304] 0 2023-01-04T18:16:25.297 INFO:tasks.workunit.client.0.smithi050.stdout:6/54: write d0/fe [219819,110156] 0 2023-01-04T18:16:25.298 INFO:tasks.workunit.client.0.smithi050.stdout:6/55: chown d0/c4 12652035 1 2023-01-04T18:16:25.300 INFO:tasks.workunit.client.0.smithi050.stdout:6/56: creat d0/d9/df/f11 x:0 0 0 2023-01-04T18:16:25.300 INFO:tasks.workunit.client.1.smithi098.stdout:1/40: write f0 [3053527,75592] 0 2023-01-04T18:16:25.301 INFO:tasks.workunit.client.1.smithi098.stdout:1/41: read d1/f6 [3044639,61116] 0 2023-01-04T18:16:25.301 INFO:tasks.workunit.client.1.smithi098.stdout:1/42: write d1/f4 [4423147,86860] 0 2023-01-04T18:16:25.301 INFO:tasks.workunit.client.1.smithi098.stdout:1/43: write d1/fc [1241808,83871] 0 2023-01-04T18:16:25.305 INFO:tasks.workunit.client.1.smithi098.stdout:8/49: truncate d6/f9 714243 0 2023-01-04T18:16:25.306 INFO:tasks.workunit.client.0.smithi050.stdout:5/62: fsync f11 0 2023-01-04T18:16:25.306 INFO:tasks.workunit.client.0.smithi050.stdout:5/63: dread - f11 zero size 2023-01-04T18:16:25.307 INFO:tasks.workunit.client.0.smithi050.stdout:5/64: creat d13/f14 x:0 0 0 2023-01-04T18:16:25.309 INFO:tasks.workunit.client.0.smithi050.stdout:5/65: mkdir d13/d15 0 2023-01-04T18:16:25.316 INFO:tasks.workunit.client.1.smithi098.stdout:1/44: dread d1/f2 [0,4194304] 0 2023-01-04T18:16:25.324 INFO:tasks.workunit.client.1.smithi098.stdout:0/73: dwrite f3 [0,4194304] 0 2023-01-04T18:16:25.325 INFO:tasks.workunit.client.1.smithi098.stdout:1/45: dread d1/fc [0,4194304] 0 2023-01-04T18:16:25.327 INFO:tasks.workunit.client.1.smithi098.stdout:1/46: mkdir d1/d8/da/d12 0 2023-01-04T18:16:25.328 INFO:tasks.workunit.client.1.smithi098.stdout:1/47: symlink d1/d8/da/l13 0 2023-01-04T18:16:25.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:23.911731+0000 mgr.smithi098.vhfzum (mgr.24455) 13 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 244 MiB data, 957 MiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s rd, 6.4 MiB/s wr, 37 op/s 2023-01-04T18:16:25.335 INFO:tasks.workunit.client.0.smithi050.stdout:5/66: dwrite d13/f14 [0,4194304] 0 2023-01-04T18:16:25.335 INFO:tasks.workunit.client.1.smithi098.stdout:8/50: dwrite d6/f9 [0,4194304] 0 2023-01-04T18:16:25.337 INFO:tasks.workunit.client.0.smithi050.stdout:5/67: creat d13/d15/f16 x:0 0 0 2023-01-04T18:16:25.338 INFO:tasks.workunit.client.0.smithi050.stdout:5/68: truncate d13/d15/f16 260425 0 2023-01-04T18:16:25.338 INFO:tasks.workunit.client.0.smithi050.stdout:5/69: chown cd 6630 1 2023-01-04T18:16:25.338 INFO:tasks.workunit.client.1.smithi098.stdout:8/51: mknod d6/d7/cb 0 2023-01-04T18:16:25.338 INFO:tasks.workunit.client.1.smithi098.stdout:8/52: chown d6/d7/cb 84390 1 2023-01-04T18:16:25.339 INFO:tasks.workunit.client.0.smithi050.stdout:5/70: stat c12 0 2023-01-04T18:16:25.342 INFO:tasks.workunit.client.1.smithi098.stdout:8/53: unlink d6/d7/cb 0 2023-01-04T18:16:25.342 INFO:tasks.workunit.client.1.smithi098.stdout:6/36: sync 2023-01-04T18:16:25.342 INFO:tasks.workunit.client.1.smithi098.stdout:6/37: write f4 [438273,12722] 0 2023-01-04T18:16:25.342 INFO:tasks.workunit.client.1.smithi098.stdout:5/28: sync 2023-01-04T18:16:25.342 INFO:tasks.workunit.client.1.smithi098.stdout:9/72: sync 2023-01-04T18:16:25.342 INFO:tasks.workunit.client.1.smithi098.stdout:5/29: fsync d1/d2/f3 0 2023-01-04T18:16:25.343 INFO:tasks.workunit.client.1.smithi098.stdout:7/43: sync 2023-01-04T18:16:25.343 INFO:tasks.workunit.client.1.smithi098.stdout:0/74: dwrite df/d17/d1c/f1e [0,4194304] 0 2023-01-04T18:16:25.343 INFO:tasks.workunit.client.1.smithi098.stdout:0/75: truncate df/d17/f1d 210748 0 2023-01-04T18:16:25.343 INFO:tasks.workunit.client.1.smithi098.stdout:8/54: mkdir d6/dc 0 2023-01-04T18:16:25.343 INFO:tasks.workunit.client.1.smithi098.stdout:8/55: readlink l3 0 2023-01-04T18:16:25.344 INFO:tasks.workunit.client.1.smithi098.stdout:6/38: mkdir d9 0 2023-01-04T18:16:25.346 INFO:tasks.workunit.client.1.smithi098.stdout:9/73: unlink d2/f7 0 2023-01-04T18:16:25.346 INFO:tasks.workunit.client.1.smithi098.stdout:9/74: readlink d2/d5/ld 0 2023-01-04T18:16:25.347 INFO:tasks.workunit.client.1.smithi098.stdout:5/30: symlink d1/d2/l4 0 2023-01-04T18:16:25.349 INFO:tasks.workunit.client.1.smithi098.stdout:7/44: creat d1/d4/ff x:0 0 0 2023-01-04T18:16:25.349 INFO:tasks.workunit.client.1.smithi098.stdout:7/45: readlink d1/le 0 2023-01-04T18:16:25.350 INFO:tasks.workunit.client.1.smithi098.stdout:3/29: sync 2023-01-04T18:16:25.351 INFO:tasks.workunit.client.1.smithi098.stdout:1/48: dwrite d1/f4 [0,4194304] 0 2023-01-04T18:16:25.352 INFO:tasks.workunit.client.0.smithi050.stdout:5/71: rmdir d13 39 2023-01-04T18:16:25.352 INFO:tasks.workunit.client.1.smithi098.stdout:3/30: write f1 [4576088,101826] 0 2023-01-04T18:16:25.354 INFO:tasks.workunit.client.1.smithi098.stdout:0/76: link df/d17/d1c/f1e df/d17/f1f 0 2023-01-04T18:16:25.354 INFO:tasks.workunit.client.0.smithi050.stdout:5/72: rmdir d13/d15 39 2023-01-04T18:16:25.356 INFO:tasks.workunit.client.0.smithi050.stdout:5/73: dread d13/d15/f16 [0,4194304] 0 2023-01-04T18:16:25.358 INFO:tasks.workunit.client.1.smithi098.stdout:6/39: unlink l0 0 2023-01-04T18:16:25.359 INFO:tasks.workunit.client.0.smithi050.stdout:5/74: write d13/f14 [3381165,55137] 0 2023-01-04T18:16:25.360 INFO:tasks.workunit.client.1.smithi098.stdout:9/75: unlink d2/d5/ld 0 2023-01-04T18:16:25.360 INFO:tasks.workunit.client.1.smithi098.stdout:9/76: chown d2 7652760 1 2023-01-04T18:16:25.360 INFO:tasks.workunit.client.1.smithi098.stdout:9/77: readlink d2/la 0 2023-01-04T18:16:25.361 INFO:tasks.workunit.client.1.smithi098.stdout:5/31: creat d1/d2/f5 x:0 0 0 2023-01-04T18:16:25.361 INFO:tasks.workunit.client.1.smithi098.stdout:5/32: write d1/d2/f3 [177083,84946] 0 2023-01-04T18:16:25.362 INFO:tasks.workunit.client.0.smithi050.stdout:5/75: mkdir d13/d15/d17 0 2023-01-04T18:16:25.362 INFO:tasks.workunit.client.0.smithi050.stdout:5/76: write f11 [771394,19950] 0 2023-01-04T18:16:25.365 INFO:tasks.workunit.client.1.smithi098.stdout:2/94: sync 2023-01-04T18:16:25.365 INFO:tasks.workunit.client.1.smithi098.stdout:4/39: sync 2023-01-04T18:16:25.367 INFO:tasks.workunit.client.1.smithi098.stdout:1/49: link d1/c5 d1/c14 0 2023-01-04T18:16:25.369 INFO:tasks.workunit.client.1.smithi098.stdout:0/77: symlink df/l20 0 2023-01-04T18:16:25.369 INFO:tasks.workunit.client.1.smithi098.stdout:0/78: write df/f14 [992215,9255] 0 2023-01-04T18:16:25.371 INFO:tasks.workunit.client.1.smithi098.stdout:9/78: getdents d2 0 2023-01-04T18:16:25.374 INFO:tasks.workunit.client.1.smithi098.stdout:3/31: dwrite f3 [0,4194304] 0 2023-01-04T18:16:25.374 INFO:tasks.workunit.client.1.smithi098.stdout:3/32: chown l2 22 1 2023-01-04T18:16:25.376 INFO:tasks.workunit.client.1.smithi098.stdout:9/79: dread d2/f10 [0,4194304] 0 2023-01-04T18:16:25.376 INFO:tasks.workunit.client.1.smithi098.stdout:1/50: creat d1/d8/da/d12/f15 x:0 0 0 2023-01-04T18:16:25.376 INFO:tasks.workunit.client.1.smithi098.stdout:0/79: mkdir df/d17/d21 0 2023-01-04T18:16:25.376 INFO:tasks.workunit.client.1.smithi098.stdout:0/80: chown df/c16 113 1 2023-01-04T18:16:25.377 INFO:tasks.workunit.client.1.smithi098.stdout:5/33: dread d1/d2/f3 [0,4194304] 0 2023-01-04T18:16:25.377 INFO:tasks.workunit.client.1.smithi098.stdout:5/34: write d1/d2/f3 [864824,22627] 0 2023-01-04T18:16:25.377 INFO:tasks.workunit.client.1.smithi098.stdout:5/35: readlink d1/d2/l4 0 2023-01-04T18:16:25.380 INFO:tasks.workunit.client.1.smithi098.stdout:9/80: truncate d2/f10 3092137 0 2023-01-04T18:16:25.380 INFO:tasks.workunit.client.1.smithi098.stdout:9/81: chown d2/f10 54242648 1 2023-01-04T18:16:25.382 INFO:tasks.workunit.client.1.smithi098.stdout:0/81: creat df/d17/d1c/f22 x:0 0 0 2023-01-04T18:16:25.382 INFO:tasks.workunit.client.1.smithi098.stdout:0/82: fdatasync df/f15 0 2023-01-04T18:16:25.382 INFO:tasks.workunit.client.1.smithi098.stdout:0/83: write df/f11 [993419,35624] 0 2023-01-04T18:16:25.384 INFO:tasks.workunit.client.1.smithi098.stdout:7/46: dwrite d1/d4/ff [0,4194304] 0 2023-01-04T18:16:25.386 INFO:tasks.workunit.client.1.smithi098.stdout:4/40: dwrite f4 [0,4194304] 0 2023-01-04T18:16:25.387 INFO:tasks.workunit.client.1.smithi098.stdout:4/41: fsync d5/f8 0 2023-01-04T18:16:25.390 INFO:tasks.workunit.client.1.smithi098.stdout:1/51: rmdir d1/d8 39 2023-01-04T18:16:25.394 INFO:tasks.workunit.client.1.smithi098.stdout:5/36: link d1/d2/f5 d1/f6 0 2023-01-04T18:16:25.395 INFO:tasks.workunit.client.1.smithi098.stdout:0/84: dread f1 [0,4194304] 0 2023-01-04T18:16:25.395 INFO:tasks.workunit.client.1.smithi098.stdout:1/52: creat d1/d8/da/d12/f16 x:0 0 0 2023-01-04T18:16:25.396 INFO:tasks.workunit.client.1.smithi098.stdout:1/53: write d1/d8/da/d12/f16 [297234,80205] 0 2023-01-04T18:16:25.396 INFO:tasks.workunit.client.1.smithi098.stdout:1/54: write d1/d8/da/d12/f15 [850853,13546] 0 2023-01-04T18:16:25.396 INFO:tasks.workunit.client.1.smithi098.stdout:6/40: dwrite f5 [0,4194304] 0 2023-01-04T18:16:25.399 INFO:tasks.workunit.client.1.smithi098.stdout:1/55: creat d1/d8/da/f17 x:0 0 0 2023-01-04T18:16:25.399 INFO:tasks.workunit.client.1.smithi098.stdout:1/56: dread - d1/d8/da/f17 zero size 2023-01-04T18:16:25.400 INFO:tasks.workunit.client.1.smithi098.stdout:5/37: mknod d1/d2/c7 0 2023-01-04T18:16:25.402 INFO:tasks.workunit.client.0.smithi050.stdout:5/77: dread d13/f14 [0,4194304] 0 2023-01-04T18:16:25.403 INFO:tasks.workunit.client.1.smithi098.stdout:1/57: mknod d1/c18 0 2023-01-04T18:16:25.403 INFO:tasks.workunit.client.1.smithi098.stdout:1/58: write d1/d8/da/f17 [325134,66972] 0 2023-01-04T18:16:25.404 INFO:tasks.workunit.client.1.smithi098.stdout:5/38: symlink d1/l8 0 2023-01-04T18:16:25.405 INFO:tasks.workunit.client.0.smithi050.stdout:5/78: creat d13/f18 x:0 0 0 2023-01-04T18:16:25.407 INFO:tasks.workunit.client.1.smithi098.stdout:0/85: dread f3 [0,4194304] 0 2023-01-04T18:16:25.407 INFO:tasks.workunit.client.1.smithi098.stdout:6/41: creat d9/fa x:0 0 0 2023-01-04T18:16:25.407 INFO:tasks.workunit.client.1.smithi098.stdout:0/86: write df/f15 [260152,121188] 0 2023-01-04T18:16:25.408 INFO:tasks.workunit.client.0.smithi050.stdout:5/79: rename d13/d15/f16 to d13/f19 0 2023-01-04T18:16:25.409 INFO:tasks.workunit.client.0.smithi050.stdout:5/80: chown cd 4066 1 2023-01-04T18:16:25.409 INFO:tasks.workunit.client.0.smithi050.stdout:5/81: chown d13/f14 134270 1 2023-01-04T18:16:25.409 INFO:tasks.workunit.client.0.smithi050.stdout:5/82: write d13/f19 [307354,114918] 0 2023-01-04T18:16:25.411 INFO:tasks.workunit.client.1.smithi098.stdout:0/87: mknod df/c23 0 2023-01-04T18:16:25.411 INFO:tasks.workunit.client.1.smithi098.stdout:0/88: readlink l9 0 2023-01-04T18:16:25.411 INFO:tasks.workunit.client.1.smithi098.stdout:0/89: chown df/f15 391 1 2023-01-04T18:16:25.412 INFO:tasks.workunit.client.1.smithi098.stdout:0/90: mkdir df/d17/d24 0 2023-01-04T18:16:25.413 INFO:tasks.workunit.client.1.smithi098.stdout:0/91: creat df/d17/d24/f25 x:0 0 0 2023-01-04T18:16:25.414 INFO:tasks.workunit.client.1.smithi098.stdout:3/33: truncate f3 773848 0 2023-01-04T18:16:25.414 INFO:tasks.workunit.client.1.smithi098.stdout:7/47: dwrite d1/d4/ff [0,4194304] 0 2023-01-04T18:16:25.414 INFO:tasks.workunit.client.1.smithi098.stdout:3/34: readlink l5 0 2023-01-04T18:16:25.416 INFO:tasks.workunit.client.1.smithi098.stdout:4/42: dwrite f4 [0,4194304] 0 2023-01-04T18:16:25.416 INFO:tasks.workunit.client.1.smithi098.stdout:2/95: dwrite d6/dc/fe [0,4194304] 0 2023-01-04T18:16:25.416 INFO:tasks.workunit.client.1.smithi098.stdout:2/96: truncate d6/f10 731702 0 2023-01-04T18:16:25.417 INFO:tasks.workunit.client.1.smithi098.stdout:0/92: rmdir df/d17/d21 0 2023-01-04T18:16:25.418 INFO:tasks.workunit.client.1.smithi098.stdout:3/35: mkdir d6 0 2023-01-04T18:16:25.420 INFO:tasks.workunit.client.0.smithi050.stdout:5/83: dread f11 [0,4194304] 0 2023-01-04T18:16:25.420 INFO:tasks.workunit.client.0.smithi050.stdout:5/84: chown l10 57 1 2023-01-04T18:16:25.420 INFO:tasks.workunit.client.0.smithi050.stdout:5/85: chown d13/d15/d17 65 1 2023-01-04T18:16:25.420 INFO:tasks.workunit.client.1.smithi098.stdout:9/82: dread f1 [0,4194304] 0 2023-01-04T18:16:25.421 INFO:tasks.workunit.client.0.smithi050.stdout:5/86: read f11 [533698,74733] 0 2023-01-04T18:16:25.424 INFO:tasks.workunit.client.1.smithi098.stdout:0/93: creat df/d17/f26 x:0 0 0 2023-01-04T18:16:25.425 INFO:tasks.workunit.client.1.smithi098.stdout:5/39: rmdir d1/d2 39 2023-01-04T18:16:25.427 INFO:tasks.workunit.client.0.smithi050.stdout:5/87: rename lf to d13/d15/l1a 0 2023-01-04T18:16:25.429 INFO:tasks.workunit.client.1.smithi098.stdout:3/36: mknod d6/c7 0 2023-01-04T18:16:25.433 INFO:tasks.workunit.client.0.smithi050.stdout:5/88: creat d13/d15/d17/f1b x:0 0 0 2023-01-04T18:16:25.433 INFO:tasks.workunit.client.0.smithi050.stdout:5/89: truncate d13/f18 736932 0 2023-01-04T18:16:25.437 INFO:tasks.workunit.client.1.smithi098.stdout:1/59: truncate d1/d8/da/f17 316955 0 2023-01-04T18:16:25.437 INFO:tasks.workunit.client.1.smithi098.stdout:6/42: rmdir d9 39 2023-01-04T18:16:25.441 INFO:tasks.workunit.client.0.smithi050.stdout:5/90: mknod d13/d15/c1c 0 2023-01-04T18:16:25.441 INFO:tasks.workunit.client.1.smithi098.stdout:9/83: symlink d2/l13 0 2023-01-04T18:16:25.443 INFO:tasks.workunit.client.0.smithi050.stdout:5/91: rename d13/d15/c1c to d13/d15/c1d 0 2023-01-04T18:16:25.445 INFO:tasks.workunit.client.0.smithi050.stdout:5/92: dread f11 [0,4194304] 0 2023-01-04T18:16:25.447 INFO:tasks.workunit.client.1.smithi098.stdout:0/94: mknod df/d17/c27 0 2023-01-04T18:16:25.447 INFO:tasks.workunit.client.0.smithi050.stdout:5/93: creat d13/d15/d17/f1e x:0 0 0 2023-01-04T18:16:25.450 INFO:tasks.workunit.client.1.smithi098.stdout:5/40: unlink d1/d2/f5 0 2023-01-04T18:16:25.451 INFO:tasks.workunit.client.1.smithi098.stdout:3/37: mknod d6/c8 0 2023-01-04T18:16:25.451 INFO:tasks.workunit.client.1.smithi098.stdout:6/43: dread - d9/fa zero size 2023-01-04T18:16:25.455 INFO:tasks.workunit.client.1.smithi098.stdout:0/95: creat df/f28 x:0 0 0 2023-01-04T18:16:25.455 INFO:tasks.workunit.client.1.smithi098.stdout:5/41: creat d1/f9 x:0 0 0 2023-01-04T18:16:25.455 INFO:tasks.workunit.client.1.smithi098.stdout:5/42: chown c0 26742 1 2023-01-04T18:16:25.455 INFO:tasks.workunit.client.1.smithi098.stdout:2/97: dwrite d6/f7 [0,4194304] 0 2023-01-04T18:16:25.457 INFO:tasks.workunit.client.1.smithi098.stdout:0/96: mknod df/c29 0 2023-01-04T18:16:25.457 INFO:tasks.workunit.client.1.smithi098.stdout:0/97: stat df/d17 0 2023-01-04T18:16:25.457 INFO:tasks.workunit.client.1.smithi098.stdout:0/98: chown df/d17/f1f 524943 1 2023-01-04T18:16:25.457 INFO:tasks.workunit.client.1.smithi098.stdout:0/99: write df/f28 [260759,19544] 0 2023-01-04T18:16:25.459 INFO:tasks.workunit.client.1.smithi098.stdout:0/100: rename df/d17/f26 to df/d17/f2a 0 2023-01-04T18:16:25.461 INFO:tasks.workunit.client.1.smithi098.stdout:0/101: mknod df/d17/d24/c2b 0 2023-01-04T18:16:25.462 INFO:tasks.workunit.client.1.smithi098.stdout:2/98: unlink d6/dc/cd 0 2023-01-04T18:16:25.462 INFO:tasks.workunit.client.1.smithi098.stdout:2/99: fsync d6/dc/f1b 0 2023-01-04T18:16:25.465 INFO:tasks.workunit.client.1.smithi098.stdout:2/100: symlink d6/dc/l21 0 2023-01-04T18:16:25.466 INFO:tasks.workunit.client.1.smithi098.stdout:2/101: creat d6/dc/d1c/d1f/f22 x:0 0 0 2023-01-04T18:16:25.469 INFO:tasks.workunit.client.1.smithi098.stdout:2/102: rename d6/dc/ff to d6/dc/d1c/d1f/f23 0 2023-01-04T18:16:25.469 INFO:tasks.workunit.client.1.smithi098.stdout:2/103: stat d6/dc/f1b 0 2023-01-04T18:16:25.471 INFO:tasks.workunit.client.0.smithi050.stdout:5/94: dread d13/f14 [0,4194304] 0 2023-01-04T18:16:25.474 INFO:tasks.workunit.client.1.smithi098.stdout:4/43: dwrite d5/f8 [0,4194304] 0 2023-01-04T18:16:25.475 INFO:tasks.workunit.client.0.smithi050.stdout:5/95: read d13/f14 [4074054,76258] 0 2023-01-04T18:16:25.475 INFO:tasks.workunit.client.0.smithi050.stdout:5/96: chown d13/d15/d17 1486256 1 2023-01-04T18:16:25.477 INFO:tasks.workunit.client.0.smithi050.stdout:5/97: write d13/f19 [84272,53080] 0 2023-01-04T18:16:25.477 INFO:tasks.workunit.client.0.smithi050.stdout:5/98: write d13/d15/d17/f1b [640704,94930] 0 2023-01-04T18:16:25.477 INFO:tasks.workunit.client.1.smithi098.stdout:4/44: mkdir d5/d9 0 2023-01-04T18:16:25.478 INFO:tasks.workunit.client.1.smithi098.stdout:4/45: creat d5/d9/fa x:0 0 0 2023-01-04T18:16:25.481 INFO:tasks.workunit.client.1.smithi098.stdout:4/46: unlink d5/d9/fa 0 2023-01-04T18:16:25.481 INFO:tasks.workunit.client.1.smithi098.stdout:4/47: chown d5/f8 401518825 1 2023-01-04T18:16:25.481 INFO:tasks.workunit.client.1.smithi098.stdout:1/60: dwrite d1/d8/da/fe [0,4194304] 0 2023-01-04T18:16:25.481 INFO:tasks.workunit.client.1.smithi098.stdout:9/84: dwrite f1 [0,4194304] 0 2023-01-04T18:16:25.483 INFO:tasks.workunit.client.1.smithi098.stdout:3/38: dwrite f3 [0,4194304] 0 2023-01-04T18:16:25.485 INFO:tasks.workunit.client.1.smithi098.stdout:0/102: dread df/f28 [0,4194304] 0 2023-01-04T18:16:25.485 INFO:tasks.workunit.client.1.smithi098.stdout:1/61: rename d1/d8/da/f11 to d1/d8/da/f19 0 2023-01-04T18:16:25.487 INFO:tasks.workunit.client.0.smithi050.stdout:5/99: fdatasync d13/f19 0 2023-01-04T18:16:25.487 INFO:tasks.workunit.client.1.smithi098.stdout:6/44: dwrite f4 [0,4194304] 0 2023-01-04T18:16:25.489 INFO:tasks.workunit.client.1.smithi098.stdout:9/85: symlink d2/l14 0 2023-01-04T18:16:25.490 INFO:tasks.workunit.client.1.smithi098.stdout:5/43: dwrite d1/f6 [0,4194304] 0 2023-01-04T18:16:25.490 INFO:tasks.workunit.client.1.smithi098.stdout:5/44: write d1/f9 [35642,81015] 0 2023-01-04T18:16:25.490 INFO:tasks.workunit.client.1.smithi098.stdout:5/45: chown d1/d2/c7 1044413 1 2023-01-04T18:16:25.491 INFO:tasks.workunit.client.1.smithi098.stdout:3/39: rename d6/c7 to d6/c9 0 2023-01-04T18:16:25.492 INFO:tasks.workunit.client.1.smithi098.stdout:3/40: chown d6 94515 1 2023-01-04T18:16:25.492 INFO:tasks.workunit.client.0.smithi050.stdout:5/100: dread d13/f19 [0,4194304] 0 2023-01-04T18:16:25.492 INFO:tasks.workunit.client.0.smithi050.stdout:5/101: write d13/f18 [1391077,72943] 0 2023-01-04T18:16:25.495 INFO:tasks.workunit.client.1.smithi098.stdout:0/103: mkdir df/d17/d1c/d2c 0 2023-01-04T18:16:25.495 INFO:tasks.workunit.client.1.smithi098.stdout:0/104: chown df/d17/d24/c2b 25 1 2023-01-04T18:16:25.495 INFO:tasks.workunit.client.0.smithi050.stdout:5/102: getdents d13 0 2023-01-04T18:16:25.497 INFO:tasks.workunit.client.1.smithi098.stdout:9/86: dread d2/d5/f6 [0,4194304] 0 2023-01-04T18:16:25.497 INFO:tasks.workunit.client.1.smithi098.stdout:9/87: stat d2/l13 0 2023-01-04T18:16:25.497 INFO:tasks.workunit.client.1.smithi098.stdout:9/88: readlink d2/l13 0 2023-01-04T18:16:25.498 INFO:tasks.workunit.client.1.smithi098.stdout:9/89: readlink d2/la 0 2023-01-04T18:16:25.498 INFO:tasks.workunit.client.1.smithi098.stdout:1/62: creat d1/d8/da/f1a x:0 0 0 2023-01-04T18:16:25.498 INFO:tasks.workunit.client.1.smithi098.stdout:1/63: chown d1/d8/f10 58232372 1 2023-01-04T18:16:25.498 INFO:tasks.workunit.client.1.smithi098.stdout:1/64: readlink d1/d8/da/l13 0 2023-01-04T18:16:25.500 INFO:tasks.workunit.client.1.smithi098.stdout:5/46: dread d1/f9 [0,4194304] 0 2023-01-04T18:16:25.504 INFO:tasks.workunit.client.1.smithi098.stdout:4/48: truncate d5/f8 549829 0 2023-01-04T18:16:25.505 INFO:tasks.workunit.client.1.smithi098.stdout:6/45: dwrite f4 [0,4194304] 0 2023-01-04T18:16:25.506 INFO:tasks.workunit.client.1.smithi098.stdout:1/65: dread d1/f6 [0,4194304] 0 2023-01-04T18:16:25.513 INFO:tasks.workunit.client.1.smithi098.stdout:1/66: dread d1/d8/da/f19 [0,4194304] 0 2023-01-04T18:16:25.514 INFO:tasks.workunit.client.0.smithi050.stdout:5/103: truncate d13/f14 3926860 0 2023-01-04T18:16:25.515 INFO:tasks.workunit.client.1.smithi098.stdout:1/67: dread d1/d8/da/d12/f15 [0,4194304] 0 2023-01-04T18:16:25.517 INFO:tasks.workunit.client.1.smithi098.stdout:2/104: dwrite d6/f17 [0,4194304] 0 2023-01-04T18:16:25.517 INFO:tasks.workunit.client.1.smithi098.stdout:0/105: creat df/d17/f2d x:0 0 0 2023-01-04T18:16:25.519 INFO:tasks.workunit.client.0.smithi050.stdout:5/104: mkdir d13/d15/d17/d1f 0 2023-01-04T18:16:25.519 INFO:tasks.workunit.client.0.smithi050.stdout:5/105: getdents d13 0 2023-01-04T18:16:25.519 INFO:tasks.workunit.client.0.smithi050.stdout:5/106: write d13/f19 [725050,29405] 0 2023-01-04T18:16:25.519 INFO:tasks.workunit.client.0.smithi050.stdout:5/107: truncate f11 1144882 0 2023-01-04T18:16:25.519 INFO:tasks.workunit.client.0.smithi050.stdout:5/108: dread - d13/d15/d17/f1e zero size 2023-01-04T18:16:25.520 INFO:tasks.workunit.client.1.smithi098.stdout:0/106: dread df/f14 [0,4194304] 0 2023-01-04T18:16:25.520 INFO:tasks.workunit.client.1.smithi098.stdout:9/90: mknod d2/d5/c15 0 2023-01-04T18:16:25.521 INFO:tasks.workunit.client.1.smithi098.stdout:8/56: sync 2023-01-04T18:16:25.521 INFO:tasks.workunit.client.1.smithi098.stdout:8/57: chown d6/c8 91831277 1 2023-01-04T18:16:25.521 INFO:tasks.workunit.client.1.smithi098.stdout:7/48: sync 2023-01-04T18:16:25.522 INFO:tasks.workunit.client.0.smithi050.stdout:5/109: rmdir d13 39 2023-01-04T18:16:25.525 INFO:tasks.workunit.client.1.smithi098.stdout:4/49: rename l1 to d5/d9/lb 0 2023-01-04T18:16:25.526 INFO:tasks.workunit.client.0.smithi050.stdout:5/110: fsync d13/d15/d17/f1b 0 2023-01-04T18:16:25.526 INFO:tasks.workunit.client.0.smithi050.stdout:5/111: chown l9 176 1 2023-01-04T18:16:25.526 INFO:tasks.workunit.client.0.smithi050.stdout:5/112: rename d13 to d13/d20 22 2023-01-04T18:16:25.529 INFO:tasks.workunit.client.1.smithi098.stdout:1/68: creat d1/f1b x:0 0 0 2023-01-04T18:16:25.529 INFO:tasks.workunit.client.1.smithi098.stdout:1/69: dread - d1/d8/da/f1a zero size 2023-01-04T18:16:25.531 INFO:tasks.workunit.client.0.smithi050.stdout:5/113: rmdir d13/d15/d17 39 2023-01-04T18:16:25.533 INFO:tasks.workunit.client.0.smithi050.stdout:5/114: symlink d13/d15/l21 0 2023-01-04T18:16:25.534 INFO:tasks.workunit.client.1.smithi098.stdout:2/105: rmdir d6/dc/d1e 0 2023-01-04T18:16:25.535 INFO:tasks.workunit.client.1.smithi098.stdout:9/91: rmdir d2/d12 0 2023-01-04T18:16:25.536 INFO:tasks.workunit.client.1.smithi098.stdout:7/49: link d1/d4/l8 d1/d4/l10 0 2023-01-04T18:16:25.538 INFO:tasks.workunit.client.1.smithi098.stdout:2/106: dread d6/f15 [0,4194304] 0 2023-01-04T18:16:25.538 INFO:tasks.workunit.client.1.smithi098.stdout:0/107: rename df/f15 to df/d17/d24/f2e 0 2023-01-04T18:16:25.538 INFO:tasks.workunit.client.1.smithi098.stdout:9/92: read f0 [4002960,51920] 0 2023-01-04T18:16:25.539 INFO:tasks.workunit.client.1.smithi098.stdout:9/93: chown d2/c11 208473821 1 2023-01-04T18:16:25.539 INFO:tasks.workunit.client.1.smithi098.stdout:4/50: truncate f4 3566620 0 2023-01-04T18:16:25.539 INFO:tasks.workunit.client.1.smithi098.stdout:1/70: mknod d1/c1c 0 2023-01-04T18:16:25.540 INFO:tasks.workunit.client.1.smithi098.stdout:9/94: write d2/f10 [683938,88154] 0 2023-01-04T18:16:25.540 INFO:tasks.workunit.client.1.smithi098.stdout:4/51: mknod d5/d9/cc 0 2023-01-04T18:16:25.544 INFO:tasks.workunit.client.1.smithi098.stdout:0/108: read df/f14 [510646,95144] 0 2023-01-04T18:16:25.546 INFO:tasks.workunit.client.0.smithi050.stdout:5/115: dread d13/f14 [0,4194304] 0 2023-01-04T18:16:25.548 INFO:tasks.workunit.client.0.smithi050.stdout:5/116: creat d13/f22 x:0 0 0 2023-01-04T18:16:25.548 INFO:tasks.workunit.client.0.smithi050.stdout:5/117: readlink d13/d15/l21 0 2023-01-04T18:16:25.549 INFO:tasks.workunit.client.1.smithi098.stdout:8/58: dwrite d6/f9 [0,4194304] 0 2023-01-04T18:16:25.549 INFO:tasks.workunit.client.1.smithi098.stdout:2/107: dread d6/f8 [0,4194304] 0 2023-01-04T18:16:25.554 INFO:tasks.workunit.client.1.smithi098.stdout:1/71: fsync d1/f1b 0 2023-01-04T18:16:25.554 INFO:tasks.workunit.client.1.smithi098.stdout:6/46: dwrite f5 [4194304,4194304] 0 2023-01-04T18:16:25.554 INFO:tasks.workunit.client.1.smithi098.stdout:2/108: dread f3 [0,4194304] 0 2023-01-04T18:16:25.554 INFO:tasks.workunit.client.1.smithi098.stdout:2/109: read - d6/dc/d1c/d1f/f22 zero size 2023-01-04T18:16:25.555 INFO:tasks.workunit.client.1.smithi098.stdout:5/47: write d1/f6 [4413181,25901] 0 2023-01-04T18:16:25.560 INFO:tasks.workunit.client.1.smithi098.stdout:8/59: dread d6/f9 [0,4194304] 0 2023-01-04T18:16:25.561 INFO:tasks.workunit.client.1.smithi098.stdout:0/109: getdents df 0 2023-01-04T18:16:25.561 INFO:tasks.workunit.client.1.smithi098.stdout:0/110: read - df/d17/d24/f25 zero size 2023-01-04T18:16:25.562 INFO:tasks.workunit.client.0.smithi050.stdout:5/118: dread d13/f14 [0,4194304] 0 2023-01-04T18:16:25.563 INFO:tasks.workunit.client.1.smithi098.stdout:1/72: symlink d1/l1d 0 2023-01-04T18:16:25.565 INFO:tasks.workunit.client.1.smithi098.stdout:9/95: dread f0 [0,4194304] 0 2023-01-04T18:16:25.565 INFO:tasks.workunit.client.1.smithi098.stdout:2/110: creat d6/dc/d1c/d1f/f24 x:0 0 0 2023-01-04T18:16:25.565 INFO:tasks.workunit.client.1.smithi098.stdout:9/96: write f0 [3246349,46121] 0 2023-01-04T18:16:25.567 INFO:tasks.workunit.client.0.smithi050.stdout:5/119: mknod d13/c23 0 2023-01-04T18:16:25.567 INFO:tasks.workunit.client.1.smithi098.stdout:7/50: dwrite d1/f5 [0,4194304] 0 2023-01-04T18:16:25.568 INFO:tasks.workunit.client.0.smithi050.stdout:5/120: dread f11 [0,4194304] 0 2023-01-04T18:16:25.570 INFO:tasks.workunit.client.1.smithi098.stdout:8/60: unlink d6/d7/ca 0 2023-01-04T18:16:25.570 INFO:tasks.workunit.client.1.smithi098.stdout:8/61: readlink l3 0 2023-01-04T18:16:25.571 INFO:tasks.workunit.client.1.smithi098.stdout:0/111: dread f5 [0,4194304] 0 2023-01-04T18:16:25.571 INFO:tasks.workunit.client.1.smithi098.stdout:0/112: fdatasync f5 0 2023-01-04T18:16:25.573 INFO:tasks.workunit.client.0.smithi050.stdout:5/121: link d13/d15/l21 d13/d15/d17/l24 0 2023-01-04T18:16:25.573 INFO:tasks.workunit.client.0.smithi050.stdout:5/122: dread - d13/d15/d17/f1e zero size 2023-01-04T18:16:25.576 INFO:tasks.workunit.client.0.smithi050.stdout:5/123: unlink cc 0 2023-01-04T18:16:25.576 INFO:tasks.workunit.client.0.smithi050.stdout:5/124: stat f11 0 2023-01-04T18:16:25.578 INFO:tasks.workunit.client.1.smithi098.stdout:7/51: rmdir d1 39 2023-01-04T18:16:25.579 INFO:tasks.workunit.client.1.smithi098.stdout:5/48: truncate d1/d2/f3 357058 0 2023-01-04T18:16:25.581 INFO:tasks.workunit.client.1.smithi098.stdout:0/113: creat df/d17/d1c/f2f x:0 0 0 2023-01-04T18:16:25.585 INFO:tasks.workunit.client.1.smithi098.stdout:0/114: mknod df/d17/c30 0 2023-01-04T18:16:25.585 INFO:tasks.workunit.client.1.smithi098.stdout:5/49: mkdir d1/da 0 2023-01-04T18:16:25.586 INFO:tasks.workunit.client.1.smithi098.stdout:0/115: creat df/d17/d1c/f31 x:0 0 0 2023-01-04T18:16:25.587 INFO:tasks.workunit.client.1.smithi098.stdout:5/50: stat d1/f9 0 2023-01-04T18:16:25.587 INFO:tasks.workunit.client.1.smithi098.stdout:5/51: fsync d1/f9 0 2023-01-04T18:16:25.588 INFO:tasks.workunit.client.1.smithi098.stdout:4/52: dwrite d5/f8 [0,4194304] 0 2023-01-04T18:16:25.588 INFO:tasks.workunit.client.1.smithi098.stdout:4/53: fsync d5/f8 0 2023-01-04T18:16:25.592 INFO:tasks.workunit.client.1.smithi098.stdout:4/54: mknod d5/cd 0 2023-01-04T18:16:25.592 INFO:tasks.workunit.client.1.smithi098.stdout:9/97: dread f0 [0,4194304] 0 2023-01-04T18:16:25.592 INFO:tasks.workunit.client.1.smithi098.stdout:0/116: dread df/f28 [0,4194304] 0 2023-01-04T18:16:25.592 INFO:tasks.workunit.client.1.smithi098.stdout:4/55: mkdir d5/de 0 2023-01-04T18:16:25.592 INFO:tasks.workunit.client.1.smithi098.stdout:9/98: creat d2/d5/f16 x:0 0 0 2023-01-04T18:16:25.592 INFO:tasks.workunit.client.1.smithi098.stdout:0/117: mknod df/d17/d1c/c32 0 2023-01-04T18:16:25.593 INFO:tasks.workunit.client.1.smithi098.stdout:9/99: rename d2/d5/ce to d2/d5/c17 0 2023-01-04T18:16:25.594 INFO:tasks.workunit.client.1.smithi098.stdout:0/118: rmdir df/d17/d24 39 2023-01-04T18:16:25.595 INFO:tasks.workunit.client.1.smithi098.stdout:0/119: link df/d17/c27 df/d17/d24/c33 0 2023-01-04T18:16:25.596 INFO:tasks.workunit.client.1.smithi098.stdout:9/100: dread d2/f10 [0,4194304] 0 2023-01-04T18:16:25.605 INFO:tasks.workunit.client.1.smithi098.stdout:2/111: rmdir d6/dc 39 2023-01-04T18:16:25.605 INFO:tasks.workunit.client.1.smithi098.stdout:2/112: rename d6/dc to d6/dc/d1c/d25 22 2023-01-04T18:16:25.605 INFO:tasks.workunit.client.1.smithi098.stdout:2/113: chown d6/f20 17655 1 2023-01-04T18:16:25.607 INFO:tasks.workunit.client.1.smithi098.stdout:6/47: dwrite f5 [0,4194304] 0 2023-01-04T18:16:25.607 INFO:tasks.workunit.client.1.smithi098.stdout:2/114: mknod d6/dc/d1c/c26 0 2023-01-04T18:16:25.607 INFO:tasks.workunit.client.1.smithi098.stdout:2/115: readlink d6/dc/l21 0 2023-01-04T18:16:25.607 INFO:tasks.workunit.client.1.smithi098.stdout:2/116: truncate d6/fa 1204729 0 2023-01-04T18:16:25.608 INFO:tasks.workunit.client.1.smithi098.stdout:6/48: write f4 [878512,20875] 0 2023-01-04T18:16:25.614 INFO:tasks.workunit.client.1.smithi098.stdout:7/52: dwrite d1/f7 [0,4194304] 0 2023-01-04T18:16:25.614 INFO:tasks.workunit.client.1.smithi098.stdout:2/117: mkdir d6/dc/d27 0 2023-01-04T18:16:25.614 INFO:tasks.workunit.client.1.smithi098.stdout:0/120: dwrite df/f11 [0,4194304] 0 2023-01-04T18:16:25.615 INFO:tasks.workunit.client.0.smithi050.stdout:5/125: dwrite f11 [0,4194304] 0 2023-01-04T18:16:25.615 INFO:tasks.workunit.client.1.smithi098.stdout:2/118: write d6/f15 [33424,21712] 0 2023-01-04T18:16:25.615 INFO:tasks.workunit.client.1.smithi098.stdout:2/119: write d6/dc/f14 [759650,64591] 0 2023-01-04T18:16:25.615 INFO:tasks.workunit.client.1.smithi098.stdout:2/120: chown d6/f8 76220429 1 2023-01-04T18:16:25.617 INFO:tasks.workunit.client.1.smithi098.stdout:4/56: dwrite d5/f8 [0,4194304] 0 2023-01-04T18:16:25.617 INFO:tasks.workunit.client.1.smithi098.stdout:5/52: truncate d1/f6 3838810 0 2023-01-04T18:16:25.617 INFO:tasks.workunit.client.1.smithi098.stdout:7/53: write d1/f7 [1882788,4264] 0 2023-01-04T18:16:25.618 INFO:tasks.workunit.client.1.smithi098.stdout:5/53: dread d1/f9 [0,4194304] 0 2023-01-04T18:16:25.618 INFO:tasks.workunit.client.1.smithi098.stdout:5/54: getdents d1/da 0 2023-01-04T18:16:25.619 INFO:tasks.workunit.client.1.smithi098.stdout:8/62: rmdir d6/d7 0 2023-01-04T18:16:25.619 INFO:tasks.workunit.client.1.smithi098.stdout:5/55: write d1/d2/f3 [42400,18883] 0 2023-01-04T18:16:25.621 INFO:tasks.workunit.client.1.smithi098.stdout:6/49: rename c6 to d9/cb 0 2023-01-04T18:16:25.621 INFO:tasks.workunit.client.1.smithi098.stdout:6/50: dread - d9/fa zero size 2023-01-04T18:16:25.625 INFO:tasks.workunit.client.1.smithi098.stdout:9/101: getdents d2/d5 0 2023-01-04T18:16:25.628 INFO:tasks.workunit.client.1.smithi098.stdout:0/121: creat df/d17/d24/f34 x:0 0 0 2023-01-04T18:16:25.628 INFO:tasks.workunit.client.1.smithi098.stdout:0/122: write f5 [6529318,75063] 0 2023-01-04T18:16:25.634 INFO:tasks.workunit.client.1.smithi098.stdout:7/54: mkdir d1/d4/d11 0 2023-01-04T18:16:25.641 INFO:tasks.workunit.client.1.smithi098.stdout:9/102: mkdir d2/d5/d18 0 2023-01-04T18:16:25.641 INFO:tasks.workunit.client.1.smithi098.stdout:8/63: dwrite d6/f9 [0,4194304] 0 2023-01-04T18:16:25.642 INFO:tasks.workunit.client.1.smithi098.stdout:0/123: truncate df/d17/d1c/f1e 3483244 0 2023-01-04T18:16:25.642 INFO:tasks.workunit.client.0.smithi050.stdout:5/126: dwrite d13/d15/d17/f1e [0,4194304] 0 2023-01-04T18:16:25.644 INFO:tasks.workunit.client.1.smithi098.stdout:4/57: truncate d5/f8 1854075 0 2023-01-04T18:16:25.645 INFO:tasks.workunit.client.1.smithi098.stdout:7/55: mkdir d1/d4/d12 0 2023-01-04T18:16:25.646 INFO:tasks.workunit.client.1.smithi098.stdout:7/56: write d1/f5 [908285,46350] 0 2023-01-04T18:16:25.649 INFO:tasks.workunit.client.1.smithi098.stdout:5/56: unlink d1/l8 0 2023-01-04T18:16:25.650 INFO:tasks.workunit.client.1.smithi098.stdout:3/41: sync 2023-01-04T18:16:25.651 INFO:tasks.workunit.client.1.smithi098.stdout:6/51: truncate f5 1782383 0 2023-01-04T18:16:25.653 INFO:tasks.workunit.client.0.smithi050.stdout:5/127: mknod d13/d15/d17/c25 0 2023-01-04T18:16:25.653 INFO:tasks.workunit.client.0.smithi050.stdout:5/128: chown d13/d15/c1d 28994635 1 2023-01-04T18:16:25.653 INFO:tasks.workunit.client.1.smithi098.stdout:9/103: write d2/d5/f16 [729896,105796] 0 2023-01-04T18:16:25.654 INFO:tasks.workunit.client.1.smithi098.stdout:8/64: symlink d6/ld 0 2023-01-04T18:16:25.656 INFO:tasks.workunit.client.0.smithi050.stdout:5/129: rename f11 to d13/d15/f26 0 2023-01-04T18:16:25.659 INFO:tasks.workunit.client.1.smithi098.stdout:0/124: symlink df/d17/l35 0 2023-01-04T18:16:25.659 INFO:tasks.workunit.client.1.smithi098.stdout:0/125: chown df/d17/d24/c2b 3 1 2023-01-04T18:16:25.660 INFO:tasks.workunit.client.1.smithi098.stdout:0/126: getdents df 0 2023-01-04T18:16:25.663 INFO:tasks.workunit.client.0.smithi050.stdout:5/130: mkdir d13/d15/d17/d27 0 2023-01-04T18:16:25.665 INFO:tasks.workunit.client.1.smithi098.stdout:7/57: mknod d1/dd/c13 0 2023-01-04T18:16:25.667 INFO:tasks.workunit.client.1.smithi098.stdout:3/42: creat d6/fa x:0 0 0 2023-01-04T18:16:25.667 INFO:tasks.workunit.client.1.smithi098.stdout:3/43: truncate d6/fa 219799 0 2023-01-04T18:16:25.667 INFO:tasks.workunit.client.0.smithi050.stdout:5/131: mkdir d13/d28 0 2023-01-04T18:16:25.669 INFO:tasks.workunit.client.1.smithi098.stdout:9/104: mkdir d2/d5/d18/d19 0 2023-01-04T18:16:25.670 INFO:tasks.workunit.client.1.smithi098.stdout:9/105: read d2/d5/f16 [135563,115830] 0 2023-01-04T18:16:25.670 INFO:tasks.workunit.client.1.smithi098.stdout:8/65: getdents d6 0 2023-01-04T18:16:25.671 INFO:tasks.workunit.client.1.smithi098.stdout:8/66: fsync d6/f9 0 2023-01-04T18:16:25.672 INFO:tasks.workunit.client.1.smithi098.stdout:7/58: creat d1/d4/d12/f14 x:0 0 0 2023-01-04T18:16:25.675 INFO:tasks.workunit.client.1.smithi098.stdout:6/52: rename f5 to d9/fc 0 2023-01-04T18:16:25.676 INFO:tasks.workunit.client.1.smithi098.stdout:9/106: creat d2/d5/d18/f1a x:0 0 0 2023-01-04T18:16:25.678 INFO:tasks.workunit.client.1.smithi098.stdout:6/53: mkdir d9/dd 0 2023-01-04T18:16:25.678 INFO:tasks.workunit.client.1.smithi098.stdout:9/107: symlink d2/d5/d18/l1b 0 2023-01-04T18:16:25.679 INFO:tasks.workunit.client.1.smithi098.stdout:9/108: write d2/f10 [5050871,91059] 0 2023-01-04T18:16:25.680 INFO:tasks.workunit.client.1.smithi098.stdout:6/54: rmdir d9 39 2023-01-04T18:16:25.680 INFO:tasks.workunit.client.1.smithi098.stdout:9/109: mknod d2/d5/d18/d19/c1c 0 2023-01-04T18:16:25.681 INFO:tasks.workunit.client.1.smithi098.stdout:6/55: truncate d9/fc 1553181 0 2023-01-04T18:16:25.681 INFO:tasks.workunit.client.1.smithi098.stdout:9/110: write f1 [2925250,88924] 0 2023-01-04T18:16:25.682 INFO:tasks.workunit.client.1.smithi098.stdout:9/111: write f0 [4754205,74460] 0 2023-01-04T18:16:25.683 INFO:tasks.workunit.client.1.smithi098.stdout:9/112: mkdir d2/d5/d18/d1d 0 2023-01-04T18:16:25.683 INFO:tasks.workunit.client.1.smithi098.stdout:9/113: chown d2/d5/lc 72 1 2023-01-04T18:16:25.688 INFO:tasks.workunit.client.1.smithi098.stdout:0/127: dwrite f1 [0,4194304] 0 2023-01-04T18:16:25.688 INFO:tasks.workunit.client.1.smithi098.stdout:7/59: fsync d1/f5 0 2023-01-04T18:16:25.689 INFO:tasks.workunit.client.1.smithi098.stdout:5/57: dwrite d1/f6 [0,4194304] 0 2023-01-04T18:16:25.689 INFO:tasks.workunit.client.1.smithi098.stdout:9/114: fsync d2/f10 0 2023-01-04T18:16:25.690 INFO:tasks.workunit.client.1.smithi098.stdout:4/58: dwrite d5/f8 [0,4194304] 0 2023-01-04T18:16:25.690 INFO:tasks.workunit.client.0.smithi050.stdout:5/132: dread d13/f19 [0,4194304] 0 2023-01-04T18:16:25.692 INFO:tasks.workunit.client.1.smithi098.stdout:3/44: rmdir d6 39 2023-01-04T18:16:25.692 INFO:tasks.workunit.client.1.smithi098.stdout:5/58: symlink d1/da/lb 0 2023-01-04T18:16:25.694 INFO:tasks.workunit.client.0.smithi050.stdout:5/133: mkdir d13/d15/d17/d1f/d29 0 2023-01-04T18:16:25.697 INFO:tasks.workunit.client.1.smithi098.stdout:8/67: truncate d6/f9 1651842 0 2023-01-04T18:16:25.698 INFO:tasks.workunit.client.1.smithi098.stdout:9/115: rename f0 to d2/f1e 0 2023-01-04T18:16:25.700 INFO:tasks.workunit.client.1.smithi098.stdout:7/60: dread d1/d4/ff [0,4194304] 0 2023-01-04T18:16:25.701 INFO:tasks.workunit.client.1.smithi098.stdout:7/61: fdatasync d1/f7 0 2023-01-04T18:16:25.701 INFO:tasks.workunit.client.1.smithi098.stdout:6/56: dwrite d9/fa [0,4194304] 0 2023-01-04T18:16:25.701 INFO:tasks.workunit.client.1.smithi098.stdout:0/128: fsync f5 0 2023-01-04T18:16:25.701 INFO:tasks.workunit.client.1.smithi098.stdout:0/129: stat f5 0 2023-01-04T18:16:25.706 INFO:tasks.workunit.client.1.smithi098.stdout:4/59: creat d5/de/ff x:0 0 0 2023-01-04T18:16:25.706 INFO:tasks.workunit.client.1.smithi098.stdout:7/62: dread d1/d4/ff [0,4194304] 0 2023-01-04T18:16:25.706 INFO:tasks.workunit.client.1.smithi098.stdout:7/63: chown d1 2521 1 2023-01-04T18:16:25.707 INFO:tasks.workunit.client.1.smithi098.stdout:3/45: mknod d6/cb 0 2023-01-04T18:16:25.707 INFO:tasks.workunit.client.1.smithi098.stdout:5/59: creat d1/fc x:0 0 0 2023-01-04T18:16:25.708 INFO:tasks.workunit.client.1.smithi098.stdout:9/116: creat d2/d5/d18/f1f x:0 0 0 2023-01-04T18:16:25.712 INFO:tasks.workunit.client.1.smithi098.stdout:0/130: mknod df/d17/d24/c36 0 2023-01-04T18:16:25.712 INFO:tasks.workunit.client.1.smithi098.stdout:4/60: rename d5/de/ff to d5/f10 0 2023-01-04T18:16:25.713 INFO:tasks.workunit.client.1.smithi098.stdout:7/64: rmdir d1/da 39 2023-01-04T18:16:25.714 INFO:tasks.workunit.client.1.smithi098.stdout:7/65: read d1/d4/ff [3991554,74703] 0 2023-01-04T18:16:25.714 INFO:tasks.workunit.client.1.smithi098.stdout:7/66: fdatasync d1/d4/d12/f14 0 2023-01-04T18:16:25.714 INFO:tasks.workunit.client.1.smithi098.stdout:7/67: chown d1/dd 2374 1 2023-01-04T18:16:25.714 INFO:tasks.workunit.client.1.smithi098.stdout:3/46: creat d6/fc x:0 0 0 2023-01-04T18:16:25.714 INFO:tasks.workunit.client.1.smithi098.stdout:3/47: fdatasync d6/fa 0 2023-01-04T18:16:25.714 INFO:tasks.workunit.client.1.smithi098.stdout:3/48: write f4 [151324,19082] 0 2023-01-04T18:16:25.714 INFO:tasks.workunit.client.1.smithi098.stdout:3/49: write d6/fc [305292,125151] 0 2023-01-04T18:16:25.715 INFO:tasks.workunit.client.1.smithi098.stdout:5/60: link d1/d2/c7 d1/d2/cd 0 2023-01-04T18:16:25.716 INFO:tasks.workunit.client.1.smithi098.stdout:9/117: mkdir d2/d5/d18/d19/d20 0 2023-01-04T18:16:25.716 INFO:tasks.workunit.client.1.smithi098.stdout:0/131: symlink df/d17/l37 0 2023-01-04T18:16:25.716 INFO:tasks.workunit.client.1.smithi098.stdout:0/132: fdatasync df/f14 0 2023-01-04T18:16:25.717 INFO:tasks.workunit.client.1.smithi098.stdout:0/133: stat df/d17/d24/c2b 0 2023-01-04T18:16:25.718 INFO:tasks.workunit.client.1.smithi098.stdout:7/68: truncate d1/d4/ff 3480601 0 2023-01-04T18:16:25.718 INFO:tasks.workunit.client.1.smithi098.stdout:3/50: creat d6/fd x:0 0 0 2023-01-04T18:16:25.718 INFO:tasks.workunit.client.1.smithi098.stdout:3/51: fsync f3 0 2023-01-04T18:16:25.718 INFO:tasks.workunit.client.1.smithi098.stdout:3/52: chown d6/c8 52194922 1 2023-01-04T18:16:25.719 INFO:tasks.workunit.client.1.smithi098.stdout:7/69: mknod d1/d4/d11/c15 0 2023-01-04T18:16:25.719 INFO:tasks.workunit.client.1.smithi098.stdout:0/134: write df/f11 [779100,3842] 0 2023-01-04T18:16:25.719 INFO:tasks.workunit.client.1.smithi098.stdout:0/135: dread - df/d17/d1c/f22 zero size 2023-01-04T18:16:25.722 INFO:tasks.workunit.client.0.smithi050.stdout:5/134: dwrite d13/d15/d17/f1e [0,4194304] 0 2023-01-04T18:16:25.722 INFO:tasks.workunit.client.1.smithi098.stdout:3/53: link l5 d6/le 0 2023-01-04T18:16:25.722 INFO:tasks.workunit.client.1.smithi098.stdout:8/68: dwrite d6/f9 [0,4194304] 0 2023-01-04T18:16:25.723 INFO:tasks.workunit.client.1.smithi098.stdout:7/70: creat d1/da/f16 x:0 0 0 2023-01-04T18:16:25.724 INFO:tasks.workunit.client.1.smithi098.stdout:8/69: read d6/f9 [402019,4584] 0 2023-01-04T18:16:25.726 INFO:tasks.workunit.client.0.smithi050.stdout:5/135: symlink d13/d15/d17/d27/l2a 0 2023-01-04T18:16:25.727 INFO:tasks.workunit.client.1.smithi098.stdout:2/121: sync 2023-01-04T18:16:25.728 INFO:tasks.workunit.client.1.smithi098.stdout:1/73: sync 2023-01-04T18:16:25.728 INFO:tasks.workunit.client.1.smithi098.stdout:1/74: chown d1/f2 12705 1 2023-01-04T18:16:25.729 INFO:tasks.workunit.client.1.smithi098.stdout:0/136: link df/d17/d1c/f2f df/f38 0 2023-01-04T18:16:25.732 INFO:tasks.workunit.client.1.smithi098.stdout:3/54: unlink d6/fd 0 2023-01-04T18:16:25.734 INFO:tasks.workunit.client.0.smithi050.stdout:5/136: creat d13/d15/d17/d27/f2b x:0 0 0 2023-01-04T18:16:25.735 INFO:tasks.workunit.client.1.smithi098.stdout:7/71: creat d1/d4/d12/f17 x:0 0 0 2023-01-04T18:16:25.737 INFO:tasks.workunit.client.1.smithi098.stdout:4/61: getdents d5/de 0 2023-01-04T18:16:25.738 INFO:tasks.workunit.client.1.smithi098.stdout:2/122: truncate d6/f16 2276144 0 2023-01-04T18:16:25.738 INFO:tasks.workunit.client.1.smithi098.stdout:2/123: dread - d6/dc/d1c/d1f/f23 zero size 2023-01-04T18:16:25.738 INFO:tasks.workunit.client.0.smithi050.stdout:5/137: creat d13/d15/d17/d27/f2c x:0 0 0 2023-01-04T18:16:25.739 INFO:tasks.workunit.client.1.smithi098.stdout:7/72: write d1/f5 [2462644,4341] 0 2023-01-04T18:16:25.739 INFO:tasks.workunit.client.1.smithi098.stdout:7/73: readlink d1/l9 0 2023-01-04T18:16:25.741 INFO:tasks.workunit.client.1.smithi098.stdout:1/75: mknod d1/d8/da/d12/c1e 0 2023-01-04T18:16:25.743 INFO:tasks.workunit.client.1.smithi098.stdout:9/118: dwrite d2/d5/d18/f1a [0,4194304] 0 2023-01-04T18:16:25.743 INFO:tasks.workunit.client.1.smithi098.stdout:0/137: rename l9 to df/d17/d24/l39 0 2023-01-04T18:16:25.743 INFO:tasks.workunit.client.1.smithi098.stdout:0/138: chown df/d17/d24/f2e 218317860 1 2023-01-04T18:16:25.743 INFO:tasks.workunit.client.1.smithi098.stdout:5/61: dwrite d1/f9 [0,4194304] 0 2023-01-04T18:16:25.743 INFO:tasks.workunit.client.1.smithi098.stdout:4/62: creat d5/de/f11 x:0 0 0 2023-01-04T18:16:25.743 INFO:tasks.workunit.client.1.smithi098.stdout:4/63: dread - d5/de/f11 zero size 2023-01-04T18:16:25.744 INFO:tasks.workunit.client.1.smithi098.stdout:8/70: dwrite d6/f9 [0,4194304] 0 2023-01-04T18:16:25.744 INFO:tasks.workunit.client.1.smithi098.stdout:8/71: chown d6 1384972993 1 2023-01-04T18:16:25.745 INFO:tasks.workunit.client.1.smithi098.stdout:0/139: read f0 [2081585,63296] 0 2023-01-04T18:16:25.745 INFO:tasks.workunit.client.1.smithi098.stdout:0/140: chown df/d17/c30 60755 1 2023-01-04T18:16:25.746 INFO:tasks.workunit.client.1.smithi098.stdout:0/141: write df/f11 [2376971,102736] 0 2023-01-04T18:16:25.746 INFO:tasks.workunit.client.1.smithi098.stdout:2/124: link c1 d6/dc/d1c/c28 0 2023-01-04T18:16:25.746 INFO:tasks.workunit.client.1.smithi098.stdout:7/74: symlink d1/d4/l18 0 2023-01-04T18:16:25.750 INFO:tasks.workunit.client.1.smithi098.stdout:1/76: truncate d1/d8/f10 503329 0 2023-01-04T18:16:25.758 INFO:tasks.workunit.client.1.smithi098.stdout:1/77: dread d1/fc [0,4194304] 0 2023-01-04T18:16:25.759 INFO:tasks.workunit.client.1.smithi098.stdout:0/142: write df/d17/f1f [452373,123695] 0 2023-01-04T18:16:25.759 INFO:tasks.workunit.client.1.smithi098.stdout:0/143: write df/f28 [516456,61882] 0 2023-01-04T18:16:25.759 INFO:tasks.workunit.client.1.smithi098.stdout:0/144: fsync df/d17/d1c/f22 0 2023-01-04T18:16:25.761 INFO:tasks.workunit.client.1.smithi098.stdout:3/55: rename f4 to d6/ff 0 2023-01-04T18:16:25.762 INFO:tasks.workunit.client.1.smithi098.stdout:3/56: fdatasync f3 0 2023-01-04T18:16:25.765 INFO:tasks.workunit.client.1.smithi098.stdout:4/64: rmdir d5 39 2023-01-04T18:16:25.767 INFO:tasks.workunit.client.1.smithi098.stdout:8/72: dwrite d6/f9 [4194304,4194304] 0 2023-01-04T18:16:25.769 INFO:tasks.workunit.client.1.smithi098.stdout:7/75: creat d1/dd/f19 x:0 0 0 2023-01-04T18:16:25.770 INFO:tasks.workunit.client.1.smithi098.stdout:1/78: creat d1/f1f x:0 0 0 2023-01-04T18:16:25.771 INFO:tasks.workunit.client.1.smithi098.stdout:9/119: dwrite f1 [4194304,4194304] 0 2023-01-04T18:16:25.772 INFO:tasks.workunit.client.1.smithi098.stdout:0/145: creat df/d17/d1c/f3a x:0 0 0 2023-01-04T18:16:25.772 INFO:tasks.workunit.client.1.smithi098.stdout:2/125: dwrite d6/dc/f12 [0,4194304] 0 2023-01-04T18:16:25.772 INFO:tasks.workunit.client.1.smithi098.stdout:2/126: write d6/dc/fe [4344834,20013] 0 2023-01-04T18:16:25.773 INFO:tasks.workunit.client.1.smithi098.stdout:4/65: dread f4 [0,4194304] 0 2023-01-04T18:16:25.774 INFO:tasks.workunit.client.1.smithi098.stdout:3/57: mkdir d6/d10 0 2023-01-04T18:16:25.774 INFO:tasks.workunit.client.1.smithi098.stdout:5/62: symlink d1/le 0 2023-01-04T18:16:25.776 INFO:tasks.workunit.client.1.smithi098.stdout:8/73: creat d6/fe x:0 0 0 2023-01-04T18:16:25.778 INFO:tasks.workunit.client.1.smithi098.stdout:7/76: creat d1/da/f1a x:0 0 0 2023-01-04T18:16:25.781 INFO:tasks.workunit.client.1.smithi098.stdout:1/79: rmdir d1/d8 39 2023-01-04T18:16:25.781 INFO:tasks.workunit.client.1.smithi098.stdout:1/80: write d1/d8/da/d12/f15 [452280,70390] 0 2023-01-04T18:16:25.782 INFO:tasks.workunit.client.1.smithi098.stdout:6/57: sync 2023-01-04T18:16:25.785 INFO:tasks.workunit.client.1.smithi098.stdout:0/146: unlink df/l19 0 2023-01-04T18:16:25.789 INFO:tasks.workunit.client.1.smithi098.stdout:4/66: rename d5/f10 to d5/f12 0 2023-01-04T18:16:25.792 INFO:tasks.workunit.client.1.smithi098.stdout:5/63: mknod d1/d2/cf 0 2023-01-04T18:16:25.793 INFO:tasks.workunit.client.1.smithi098.stdout:8/74: unlink l3 0 2023-01-04T18:16:25.796 INFO:tasks.workunit.client.1.smithi098.stdout:9/120: truncate d2/f10 5440942 0 2023-01-04T18:16:25.797 INFO:tasks.workunit.client.1.smithi098.stdout:4/67: mkdir d5/d9/d13 0 2023-01-04T18:16:25.799 INFO:tasks.workunit.client.1.smithi098.stdout:5/64: getdents d1/da 0 2023-01-04T18:16:25.799 INFO:tasks.workunit.client.1.smithi098.stdout:2/127: dwrite d6/f20 [0,4194304] 0 2023-01-04T18:16:25.802 INFO:tasks.workunit.client.1.smithi098.stdout:8/75: creat d6/ff x:0 0 0 2023-01-04T18:16:25.803 INFO:tasks.workunit.client.1.smithi098.stdout:8/76: read d6/f9 [6000551,47814] 0 2023-01-04T18:16:25.803 INFO:tasks.workunit.client.1.smithi098.stdout:8/77: write d6/fe [518891,33088] 0 2023-01-04T18:16:25.804 INFO:tasks.workunit.client.1.smithi098.stdout:9/121: symlink d2/d5/d18/d19/l21 0 2023-01-04T18:16:25.804 INFO:tasks.workunit.client.1.smithi098.stdout:9/122: fdatasync f1 0 2023-01-04T18:16:25.804 INFO:tasks.workunit.client.1.smithi098.stdout:9/123: readlink d2/l14 0 2023-01-04T18:16:25.804 INFO:tasks.workunit.client.1.smithi098.stdout:9/124: chown d2/d5/d18/f1f 816787616 1 2023-01-04T18:16:25.805 INFO:tasks.workunit.client.1.smithi098.stdout:3/58: dwrite d6/fa [0,4194304] 0 2023-01-04T18:16:25.805 INFO:tasks.workunit.client.1.smithi098.stdout:6/58: dread f4 [0,4194304] 0 2023-01-04T18:16:25.805 INFO:tasks.workunit.client.1.smithi098.stdout:5/65: mknod d1/da/c10 0 2023-01-04T18:16:25.805 INFO:tasks.workunit.client.1.smithi098.stdout:5/66: readlink d1/da/lb 0 2023-01-04T18:16:25.807 INFO:tasks.workunit.client.1.smithi098.stdout:2/128: truncate d6/f7 709214 0 2023-01-04T18:16:25.807 INFO:tasks.workunit.client.1.smithi098.stdout:2/129: chown d6/dc/d1c/d1f 3602762 1 2023-01-04T18:16:25.810 INFO:tasks.workunit.client.1.smithi098.stdout:9/125: mknod d2/d5/d18/d1d/c22 0 2023-01-04T18:16:25.810 INFO:tasks.workunit.client.1.smithi098.stdout:8/78: symlink d6/dc/l10 0 2023-01-04T18:16:25.814 INFO:tasks.workunit.client.1.smithi098.stdout:3/59: rename l2 to d6/l11 0 2023-01-04T18:16:25.816 INFO:tasks.workunit.client.1.smithi098.stdout:8/79: mkdir d6/d11 0 2023-01-04T18:16:25.816 INFO:tasks.workunit.client.1.smithi098.stdout:9/126: mkdir d2/d5/d18/d1d/d23 0 2023-01-04T18:16:25.816 INFO:tasks.workunit.client.1.smithi098.stdout:9/127: dread - d2/d5/d18/f1f zero size 2023-01-04T18:16:25.817 INFO:tasks.workunit.client.1.smithi098.stdout:9/128: chown d2/d5/d18/d1d 214325 1 2023-01-04T18:16:25.817 INFO:tasks.workunit.client.1.smithi098.stdout:9/129: stat d2/d5/d18 0 2023-01-04T18:16:25.817 INFO:tasks.workunit.client.1.smithi098.stdout:3/60: rename d6/fc to d6/d10/f12 0 2023-01-04T18:16:25.818 INFO:tasks.workunit.client.1.smithi098.stdout:5/67: mknod d1/c11 0 2023-01-04T18:16:25.819 INFO:tasks.workunit.client.1.smithi098.stdout:8/80: mkdir d6/dc/d12 0 2023-01-04T18:16:25.819 INFO:tasks.workunit.client.1.smithi098.stdout:8/81: rename d6 to d6/d11/d13 22 2023-01-04T18:16:25.819 INFO:tasks.workunit.client.1.smithi098.stdout:8/82: stat d6/ld 0 2023-01-04T18:16:25.820 INFO:tasks.workunit.client.1.smithi098.stdout:3/61: truncate f3 2585738 0 2023-01-04T18:16:25.821 INFO:tasks.workunit.client.1.smithi098.stdout:8/83: symlink d6/dc/l14 0 2023-01-04T18:16:25.821 INFO:tasks.workunit.client.1.smithi098.stdout:8/84: readlink d6/dc/l14 0 2023-01-04T18:16:25.826 INFO:tasks.workunit.client.1.smithi098.stdout:9/130: dread d2/d5/f6 [0,4194304] 0 2023-01-04T18:16:25.827 INFO:tasks.workunit.client.1.smithi098.stdout:9/131: write d2/f1e [3306266,58948] 0 2023-01-04T18:16:25.835 INFO:tasks.workunit.client.1.smithi098.stdout:1/81: dwrite d1/f1b [0,4194304] 0 2023-01-04T18:16:25.899 INFO:tasks.workunit.client.1.smithi098.stdout:6/59: dwrite d9/fa [0,4194304] 0 2023-01-04T18:16:25.899 INFO:tasks.workunit.client.1.smithi098.stdout:6/60: write d9/fc [2011659,33982] 0 2023-01-04T18:16:25.899 INFO:tasks.workunit.client.1.smithi098.stdout:6/61: write f4 [5175574,56077] 0 2023-01-04T18:16:25.900 INFO:tasks.workunit.client.1.smithi098.stdout:4/68: dwrite f4 [0,4194304] 0 2023-01-04T18:16:25.903 INFO:tasks.workunit.client.1.smithi098.stdout:9/132: fdatasync f1 0 2023-01-04T18:16:25.903 INFO:tasks.workunit.client.1.smithi098.stdout:9/133: dread - d2/d5/d18/f1f zero size 2023-01-04T18:16:25.903 INFO:tasks.workunit.client.1.smithi098.stdout:9/134: fsync d2/f1e 0 2023-01-04T18:16:25.903 INFO:tasks.workunit.client.1.smithi098.stdout:9/135: chown d2/l14 14077 1 2023-01-04T18:16:25.903 INFO:tasks.workunit.client.1.smithi098.stdout:2/130: dwrite d6/dc/fe [0,4194304] 0 2023-01-04T18:16:25.905 INFO:tasks.workunit.client.1.smithi098.stdout:6/62: mkdir d9/dd/de 0 2023-01-04T18:16:25.905 INFO:tasks.workunit.client.1.smithi098.stdout:6/63: chown d9/cb 20499 1 2023-01-04T18:16:25.906 INFO:tasks.workunit.client.1.smithi098.stdout:4/69: creat d5/d9/d13/f14 x:0 0 0 2023-01-04T18:16:25.907 INFO:tasks.workunit.client.1.smithi098.stdout:2/131: dread d6/fa [0,4194304] 0 2023-01-04T18:16:25.908 INFO:tasks.workunit.client.1.smithi098.stdout:9/136: creat d2/d5/f24 x:0 0 0 2023-01-04T18:16:25.908 INFO:tasks.workunit.client.1.smithi098.stdout:8/85: dwrite d6/f9 [8388608,4194304] 0 2023-01-04T18:16:25.908 INFO:tasks.workunit.client.1.smithi098.stdout:8/86: readlink d6/ld 0 2023-01-04T18:16:25.909 INFO:tasks.workunit.client.1.smithi098.stdout:1/82: dwrite d1/d8/da/d12/f16 [0,4194304] 0 2023-01-04T18:16:25.909 INFO:tasks.workunit.client.1.smithi098.stdout:1/83: chown d1/c1c 782 1 2023-01-04T18:16:25.910 INFO:tasks.workunit.client.1.smithi098.stdout:5/68: dwrite d1/f9 [4194304,4194304] 0 2023-01-04T18:16:25.914 INFO:tasks.workunit.client.1.smithi098.stdout:4/70: creat d5/de/f15 x:0 0 0 2023-01-04T18:16:25.915 INFO:tasks.workunit.client.1.smithi098.stdout:2/132: rmdir d6/dc/d27 0 2023-01-04T18:16:25.917 INFO:tasks.workunit.client.1.smithi098.stdout:9/137: symlink d2/d5/d18/d1d/d23/l25 0 2023-01-04T18:16:25.917 INFO:tasks.workunit.client.1.smithi098.stdout:2/133: dread d6/f15 [0,4194304] 0 2023-01-04T18:16:25.923 INFO:tasks.workunit.client.1.smithi098.stdout:1/84: dread d1/f4 [0,4194304] 0 2023-01-04T18:16:25.924 INFO:tasks.workunit.client.1.smithi098.stdout:1/85: chown d1/d8/da/cf 47969 1 2023-01-04T18:16:25.924 INFO:tasks.workunit.client.1.smithi098.stdout:8/87: mkdir d6/d11/d15 0 2023-01-04T18:16:25.926 INFO:tasks.workunit.client.1.smithi098.stdout:8/88: read d6/f9 [5947362,51599] 0 2023-01-04T18:16:25.926 INFO:tasks.workunit.client.1.smithi098.stdout:8/89: write d6/ff [638415,70728] 0 2023-01-04T18:16:25.926 INFO:tasks.workunit.client.1.smithi098.stdout:8/90: write d6/ff [991507,68197] 0 2023-01-04T18:16:25.926 INFO:tasks.workunit.client.1.smithi098.stdout:6/64: link l7 d9/dd/de/lf 0 2023-01-04T18:16:25.926 INFO:tasks.workunit.client.1.smithi098.stdout:6/65: chown d9/fc 8 1 2023-01-04T18:16:25.927 INFO:tasks.workunit.client.1.smithi098.stdout:2/134: link d6/dc/f12 d6/dc/d1c/d1f/f29 0 2023-01-04T18:16:25.928 INFO:tasks.workunit.client.1.smithi098.stdout:9/138: mkdir d2/d5/d18/d19/d20/d26 0 2023-01-04T18:16:25.933 INFO:tasks.workunit.client.1.smithi098.stdout:6/66: symlink d9/dd/l10 0 2023-01-04T18:16:25.933 INFO:tasks.workunit.client.1.smithi098.stdout:1/86: dread d1/f2 [0,4194304] 0 2023-01-04T18:16:25.934 INFO:tasks.workunit.client.1.smithi098.stdout:9/139: dread d2/f10 [0,4194304] 0 2023-01-04T18:16:25.934 INFO:tasks.workunit.client.1.smithi098.stdout:9/140: truncate d2/d5/f24 956594 0 2023-01-04T18:16:25.935 INFO:tasks.workunit.client.1.smithi098.stdout:1/87: read d1/fc [579656,81235] 0 2023-01-04T18:16:25.935 INFO:tasks.workunit.client.1.smithi098.stdout:6/67: creat d9/dd/f11 x:0 0 0 2023-01-04T18:16:25.935 INFO:tasks.workunit.client.1.smithi098.stdout:2/135: link d6/c1d d6/c2a 0 2023-01-04T18:16:25.936 INFO:tasks.workunit.client.1.smithi098.stdout:9/141: creat d2/d5/f27 x:0 0 0 2023-01-04T18:16:25.936 INFO:tasks.workunit.client.1.smithi098.stdout:9/142: truncate d2/d5/f16 1293846 0 2023-01-04T18:16:25.936 INFO:tasks.workunit.client.1.smithi098.stdout:5/69: dwrite d1/d2/f3 [0,4194304] 0 2023-01-04T18:16:25.938 INFO:tasks.workunit.client.1.smithi098.stdout:1/88: unlink d1/f6 0 2023-01-04T18:16:25.939 INFO:tasks.workunit.client.1.smithi098.stdout:4/71: dwrite f4 [0,4194304] 0 2023-01-04T18:16:25.939 INFO:tasks.workunit.client.1.smithi098.stdout:4/72: truncate d5/de/f11 305355 0 2023-01-04T18:16:25.941 INFO:tasks.workunit.client.1.smithi098.stdout:8/91: dread d6/f9 [4194304,4194304] 0 2023-01-04T18:16:25.943 INFO:tasks.workunit.client.1.smithi098.stdout:5/70: rename d1/da/c10 to d1/da/c12 0 2023-01-04T18:16:25.943 INFO:tasks.workunit.client.1.smithi098.stdout:4/73: creat d5/f16 x:0 0 0 2023-01-04T18:16:25.943 INFO:tasks.workunit.client.1.smithi098.stdout:4/74: readlink d5/l7 0 2023-01-04T18:16:25.944 INFO:tasks.workunit.client.1.smithi098.stdout:8/92: symlink d6/d11/d15/l16 0 2023-01-04T18:16:25.946 INFO:tasks.workunit.client.1.smithi098.stdout:1/89: creat d1/d8/da/d12/f20 x:0 0 0 2023-01-04T18:16:25.947 INFO:tasks.workunit.client.1.smithi098.stdout:9/143: rename d2/d5/f27 to d2/d5/f28 0 2023-01-04T18:16:25.947 INFO:tasks.workunit.client.1.smithi098.stdout:9/144: chown d2/f1e 126 1 2023-01-04T18:16:25.949 INFO:tasks.workunit.client.1.smithi098.stdout:5/71: rmdir d1/d2 39 2023-01-04T18:16:25.951 INFO:tasks.workunit.client.1.smithi098.stdout:6/68: dread f4 [0,4194304] 0 2023-01-04T18:16:25.953 INFO:tasks.workunit.client.1.smithi098.stdout:4/75: stat c3 0 2023-01-04T18:16:25.954 INFO:tasks.workunit.client.1.smithi098.stdout:5/72: write d1/d2/f3 [1053983,96785] 0 2023-01-04T18:16:25.954 INFO:tasks.workunit.client.1.smithi098.stdout:2/136: dwrite d6/f8 [0,4194304] 0 2023-01-04T18:16:25.955 INFO:tasks.workunit.client.1.smithi098.stdout:8/93: symlink d6/l17 0 2023-01-04T18:16:25.955 INFO:tasks.workunit.client.1.smithi098.stdout:8/94: fdatasync d6/f9 0 2023-01-04T18:16:25.956 INFO:tasks.workunit.client.1.smithi098.stdout:9/145: dread - d2/d5/fb zero size 2023-01-04T18:16:25.959 INFO:tasks.workunit.client.1.smithi098.stdout:4/76: write f4 [558901,97521] 0 2023-01-04T18:16:25.959 INFO:tasks.workunit.client.1.smithi098.stdout:6/69: mknod d9/dd/c12 0 2023-01-04T18:16:25.963 INFO:tasks.workunit.client.1.smithi098.stdout:5/73: getdents d1/da 0 2023-01-04T18:16:25.964 INFO:tasks.workunit.client.1.smithi098.stdout:2/137: getdents d6/dc 0 2023-01-04T18:16:25.965 INFO:tasks.workunit.client.1.smithi098.stdout:8/95: creat d6/dc/f18 x:0 0 0 2023-01-04T18:16:25.965 INFO:tasks.workunit.client.1.smithi098.stdout:9/146: dread d2/d5/d18/f1a [0,4194304] 0 2023-01-04T18:16:25.966 INFO:tasks.workunit.client.1.smithi098.stdout:6/70: mknod d9/dd/de/c13 0 2023-01-04T18:16:25.967 INFO:tasks.workunit.client.1.smithi098.stdout:1/90: dwrite d1/fc [0,4194304] 0 2023-01-04T18:16:25.968 INFO:tasks.workunit.client.1.smithi098.stdout:6/71: write d9/fc [1858702,85405] 0 2023-01-04T18:16:25.968 INFO:tasks.workunit.client.1.smithi098.stdout:5/74: creat d1/da/f13 x:0 0 0 2023-01-04T18:16:25.977 INFO:tasks.workunit.client.1.smithi098.stdout:6/72: dread d9/fa [0,4194304] 0 2023-01-04T18:16:25.983 INFO:tasks.workunit.client.1.smithi098.stdout:6/73: unlink f4 0 2023-01-04T18:16:25.984 INFO:tasks.workunit.client.1.smithi098.stdout:6/74: symlink d9/dd/l14 0 2023-01-04T18:16:25.985 INFO:tasks.workunit.client.1.smithi098.stdout:6/75: read - d9/dd/f11 zero size 2023-01-04T18:16:25.985 INFO:tasks.workunit.client.1.smithi098.stdout:2/138: dwrite f3 [0,4194304] 0 2023-01-04T18:16:25.989 INFO:tasks.workunit.client.1.smithi098.stdout:9/147: dwrite d2/d5/d18/f1f [0,4194304] 0 2023-01-04T18:16:25.989 INFO:tasks.workunit.client.1.smithi098.stdout:2/139: mkdir d6/dc/d2b 0 2023-01-04T18:16:25.989 INFO:tasks.workunit.client.1.smithi098.stdout:9/148: read d2/d5/d18/f1a [276468,95466] 0 2023-01-04T18:16:25.990 INFO:tasks.workunit.client.1.smithi098.stdout:2/140: dread - d6/dc/d1c/d1f/f22 zero size 2023-01-04T18:16:25.990 INFO:tasks.workunit.client.1.smithi098.stdout:2/141: chown d6/dc/c13 1750 1 2023-01-04T18:16:25.990 INFO:tasks.workunit.client.1.smithi098.stdout:6/76: dread d9/fc [0,4194304] 0 2023-01-04T18:16:25.991 INFO:tasks.workunit.client.1.smithi098.stdout:6/77: dread - d9/dd/f11 zero size 2023-01-04T18:16:25.991 INFO:tasks.workunit.client.1.smithi098.stdout:5/75: dread d1/f9 [0,4194304] 0 2023-01-04T18:16:25.992 INFO:tasks.workunit.client.1.smithi098.stdout:9/149: rename d2/la to d2/d5/d18/l29 0 2023-01-04T18:16:25.994 INFO:tasks.workunit.client.1.smithi098.stdout:2/142: creat d6/dc/d1c/f2c x:0 0 0 2023-01-04T18:16:25.994 INFO:tasks.workunit.client.1.smithi098.stdout:6/78: mkdir d9/dd/d15 0 2023-01-04T18:16:25.994 INFO:tasks.workunit.client.1.smithi098.stdout:2/143: chown f3 108629 1 2023-01-04T18:16:25.997 INFO:tasks.workunit.client.1.smithi098.stdout:5/76: mkdir d1/d2/d14 0 2023-01-04T18:16:25.997 INFO:tasks.workunit.client.1.smithi098.stdout:9/150: mkdir d2/d5/d18/d19/d2a 0 2023-01-04T18:16:25.997 INFO:tasks.workunit.client.1.smithi098.stdout:5/77: fsync d1/fc 0 2023-01-04T18:16:25.997 INFO:tasks.workunit.client.1.smithi098.stdout:5/78: chown d1/d2/d14 127262 1 2023-01-04T18:16:25.997 INFO:tasks.workunit.client.1.smithi098.stdout:6/79: dread d9/fc [0,4194304] 0 2023-01-04T18:16:25.997 INFO:tasks.workunit.client.1.smithi098.stdout:6/80: chown d9/dd/f11 1152679 1 2023-01-04T18:16:25.998 INFO:tasks.workunit.client.1.smithi098.stdout:0/147: sync 2023-01-04T18:16:25.998 INFO:tasks.workunit.client.1.smithi098.stdout:7/77: sync 2023-01-04T18:16:25.998 INFO:tasks.workunit.client.1.smithi098.stdout:3/62: sync 2023-01-04T18:16:25.998 INFO:tasks.workunit.client.1.smithi098.stdout:0/148: readlink df/l20 0 2023-01-04T18:16:25.998 INFO:tasks.workunit.client.1.smithi098.stdout:3/63: readlink d6/le 0 2023-01-04T18:16:25.998 INFO:tasks.workunit.client.1.smithi098.stdout:0/149: dread - df/d17/d1c/f31 zero size 2023-01-04T18:16:25.998 INFO:tasks.workunit.client.1.smithi098.stdout:3/64: readlink l0 0 2023-01-04T18:16:25.998 INFO:tasks.workunit.client.1.smithi098.stdout:3/65: readlink l0 0 2023-01-04T18:16:25.999 INFO:tasks.workunit.client.1.smithi098.stdout:2/144: getdents d6 0 2023-01-04T18:16:26.001 INFO:tasks.workunit.client.1.smithi098.stdout:9/151: rmdir d2/d5/d18/d19 39 2023-01-04T18:16:26.001 INFO:tasks.workunit.client.1.smithi098.stdout:5/79: unlink d1/d2/cf 0 2023-01-04T18:16:26.004 INFO:tasks.workunit.client.1.smithi098.stdout:6/81: rmdir d9/dd 39 2023-01-04T18:16:26.004 INFO:tasks.workunit.client.1.smithi098.stdout:6/82: write d9/fa [4838360,4302] 0 2023-01-04T18:16:26.004 INFO:tasks.workunit.client.1.smithi098.stdout:6/83: readlink d9/dd/l10 0 2023-01-04T18:16:26.004 INFO:tasks.workunit.client.1.smithi098.stdout:6/84: read - d9/dd/f11 zero size 2023-01-04T18:16:26.005 INFO:tasks.workunit.client.1.smithi098.stdout:7/78: truncate d1/f5 2901350 0 2023-01-04T18:16:26.006 INFO:tasks.workunit.client.1.smithi098.stdout:3/66: unlink d6/c9 0 2023-01-04T18:16:26.006 INFO:tasks.workunit.client.1.smithi098.stdout:3/67: chown d6/cb 3273 1 2023-01-04T18:16:26.007 INFO:tasks.workunit.client.1.smithi098.stdout:2/145: rename d6/fa to d6/f2d 0 2023-01-04T18:16:26.008 INFO:tasks.workunit.client.1.smithi098.stdout:9/152: creat d2/f2b x:0 0 0 2023-01-04T18:16:26.009 INFO:tasks.workunit.client.1.smithi098.stdout:6/85: truncate d9/fc 1142821 0 2023-01-04T18:16:26.010 INFO:tasks.workunit.client.1.smithi098.stdout:7/79: creat d1/da/f1b x:0 0 0 2023-01-04T18:16:26.010 INFO:tasks.workunit.client.1.smithi098.stdout:7/80: stat d1/f5 0 2023-01-04T18:16:26.010 INFO:tasks.workunit.client.1.smithi098.stdout:3/68: truncate f1 6173836 0 2023-01-04T18:16:26.012 INFO:tasks.workunit.client.1.smithi098.stdout:9/153: symlink d2/d5/d18/d1d/d23/l2c 0 2023-01-04T18:16:26.012 INFO:tasks.workunit.client.1.smithi098.stdout:7/81: unlink d1/da/cc 0 2023-01-04T18:16:26.013 INFO:tasks.workunit.client.1.smithi098.stdout:0/150: dwrite df/d17/d1c/f2f [0,4194304] 0 2023-01-04T18:16:26.013 INFO:tasks.workunit.client.1.smithi098.stdout:0/151: fsync f1 0 2023-01-04T18:16:26.017 INFO:tasks.workunit.client.1.smithi098.stdout:2/146: rmdir d6/dc/d1c/d1f 39 2023-01-04T18:16:26.017 INFO:tasks.workunit.client.1.smithi098.stdout:5/80: getdents d1/d2 0 2023-01-04T18:16:26.018 INFO:tasks.workunit.client.1.smithi098.stdout:9/154: mkdir d2/d2d 0 2023-01-04T18:16:26.018 INFO:tasks.workunit.client.1.smithi098.stdout:9/155: write f1 [5517323,43706] 0 2023-01-04T18:16:26.018 INFO:tasks.workunit.client.1.smithi098.stdout:9/156: dread - d2/d5/fb zero size 2023-01-04T18:16:26.019 INFO:tasks.workunit.client.1.smithi098.stdout:7/82: symlink d1/d4/d12/l1c 0 2023-01-04T18:16:26.024 INFO:tasks.workunit.client.1.smithi098.stdout:5/81: truncate d1/f6 2602454 0 2023-01-04T18:16:26.025 INFO:tasks.workunit.client.1.smithi098.stdout:5/82: write d1/fc [985846,72335] 0 2023-01-04T18:16:26.026 INFO:tasks.workunit.client.1.smithi098.stdout:7/83: mknod d1/d4/d11/c1d 0 2023-01-04T18:16:26.028 INFO:tasks.workunit.client.1.smithi098.stdout:2/147: link d6/f8 d6/dc/d2b/f2e 0 2023-01-04T18:16:26.030 INFO:tasks.workunit.client.1.smithi098.stdout:6/86: dread d9/fc [0,4194304] 0 2023-01-04T18:16:26.031 INFO:tasks.workunit.client.1.smithi098.stdout:9/157: dread d2/d5/f6 [4194304,4194304] 0 2023-01-04T18:16:26.033 INFO:tasks.workunit.client.1.smithi098.stdout:3/69: dwrite d6/ff [0,4194304] 0 2023-01-04T18:16:26.033 INFO:tasks.workunit.client.1.smithi098.stdout:6/87: rename l7 to d9/dd/d15/l16 0 2023-01-04T18:16:26.034 INFO:tasks.workunit.client.1.smithi098.stdout:2/148: rename d6/f17 to d6/f2f 0 2023-01-04T18:16:26.035 INFO:tasks.workunit.client.1.smithi098.stdout:9/158: truncate d2/d5/d18/f1a 2470926 0 2023-01-04T18:16:26.038 INFO:tasks.workunit.client.1.smithi098.stdout:3/70: rmdir d6/d10 39 2023-01-04T18:16:26.039 INFO:tasks.workunit.client.1.smithi098.stdout:6/88: getdents d9/dd/de 0 2023-01-04T18:16:26.040 INFO:tasks.workunit.client.1.smithi098.stdout:2/149: creat d6/dc/d1c/d1f/f30 x:0 0 0 2023-01-04T18:16:26.040 INFO:tasks.workunit.client.1.smithi098.stdout:9/159: truncate d2/d5/d18/f1f 4109261 0 2023-01-04T18:16:26.043 INFO:tasks.workunit.client.1.smithi098.stdout:6/89: unlink d9/cb 0 2023-01-04T18:16:26.043 INFO:tasks.workunit.client.1.smithi098.stdout:0/152: dwrite df/d17/d1c/f1e [0,4194304] 0 2023-01-04T18:16:26.043 INFO:tasks.workunit.client.1.smithi098.stdout:2/150: mkdir d6/dc/d1c/d31 0 2023-01-04T18:16:26.044 INFO:tasks.workunit.client.1.smithi098.stdout:2/151: fsync d6/dc/d1c/d1f/f22 0 2023-01-04T18:16:26.044 INFO:tasks.workunit.client.1.smithi098.stdout:2/152: stat d6/dc 0 2023-01-04T18:16:26.044 INFO:tasks.workunit.client.1.smithi098.stdout:6/90: creat d9/f17 x:0 0 0 2023-01-04T18:16:26.044 INFO:tasks.workunit.client.1.smithi098.stdout:7/84: dwrite d1/da/f1a [0,4194304] 0 2023-01-04T18:16:26.046 INFO:tasks.workunit.client.1.smithi098.stdout:3/71: dread f1 [0,4194304] 0 2023-01-04T18:16:26.047 INFO:tasks.workunit.client.1.smithi098.stdout:0/153: mkdir df/d17/d1c/d3b 0 2023-01-04T18:16:26.049 INFO:tasks.workunit.client.1.smithi098.stdout:6/91: fsync d9/fa 0 2023-01-04T18:16:26.053 INFO:tasks.workunit.client.1.smithi098.stdout:7/85: rename d1/d4/d12/f14 to d1/da/f1e 0 2023-01-04T18:16:26.053 INFO:tasks.workunit.client.1.smithi098.stdout:7/86: write d1/da/f1e [310663,103231] 0 2023-01-04T18:16:26.053 INFO:tasks.workunit.client.1.smithi098.stdout:7/87: readlink d1/d4/d12/l1c 0 2023-01-04T18:16:26.057 INFO:tasks.workunit.client.1.smithi098.stdout:5/83: dwrite d1/f6 [0,4194304] 0 2023-01-04T18:16:26.060 INFO:tasks.workunit.client.1.smithi098.stdout:7/88: dread d1/f5 [0,4194304] 0 2023-01-04T18:16:26.060 INFO:tasks.workunit.client.1.smithi098.stdout:7/89: dread - d1/dd/f19 zero size 2023-01-04T18:16:26.061 INFO:tasks.workunit.client.1.smithi098.stdout:7/90: write d1/d4/d12/f17 [141356,90743] 0 2023-01-04T18:16:26.107 INFO:tasks.workunit.client.1.smithi098.stdout:3/72: symlink d6/d10/l13 0 2023-01-04T18:16:26.107 INFO:tasks.workunit.client.1.smithi098.stdout:2/153: dwrite d6/f2d [0,4194304] 0 2023-01-04T18:16:26.114 INFO:tasks.workunit.client.1.smithi098.stdout:9/160: dread d2/d5/d18/f1f [0,4194304] 0 2023-01-04T18:16:26.115 INFO:tasks.workunit.client.1.smithi098.stdout:7/91: creat d1/dd/f1f x:0 0 0 2023-01-04T18:16:26.116 INFO:tasks.workunit.client.1.smithi098.stdout:7/92: write d1/da/f1b [1038738,72363] 0 2023-01-04T18:16:26.116 INFO:tasks.workunit.client.1.smithi098.stdout:7/93: readlink d1/d4/l8 0 2023-01-04T18:16:26.116 INFO:tasks.workunit.client.1.smithi098.stdout:3/73: creat d6/f14 x:0 0 0 2023-01-04T18:16:26.117 INFO:tasks.workunit.client.1.smithi098.stdout:6/92: rename l8 to d9/dd/l18 0 2023-01-04T18:16:26.118 INFO:tasks.workunit.client.1.smithi098.stdout:7/94: creat d1/f20 x:0 0 0 2023-01-04T18:16:26.119 INFO:tasks.workunit.client.1.smithi098.stdout:3/74: unlink d6/le 0 2023-01-04T18:16:26.120 INFO:tasks.workunit.client.1.smithi098.stdout:9/161: rename d2/d5/d18/d19/d20 to d2/d5/d18/d19/d2a/d2e 0 2023-01-04T18:16:26.121 INFO:tasks.workunit.client.1.smithi098.stdout:9/162: chown d2/d5/d18/f1f 686008 1 2023-01-04T18:16:26.121 INFO:tasks.workunit.client.1.smithi098.stdout:9/163: stat d2/f2b 0 2023-01-04T18:16:26.121 INFO:tasks.workunit.client.1.smithi098.stdout:6/93: symlink d9/dd/de/l19 0 2023-01-04T18:16:26.123 INFO:tasks.workunit.client.1.smithi098.stdout:2/154: dwrite f3 [0,4194304] 0 2023-01-04T18:16:26.123 INFO:tasks.workunit.client.1.smithi098.stdout:2/155: fdatasync d6/f2d 0 2023-01-04T18:16:26.123 INFO:tasks.workunit.client.1.smithi098.stdout:3/75: creat d6/f15 x:0 0 0 2023-01-04T18:16:26.123 INFO:tasks.workunit.client.1.smithi098.stdout:9/164: dread f1 [4194304,4194304] 0 2023-01-04T18:16:26.123 INFO:tasks.workunit.client.1.smithi098.stdout:6/94: link d9/f17 d9/dd/d15/f1a 0 2023-01-04T18:16:26.125 INFO:tasks.workunit.client.1.smithi098.stdout:3/76: creat d6/f16 x:0 0 0 2023-01-04T18:16:26.126 INFO:tasks.workunit.client.1.smithi098.stdout:2/156: dread d6/f7 [0,4194304] 0 2023-01-04T18:16:26.127 INFO:tasks.workunit.client.1.smithi098.stdout:9/165: creat d2/d5/d18/d1d/f2f x:0 0 0 2023-01-04T18:16:26.128 INFO:tasks.workunit.client.1.smithi098.stdout:6/95: creat d9/dd/de/f1b x:0 0 0 2023-01-04T18:16:26.128 INFO:tasks.workunit.client.1.smithi098.stdout:3/77: creat d6/f17 x:0 0 0 2023-01-04T18:16:26.129 INFO:tasks.workunit.client.1.smithi098.stdout:2/157: mkdir d6/dc/d2b/d32 0 2023-01-04T18:16:26.130 INFO:tasks.workunit.client.1.smithi098.stdout:9/166: creat d2/d5/d18/d1d/f30 x:0 0 0 2023-01-04T18:16:26.130 INFO:tasks.workunit.client.1.smithi098.stdout:9/167: write d2/d5/f24 [1075690,19785] 0 2023-01-04T18:16:26.130 INFO:tasks.workunit.client.1.smithi098.stdout:9/168: dread - d2/f2b zero size 2023-01-04T18:16:26.130 INFO:tasks.workunit.client.1.smithi098.stdout:6/96: symlink d9/l1c 0 2023-01-04T18:16:26.131 INFO:tasks.workunit.client.1.smithi098.stdout:3/78: link d6/fa d6/d10/f18 0 2023-01-04T18:16:26.132 INFO:tasks.workunit.client.1.smithi098.stdout:2/158: creat d6/f33 x:0 0 0 2023-01-04T18:16:26.133 INFO:tasks.workunit.client.1.smithi098.stdout:9/169: symlink d2/d2d/l31 0 2023-01-04T18:16:26.137 INFO:tasks.workunit.client.1.smithi098.stdout:6/97: link d9/f17 d9/dd/d15/f1d 0 2023-01-04T18:16:26.137 INFO:tasks.workunit.client.1.smithi098.stdout:9/170: mknod d2/d5/d18/d19/d2a/d2e/d26/c32 0 2023-01-04T18:16:26.137 INFO:tasks.workunit.client.1.smithi098.stdout:9/171: dread - d2/f2b zero size 2023-01-04T18:16:26.138 INFO:tasks.workunit.client.1.smithi098.stdout:6/98: rename d9/dd/de/f1b to d9/dd/de/f1e 0 2023-01-04T18:16:26.141 INFO:tasks.workunit.client.1.smithi098.stdout:9/172: symlink d2/d5/d18/l33 0 2023-01-04T18:16:26.141 INFO:tasks.workunit.client.1.smithi098.stdout:9/173: dread - d2/d5/f28 zero size 2023-01-04T18:16:26.141 INFO:tasks.workunit.client.1.smithi098.stdout:9/174: fdatasync d2/d5/d18/d1d/f2f 0 2023-01-04T18:16:26.141 INFO:tasks.workunit.client.1.smithi098.stdout:9/175: dread - d2/d5/d18/d1d/f30 zero size 2023-01-04T18:16:26.145 INFO:tasks.workunit.client.1.smithi098.stdout:9/176: dread d2/f10 [0,4194304] 0 2023-01-04T18:16:26.154 INFO:tasks.workunit.client.1.smithi098.stdout:2/159: dwrite d6/f33 [0,4194304] 0 2023-01-04T18:16:26.155 INFO:tasks.workunit.client.1.smithi098.stdout:2/160: symlink d6/dc/d1c/l34 0 2023-01-04T18:16:26.156 INFO:tasks.workunit.client.1.smithi098.stdout:2/161: mkdir d6/dc/d1c/d35 0 2023-01-04T18:16:26.158 INFO:tasks.workunit.client.1.smithi098.stdout:2/162: write d6/f33 [2183408,48022] 0 2023-01-04T18:16:26.159 INFO:tasks.workunit.client.1.smithi098.stdout:6/99: dwrite d9/dd/de/f1e [0,4194304] 0 2023-01-04T18:16:26.159 INFO:tasks.workunit.client.1.smithi098.stdout:6/100: chown d9/dd/de/lf 37710 1 2023-01-04T18:16:26.160 INFO:tasks.workunit.client.1.smithi098.stdout:3/79: dwrite d6/f15 [0,4194304] 0 2023-01-04T18:16:26.160 INFO:tasks.workunit.client.1.smithi098.stdout:2/163: link d6/dc/f12 d6/dc/d2b/f36 0 2023-01-04T18:16:26.160 INFO:tasks.workunit.client.1.smithi098.stdout:2/164: chown d6/dc/d1c/d1f/f30 18 1 2023-01-04T18:16:26.162 INFO:tasks.workunit.client.1.smithi098.stdout:2/165: creat d6/dc/d2b/d32/f37 x:0 0 0 2023-01-04T18:16:26.162 INFO:tasks.workunit.client.1.smithi098.stdout:3/80: write d6/ff [590011,99756] 0 2023-01-04T18:16:26.164 INFO:tasks.workunit.client.1.smithi098.stdout:3/81: mkdir d6/d10/d19 0 2023-01-04T18:16:26.165 INFO:tasks.workunit.client.1.smithi098.stdout:3/82: read - d6/f17 zero size 2023-01-04T18:16:26.169 INFO:tasks.workunit.client.1.smithi098.stdout:2/166: dread d6/f11 [0,4194304] 0 2023-01-04T18:16:26.175 INFO:tasks.workunit.client.1.smithi098.stdout:3/83: mknod d6/d10/d19/c1a 0 2023-01-04T18:16:26.188 INFO:tasks.workunit.client.1.smithi098.stdout:2/167: dwrite d6/dc/f14 [0,4194304] 0 2023-01-04T18:16:26.191 INFO:tasks.workunit.client.1.smithi098.stdout:2/168: creat d6/dc/d1c/d35/f38 x:0 0 0 2023-01-04T18:16:26.191 INFO:tasks.workunit.client.1.smithi098.stdout:2/169: write d6/dc/d2b/f2e [4196051,37390] 0 2023-01-04T18:16:26.191 INFO:tasks.workunit.client.1.smithi098.stdout:2/170: mkdir d6/dc/d1c/d1f/d39 0 2023-01-04T18:16:26.194 INFO:tasks.workunit.client.1.smithi098.stdout:3/84: dwrite d6/f16 [0,4194304] 0 2023-01-04T18:16:26.195 INFO:tasks.workunit.client.1.smithi098.stdout:3/85: stat d6/d10 0 2023-01-04T18:16:26.196 INFO:tasks.workunit.client.1.smithi098.stdout:3/86: truncate d6/f15 297349 0 2023-01-04T18:16:26.199 INFO:tasks.workunit.client.1.smithi098.stdout:3/87: rename d6/f16 to d6/d10/f1b 0 2023-01-04T18:16:26.204 INFO:tasks.workunit.client.1.smithi098.stdout:3/88: rename f1 to d6/f1c 0 2023-01-04T18:16:26.205 INFO:tasks.workunit.client.1.smithi098.stdout:3/89: mknod d6/c1d 0 2023-01-04T18:16:26.208 INFO:tasks.workunit.client.1.smithi098.stdout:2/171: dwrite d6/dc/d1c/f2c [0,4194304] 0 2023-01-04T18:16:26.211 INFO:tasks.workunit.client.1.smithi098.stdout:3/90: getdents d6/d10 0 2023-01-04T18:16:26.218 INFO:tasks.workunit.client.1.smithi098.stdout:3/91: write d6/d10/f1b [3496911,18658] 0 2023-01-04T18:16:26.218 INFO:tasks.workunit.client.1.smithi098.stdout:3/92: truncate d6/f15 856883 0 2023-01-04T18:16:26.218 INFO:tasks.workunit.client.1.smithi098.stdout:2/172: dread d6/f33 [0,4194304] 0 2023-01-04T18:16:26.218 INFO:tasks.workunit.client.1.smithi098.stdout:3/93: dread - d6/f14 zero size 2023-01-04T18:16:26.219 INFO:tasks.workunit.client.1.smithi098.stdout:3/94: dread d6/d10/f12 [0,4194304] 0 2023-01-04T18:16:26.219 INFO:tasks.workunit.client.1.smithi098.stdout:2/173: creat d6/dc/d1c/d1f/f3a x:0 0 0 2023-01-04T18:16:26.219 INFO:tasks.workunit.client.1.smithi098.stdout:2/174: readlink d6/dc/l19 0 2023-01-04T18:16:26.220 INFO:tasks.workunit.client.1.smithi098.stdout:2/175: write f5 [4966540,90981] 0 2023-01-04T18:16:26.220 INFO:tasks.workunit.client.1.smithi098.stdout:3/95: creat d6/f1e x:0 0 0 2023-01-04T18:16:26.223 INFO:tasks.workunit.client.1.smithi098.stdout:3/96: fsync d6/ff 0 2023-01-04T18:16:26.223 INFO:tasks.workunit.client.1.smithi098.stdout:3/97: write d6/f15 [1719911,65106] 0 2023-01-04T18:16:26.223 INFO:tasks.workunit.client.1.smithi098.stdout:3/98: truncate d6/f14 389298 0 2023-01-04T18:16:26.225 INFO:tasks.workunit.client.1.smithi098.stdout:3/99: unlink d6/ff 0 2023-01-04T18:16:26.226 INFO:tasks.workunit.client.1.smithi098.stdout:3/100: mknod d6/c1f 0 2023-01-04T18:16:26.228 INFO:tasks.workunit.client.1.smithi098.stdout:3/101: rename d6/c1f to d6/d10/d19/c20 0 2023-01-04T18:16:26.232 INFO:tasks.workunit.client.1.smithi098.stdout:3/102: dread d6/f1c [0,4194304] 0 2023-01-04T18:16:26.233 INFO:tasks.workunit.client.1.smithi098.stdout:3/103: creat d6/f21 x:0 0 0 2023-01-04T18:16:26.233 INFO:tasks.workunit.client.1.smithi098.stdout:3/104: write d6/f17 [833266,68469] 0 2023-01-04T18:16:26.234 INFO:tasks.workunit.client.1.smithi098.stdout:3/105: mknod d6/c22 0 2023-01-04T18:16:26.234 INFO:tasks.workunit.client.1.smithi098.stdout:3/106: fdatasync d6/d10/f12 0 2023-01-04T18:16:26.234 INFO:tasks.workunit.client.1.smithi098.stdout:3/107: truncate d6/d10/f12 642682 0 2023-01-04T18:16:26.235 INFO:tasks.workunit.client.1.smithi098.stdout:3/108: creat d6/d10/f23 x:0 0 0 2023-01-04T18:16:26.236 INFO:tasks.workunit.client.1.smithi098.stdout:3/109: symlink d6/d10/d19/l24 0 2023-01-04T18:16:26.237 INFO:tasks.workunit.client.1.smithi098.stdout:3/110: link d6/f1e d6/f25 0 2023-01-04T18:16:26.239 INFO:tasks.workunit.client.1.smithi098.stdout:3/111: unlink d6/f17 0 2023-01-04T18:16:26.239 INFO:tasks.workunit.client.1.smithi098.stdout:3/112: readlink d6/d10/l13 0 2023-01-04T18:16:26.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:25.912228+0000 mgr.smithi098.vhfzum (mgr.24455) 14 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 283 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.2 MiB/s rd, 9.4 MiB/s wr, 399 op/s 2023-01-04T18:16:26.549 INFO:tasks.workunit.client.1.smithi098.stdout:5/84: dwrite d1/d2/f3 [0,4194304] 0 2023-01-04T18:16:26.551 INFO:tasks.workunit.client.1.smithi098.stdout:5/85: creat d1/d2/f15 x:0 0 0 2023-01-04T18:16:26.553 INFO:tasks.workunit.client.1.smithi098.stdout:7/95: dread d1/da/f1e [0,4194304] 0 2023-01-04T18:16:26.554 INFO:tasks.workunit.client.1.smithi098.stdout:9/177: dread d2/d5/f24 [0,4194304] 0 2023-01-04T18:16:26.557 INFO:tasks.workunit.client.1.smithi098.stdout:5/86: symlink d1/d2/d14/l16 0 2023-01-04T18:16:26.558 INFO:tasks.workunit.client.1.smithi098.stdout:5/87: unlink d1/da/lb 0 2023-01-04T18:16:26.559 INFO:tasks.workunit.client.1.smithi098.stdout:5/88: fsync d1/f6 0 2023-01-04T18:16:26.559 INFO:tasks.workunit.client.1.smithi098.stdout:5/89: chown d1/fc 6171644 1 2023-01-04T18:16:26.560 INFO:tasks.workunit.client.1.smithi098.stdout:5/90: link d1/d2/f15 d1/d2/f17 0 2023-01-04T18:16:26.562 INFO:tasks.workunit.client.1.smithi098.stdout:5/91: creat d1/f18 x:0 0 0 2023-01-04T18:16:26.562 INFO:tasks.workunit.client.1.smithi098.stdout:5/92: chown d1 2 1 2023-01-04T18:16:26.562 INFO:tasks.workunit.client.1.smithi098.stdout:5/93: write d1/f18 [129785,100695] 0 2023-01-04T18:16:26.570 INFO:tasks.workunit.client.1.smithi098.stdout:6/101: dwrite d9/fc [0,4194304] 0 2023-01-04T18:16:26.572 INFO:tasks.workunit.client.1.smithi098.stdout:5/94: dread d1/f6 [0,4194304] 0 2023-01-04T18:16:26.575 INFO:tasks.workunit.client.1.smithi098.stdout:7/96: dwrite d1/da/f1a [0,4194304] 0 2023-01-04T18:16:26.576 INFO:tasks.workunit.client.1.smithi098.stdout:5/95: mkdir d1/d2/d14/d19 0 2023-01-04T18:16:26.576 INFO:tasks.workunit.client.1.smithi098.stdout:9/178: dwrite d2/d5/f24 [0,4194304] 0 2023-01-04T18:16:26.578 INFO:tasks.workunit.client.1.smithi098.stdout:7/97: mkdir d1/d4/d12/d21 0 2023-01-04T18:16:26.579 INFO:tasks.workunit.client.1.smithi098.stdout:9/179: dread d2/d5/d18/f1a [0,4194304] 0 2023-01-04T18:16:26.580 INFO:tasks.workunit.client.1.smithi098.stdout:5/96: dread d1/fc [0,4194304] 0 2023-01-04T18:16:26.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:25.912228+0000 mgr.smithi098.vhfzum (mgr.24455) 14 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 283 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.2 MiB/s rd, 9.4 MiB/s wr, 399 op/s 2023-01-04T18:16:26.581 INFO:tasks.workunit.client.1.smithi098.stdout:5/97: dread d1/fc [0,4194304] 0 2023-01-04T18:16:26.582 INFO:tasks.workunit.client.1.smithi098.stdout:9/180: link d2/d5/d18/d1d/f30 d2/d5/d18/d1d/f34 0 2023-01-04T18:16:26.582 INFO:tasks.workunit.client.1.smithi098.stdout:9/181: fsync d2/d5/f28 0 2023-01-04T18:16:26.582 INFO:tasks.workunit.client.1.smithi098.stdout:5/98: mknod d1/da/c1a 0 2023-01-04T18:16:26.584 INFO:tasks.workunit.client.1.smithi098.stdout:5/99: creat d1/f1b x:0 0 0 2023-01-04T18:16:26.584 INFO:tasks.workunit.client.1.smithi098.stdout:5/100: chown d1/d2/c7 130 1 2023-01-04T18:16:26.584 INFO:tasks.workunit.client.1.smithi098.stdout:5/101: write d1/f6 [5076123,19258] 0 2023-01-04T18:16:26.584 INFO:tasks.workunit.client.1.smithi098.stdout:5/102: readlink d1/le 0 2023-01-04T18:16:26.586 INFO:tasks.workunit.client.1.smithi098.stdout:9/182: rename d2/d5/lf to d2/d5/d18/d1d/d23/l35 0 2023-01-04T18:16:26.587 INFO:tasks.workunit.client.1.smithi098.stdout:6/102: dwrite d9/fa [0,4194304] 0 2023-01-04T18:16:26.589 INFO:tasks.workunit.client.1.smithi098.stdout:7/98: rmdir d1/d4/d12 39 2023-01-04T18:16:26.589 INFO:tasks.workunit.client.1.smithi098.stdout:9/183: dread f1 [0,4194304] 0 2023-01-04T18:16:26.591 INFO:tasks.workunit.client.1.smithi098.stdout:8/96: sync 2023-01-04T18:16:26.591 INFO:tasks.workunit.client.1.smithi098.stdout:7/99: getdents d1/da 0 2023-01-04T18:16:26.591 INFO:tasks.workunit.client.1.smithi098.stdout:8/97: rename d6 to d6/dc/d12/d19 22 2023-01-04T18:16:26.591 INFO:tasks.workunit.client.1.smithi098.stdout:8/98: chown d6 217 1 2023-01-04T18:16:26.591 INFO:tasks.workunit.client.1.smithi098.stdout:8/99: write d6/fe [1165777,114634] 0 2023-01-04T18:16:26.592 INFO:tasks.workunit.client.1.smithi098.stdout:1/91: sync 2023-01-04T18:16:26.592 INFO:tasks.workunit.client.1.smithi098.stdout:4/77: sync 2023-01-04T18:16:26.592 INFO:tasks.workunit.client.1.smithi098.stdout:0/154: sync 2023-01-04T18:16:26.592 INFO:tasks.workunit.client.1.smithi098.stdout:2/176: sync 2023-01-04T18:16:26.592 INFO:tasks.workunit.client.1.smithi098.stdout:3/113: sync 2023-01-04T18:16:26.593 INFO:tasks.workunit.client.1.smithi098.stdout:5/103: dread d1/f6 [0,4194304] 0 2023-01-04T18:16:26.593 INFO:tasks.workunit.client.1.smithi098.stdout:7/100: creat d1/f22 x:0 0 0 2023-01-04T18:16:26.593 INFO:tasks.workunit.client.1.smithi098.stdout:7/101: write d1/d4/d12/f17 [1258616,119732] 0 2023-01-04T18:16:26.593 INFO:tasks.workunit.client.1.smithi098.stdout:9/184: symlink d2/d5/d18/d1d/l36 0 2023-01-04T18:16:26.595 INFO:tasks.workunit.client.1.smithi098.stdout:6/103: dread d9/dd/de/f1e [0,4194304] 0 2023-01-04T18:16:26.595 INFO:tasks.workunit.client.1.smithi098.stdout:6/104: write d9/dd/f11 [99579,89932] 0 2023-01-04T18:16:26.596 INFO:tasks.workunit.client.1.smithi098.stdout:7/102: write d1/da/f1a [370595,26992] 0 2023-01-04T18:16:26.596 INFO:tasks.workunit.client.1.smithi098.stdout:7/103: chown d1/le 6959643 1 2023-01-04T18:16:26.596 INFO:tasks.workunit.client.1.smithi098.stdout:7/104: fsync d1/d4/ff 0 2023-01-04T18:16:26.596 INFO:tasks.workunit.client.1.smithi098.stdout:7/105: dread - d1/f22 zero size 2023-01-04T18:16:26.596 INFO:tasks.workunit.client.1.smithi098.stdout:8/100: creat d6/d11/f1a x:0 0 0 2023-01-04T18:16:26.596 INFO:tasks.workunit.client.1.smithi098.stdout:8/101: write d6/dc/f18 [434091,44140] 0 2023-01-04T18:16:26.597 INFO:tasks.workunit.client.1.smithi098.stdout:8/102: chown d6/dc/f18 93419 1 2023-01-04T18:16:26.597 INFO:tasks.workunit.client.1.smithi098.stdout:8/103: write d6/dc/f18 [388066,93128] 0 2023-01-04T18:16:26.597 INFO:tasks.workunit.client.1.smithi098.stdout:1/92: getdents d1 0 2023-01-04T18:16:26.598 INFO:tasks.workunit.client.1.smithi098.stdout:4/78: getdents d5/de 0 2023-01-04T18:16:26.598 INFO:tasks.workunit.client.1.smithi098.stdout:4/79: fsync d5/f16 0 2023-01-04T18:16:26.598 INFO:tasks.workunit.client.1.smithi098.stdout:4/80: truncate d5/de/f15 720470 0 2023-01-04T18:16:26.598 INFO:tasks.workunit.client.1.smithi098.stdout:0/155: creat df/d17/d1c/f3c x:0 0 0 2023-01-04T18:16:26.598 INFO:tasks.workunit.client.1.smithi098.stdout:0/156: truncate df/d17/d1c/f22 883401 0 2023-01-04T18:16:26.600 INFO:tasks.workunit.client.1.smithi098.stdout:3/114: link d6/f25 d6/d10/d19/f26 0 2023-01-04T18:16:26.602 INFO:tasks.workunit.client.1.smithi098.stdout:2/177: creat d6/dc/d2b/d32/f3b x:0 0 0 2023-01-04T18:16:26.603 INFO:tasks.workunit.client.1.smithi098.stdout:2/178: write d6/dc/f12 [3010105,7652] 0 2023-01-04T18:16:26.603 INFO:tasks.workunit.client.1.smithi098.stdout:2/179: dread - d6/dc/d2b/d32/f37 zero size 2023-01-04T18:16:26.604 INFO:tasks.workunit.client.1.smithi098.stdout:5/104: rename d1/da/f13 to d1/da/f1c 0 2023-01-04T18:16:26.605 INFO:tasks.workunit.client.1.smithi098.stdout:9/185: rename d2/d5/f16 to d2/d5/d18/d19/d2a/d2e/d26/f37 0 2023-01-04T18:16:26.606 INFO:tasks.workunit.client.1.smithi098.stdout:6/105: mkdir d9/dd/d1f 0 2023-01-04T18:16:26.606 INFO:tasks.workunit.client.1.smithi098.stdout:8/104: mkdir d6/d11/d15/d1b 0 2023-01-04T18:16:26.607 INFO:tasks.workunit.client.1.smithi098.stdout:1/93: creat d1/f21 x:0 0 0 2023-01-04T18:16:26.608 INFO:tasks.workunit.client.1.smithi098.stdout:0/157: symlink df/d17/d1c/d2c/l3d 0 2023-01-04T18:16:26.610 INFO:tasks.workunit.client.1.smithi098.stdout:2/180: mknod d6/dc/d1c/d35/c3c 0 2023-01-04T18:16:26.612 INFO:tasks.workunit.client.1.smithi098.stdout:5/105: creat d1/f1d x:0 0 0 2023-01-04T18:16:26.615 INFO:tasks.workunit.client.1.smithi098.stdout:0/158: dread f5 [0,4194304] 0 2023-01-04T18:16:26.615 INFO:tasks.workunit.client.1.smithi098.stdout:0/159: fsync df/d17/d1c/f31 0 2023-01-04T18:16:26.615 INFO:tasks.workunit.client.1.smithi098.stdout:9/186: mknod d2/d5/d18/d19/c38 0 2023-01-04T18:16:26.616 INFO:tasks.workunit.client.1.smithi098.stdout:9/187: dread - d2/f2b zero size 2023-01-04T18:16:26.617 INFO:tasks.workunit.client.1.smithi098.stdout:7/106: rename d1/d4/d12 to d1/d23 0 2023-01-04T18:16:26.617 INFO:tasks.workunit.client.1.smithi098.stdout:7/107: write d1/da/f1e [1014185,108358] 0 2023-01-04T18:16:26.618 INFO:tasks.workunit.client.1.smithi098.stdout:6/106: unlink d9/dd/d15/f1d 0 2023-01-04T18:16:26.618 INFO:tasks.workunit.client.1.smithi098.stdout:6/107: chown d9/dd/l14 62174489 1 2023-01-04T18:16:26.619 INFO:tasks.workunit.client.1.smithi098.stdout:8/105: rmdir d6/dc 39 2023-01-04T18:16:26.621 INFO:tasks.workunit.client.1.smithi098.stdout:4/81: dread d5/de/f15 [0,4194304] 0 2023-01-04T18:16:26.621 INFO:tasks.workunit.client.1.smithi098.stdout:4/82: dread - d5/f16 zero size 2023-01-04T18:16:26.624 INFO:tasks.workunit.client.1.smithi098.stdout:5/106: rmdir d1/da 39 2023-01-04T18:16:26.624 INFO:tasks.workunit.client.1.smithi098.stdout:5/107: fdatasync d1/f1d 0 2023-01-04T18:16:26.624 INFO:tasks.workunit.client.1.smithi098.stdout:5/108: truncate d1/f18 670794 0 2023-01-04T18:16:26.627 INFO:tasks.workunit.client.1.smithi098.stdout:7/108: rename d1/dd to d1/d23/d24 0 2023-01-04T18:16:26.630 INFO:tasks.workunit.client.1.smithi098.stdout:6/108: mkdir d9/dd/de/d20 0 2023-01-04T18:16:26.630 INFO:tasks.workunit.client.1.smithi098.stdout:6/109: chown d9/dd/d15 23 1 2023-01-04T18:16:26.631 INFO:tasks.workunit.client.1.smithi098.stdout:1/94: dread d1/fc [0,4194304] 0 2023-01-04T18:16:26.635 INFO:tasks.workunit.client.1.smithi098.stdout:8/106: rmdir d6 39 2023-01-04T18:16:26.635 INFO:tasks.workunit.client.1.smithi098.stdout:4/83: creat d5/d9/d13/f17 x:0 0 0 2023-01-04T18:16:26.635 INFO:tasks.workunit.client.1.smithi098.stdout:7/109: getdents d1/d4/d11 0 2023-01-04T18:16:26.635 INFO:tasks.workunit.client.1.smithi098.stdout:4/84: dread - d5/d9/d13/f17 zero size 2023-01-04T18:16:26.636 INFO:tasks.workunit.client.1.smithi098.stdout:6/110: write d9/f17 [938488,99538] 0 2023-01-04T18:16:26.636 INFO:tasks.workunit.client.1.smithi098.stdout:4/85: read d5/de/f15 [409734,117801] 0 2023-01-04T18:16:26.636 INFO:tasks.workunit.client.1.smithi098.stdout:1/95: write d1/d8/da/d12/f16 [5231492,2314] 0 2023-01-04T18:16:26.636 INFO:tasks.workunit.client.1.smithi098.stdout:6/111: read d9/fc [2043714,11536] 0 2023-01-04T18:16:26.636 INFO:tasks.workunit.client.1.smithi098.stdout:7/110: creat d1/d23/d24/f25 x:0 0 0 2023-01-04T18:16:26.637 INFO:tasks.workunit.client.1.smithi098.stdout:1/96: creat d1/f22 x:0 0 0 2023-01-04T18:16:26.637 INFO:tasks.workunit.client.1.smithi098.stdout:1/97: write f0 [5050662,117772] 0 2023-01-04T18:16:26.638 INFO:tasks.workunit.client.1.smithi098.stdout:6/112: unlink d9/dd/c12 0 2023-01-04T18:16:26.638 INFO:tasks.workunit.client.1.smithi098.stdout:6/113: chown d9/f17 964 1 2023-01-04T18:16:26.708 INFO:tasks.workunit.client.1.smithi098.stdout:8/107: write d6/f9 [7873430,4174] 0 2023-01-04T18:16:26.710 INFO:tasks.workunit.client.1.smithi098.stdout:9/188: write d2/d5/f6 [258690,56785] 0 2023-01-04T18:16:26.710 INFO:tasks.workunit.client.1.smithi098.stdout:8/108: unlink d6/c8 0 2023-01-04T18:16:26.731 INFO:tasks.workunit.client.1.smithi098.stdout:0/160: dwrite df/d17/d1c/f2f [0,4194304] 0 2023-01-04T18:16:26.731 INFO:tasks.workunit.client.1.smithi098.stdout:4/86: dwrite d5/de/f11 [0,4194304] 0 2023-01-04T18:16:26.731 INFO:tasks.workunit.client.1.smithi098.stdout:1/98: dwrite d1/f4 [0,4194304] 0 2023-01-04T18:16:26.732 INFO:tasks.workunit.client.1.smithi098.stdout:5/109: dwrite d1/f18 [0,4194304] 0 2023-01-04T18:16:26.732 INFO:tasks.workunit.client.1.smithi098.stdout:5/110: chown d1/d2/l4 17511 1 2023-01-04T18:16:26.732 INFO:tasks.workunit.client.1.smithi098.stdout:5/111: write d1/d2/f15 [289319,10637] 0 2023-01-04T18:16:26.732 INFO:tasks.workunit.client.1.smithi098.stdout:9/189: rmdir d2/d5 39 2023-01-04T18:16:26.734 INFO:tasks.workunit.client.1.smithi098.stdout:0/161: creat df/f3e x:0 0 0 2023-01-04T18:16:26.735 INFO:tasks.workunit.client.1.smithi098.stdout:7/111: getdents d1/d4 0 2023-01-04T18:16:26.735 INFO:tasks.workunit.client.1.smithi098.stdout:0/162: write df/d17/d1c/f3a [721381,2020] 0 2023-01-04T18:16:26.735 INFO:tasks.workunit.client.1.smithi098.stdout:8/109: dwrite d6/d11/f1a [0,4194304] 0 2023-01-04T18:16:26.735 INFO:tasks.workunit.client.1.smithi098.stdout:4/87: write d5/de/f11 [71244,35207] 0 2023-01-04T18:16:26.741 INFO:tasks.workunit.client.1.smithi098.stdout:1/99: mknod d1/d8/da/c23 0 2023-01-04T18:16:26.741 INFO:tasks.workunit.client.1.smithi098.stdout:1/100: fsync d1/f22 0 2023-01-04T18:16:26.742 INFO:tasks.workunit.client.1.smithi098.stdout:1/101: chown d1/fc 223 1 2023-01-04T18:16:26.742 INFO:tasks.workunit.client.1.smithi098.stdout:6/114: dwrite d9/dd/d15/f1a [0,4194304] 0 2023-01-04T18:16:26.746 INFO:tasks.workunit.client.1.smithi098.stdout:9/190: creat d2/d5/d18/f39 x:0 0 0 2023-01-04T18:16:26.747 INFO:tasks.workunit.client.1.smithi098.stdout:7/112: rmdir d1 39 2023-01-04T18:16:26.750 INFO:tasks.workunit.client.1.smithi098.stdout:4/88: dread d5/f8 [0,4194304] 0 2023-01-04T18:16:26.754 INFO:tasks.workunit.client.1.smithi098.stdout:0/163: mkdir df/d17/d1c/d3f 0 2023-01-04T18:16:26.755 INFO:tasks.workunit.client.1.smithi098.stdout:1/102: stat d1/c18 0 2023-01-04T18:16:26.755 INFO:tasks.workunit.client.1.smithi098.stdout:5/112: mkdir d1/d1e 0 2023-01-04T18:16:26.755 INFO:tasks.workunit.client.1.smithi098.stdout:9/191: mknod d2/d5/d18/d19/d2a/d2e/d26/c3a 0 2023-01-04T18:16:26.755 INFO:tasks.workunit.client.1.smithi098.stdout:8/110: getdents d6 0 2023-01-04T18:16:26.755 INFO:tasks.workunit.client.1.smithi098.stdout:7/113: mkdir d1/d23/d24/d26 0 2023-01-04T18:16:26.756 INFO:tasks.workunit.client.1.smithi098.stdout:0/164: mkdir df/d40 0 2023-01-04T18:16:26.760 INFO:tasks.workunit.client.1.smithi098.stdout:1/103: rename d1/d8/da/d12/f15 to d1/d8/da/f24 0 2023-01-04T18:16:26.760 INFO:tasks.workunit.client.1.smithi098.stdout:1/104: fdatasync d1/f22 0 2023-01-04T18:16:26.761 INFO:tasks.workunit.client.1.smithi098.stdout:1/105: write d1/f21 [572620,109231] 0 2023-01-04T18:16:26.761 INFO:tasks.workunit.client.1.smithi098.stdout:3/115: sync 2023-01-04T18:16:26.762 INFO:tasks.workunit.client.1.smithi098.stdout:3/116: write d6/d10/f12 [180360,121497] 0 2023-01-04T18:16:26.763 INFO:tasks.workunit.client.1.smithi098.stdout:5/113: creat d1/d2/d14/f1f x:0 0 0 2023-01-04T18:16:26.763 INFO:tasks.workunit.client.1.smithi098.stdout:5/114: rename d1/d2/d14 to d1/d2/d14/d20 22 2023-01-04T18:16:26.763 INFO:tasks.workunit.client.1.smithi098.stdout:3/117: read d6/d10/f12 [337186,116778] 0 2023-01-04T18:16:26.763 INFO:tasks.workunit.client.1.smithi098.stdout:3/118: write d6/f14 [1089363,46390] 0 2023-01-04T18:16:26.765 INFO:tasks.workunit.client.1.smithi098.stdout:7/114: mknod d1/d23/d24/d26/c27 0 2023-01-04T18:16:26.768 INFO:tasks.workunit.client.1.smithi098.stdout:0/165: unlink lc 0 2023-01-04T18:16:26.768 INFO:tasks.workunit.client.1.smithi098.stdout:0/166: write df/d17/f2d [861874,16217] 0 2023-01-04T18:16:26.768 INFO:tasks.workunit.client.1.smithi098.stdout:5/115: symlink d1/d2/d14/l21 0 2023-01-04T18:16:26.768 INFO:tasks.workunit.client.1.smithi098.stdout:5/116: truncate d1/f1b 65818 0 2023-01-04T18:16:26.768 INFO:tasks.workunit.client.1.smithi098.stdout:5/117: readlink d1/le 0 2023-01-04T18:16:26.768 INFO:tasks.workunit.client.1.smithi098.stdout:5/118: chown d1/d2/d14/f1f 79 1 2023-01-04T18:16:26.768 INFO:tasks.workunit.client.1.smithi098.stdout:5/119: write d1/d2/f17 [1098769,75487] 0 2023-01-04T18:16:26.769 INFO:tasks.workunit.client.1.smithi098.stdout:3/119: creat d6/f27 x:0 0 0 2023-01-04T18:16:26.770 INFO:tasks.workunit.client.1.smithi098.stdout:3/120: chown d6/d10/d19/c1a 7420500 1 2023-01-04T18:16:26.770 INFO:tasks.workunit.client.1.smithi098.stdout:5/120: read d1/f9 [999694,121939] 0 2023-01-04T18:16:26.770 INFO:tasks.workunit.client.1.smithi098.stdout:5/121: write d1/fc [1849513,50560] 0 2023-01-04T18:16:26.770 INFO:tasks.workunit.client.1.smithi098.stdout:1/106: mkdir d1/d25 0 2023-01-04T18:16:26.771 INFO:tasks.workunit.client.1.smithi098.stdout:3/121: link l0 d6/d10/d19/l28 0 2023-01-04T18:16:26.772 INFO:tasks.workunit.client.1.smithi098.stdout:5/122: rename d1/d2/d14/f1f to d1/d2/d14/d19/f22 0 2023-01-04T18:16:26.772 INFO:tasks.workunit.client.1.smithi098.stdout:0/167: dread df/d17/d1c/f3a [0,4194304] 0 2023-01-04T18:16:26.776 INFO:tasks.workunit.client.1.smithi098.stdout:0/168: rename df/d17/d1c/d3f to df/d17/d1c/d2c/d41 0 2023-01-04T18:16:26.777 INFO:tasks.workunit.client.1.smithi098.stdout:5/123: creat d1/d2/d14/f23 x:0 0 0 2023-01-04T18:16:26.777 INFO:tasks.workunit.client.1.smithi098.stdout:0/169: write df/d17/d1c/f3a [804034,54403] 0 2023-01-04T18:16:26.777 INFO:tasks.workunit.client.1.smithi098.stdout:3/122: write d6/f1c [5237919,33079] 0 2023-01-04T18:16:26.778 INFO:tasks.workunit.client.1.smithi098.stdout:3/123: stat d6/f15 0 2023-01-04T18:16:26.778 INFO:tasks.workunit.client.1.smithi098.stdout:3/124: readlink d6/d10/d19/l24 0 2023-01-04T18:16:26.778 INFO:tasks.workunit.client.1.smithi098.stdout:5/124: mkdir d1/d2/d14/d24 0 2023-01-04T18:16:26.781 INFO:tasks.workunit.client.1.smithi098.stdout:5/125: creat d1/d2/d14/d19/f25 x:0 0 0 2023-01-04T18:16:26.784 INFO:tasks.workunit.client.1.smithi098.stdout:5/126: creat d1/da/f26 x:0 0 0 2023-01-04T18:16:26.784 INFO:tasks.workunit.client.1.smithi098.stdout:5/127: write d1/f1d [800757,84182] 0 2023-01-04T18:16:26.784 INFO:tasks.workunit.client.1.smithi098.stdout:5/128: creat d1/d2/d14/f27 x:0 0 0 2023-01-04T18:16:26.808 INFO:tasks.workunit.client.1.smithi098.stdout:9/192: dwrite d2/d5/d18/d1d/f2f [0,4194304] 0 2023-01-04T18:16:26.809 INFO:tasks.workunit.client.1.smithi098.stdout:1/107: dwrite d1/f1f [0,4194304] 0 2023-01-04T18:16:26.809 INFO:tasks.workunit.client.1.smithi098.stdout:1/108: chown d1/c18 924 1 2023-01-04T18:16:26.809 INFO:tasks.workunit.client.1.smithi098.stdout:1/109: truncate d1/d8/da/f17 1117871 0 2023-01-04T18:16:26.810 INFO:tasks.workunit.client.1.smithi098.stdout:8/111: dwrite d6/f9 [12582912,4194304] 0 2023-01-04T18:16:26.810 INFO:tasks.workunit.client.1.smithi098.stdout:8/112: fsync d6/fe 0 2023-01-04T18:16:26.811 INFO:tasks.workunit.client.1.smithi098.stdout:9/193: link d2/f2b d2/d5/d18/d19/f3b 0 2023-01-04T18:16:26.811 INFO:tasks.workunit.client.1.smithi098.stdout:4/89: dwrite d5/f8 [0,4194304] 0 2023-01-04T18:16:26.812 INFO:tasks.workunit.client.1.smithi098.stdout:7/115: dwrite d1/da/f16 [0,4194304] 0 2023-01-04T18:16:26.815 INFO:tasks.workunit.client.1.smithi098.stdout:3/125: dwrite d6/f25 [0,4194304] 0 2023-01-04T18:16:26.815 INFO:tasks.workunit.client.1.smithi098.stdout:3/126: readlink d6/d10/d19/l28 0 2023-01-04T18:16:26.815 INFO:tasks.workunit.client.1.smithi098.stdout:1/110: symlink d1/d8/l26 0 2023-01-04T18:16:26.816 INFO:tasks.workunit.client.1.smithi098.stdout:1/111: read d1/d8/da/f19 [4103634,79153] 0 2023-01-04T18:16:26.816 INFO:tasks.workunit.client.1.smithi098.stdout:3/127: read d6/fa [3218162,18446] 0 2023-01-04T18:16:26.818 INFO:tasks.workunit.client.1.smithi098.stdout:8/113: symlink d6/dc/d12/l1c 0 2023-01-04T18:16:26.821 INFO:tasks.workunit.client.1.smithi098.stdout:4/90: dread f4 [0,4194304] 0 2023-01-04T18:16:26.822 INFO:tasks.workunit.client.1.smithi098.stdout:9/194: rename d2/d5/lc to d2/d5/d18/d19/d2a/d2e/d26/l3c 0 2023-01-04T18:16:26.825 INFO:tasks.workunit.client.1.smithi098.stdout:5/129: dwrite d1/d2/f17 [0,4194304] 0 2023-01-04T18:16:26.827 INFO:tasks.workunit.client.1.smithi098.stdout:2/181: sync 2023-01-04T18:16:26.830 INFO:tasks.workunit.client.1.smithi098.stdout:7/116: mkdir d1/d23/d24/d26/d28 0 2023-01-04T18:16:26.830 INFO:tasks.workunit.client.1.smithi098.stdout:7/117: dread - d1/d23/d24/f1f zero size 2023-01-04T18:16:26.839 INFO:tasks.workunit.client.1.smithi098.stdout:8/114: dwrite d6/d11/f1a [0,4194304] 0 2023-01-04T18:16:26.840 INFO:tasks.workunit.client.1.smithi098.stdout:8/115: read d6/ff [173239,41365] 0 2023-01-04T18:16:26.840 INFO:tasks.workunit.client.1.smithi098.stdout:8/116: write d6/fe [218680,42892] 0 2023-01-04T18:16:26.843 INFO:tasks.workunit.client.1.smithi098.stdout:5/130: dwrite d1/f9 [0,4194304] 0 2023-01-04T18:16:26.846 INFO:tasks.workunit.client.1.smithi098.stdout:1/112: mkdir d1/d25/d27 0 2023-01-04T18:16:26.847 INFO:tasks.workunit.client.1.smithi098.stdout:3/128: mkdir d6/d10/d29 0 2023-01-04T18:16:26.849 INFO:tasks.workunit.client.1.smithi098.stdout:4/91: symlink d5/l18 0 2023-01-04T18:16:26.852 INFO:tasks.workunit.client.1.smithi098.stdout:9/195: mknod d2/d5/d18/d19/d2a/d2e/d26/c3d 0 2023-01-04T18:16:26.852 INFO:tasks.workunit.client.1.smithi098.stdout:9/196: fdatasync d2/d5/d18/f39 0 2023-01-04T18:16:26.854 INFO:tasks.workunit.client.1.smithi098.stdout:7/118: creat d1/d4/f29 x:0 0 0 2023-01-04T18:16:26.858 INFO:tasks.workunit.client.1.smithi098.stdout:8/117: creat d6/d11/d15/f1d x:0 0 0 2023-01-04T18:16:26.860 INFO:tasks.workunit.client.1.smithi098.stdout:5/131: mknod d1/d1e/c28 0 2023-01-04T18:16:26.860 INFO:tasks.workunit.client.1.smithi098.stdout:5/132: write d1/d2/d14/d19/f25 [192818,92866] 0 2023-01-04T18:16:26.862 INFO:tasks.workunit.client.1.smithi098.stdout:1/113: getdents d1/d8 0 2023-01-04T18:16:26.864 INFO:tasks.workunit.client.1.smithi098.stdout:3/129: mknod d6/d10/c2a 0 2023-01-04T18:16:26.864 INFO:tasks.workunit.client.1.smithi098.stdout:9/197: getdents d2/d5/d18 0 2023-01-04T18:16:26.865 INFO:tasks.workunit.client.1.smithi098.stdout:9/198: fsync d2/d5/f28 0 2023-01-04T18:16:26.865 INFO:tasks.workunit.client.1.smithi098.stdout:3/130: write f3 [1768677,83826] 0 2023-01-04T18:16:26.865 INFO:tasks.workunit.client.1.smithi098.stdout:3/131: fdatasync d6/f15 0 2023-01-04T18:16:26.866 INFO:tasks.workunit.client.1.smithi098.stdout:3/132: chown d6/d10/d19/c1a 1119 1 2023-01-04T18:16:26.866 INFO:tasks.workunit.client.1.smithi098.stdout:7/119: mknod d1/d23/c2a 0 2023-01-04T18:16:26.866 INFO:tasks.workunit.client.1.smithi098.stdout:7/120: getdents d1/d23/d24/d26/d28 0 2023-01-04T18:16:26.868 INFO:tasks.workunit.client.1.smithi098.stdout:8/118: mkdir d6/dc/d12/d1e 0 2023-01-04T18:16:26.868 INFO:tasks.workunit.client.1.smithi098.stdout:9/199: truncate d2/d5/d18/f1a 2437204 0 2023-01-04T18:16:26.868 INFO:tasks.workunit.client.1.smithi098.stdout:5/133: dread d1/d2/f17 [0,4194304] 0 2023-01-04T18:16:26.868 INFO:tasks.workunit.client.1.smithi098.stdout:5/134: write d1/fc [2594091,116358] 0 2023-01-04T18:16:26.868 INFO:tasks.workunit.client.1.smithi098.stdout:5/135: fdatasync d1/d2/d14/d19/f22 0 2023-01-04T18:16:26.869 INFO:tasks.workunit.client.1.smithi098.stdout:5/136: dread - d1/d2/d14/d19/f22 zero size 2023-01-04T18:16:26.869 INFO:tasks.workunit.client.1.smithi098.stdout:5/137: fsync d1/f9 0 2023-01-04T18:16:26.869 INFO:tasks.workunit.client.1.smithi098.stdout:5/138: truncate d1/da/f26 306853 0 2023-01-04T18:16:26.869 INFO:tasks.workunit.client.1.smithi098.stdout:3/133: symlink d6/d10/d29/l2b 0 2023-01-04T18:16:26.870 INFO:tasks.workunit.client.1.smithi098.stdout:7/121: truncate d1/d23/f17 618464 0 2023-01-04T18:16:26.870 INFO:tasks.workunit.client.1.smithi098.stdout:7/122: dread - d1/d4/f29 zero size 2023-01-04T18:16:26.871 INFO:tasks.workunit.client.1.smithi098.stdout:8/119: rmdir d6/d11 39 2023-01-04T18:16:26.872 INFO:tasks.workunit.client.1.smithi098.stdout:7/123: truncate d1/f5 2455363 0 2023-01-04T18:16:26.875 INFO:tasks.workunit.client.1.smithi098.stdout:7/124: mknod d1/d23/d24/d26/c2b 0 2023-01-04T18:16:26.875 INFO:tasks.workunit.client.1.smithi098.stdout:8/120: rename d6/ff to d6/d11/d15/f1f 0 2023-01-04T18:16:26.884 INFO:tasks.workunit.client.1.smithi098.stdout:4/92: dwrite d5/f8 [0,4194304] 0 2023-01-04T18:16:26.884 INFO:tasks.workunit.client.1.smithi098.stdout:4/93: stat d5/f16 0 2023-01-04T18:16:26.884 INFO:tasks.workunit.client.1.smithi098.stdout:4/94: dread - d5/f12 zero size 2023-01-04T18:16:26.886 INFO:tasks.workunit.client.1.smithi098.stdout:4/95: unlink d5/de/f15 0 2023-01-04T18:16:26.887 INFO:tasks.workunit.client.1.smithi098.stdout:4/96: read d5/de/f11 [3719664,87647] 0 2023-01-04T18:16:26.887 INFO:tasks.workunit.client.1.smithi098.stdout:4/97: stat d5/d9/lb 0 2023-01-04T18:16:26.888 INFO:tasks.workunit.client.1.smithi098.stdout:4/98: symlink d5/d9/d13/l19 0 2023-01-04T18:16:26.914 INFO:tasks.workunit.client.1.smithi098.stdout:6/115: sync 2023-01-04T18:16:26.923 INFO:tasks.workunit.client.1.smithi098.stdout:6/116: dread d9/dd/d15/f1a [0,4194304] 0 2023-01-04T18:16:26.924 INFO:tasks.workunit.client.1.smithi098.stdout:6/117: fdatasync d9/fc 0 2023-01-04T18:16:26.928 INFO:tasks.workunit.client.1.smithi098.stdout:6/118: read d9/fa [2845202,75900] 0 2023-01-04T18:16:26.928 INFO:tasks.workunit.client.1.smithi098.stdout:6/119: write d9/fa [2497052,23993] 0 2023-01-04T18:16:26.931 INFO:tasks.workunit.client.1.smithi098.stdout:9/200: dwrite d2/d5/d18/d19/f3b [0,4194304] 0 2023-01-04T18:16:26.931 INFO:tasks.workunit.client.1.smithi098.stdout:8/121: dwrite d6/f9 [8388608,4194304] 0 2023-01-04T18:16:26.932 INFO:tasks.workunit.client.1.smithi098.stdout:3/134: dwrite d6/f21 [0,4194304] 0 2023-01-04T18:16:26.932 INFO:tasks.workunit.client.1.smithi098.stdout:1/114: dwrite d1/d8/da/fe [0,4194304] 0 2023-01-04T18:16:26.932 INFO:tasks.workunit.client.1.smithi098.stdout:4/99: dwrite d5/d9/d13/f17 [0,4194304] 0 2023-01-04T18:16:26.935 INFO:tasks.workunit.client.1.smithi098.stdout:5/139: dwrite d1/d2/d14/f23 [0,4194304] 0 2023-01-04T18:16:26.935 INFO:tasks.workunit.client.1.smithi098.stdout:5/140: fdatasync d1/d2/d14/f23 0 2023-01-04T18:16:26.935 INFO:tasks.workunit.client.1.smithi098.stdout:9/201: mknod d2/c3e 0 2023-01-04T18:16:26.935 INFO:tasks.workunit.client.1.smithi098.stdout:6/120: dread d9/f17 [0,4194304] 0 2023-01-04T18:16:26.935 INFO:tasks.workunit.client.1.smithi098.stdout:9/202: write d2/f1e [2501995,14268] 0 2023-01-04T18:16:26.938 INFO:tasks.workunit.client.1.smithi098.stdout:8/122: mkdir d6/dc/d12/d20 0 2023-01-04T18:16:26.938 INFO:tasks.workunit.client.1.smithi098.stdout:9/203: dread d2/d5/d18/d19/d2a/d2e/d26/f37 [0,4194304] 0 2023-01-04T18:16:26.938 INFO:tasks.workunit.client.1.smithi098.stdout:3/135: mknod d6/d10/c2c 0 2023-01-04T18:16:26.938 INFO:tasks.workunit.client.1.smithi098.stdout:3/136: readlink d6/d10/d19/l24 0 2023-01-04T18:16:26.940 INFO:tasks.workunit.client.1.smithi098.stdout:1/115: truncate d1/d8/da/f17 327876 0 2023-01-04T18:16:26.940 INFO:tasks.workunit.client.1.smithi098.stdout:1/116: dread - d1/d8/da/f1a zero size 2023-01-04T18:16:26.945 INFO:tasks.workunit.client.1.smithi098.stdout:4/100: creat d5/d9/f1a x:0 0 0 2023-01-04T18:16:26.952 INFO:tasks.workunit.client.1.smithi098.stdout:5/141: mknod d1/da/c29 0 2023-01-04T18:16:26.954 INFO:tasks.workunit.client.1.smithi098.stdout:6/121: creat d9/dd/de/f21 x:0 0 0 2023-01-04T18:16:26.955 INFO:tasks.workunit.client.1.smithi098.stdout:9/204: rename d2/d5/fb to d2/d5/d18/f3f 0 2023-01-04T18:16:26.956 INFO:tasks.workunit.client.1.smithi098.stdout:9/205: dread - d2/d5/f28 zero size 2023-01-04T18:16:26.956 INFO:tasks.workunit.client.1.smithi098.stdout:9/206: dread - d2/d5/d18/f39 zero size 2023-01-04T18:16:26.956 INFO:tasks.workunit.client.1.smithi098.stdout:4/101: dread d5/f8 [0,4194304] 0 2023-01-04T18:16:26.957 INFO:tasks.workunit.client.1.smithi098.stdout:3/137: rmdir d6 39 2023-01-04T18:16:26.957 INFO:tasks.workunit.client.1.smithi098.stdout:3/138: chown d6/c1d 1 1 2023-01-04T18:16:26.957 INFO:tasks.workunit.client.1.smithi098.stdout:6/122: read d9/fc [4097464,26092] 0 2023-01-04T18:16:26.957 INFO:tasks.workunit.client.1.smithi098.stdout:1/117: link d1/d8/da/d12/f20 d1/d8/f28 0 2023-01-04T18:16:26.957 INFO:tasks.workunit.client.1.smithi098.stdout:1/118: chown d1 6 1 2023-01-04T18:16:26.958 INFO:tasks.workunit.client.1.smithi098.stdout:8/123: dwrite d6/d11/f1a [4194304,4194304] 0 2023-01-04T18:16:26.958 INFO:tasks.workunit.client.1.smithi098.stdout:9/207: rename d2/l14 to d2/d5/d18/d1d/d23/l40 0 2023-01-04T18:16:26.961 INFO:tasks.workunit.client.1.smithi098.stdout:4/102: unlink d5/l7 0 2023-01-04T18:16:26.962 INFO:tasks.workunit.client.1.smithi098.stdout:3/139: creat d6/d10/d29/f2d x:0 0 0 2023-01-04T18:16:26.965 INFO:tasks.workunit.client.1.smithi098.stdout:8/124: mknod d6/dc/c21 0 2023-01-04T18:16:26.967 INFO:tasks.workunit.client.1.smithi098.stdout:6/123: rename d9/dd/d15/l16 to d9/dd/l22 0 2023-01-04T18:16:26.969 INFO:tasks.workunit.client.1.smithi098.stdout:9/208: mkdir d2/d5/d18/d19/d2a/d2e/d26/d41 0 2023-01-04T18:16:26.970 INFO:tasks.workunit.client.1.smithi098.stdout:7/125: truncate d1/f5 351595 0 2023-01-04T18:16:26.970 INFO:tasks.workunit.client.1.smithi098.stdout:7/126: write d1/d4/f29 [304893,9703] 0 2023-01-04T18:16:26.970 INFO:tasks.workunit.client.1.smithi098.stdout:7/127: write d1/d4/f29 [779406,108930] 0 2023-01-04T18:16:26.971 INFO:tasks.workunit.client.1.smithi098.stdout:3/140: mkdir d6/d10/d19/d2e 0 2023-01-04T18:16:26.971 INFO:tasks.workunit.client.1.smithi098.stdout:8/125: symlink d6/dc/d12/l22 0 2023-01-04T18:16:26.972 INFO:tasks.workunit.client.1.smithi098.stdout:9/209: mkdir d2/d5/d18/d19/d2a/d42 0 2023-01-04T18:16:26.973 INFO:tasks.workunit.client.1.smithi098.stdout:7/128: rename d1/d23/d24/f25 to d1/d23/f2c 0 2023-01-04T18:16:26.973 INFO:tasks.workunit.client.1.smithi098.stdout:7/129: truncate d1/f7 4851393 0 2023-01-04T18:16:26.973 INFO:tasks.workunit.client.1.smithi098.stdout:8/126: symlink d6/l23 0 2023-01-04T18:16:26.974 INFO:tasks.workunit.client.1.smithi098.stdout:8/127: truncate d6/fe 2315969 0 2023-01-04T18:16:26.974 INFO:tasks.workunit.client.1.smithi098.stdout:8/128: write d6/d11/f1a [2603365,116277] 0 2023-01-04T18:16:26.975 INFO:tasks.workunit.client.1.smithi098.stdout:9/210: link d2/d5/d18/d1d/f34 d2/d5/d18/d19/d2a/d2e/d26/d41/f43 0 2023-01-04T18:16:26.976 INFO:tasks.workunit.client.1.smithi098.stdout:3/141: rename f3 to d6/d10/d19/d2e/f2f 0 2023-01-04T18:16:26.977 INFO:tasks.workunit.client.1.smithi098.stdout:3/142: chown d6/d10/c2a 2700956 1 2023-01-04T18:16:26.977 INFO:tasks.workunit.client.1.smithi098.stdout:7/130: mkdir d1/d23/d24/d26/d28/d2d 0 2023-01-04T18:16:26.977 INFO:tasks.workunit.client.1.smithi098.stdout:7/131: readlink d1/d23/l1c 0 2023-01-04T18:16:26.977 INFO:tasks.workunit.client.1.smithi098.stdout:7/132: chown d1/da 1812970294 1 2023-01-04T18:16:26.978 INFO:tasks.workunit.client.1.smithi098.stdout:6/124: dread d9/fa [0,4194304] 0 2023-01-04T18:16:26.978 INFO:tasks.workunit.client.1.smithi098.stdout:6/125: chown d9/dd/de 1786386546 1 2023-01-04T18:16:26.980 INFO:tasks.workunit.client.1.smithi098.stdout:5/142: dwrite d1/f18 [0,4194304] 0 2023-01-04T18:16:26.981 INFO:tasks.workunit.client.1.smithi098.stdout:3/143: rename d6/f27 to d6/d10/d19/d2e/f30 0 2023-01-04T18:16:26.982 INFO:tasks.workunit.client.1.smithi098.stdout:7/133: mkdir d1/d2e 0 2023-01-04T18:16:26.982 INFO:tasks.workunit.client.1.smithi098.stdout:7/134: write d1/d23/f17 [169985,59071] 0 2023-01-04T18:16:26.982 INFO:tasks.workunit.client.1.smithi098.stdout:4/103: dwrite f4 [0,4194304] 0 2023-01-04T18:16:26.983 INFO:tasks.workunit.client.1.smithi098.stdout:6/126: mknod d9/dd/c23 0 2023-01-04T18:16:26.988 INFO:tasks.workunit.client.1.smithi098.stdout:7/135: dread d1/d23/f17 [0,4194304] 0 2023-01-04T18:16:26.989 INFO:tasks.workunit.client.1.smithi098.stdout:4/104: truncate d5/d9/d13/f17 3864152 0 2023-01-04T18:16:26.989 INFO:tasks.workunit.client.1.smithi098.stdout:4/105: chown d5/f16 1 1 2023-01-04T18:16:26.989 INFO:tasks.workunit.client.1.smithi098.stdout:4/106: fdatasync d5/f8 0 2023-01-04T18:16:26.990 INFO:tasks.workunit.client.1.smithi098.stdout:6/127: mkdir d9/dd/d24 0 2023-01-04T18:16:26.990 INFO:tasks.workunit.client.1.smithi098.stdout:5/143: dread d1/da/f26 [0,4194304] 0 2023-01-04T18:16:26.992 INFO:tasks.workunit.client.1.smithi098.stdout:8/129: dread d6/d11/f1a [4194304,4194304] 0 2023-01-04T18:16:26.992 INFO:tasks.workunit.client.1.smithi098.stdout:8/130: dread - d6/d11/d15/f1d zero size 2023-01-04T18:16:26.992 INFO:tasks.workunit.client.1.smithi098.stdout:4/107: creat d5/f1b x:0 0 0 2023-01-04T18:16:26.993 INFO:tasks.workunit.client.1.smithi098.stdout:3/144: dread d6/f1e [0,4194304] 0 2023-01-04T18:16:26.993 INFO:tasks.workunit.client.1.smithi098.stdout:3/145: write d6/f25 [4867978,90203] 0 2023-01-04T18:16:26.993 INFO:tasks.workunit.client.1.smithi098.stdout:3/146: readlink d6/d10/l13 0 2023-01-04T18:16:26.993 INFO:tasks.workunit.client.1.smithi098.stdout:3/147: readlink d6/d10/d19/l28 0 2023-01-04T18:16:26.994 INFO:tasks.workunit.client.1.smithi098.stdout:2/182: sync 2023-01-04T18:16:26.994 INFO:tasks.workunit.client.1.smithi098.stdout:0/170: sync 2023-01-04T18:16:26.994 INFO:tasks.workunit.client.1.smithi098.stdout:6/128: dread d9/dd/f11 [0,4194304] 0 2023-01-04T18:16:26.995 INFO:tasks.workunit.client.1.smithi098.stdout:9/211: dwrite d2/d5/f28 [0,4194304] 0 2023-01-04T18:16:26.995 INFO:tasks.workunit.client.1.smithi098.stdout:9/212: chown d2/d5/d18/d1d/d23 87 1 2023-01-04T18:16:26.995 INFO:tasks.workunit.client.1.smithi098.stdout:9/213: readlink d2/d5/d18/d1d/d23/l35 0 2023-01-04T18:16:26.995 INFO:tasks.workunit.client.1.smithi098.stdout:9/214: dread - d2/d5/d18/d19/d2a/d2e/d26/d41/f43 zero size 2023-01-04T18:16:26.995 INFO:tasks.workunit.client.1.smithi098.stdout:9/215: chown d2/d5/d18/d1d/d23/l35 23027343 1 2023-01-04T18:16:26.996 INFO:tasks.workunit.client.1.smithi098.stdout:5/144: mknod d1/d2/c2a 0 2023-01-04T18:16:26.997 INFO:tasks.workunit.client.1.smithi098.stdout:5/145: read d1/d2/f17 [953086,43394] 0 2023-01-04T18:16:26.997 INFO:tasks.workunit.client.1.smithi098.stdout:8/131: mknod d6/dc/d12/c24 0 2023-01-04T18:16:26.999 INFO:tasks.workunit.client.1.smithi098.stdout:7/136: dread d1/da/f16 [0,4194304] 0 2023-01-04T18:16:26.999 INFO:tasks.workunit.client.1.smithi098.stdout:7/137: chown d1/d4/l10 7033731 1 2023-01-04T18:16:26.999 INFO:tasks.workunit.client.1.smithi098.stdout:7/138: chown d1/da/f1b 3582649 1 2023-01-04T18:16:26.999 INFO:tasks.workunit.client.1.smithi098.stdout:7/139: stat d1/d23/f2c 0 2023-01-04T18:16:27.002 INFO:tasks.workunit.client.1.smithi098.stdout:4/108: mkdir d5/d1c 0 2023-01-04T18:16:27.002 INFO:tasks.workunit.client.1.smithi098.stdout:3/148: mknod d6/d10/d19/d2e/c31 0 2023-01-04T18:16:27.003 INFO:tasks.workunit.client.1.smithi098.stdout:2/183: dread d6/dc/d1c/f2c [0,4194304] 0 2023-01-04T18:16:27.004 INFO:tasks.workunit.client.1.smithi098.stdout:0/171: creat df/d17/d1c/d2c/d41/f42 x:0 0 0 2023-01-04T18:16:27.005 INFO:tasks.workunit.client.1.smithi098.stdout:3/149: write d6/fa [113915,122657] 0 2023-01-04T18:16:27.005 INFO:tasks.workunit.client.1.smithi098.stdout:6/129: rename d9/dd/l14 to d9/dd/de/l25 0 2023-01-04T18:16:27.005 INFO:tasks.workunit.client.1.smithi098.stdout:0/172: write df/d17/f2d [503767,127143] 0 2023-01-04T18:16:27.006 INFO:tasks.workunit.client.1.smithi098.stdout:5/146: creat d1/da/f2b x:0 0 0 2023-01-04T18:16:27.007 INFO:tasks.workunit.client.1.smithi098.stdout:4/109: mknod d5/d1c/c1d 0 2023-01-04T18:16:27.007 INFO:tasks.workunit.client.1.smithi098.stdout:4/110: readlink d5/d9/d13/l19 0 2023-01-04T18:16:27.007 INFO:tasks.workunit.client.1.smithi098.stdout:4/111: write d5/d9/f1a [158869,4532] 0 2023-01-04T18:16:27.007 INFO:tasks.workunit.client.1.smithi098.stdout:2/184: symlink d6/dc/d2b/d32/l3d 0 2023-01-04T18:16:27.009 INFO:tasks.workunit.client.1.smithi098.stdout:3/150: getdents d6/d10/d19 0 2023-01-04T18:16:27.010 INFO:tasks.workunit.client.1.smithi098.stdout:6/130: mkdir d9/dd/de/d26 0 2023-01-04T18:16:27.013 INFO:tasks.workunit.client.1.smithi098.stdout:4/112: stat d5/d9/lb 0 2023-01-04T18:16:27.013 INFO:tasks.workunit.client.1.smithi098.stdout:0/173: truncate df/d17/f1f 2214364 0 2023-01-04T18:16:27.013 INFO:tasks.workunit.client.1.smithi098.stdout:6/131: read d9/fa [3209005,108482] 0 2023-01-04T18:16:27.015 INFO:tasks.workunit.client.1.smithi098.stdout:3/151: creat d6/d10/f32 x:0 0 0 2023-01-04T18:16:27.017 INFO:tasks.workunit.client.1.smithi098.stdout:3/152: mknod d6/d10/c33 0 2023-01-04T18:16:27.022 INFO:tasks.workunit.client.1.smithi098.stdout:6/132: dread d9/f17 [0,4194304] 0 2023-01-04T18:16:27.022 INFO:tasks.workunit.client.1.smithi098.stdout:6/133: readlink d9/dd/de/l19 0 2023-01-04T18:16:27.022 INFO:tasks.workunit.client.1.smithi098.stdout:6/134: stat d9/dd/de/d20 0 2023-01-04T18:16:27.029 INFO:tasks.workunit.client.1.smithi098.stdout:2/185: dwrite d6/f33 [0,4194304] 0 2023-01-04T18:16:27.033 INFO:tasks.workunit.client.1.smithi098.stdout:7/140: dwrite d1/d23/f2c [0,4194304] 0 2023-01-04T18:16:27.033 INFO:tasks.workunit.client.1.smithi098.stdout:2/186: link d6/dc/d1c/d1f/f30 d6/f3e 0 2023-01-04T18:16:27.040 INFO:tasks.workunit.client.1.smithi098.stdout:2/187: mknod d6/dc/d1c/d1f/c3f 0 2023-01-04T18:16:27.049 INFO:tasks.workunit.client.1.smithi098.stdout:2/188: creat d6/dc/d2b/f40 x:0 0 0 2023-01-04T18:16:27.050 INFO:tasks.workunit.client.1.smithi098.stdout:2/189: write d6/dc/d1c/d1f/f30 [69903,81865] 0 2023-01-04T18:16:27.050 INFO:tasks.workunit.client.1.smithi098.stdout:2/190: readlink d6/dc/d1c/l34 0 2023-01-04T18:16:27.054 INFO:tasks.workunit.client.1.smithi098.stdout:2/191: truncate d6/dc/d2b/f2e 1390888 0 2023-01-04T18:16:27.056 INFO:tasks.workunit.client.1.smithi098.stdout:5/147: dwrite d1/f1b [0,4194304] 0 2023-01-04T18:16:27.056 INFO:tasks.workunit.client.1.smithi098.stdout:5/148: dread - d1/d2/d14/d19/f22 zero size 2023-01-04T18:16:27.059 INFO:tasks.workunit.client.1.smithi098.stdout:6/135: dwrite d9/dd/f11 [0,4194304] 0 2023-01-04T18:16:27.061 INFO:tasks.workunit.client.1.smithi098.stdout:6/136: creat d9/dd/d1f/f27 x:0 0 0 2023-01-04T18:16:27.061 INFO:tasks.workunit.client.1.smithi098.stdout:6/137: write d9/dd/d1f/f27 [661025,4002] 0 2023-01-04T18:16:27.061 INFO:tasks.workunit.client.1.smithi098.stdout:7/141: dwrite d1/f7 [4194304,4194304] 0 2023-01-04T18:16:27.062 INFO:tasks.workunit.client.1.smithi098.stdout:3/153: dwrite d6/f25 [0,4194304] 0 2023-01-04T18:16:27.064 INFO:tasks.workunit.client.1.smithi098.stdout:3/154: fsync d6/d10/f32 0 2023-01-04T18:16:27.065 INFO:tasks.workunit.client.1.smithi098.stdout:6/138: dread d9/dd/de/f1e [0,4194304] 0 2023-01-04T18:16:27.069 INFO:tasks.workunit.client.1.smithi098.stdout:7/142: unlink d1/d23/d24/d26/c27 0 2023-01-04T18:16:27.074 INFO:tasks.workunit.client.1.smithi098.stdout:5/149: dwrite d1/d2/d14/d19/f22 [0,4194304] 0 2023-01-04T18:16:27.074 INFO:tasks.workunit.client.1.smithi098.stdout:3/155: creat d6/d10/d29/f34 x:0 0 0 2023-01-04T18:16:27.075 INFO:tasks.workunit.client.1.smithi098.stdout:5/150: read d1/f6 [3059088,129905] 0 2023-01-04T18:16:27.075 INFO:tasks.workunit.client.1.smithi098.stdout:4/113: dwrite d5/d9/f1a [0,4194304] 0 2023-01-04T18:16:27.076 INFO:tasks.workunit.client.1.smithi098.stdout:6/139: mknod d9/dd/de/d20/c28 0 2023-01-04T18:16:27.081 INFO:tasks.workunit.client.1.smithi098.stdout:7/143: dread d1/f7 [0,4194304] 0 2023-01-04T18:16:27.082 INFO:tasks.workunit.client.1.smithi098.stdout:6/140: dread d9/fa [0,4194304] 0 2023-01-04T18:16:27.082 INFO:tasks.workunit.client.1.smithi098.stdout:3/156: symlink d6/d10/d19/l35 0 2023-01-04T18:16:27.083 INFO:tasks.workunit.client.1.smithi098.stdout:4/114: symlink d5/de/l1e 0 2023-01-04T18:16:27.083 INFO:tasks.workunit.client.1.smithi098.stdout:4/115: chown d5 0 1 2023-01-04T18:16:27.083 INFO:tasks.workunit.client.1.smithi098.stdout:4/116: fdatasync d5/d9/d13/f14 0 2023-01-04T18:16:27.085 INFO:tasks.workunit.client.1.smithi098.stdout:7/144: mknod d1/c2f 0 2023-01-04T18:16:27.085 INFO:tasks.workunit.client.1.smithi098.stdout:7/145: chown d1/da/f16 15065 1 2023-01-04T18:16:27.089 INFO:tasks.workunit.client.1.smithi098.stdout:3/157: creat d6/d10/d19/f36 x:0 0 0 2023-01-04T18:16:27.089 INFO:tasks.workunit.client.1.smithi098.stdout:1/119: sync 2023-01-04T18:16:27.090 INFO:tasks.workunit.client.1.smithi098.stdout:4/117: symlink d5/d9/d13/l1f 0 2023-01-04T18:16:27.090 INFO:tasks.workunit.client.1.smithi098.stdout:4/118: readlink d5/d9/lb 0 2023-01-04T18:16:27.093 INFO:tasks.workunit.client.1.smithi098.stdout:7/146: creat d1/d23/d24/d26/f30 x:0 0 0 2023-01-04T18:16:27.094 INFO:tasks.workunit.client.1.smithi098.stdout:5/151: dwrite d1/f1d [0,4194304] 0 2023-01-04T18:16:27.094 INFO:tasks.workunit.client.1.smithi098.stdout:5/152: dread - d1/da/f2b zero size 2023-01-04T18:16:27.094 INFO:tasks.workunit.client.1.smithi098.stdout:3/158: symlink d6/l37 0 2023-01-04T18:16:27.101 INFO:tasks.workunit.client.1.smithi098.stdout:4/119: write d5/f8 [2197404,118519] 0 2023-01-04T18:16:27.102 INFO:tasks.workunit.client.1.smithi098.stdout:4/120: mknod d5/c20 0 2023-01-04T18:16:27.104 INFO:tasks.workunit.client.1.smithi098.stdout:4/121: rename d5/d1c to d5/de/d21 0 2023-01-04T18:16:27.117 INFO:tasks.workunit.client.1.smithi098.stdout:3/159: dread d6/f1e [0,4194304] 0 2023-01-04T18:16:27.118 INFO:tasks.workunit.client.1.smithi098.stdout:6/141: dwrite d9/dd/d15/f1a [0,4194304] 0 2023-01-04T18:16:27.119 INFO:tasks.workunit.client.1.smithi098.stdout:3/160: unlink d6/d10/f18 0 2023-01-04T18:16:27.119 INFO:tasks.workunit.client.1.smithi098.stdout:3/161: write d6/d10/d29/f2d [557785,438] 0 2023-01-04T18:16:27.120 INFO:tasks.workunit.client.1.smithi098.stdout:3/162: readlink d6/l11 0 2023-01-04T18:16:27.121 INFO:tasks.workunit.client.1.smithi098.stdout:3/163: symlink d6/l38 0 2023-01-04T18:16:27.122 INFO:tasks.workunit.client.1.smithi098.stdout:3/164: rename d6/d10/d19/f36 to d6/d10/d19/f39 0 2023-01-04T18:16:27.124 INFO:tasks.workunit.client.1.smithi098.stdout:3/165: link d6/d10/f1b d6/d10/d19/f3a 0 2023-01-04T18:16:27.126 INFO:tasks.workunit.client.1.smithi098.stdout:3/166: dread d6/f1e [0,4194304] 0 2023-01-04T18:16:27.127 INFO:tasks.workunit.client.1.smithi098.stdout:3/167: mkdir d6/d10/d3b 0 2023-01-04T18:16:27.129 INFO:tasks.workunit.client.1.smithi098.stdout:3/168: unlink d6/f1e 0 2023-01-04T18:16:27.130 INFO:tasks.workunit.client.1.smithi098.stdout:3/169: creat d6/d10/d3b/f3c x:0 0 0 2023-01-04T18:16:27.130 INFO:tasks.workunit.client.1.smithi098.stdout:3/170: dread - d6/d10/d3b/f3c zero size 2023-01-04T18:16:27.130 INFO:tasks.workunit.client.1.smithi098.stdout:3/171: mknod d6/d10/c3d 0 2023-01-04T18:16:27.131 INFO:tasks.workunit.client.1.smithi098.stdout:5/153: dwrite d1/da/f1c [0,4194304] 0 2023-01-04T18:16:27.132 INFO:tasks.workunit.client.1.smithi098.stdout:3/172: unlink d6/c22 0 2023-01-04T18:16:27.132 INFO:tasks.workunit.client.1.smithi098.stdout:4/122: dwrite f4 [0,4194304] 0 2023-01-04T18:16:27.133 INFO:tasks.workunit.client.1.smithi098.stdout:1/120: dwrite d1/d8/da/fe [0,4194304] 0 2023-01-04T18:16:27.133 INFO:tasks.workunit.client.1.smithi098.stdout:5/154: write d1/f1d [136964,129448] 0 2023-01-04T18:16:27.134 INFO:tasks.workunit.client.1.smithi098.stdout:1/121: creat d1/d25/f29 x:0 0 0 2023-01-04T18:16:27.134 INFO:tasks.workunit.client.1.smithi098.stdout:3/173: dread d6/d10/d29/f2d [0,4194304] 0 2023-01-04T18:16:27.135 INFO:tasks.workunit.client.1.smithi098.stdout:3/174: truncate d6/d10/f23 332776 0 2023-01-04T18:16:27.135 INFO:tasks.workunit.client.1.smithi098.stdout:3/175: chown d6/d10/d29/f2d 2775283 1 2023-01-04T18:16:27.135 INFO:tasks.workunit.client.1.smithi098.stdout:5/155: truncate d1/f1b 2183062 0 2023-01-04T18:16:27.136 INFO:tasks.workunit.client.1.smithi098.stdout:5/156: chown d1/d2/d14 301174 1 2023-01-04T18:16:27.139 INFO:tasks.workunit.client.1.smithi098.stdout:1/122: mknod d1/d25/c2a 0 2023-01-04T18:16:27.141 INFO:tasks.workunit.client.1.smithi098.stdout:5/157: symlink d1/d1e/l2c 0 2023-01-04T18:16:27.144 INFO:tasks.workunit.client.1.smithi098.stdout:1/123: fdatasync d1/f2 0 2023-01-04T18:16:27.144 INFO:tasks.workunit.client.1.smithi098.stdout:1/124: dread - d1/d25/f29 zero size 2023-01-04T18:16:27.145 INFO:tasks.workunit.client.1.smithi098.stdout:4/123: dwrite d5/f12 [0,4194304] 0 2023-01-04T18:16:27.145 INFO:tasks.workunit.client.1.smithi098.stdout:3/176: truncate d6/d10/d19/f26 620253 0 2023-01-04T18:16:27.145 INFO:tasks.workunit.client.1.smithi098.stdout:3/177: chown l0 190137996 1 2023-01-04T18:16:27.147 INFO:tasks.workunit.client.1.smithi098.stdout:5/158: creat d1/d2/d14/f2d x:0 0 0 2023-01-04T18:16:27.149 INFO:tasks.workunit.client.1.smithi098.stdout:9/216: sync 2023-01-04T18:16:27.150 INFO:tasks.workunit.client.1.smithi098.stdout:8/132: sync 2023-01-04T18:16:27.150 INFO:tasks.workunit.client.1.smithi098.stdout:0/174: sync 2023-01-04T18:16:27.150 INFO:tasks.workunit.client.1.smithi098.stdout:0/175: write df/d17/f1f [2484647,41450] 0 2023-01-04T18:16:27.152 INFO:tasks.workunit.client.1.smithi098.stdout:3/178: write d6/d10/d19/f26 [1303212,67147] 0 2023-01-04T18:16:27.154 INFO:tasks.workunit.client.1.smithi098.stdout:4/124: creat d5/de/d21/f22 x:0 0 0 2023-01-04T18:16:27.155 INFO:tasks.workunit.client.1.smithi098.stdout:8/133: write d6/d11/f1a [5077809,54341] 0 2023-01-04T18:16:27.156 INFO:tasks.workunit.client.1.smithi098.stdout:9/217: creat d2/d5/d18/f44 x:0 0 0 2023-01-04T18:16:27.156 INFO:tasks.workunit.client.1.smithi098.stdout:4/125: write f4 [3790996,125450] 0 2023-01-04T18:16:27.159 INFO:tasks.workunit.client.1.smithi098.stdout:0/176: rename df/c13 to df/d17/d24/c43 0 2023-01-04T18:16:27.159 INFO:tasks.workunit.client.1.smithi098.stdout:0/177: chown la 820910871 1 2023-01-04T18:16:27.160 INFO:tasks.workunit.client.1.smithi098.stdout:0/178: chown ld 3 1 2023-01-04T18:16:27.161 INFO:tasks.workunit.client.1.smithi098.stdout:1/125: link d1/d25/f29 d1/d8/da/d12/f2b 0 2023-01-04T18:16:27.161 INFO:tasks.workunit.client.1.smithi098.stdout:3/179: symlink d6/d10/d3b/l3e 0 2023-01-04T18:16:27.163 INFO:tasks.workunit.client.1.smithi098.stdout:9/218: creat d2/f45 x:0 0 0 2023-01-04T18:16:27.163 INFO:tasks.workunit.client.1.smithi098.stdout:9/219: write d2/d5/d18/d1d/f34 [946772,24881] 0 2023-01-04T18:16:27.165 INFO:tasks.workunit.client.1.smithi098.stdout:9/220: symlink d2/d5/d18/d19/d2a/d2e/d26/d41/l46 0 2023-01-04T18:16:27.208 INFO:tasks.workunit.client.1.smithi098.stdout:5/159: dwrite d1/f1b [0,4194304] 0 2023-01-04T18:16:27.208 INFO:tasks.workunit.client.1.smithi098.stdout:5/160: truncate d1/d2/d14/f27 415147 0 2023-01-04T18:16:27.209 INFO:tasks.workunit.client.1.smithi098.stdout:0/179: dread df/d17/d1c/f1e [0,4194304] 0 2023-01-04T18:16:27.211 INFO:tasks.workunit.client.1.smithi098.stdout:4/126: dwrite d5/f12 [0,4194304] 0 2023-01-04T18:16:27.211 INFO:tasks.workunit.client.1.smithi098.stdout:1/126: dwrite d1/f1f [0,4194304] 0 2023-01-04T18:16:27.211 INFO:tasks.workunit.client.1.smithi098.stdout:0/180: rename df/d17/f1f to df/d17/d24/f44 0 2023-01-04T18:16:27.214 INFO:tasks.workunit.client.1.smithi098.stdout:4/127: creat d5/d9/d13/f23 x:0 0 0 2023-01-04T18:16:27.217 INFO:tasks.workunit.client.1.smithi098.stdout:3/180: rename d6/d10/d19/d2e to d6/d10/d19/d3f 0 2023-01-04T18:16:27.217 INFO:tasks.workunit.client.1.smithi098.stdout:3/181: chown d6/d10/f12 29408887 1 2023-01-04T18:16:27.217 INFO:tasks.workunit.client.1.smithi098.stdout:3/182: fsync d6/d10/f23 0 2023-01-04T18:16:27.220 INFO:tasks.workunit.client.1.smithi098.stdout:1/127: mknod d1/d8/da/d12/c2c 0 2023-01-04T18:16:27.221 INFO:tasks.workunit.client.1.smithi098.stdout:9/221: truncate d2/d5/d18/d1d/f34 459188 0 2023-01-04T18:16:27.224 INFO:tasks.workunit.client.1.smithi098.stdout:4/128: creat d5/d9/d13/f24 x:0 0 0 2023-01-04T18:16:27.224 INFO:tasks.workunit.client.1.smithi098.stdout:4/129: write d5/d9/d13/f14 [157637,81205] 0 2023-01-04T18:16:27.224 INFO:tasks.workunit.client.1.smithi098.stdout:4/130: fsync d5/de/d21/f22 0 2023-01-04T18:16:27.225 INFO:tasks.workunit.client.1.smithi098.stdout:3/183: getdents d6 0 2023-01-04T18:16:27.226 INFO:tasks.workunit.client.1.smithi098.stdout:1/128: rename d1/f2 to d1/d25/d27/f2d 0 2023-01-04T18:16:27.227 INFO:tasks.workunit.client.1.smithi098.stdout:9/222: mknod d2/d5/d18/d19/d2a/d42/c47 0 2023-01-04T18:16:27.227 INFO:tasks.workunit.client.1.smithi098.stdout:3/184: creat d6/d10/f40 x:0 0 0 2023-01-04T18:16:27.227 INFO:tasks.workunit.client.1.smithi098.stdout:3/185: readlink d6/d10/d3b/l3e 0 2023-01-04T18:16:27.228 INFO:tasks.workunit.client.1.smithi098.stdout:4/131: rename d5/c20 to d5/de/c25 0 2023-01-04T18:16:27.230 INFO:tasks.workunit.client.1.smithi098.stdout:9/223: rename d2/d2d/l31 to d2/d5/d18/d1d/l48 0 2023-01-04T18:16:27.231 INFO:tasks.workunit.client.1.smithi098.stdout:4/132: symlink d5/de/l26 0 2023-01-04T18:16:27.231 INFO:tasks.workunit.client.1.smithi098.stdout:4/133: write d5/f16 [838885,54066] 0 2023-01-04T18:16:27.232 INFO:tasks.workunit.client.1.smithi098.stdout:1/129: mkdir d1/d2e 0 2023-01-04T18:16:27.232 INFO:tasks.workunit.client.1.smithi098.stdout:1/130: chown d1/fc 1 1 2023-01-04T18:16:27.233 INFO:tasks.workunit.client.1.smithi098.stdout:1/131: write d1/f1f [2225071,98080] 0 2023-01-04T18:16:27.234 INFO:tasks.workunit.client.1.smithi098.stdout:3/186: unlink d6/d10/d19/c1a 0 2023-01-04T18:16:27.235 INFO:tasks.workunit.client.1.smithi098.stdout:0/181: dwrite df/f14 [0,4194304] 0 2023-01-04T18:16:27.235 INFO:tasks.workunit.client.1.smithi098.stdout:0/182: stat df/d17/d24/f2e 0 2023-01-04T18:16:27.235 INFO:tasks.workunit.client.1.smithi098.stdout:3/187: chown d6/d10/d19/c20 10037 1 2023-01-04T18:16:27.235 INFO:tasks.workunit.client.1.smithi098.stdout:3/188: chown d6/c8 207 1 2023-01-04T18:16:27.242 INFO:tasks.workunit.client.1.smithi098.stdout:3/189: unlink d6/f14 0 2023-01-04T18:16:27.242 INFO:tasks.workunit.client.1.smithi098.stdout:3/190: fsync d6/d10/f1b 0 2023-01-04T18:16:27.242 INFO:tasks.workunit.client.1.smithi098.stdout:3/191: chown d6/d10/d3b/f3c 636133 1 2023-01-04T18:16:27.247 INFO:tasks.workunit.client.1.smithi098.stdout:3/192: creat d6/f41 x:0 0 0 2023-01-04T18:16:27.247 INFO:tasks.workunit.client.1.smithi098.stdout:3/193: truncate d6/d10/d3b/f3c 171796 0 2023-01-04T18:16:27.248 INFO:tasks.workunit.client.1.smithi098.stdout:3/194: creat d6/d10/d19/f42 x:0 0 0 2023-01-04T18:16:27.248 INFO:tasks.workunit.client.1.smithi098.stdout:3/195: write d6/d10/f40 [871332,124845] 0 2023-01-04T18:16:27.253 INFO:tasks.workunit.client.1.smithi098.stdout:9/224: dwrite d2/d5/d18/f44 [0,4194304] 0 2023-01-04T18:16:27.262 INFO:tasks.workunit.client.1.smithi098.stdout:4/134: dread d5/f12 [0,4194304] 0 2023-01-04T18:16:27.262 INFO:tasks.workunit.client.1.smithi098.stdout:4/135: readlink d5/d9/d13/l19 0 2023-01-04T18:16:27.265 INFO:tasks.workunit.client.1.smithi098.stdout:3/196: dread d6/d10/f1b [0,4194304] 0 2023-01-04T18:16:27.265 INFO:tasks.workunit.client.1.smithi098.stdout:3/197: write d6/f41 [756844,130248] 0 2023-01-04T18:16:27.266 INFO:tasks.workunit.client.1.smithi098.stdout:1/132: dwrite d1/d25/f29 [0,4194304] 0 2023-01-04T18:16:27.273 INFO:tasks.workunit.client.1.smithi098.stdout:1/133: creat d1/d8/f2f x:0 0 0 2023-01-04T18:16:27.273 INFO:tasks.workunit.client.1.smithi098.stdout:1/134: write d1/d8/f28 [538011,53276] 0 2023-01-04T18:16:27.275 INFO:tasks.workunit.client.1.smithi098.stdout:2/192: sync 2023-01-04T18:16:27.279 INFO:tasks.workunit.client.1.smithi098.stdout:1/135: creat d1/f30 x:0 0 0 2023-01-04T18:16:27.279 INFO:tasks.workunit.client.1.smithi098.stdout:4/136: dwrite d5/de/f11 [0,4194304] 0 2023-01-04T18:16:27.279 INFO:tasks.workunit.client.1.smithi098.stdout:4/137: dread - d5/f1b zero size 2023-01-04T18:16:27.279 INFO:tasks.workunit.client.1.smithi098.stdout:4/138: read d5/d9/d13/f14 [146884,129964] 0 2023-01-04T18:16:27.279 INFO:tasks.workunit.client.1.smithi098.stdout:4/139: dread - d5/d9/d13/f24 zero size 2023-01-04T18:16:27.279 INFO:tasks.workunit.client.1.smithi098.stdout:2/193: creat d6/dc/d1c/f41 x:0 0 0 2023-01-04T18:16:27.280 INFO:tasks.workunit.client.1.smithi098.stdout:1/136: rename d1/d8/da/fe to d1/d8/da/f31 0 2023-01-04T18:16:27.280 INFO:tasks.workunit.client.1.smithi098.stdout:1/137: chown d1/d2e 7461012 1 2023-01-04T18:16:27.280 INFO:tasks.workunit.client.1.smithi098.stdout:1/138: truncate d1/d25/f29 4731865 0 2023-01-04T18:16:27.281 INFO:tasks.workunit.client.1.smithi098.stdout:1/139: fsync d1/fc 0 2023-01-04T18:16:27.282 INFO:tasks.workunit.client.1.smithi098.stdout:4/140: getdents d5/d9/d13 0 2023-01-04T18:16:27.283 INFO:tasks.workunit.client.1.smithi098.stdout:2/194: mkdir d6/dc/d2b/d42 0 2023-01-04T18:16:27.283 INFO:tasks.workunit.client.1.smithi098.stdout:4/141: mknod d5/de/d21/c27 0 2023-01-04T18:16:27.284 INFO:tasks.workunit.client.1.smithi098.stdout:2/195: creat d6/dc/d1c/d31/f43 x:0 0 0 2023-01-04T18:16:27.286 INFO:tasks.workunit.client.1.smithi098.stdout:4/142: mkdir d5/d28 0 2023-01-04T18:16:27.287 INFO:tasks.workunit.client.1.smithi098.stdout:2/196: write f5 [2918660,21837] 0 2023-01-04T18:16:27.287 INFO:tasks.workunit.client.1.smithi098.stdout:2/197: fdatasync d6/dc/d1c/d31/f43 0 2023-01-04T18:16:27.287 INFO:tasks.workunit.client.1.smithi098.stdout:2/198: chown d6/dc/d2b 17847 1 2023-01-04T18:16:27.288 INFO:tasks.workunit.client.1.smithi098.stdout:3/198: dwrite d6/f41 [0,4194304] 0 2023-01-04T18:16:27.288 INFO:tasks.workunit.client.1.smithi098.stdout:4/143: creat d5/de/f29 x:0 0 0 2023-01-04T18:16:27.288 INFO:tasks.workunit.client.1.smithi098.stdout:2/199: write d6/f2f [3499908,60708] 0 2023-01-04T18:16:27.291 INFO:tasks.workunit.client.1.smithi098.stdout:4/144: creat d5/d9/d13/f2a x:0 0 0 2023-01-04T18:16:27.292 INFO:tasks.workunit.client.1.smithi098.stdout:2/200: mknod d6/dc/d2b/c44 0 2023-01-04T18:16:27.295 INFO:tasks.workunit.client.1.smithi098.stdout:4/145: creat d5/d28/f2b x:0 0 0 2023-01-04T18:16:27.295 INFO:tasks.workunit.client.1.smithi098.stdout:4/146: dread - d5/d28/f2b zero size 2023-01-04T18:16:27.299 INFO:tasks.workunit.client.1.smithi098.stdout:4/147: mkdir d5/de/d2c 0 2023-01-04T18:16:27.299 INFO:tasks.workunit.client.1.smithi098.stdout:2/201: creat d6/f45 x:0 0 0 2023-01-04T18:16:27.305 INFO:tasks.workunit.client.1.smithi098.stdout:3/199: dwrite d6/f41 [0,4194304] 0 2023-01-04T18:16:27.308 INFO:tasks.workunit.client.1.smithi098.stdout:2/202: dread f5 [4194304,4194304] 0 2023-01-04T18:16:27.308 INFO:tasks.workunit.client.1.smithi098.stdout:3/200: symlink d6/l43 0 2023-01-04T18:16:27.308 INFO:tasks.workunit.client.1.smithi098.stdout:3/201: stat d6/l11 0 2023-01-04T18:16:27.310 INFO:tasks.workunit.client.1.smithi098.stdout:2/203: mkdir d6/dc/d2b/d46 0 2023-01-04T18:16:27.310 INFO:tasks.workunit.client.1.smithi098.stdout:3/202: creat d6/f44 x:0 0 0 2023-01-04T18:16:27.318 INFO:tasks.workunit.client.1.smithi098.stdout:2/204: rename d6/dc/d1c to d6/dc/d2b/d42/d47 0 2023-01-04T18:16:27.323 INFO:tasks.workunit.client.1.smithi098.stdout:8/134: sync 2023-01-04T18:16:27.323 INFO:tasks.workunit.client.1.smithi098.stdout:6/142: sync 2023-01-04T18:16:27.323 INFO:tasks.workunit.client.1.smithi098.stdout:8/135: dread - d6/d11/d15/f1d zero size 2023-01-04T18:16:27.324 INFO:tasks.workunit.client.1.smithi098.stdout:8/136: mknod d6/d11/d15/d1b/c25 0 2023-01-04T18:16:27.325 INFO:tasks.workunit.client.1.smithi098.stdout:8/137: truncate d6/f9 6907851 0 2023-01-04T18:16:27.332 INFO:tasks.workunit.client.1.smithi098.stdout:6/143: dread d9/dd/f11 [0,4194304] 0 2023-01-04T18:16:27.333 INFO:tasks.workunit.client.1.smithi098.stdout:6/144: creat d9/dd/f29 x:0 0 0 2023-01-04T18:16:27.337 INFO:tasks.workunit.client.1.smithi098.stdout:7/147: sync 2023-01-04T18:16:27.337 INFO:tasks.workunit.client.1.smithi098.stdout:4/148: dwrite d5/d9/d13/f24 [0,4194304] 0 2023-01-04T18:16:27.338 INFO:tasks.workunit.client.1.smithi098.stdout:7/148: mknod d1/d23/d24/c31 0 2023-01-04T18:16:27.338 INFO:tasks.workunit.client.1.smithi098.stdout:3/203: dwrite d6/d10/f12 [0,4194304] 0 2023-01-04T18:16:27.339 INFO:tasks.workunit.client.1.smithi098.stdout:2/205: dwrite d6/f3e [0,4194304] 0 2023-01-04T18:16:27.340 INFO:tasks.workunit.client.1.smithi098.stdout:4/149: truncate d5/d9/d13/f17 2024812 0 2023-01-04T18:16:27.340 INFO:tasks.workunit.client.1.smithi098.stdout:4/150: chown d5/d28 14 1 2023-01-04T18:16:27.340 INFO:tasks.workunit.client.1.smithi098.stdout:4/151: stat d5/d9/d13/f17 0 2023-01-04T18:16:27.342 INFO:tasks.workunit.client.1.smithi098.stdout:7/149: rename d1/f5 to d1/d23/d24/d26/d28/d2d/f32 0 2023-01-04T18:16:27.342 INFO:tasks.workunit.client.1.smithi098.stdout:7/150: chown d1/d4/l8 25974075 1 2023-01-04T18:16:27.342 INFO:tasks.workunit.client.1.smithi098.stdout:6/145: dread d9/dd/d15/f1a [0,4194304] 0 2023-01-04T18:16:27.343 INFO:tasks.workunit.client.1.smithi098.stdout:7/151: read d1/da/f1e [830609,38796] 0 2023-01-04T18:16:27.345 INFO:tasks.workunit.client.1.smithi098.stdout:3/204: write d6/d10/d19/f3a [2382364,66226] 0 2023-01-04T18:16:27.346 INFO:tasks.workunit.client.1.smithi098.stdout:8/138: write d6/f9 [2576022,36543] 0 2023-01-04T18:16:27.347 INFO:tasks.workunit.client.1.smithi098.stdout:2/206: unlink d6/dc/d2b/d42/d47/d1f/f23 0 2023-01-04T18:16:27.347 INFO:tasks.workunit.client.1.smithi098.stdout:2/207: truncate d6/dc/f12 4471656 0 2023-01-04T18:16:27.351 INFO:tasks.workunit.client.1.smithi098.stdout:6/146: creat d9/dd/d1f/f2a x:0 0 0 2023-01-04T18:16:27.353 INFO:tasks.workunit.client.1.smithi098.stdout:7/152: mknod d1/d23/d24/d26/c33 0 2023-01-04T18:16:27.354 INFO:tasks.workunit.client.1.smithi098.stdout:6/147: dread d9/dd/d1f/f27 [0,4194304] 0 2023-01-04T18:16:27.354 INFO:tasks.workunit.client.1.smithi098.stdout:6/148: chown d9/fa 200712 1 2023-01-04T18:16:27.354 INFO:tasks.workunit.client.1.smithi098.stdout:6/149: stat d9/dd/d24 0 2023-01-04T18:16:27.354 INFO:tasks.workunit.client.1.smithi098.stdout:6/150: chown d9/dd/de/f1e 2 1 2023-01-04T18:16:27.354 INFO:tasks.workunit.client.1.smithi098.stdout:5/161: sync 2023-01-04T18:16:27.355 INFO:tasks.workunit.client.1.smithi098.stdout:3/205: rmdir d6/d10/d19/d3f 39 2023-01-04T18:16:27.357 INFO:tasks.workunit.client.1.smithi098.stdout:8/139: link d6/dc/c21 d6/dc/d12/d1e/c26 0 2023-01-04T18:16:27.358 INFO:tasks.workunit.client.1.smithi098.stdout:4/152: dwrite d5/de/d21/f22 [0,4194304] 0 2023-01-04T18:16:27.358 INFO:tasks.workunit.client.1.smithi098.stdout:4/153: fdatasync d5/f8 0 2023-01-04T18:16:27.358 INFO:tasks.workunit.client.1.smithi098.stdout:2/208: truncate d6/dc/fe 80430 0 2023-01-04T18:16:27.359 INFO:tasks.workunit.client.1.smithi098.stdout:8/140: write d6/d11/f1a [3312625,4228] 0 2023-01-04T18:16:27.359 INFO:tasks.workunit.client.1.smithi098.stdout:8/141: readlink d6/l23 0 2023-01-04T18:16:27.360 INFO:tasks.workunit.client.1.smithi098.stdout:7/153: rename d1/d4/ff to d1/d23/d24/d26/d28/d2d/f34 0 2023-01-04T18:16:27.360 INFO:tasks.workunit.client.1.smithi098.stdout:5/162: creat d1/f2e x:0 0 0 2023-01-04T18:16:27.360 INFO:tasks.workunit.client.1.smithi098.stdout:3/206: creat d6/d10/d3b/f45 x:0 0 0 2023-01-04T18:16:27.361 INFO:tasks.workunit.client.1.smithi098.stdout:4/154: creat d5/de/d21/f2d x:0 0 0 2023-01-04T18:16:27.362 INFO:tasks.workunit.client.1.smithi098.stdout:2/209: creat d6/dc/d2b/d46/f48 x:0 0 0 2023-01-04T18:16:27.362 INFO:tasks.workunit.client.1.smithi098.stdout:2/210: fsync d6/dc/d2b/f36 0 2023-01-04T18:16:27.362 INFO:tasks.workunit.client.1.smithi098.stdout:2/211: truncate d6/dc/d2b/d32/f37 653979 0 2023-01-04T18:16:27.363 INFO:tasks.workunit.client.1.smithi098.stdout:8/142: symlink d6/d11/d15/d1b/l27 0 2023-01-04T18:16:27.363 INFO:tasks.workunit.client.1.smithi098.stdout:2/212: write f5 [5153661,47044] 0 2023-01-04T18:16:27.364 INFO:tasks.workunit.client.1.smithi098.stdout:5/163: rmdir d1/d2/d14/d24 0 2023-01-04T18:16:27.364 INFO:tasks.workunit.client.1.smithi098.stdout:3/207: mkdir d6/d10/d19/d3f/d46 0 2023-01-04T18:16:27.366 INFO:tasks.workunit.client.1.smithi098.stdout:4/155: getdents d5/d9/d13 0 2023-01-04T18:16:27.368 INFO:tasks.workunit.client.1.smithi098.stdout:8/143: link c5 d6/d11/d15/d1b/c28 0 2023-01-04T18:16:27.369 INFO:tasks.workunit.client.1.smithi098.stdout:2/213: creat d6/dc/d2b/d42/d47/d35/f49 x:0 0 0 2023-01-04T18:16:27.370 INFO:tasks.workunit.client.1.smithi098.stdout:4/156: creat d5/d9/d13/f2e x:0 0 0 2023-01-04T18:16:27.370 INFO:tasks.workunit.client.1.smithi098.stdout:2/214: creat d6/f4a x:0 0 0 2023-01-04T18:16:27.371 INFO:tasks.workunit.client.1.smithi098.stdout:5/164: mkdir d1/d2f 0 2023-01-04T18:16:27.372 INFO:tasks.workunit.client.1.smithi098.stdout:4/157: mknod d5/d9/c2f 0 2023-01-04T18:16:27.373 INFO:tasks.workunit.client.1.smithi098.stdout:5/165: symlink d1/d2/d14/l30 0 2023-01-04T18:16:27.375 INFO:tasks.workunit.client.1.smithi098.stdout:0/183: sync 2023-01-04T18:16:27.375 INFO:tasks.workunit.client.1.smithi098.stdout:7/154: dread d1/d23/f2c [0,4194304] 0 2023-01-04T18:16:27.376 INFO:tasks.workunit.client.1.smithi098.stdout:0/184: chown df/c16 184241 1 2023-01-04T18:16:27.376 INFO:tasks.workunit.client.1.smithi098.stdout:7/155: readlink d1/le 0 2023-01-04T18:16:27.376 INFO:tasks.workunit.client.1.smithi098.stdout:0/185: fsync f3 0 2023-01-04T18:16:27.376 INFO:tasks.workunit.client.1.smithi098.stdout:7/156: dread - d1/d23/d24/d26/f30 zero size 2023-01-04T18:16:27.376 INFO:tasks.workunit.client.1.smithi098.stdout:0/186: fsync df/d17/d1c/d2c/d41/f42 0 2023-01-04T18:16:27.376 INFO:tasks.workunit.client.1.smithi098.stdout:9/225: sync 2023-01-04T18:16:27.377 INFO:tasks.workunit.client.1.smithi098.stdout:9/226: write d2/d5/d18/d1d/f34 [696722,13319] 0 2023-01-04T18:16:27.378 INFO:tasks.workunit.client.1.smithi098.stdout:0/187: mknod df/d17/d1c/d2c/d41/c45 0 2023-01-04T18:16:27.378 INFO:tasks.workunit.client.1.smithi098.stdout:0/188: dread - df/d17/d24/f34 zero size 2023-01-04T18:16:27.379 INFO:tasks.workunit.client.1.smithi098.stdout:4/158: dread d5/f12 [0,4194304] 0 2023-01-04T18:16:27.381 INFO:tasks.workunit.client.1.smithi098.stdout:6/151: dwrite d9/dd/d1f/f2a [0,4194304] 0 2023-01-04T18:16:27.381 INFO:tasks.workunit.client.1.smithi098.stdout:6/152: readlink d9/dd/l10 0 2023-01-04T18:16:27.382 INFO:tasks.workunit.client.1.smithi098.stdout:6/153: read - d9/dd/de/f21 zero size 2023-01-04T18:16:27.382 INFO:tasks.workunit.client.1.smithi098.stdout:4/159: getdents d5/d28 0 2023-01-04T18:16:27.390 INFO:tasks.workunit.client.1.smithi098.stdout:6/154: unlink d9/fc 0 2023-01-04T18:16:27.392 INFO:tasks.workunit.client.1.smithi098.stdout:4/160: mkdir d5/de/d30 0 2023-01-04T18:16:27.393 INFO:tasks.workunit.client.1.smithi098.stdout:4/161: write d5/d9/f1a [129264,77102] 0 2023-01-04T18:16:27.393 INFO:tasks.workunit.client.1.smithi098.stdout:4/162: getdents d5/d28 0 2023-01-04T18:16:27.393 INFO:tasks.workunit.client.1.smithi098.stdout:4/163: fsync d5/f8 0 2023-01-04T18:16:27.400 INFO:tasks.workunit.client.1.smithi098.stdout:5/166: write d1/d2/d14/f23 [1598920,80566] 0 2023-01-04T18:16:27.410 INFO:tasks.workunit.client.1.smithi098.stdout:8/144: dread d6/f9 [0,4194304] 0 2023-01-04T18:16:27.412 INFO:tasks.workunit.client.1.smithi098.stdout:8/145: link d6/d11/f1a d6/dc/f29 0 2023-01-04T18:16:27.413 INFO:tasks.workunit.client.1.smithi098.stdout:8/146: mkdir d6/d11/d15/d1b/d2a 0 2023-01-04T18:16:27.415 INFO:tasks.workunit.client.1.smithi098.stdout:8/147: creat d6/dc/d12/d1e/f2b x:0 0 0 2023-01-04T18:16:27.416 INFO:tasks.workunit.client.1.smithi098.stdout:8/148: symlink d6/d11/d15/d1b/d2a/l2c 0 2023-01-04T18:16:27.418 INFO:tasks.workunit.client.1.smithi098.stdout:8/149: dread d6/f9 [0,4194304] 0 2023-01-04T18:16:27.419 INFO:tasks.workunit.client.1.smithi098.stdout:8/150: chown d6/d11/d15/d1b/c25 277 1 2023-01-04T18:16:27.420 INFO:tasks.workunit.client.1.smithi098.stdout:6/155: dwrite d9/dd/d15/f1a [0,4194304] 0 2023-01-04T18:16:27.420 INFO:tasks.workunit.client.1.smithi098.stdout:6/156: write d9/dd/de/f21 [1004867,3036] 0 2023-01-04T18:16:27.420 INFO:tasks.workunit.client.1.smithi098.stdout:8/151: link d6/d11/d15/d1b/c28 d6/d11/d15/c2d 0 2023-01-04T18:16:27.421 INFO:tasks.workunit.client.1.smithi098.stdout:8/152: write d6/d11/d15/f1f [621153,62459] 0 2023-01-04T18:16:27.422 INFO:tasks.workunit.client.1.smithi098.stdout:3/208: dwrite d6/d10/d19/f3a [0,4194304] 0 2023-01-04T18:16:27.422 INFO:tasks.workunit.client.1.smithi098.stdout:2/215: dwrite d6/dc/d2b/d42/d47/d1f/f30 [0,4194304] 0 2023-01-04T18:16:27.422 INFO:tasks.workunit.client.1.smithi098.stdout:8/153: write d6/fe [607025,13111] 0 2023-01-04T18:16:27.422 INFO:tasks.workunit.client.1.smithi098.stdout:8/154: chown d6/dc/d12/d1e/f2b 241195011 1 2023-01-04T18:16:27.422 INFO:tasks.workunit.client.1.smithi098.stdout:8/155: write d6/dc/f18 [1361960,49523] 0 2023-01-04T18:16:27.423 INFO:tasks.workunit.client.1.smithi098.stdout:6/157: rename d9/l1c to d9/dd/d15/l2b 0 2023-01-04T18:16:27.423 INFO:tasks.workunit.client.1.smithi098.stdout:7/157: dwrite d1/f7 [4194304,4194304] 0 2023-01-04T18:16:27.423 INFO:tasks.workunit.client.1.smithi098.stdout:7/158: fsync d1/d23/f17 0 2023-01-04T18:16:27.423 INFO:tasks.workunit.client.1.smithi098.stdout:6/158: write d9/dd/d1f/f27 [438829,116597] 0 2023-01-04T18:16:27.424 INFO:tasks.workunit.client.1.smithi098.stdout:8/156: write d6/d11/f1a [2555040,12807] 0 2023-01-04T18:16:27.424 INFO:tasks.workunit.client.1.smithi098.stdout:4/164: dwrite d5/f1b [0,4194304] 0 2023-01-04T18:16:27.425 INFO:tasks.workunit.client.1.smithi098.stdout:5/167: getdents d1 0 2023-01-04T18:16:27.428 INFO:tasks.workunit.client.1.smithi098.stdout:3/209: creat d6/d10/d19/d3f/f47 x:0 0 0 2023-01-04T18:16:27.435 INFO:tasks.workunit.client.1.smithi098.stdout:6/159: dread d9/dd/de/f21 [0,4194304] 0 2023-01-04T18:16:27.435 INFO:tasks.workunit.client.1.smithi098.stdout:7/159: unlink d1/d23/d24/f1f 0 2023-01-04T18:16:27.441 INFO:tasks.workunit.client.1.smithi098.stdout:4/165: creat d5/de/f31 x:0 0 0 2023-01-04T18:16:27.442 INFO:tasks.workunit.client.1.smithi098.stdout:5/168: symlink d1/d2f/l31 0 2023-01-04T18:16:27.442 INFO:tasks.workunit.client.1.smithi098.stdout:3/210: creat d6/d10/d3b/f48 x:0 0 0 2023-01-04T18:16:27.444 INFO:tasks.workunit.client.1.smithi098.stdout:2/216: dwrite d6/dc/fe [0,4194304] 0 2023-01-04T18:16:27.444 INFO:tasks.workunit.client.1.smithi098.stdout:6/160: rename d9/dd/de/l19 to d9/l2c 0 2023-01-04T18:16:27.444 INFO:tasks.workunit.client.1.smithi098.stdout:6/161: fdatasync d9/dd/d1f/f2a 0 2023-01-04T18:16:27.444 INFO:tasks.workunit.client.1.smithi098.stdout:6/162: stat d9/dd/de 0 2023-01-04T18:16:27.445 INFO:tasks.workunit.client.1.smithi098.stdout:6/163: write d9/dd/d15/f1a [1184544,120844] 0 2023-01-04T18:16:27.445 INFO:tasks.workunit.client.1.smithi098.stdout:7/160: unlink d1/le 0 2023-01-04T18:16:27.446 INFO:tasks.workunit.client.1.smithi098.stdout:4/166: mkdir d5/de/d2c/d32 0 2023-01-04T18:16:27.447 INFO:tasks.workunit.client.1.smithi098.stdout:5/169: truncate d1/d2/f17 4088676 0 2023-01-04T18:16:27.447 INFO:tasks.workunit.client.1.smithi098.stdout:8/157: dwrite d6/dc/f18 [0,4194304] 0 2023-01-04T18:16:27.447 INFO:tasks.workunit.client.1.smithi098.stdout:3/211: stat d6/d10/d19/l24 0 2023-01-04T18:16:27.447 INFO:tasks.workunit.client.1.smithi098.stdout:2/217: dread d6/f11 [0,4194304] 0 2023-01-04T18:16:27.448 INFO:tasks.workunit.client.1.smithi098.stdout:9/227: dwrite d2/d5/d18/d1d/f34 [0,4194304] 0 2023-01-04T18:16:27.448 INFO:tasks.workunit.client.1.smithi098.stdout:8/158: read d6/fe [1333146,10792] 0 2023-01-04T18:16:27.448 INFO:tasks.workunit.client.1.smithi098.stdout:8/159: readlink d6/d11/d15/l16 0 2023-01-04T18:16:27.449 INFO:tasks.workunit.client.1.smithi098.stdout:6/164: creat d9/dd/d15/f2d x:0 0 0 2023-01-04T18:16:27.449 INFO:tasks.workunit.client.1.smithi098.stdout:7/161: creat d1/d2e/f35 x:0 0 0 2023-01-04T18:16:27.449 INFO:tasks.workunit.client.1.smithi098.stdout:7/162: fdatasync d1/da/f1a 0 2023-01-04T18:16:27.455 INFO:tasks.workunit.client.1.smithi098.stdout:4/167: creat d5/d9/d13/f33 x:0 0 0 2023-01-04T18:16:27.456 INFO:tasks.workunit.client.1.smithi098.stdout:5/170: mkdir d1/d2/d32 0 2023-01-04T18:16:27.456 INFO:tasks.workunit.client.1.smithi098.stdout:4/168: fdatasync d5/de/d21/f22 0 2023-01-04T18:16:27.456 INFO:tasks.workunit.client.1.smithi098.stdout:4/169: chown d5/c6 74273 1 2023-01-04T18:16:27.459 INFO:tasks.workunit.client.1.smithi098.stdout:3/212: mknod d6/c49 0 2023-01-04T18:16:27.459 INFO:tasks.workunit.client.1.smithi098.stdout:3/213: chown d6/d10/d3b/f3c 2287 1 2023-01-04T18:16:27.459 INFO:tasks.workunit.client.1.smithi098.stdout:1/140: sync 2023-01-04T18:16:27.462 INFO:tasks.workunit.client.1.smithi098.stdout:2/218: mkdir d6/dc/d4b 0 2023-01-04T18:16:27.464 INFO:tasks.workunit.client.1.smithi098.stdout:8/160: creat d6/dc/f2e x:0 0 0 2023-01-04T18:16:27.468 INFO:tasks.workunit.client.1.smithi098.stdout:6/165: creat d9/dd/de/d26/f2e x:0 0 0 2023-01-04T18:16:27.468 INFO:tasks.workunit.client.1.smithi098.stdout:6/166: stat d9/dd/de/d20 0 2023-01-04T18:16:27.468 INFO:tasks.workunit.client.1.smithi098.stdout:7/163: mknod d1/d23/d24/c36 0 2023-01-04T18:16:27.468 INFO:tasks.workunit.client.1.smithi098.stdout:9/228: dwrite d2/d5/d18/d1d/f2f [0,4194304] 0 2023-01-04T18:16:27.470 INFO:tasks.workunit.client.1.smithi098.stdout:5/171: link d1/d2/d14/f2d d1/da/f33 0 2023-01-04T18:16:27.470 INFO:tasks.workunit.client.1.smithi098.stdout:8/161: read d6/fe [256702,126393] 0 2023-01-04T18:16:27.471 INFO:tasks.workunit.client.1.smithi098.stdout:4/170: symlink d5/de/d2c/l34 0 2023-01-04T18:16:27.471 INFO:tasks.workunit.client.1.smithi098.stdout:4/171: dread - d5/de/f31 zero size 2023-01-04T18:16:27.473 INFO:tasks.workunit.client.1.smithi098.stdout:1/141: dread f0 [0,4194304] 0 2023-01-04T18:16:27.473 INFO:tasks.workunit.client.1.smithi098.stdout:3/214: symlink d6/l4a 0 2023-01-04T18:16:27.474 INFO:tasks.workunit.client.1.smithi098.stdout:9/229: mknod d2/c49 0 2023-01-04T18:16:27.477 INFO:tasks.workunit.client.1.smithi098.stdout:5/172: creat d1/da/f34 x:0 0 0 2023-01-04T18:16:27.477 INFO:tasks.workunit.client.1.smithi098.stdout:5/173: readlink d1/d2/l4 0 2023-01-04T18:16:27.478 INFO:tasks.workunit.client.1.smithi098.stdout:8/162: mknod d6/d11/d15/d1b/c2f 0 2023-01-04T18:16:27.479 INFO:tasks.workunit.client.1.smithi098.stdout:4/172: getdents d5/de 0 2023-01-04T18:16:27.480 INFO:tasks.workunit.client.1.smithi098.stdout:1/142: rename d1/d8/da/c23 to d1/d8/da/d12/c32 0 2023-01-04T18:16:27.482 INFO:tasks.workunit.client.1.smithi098.stdout:3/215: rmdir d6/d10 39 2023-01-04T18:16:27.483 INFO:tasks.workunit.client.1.smithi098.stdout:3/216: fdatasync d6/f21 0 2023-01-04T18:16:27.483 INFO:tasks.workunit.client.1.smithi098.stdout:3/217: chown d6/f25 7391489 1 2023-01-04T18:16:27.484 INFO:tasks.workunit.client.1.smithi098.stdout:2/219: dwrite d6/f4a [0,4194304] 0 2023-01-04T18:16:27.484 INFO:tasks.workunit.client.1.smithi098.stdout:9/230: creat d2/d5/d18/d19/d2a/d2e/d26/f4a x:0 0 0 2023-01-04T18:16:27.485 INFO:tasks.workunit.client.1.smithi098.stdout:5/174: creat d1/d2/d14/d19/f35 x:0 0 0 2023-01-04T18:16:27.487 INFO:tasks.workunit.client.1.smithi098.stdout:1/143: write d1/f1f [1222789,37412] 0 2023-01-04T18:16:27.487 INFO:tasks.workunit.client.1.smithi098.stdout:7/164: dwrite d1/d23/d24/d26/d28/d2d/f32 [0,4194304] 0 2023-01-04T18:16:27.488 INFO:tasks.workunit.client.1.smithi098.stdout:8/163: rename d6/l23 to d6/d11/d15/d1b/d2a/l30 0 2023-01-04T18:16:27.488 INFO:tasks.workunit.client.1.smithi098.stdout:8/164: dread - d6/dc/f2e zero size 2023-01-04T18:16:27.488 INFO:tasks.workunit.client.1.smithi098.stdout:8/165: readlink d6/d11/d15/d1b/d2a/l2c 0 2023-01-04T18:16:27.489 INFO:tasks.workunit.client.1.smithi098.stdout:1/144: write d1/d8/da/d12/f2b [960567,15093] 0 2023-01-04T18:16:27.489 INFO:tasks.workunit.client.1.smithi098.stdout:1/145: write d1/fc [4864206,105995] 0 2023-01-04T18:16:27.489 INFO:tasks.workunit.client.1.smithi098.stdout:8/166: write d6/fe [808854,40349] 0 2023-01-04T18:16:27.489 INFO:tasks.workunit.client.1.smithi098.stdout:1/146: write d1/d25/f29 [3863151,63091] 0 2023-01-04T18:16:27.491 INFO:tasks.workunit.client.1.smithi098.stdout:3/218: unlink d6/l11 0 2023-01-04T18:16:27.500 INFO:tasks.workunit.client.1.smithi098.stdout:9/231: creat d2/d5/d18/d19/f4b x:0 0 0 2023-01-04T18:16:27.501 INFO:tasks.workunit.client.1.smithi098.stdout:5/175: symlink d1/d2/l36 0 2023-01-04T18:16:27.501 INFO:tasks.workunit.client.1.smithi098.stdout:5/176: dread - d1/da/f34 zero size 2023-01-04T18:16:27.502 INFO:tasks.workunit.client.1.smithi098.stdout:2/220: rename d6/dc/d2b/d42/d47/d1f/c3f to d6/dc/d2b/d42/d47/c4c 0 2023-01-04T18:16:27.503 INFO:tasks.workunit.client.1.smithi098.stdout:7/165: mkdir d1/d23/d37 0 2023-01-04T18:16:27.503 INFO:tasks.workunit.client.1.smithi098.stdout:7/166: chown d1/d23/d24/d26/d28/d2d/f32 310429 1 2023-01-04T18:16:27.504 INFO:tasks.workunit.client.1.smithi098.stdout:1/147: mknod d1/d8/c33 0 2023-01-04T18:16:27.504 INFO:tasks.workunit.client.1.smithi098.stdout:1/148: stat d1/f1f 0 2023-01-04T18:16:27.505 INFO:tasks.workunit.client.1.smithi098.stdout:9/232: mknod d2/d5/d18/d19/d2a/c4c 0 2023-01-04T18:16:27.505 INFO:tasks.workunit.client.1.smithi098.stdout:1/149: write d1/d8/f10 [320158,79242] 0 2023-01-04T18:16:27.505 INFO:tasks.workunit.client.1.smithi098.stdout:5/177: rmdir d1 39 2023-01-04T18:16:27.506 INFO:tasks.workunit.client.1.smithi098.stdout:2/221: chown d6/f10 55 1 2023-01-04T18:16:27.506 INFO:tasks.workunit.client.1.smithi098.stdout:2/222: dread - d6/dc/d2b/d42/d47/f41 zero size 2023-01-04T18:16:27.506 INFO:tasks.workunit.client.1.smithi098.stdout:2/223: getdents d6/dc/d2b/d42/d47/d1f/d39 0 2023-01-04T18:16:27.507 INFO:tasks.workunit.client.1.smithi098.stdout:7/167: creat d1/d4/d11/f38 x:0 0 0 2023-01-04T18:16:27.507 INFO:tasks.workunit.client.1.smithi098.stdout:7/168: dread - d1/d23/d24/d26/f30 zero size 2023-01-04T18:16:27.508 INFO:tasks.workunit.client.1.smithi098.stdout:9/233: creat d2/d5/d18/d19/d2a/d2e/f4d x:0 0 0 2023-01-04T18:16:27.508 INFO:tasks.workunit.client.1.smithi098.stdout:9/234: chown d2/d5/d18/d19/d2a/d2e/d26/d41 9128 1 2023-01-04T18:16:27.509 INFO:tasks.workunit.client.1.smithi098.stdout:2/224: write d6/dc/d2b/f36 [1941309,106478] 0 2023-01-04T18:16:27.509 INFO:tasks.workunit.client.1.smithi098.stdout:2/225: write d6/f11 [3025214,49656] 0 2023-01-04T18:16:27.510 INFO:tasks.workunit.client.1.smithi098.stdout:4/173: dwrite d5/d28/f2b [0,4194304] 0 2023-01-04T18:16:27.510 INFO:tasks.workunit.client.1.smithi098.stdout:4/174: chown d5/de/d30 89391 1 2023-01-04T18:16:27.510 INFO:tasks.workunit.client.1.smithi098.stdout:4/175: chown d5 50356 1 2023-01-04T18:16:27.511 INFO:tasks.workunit.client.1.smithi098.stdout:5/178: truncate d1/d2/f17 2702627 0 2023-01-04T18:16:27.511 INFO:tasks.workunit.client.1.smithi098.stdout:5/179: write d1/f1d [2532316,2508] 0 2023-01-04T18:16:27.511 INFO:tasks.workunit.client.1.smithi098.stdout:7/169: creat d1/d2e/f39 x:0 0 0 2023-01-04T18:16:27.511 INFO:tasks.workunit.client.1.smithi098.stdout:7/170: chown d1/da/f16 1 1 2023-01-04T18:16:27.512 INFO:tasks.workunit.client.1.smithi098.stdout:9/235: unlink d2/d5/d18/f1a 0 2023-01-04T18:16:27.514 INFO:tasks.workunit.client.1.smithi098.stdout:8/167: dwrite d6/dc/f18 [0,4194304] 0 2023-01-04T18:16:27.514 INFO:tasks.workunit.client.1.smithi098.stdout:8/168: write d6/f9 [7059442,101376] 0 2023-01-04T18:16:27.515 INFO:tasks.workunit.client.1.smithi098.stdout:3/219: dwrite d6/d10/d19/d3f/f2f [0,4194304] 0 2023-01-04T18:16:27.515 INFO:tasks.workunit.client.1.smithi098.stdout:8/169: write d6/fe [2126244,65776] 0 2023-01-04T18:16:27.515 INFO:tasks.workunit.client.1.smithi098.stdout:8/170: write d6/d11/d15/f1f [1120650,100327] 0 2023-01-04T18:16:27.515 INFO:tasks.workunit.client.1.smithi098.stdout:8/171: readlink d6/dc/d12/l1c 0 2023-01-04T18:16:27.515 INFO:tasks.workunit.client.1.smithi098.stdout:8/172: write d6/fe [3059438,106013] 0 2023-01-04T18:16:27.518 INFO:tasks.workunit.client.1.smithi098.stdout:8/173: write d6/dc/f18 [3272499,83560] 0 2023-01-04T18:16:27.518 INFO:tasks.workunit.client.1.smithi098.stdout:4/176: symlink d5/d9/d13/l35 0 2023-01-04T18:16:27.520 INFO:tasks.workunit.client.1.smithi098.stdout:5/180: creat d1/da/f37 x:0 0 0 2023-01-04T18:16:27.520 INFO:tasks.workunit.client.1.smithi098.stdout:5/181: fdatasync d1/da/f34 0 2023-01-04T18:16:27.520 INFO:tasks.workunit.client.1.smithi098.stdout:5/182: chown d1/f2e 1538306725 1 2023-01-04T18:16:27.522 INFO:tasks.workunit.client.1.smithi098.stdout:7/171: mknod d1/d2e/c3a 0 2023-01-04T18:16:27.522 INFO:tasks.workunit.client.1.smithi098.stdout:7/172: write d1/d23/d24/d26/f30 [458863,74891] 0 2023-01-04T18:16:27.523 INFO:tasks.workunit.client.1.smithi098.stdout:0/189: sync 2023-01-04T18:16:27.523 INFO:tasks.workunit.client.1.smithi098.stdout:2/226: dread d6/dc/f12 [0,4194304] 0 2023-01-04T18:16:27.523 INFO:tasks.workunit.client.1.smithi098.stdout:2/227: chown d6/dc/d2b 120423185 1 2023-01-04T18:16:27.524 INFO:tasks.workunit.client.1.smithi098.stdout:1/150: rmdir d1/d8 39 2023-01-04T18:16:27.524 INFO:tasks.workunit.client.1.smithi098.stdout:1/151: write d1/d8/da/f19 [4367590,107164] 0 2023-01-04T18:16:27.524 INFO:tasks.workunit.client.1.smithi098.stdout:1/152: read - d1/f30 zero size 2023-01-04T18:16:27.525 INFO:tasks.workunit.client.1.smithi098.stdout:3/220: dread d6/d10/f1b [0,4194304] 0 2023-01-04T18:16:27.528 INFO:tasks.workunit.client.1.smithi098.stdout:4/177: unlink d5/de/f11 0 2023-01-04T18:16:27.529 INFO:tasks.workunit.client.1.smithi098.stdout:7/173: dread d1/d23/d24/d26/f30 [0,4194304] 0 2023-01-04T18:16:27.529 INFO:tasks.workunit.client.1.smithi098.stdout:7/174: write d1/d23/d24/f19 [553701,9888] 0 2023-01-04T18:16:27.530 INFO:tasks.workunit.client.1.smithi098.stdout:9/236: rename d2/d5/d18/d19/d2a to d2/d5/d18/d4e 0 2023-01-04T18:16:27.532 INFO:tasks.workunit.client.1.smithi098.stdout:8/174: dread d6/dc/f18 [0,4194304] 0 2023-01-04T18:16:27.533 INFO:tasks.workunit.client.1.smithi098.stdout:0/190: unlink df/d17/d1c/f3c 0 2023-01-04T18:16:27.534 INFO:tasks.workunit.client.1.smithi098.stdout:0/191: write df/d17/f2a [362237,2271] 0 2023-01-04T18:16:27.548 INFO:tasks.workunit.client.1.smithi098.stdout:9/237: symlink d2/d2d/l4f 0 2023-01-04T18:16:27.548 INFO:tasks.workunit.client.1.smithi098.stdout:9/238: stat d2/d5/d18/d4e/d2e/d26/f4a 0 2023-01-04T18:16:27.548 INFO:tasks.workunit.client.1.smithi098.stdout:9/239: write d2/d5/d18/d4e/d2e/f4d [719581,8215] 0 2023-01-04T18:16:27.549 INFO:tasks.workunit.client.1.smithi098.stdout:4/178: creat d5/d9/f36 x:0 0 0 2023-01-04T18:16:27.549 INFO:tasks.workunit.client.1.smithi098.stdout:4/179: write d5/de/f29 [811767,115768] 0 2023-01-04T18:16:27.549 INFO:tasks.workunit.client.1.smithi098.stdout:4/180: dread - d5/de/d21/f2d zero size 2023-01-04T18:16:27.550 INFO:tasks.workunit.client.1.smithi098.stdout:2/228: dread d6/f10 [0,4194304] 0 2023-01-04T18:16:27.550 INFO:tasks.workunit.client.1.smithi098.stdout:1/153: getdents d1/d8 0 2023-01-04T18:16:27.552 INFO:tasks.workunit.client.1.smithi098.stdout:3/221: dwrite d6/d10/d19/d3f/f30 [0,4194304] 0 2023-01-04T18:16:27.554 INFO:tasks.workunit.client.1.smithi098.stdout:5/183: dwrite d1/f1d [0,4194304] 0 2023-01-04T18:16:27.557 INFO:tasks.workunit.client.1.smithi098.stdout:4/181: creat d5/f37 x:0 0 0 2023-01-04T18:16:27.559 INFO:tasks.workunit.client.1.smithi098.stdout:2/229: mknod d6/dc/d2b/d42/d47/c4d 0 2023-01-04T18:16:27.559 INFO:tasks.workunit.client.1.smithi098.stdout:2/230: dread - d6/dc/d2b/d42/d47/d1f/f24 zero size 2023-01-04T18:16:27.559 INFO:tasks.workunit.client.1.smithi098.stdout:6/167: sync 2023-01-04T18:16:27.560 INFO:tasks.workunit.client.1.smithi098.stdout:6/168: write d9/dd/f11 [1072556,92633] 0 2023-01-04T18:16:27.560 INFO:tasks.workunit.client.1.smithi098.stdout:1/154: getdents d1/d25/d27 0 2023-01-04T18:16:27.561 INFO:tasks.workunit.client.1.smithi098.stdout:0/192: dwrite df/d17/d24/f2e [0,4194304] 0 2023-01-04T18:16:27.566 INFO:tasks.workunit.client.1.smithi098.stdout:5/184: mkdir d1/d38 0 2023-01-04T18:16:27.567 INFO:tasks.workunit.client.1.smithi098.stdout:4/182: unlink d5/d9/d13/l1f 0 2023-01-04T18:16:27.568 INFO:tasks.workunit.client.1.smithi098.stdout:2/231: getdents d6/dc 0 2023-01-04T18:16:27.571 INFO:tasks.workunit.client.1.smithi098.stdout:6/169: truncate d9/dd/de/f21 735165 0 2023-01-04T18:16:27.573 INFO:tasks.workunit.client.1.smithi098.stdout:1/155: rename d1/d25/d27/f2d to d1/d25/d27/f34 0 2023-01-04T18:16:27.573 INFO:tasks.workunit.client.1.smithi098.stdout:1/156: write d1/f22 [318841,23874] 0 2023-01-04T18:16:27.574 INFO:tasks.workunit.client.1.smithi098.stdout:3/222: dwrite d6/f15 [0,4194304] 0 2023-01-04T18:16:27.574 INFO:tasks.workunit.client.1.smithi098.stdout:3/223: stat d6/cb 0 2023-01-04T18:16:27.574 INFO:tasks.workunit.client.1.smithi098.stdout:3/224: dread - d6/d10/d29/f34 zero size 2023-01-04T18:16:27.575 INFO:tasks.workunit.client.1.smithi098.stdout:5/185: rename d1/f1b to d1/d2/d32/f39 0 2023-01-04T18:16:27.577 INFO:tasks.workunit.client.1.smithi098.stdout:5/186: write d1/d2/f17 [42948,24563] 0 2023-01-04T18:16:27.578 INFO:tasks.workunit.client.1.smithi098.stdout:0/193: dwrite df/d17/f2a [0,4194304] 0 2023-01-04T18:16:27.578 INFO:tasks.workunit.client.1.smithi098.stdout:4/183: rmdir d5/de/d2c/d32 0 2023-01-04T18:16:27.579 INFO:tasks.workunit.client.1.smithi098.stdout:2/232: symlink d6/dc/d2b/d32/l4e 0 2023-01-04T18:16:27.579 INFO:tasks.workunit.client.1.smithi098.stdout:0/194: write df/d17/f2a [1324547,48661] 0 2023-01-04T18:16:27.580 INFO:tasks.workunit.client.1.smithi098.stdout:4/184: write f4 [445654,41050] 0 2023-01-04T18:16:27.582 INFO:tasks.workunit.client.1.smithi098.stdout:6/170: mknod d9/c2f 0 2023-01-04T18:16:27.584 INFO:tasks.workunit.client.1.smithi098.stdout:3/225: chown d6/d10/d19/l35 8 1 2023-01-04T18:16:27.584 INFO:tasks.workunit.client.1.smithi098.stdout:3/226: write d6/d10/d29/f2d [790460,128759] 0 2023-01-04T18:16:27.588 INFO:tasks.workunit.client.1.smithi098.stdout:2/233: symlink d6/dc/d2b/d42/d47/d1f/l4f 0 2023-01-04T18:16:27.588 INFO:tasks.workunit.client.1.smithi098.stdout:0/195: truncate df/f38 3913474 0 2023-01-04T18:16:27.590 INFO:tasks.workunit.client.1.smithi098.stdout:3/227: mknod d6/d10/d29/c4b 0 2023-01-04T18:16:27.590 INFO:tasks.workunit.client.1.smithi098.stdout:6/171: creat d9/dd/d24/f30 x:0 0 0 2023-01-04T18:16:27.590 INFO:tasks.workunit.client.1.smithi098.stdout:0/196: write df/d17/d1c/f1e [2248217,54517] 0 2023-01-04T18:16:27.591 INFO:tasks.workunit.client.1.smithi098.stdout:0/197: rename df/d17/d1c to df/d17/d1c/d3b/d46 22 2023-01-04T18:16:27.591 INFO:tasks.workunit.client.1.smithi098.stdout:4/185: dread d5/f1b [0,4194304] 0 2023-01-04T18:16:27.591 INFO:tasks.workunit.client.1.smithi098.stdout:0/198: read df/d17/d24/f2e [3313666,76538] 0 2023-01-04T18:16:27.591 INFO:tasks.workunit.client.1.smithi098.stdout:6/172: rmdir d9/dd/d15 39 2023-01-04T18:16:27.593 INFO:tasks.workunit.client.1.smithi098.stdout:3/228: mkdir d6/d4c 0 2023-01-04T18:16:27.595 INFO:tasks.workunit.client.1.smithi098.stdout:5/187: dwrite d1/d2/d14/d19/f25 [0,4194304] 0 2023-01-04T18:16:27.598 INFO:tasks.workunit.client.1.smithi098.stdout:4/186: link d5/d9/d13/f33 d5/f38 0 2023-01-04T18:16:27.602 INFO:tasks.workunit.client.1.smithi098.stdout:0/199: creat df/d17/d1c/f47 x:0 0 0 2023-01-04T18:16:27.603 INFO:tasks.workunit.client.1.smithi098.stdout:2/234: dwrite d6/f11 [0,4194304] 0 2023-01-04T18:16:27.607 INFO:tasks.workunit.client.1.smithi098.stdout:6/173: rename d9/l2c to d9/dd/d15/l31 0 2023-01-04T18:16:27.607 INFO:tasks.workunit.client.1.smithi098.stdout:3/229: getdents d6/d10/d3b 0 2023-01-04T18:16:27.607 INFO:tasks.workunit.client.1.smithi098.stdout:3/230: readlink d6/d10/d19/l35 0 2023-01-04T18:16:27.610 INFO:tasks.workunit.client.1.smithi098.stdout:5/188: mkdir d1/d2/d3a 0 2023-01-04T18:16:27.610 INFO:tasks.workunit.client.1.smithi098.stdout:4/187: unlink d5/d9/d13/f14 0 2023-01-04T18:16:27.610 INFO:tasks.workunit.client.1.smithi098.stdout:0/200: mknod df/d40/c48 0 2023-01-04T18:16:27.616 INFO:tasks.workunit.client.1.smithi098.stdout:2/235: getdents d6/dc/d2b/d42/d47/d31 0 2023-01-04T18:16:27.616 INFO:tasks.workunit.client.1.smithi098.stdout:2/236: chown d6/dc/l19 76 1 2023-01-04T18:16:27.617 INFO:tasks.workunit.client.1.smithi098.stdout:6/174: mknod d9/c32 0 2023-01-04T18:16:27.617 INFO:tasks.workunit.client.1.smithi098.stdout:6/175: dread - d9/dd/de/d26/f2e zero size 2023-01-04T18:16:27.618 INFO:tasks.workunit.client.1.smithi098.stdout:6/176: write d9/fa [4698983,72321] 0 2023-01-04T18:16:27.618 INFO:tasks.workunit.client.1.smithi098.stdout:6/177: truncate d9/dd/d15/f2d 1016658 0 2023-01-04T18:16:27.619 INFO:tasks.workunit.client.1.smithi098.stdout:2/237: symlink d6/dc/d2b/d42/d47/d31/l50 0 2023-01-04T18:16:27.619 INFO:tasks.workunit.client.1.smithi098.stdout:2/238: write d6/f10 [914078,129237] 0 2023-01-04T18:16:27.619 INFO:tasks.workunit.client.1.smithi098.stdout:2/239: truncate d6/dc/d2b/d42/d47/f41 1034110 0 2023-01-04T18:16:27.619 INFO:tasks.workunit.client.1.smithi098.stdout:2/240: dread - d6/dc/d2b/d32/f3b zero size 2023-01-04T18:16:27.619 INFO:tasks.workunit.client.1.smithi098.stdout:0/201: mkdir df/d17/d1c/d49 0 2023-01-04T18:16:27.623 INFO:tasks.workunit.client.1.smithi098.stdout:0/202: mkdir df/d17/d1c/d2c/d41/d4a 0 2023-01-04T18:16:27.623 INFO:tasks.workunit.client.1.smithi098.stdout:2/241: mkdir d6/dc/d2b/d42/d51 0 2023-01-04T18:16:27.623 INFO:tasks.workunit.client.1.smithi098.stdout:2/242: dread - d6/dc/d2b/d46/f48 zero size 2023-01-04T18:16:27.623 INFO:tasks.workunit.client.1.smithi098.stdout:2/243: write d6/dc/d2b/f2e [1660095,29483] 0 2023-01-04T18:16:27.625 INFO:tasks.workunit.client.1.smithi098.stdout:0/203: rmdir df/d17/d1c/d49 0 2023-01-04T18:16:27.625 INFO:tasks.workunit.client.1.smithi098.stdout:0/204: chown df/d17/d24/f44 17932601 1 2023-01-04T18:16:27.626 INFO:tasks.workunit.client.1.smithi098.stdout:2/244: mknod d6/c52 0 2023-01-04T18:16:27.626 INFO:tasks.workunit.client.1.smithi098.stdout:3/231: dread d6/fa [0,4194304] 0 2023-01-04T18:16:27.627 INFO:tasks.workunit.client.1.smithi098.stdout:3/232: creat d6/d10/d29/f4d x:0 0 0 2023-01-04T18:16:27.631 INFO:tasks.workunit.client.1.smithi098.stdout:3/233: write d6/f25 [1703990,84298] 0 2023-01-04T18:16:27.632 INFO:tasks.workunit.client.1.smithi098.stdout:3/234: creat d6/d10/f4e x:0 0 0 2023-01-04T18:16:27.637 INFO:tasks.workunit.client.1.smithi098.stdout:3/235: dread d6/f15 [0,4194304] 0 2023-01-04T18:16:27.639 INFO:tasks.workunit.client.1.smithi098.stdout:3/236: mknod d6/d10/c4f 0 2023-01-04T18:16:27.640 INFO:tasks.workunit.client.1.smithi098.stdout:3/237: creat d6/d10/f50 x:0 0 0 2023-01-04T18:16:27.641 INFO:tasks.workunit.client.1.smithi098.stdout:3/238: symlink d6/d4c/l51 0 2023-01-04T18:16:27.641 INFO:tasks.workunit.client.1.smithi098.stdout:3/239: chown d6/d10/c4f 0 1 2023-01-04T18:16:27.642 INFO:tasks.workunit.client.1.smithi098.stdout:3/240: creat d6/d10/d3b/f52 x:0 0 0 2023-01-04T18:16:27.643 INFO:tasks.workunit.client.1.smithi098.stdout:3/241: rename d6/d10/f4e to d6/f53 0 2023-01-04T18:16:27.643 INFO:tasks.workunit.client.1.smithi098.stdout:3/242: fdatasync d6/d10/d29/f34 0 2023-01-04T18:16:27.644 INFO:tasks.workunit.client.1.smithi098.stdout:3/243: creat d6/f54 x:0 0 0 2023-01-04T18:16:27.644 INFO:tasks.workunit.client.1.smithi098.stdout:3/244: chown d6/f54 2818 1 2023-01-04T18:16:27.644 INFO:tasks.workunit.client.1.smithi098.stdout:3/245: truncate d6/d10/f32 584725 0 2023-01-04T18:16:27.645 INFO:tasks.workunit.client.1.smithi098.stdout:3/246: truncate d6/d10/f1b 4631975 0 2023-01-04T18:16:27.645 INFO:tasks.workunit.client.1.smithi098.stdout:3/247: dread - d6/d10/d3b/f45 zero size 2023-01-04T18:16:27.646 INFO:tasks.workunit.client.1.smithi098.stdout:3/248: truncate d6/d10/d19/d3f/f30 2536090 0 2023-01-04T18:16:27.649 INFO:tasks.workunit.client.1.smithi098.stdout:3/249: rename l5 to d6/l55 0 2023-01-04T18:16:27.650 INFO:tasks.workunit.client.1.smithi098.stdout:3/250: stat d6/d10/f32 0 2023-01-04T18:16:27.674 INFO:tasks.workunit.client.1.smithi098.stdout:4/188: dwrite d5/d9/f1a [0,4194304] 0 2023-01-04T18:16:27.675 INFO:tasks.workunit.client.1.smithi098.stdout:3/251: dwrite d6/d10/f23 [0,4194304] 0 2023-01-04T18:16:27.676 INFO:tasks.workunit.client.1.smithi098.stdout:0/205: dwrite df/f38 [0,4194304] 0 2023-01-04T18:16:27.676 INFO:tasks.workunit.client.1.smithi098.stdout:6/178: dwrite d9/dd/d15/f1a [4194304,4194304] 0 2023-01-04T18:16:27.678 INFO:tasks.workunit.client.1.smithi098.stdout:7/175: sync 2023-01-04T18:16:27.679 INFO:tasks.workunit.client.1.smithi098.stdout:7/176: read d1/f7 [4742060,80553] 0 2023-01-04T18:16:27.679 INFO:tasks.workunit.client.1.smithi098.stdout:7/177: dread - d1/d2e/f35 zero size 2023-01-04T18:16:27.689 INFO:tasks.workunit.client.1.smithi098.stdout:4/189: creat d5/de/d21/f39 x:0 0 0 2023-01-04T18:16:27.689 INFO:tasks.workunit.client.1.smithi098.stdout:4/190: readlink d5/l18 0 2023-01-04T18:16:27.696 INFO:tasks.workunit.client.1.smithi098.stdout:0/206: creat df/d17/f4b x:0 0 0 2023-01-04T18:16:27.696 INFO:tasks.workunit.client.1.smithi098.stdout:3/252: mkdir d6/d56 0 2023-01-04T18:16:27.697 INFO:tasks.workunit.client.1.smithi098.stdout:6/179: symlink d9/dd/l33 0 2023-01-04T18:16:27.698 INFO:tasks.workunit.client.1.smithi098.stdout:7/178: symlink d1/da/l3b 0 2023-01-04T18:16:27.699 INFO:tasks.workunit.client.1.smithi098.stdout:7/179: truncate d1/f22 832658 0 2023-01-04T18:16:27.699 INFO:tasks.workunit.client.1.smithi098.stdout:7/180: chown d1/d4/d11/c1d 4276 1 2023-01-04T18:16:27.699 INFO:tasks.workunit.client.1.smithi098.stdout:0/207: mkdir df/d17/d1c/d2c/d41/d4a/d4c 0 2023-01-04T18:16:27.699 INFO:tasks.workunit.client.1.smithi098.stdout:0/208: truncate df/d17/d1c/d2c/d41/f42 453401 0 2023-01-04T18:16:27.701 INFO:tasks.workunit.client.1.smithi098.stdout:6/180: dread d9/dd/d1f/f27 [0,4194304] 0 2023-01-04T18:16:27.701 INFO:tasks.workunit.client.1.smithi098.stdout:6/181: chown d9/dd/de/f21 3 1 2023-01-04T18:16:27.701 INFO:tasks.workunit.client.1.smithi098.stdout:6/182: chown d9/dd/de/d26/f2e 59586 1 2023-01-04T18:16:27.701 INFO:tasks.workunit.client.1.smithi098.stdout:7/181: creat d1/f3c x:0 0 0 2023-01-04T18:16:27.701 INFO:tasks.workunit.client.1.smithi098.stdout:6/183: write d9/dd/d15/f2d [65001,33967] 0 2023-01-04T18:16:27.701 INFO:tasks.workunit.client.1.smithi098.stdout:3/253: symlink d6/d10/d19/l57 0 2023-01-04T18:16:27.702 INFO:tasks.workunit.client.1.smithi098.stdout:7/182: rename d1/da/f16 to d1/da/f3d 0 2023-01-04T18:16:27.702 INFO:tasks.workunit.client.1.smithi098.stdout:7/183: truncate d1/d4/f29 1506830 0 2023-01-04T18:16:27.703 INFO:tasks.workunit.client.1.smithi098.stdout:3/254: creat d6/d10/d19/f58 x:0 0 0 2023-01-04T18:16:27.704 INFO:tasks.workunit.client.1.smithi098.stdout:4/191: dwrite d5/d9/f1a [0,4194304] 0 2023-01-04T18:16:27.707 INFO:tasks.workunit.client.1.smithi098.stdout:6/184: dread d9/dd/d15/f2d [0,4194304] 0 2023-01-04T18:16:27.707 INFO:tasks.workunit.client.1.smithi098.stdout:6/185: chown d9/dd/l22 4143258 1 2023-01-04T18:16:27.707 INFO:tasks.workunit.client.1.smithi098.stdout:9/240: sync 2023-01-04T18:16:27.707 INFO:tasks.workunit.client.1.smithi098.stdout:1/157: sync 2023-01-04T18:16:27.707 INFO:tasks.workunit.client.1.smithi098.stdout:9/241: chown d2/d5/d18/f39 178894611 1 2023-01-04T18:16:27.707 INFO:tasks.workunit.client.1.smithi098.stdout:9/242: dread - d2/d5/d18/f3f zero size 2023-01-04T18:16:27.707 INFO:tasks.workunit.client.1.smithi098.stdout:8/175: sync 2023-01-04T18:16:27.707 INFO:tasks.workunit.client.1.smithi098.stdout:1/158: write d1/f4 [4372497,102039] 0 2023-01-04T18:16:27.707 INFO:tasks.workunit.client.1.smithi098.stdout:1/159: chown d1/d8/da/f19 32 1 2023-01-04T18:16:27.707 INFO:tasks.workunit.client.1.smithi098.stdout:1/160: chown d1/d8/da/f24 190 1 2023-01-04T18:16:27.708 INFO:tasks.workunit.client.1.smithi098.stdout:1/161: dread d1/d8/da/d12/f20 [0,4194304] 0 2023-01-04T18:16:27.710 INFO:tasks.workunit.client.1.smithi098.stdout:3/255: symlink d6/d56/l59 0 2023-01-04T18:16:27.710 INFO:tasks.workunit.client.1.smithi098.stdout:3/256: dread - d6/d10/d29/f4d zero size 2023-01-04T18:16:27.711 INFO:tasks.workunit.client.1.smithi098.stdout:4/192: creat d5/de/d2c/f3a x:0 0 0 2023-01-04T18:16:27.711 INFO:tasks.workunit.client.1.smithi098.stdout:4/193: fsync d5/f16 0 2023-01-04T18:16:27.711 INFO:tasks.workunit.client.1.smithi098.stdout:4/194: truncate d5/de/d2c/f3a 911497 0 2023-01-04T18:16:27.712 INFO:tasks.workunit.client.1.smithi098.stdout:6/186: mknod d9/dd/de/c34 0 2023-01-04T18:16:27.714 INFO:tasks.workunit.client.1.smithi098.stdout:9/243: creat d2/d2d/f50 x:0 0 0 2023-01-04T18:16:27.716 INFO:tasks.workunit.client.1.smithi098.stdout:1/162: unlink d1/d8/da/l13 0 2023-01-04T18:16:27.718 INFO:tasks.workunit.client.1.smithi098.stdout:3/257: creat d6/d10/d19/d3f/d46/f5a x:0 0 0 2023-01-04T18:16:27.719 INFO:tasks.workunit.client.1.smithi098.stdout:4/195: creat d5/d9/f3b x:0 0 0 2023-01-04T18:16:27.719 INFO:tasks.workunit.client.1.smithi098.stdout:4/196: truncate d5/d9/d13/f2e 1014771 0 2023-01-04T18:16:27.720 INFO:tasks.workunit.client.1.smithi098.stdout:9/244: symlink d2/d5/d18/d4e/d2e/d26/d41/l51 0 2023-01-04T18:16:27.723 INFO:tasks.workunit.client.1.smithi098.stdout:9/245: truncate d2/d5/f24 1789128 0 2023-01-04T18:16:27.724 INFO:tasks.workunit.client.1.smithi098.stdout:4/197: dread d5/d9/d13/f2e [0,4194304] 0 2023-01-04T18:16:27.724 INFO:tasks.workunit.client.1.smithi098.stdout:4/198: readlink d5/l18 0 2023-01-04T18:16:27.725 INFO:tasks.workunit.client.1.smithi098.stdout:9/246: mknod d2/d5/d18/c52 0 2023-01-04T18:16:27.725 INFO:tasks.workunit.client.1.smithi098.stdout:9/247: readlink d2/d5/d18/d19/l21 0 2023-01-04T18:16:27.726 INFO:tasks.workunit.client.1.smithi098.stdout:4/199: symlink d5/l3c 0 2023-01-04T18:16:27.727 INFO:tasks.workunit.client.1.smithi098.stdout:9/248: mkdir d2/d53 0 2023-01-04T18:16:27.729 INFO:tasks.workunit.client.1.smithi098.stdout:4/200: creat d5/d9/d13/f3d x:0 0 0 2023-01-04T18:16:27.729 INFO:tasks.workunit.client.1.smithi098.stdout:4/201: write d5/f38 [866125,13979] 0 2023-01-04T18:16:27.731 INFO:tasks.workunit.client.1.smithi098.stdout:6/187: dwrite d9/dd/de/d26/f2e [0,4194304] 0 2023-01-04T18:16:27.734 INFO:tasks.workunit.client.1.smithi098.stdout:6/188: stat d9/dd/de/l25 0 2023-01-04T18:16:27.753 INFO:tasks.workunit.client.1.smithi098.stdout:0/209: dwrite df/d17/f2d [0,4194304] 0 2023-01-04T18:16:27.753 INFO:tasks.workunit.client.1.smithi098.stdout:0/210: truncate df/d17/f4b 116285 0 2023-01-04T18:16:27.753 INFO:tasks.workunit.client.1.smithi098.stdout:3/258: dwrite d6/d10/d3b/f52 [0,4194304] 0 2023-01-04T18:16:27.753 INFO:tasks.workunit.client.1.smithi098.stdout:3/259: write d6/d10/f50 [122927,84334] 0 2023-01-04T18:16:27.755 INFO:tasks.workunit.client.1.smithi098.stdout:6/189: dread d9/fa [0,4194304] 0 2023-01-04T18:16:27.760 INFO:tasks.workunit.client.1.smithi098.stdout:3/260: creat d6/d4c/f5b x:0 0 0 2023-01-04T18:16:27.761 INFO:tasks.workunit.client.1.smithi098.stdout:2/245: sync 2023-01-04T18:16:27.762 INFO:tasks.workunit.client.1.smithi098.stdout:2/246: fdatasync d6/f45 0 2023-01-04T18:16:27.762 INFO:tasks.workunit.client.1.smithi098.stdout:0/211: dread df/f14 [0,4194304] 0 2023-01-04T18:16:27.763 INFO:tasks.workunit.client.1.smithi098.stdout:0/212: fdatasync df/d17/d24/f25 0 2023-01-04T18:16:27.763 INFO:tasks.workunit.client.1.smithi098.stdout:6/190: rename d9/dd/l10 to d9/dd/de/d20/l35 0 2023-01-04T18:16:27.763 INFO:tasks.workunit.client.1.smithi098.stdout:2/247: dread d6/f7 [0,4194304] 0 2023-01-04T18:16:27.767 INFO:tasks.workunit.client.1.smithi098.stdout:0/213: symlink df/d17/d1c/d2c/d41/d4a/d4c/l4d 0 2023-01-04T18:16:27.769 INFO:tasks.workunit.client.1.smithi098.stdout:5/189: sync 2023-01-04T18:16:27.769 INFO:tasks.workunit.client.1.smithi098.stdout:3/261: rename d6/d10/d19/d3f/f30 to d6/d4c/f5c 0 2023-01-04T18:16:27.770 INFO:tasks.workunit.client.1.smithi098.stdout:4/202: dwrite d5/de/f29 [0,4194304] 0 2023-01-04T18:16:27.772 INFO:tasks.workunit.client.1.smithi098.stdout:2/248: creat d6/dc/d2b/d46/f53 x:0 0 0 2023-01-04T18:16:27.774 INFO:tasks.workunit.client.1.smithi098.stdout:0/214: symlink df/d17/d24/l4e 0 2023-01-04T18:16:27.775 INFO:tasks.workunit.client.1.smithi098.stdout:3/262: symlink d6/d4c/l5d 0 2023-01-04T18:16:27.775 INFO:tasks.workunit.client.1.smithi098.stdout:3/263: stat d6/l4a 0 2023-01-04T18:16:27.778 INFO:tasks.workunit.client.1.smithi098.stdout:2/249: write d6/f4a [1156856,126897] 0 2023-01-04T18:16:27.778 INFO:tasks.workunit.client.1.smithi098.stdout:2/250: chown d6/dc/d2b 0 1 2023-01-04T18:16:27.781 INFO:tasks.workunit.client.1.smithi098.stdout:0/215: mkdir df/d4f 0 2023-01-04T18:16:27.781 INFO:tasks.workunit.client.1.smithi098.stdout:3/264: mkdir d6/d10/d19/d3f/d5e 0 2023-01-04T18:16:27.782 INFO:tasks.workunit.client.1.smithi098.stdout:1/163: dwrite d1/f1b [0,4194304] 0 2023-01-04T18:16:27.782 INFO:tasks.workunit.client.1.smithi098.stdout:4/203: dread d5/de/d21/f22 [0,4194304] 0 2023-01-04T18:16:27.782 INFO:tasks.workunit.client.1.smithi098.stdout:6/191: dwrite d9/dd/d15/f2d [0,4194304] 0 2023-01-04T18:16:27.783 INFO:tasks.workunit.client.1.smithi098.stdout:9/249: dwrite d2/d5/d18/d1d/f2f [0,4194304] 0 2023-01-04T18:16:27.785 INFO:tasks.workunit.client.1.smithi098.stdout:2/251: creat d6/dc/d2b/d42/d51/f54 x:0 0 0 2023-01-04T18:16:27.785 INFO:tasks.workunit.client.1.smithi098.stdout:2/252: readlink d6/dc/d2b/d32/l4e 0 2023-01-04T18:16:27.785 INFO:tasks.workunit.client.1.smithi098.stdout:2/253: read - d6/dc/d2b/d42/d47/d1f/f24 zero size 2023-01-04T18:16:27.786 INFO:tasks.workunit.client.1.smithi098.stdout:0/216: symlink df/d40/l50 0 2023-01-04T18:16:27.788 INFO:tasks.workunit.client.1.smithi098.stdout:3/265: unlink d6/d10/d29/f4d 0 2023-01-04T18:16:27.791 INFO:tasks.workunit.client.1.smithi098.stdout:9/250: dread d2/d5/f28 [0,4194304] 0 2023-01-04T18:16:27.792 INFO:tasks.workunit.client.1.smithi098.stdout:5/190: dwrite d1/f6 [0,4194304] 0 2023-01-04T18:16:27.796 INFO:tasks.workunit.client.1.smithi098.stdout:6/192: creat d9/dd/d15/f36 x:0 0 0 2023-01-04T18:16:27.796 INFO:tasks.workunit.client.1.smithi098.stdout:6/193: fsync d9/fa 0 2023-01-04T18:16:27.796 INFO:tasks.workunit.client.1.smithi098.stdout:4/204: dread d5/de/d2c/f3a [0,4194304] 0 2023-01-04T18:16:27.799 INFO:tasks.workunit.client.1.smithi098.stdout:5/191: dread d1/f18 [0,4194304] 0 2023-01-04T18:16:27.799 INFO:tasks.workunit.client.1.smithi098.stdout:9/251: creat d2/d5/d18/d19/f54 x:0 0 0 2023-01-04T18:16:27.799 INFO:tasks.workunit.client.1.smithi098.stdout:9/252: fdatasync d2/d5/d18/d4e/d2e/d26/f4a 0 2023-01-04T18:16:27.800 INFO:tasks.workunit.client.1.smithi098.stdout:6/194: mknod d9/c37 0 2023-01-04T18:16:27.802 INFO:tasks.workunit.client.1.smithi098.stdout:4/205: creat d5/de/d2c/f3e x:0 0 0 2023-01-04T18:16:27.802 INFO:tasks.workunit.client.1.smithi098.stdout:7/184: sync 2023-01-04T18:16:27.802 INFO:tasks.workunit.client.1.smithi098.stdout:8/176: sync 2023-01-04T18:16:27.802 INFO:tasks.workunit.client.1.smithi098.stdout:7/185: chown d1/d23/d24/d26/f30 25896 1 2023-01-04T18:16:27.803 INFO:tasks.workunit.client.1.smithi098.stdout:7/186: dread - d1/d2e/f35 zero size 2023-01-04T18:16:27.803 INFO:tasks.workunit.client.1.smithi098.stdout:7/187: fdatasync d1/d23/d24/d26/d28/d2d/f32 0 2023-01-04T18:16:27.803 INFO:tasks.workunit.client.1.smithi098.stdout:3/266: dread d6/d10/d3b/f3c [0,4194304] 0 2023-01-04T18:16:27.804 INFO:tasks.workunit.client.1.smithi098.stdout:1/164: rename d1/c5 to d1/d25/d27/c35 0 2023-01-04T18:16:27.804 INFO:tasks.workunit.client.1.smithi098.stdout:4/206: write d5/f12 [537533,85639] 0 2023-01-04T18:16:27.804 INFO:tasks.workunit.client.1.smithi098.stdout:4/207: chown d5/f12 5293 1 2023-01-04T18:16:27.805 INFO:tasks.workunit.client.1.smithi098.stdout:3/267: fdatasync d6/d10/d19/f26 0 2023-01-04T18:16:27.812 INFO:tasks.workunit.client.1.smithi098.stdout:2/254: rename d6/dc/d2b/d42/d47/f2c to d6/dc/d2b/d42/d47/d35/f55 0 2023-01-04T18:16:27.812 INFO:tasks.workunit.client.1.smithi098.stdout:1/165: mkdir d1/d25/d36 0 2023-01-04T18:16:27.814 INFO:tasks.workunit.client.1.smithi098.stdout:0/217: rename df/f11 to df/d4f/f51 0 2023-01-04T18:16:27.815 INFO:tasks.workunit.client.1.smithi098.stdout:1/166: rmdir d1/d25/d27 39 2023-01-04T18:16:27.817 INFO:tasks.workunit.client.1.smithi098.stdout:8/177: rename d6/d11/d15/d1b/d2a/l30 to d6/l31 0 2023-01-04T18:16:27.817 INFO:tasks.workunit.client.1.smithi098.stdout:8/178: chown d6/d11/d15/d1b/l27 2 1 2023-01-04T18:16:27.818 INFO:tasks.workunit.client.1.smithi098.stdout:8/179: dread - d6/d11/d15/f1d zero size 2023-01-04T18:16:27.818 INFO:tasks.workunit.client.1.smithi098.stdout:3/268: write d6/d4c/f5c [684413,45882] 0 2023-01-04T18:16:27.818 INFO:tasks.workunit.client.1.smithi098.stdout:0/218: creat df/f52 x:0 0 0 2023-01-04T18:16:27.818 INFO:tasks.workunit.client.1.smithi098.stdout:0/219: read - df/d17/d24/f25 zero size 2023-01-04T18:16:27.820 INFO:tasks.workunit.client.1.smithi098.stdout:1/167: unlink d1/f21 0 2023-01-04T18:16:27.822 INFO:tasks.workunit.client.1.smithi098.stdout:4/208: rename d5/de/l26 to d5/d9/d13/l3f 0 2023-01-04T18:16:27.824 INFO:tasks.workunit.client.1.smithi098.stdout:8/180: truncate d6/d11/d15/f1f 636865 0 2023-01-04T18:16:27.824 INFO:tasks.workunit.client.1.smithi098.stdout:8/181: dread - d6/d11/d15/f1d zero size 2023-01-04T18:16:27.827 INFO:tasks.workunit.client.1.smithi098.stdout:3/269: symlink d6/l5f 0 2023-01-04T18:16:27.827 INFO:tasks.workunit.client.1.smithi098.stdout:8/182: symlink d6/d11/d15/d1b/l32 0 2023-01-04T18:16:27.827 INFO:tasks.workunit.client.1.smithi098.stdout:8/183: write d6/dc/d12/d1e/f2b [658912,20045] 0 2023-01-04T18:16:27.827 INFO:tasks.workunit.client.1.smithi098.stdout:2/255: dread d6/f3e [0,4194304] 0 2023-01-04T18:16:27.828 INFO:tasks.workunit.client.1.smithi098.stdout:3/270: creat d6/d56/f60 x:0 0 0 2023-01-04T18:16:27.829 INFO:tasks.workunit.client.1.smithi098.stdout:8/184: unlink d6/dc/c21 0 2023-01-04T18:16:27.830 INFO:tasks.workunit.client.1.smithi098.stdout:2/256: creat d6/dc/d2b/d42/d47/d1f/d39/f56 x:0 0 0 2023-01-04T18:16:27.833 INFO:tasks.workunit.client.1.smithi098.stdout:8/185: mkdir d6/d11/d15/d1b/d2a/d33 0 2023-01-04T18:16:27.833 INFO:tasks.workunit.client.1.smithi098.stdout:5/192: dwrite d1/d2/d32/f39 [4194304,4194304] 0 2023-01-04T18:16:27.835 INFO:tasks.workunit.client.1.smithi098.stdout:5/193: mkdir d1/d38/d3b 0 2023-01-04T18:16:27.837 INFO:tasks.workunit.client.1.smithi098.stdout:5/194: symlink d1/d2f/l3c 0 2023-01-04T18:16:27.837 INFO:tasks.workunit.client.1.smithi098.stdout:7/188: dwrite d1/f7 [0,4194304] 0 2023-01-04T18:16:27.837 INFO:tasks.workunit.client.1.smithi098.stdout:4/209: dread d5/d9/f1a [0,4194304] 0 2023-01-04T18:16:27.838 INFO:tasks.workunit.client.1.smithi098.stdout:2/257: dread d6/dc/d2b/f2e [0,4194304] 0 2023-01-04T18:16:27.838 INFO:tasks.workunit.client.1.smithi098.stdout:7/189: read d1/d23/d24/d26/d28/d2d/f32 [3925679,82063] 0 2023-01-04T18:16:27.838 INFO:tasks.workunit.client.1.smithi098.stdout:5/195: mknod d1/d1e/c3d 0 2023-01-04T18:16:27.839 INFO:tasks.workunit.client.1.smithi098.stdout:4/210: mkdir d5/d28/d40 0 2023-01-04T18:16:27.839 INFO:tasks.workunit.client.1.smithi098.stdout:4/211: truncate d5/d9/f36 410810 0 2023-01-04T18:16:27.839 INFO:tasks.workunit.client.1.smithi098.stdout:4/212: stat d5/de/d21/c1d 0 2023-01-04T18:16:27.839 INFO:tasks.workunit.client.1.smithi098.stdout:2/258: creat d6/dc/d2b/d42/f57 x:0 0 0 2023-01-04T18:16:27.839 INFO:tasks.workunit.client.1.smithi098.stdout:2/259: chown d6/dc/f14 296 1 2023-01-04T18:16:27.840 INFO:tasks.workunit.client.1.smithi098.stdout:5/196: rmdir d1/d2/d32 39 2023-01-04T18:16:27.841 INFO:tasks.workunit.client.1.smithi098.stdout:9/253: dwrite d2/d5/d18/d4e/d2e/d26/d41/f43 [0,4194304] 0 2023-01-04T18:16:27.842 INFO:tasks.workunit.client.1.smithi098.stdout:4/213: truncate d5/f8 30225 0 2023-01-04T18:16:27.843 INFO:tasks.workunit.client.1.smithi098.stdout:5/197: creat d1/d1e/f3e x:0 0 0 2023-01-04T18:16:27.843 INFO:tasks.workunit.client.1.smithi098.stdout:5/198: write d1/d2/d14/f23 [5034430,69614] 0 2023-01-04T18:16:27.846 INFO:tasks.workunit.client.1.smithi098.stdout:4/214: creat d5/de/d21/f41 x:0 0 0 2023-01-04T18:16:27.847 INFO:tasks.workunit.client.1.smithi098.stdout:4/215: write d5/de/d21/f41 [630363,73626] 0 2023-01-04T18:16:27.849 INFO:tasks.workunit.client.1.smithi098.stdout:4/216: write d5/d9/f1a [1677582,112442] 0 2023-01-04T18:16:27.850 INFO:tasks.workunit.client.1.smithi098.stdout:7/190: dread d1/d23/d24/d26/d28/d2d/f32 [0,4194304] 0 2023-01-04T18:16:27.854 INFO:tasks.workunit.client.1.smithi098.stdout:4/217: dread d5/de/d21/f22 [0,4194304] 0 2023-01-04T18:16:27.855 INFO:tasks.workunit.client.1.smithi098.stdout:0/220: dwrite df/d17/d1c/f2f [0,4194304] 0 2023-01-04T18:16:27.856 INFO:tasks.workunit.client.1.smithi098.stdout:0/221: chown df/d40/c48 281418 1 2023-01-04T18:16:27.856 INFO:tasks.workunit.client.1.smithi098.stdout:4/218: creat d5/f42 x:0 0 0 2023-01-04T18:16:27.856 INFO:tasks.workunit.client.1.smithi098.stdout:4/219: readlink d5/de/d2c/l34 0 2023-01-04T18:16:27.858 INFO:tasks.workunit.client.1.smithi098.stdout:6/195: dwrite d9/dd/de/f21 [0,4194304] 0 2023-01-04T18:16:27.865 INFO:tasks.workunit.client.1.smithi098.stdout:4/220: creat d5/d9/f43 x:0 0 0 2023-01-04T18:16:27.865 INFO:tasks.workunit.client.1.smithi098.stdout:6/196: symlink d9/dd/d15/l38 0 2023-01-04T18:16:27.865 INFO:tasks.workunit.client.1.smithi098.stdout:6/197: stat d9/dd/l22 0 2023-01-04T18:16:27.867 INFO:tasks.workunit.client.1.smithi098.stdout:0/222: dread df/f38 [0,4194304] 0 2023-01-04T18:16:27.868 INFO:tasks.workunit.client.1.smithi098.stdout:0/223: symlink df/d4f/l53 0 2023-01-04T18:16:27.870 INFO:tasks.workunit.client.1.smithi098.stdout:3/271: dwrite d6/d10/f40 [0,4194304] 0 2023-01-04T18:16:27.870 INFO:tasks.workunit.client.1.smithi098.stdout:3/272: truncate d6/d10/f50 468591 0 2023-01-04T18:16:27.870 INFO:tasks.workunit.client.1.smithi098.stdout:3/273: write d6/d10/d3b/f3c [701534,65855] 0 2023-01-04T18:16:27.876 INFO:tasks.workunit.client.1.smithi098.stdout:8/186: getdents d6 0 2023-01-04T18:16:27.879 INFO:tasks.workunit.client.1.smithi098.stdout:6/198: dread d9/dd/de/f1e [0,4194304] 0 2023-01-04T18:16:27.879 INFO:tasks.workunit.client.1.smithi098.stdout:6/199: dread - d9/dd/d15/f36 zero size 2023-01-04T18:16:27.879 INFO:tasks.workunit.client.1.smithi098.stdout:6/200: chown d9/dd/d1f 12846428 1 2023-01-04T18:16:27.879 INFO:tasks.workunit.client.1.smithi098.stdout:6/201: fdatasync d9/dd/de/f21 0 2023-01-04T18:16:27.883 INFO:tasks.workunit.client.1.smithi098.stdout:3/274: creat d6/d10/d29/f61 x:0 0 0 2023-01-04T18:16:27.886 INFO:tasks.workunit.client.1.smithi098.stdout:8/187: dread d6/f9 [0,4194304] 0 2023-01-04T18:16:27.886 INFO:tasks.workunit.client.1.smithi098.stdout:8/188: write d6/d11/d15/f1d [80485,80342] 0 2023-01-04T18:16:27.888 INFO:tasks.workunit.client.1.smithi098.stdout:3/275: creat d6/d10/f62 x:0 0 0 2023-01-04T18:16:27.888 INFO:tasks.workunit.client.1.smithi098.stdout:2/260: dwrite d6/dc/d2b/d42/f57 [0,4194304] 0 2023-01-04T18:16:27.888 INFO:tasks.workunit.client.1.smithi098.stdout:2/261: chown d6/dc/d2b 1036260867 1 2023-01-04T18:16:27.888 INFO:tasks.workunit.client.1.smithi098.stdout:2/262: write d6/f2f [4208741,20544] 0 2023-01-04T18:16:27.889 INFO:tasks.workunit.client.1.smithi098.stdout:8/189: getdents d6/dc/d12 0 2023-01-04T18:16:27.890 INFO:tasks.workunit.client.1.smithi098.stdout:9/254: dwrite d2/d5/d18/d19/f54 [0,4194304] 0 2023-01-04T18:16:27.890 INFO:tasks.workunit.client.1.smithi098.stdout:9/255: stat d2/d5/d18/f1f 0 2023-01-04T18:16:27.890 INFO:tasks.workunit.client.1.smithi098.stdout:9/256: truncate d2/d5/f6 6182635 0 2023-01-04T18:16:27.890 INFO:tasks.workunit.client.1.smithi098.stdout:9/257: truncate d2/d5/d18/f39 434140 0 2023-01-04T18:16:27.891 INFO:tasks.workunit.client.1.smithi098.stdout:5/199: dwrite d1/d2/f15 [0,4194304] 0 2023-01-04T18:16:27.891 INFO:tasks.workunit.client.1.smithi098.stdout:7/191: dwrite d1/f22 [0,4194304] 0 2023-01-04T18:16:27.894 INFO:tasks.workunit.client.1.smithi098.stdout:8/190: rmdir d6/d11/d15/d1b 39 2023-01-04T18:16:27.895 INFO:tasks.workunit.client.1.smithi098.stdout:9/258: mknod d2/d5/d18/d19/c55 0 2023-01-04T18:16:27.896 INFO:tasks.workunit.client.1.smithi098.stdout:3/276: link d6/d10/d29/f34 d6/d10/d19/f63 0 2023-01-04T18:16:27.896 INFO:tasks.workunit.client.1.smithi098.stdout:3/277: fsync d6/d10/d19/f42 0 2023-01-04T18:16:27.896 INFO:tasks.workunit.client.1.smithi098.stdout:3/278: truncate d6/d10/d3b/f3c 1587774 0 2023-01-04T18:16:27.896 INFO:tasks.workunit.client.1.smithi098.stdout:3/279: chown d6/d10/d19/d3f/d5e 5 1 2023-01-04T18:16:27.897 INFO:tasks.workunit.client.1.smithi098.stdout:3/280: fdatasync d6/f25 0 2023-01-04T18:16:27.898 INFO:tasks.workunit.client.1.smithi098.stdout:5/200: creat d1/da/f3f x:0 0 0 2023-01-04T18:16:27.899 INFO:tasks.workunit.client.1.smithi098.stdout:7/192: symlink d1/d23/d21/l3e 0 2023-01-04T18:16:27.899 INFO:tasks.workunit.client.1.smithi098.stdout:7/193: truncate d1/f3c 944672 0 2023-01-04T18:16:27.902 INFO:tasks.workunit.client.1.smithi098.stdout:4/221: dread d5/d9/f1a [0,4194304] 0 2023-01-04T18:16:27.914 INFO:tasks.workunit.client.1.smithi098.stdout:9/259: mknod d2/d5/d18/c56 0 2023-01-04T18:16:27.914 INFO:tasks.workunit.client.1.smithi098.stdout:3/281: symlink d6/d10/d19/d3f/d5e/l64 0 2023-01-04T18:16:27.923 INFO:tasks.workunit.client.1.smithi098.stdout:5/201: link d1/d2/d14/l16 d1/l40 0 2023-01-04T18:16:27.923 INFO:tasks.workunit.client.1.smithi098.stdout:4/222: mkdir d5/d28/d44 0 2023-01-04T18:16:27.924 INFO:tasks.workunit.client.1.smithi098.stdout:5/202: truncate d1/d1e/f3e 1025240 0 2023-01-04T18:16:27.924 INFO:tasks.workunit.client.1.smithi098.stdout:3/282: mknod d6/d4c/c65 0 2023-01-04T18:16:27.924 INFO:tasks.workunit.client.1.smithi098.stdout:9/260: mkdir d2/d5/d18/d4e/d2e/d26/d41/d57 0 2023-01-04T18:16:27.924 INFO:tasks.workunit.client.1.smithi098.stdout:4/223: mknod d5/d9/c45 0 2023-01-04T18:16:27.925 INFO:tasks.workunit.client.1.smithi098.stdout:4/224: creat d5/de/d2c/f46 x:0 0 0 2023-01-04T18:16:27.928 INFO:tasks.workunit.client.1.smithi098.stdout:4/225: rename d5/f12 to d5/f47 0 2023-01-04T18:16:27.928 INFO:tasks.workunit.client.1.smithi098.stdout:4/226: chown d5/d9/d13/f17 388900347 1 2023-01-04T18:16:27.928 INFO:tasks.workunit.client.1.smithi098.stdout:4/227: fsync d5/de/d21/f39 0 2023-01-04T18:16:27.928 INFO:tasks.workunit.client.1.smithi098.stdout:9/261: write d2/d5/d18/d4e/d2e/f4d [575982,121966] 0 2023-01-04T18:16:27.931 INFO:tasks.workunit.client.1.smithi098.stdout:9/262: creat d2/d5/d18/d19/f58 x:0 0 0 2023-01-04T18:16:27.932 INFO:tasks.workunit.client.1.smithi098.stdout:9/263: creat d2/d5/d18/d4e/d2e/d26/d41/d57/f59 x:0 0 0 2023-01-04T18:16:27.935 INFO:tasks.workunit.client.1.smithi098.stdout:9/264: read d2/d5/d18/d1d/f34 [1191231,97356] 0 2023-01-04T18:16:27.968 INFO:tasks.workunit.client.1.smithi098.stdout:2/263: dwrite d6/dc/d2b/f2e [0,4194304] 0 2023-01-04T18:16:27.968 INFO:tasks.workunit.client.1.smithi098.stdout:2/264: chown d6/f3e 466380225 1 2023-01-04T18:16:27.969 INFO:tasks.workunit.client.1.smithi098.stdout:2/265: chown d6/dc/d2b/d42/d47/c26 530138 1 2023-01-04T18:16:27.969 INFO:tasks.workunit.client.1.smithi098.stdout:3/283: dread d6/d10/f12 [0,4194304] 0 2023-01-04T18:16:27.970 INFO:tasks.workunit.client.1.smithi098.stdout:3/284: stat d6/d10/f1b 0 2023-01-04T18:16:27.970 INFO:tasks.workunit.client.1.smithi098.stdout:3/285: write d6/d56/f60 [294635,2652] 0 2023-01-04T18:16:27.970 INFO:tasks.workunit.client.1.smithi098.stdout:3/286: chown d6/d10/f40 1441632157 1 2023-01-04T18:16:27.970 INFO:tasks.workunit.client.1.smithi098.stdout:2/266: mknod d6/dc/d2b/d42/d51/c58 0 2023-01-04T18:16:27.970 INFO:tasks.workunit.client.1.smithi098.stdout:2/267: chown d6/dc/d2b/d32/l4e 606878506 1 2023-01-04T18:16:27.971 INFO:tasks.workunit.client.1.smithi098.stdout:3/287: chown d6/d10/d19/f39 15280 1 2023-01-04T18:16:27.971 INFO:tasks.workunit.client.1.smithi098.stdout:6/202: dwrite d9/dd/de/f21 [0,4194304] 0 2023-01-04T18:16:27.971 INFO:tasks.workunit.client.1.smithi098.stdout:6/203: chown d9/dd/d1f 13 1 2023-01-04T18:16:27.971 INFO:tasks.workunit.client.1.smithi098.stdout:6/204: fsync d9/dd/d15/f2d 0 2023-01-04T18:16:27.971 INFO:tasks.workunit.client.1.smithi098.stdout:6/205: chown d9/dd/f11 26 1 2023-01-04T18:16:27.971 INFO:tasks.workunit.client.1.smithi098.stdout:2/268: creat d6/dc/d2b/d42/d47/d31/f59 x:0 0 0 2023-01-04T18:16:27.972 INFO:tasks.workunit.client.1.smithi098.stdout:3/288: symlink d6/d10/d19/d3f/d46/l66 0 2023-01-04T18:16:27.974 INFO:tasks.workunit.client.1.smithi098.stdout:6/206: link d9/dd/de/lf d9/dd/de/d20/l39 0 2023-01-04T18:16:27.975 INFO:tasks.workunit.client.1.smithi098.stdout:2/269: mknod d6/dc/d2b/d42/d47/d35/c5a 0 2023-01-04T18:16:27.975 INFO:tasks.workunit.client.1.smithi098.stdout:6/207: symlink d9/l3a 0 2023-01-04T18:16:27.976 INFO:tasks.workunit.client.1.smithi098.stdout:2/270: mknod d6/dc/c5b 0 2023-01-04T18:16:27.977 INFO:tasks.workunit.client.1.smithi098.stdout:6/208: mknod d9/c3b 0 2023-01-04T18:16:27.984 INFO:tasks.workunit.client.1.smithi098.stdout:3/289: dread d6/d10/f40 [0,4194304] 0 2023-01-04T18:16:27.984 INFO:tasks.workunit.client.1.smithi098.stdout:3/290: truncate d6/d10/d29/f61 824983 0 2023-01-04T18:16:27.998 INFO:tasks.workunit.client.1.smithi098.stdout:2/271: dwrite d6/dc/d2b/d42/d47/d1f/f29 [4194304,4194304] 0 2023-01-04T18:16:27.998 INFO:tasks.workunit.client.1.smithi098.stdout:9/265: dwrite d2/d5/d18/d19/f3b [4194304,4194304] 0 2023-01-04T18:16:27.998 INFO:tasks.workunit.client.1.smithi098.stdout:9/266: readlink d2/l13 0 2023-01-04T18:16:27.999 INFO:tasks.workunit.client.1.smithi098.stdout:9/267: stat d2/d5/d18/f3f 0 2023-01-04T18:16:27.999 INFO:tasks.workunit.client.1.smithi098.stdout:9/268: chown d2/d2d/f50 371180 1 2023-01-04T18:16:27.999 INFO:tasks.workunit.client.1.smithi098.stdout:7/194: dwrite d1/da/f3d [0,4194304] 0 2023-01-04T18:16:27.999 INFO:tasks.workunit.client.1.smithi098.stdout:5/203: dwrite d1/da/f3f [0,4194304] 0 2023-01-04T18:16:27.999 INFO:tasks.workunit.client.1.smithi098.stdout:5/204: readlink d1/l40 0 2023-01-04T18:16:28.000 INFO:tasks.workunit.client.1.smithi098.stdout:6/209: dwrite d9/dd/d1f/f27 [0,4194304] 0 2023-01-04T18:16:28.000 INFO:tasks.workunit.client.1.smithi098.stdout:6/210: write d9/f17 [8772965,130793] 0 2023-01-04T18:16:28.002 INFO:tasks.workunit.client.1.smithi098.stdout:4/228: rmdir d5/d9 39 2023-01-04T18:16:28.003 INFO:tasks.workunit.client.1.smithi098.stdout:2/272: creat d6/dc/f5c x:0 0 0 2023-01-04T18:16:28.013 INFO:tasks.workunit.client.1.smithi098.stdout:4/229: link d5/f38 d5/d28/d40/f48 0 2023-01-04T18:16:28.013 INFO:tasks.workunit.client.1.smithi098.stdout:2/273: creat d6/dc/d2b/d42/d47/d1f/d39/f5d x:0 0 0 2023-01-04T18:16:28.014 INFO:tasks.workunit.client.1.smithi098.stdout:4/230: mknod d5/c49 0 2023-01-04T18:16:28.014 INFO:tasks.workunit.client.1.smithi098.stdout:4/231: fdatasync d5/f47 0 2023-01-04T18:16:28.014 INFO:tasks.workunit.client.1.smithi098.stdout:4/232: fdatasync d5/de/d21/f39 0 2023-01-04T18:16:28.014 INFO:tasks.workunit.client.1.smithi098.stdout:4/233: fsync d5/d9/d13/f2a 0 2023-01-04T18:16:28.015 INFO:tasks.workunit.client.1.smithi098.stdout:2/274: creat d6/dc/d2b/d42/d47/d31/f5e x:0 0 0 2023-01-04T18:16:28.016 INFO:tasks.workunit.client.1.smithi098.stdout:2/275: dread d6/dc/f1b [0,4194304] 0 2023-01-04T18:16:28.016 INFO:tasks.workunit.client.1.smithi098.stdout:2/276: readlink d6/dc/d2b/d42/d47/d31/l50 0 2023-01-04T18:16:28.026 INFO:tasks.workunit.client.1.smithi098.stdout:6/211: dwrite d9/dd/de/d26/f2e [0,4194304] 0 2023-01-04T18:16:28.026 INFO:tasks.workunit.client.1.smithi098.stdout:6/212: chown d9/dd/c23 2911547 1 2023-01-04T18:16:28.031 INFO:tasks.workunit.client.1.smithi098.stdout:2/277: read d6/f33 [732641,104627] 0 2023-01-04T18:16:28.040 INFO:tasks.workunit.client.1.smithi098.stdout:6/213: rmdir d9/dd 39 2023-01-04T18:16:28.041 INFO:tasks.workunit.client.1.smithi098.stdout:6/214: mknod d9/dd/de/d26/c3c 0 2023-01-04T18:16:28.041 INFO:tasks.workunit.client.1.smithi098.stdout:6/215: chown d9/c3b 112116 1 2023-01-04T18:16:28.043 INFO:tasks.workunit.client.1.smithi098.stdout:6/216: mknod d9/dd/de/d20/c3d 0 2023-01-04T18:16:28.044 INFO:tasks.workunit.client.1.smithi098.stdout:6/217: chown d9/dd/de/l25 30 1 2023-01-04T18:16:28.052 INFO:tasks.workunit.client.1.smithi098.stdout:5/205: dwrite d1/d2/f15 [0,4194304] 0 2023-01-04T18:16:28.053 INFO:tasks.workunit.client.1.smithi098.stdout:9/269: dwrite d2/d5/d18/d19/f58 [0,4194304] 0 2023-01-04T18:16:28.053 INFO:tasks.workunit.client.1.smithi098.stdout:2/278: dwrite d6/dc/fe [0,4194304] 0 2023-01-04T18:16:28.053 INFO:tasks.workunit.client.1.smithi098.stdout:2/279: write d6/dc/d2b/d42/d47/d1f/f24 [628808,93780] 0 2023-01-04T18:16:28.054 INFO:tasks.workunit.client.1.smithi098.stdout:2/280: chown d6/dc/l19 73650 1 2023-01-04T18:16:28.055 INFO:tasks.workunit.client.1.smithi098.stdout:5/206: creat d1/d38/f41 x:0 0 0 2023-01-04T18:16:28.055 INFO:tasks.workunit.client.1.smithi098.stdout:5/207: fdatasync d1/f1d 0 2023-01-04T18:16:28.059 INFO:tasks.workunit.client.1.smithi098.stdout:9/270: creat d2/d5/d18/d4e/d2e/d26/d41/d57/f5a x:0 0 0 2023-01-04T18:16:28.062 INFO:tasks.workunit.client.1.smithi098.stdout:6/218: dwrite d9/dd/de/d26/f2e [0,4194304] 0 2023-01-04T18:16:28.062 INFO:tasks.workunit.client.1.smithi098.stdout:6/219: fsync d9/dd/d1f/f27 0 2023-01-04T18:16:28.066 INFO:tasks.workunit.client.1.smithi098.stdout:5/208: symlink d1/d1e/l42 0 2023-01-04T18:16:28.066 INFO:tasks.workunit.client.1.smithi098.stdout:5/209: stat c0 0 2023-01-04T18:16:28.067 INFO:tasks.workunit.client.1.smithi098.stdout:9/271: rename d2/d5/d18/d4e/c4c to d2/d53/c5b 0 2023-01-04T18:16:28.069 INFO:tasks.workunit.client.1.smithi098.stdout:9/272: mkdir d2/d5/d18/d1d/d23/d5c 0 2023-01-04T18:16:28.072 INFO:tasks.workunit.client.1.smithi098.stdout:1/168: sync 2023-01-04T18:16:28.073 INFO:tasks.workunit.client.1.smithi098.stdout:1/169: truncate d1/d8/da/f31 2423576 0 2023-01-04T18:16:28.075 INFO:tasks.workunit.client.1.smithi098.stdout:1/170: rename d1/d8/da/f19 to d1/d2e/f37 0 2023-01-04T18:16:28.076 INFO:tasks.workunit.client.1.smithi098.stdout:5/210: dread d1/da/f1c [0,4194304] 0 2023-01-04T18:16:28.077 INFO:tasks.workunit.client.1.smithi098.stdout:5/211: mknod d1/d38/c43 0 2023-01-04T18:16:28.078 INFO:tasks.workunit.client.1.smithi098.stdout:2/281: dwrite d6/f8 [0,4194304] 0 2023-01-04T18:16:28.078 INFO:tasks.workunit.client.1.smithi098.stdout:2/282: write d6/dc/d2b/d42/d51/f54 [68806,13995] 0 2023-01-04T18:16:28.079 INFO:tasks.workunit.client.1.smithi098.stdout:5/212: unlink d1/d2/cd 0 2023-01-04T18:16:28.081 INFO:tasks.workunit.client.1.smithi098.stdout:6/220: dwrite d9/dd/de/f21 [4194304,4194304] 0 2023-01-04T18:16:28.081 INFO:tasks.workunit.client.1.smithi098.stdout:6/221: chown d9/dd/de/d20/c3d 25 1 2023-01-04T18:16:28.083 INFO:tasks.workunit.client.1.smithi098.stdout:6/222: write d9/dd/f11 [3092110,75796] 0 2023-01-04T18:16:28.086 INFO:tasks.workunit.client.1.smithi098.stdout:6/223: mkdir d9/dd/d24/d3e 0 2023-01-04T18:16:28.099 INFO:tasks.workunit.client.1.smithi098.stdout:0/224: sync 2023-01-04T18:16:28.101 INFO:tasks.workunit.client.1.smithi098.stdout:0/225: rename df/d17/d1c/d2c/d41/f42 to df/d17/f54 0 2023-01-04T18:16:28.101 INFO:tasks.workunit.client.1.smithi098.stdout:0/226: fdatasync df/f3e 0 2023-01-04T18:16:28.101 INFO:tasks.workunit.client.1.smithi098.stdout:0/227: write df/d17/d24/f44 [1887017,99528] 0 2023-01-04T18:16:28.102 INFO:tasks.workunit.client.1.smithi098.stdout:0/228: creat df/d4f/f55 x:0 0 0 2023-01-04T18:16:28.103 INFO:tasks.workunit.client.1.smithi098.stdout:9/273: dwrite d2/d5/d18/d4e/d2e/d26/f4a [0,4194304] 0 2023-01-04T18:16:28.103 INFO:tasks.workunit.client.1.smithi098.stdout:9/274: truncate d2/d5/d18/d1d/f34 4804033 0 2023-01-04T18:16:28.104 INFO:tasks.workunit.client.1.smithi098.stdout:9/275: chown d2/d5/d18/f44 18 1 2023-01-04T18:16:28.105 INFO:tasks.workunit.client.1.smithi098.stdout:9/276: creat d2/d2d/f5d x:0 0 0 2023-01-04T18:16:28.105 INFO:tasks.workunit.client.1.smithi098.stdout:9/277: chown d2/d5/d18/d1d/f30 899 1 2023-01-04T18:16:28.106 INFO:tasks.workunit.client.1.smithi098.stdout:9/278: write d2/f1e [5115726,74983] 0 2023-01-04T18:16:28.106 INFO:tasks.workunit.client.1.smithi098.stdout:9/279: write d2/d5/f24 [2726147,82116] 0 2023-01-04T18:16:28.106 INFO:tasks.workunit.client.1.smithi098.stdout:1/171: dwrite d1/d8/da/f24 [0,4194304] 0 2023-01-04T18:16:28.107 INFO:tasks.workunit.client.1.smithi098.stdout:2/283: dwrite d6/dc/d2b/d42/d47/d35/f38 [0,4194304] 0 2023-01-04T18:16:28.107 INFO:tasks.workunit.client.1.smithi098.stdout:2/284: fdatasync d6/dc/d2b/f2e 0 2023-01-04T18:16:28.107 INFO:tasks.workunit.client.1.smithi098.stdout:5/213: dwrite d1/da/f3f [4194304,4194304] 0 2023-01-04T18:16:28.108 INFO:tasks.workunit.client.1.smithi098.stdout:6/224: dwrite d9/fa [4194304,4194304] 0 2023-01-04T18:16:28.108 INFO:tasks.workunit.client.1.smithi098.stdout:6/225: fdatasync d9/dd/de/f1e 0 2023-01-04T18:16:28.108 INFO:tasks.workunit.client.1.smithi098.stdout:6/226: chown d9/dd/de/d20/l35 13851 1 2023-01-04T18:16:28.111 INFO:tasks.workunit.client.1.smithi098.stdout:0/229: dread df/d17/f2d [0,4194304] 0 2023-01-04T18:16:28.111 INFO:tasks.workunit.client.1.smithi098.stdout:6/227: write d9/dd/d1f/f27 [1352270,61941] 0 2023-01-04T18:16:28.111 INFO:tasks.workunit.client.1.smithi098.stdout:6/228: chown d9/dd/l18 794628713 1 2023-01-04T18:16:28.113 INFO:tasks.workunit.client.1.smithi098.stdout:1/172: symlink d1/d2e/l38 0 2023-01-04T18:16:28.115 INFO:tasks.workunit.client.1.smithi098.stdout:2/285: mknod d6/dc/d2b/d42/d47/d1f/d39/c5f 0 2023-01-04T18:16:28.116 INFO:tasks.workunit.client.1.smithi098.stdout:5/214: mkdir d1/da/d44 0 2023-01-04T18:16:28.127 INFO:tasks.workunit.client.1.smithi098.stdout:9/280: dwrite d2/d5/d18/d4e/d2e/d26/f37 [0,4194304] 0 2023-01-04T18:16:28.127 INFO:tasks.workunit.client.1.smithi098.stdout:9/281: chown d2/d5/d18/d19/f3b 14843 1 2023-01-04T18:16:28.129 INFO:tasks.workunit.client.1.smithi098.stdout:0/230: getdents df/d17 0 2023-01-04T18:16:28.129 INFO:tasks.workunit.client.1.smithi098.stdout:0/231: fdatasync df/d17/d1c/f47 0 2023-01-04T18:16:28.129 INFO:tasks.workunit.client.1.smithi098.stdout:0/232: write df/d17/d1c/f22 [1336811,74536] 0 2023-01-04T18:16:28.133 INFO:tasks.workunit.client.1.smithi098.stdout:6/229: rename d9/dd/d1f/f2a to d9/dd/de/d20/f3f 0 2023-01-04T18:16:28.135 INFO:tasks.workunit.client.1.smithi098.stdout:8/191: sync 2023-01-04T18:16:28.135 INFO:tasks.workunit.client.1.smithi098.stdout:3/291: sync 2023-01-04T18:16:28.136 INFO:tasks.workunit.client.1.smithi098.stdout:1/173: truncate d1/d8/da/f31 881801 0 2023-01-04T18:16:28.136 INFO:tasks.workunit.client.1.smithi098.stdout:1/174: chown d1/d8/da/f31 300 1 2023-01-04T18:16:28.137 INFO:tasks.workunit.client.1.smithi098.stdout:2/286: truncate d6/dc/d2b/d32/f37 327413 0 2023-01-04T18:16:28.139 INFO:tasks.workunit.client.1.smithi098.stdout:5/215: rmdir d1/d2/d3a 0 2023-01-04T18:16:28.140 INFO:tasks.workunit.client.1.smithi098.stdout:5/216: write d1/d2/f17 [2106346,24816] 0 2023-01-04T18:16:28.141 INFO:tasks.workunit.client.1.smithi098.stdout:5/217: truncate d1/da/f26 645288 0 2023-01-04T18:16:28.141 INFO:tasks.workunit.client.1.smithi098.stdout:9/282: rename d2/d5/d18/d1d/f34 to d2/d53/f5e 0 2023-01-04T18:16:28.142 INFO:tasks.workunit.client.1.smithi098.stdout:6/230: mknod d9/dd/c40 0 2023-01-04T18:16:28.142 INFO:tasks.workunit.client.1.smithi098.stdout:6/231: fdatasync d9/dd/d15/f36 0 2023-01-04T18:16:28.143 INFO:tasks.workunit.client.1.smithi098.stdout:8/192: symlink d6/dc/l34 0 2023-01-04T18:16:28.143 INFO:tasks.workunit.client.1.smithi098.stdout:8/193: chown d6/d11/d15/f1d 1 1 2023-01-04T18:16:28.144 INFO:tasks.workunit.client.1.smithi098.stdout:1/175: mkdir d1/d25/d39 0 2023-01-04T18:16:28.146 INFO:tasks.workunit.client.1.smithi098.stdout:2/287: mknod d6/dc/d2b/c60 0 2023-01-04T18:16:28.147 INFO:tasks.workunit.client.1.smithi098.stdout:5/218: unlink d1/d2/d14/f23 0 2023-01-04T18:16:28.147 INFO:tasks.workunit.client.1.smithi098.stdout:5/219: chown c0 17656 1 2023-01-04T18:16:28.147 INFO:tasks.workunit.client.1.smithi098.stdout:5/220: readlink d1/l40 0 2023-01-04T18:16:28.148 INFO:tasks.workunit.client.1.smithi098.stdout:5/221: chown d1/d2/c7 17759 1 2023-01-04T18:16:28.148 INFO:tasks.workunit.client.1.smithi098.stdout:0/233: dwrite df/d17/f1d [0,4194304] 0 2023-01-04T18:16:28.148 INFO:tasks.workunit.client.1.smithi098.stdout:0/234: getdents df/d17/d1c/d3b 0 2023-01-04T18:16:28.149 INFO:tasks.workunit.client.1.smithi098.stdout:0/235: dread df/d17/d1c/f3a [0,4194304] 0 2023-01-04T18:16:28.149 INFO:tasks.workunit.client.1.smithi098.stdout:9/283: symlink d2/d53/l5f 0 2023-01-04T18:16:28.149 INFO:tasks.workunit.client.1.smithi098.stdout:0/236: fdatasync df/f52 0 2023-01-04T18:16:28.150 INFO:tasks.workunit.client.1.smithi098.stdout:5/222: write d1/d2/f17 [273095,22915] 0 2023-01-04T18:16:28.152 INFO:tasks.workunit.client.1.smithi098.stdout:3/292: rename d6/d4c/f5b to d6/d10/d19/d3f/d5e/f67 0 2023-01-04T18:16:28.152 INFO:tasks.workunit.client.1.smithi098.stdout:6/232: creat d9/dd/d15/f41 x:0 0 0 2023-01-04T18:16:28.153 INFO:tasks.workunit.client.1.smithi098.stdout:8/194: creat d6/d11/d15/d1b/d2a/d33/f35 x:0 0 0 2023-01-04T18:16:28.153 INFO:tasks.workunit.client.1.smithi098.stdout:6/233: read d9/dd/f11 [3457375,109146] 0 2023-01-04T18:16:28.153 INFO:tasks.workunit.client.1.smithi098.stdout:1/176: readlink d1/l1d 0 2023-01-04T18:16:28.154 INFO:tasks.workunit.client.1.smithi098.stdout:2/288: creat d6/dc/d2b/d32/f61 x:0 0 0 2023-01-04T18:16:28.155 INFO:tasks.workunit.client.1.smithi098.stdout:8/195: dread d6/d11/d15/f1f [0,4194304] 0 2023-01-04T18:16:28.163 INFO:tasks.workunit.client.1.smithi098.stdout:5/223: dread d1/d2/f17 [0,4194304] 0 2023-01-04T18:16:28.163 INFO:tasks.workunit.client.1.smithi098.stdout:5/224: readlink d1/d2/d14/l16 0 2023-01-04T18:16:28.164 INFO:tasks.workunit.client.1.smithi098.stdout:5/225: chown d1/da/f26 15 1 2023-01-04T18:16:28.164 INFO:tasks.workunit.client.1.smithi098.stdout:5/226: read - d1/da/f37 zero size 2023-01-04T18:16:28.164 INFO:tasks.workunit.client.1.smithi098.stdout:5/227: write d1/da/f37 [451496,46332] 0 2023-01-04T18:16:28.164 INFO:tasks.workunit.client.1.smithi098.stdout:5/228: write d1/d2/d14/f2d [562047,50230] 0 2023-01-04T18:16:28.164 INFO:tasks.workunit.client.1.smithi098.stdout:5/229: chown d1/da/f34 0 1 2023-01-04T18:16:28.165 INFO:tasks.workunit.client.1.smithi098.stdout:7/195: sync 2023-01-04T18:16:28.165 INFO:tasks.workunit.client.1.smithi098.stdout:4/234: sync 2023-01-04T18:16:28.165 INFO:tasks.workunit.client.1.smithi098.stdout:0/237: mkdir df/d17/d1c/d2c/d41/d4a/d56 0 2023-01-04T18:16:28.165 INFO:tasks.workunit.client.1.smithi098.stdout:9/284: rename d2/l4 to d2/d5/d18/d4e/d42/l60 0 2023-01-04T18:16:28.166 INFO:tasks.workunit.client.1.smithi098.stdout:6/234: link d9/dd/d15/f2d d9/dd/f42 0 2023-01-04T18:16:28.166 INFO:tasks.workunit.client.1.smithi098.stdout:2/289: mknod d6/dc/d2b/d42/d47/d1f/c62 0 2023-01-04T18:16:28.166 INFO:tasks.workunit.client.1.smithi098.stdout:2/290: stat d6/dc/fe 0 2023-01-04T18:16:28.166 INFO:tasks.workunit.client.1.smithi098.stdout:2/291: truncate d6/dc/f1b 872058 0 2023-01-04T18:16:28.167 INFO:tasks.workunit.client.1.smithi098.stdout:3/293: link d6/d10/d19/f63 d6/d56/f68 0 2023-01-04T18:16:28.167 INFO:tasks.workunit.client.1.smithi098.stdout:3/294: chown d6/d10/f40 5531 1 2023-01-04T18:16:28.167 INFO:tasks.workunit.client.1.smithi098.stdout:8/196: mkdir d6/d11/d36 0 2023-01-04T18:16:28.169 INFO:tasks.workunit.client.1.smithi098.stdout:0/238: dread df/f38 [0,4194304] 0 2023-01-04T18:16:28.169 INFO:tasks.workunit.client.1.smithi098.stdout:4/235: link d5/de/d2c/f3a d5/d28/d40/f4a 0 2023-01-04T18:16:28.169 INFO:tasks.workunit.client.1.smithi098.stdout:4/236: chown d5/de 14 1 2023-01-04T18:16:28.170 INFO:tasks.workunit.client.1.smithi098.stdout:7/196: mknod d1/c3f 0 2023-01-04T18:16:28.172 INFO:tasks.workunit.client.1.smithi098.stdout:5/230: rename d1/d2/d32 to d1/da/d44/d45 0 2023-01-04T18:16:28.173 INFO:tasks.workunit.client.1.smithi098.stdout:1/177: dwrite d1/d8/da/f1a [0,4194304] 0 2023-01-04T18:16:28.173 INFO:tasks.workunit.client.1.smithi098.stdout:3/295: mknod d6/c69 0 2023-01-04T18:16:28.175 INFO:tasks.workunit.client.1.smithi098.stdout:0/239: unlink df/d40/l50 0 2023-01-04T18:16:28.177 INFO:tasks.workunit.client.1.smithi098.stdout:4/237: symlink d5/d9/l4b 0 2023-01-04T18:16:28.177 INFO:tasks.workunit.client.1.smithi098.stdout:7/197: getdents d1/d23/d24 0 2023-01-04T18:16:28.179 INFO:tasks.workunit.client.1.smithi098.stdout:6/235: dread d9/dd/d15/f1a [4194304,4194304] 0 2023-01-04T18:16:28.182 INFO:tasks.workunit.client.1.smithi098.stdout:3/296: dread d6/d10/f12 [0,4194304] 0 2023-01-04T18:16:28.182 INFO:tasks.workunit.client.1.smithi098.stdout:3/297: chown d6/d10/d19/f26 51553851 1 2023-01-04T18:16:28.182 INFO:tasks.workunit.client.1.smithi098.stdout:0/240: dread df/f28 [0,4194304] 0 2023-01-04T18:16:28.183 INFO:tasks.workunit.client.1.smithi098.stdout:1/178: unlink d1/d8/ld 0 2023-01-04T18:16:28.183 INFO:tasks.workunit.client.1.smithi098.stdout:0/241: write df/d17/d24/f44 [1215772,130902] 0 2023-01-04T18:16:28.185 INFO:tasks.workunit.client.1.smithi098.stdout:4/238: truncate d5/f16 619047 0 2023-01-04T18:16:28.185 INFO:tasks.workunit.client.1.smithi098.stdout:8/197: mkdir d6/dc/d12/d1e/d37 0 2023-01-04T18:16:28.185 INFO:tasks.workunit.client.1.smithi098.stdout:8/198: chown d6/dc/d12/d20 459503464 1 2023-01-04T18:16:28.185 INFO:tasks.workunit.client.1.smithi098.stdout:3/298: read d6/f15 [1799762,70163] 0 2023-01-04T18:16:28.186 INFO:tasks.workunit.client.1.smithi098.stdout:5/231: mkdir d1/d46 0 2023-01-04T18:16:28.186 INFO:tasks.workunit.client.1.smithi098.stdout:7/198: mkdir d1/d23/d37/d40 0 2023-01-04T18:16:28.187 INFO:tasks.workunit.client.1.smithi098.stdout:0/242: rename f0 to df/d17/d24/f57 0 2023-01-04T18:16:28.187 INFO:tasks.workunit.client.1.smithi098.stdout:9/285: dwrite d2/d5/d18/f1f [0,4194304] 0 2023-01-04T18:16:28.192 INFO:tasks.workunit.client.1.smithi098.stdout:3/299: mkdir d6/d10/d29/d6a 0 2023-01-04T18:16:28.196 INFO:tasks.workunit.client.1.smithi098.stdout:0/243: creat df/d17/d1c/d3b/f58 x:0 0 0 2023-01-04T18:16:28.196 INFO:tasks.workunit.client.1.smithi098.stdout:8/199: creat d6/d11/d15/d1b/d2a/d33/f38 x:0 0 0 2023-01-04T18:16:28.196 INFO:tasks.workunit.client.1.smithi098.stdout:7/199: mknod d1/da/c41 0 2023-01-04T18:16:28.200 INFO:tasks.workunit.client.1.smithi098.stdout:8/200: mkdir d6/dc/d12/d39 0 2023-01-04T18:16:28.200 INFO:tasks.workunit.client.1.smithi098.stdout:8/201: fsync d6/d11/d15/d1b/d2a/d33/f35 0 2023-01-04T18:16:28.202 INFO:tasks.workunit.client.1.smithi098.stdout:9/286: symlink d2/d5/d18/d1d/d23/l61 0 2023-01-04T18:16:28.202 INFO:tasks.workunit.client.1.smithi098.stdout:9/287: stat d2/d5/d18/d19 0 2023-01-04T18:16:28.204 INFO:tasks.workunit.client.1.smithi098.stdout:8/202: creat d6/dc/d12/d1e/d37/f3a x:0 0 0 2023-01-04T18:16:28.207 INFO:tasks.workunit.client.1.smithi098.stdout:9/288: mknod d2/d2d/c62 0 2023-01-04T18:16:28.208 INFO:tasks.workunit.client.1.smithi098.stdout:0/244: write f3 [942984,82994] 0 2023-01-04T18:16:28.208 INFO:tasks.workunit.client.1.smithi098.stdout:0/245: stat df/d17/d24/f34 0 2023-01-04T18:16:28.208 INFO:tasks.workunit.client.1.smithi098.stdout:0/246: fsync df/f52 0 2023-01-04T18:16:28.208 INFO:tasks.workunit.client.1.smithi098.stdout:1/179: dread d1/d8/da/f24 [0,4194304] 0 2023-01-04T18:16:28.208 INFO:tasks.workunit.client.1.smithi098.stdout:0/247: chown df/d17/d24/c2b 16341 1 2023-01-04T18:16:28.210 INFO:tasks.workunit.client.1.smithi098.stdout:1/180: rename d1/d8/da/cf to d1/d2e/c3a 0 2023-01-04T18:16:28.212 INFO:tasks.workunit.client.1.smithi098.stdout:1/181: truncate d1/f1f 245578 0 2023-01-04T18:16:28.212 INFO:tasks.workunit.client.1.smithi098.stdout:9/289: write d2/d5/d18/d4e/d2e/f4d [452893,119990] 0 2023-01-04T18:16:28.212 INFO:tasks.workunit.client.1.smithi098.stdout:9/290: getdents d2/d5/d18/d4e/d2e/d26/d41 0 2023-01-04T18:16:28.214 INFO:tasks.workunit.client.1.smithi098.stdout:9/291: write d2/d5/d18/d1d/f2f [1626612,20436] 0 2023-01-04T18:16:28.214 INFO:tasks.workunit.client.1.smithi098.stdout:9/292: truncate d2/f45 52196 0 2023-01-04T18:16:28.214 INFO:tasks.workunit.client.1.smithi098.stdout:9/293: getdents d2/d5/d18/d4e 0 2023-01-04T18:16:28.215 INFO:tasks.workunit.client.1.smithi098.stdout:9/294: symlink d2/d5/d18/d4e/d2e/d26/l63 0 2023-01-04T18:16:28.217 INFO:tasks.workunit.client.1.smithi098.stdout:1/182: write d1/d8/da/d12/f2b [2950406,61243] 0 2023-01-04T18:16:28.217 INFO:tasks.workunit.client.1.smithi098.stdout:1/183: fdatasync d1/d8/da/f31 0 2023-01-04T18:16:28.217 INFO:tasks.workunit.client.1.smithi098.stdout:9/295: rename d2/f45 to d2/d5/d18/d4e/d42/f64 0 2023-01-04T18:16:28.218 INFO:tasks.workunit.client.1.smithi098.stdout:1/184: truncate d1/d8/da/f17 939907 0 2023-01-04T18:16:28.220 INFO:tasks.workunit.client.1.smithi098.stdout:1/185: creat d1/d8/da/d12/f3b x:0 0 0 2023-01-04T18:16:28.223 INFO:tasks.workunit.client.1.smithi098.stdout:1/186: read d1/f4 [2378040,84] 0 2023-01-04T18:16:28.223 INFO:tasks.workunit.client.1.smithi098.stdout:1/187: write d1/d8/da/d12/f2b [4427292,23243] 0 2023-01-04T18:16:28.223 INFO:tasks.workunit.client.1.smithi098.stdout:1/188: fsync d1/d8/da/f24 0 2023-01-04T18:16:28.227 INFO:tasks.workunit.client.1.smithi098.stdout:6/236: dwrite d9/dd/d15/f2d [0,4194304] 0 2023-01-04T18:16:28.227 INFO:tasks.workunit.client.1.smithi098.stdout:1/189: write f0 [2622907,95147] 0 2023-01-04T18:16:28.234 INFO:tasks.workunit.client.1.smithi098.stdout:3/300: dwrite d6/f41 [0,4194304] 0 2023-01-04T18:16:28.235 INFO:tasks.workunit.client.1.smithi098.stdout:3/301: mkdir d6/d10/d6b 0 2023-01-04T18:16:28.236 INFO:tasks.workunit.client.1.smithi098.stdout:4/239: dwrite d5/d9/f3b [0,4194304] 0 2023-01-04T18:16:28.236 INFO:tasks.workunit.client.1.smithi098.stdout:2/292: dwrite d6/dc/d2b/d42/d47/d31/f59 [0,4194304] 0 2023-01-04T18:16:28.236 INFO:tasks.workunit.client.1.smithi098.stdout:2/293: chown d6/dc/d2b/d42/d47/d35/f55 22824 1 2023-01-04T18:16:28.236 INFO:tasks.workunit.client.1.smithi098.stdout:2/294: fsync d6/dc/f5c 0 2023-01-04T18:16:28.236 INFO:tasks.workunit.client.1.smithi098.stdout:5/232: dwrite d1/da/f26 [0,4194304] 0 2023-01-04T18:16:28.236 INFO:tasks.workunit.client.1.smithi098.stdout:2/295: truncate d6/dc/f5c 97352 0 2023-01-04T18:16:28.237 INFO:tasks.workunit.client.1.smithi098.stdout:0/248: dwrite df/d17/f54 [0,4194304] 0 2023-01-04T18:16:28.237 INFO:tasks.workunit.client.1.smithi098.stdout:3/302: truncate d6/fa 2778549 0 2023-01-04T18:16:28.237 INFO:tasks.workunit.client.1.smithi098.stdout:9/296: fsync d2/f1e 0 2023-01-04T18:16:28.240 INFO:tasks.workunit.client.1.smithi098.stdout:1/190: dread d1/d2e/f37 [0,4194304] 0 2023-01-04T18:16:28.243 INFO:tasks.workunit.client.1.smithi098.stdout:1/191: dread d1/d8/f10 [0,4194304] 0 2023-01-04T18:16:28.243 INFO:tasks.workunit.client.1.smithi098.stdout:1/192: readlink d1/l1d 0 2023-01-04T18:16:28.250 INFO:tasks.workunit.client.1.smithi098.stdout:8/203: rename d6/d11/d15/d1b/d2a/d33 to d6/d11/d15/d1b/d2a/d3b 0 2023-01-04T18:16:28.251 INFO:tasks.workunit.client.1.smithi098.stdout:4/240: mknod d5/de/d30/c4c 0 2023-01-04T18:16:28.253 INFO:tasks.workunit.client.1.smithi098.stdout:4/241: write f4 [625717,103092] 0 2023-01-04T18:16:28.256 INFO:tasks.workunit.client.1.smithi098.stdout:2/296: creat d6/dc/d4b/f63 x:0 0 0 2023-01-04T18:16:28.257 INFO:tasks.workunit.client.1.smithi098.stdout:5/233: symlink d1/l47 0 2023-01-04T18:16:28.257 INFO:tasks.workunit.client.1.smithi098.stdout:5/234: fsync d1/da/f37 0 2023-01-04T18:16:28.257 INFO:tasks.workunit.client.1.smithi098.stdout:5/235: dread - d1/f2e zero size 2023-01-04T18:16:28.267 INFO:tasks.workunit.client.1.smithi098.stdout:3/303: rename d6/d10/f23 to d6/f6c 0 2023-01-04T18:16:28.268 INFO:tasks.workunit.client.1.smithi098.stdout:9/297: creat d2/d53/f65 x:0 0 0 2023-01-04T18:16:28.270 INFO:tasks.workunit.client.1.smithi098.stdout:8/204: dwrite d6/dc/f2e [0,4194304] 0 2023-01-04T18:16:28.272 INFO:tasks.workunit.client.1.smithi098.stdout:2/297: dwrite d6/f10 [0,4194304] 0 2023-01-04T18:16:28.272 INFO:tasks.workunit.client.1.smithi098.stdout:2/298: fsync d6/dc/d2b/d42/d47/d35/f38 0 2023-01-04T18:16:28.281 INFO:tasks.workunit.client.1.smithi098.stdout:2/299: dread d6/f2f [0,4194304] 0 2023-01-04T18:16:28.281 INFO:tasks.workunit.client.1.smithi098.stdout:2/300: chown d6/dc/c13 32593882 1 2023-01-04T18:16:28.285 INFO:tasks.workunit.client.1.smithi098.stdout:1/193: creat d1/d25/f3c x:0 0 0 2023-01-04T18:16:28.287 INFO:tasks.workunit.client.1.smithi098.stdout:4/242: link d5/d28/f2b d5/f4d 0 2023-01-04T18:16:28.288 INFO:tasks.workunit.client.1.smithi098.stdout:4/243: write d5/de/d21/f22 [1127298,1627] 0 2023-01-04T18:16:28.288 INFO:tasks.workunit.client.1.smithi098.stdout:5/236: creat d1/f48 x:0 0 0 2023-01-04T18:16:28.289 INFO:tasks.workunit.client.1.smithi098.stdout:3/304: truncate d6/d10/f1b 1155588 0 2023-01-04T18:16:28.292 INFO:tasks.workunit.client.1.smithi098.stdout:2/301: getdents d6/dc/d2b/d42/d47 0 2023-01-04T18:16:28.292 INFO:tasks.workunit.client.1.smithi098.stdout:8/205: dwrite d6/d11/d15/d1b/d2a/d3b/f35 [0,4194304] 0 2023-01-04T18:16:28.293 INFO:tasks.workunit.client.1.smithi098.stdout:8/206: chown d6/fe 3763 1 2023-01-04T18:16:28.293 INFO:tasks.workunit.client.1.smithi098.stdout:9/298: dwrite d2/f2b [4194304,4194304] 0 2023-01-04T18:16:28.293 INFO:tasks.workunit.client.1.smithi098.stdout:1/194: mknod d1/d25/d39/c3d 0 2023-01-04T18:16:28.293 INFO:tasks.workunit.client.1.smithi098.stdout:1/195: readlink d1/l1d 0 2023-01-04T18:16:28.294 INFO:tasks.workunit.client.1.smithi098.stdout:5/237: creat d1/d46/f49 x:0 0 0 2023-01-04T18:16:28.295 INFO:tasks.workunit.client.1.smithi098.stdout:3/305: unlink d6/d10/c2a 0 2023-01-04T18:16:28.295 INFO:tasks.workunit.client.1.smithi098.stdout:3/306: truncate d6/f54 459757 0 2023-01-04T18:16:28.295 INFO:tasks.workunit.client.1.smithi098.stdout:3/307: chown d6/l37 0 1 2023-01-04T18:16:28.299 INFO:tasks.workunit.client.1.smithi098.stdout:1/196: creat d1/d8/f3e x:0 0 0 2023-01-04T18:16:28.299 INFO:tasks.workunit.client.1.smithi098.stdout:1/197: rename d1/d8 to d1/d8/da/d12/d3f 22 2023-01-04T18:16:28.299 INFO:tasks.workunit.client.1.smithi098.stdout:1/198: write d1/d8/f10 [1007877,30253] 0 2023-01-04T18:16:28.300 INFO:tasks.workunit.client.1.smithi098.stdout:3/308: creat d6/d10/d19/d3f/f6d x:0 0 0 2023-01-04T18:16:28.300 INFO:tasks.workunit.client.1.smithi098.stdout:1/199: getdents d1/d25/d27 0 2023-01-04T18:16:28.300 INFO:tasks.workunit.client.1.smithi098.stdout:3/309: chown d6/f25 243 1 2023-01-04T18:16:28.300 INFO:tasks.workunit.client.1.smithi098.stdout:1/200: readlink d1/d2e/l38 0 2023-01-04T18:16:28.302 INFO:tasks.workunit.client.1.smithi098.stdout:3/310: truncate d6/fa 2546879 0 2023-01-04T18:16:28.303 INFO:tasks.workunit.client.1.smithi098.stdout:3/311: creat d6/d10/d3b/f6e x:0 0 0 2023-01-04T18:16:28.303 INFO:tasks.workunit.client.1.smithi098.stdout:3/312: write d6/d10/d19/f63 [59596,7375] 0 2023-01-04T18:16:28.306 INFO:tasks.workunit.client.1.smithi098.stdout:3/313: mkdir d6/d6f 0 2023-01-04T18:16:28.308 INFO:tasks.workunit.client.1.smithi098.stdout:3/314: mknod d6/d6f/c70 0 2023-01-04T18:16:28.308 INFO:tasks.workunit.client.1.smithi098.stdout:3/315: readlink d6/d10/d19/d3f/d5e/l64 0 2023-01-04T18:16:28.310 INFO:tasks.workunit.client.1.smithi098.stdout:3/316: truncate d6/d10/d3b/f3c 353884 0 2023-01-04T18:16:28.311 INFO:tasks.workunit.client.1.smithi098.stdout:3/317: symlink d6/d10/d29/l71 0 2023-01-04T18:16:28.312 INFO:tasks.workunit.client.1.smithi098.stdout:3/318: truncate d6/d56/f60 311579 0 2023-01-04T18:16:28.312 INFO:tasks.workunit.client.1.smithi098.stdout:3/319: fdatasync d6/d10/f32 0 2023-01-04T18:16:28.313 INFO:tasks.workunit.client.1.smithi098.stdout:3/320: rename d6/d10/d19/l57 to d6/d10/d3b/l72 0 2023-01-04T18:16:28.314 INFO:tasks.workunit.client.1.smithi098.stdout:3/321: write d6/d10/f62 [165674,15229] 0 2023-01-04T18:16:28.316 INFO:tasks.workunit.client.1.smithi098.stdout:2/302: write d6/f10 [2723167,89675] 0 2023-01-04T18:16:28.317 INFO:tasks.workunit.client.1.smithi098.stdout:2/303: readlink d6/dc/d2b/d42/d47/l34 0 2023-01-04T18:16:28.318 INFO:tasks.workunit.client.1.smithi098.stdout:3/322: write d6/f6c [1794205,22205] 0 2023-01-04T18:16:28.319 INFO:tasks.workunit.client.1.smithi098.stdout:8/207: dwrite d6/d11/f1a [0,4194304] 0 2023-01-04T18:16:28.320 INFO:tasks.workunit.client.1.smithi098.stdout:2/304: link d6/dc/d2b/d42/d47/d35/f38 d6/dc/d2b/d42/d47/d1f/d39/f64 0 2023-01-04T18:16:28.324 INFO:tasks.workunit.client.1.smithi098.stdout:8/208: creat d6/d11/d15/d1b/d2a/d3b/f3c x:0 0 0 2023-01-04T18:16:28.337 INFO:tasks.workunit.client.1.smithi098.stdout:9/299: dwrite d2/d5/d18/d4e/d42/f64 [0,4194304] 0 2023-01-04T18:16:28.340 INFO:tasks.workunit.client.1.smithi098.stdout:1/201: dwrite d1/f4 [0,4194304] 0 2023-01-04T18:16:28.343 INFO:tasks.workunit.client.1.smithi098.stdout:2/305: dread d6/dc/f14 [0,4194304] 0 2023-01-04T18:16:28.354 INFO:tasks.workunit.client.1.smithi098.stdout:5/238: dwrite d1/f6 [0,4194304] 0 2023-01-04T18:16:28.355 INFO:tasks.workunit.client.1.smithi098.stdout:5/239: readlink d1/d2f/l31 0 2023-01-04T18:16:28.355 INFO:tasks.workunit.client.1.smithi098.stdout:5/240: chown d1/d1e/l42 59248 1 2023-01-04T18:16:28.357 INFO:tasks.workunit.client.1.smithi098.stdout:8/209: link d6/d11/d15/d1b/c25 d6/d11/d36/c3d 0 2023-01-04T18:16:28.357 INFO:tasks.workunit.client.1.smithi098.stdout:8/210: readlink d6/d11/d15/d1b/l32 0 2023-01-04T18:16:28.357 INFO:tasks.workunit.client.1.smithi098.stdout:8/211: chown d6/d11/d15/c2d 106840338 1 2023-01-04T18:16:28.357 INFO:tasks.workunit.client.1.smithi098.stdout:8/212: truncate d6/d11/d15/d1b/d2a/d3b/f38 975396 0 2023-01-04T18:16:28.359 INFO:tasks.workunit.client.1.smithi098.stdout:9/300: mkdir d2/d5/d18/d1d/d23/d66 0 2023-01-04T18:16:28.359 INFO:tasks.workunit.client.1.smithi098.stdout:9/301: chown d2/d5/d18/f1f 31 1 2023-01-04T18:16:28.364 INFO:tasks.workunit.client.1.smithi098.stdout:3/323: dwrite d6/f15 [0,4194304] 0 2023-01-04T18:16:28.376 INFO:tasks.workunit.client.1.smithi098.stdout:2/306: creat d6/dc/d2b/d42/d47/d1f/d39/f65 x:0 0 0 2023-01-04T18:16:28.380 INFO:tasks.workunit.client.1.smithi098.stdout:8/213: dwrite d6/dc/f29 [4194304,4194304] 0 2023-01-04T18:16:28.381 INFO:tasks.workunit.client.1.smithi098.stdout:5/241: unlink d1/d2/l4 0 2023-01-04T18:16:28.381 INFO:tasks.workunit.client.1.smithi098.stdout:5/242: dread - d1/d2/d14/d19/f35 zero size 2023-01-04T18:16:28.386 INFO:tasks.workunit.client.1.smithi098.stdout:5/243: dread d1/fc [0,4194304] 0 2023-01-04T18:16:28.402 INFO:tasks.workunit.client.1.smithi098.stdout:3/324: rename d6/d10/d19/d3f/d46/l66 to d6/d10/d3b/l73 0 2023-01-04T18:16:28.405 INFO:tasks.workunit.client.1.smithi098.stdout:8/214: unlink c5 0 2023-01-04T18:16:28.406 INFO:tasks.workunit.client.1.smithi098.stdout:5/244: mknod d1/d2/d14/d19/c4a 0 2023-01-04T18:16:28.406 INFO:tasks.workunit.client.1.smithi098.stdout:9/302: dwrite d2/d2d/f50 [0,4194304] 0 2023-01-04T18:16:28.407 INFO:tasks.workunit.client.1.smithi098.stdout:5/245: read d1/d2/d14/d19/f25 [3877716,113416] 0 2023-01-04T18:16:28.410 INFO:tasks.workunit.client.1.smithi098.stdout:8/215: dread d6/fe [0,4194304] 0 2023-01-04T18:16:28.410 INFO:tasks.workunit.client.1.smithi098.stdout:8/216: dread - d6/d11/d15/d1b/d2a/d3b/f3c zero size 2023-01-04T18:16:28.411 INFO:tasks.workunit.client.1.smithi098.stdout:9/303: creat d2/d5/d18/d1d/d23/d66/f67 x:0 0 0 2023-01-04T18:16:28.417 INFO:tasks.workunit.client.1.smithi098.stdout:5/246: unlink d1/da/c12 0 2023-01-04T18:16:28.418 INFO:tasks.workunit.client.1.smithi098.stdout:5/247: mkdir d1/da/d44/d45/d4b 0 2023-01-04T18:16:28.419 INFO:tasks.workunit.client.1.smithi098.stdout:9/304: symlink d2/d5/l68 0 2023-01-04T18:16:28.422 INFO:tasks.workunit.client.1.smithi098.stdout:9/305: write d2/d5/d18/d4e/d2e/d26/d41/f43 [635497,6929] 0 2023-01-04T18:16:28.491 INFO:tasks.workunit.client.1.smithi098.stdout:8/217: read d6/dc/f2e [3047351,69802] 0 2023-01-04T18:16:28.492 INFO:tasks.workunit.client.1.smithi098.stdout:8/218: chown d6/fe 62386 1 2023-01-04T18:16:28.492 INFO:tasks.workunit.client.1.smithi098.stdout:8/219: write d6/d11/d15/d1b/d2a/d3b/f3c [957618,85733] 0 2023-01-04T18:16:28.492 INFO:tasks.workunit.client.1.smithi098.stdout:8/220: unlink d6/dc/l10 0 2023-01-04T18:16:28.493 INFO:tasks.workunit.client.1.smithi098.stdout:8/221: mknod d6/d11/d36/c3e 0 2023-01-04T18:16:28.494 INFO:tasks.workunit.client.1.smithi098.stdout:8/222: chown d6/dc/d12/l1c 75520721 1 2023-01-04T18:16:28.496 INFO:tasks.workunit.client.1.smithi098.stdout:8/223: mknod d6/d11/d36/c3f 0 2023-01-04T18:16:28.499 INFO:tasks.workunit.client.1.smithi098.stdout:9/306: dread d2/d5/f6 [0,4194304] 0 2023-01-04T18:16:28.503 INFO:tasks.workunit.client.1.smithi098.stdout:8/224: dread d6/d11/d15/d1b/d2a/d3b/f3c [0,4194304] 0 2023-01-04T18:16:28.505 INFO:tasks.workunit.client.1.smithi098.stdout:9/307: rmdir d2/d5/d18/d4e/d2e/d26 39 2023-01-04T18:16:28.508 INFO:tasks.workunit.client.1.smithi098.stdout:7/200: sync 2023-01-04T18:16:28.508 INFO:tasks.workunit.client.1.smithi098.stdout:7/201: truncate d1/f3c 1685484 0 2023-01-04T18:16:28.509 INFO:tasks.workunit.client.1.smithi098.stdout:7/202: stat d1/d23/d21 0 2023-01-04T18:16:28.510 INFO:tasks.workunit.client.1.smithi098.stdout:3/325: rename d6/d10/d3b to d6/d10/d19/d3f/d5e/d74 0 2023-01-04T18:16:28.512 INFO:tasks.workunit.client.1.smithi098.stdout:5/248: dwrite d1/d1e/f3e [0,4194304] 0 2023-01-04T18:16:28.514 INFO:tasks.workunit.client.1.smithi098.stdout:7/203: rename d1/da/f3d to d1/d23/d37/f42 0 2023-01-04T18:16:28.515 INFO:tasks.workunit.client.1.smithi098.stdout:3/326: creat d6/d10/f75 x:0 0 0 2023-01-04T18:16:28.524 INFO:tasks.workunit.client.1.smithi098.stdout:5/249: truncate d1/f9 201383 0 2023-01-04T18:16:28.525 INFO:tasks.workunit.client.1.smithi098.stdout:7/204: mkdir d1/d23/d21/d43 0 2023-01-04T18:16:28.526 INFO:tasks.workunit.client.1.smithi098.stdout:7/205: fsync d1/f3c 0 2023-01-04T18:16:28.526 INFO:tasks.workunit.client.1.smithi098.stdout:7/206: readlink d1/da/l3b 0 2023-01-04T18:16:28.526 INFO:tasks.workunit.client.1.smithi098.stdout:3/327: creat d6/d10/d19/f76 x:0 0 0 2023-01-04T18:16:28.527 INFO:tasks.workunit.client.1.smithi098.stdout:5/250: read d1/d2/d14/f27 [119688,98331] 0 2023-01-04T18:16:28.527 INFO:tasks.workunit.client.1.smithi098.stdout:5/251: getdents d1 0 2023-01-04T18:16:28.528 INFO:tasks.workunit.client.1.smithi098.stdout:8/225: dwrite d6/dc/f2e [0,4194304] 0 2023-01-04T18:16:28.528 INFO:tasks.workunit.client.1.smithi098.stdout:5/252: symlink d1/d46/l4c 0 2023-01-04T18:16:28.528 INFO:tasks.workunit.client.1.smithi098.stdout:5/253: getdents d1/d38/d3b 0 2023-01-04T18:16:28.529 INFO:tasks.workunit.client.1.smithi098.stdout:9/308: dwrite d2/d5/d18/d4e/d42/f64 [0,4194304] 0 2023-01-04T18:16:28.530 INFO:tasks.workunit.client.1.smithi098.stdout:7/207: write d1/f22 [1529546,58445] 0 2023-01-04T18:16:28.530 INFO:tasks.workunit.client.1.smithi098.stdout:7/208: write d1/f3c [616649,117945] 0 2023-01-04T18:16:28.530 INFO:tasks.workunit.client.1.smithi098.stdout:3/328: write d6/f21 [3600054,70114] 0 2023-01-04T18:16:28.530 INFO:tasks.workunit.client.1.smithi098.stdout:3/329: fdatasync d6/d10/d19/f76 0 2023-01-04T18:16:28.530 INFO:tasks.workunit.client.1.smithi098.stdout:5/254: dread d1/d2/d14/f2d [0,4194304] 0 2023-01-04T18:16:28.532 INFO:tasks.workunit.client.1.smithi098.stdout:5/255: read d1/da/d44/d45/f39 [6617029,20236] 0 2023-01-04T18:16:28.533 INFO:tasks.workunit.client.1.smithi098.stdout:5/256: chown d1/da/f34 668405 1 2023-01-04T18:16:28.533 INFO:tasks.workunit.client.1.smithi098.stdout:5/257: write d1/d2/d14/d19/f35 [468338,99732] 0 2023-01-04T18:16:28.534 INFO:tasks.workunit.client.1.smithi098.stdout:3/330: getdents d6/d10/d19/d3f/d5e/d74 0 2023-01-04T18:16:28.536 INFO:tasks.workunit.client.1.smithi098.stdout:6/237: sync 2023-01-04T18:16:28.536 INFO:tasks.workunit.client.1.smithi098.stdout:6/238: stat d9/c2f 0 2023-01-04T18:16:28.537 INFO:tasks.workunit.client.1.smithi098.stdout:0/249: sync 2023-01-04T18:16:28.540 INFO:tasks.workunit.client.1.smithi098.stdout:6/239: mkdir d9/dd/d15/d43 0 2023-01-04T18:16:28.540 INFO:tasks.workunit.client.1.smithi098.stdout:9/309: dread d2/d5/f28 [0,4194304] 0 2023-01-04T18:16:28.540 INFO:tasks.workunit.client.1.smithi098.stdout:9/310: chown d2/d5/d18/d4e/d2e/d26/c3d 3388 1 2023-01-04T18:16:28.540 INFO:tasks.workunit.client.1.smithi098.stdout:9/311: getdents d2/d5/d18/d4e 0 2023-01-04T18:16:28.545 INFO:tasks.workunit.client.1.smithi098.stdout:0/250: link df/c29 df/d17/d1c/d2c/d41/d4a/d56/c59 0 2023-01-04T18:16:28.551 INFO:tasks.workunit.client.1.smithi098.stdout:0/251: creat df/d17/d1c/d2c/d41/d4a/d56/f5a x:0 0 0 2023-01-04T18:16:28.551 INFO:tasks.workunit.client.1.smithi098.stdout:0/252: fsync df/f52 0 2023-01-04T18:16:28.560 INFO:tasks.workunit.client.1.smithi098.stdout:3/331: dwrite d6/d10/d19/f76 [0,4194304] 0 2023-01-04T18:16:28.560 INFO:tasks.workunit.client.1.smithi098.stdout:3/332: read - d6/f53 zero size 2023-01-04T18:16:28.560 INFO:tasks.workunit.client.1.smithi098.stdout:3/333: chown d6/d10/f1b 3453 1 2023-01-04T18:16:28.560 INFO:tasks.workunit.client.1.smithi098.stdout:3/334: fsync d6/f6c 0 2023-01-04T18:16:28.562 INFO:tasks.workunit.client.1.smithi098.stdout:7/209: dwrite d1/d23/d24/d26/f30 [0,4194304] 0 2023-01-04T18:16:28.563 INFO:tasks.workunit.client.1.smithi098.stdout:3/335: symlink d6/d10/d19/d3f/d5e/l77 0 2023-01-04T18:16:28.564 INFO:tasks.workunit.client.1.smithi098.stdout:6/240: dread d9/fa [4194304,4194304] 0 2023-01-04T18:16:28.569 INFO:tasks.workunit.client.1.smithi098.stdout:8/226: dwrite d6/d11/d15/d1b/d2a/d3b/f3c [0,4194304] 0 2023-01-04T18:16:28.571 INFO:tasks.workunit.client.1.smithi098.stdout:7/210: symlink d1/d4/l44 0 2023-01-04T18:16:28.571 INFO:tasks.workunit.client.1.smithi098.stdout:3/336: mknod d6/d10/d19/d3f/d46/c78 0 2023-01-04T18:16:28.573 INFO:tasks.workunit.client.1.smithi098.stdout:9/312: dwrite f1 [4194304,4194304] 0 2023-01-04T18:16:28.574 INFO:tasks.workunit.client.1.smithi098.stdout:5/258: dwrite d1/d2/d14/f27 [0,4194304] 0 2023-01-04T18:16:28.574 INFO:tasks.workunit.client.1.smithi098.stdout:5/259: chown d1/d1e/f3e 38 1 2023-01-04T18:16:28.574 INFO:tasks.workunit.client.1.smithi098.stdout:8/227: creat d6/dc/d12/d20/f40 x:0 0 0 2023-01-04T18:16:28.575 INFO:tasks.workunit.client.1.smithi098.stdout:3/337: symlink d6/d10/d19/d3f/d5e/d74/l79 0 2023-01-04T18:16:28.577 INFO:tasks.workunit.client.1.smithi098.stdout:9/313: mknod d2/d5/d18/d4e/c69 0 2023-01-04T18:16:28.577 INFO:tasks.workunit.client.1.smithi098.stdout:9/314: write d2/d5/f24 [3781998,70710] 0 2023-01-04T18:16:28.577 INFO:tasks.workunit.client.1.smithi098.stdout:9/315: write d2/d5/d18/d19/f4b [475373,23352] 0 2023-01-04T18:16:28.579 INFO:tasks.workunit.client.1.smithi098.stdout:0/253: dwrite df/d17/f1d [4194304,4194304] 0 2023-01-04T18:16:28.585 INFO:tasks.workunit.client.1.smithi098.stdout:5/260: mknod d1/d46/c4d 0 2023-01-04T18:16:28.587 INFO:tasks.workunit.client.1.smithi098.stdout:8/228: creat d6/dc/d12/f41 x:0 0 0 2023-01-04T18:16:28.588 INFO:tasks.workunit.client.1.smithi098.stdout:5/261: dread d1/d2/f15 [0,4194304] 0 2023-01-04T18:16:28.588 INFO:tasks.workunit.client.1.smithi098.stdout:3/338: mkdir d6/d10/d19/d3f/d5e/d74/d7a 0 2023-01-04T18:16:28.588 INFO:tasks.workunit.client.1.smithi098.stdout:3/339: write d6/d56/f60 [574233,38670] 0 2023-01-04T18:16:28.589 INFO:tasks.workunit.client.1.smithi098.stdout:3/340: fdatasync d6/d10/d19/f58 0 2023-01-04T18:16:28.589 INFO:tasks.workunit.client.1.smithi098.stdout:6/241: dwrite d9/dd/de/f21 [0,4194304] 0 2023-01-04T18:16:28.590 INFO:tasks.workunit.client.1.smithi098.stdout:9/316: rename d2/d5/d18/d4e/d2e/d26/d41/d57/f5a to d2/d5/d18/d4e/d2e/d26/d41/f6a 0 2023-01-04T18:16:28.590 INFO:tasks.workunit.client.1.smithi098.stdout:9/317: read d2/f10 [144458,94880] 0 2023-01-04T18:16:28.592 INFO:tasks.workunit.client.1.smithi098.stdout:7/211: dwrite d1/d23/d24/f19 [0,4194304] 0 2023-01-04T18:16:28.593 INFO:tasks.workunit.client.1.smithi098.stdout:0/254: mknod df/d17/d1c/d2c/d41/d4a/d56/c5b 0 2023-01-04T18:16:28.594 INFO:tasks.workunit.client.1.smithi098.stdout:5/262: getdents d1/d2/d14 0 2023-01-04T18:16:28.598 INFO:tasks.workunit.client.1.smithi098.stdout:6/242: mkdir d9/dd/de/d44 0 2023-01-04T18:16:28.598 INFO:tasks.workunit.client.1.smithi098.stdout:6/243: stat d9/dd/d15/f2d 0 2023-01-04T18:16:28.599 INFO:tasks.workunit.client.1.smithi098.stdout:3/341: dread d6/d10/f12 [0,4194304] 0 2023-01-04T18:16:28.600 INFO:tasks.workunit.client.1.smithi098.stdout:0/255: mkdir df/d40/d5c 0 2023-01-04T18:16:28.601 INFO:tasks.workunit.client.1.smithi098.stdout:5/263: rmdir d1/d1e 39 2023-01-04T18:16:28.604 INFO:tasks.workunit.client.1.smithi098.stdout:4/244: sync 2023-01-04T18:16:28.604 INFO:tasks.workunit.client.1.smithi098.stdout:1/202: sync 2023-01-04T18:16:28.604 INFO:tasks.workunit.client.1.smithi098.stdout:1/203: stat d1/f4 0 2023-01-04T18:16:28.604 INFO:tasks.workunit.client.1.smithi098.stdout:1/204: chown d1/d25/f3c 0 1 2023-01-04T18:16:28.606 INFO:tasks.workunit.client.1.smithi098.stdout:5/264: dread d1/d2/f15 [0,4194304] 0 2023-01-04T18:16:28.606 INFO:tasks.workunit.client.1.smithi098.stdout:5/265: dread - d1/d38/f41 zero size 2023-01-04T18:16:28.607 INFO:tasks.workunit.client.1.smithi098.stdout:6/244: dread d9/dd/f42 [0,4194304] 0 2023-01-04T18:16:28.607 INFO:tasks.workunit.client.1.smithi098.stdout:3/342: creat d6/d10/d19/d3f/d5e/d74/f7b x:0 0 0 2023-01-04T18:16:28.608 INFO:tasks.workunit.client.1.smithi098.stdout:0/256: creat df/d4f/f5d x:0 0 0 2023-01-04T18:16:28.608 INFO:tasks.workunit.client.1.smithi098.stdout:8/229: dwrite d6/d11/f1a [0,4194304] 0 2023-01-04T18:16:28.608 INFO:tasks.workunit.client.1.smithi098.stdout:8/230: chown d6/f9 993 1 2023-01-04T18:16:28.610 INFO:tasks.workunit.client.1.smithi098.stdout:2/307: sync 2023-01-04T18:16:28.610 INFO:tasks.workunit.client.1.smithi098.stdout:2/308: readlink d6/dc/d2b/d42/d47/d1f/l4f 0 2023-01-04T18:16:28.613 INFO:tasks.workunit.client.1.smithi098.stdout:1/205: dread d1/f1b [0,4194304] 0 2023-01-04T18:16:28.614 INFO:tasks.workunit.client.1.smithi098.stdout:4/245: rename d5/de/d21/c1d to d5/de/d30/c4e 0 2023-01-04T18:16:28.615 INFO:tasks.workunit.client.1.smithi098.stdout:0/257: dread f5 [4194304,4194304] 0 2023-01-04T18:16:28.615 INFO:tasks.workunit.client.1.smithi098.stdout:6/245: mknod d9/dd/d24/c45 0 2023-01-04T18:16:28.617 INFO:tasks.workunit.client.1.smithi098.stdout:3/343: getdents d6/d56 0 2023-01-04T18:16:28.618 INFO:tasks.workunit.client.1.smithi098.stdout:8/231: symlink d6/d11/l42 0 2023-01-04T18:16:28.618 INFO:tasks.workunit.client.1.smithi098.stdout:8/232: stat d6/dc/d12/d1e/d37 0 2023-01-04T18:16:28.618 INFO:tasks.workunit.client.1.smithi098.stdout:2/309: fsync d6/f15 0 2023-01-04T18:16:28.618 INFO:tasks.workunit.client.1.smithi098.stdout:2/310: truncate d6/dc/d2b/d46/f48 445664 0 2023-01-04T18:16:28.619 INFO:tasks.workunit.client.1.smithi098.stdout:7/212: dwrite d1/f22 [0,4194304] 0 2023-01-04T18:16:28.619 INFO:tasks.workunit.client.1.smithi098.stdout:7/213: fsync d1/d4/f29 0 2023-01-04T18:16:28.619 INFO:tasks.workunit.client.1.smithi098.stdout:1/206: creat d1/d25/d36/f40 x:0 0 0 2023-01-04T18:16:28.620 INFO:tasks.workunit.client.1.smithi098.stdout:4/246: mkdir d5/de/d30/d4f 0 2023-01-04T18:16:28.620 INFO:tasks.workunit.client.1.smithi098.stdout:6/246: write d9/dd/d1f/f27 [3273251,51305] 0 2023-01-04T18:16:28.620 INFO:tasks.workunit.client.1.smithi098.stdout:6/247: chown d9/dd/l18 86 1 2023-01-04T18:16:28.621 INFO:tasks.workunit.client.1.smithi098.stdout:0/258: unlink df/d17/d1c/d2c/l3d 0 2023-01-04T18:16:28.621 INFO:tasks.workunit.client.1.smithi098.stdout:3/344: rmdir d6/d10/d19/d3f/d5e 39 2023-01-04T18:16:28.622 INFO:tasks.workunit.client.1.smithi098.stdout:8/233: truncate d6/f9 399844 0 2023-01-04T18:16:28.623 INFO:tasks.workunit.client.1.smithi098.stdout:1/207: rename d1/d8/da/d12/f16 to d1/d8/da/d12/f41 0 2023-01-04T18:16:28.624 INFO:tasks.workunit.client.1.smithi098.stdout:4/247: creat d5/d9/d13/f50 x:0 0 0 2023-01-04T18:16:28.624 INFO:tasks.workunit.client.1.smithi098.stdout:4/248: chown f4 61910 1 2023-01-04T18:16:28.626 INFO:tasks.workunit.client.1.smithi098.stdout:0/259: rename df/f38 to df/d17/d1c/d2c/f5e 0 2023-01-04T18:16:28.627 INFO:tasks.workunit.client.1.smithi098.stdout:8/234: creat d6/d11/d15/f43 x:0 0 0 2023-01-04T18:16:28.628 INFO:tasks.workunit.client.1.smithi098.stdout:1/208: mknod d1/d25/d36/c42 0 2023-01-04T18:16:28.628 INFO:tasks.workunit.client.1.smithi098.stdout:6/248: dread d9/dd/f42 [0,4194304] 0 2023-01-04T18:16:28.629 INFO:tasks.workunit.client.1.smithi098.stdout:3/345: rename d6/d10/f12 to d6/d10/d6b/f7c 0 2023-01-04T18:16:28.629 INFO:tasks.workunit.client.1.smithi098.stdout:3/346: fsync d6/f53 0 2023-01-04T18:16:28.629 INFO:tasks.workunit.client.1.smithi098.stdout:3/347: fsync d6/f41 0 2023-01-04T18:16:28.630 INFO:tasks.workunit.client.1.smithi098.stdout:7/214: dread d1/f7 [0,4194304] 0 2023-01-04T18:16:28.631 INFO:tasks.workunit.client.1.smithi098.stdout:0/260: unlink df/d17/d1c/f2f 0 2023-01-04T18:16:28.632 INFO:tasks.workunit.client.1.smithi098.stdout:0/261: write df/d4f/f55 [743351,33659] 0 2023-01-04T18:16:28.633 INFO:tasks.workunit.client.1.smithi098.stdout:6/249: write d9/dd/f11 [1458676,116268] 0 2023-01-04T18:16:28.633 INFO:tasks.workunit.client.1.smithi098.stdout:6/250: chown d9/dd/de 23836 1 2023-01-04T18:16:28.633 INFO:tasks.workunit.client.1.smithi098.stdout:0/262: dread df/d17/d1c/f3a [0,4194304] 0 2023-01-04T18:16:28.633 INFO:tasks.workunit.client.1.smithi098.stdout:3/348: dread d6/d10/d29/f61 [0,4194304] 0 2023-01-04T18:16:28.634 INFO:tasks.workunit.client.1.smithi098.stdout:1/209: write d1/d2e/f37 [3342607,51835] 0 2023-01-04T18:16:28.635 INFO:tasks.workunit.client.1.smithi098.stdout:5/266: dwrite d1/d1e/f3e [0,4194304] 0 2023-01-04T18:16:28.635 INFO:tasks.workunit.client.1.smithi098.stdout:6/251: write d9/dd/f42 [3164445,6305] 0 2023-01-04T18:16:28.637 INFO:tasks.workunit.client.1.smithi098.stdout:1/210: dread d1/d8/f28 [0,4194304] 0 2023-01-04T18:16:28.637 INFO:tasks.workunit.client.1.smithi098.stdout:3/349: rmdir d6/d10/d19/d3f/d46 39 2023-01-04T18:16:28.637 INFO:tasks.workunit.client.1.smithi098.stdout:2/311: dwrite d6/dc/d2b/f40 [0,4194304] 0 2023-01-04T18:16:28.638 INFO:tasks.workunit.client.1.smithi098.stdout:5/267: dread d1/fc [0,4194304] 0 2023-01-04T18:16:28.638 INFO:tasks.workunit.client.1.smithi098.stdout:0/263: mkdir df/d17/d1c/d2c/d41/d4a/d4c/d5f 0 2023-01-04T18:16:28.638 INFO:tasks.workunit.client.1.smithi098.stdout:3/350: write d6/d10/d19/d3f/d5e/d74/f52 [662248,42525] 0 2023-01-04T18:16:28.638 INFO:tasks.workunit.client.1.smithi098.stdout:3/351: truncate d6/f15 4737495 0 2023-01-04T18:16:28.638 INFO:tasks.workunit.client.1.smithi098.stdout:3/352: write d6/d10/d19/d3f/d5e/d74/f52 [4293332,103298] 0 2023-01-04T18:16:28.642 INFO:tasks.workunit.client.1.smithi098.stdout:6/252: creat d9/dd/d24/d3e/f46 x:0 0 0 2023-01-04T18:16:28.643 INFO:tasks.workunit.client.1.smithi098.stdout:1/211: rename d1/l1d to d1/d25/d39/l43 0 2023-01-04T18:16:28.645 INFO:tasks.workunit.client.1.smithi098.stdout:2/312: symlink d6/dc/d2b/d32/l66 0 2023-01-04T18:16:28.645 INFO:tasks.workunit.client.1.smithi098.stdout:2/313: fdatasync d6/dc/d2b/d42/d47/d35/f49 0 2023-01-04T18:16:28.645 INFO:tasks.workunit.client.1.smithi098.stdout:0/264: truncate f3 1503737 0 2023-01-04T18:16:28.646 INFO:tasks.workunit.client.1.smithi098.stdout:6/253: symlink d9/dd/de/l47 0 2023-01-04T18:16:28.648 INFO:tasks.workunit.client.1.smithi098.stdout:3/353: rename d6/d4c to d6/d10/d19/d3f/d5e/d7d 0 2023-01-04T18:16:28.648 INFO:tasks.workunit.client.1.smithi098.stdout:2/314: creat d6/dc/d2b/d42/d47/d35/f67 x:0 0 0 2023-01-04T18:16:28.649 INFO:tasks.workunit.client.1.smithi098.stdout:0/265: truncate df/d17/f2a 3812458 0 2023-01-04T18:16:28.650 INFO:tasks.workunit.client.1.smithi098.stdout:2/315: rmdir d6/dc/d2b/d46 39 2023-01-04T18:16:28.650 INFO:tasks.workunit.client.1.smithi098.stdout:0/266: creat df/f60 x:0 0 0 2023-01-04T18:16:28.651 INFO:tasks.workunit.client.1.smithi098.stdout:2/316: creat d6/dc/d2b/d42/d47/d1f/f68 x:0 0 0 2023-01-04T18:16:28.653 INFO:tasks.workunit.client.1.smithi098.stdout:2/317: write d6/f16 [635174,9296] 0 2023-01-04T18:16:28.653 INFO:tasks.workunit.client.1.smithi098.stdout:2/318: write d6/dc/d2b/d42/d51/f54 [257050,2410] 0 2023-01-04T18:16:28.655 INFO:tasks.workunit.client.1.smithi098.stdout:2/319: creat d6/dc/d2b/d42/f69 x:0 0 0 2023-01-04T18:16:28.665 INFO:tasks.workunit.client.1.smithi098.stdout:6/254: write d9/dd/f11 [3089068,114014] 0 2023-01-04T18:16:28.667 INFO:tasks.workunit.client.1.smithi098.stdout:6/255: rmdir d9/dd/de/d26 39 2023-01-04T18:16:28.676 INFO:tasks.workunit.client.1.smithi098.stdout:2/320: dread d6/dc/d2b/d42/d47/d1f/f30 [0,4194304] 0 2023-01-04T18:16:28.677 INFO:tasks.workunit.client.1.smithi098.stdout:5/268: dread d1/da/d44/d45/f39 [4194304,4194304] 0 2023-01-04T18:16:28.678 INFO:tasks.workunit.client.1.smithi098.stdout:2/321: mknod d6/dc/d2b/d42/c6a 0 2023-01-04T18:16:28.679 INFO:tasks.workunit.client.1.smithi098.stdout:2/322: write d6/dc/f1b [1881722,78842] 0 2023-01-04T18:16:28.679 INFO:tasks.workunit.client.1.smithi098.stdout:2/323: write d6/f45 [532239,115967] 0 2023-01-04T18:16:28.682 INFO:tasks.workunit.client.1.smithi098.stdout:2/324: creat d6/dc/d2b/d42/d47/d31/f6b x:0 0 0 2023-01-04T18:16:28.682 INFO:tasks.workunit.client.1.smithi098.stdout:2/325: chown d6/dc/d2b/d42/d47/c4d 4019558 1 2023-01-04T18:16:28.685 INFO:tasks.workunit.client.1.smithi098.stdout:2/326: rename d6/dc/d2b/d42/d47/d1f/c62 to d6/dc/d2b/d42/d47/d35/c6c 0 2023-01-04T18:16:28.688 INFO:tasks.workunit.client.1.smithi098.stdout:2/327: rename d6/dc/d2b/c44 to d6/c6d 0 2023-01-04T18:16:28.690 INFO:tasks.workunit.client.1.smithi098.stdout:2/328: mkdir d6/dc/d2b/d42/d47/d1f/d39/d6e 0 2023-01-04T18:16:28.690 INFO:tasks.workunit.client.1.smithi098.stdout:6/256: dread d9/dd/d15/f1a [4194304,4194304] 0 2023-01-04T18:16:28.692 INFO:tasks.workunit.client.1.smithi098.stdout:6/257: rename d9/dd/d24/c45 to d9/dd/c48 0 2023-01-04T18:16:28.692 INFO:tasks.workunit.client.1.smithi098.stdout:6/258: dread - d9/dd/d15/f36 zero size 2023-01-04T18:16:28.693 INFO:tasks.workunit.client.1.smithi098.stdout:2/329: unlink d6/c2a 0 2023-01-04T18:16:28.693 INFO:tasks.workunit.client.1.smithi098.stdout:6/259: mknod d9/dd/c49 0 2023-01-04T18:16:28.694 INFO:tasks.workunit.client.1.smithi098.stdout:6/260: chown d9/dd/d24/d3e/f46 1240 1 2023-01-04T18:16:28.705 INFO:tasks.workunit.client.1.smithi098.stdout:2/330: dread d6/dc/d2b/d42/d47/d35/f38 [0,4194304] 0 2023-01-04T18:16:28.706 INFO:tasks.workunit.client.1.smithi098.stdout:4/249: dwrite d5/de/d2c/f3a [0,4194304] 0 2023-01-04T18:16:28.706 INFO:tasks.workunit.client.1.smithi098.stdout:4/250: chown d5/d9/d13/f2a 1092 1 2023-01-04T18:16:28.706 INFO:tasks.workunit.client.1.smithi098.stdout:7/215: dwrite d1/d23/d24/d26/f30 [0,4194304] 0 2023-01-04T18:16:28.706 INFO:tasks.workunit.client.1.smithi098.stdout:0/267: dwrite df/d17/d1c/f1e [0,4194304] 0 2023-01-04T18:16:28.706 INFO:tasks.workunit.client.1.smithi098.stdout:0/268: dread - df/d4f/f5d zero size 2023-01-04T18:16:28.706 INFO:tasks.workunit.client.1.smithi098.stdout:0/269: dread - df/d17/d1c/f47 zero size 2023-01-04T18:16:28.706 INFO:tasks.workunit.client.1.smithi098.stdout:0/270: write df/d4f/f5d [566914,10434] 0 2023-01-04T18:16:28.707 INFO:tasks.workunit.client.1.smithi098.stdout:3/354: dwrite d6/f25 [0,4194304] 0 2023-01-04T18:16:28.707 INFO:tasks.workunit.client.1.smithi098.stdout:1/212: dwrite d1/d8/da/f17 [0,4194304] 0 2023-01-04T18:16:28.707 INFO:tasks.workunit.client.1.smithi098.stdout:5/269: dwrite d1/f6 [0,4194304] 0 2023-01-04T18:16:28.708 INFO:tasks.workunit.client.1.smithi098.stdout:1/213: write d1/d8/da/d12/f41 [1189721,128760] 0 2023-01-04T18:16:28.720 INFO:tasks.workunit.client.1.smithi098.stdout:2/331: creat d6/dc/d2b/d42/d47/d1f/f6f x:0 0 0 2023-01-04T18:16:28.723 INFO:tasks.workunit.client.1.smithi098.stdout:4/251: link d5/f47 d5/d28/f51 0 2023-01-04T18:16:28.723 INFO:tasks.workunit.client.1.smithi098.stdout:4/252: chown d5/de/d30/d4f 3733 1 2023-01-04T18:16:28.725 INFO:tasks.workunit.client.1.smithi098.stdout:7/216: rename d1/f22 to d1/f45 0 2023-01-04T18:16:28.725 INFO:tasks.workunit.client.1.smithi098.stdout:3/355: dwrite d6/d10/f75 [0,4194304] 0 2023-01-04T18:16:28.726 INFO:tasks.workunit.client.1.smithi098.stdout:7/217: write d1/d2e/f35 [798690,46607] 0 2023-01-04T18:16:28.726 INFO:tasks.workunit.client.1.smithi098.stdout:3/356: chown d6/d10/f50 6 1 2023-01-04T18:16:28.728 INFO:tasks.workunit.client.1.smithi098.stdout:6/261: getdents d9/dd/d24 0 2023-01-04T18:16:28.729 INFO:tasks.workunit.client.1.smithi098.stdout:2/332: dread d6/f33 [0,4194304] 0 2023-01-04T18:16:28.734 INFO:tasks.workunit.client.1.smithi098.stdout:0/271: rename df/d17/c30 to df/d17/d1c/d2c/d41/d4a/d4c/c61 0 2023-01-04T18:16:28.742 INFO:tasks.workunit.client.1.smithi098.stdout:4/253: dwrite d5/d9/d13/f3d [0,4194304] 0 2023-01-04T18:16:28.742 INFO:tasks.workunit.client.1.smithi098.stdout:4/254: read d5/f8 [1745,67607] 0 2023-01-04T18:16:28.742 INFO:tasks.workunit.client.1.smithi098.stdout:4/255: chown d5/de/d30 525604641 1 2023-01-04T18:16:28.745 INFO:tasks.workunit.client.1.smithi098.stdout:0/272: dread df/d4f/f51 [0,4194304] 0 2023-01-04T18:16:28.745 INFO:tasks.workunit.client.1.smithi098.stdout:0/273: chown ld 1019 1 2023-01-04T18:16:28.749 INFO:tasks.workunit.client.1.smithi098.stdout:5/270: symlink d1/d38/l4e 0 2023-01-04T18:16:28.749 INFO:tasks.workunit.client.1.smithi098.stdout:5/271: readlink d1/d2/d14/l21 0 2023-01-04T18:16:28.749 INFO:tasks.workunit.client.1.smithi098.stdout:5/272: fsync d1/da/d44/d45/f39 0 2023-01-04T18:16:28.749 INFO:tasks.workunit.client.1.smithi098.stdout:5/273: fsync d1/d2/d14/d19/f35 0 2023-01-04T18:16:28.749 INFO:tasks.workunit.client.1.smithi098.stdout:5/274: fsync d1/d2/d14/f27 0 2023-01-04T18:16:28.752 INFO:tasks.workunit.client.1.smithi098.stdout:1/214: rmdir d1/d25/d39 39 2023-01-04T18:16:28.756 INFO:tasks.workunit.client.1.smithi098.stdout:7/218: mknod d1/d23/c46 0 2023-01-04T18:16:28.756 INFO:tasks.workunit.client.1.smithi098.stdout:3/357: mknod d6/d10/d29/c7e 0 2023-01-04T18:16:28.757 INFO:tasks.workunit.client.1.smithi098.stdout:6/262: mknod d9/dd/c4a 0 2023-01-04T18:16:28.758 INFO:tasks.workunit.client.1.smithi098.stdout:6/263: chown d9/dd/de/d26/c3c 113756 1 2023-01-04T18:16:28.758 INFO:tasks.workunit.client.1.smithi098.stdout:3/358: write d6/d10/f40 [1441709,8729] 0 2023-01-04T18:16:28.758 INFO:tasks.workunit.client.1.smithi098.stdout:2/333: creat d6/dc/d2b/f70 x:0 0 0 2023-01-04T18:16:28.762 INFO:tasks.workunit.client.1.smithi098.stdout:7/219: dread d1/d2e/f35 [0,4194304] 0 2023-01-04T18:16:28.762 INFO:tasks.workunit.client.1.smithi098.stdout:7/220: chown d1/d4/d11/f38 3460 1 2023-01-04T18:16:28.764 INFO:tasks.workunit.client.1.smithi098.stdout:0/274: truncate df/d17/d24/f57 1833739 0 2023-01-04T18:16:28.764 INFO:tasks.workunit.client.1.smithi098.stdout:0/275: chown df/d17/l37 2504 1 2023-01-04T18:16:28.765 INFO:tasks.workunit.client.1.smithi098.stdout:5/275: unlink d1/da/d44/d45/f39 0 2023-01-04T18:16:28.767 INFO:tasks.workunit.client.1.smithi098.stdout:4/256: truncate d5/d9/d13/f33 146777 0 2023-01-04T18:16:28.768 INFO:tasks.workunit.client.1.smithi098.stdout:4/257: chown d5/d9/f36 698160 1 2023-01-04T18:16:28.769 INFO:tasks.workunit.client.1.smithi098.stdout:7/221: creat d1/f47 x:0 0 0 2023-01-04T18:16:28.769 INFO:tasks.workunit.client.1.smithi098.stdout:7/222: chown d1/d4 611655974 1 2023-01-04T18:16:28.770 INFO:tasks.workunit.client.1.smithi098.stdout:0/276: mknod df/d17/d1c/c62 0 2023-01-04T18:16:28.773 INFO:tasks.workunit.client.1.smithi098.stdout:1/215: rename d1/d8/da/d12/f20 to d1/f44 0 2023-01-04T18:16:28.773 INFO:tasks.workunit.client.1.smithi098.stdout:5/276: dread d1/f1d [0,4194304] 0 2023-01-04T18:16:28.774 INFO:tasks.workunit.client.1.smithi098.stdout:4/258: creat d5/d28/d40/f52 x:0 0 0 2023-01-04T18:16:28.776 INFO:tasks.workunit.client.1.smithi098.stdout:7/223: unlink d1/d4/d11/c1d 0 2023-01-04T18:16:28.776 INFO:tasks.workunit.client.1.smithi098.stdout:7/224: chown d1/d23/d24/d26/f30 0 1 2023-01-04T18:16:28.776 INFO:tasks.workunit.client.1.smithi098.stdout:7/225: write d1/d4/d11/f38 [478502,66688] 0 2023-01-04T18:16:28.779 INFO:tasks.workunit.client.1.smithi098.stdout:2/334: rename d6/dc/d2b/d42/d47/d1f/d39/f5d to d6/dc/d2b/d42/f71 0 2023-01-04T18:16:28.781 INFO:tasks.workunit.client.1.smithi098.stdout:3/359: dwrite d6/d10/d19/f58 [0,4194304] 0 2023-01-04T18:16:28.781 INFO:tasks.workunit.client.1.smithi098.stdout:3/360: write d6/d10/d19/d3f/f47 [209359,40270] 0 2023-01-04T18:16:28.781 INFO:tasks.workunit.client.1.smithi098.stdout:6/264: dwrite d9/dd/d15/f41 [0,4194304] 0 2023-01-04T18:16:28.782 INFO:tasks.workunit.client.1.smithi098.stdout:6/265: chown d9/dd 1 1 2023-01-04T18:16:28.782 INFO:tasks.workunit.client.1.smithi098.stdout:4/259: getdents d5/d9/d13 0 2023-01-04T18:16:28.782 INFO:tasks.workunit.client.1.smithi098.stdout:1/216: symlink d1/d8/da/l45 0 2023-01-04T18:16:28.783 INFO:tasks.workunit.client.1.smithi098.stdout:7/226: mknod d1/da/c48 0 2023-01-04T18:16:28.786 INFO:tasks.workunit.client.1.smithi098.stdout:0/277: creat df/d17/d1c/d2c/d41/d4a/d4c/d5f/f63 x:0 0 0 2023-01-04T18:16:28.789 INFO:tasks.workunit.client.1.smithi098.stdout:2/335: rename d6/dc/d2b/d32/f3b to d6/dc/d2b/d42/d47/d35/f72 0 2023-01-04T18:16:28.795 INFO:tasks.workunit.client.1.smithi098.stdout:4/260: creat d5/de/d2c/f53 x:0 0 0 2023-01-04T18:16:28.795 INFO:tasks.workunit.client.1.smithi098.stdout:8/235: sync 2023-01-04T18:16:28.796 INFO:tasks.workunit.client.1.smithi098.stdout:9/318: sync 2023-01-04T18:16:28.796 INFO:tasks.workunit.client.1.smithi098.stdout:3/361: dwrite d6/d10/d19/f58 [0,4194304] 0 2023-01-04T18:16:28.798 INFO:tasks.workunit.client.1.smithi098.stdout:1/217: getdents d1/d25/d36 0 2023-01-04T18:16:28.798 INFO:tasks.workunit.client.1.smithi098.stdout:7/227: truncate d1/da/f1e 507469 0 2023-01-04T18:16:28.801 INFO:tasks.workunit.client.1.smithi098.stdout:0/278: mkdir df/d17/d1c/d2c/d41/d64 0 2023-01-04T18:16:28.802 INFO:tasks.workunit.client.1.smithi098.stdout:5/277: rename d1/d2/f3 to d1/da/d44/d45/d4b/f4f 0 2023-01-04T18:16:28.804 INFO:tasks.workunit.client.1.smithi098.stdout:2/336: link d6/dc/d2b/d42/d47/d1f/d39/f64 d6/dc/d2b/d42/f73 0 2023-01-04T18:16:28.807 INFO:tasks.workunit.client.1.smithi098.stdout:7/228: dread d1/d23/d24/f19 [0,4194304] 0 2023-01-04T18:16:28.807 INFO:tasks.workunit.client.1.smithi098.stdout:7/229: fsync d1/d23/f2c 0 2023-01-04T18:16:28.814 INFO:tasks.workunit.client.1.smithi098.stdout:9/319: symlink d2/d5/d18/d4e/d2e/d26/d41/d57/l6b 0 2023-01-04T18:16:28.819 INFO:tasks.workunit.client.1.smithi098.stdout:6/266: rename d9/dd/de/l25 to d9/dd/de/d20/l4b 0 2023-01-04T18:16:28.819 INFO:tasks.workunit.client.1.smithi098.stdout:6/267: chown d9/dd/de/d20/c28 27 1 2023-01-04T18:16:28.820 INFO:tasks.workunit.client.1.smithi098.stdout:0/279: dread df/d17/d24/f57 [0,4194304] 0 2023-01-04T18:16:28.820 INFO:tasks.workunit.client.1.smithi098.stdout:0/280: readlink df/d17/d24/l39 0 2023-01-04T18:16:28.826 INFO:tasks.workunit.client.1.smithi098.stdout:7/230: creat d1/f49 x:0 0 0 2023-01-04T18:16:28.826 INFO:tasks.workunit.client.1.smithi098.stdout:8/236: mkdir d6/dc/d12/d1e/d44 0 2023-01-04T18:16:28.826 INFO:tasks.workunit.client.1.smithi098.stdout:9/320: mknod d2/d5/d18/d1d/d23/c6c 0 2023-01-04T18:16:28.827 INFO:tasks.workunit.client.1.smithi098.stdout:5/278: rename d1/d38/l4e to d1/d2/d14/d19/l50 0 2023-01-04T18:16:28.829 INFO:tasks.workunit.client.1.smithi098.stdout:0/281: creat df/d17/d1c/d2c/d41/d4a/f65 x:0 0 0 2023-01-04T18:16:28.829 INFO:tasks.workunit.client.1.smithi098.stdout:0/282: readlink la 0 2023-01-04T18:16:28.829 INFO:tasks.workunit.client.1.smithi098.stdout:0/283: chown df/d17/l37 346678894 1 2023-01-04T18:16:28.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:27.760556+0000 mon.smithi050 (mon.0) 587 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:16:28.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:27.912607+0000 mgr.smithi098.vhfzum (mgr.24455) 15 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 283 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.9 MiB/s rd, 9.1 MiB/s wr, 398 op/s 2023-01-04T18:16:28.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:28.280265+0000 mon.smithi050 (mon.0) 588 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:16:28.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:28.293119+0000 mon.smithi050 (mon.0) 589 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:16:28.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:28.306288+0000 mon.smithi050 (mon.0) 590 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:16:28.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:28.320396+0000 mon.smithi050 (mon.0) 591 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:16:28.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:28.339343+0000 mon.smithi050 (mon.0) 592 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:16:28.831 INFO:tasks.workunit.client.1.smithi098.stdout:7/231: mknod d1/d23/d21/c4a 0 2023-01-04T18:16:28.832 INFO:tasks.workunit.client.1.smithi098.stdout:9/321: symlink d2/d5/d18/d4e/d42/l6d 0 2023-01-04T18:16:28.835 INFO:tasks.workunit.client.1.smithi098.stdout:2/337: rename d6/f10 to d6/dc/d2b/d42/d47/d1f/d39/d6e/f74 0 2023-01-04T18:16:28.836 INFO:tasks.workunit.client.1.smithi098.stdout:5/279: mkdir d1/d1e/d51 0 2023-01-04T18:16:28.837 INFO:tasks.workunit.client.1.smithi098.stdout:6/268: dwrite d9/fa [0,4194304] 0 2023-01-04T18:16:28.839 INFO:tasks.workunit.client.1.smithi098.stdout:0/284: link df/d17/f4b df/d17/d1c/d2c/d41/d4a/d4c/f66 0 2023-01-04T18:16:28.840 INFO:tasks.workunit.client.1.smithi098.stdout:8/237: dread d6/d11/f1a [4194304,4194304] 0 2023-01-04T18:16:28.840 INFO:tasks.workunit.client.1.smithi098.stdout:3/362: dwrite d6/d10/d19/f63 [0,4194304] 0 2023-01-04T18:16:28.840 INFO:tasks.workunit.client.1.smithi098.stdout:3/363: fdatasync d6/d10/d19/d3f/f2f 0 2023-01-04T18:16:28.842 INFO:tasks.workunit.client.1.smithi098.stdout:9/322: dread d2/d5/f6 [4194304,4194304] 0 2023-01-04T18:16:28.843 INFO:tasks.workunit.client.1.smithi098.stdout:4/261: dwrite d5/de/d2c/f3e [0,4194304] 0 2023-01-04T18:16:28.843 INFO:tasks.workunit.client.1.smithi098.stdout:7/232: rename d1/f7 to d1/d23/d21/f4b 0 2023-01-04T18:16:28.845 INFO:tasks.workunit.client.1.smithi098.stdout:5/280: creat d1/da/d44/f52 x:0 0 0 2023-01-04T18:16:28.847 INFO:tasks.workunit.client.1.smithi098.stdout:6/269: mkdir d9/dd/de/d26/d4c 0 2023-01-04T18:16:28.850 INFO:tasks.workunit.client.1.smithi098.stdout:8/238: rmdir d6/d11/d15/d1b/d2a/d3b 39 2023-01-04T18:16:28.851 INFO:tasks.workunit.client.1.smithi098.stdout:3/364: unlink d6/c8 0 2023-01-04T18:16:28.853 INFO:tasks.workunit.client.1.smithi098.stdout:0/285: dread df/d17/d24/f44 [0,4194304] 0 2023-01-04T18:16:28.854 INFO:tasks.workunit.client.1.smithi098.stdout:9/323: mknod d2/d5/d18/d4e/d2e/c6e 0 2023-01-04T18:16:28.854 INFO:tasks.workunit.client.1.smithi098.stdout:9/324: chown d2/d5/d18/d4e/d42/l60 609097 1 2023-01-04T18:16:28.855 INFO:tasks.workunit.client.1.smithi098.stdout:0/286: write f3 [904739,57376] 0 2023-01-04T18:16:28.855 INFO:tasks.workunit.client.1.smithi098.stdout:0/287: write df/d17/f4b [663823,52590] 0 2023-01-04T18:16:28.855 INFO:tasks.workunit.client.1.smithi098.stdout:5/281: symlink d1/da/d44/l53 0 2023-01-04T18:16:28.858 INFO:tasks.workunit.client.1.smithi098.stdout:6/270: mknod d9/dd/d15/d43/c4d 0 2023-01-04T18:16:28.859 INFO:tasks.workunit.client.1.smithi098.stdout:4/262: dread f4 [0,4194304] 0 2023-01-04T18:16:28.859 INFO:tasks.workunit.client.1.smithi098.stdout:2/338: dwrite d6/dc/d2b/d42/d47/d1f/d39/f64 [0,4194304] 0 2023-01-04T18:16:28.859 INFO:tasks.workunit.client.1.smithi098.stdout:5/282: mknod d1/d2/d14/c54 0 2023-01-04T18:16:28.859 INFO:tasks.workunit.client.1.smithi098.stdout:5/283: chown d1/d2f/l31 15340 1 2023-01-04T18:16:28.859 INFO:tasks.workunit.client.1.smithi098.stdout:0/288: mknod df/d17/d1c/d3b/c67 0 2023-01-04T18:16:28.863 INFO:tasks.workunit.client.1.smithi098.stdout:7/233: dwrite d1/f45 [0,4194304] 0 2023-01-04T18:16:28.864 INFO:tasks.workunit.client.1.smithi098.stdout:7/234: read d1/d2e/f35 [631662,101089] 0 2023-01-04T18:16:28.864 INFO:tasks.workunit.client.1.smithi098.stdout:8/239: unlink d6/dc/d12/d1e/c26 0 2023-01-04T18:16:28.864 INFO:tasks.workunit.client.1.smithi098.stdout:8/240: chown d6/dc/d12/f41 0 1 2023-01-04T18:16:28.867 INFO:tasks.workunit.client.1.smithi098.stdout:3/365: symlink d6/d10/d19/l7f 0 2023-01-04T18:16:28.868 INFO:tasks.workunit.client.1.smithi098.stdout:3/366: truncate d6/d10/d19/d3f/d5e/d74/f6e 52172 0 2023-01-04T18:16:28.868 INFO:tasks.workunit.client.1.smithi098.stdout:4/263: symlink d5/d28/d40/l54 0 2023-01-04T18:16:28.870 INFO:tasks.workunit.client.1.smithi098.stdout:5/284: creat d1/da/d44/d45/f55 x:0 0 0 2023-01-04T18:16:28.870 INFO:tasks.workunit.client.1.smithi098.stdout:5/285: chown d1 53736 1 2023-01-04T18:16:28.871 INFO:tasks.workunit.client.1.smithi098.stdout:0/289: mkdir df/d17/d68 0 2023-01-04T18:16:28.871 INFO:tasks.workunit.client.1.smithi098.stdout:0/290: write f3 [1970926,15312] 0 2023-01-04T18:16:28.872 INFO:tasks.workunit.client.1.smithi098.stdout:7/235: creat d1/d2e/f4c x:0 0 0 2023-01-04T18:16:28.873 INFO:tasks.workunit.client.1.smithi098.stdout:8/241: truncate d6/dc/f29 870080 0 2023-01-04T18:16:28.875 INFO:tasks.workunit.client.1.smithi098.stdout:3/367: rmdir d6/d10/d19/d3f/d5e/d74/d7a 0 2023-01-04T18:16:28.877 INFO:tasks.workunit.client.1.smithi098.stdout:9/325: dwrite d2/d5/f6 [8388608,4194304] 0 2023-01-04T18:16:28.877 INFO:tasks.workunit.client.1.smithi098.stdout:4/264: truncate d5/d9/d13/f3d 3609827 0 2023-01-04T18:16:28.879 INFO:tasks.workunit.client.1.smithi098.stdout:5/286: mknod d1/d38/c56 0 2023-01-04T18:16:28.879 INFO:tasks.workunit.client.1.smithi098.stdout:0/291: creat df/d17/d1c/d2c/d41/d4a/d56/f69 x:0 0 0 2023-01-04T18:16:28.879 INFO:tasks.workunit.client.1.smithi098.stdout:5/287: fsync d1/f18 0 2023-01-04T18:16:28.881 INFO:tasks.workunit.client.1.smithi098.stdout:6/271: dwrite d9/dd/d15/f41 [0,4194304] 0 2023-01-04T18:16:28.881 INFO:tasks.workunit.client.1.smithi098.stdout:4/265: symlink d5/de/d30/d4f/l55 0 2023-01-04T18:16:28.882 INFO:tasks.workunit.client.1.smithi098.stdout:5/288: rmdir d1/d1e 39 2023-01-04T18:16:28.883 INFO:tasks.workunit.client.1.smithi098.stdout:2/339: dwrite d6/dc/d2b/d42/d51/f54 [0,4194304] 0 2023-01-04T18:16:28.883 INFO:tasks.workunit.client.1.smithi098.stdout:2/340: dread - d6/dc/d2b/d42/d47/d31/f6b zero size 2023-01-04T18:16:28.883 INFO:tasks.workunit.client.1.smithi098.stdout:0/292: creat df/d17/d1c/d2c/d41/d4a/d56/f6a x:0 0 0 2023-01-04T18:16:28.883 INFO:tasks.workunit.client.1.smithi098.stdout:6/272: read d9/dd/de/d26/f2e [919763,46152] 0 2023-01-04T18:16:28.883 INFO:tasks.workunit.client.1.smithi098.stdout:6/273: dread - d9/dd/d24/d3e/f46 zero size 2023-01-04T18:16:28.883 INFO:tasks.workunit.client.1.smithi098.stdout:6/274: chown d9/dd/d15/f1a 32 1 2023-01-04T18:16:28.884 INFO:tasks.workunit.client.1.smithi098.stdout:9/326: mkdir d2/d5/d6f 0 2023-01-04T18:16:28.884 INFO:tasks.workunit.client.1.smithi098.stdout:9/327: stat d2/d5/d18/d19 0 2023-01-04T18:16:28.890 INFO:tasks.workunit.client.1.smithi098.stdout:4/266: rename d5/d9/d13/f2e to d5/d28/d40/f56 0 2023-01-04T18:16:28.890 INFO:tasks.workunit.client.1.smithi098.stdout:4/267: chown d5/d28/d40/f56 7662 1 2023-01-04T18:16:28.890 INFO:tasks.workunit.client.1.smithi098.stdout:8/242: fsync d6/dc/f29 0 2023-01-04T18:16:28.895 INFO:tasks.workunit.client.1.smithi098.stdout:5/289: dread d1/f18 [0,4194304] 0 2023-01-04T18:16:28.898 INFO:tasks.workunit.client.1.smithi098.stdout:0/293: mkdir df/d4f/d6b 0 2023-01-04T18:16:28.899 INFO:tasks.workunit.client.1.smithi098.stdout:6/275: unlink d9/dd/l18 0 2023-01-04T18:16:28.901 INFO:tasks.workunit.client.1.smithi098.stdout:2/341: rename d6/dc/d2b/d32/l4e to d6/dc/d2b/d42/l75 0 2023-01-04T18:16:28.901 INFO:tasks.workunit.client.1.smithi098.stdout:8/243: creat d6/dc/d12/d20/f45 x:0 0 0 2023-01-04T18:16:28.902 INFO:tasks.workunit.client.1.smithi098.stdout:8/244: stat d6/dc/d12/l22 0 2023-01-04T18:16:28.902 INFO:tasks.workunit.client.1.smithi098.stdout:7/236: dwrite d1/f20 [0,4194304] 0 2023-01-04T18:16:28.908 INFO:tasks.workunit.client.1.smithi098.stdout:6/276: dread d9/dd/de/f1e [0,4194304] 0 2023-01-04T18:16:28.910 INFO:tasks.workunit.client.1.smithi098.stdout:5/290: symlink d1/da/d44/l57 0 2023-01-04T18:16:28.910 INFO:tasks.workunit.client.1.smithi098.stdout:5/291: write d1/da/d44/d45/f55 [706810,22208] 0 2023-01-04T18:16:28.911 INFO:tasks.workunit.client.1.smithi098.stdout:5/292: truncate d1/d46/f49 31364 0 2023-01-04T18:16:28.911 INFO:tasks.workunit.client.1.smithi098.stdout:5/293: write d1/da/f37 [123560,105707] 0 2023-01-04T18:16:28.913 INFO:tasks.workunit.client.1.smithi098.stdout:0/294: link f3 df/d17/d1c/d2c/d41/d4a/d4c/f6c 0 2023-01-04T18:16:28.913 INFO:tasks.workunit.client.1.smithi098.stdout:0/295: fsync df/d17/d1c/f3a 0 2023-01-04T18:16:28.913 INFO:tasks.workunit.client.1.smithi098.stdout:0/296: chown la 324480057 1 2023-01-04T18:16:28.913 INFO:tasks.workunit.client.1.smithi098.stdout:2/342: dread d6/dc/d2b/d42/d47/d35/f55 [0,4194304] 0 2023-01-04T18:16:28.913 INFO:tasks.workunit.client.1.smithi098.stdout:2/343: dread - d6/dc/d2b/d42/d47/d1f/d39/f65 zero size 2023-01-04T18:16:28.914 INFO:tasks.workunit.client.1.smithi098.stdout:9/328: link d2/d5/l68 d2/d5/l70 0 2023-01-04T18:16:28.916 INFO:tasks.workunit.client.1.smithi098.stdout:6/277: truncate d9/f17 7546210 0 2023-01-04T18:16:28.916 INFO:tasks.workunit.client.1.smithi098.stdout:6/278: chown d9/dd/de/d20/l39 16517908 1 2023-01-04T18:16:28.917 INFO:tasks.workunit.client.1.smithi098.stdout:5/294: symlink d1/d38/l58 0 2023-01-04T18:16:28.919 INFO:tasks.workunit.client.1.smithi098.stdout:0/297: mkdir df/d17/d1c/d2c/d41/d4a/d6d 0 2023-01-04T18:16:28.921 INFO:tasks.workunit.client.1.smithi098.stdout:2/344: link d6/dc/l19 d6/dc/d2b/d42/d47/d1f/l76 0 2023-01-04T18:16:28.921 INFO:tasks.workunit.client.1.smithi098.stdout:0/298: getdents df/d17/d1c/d2c 0 2023-01-04T18:16:28.923 INFO:tasks.workunit.client.1.smithi098.stdout:9/329: dread d2/d5/d18/d4e/d2e/d26/d41/f43 [0,4194304] 0 2023-01-04T18:16:28.924 INFO:tasks.workunit.client.1.smithi098.stdout:2/345: rename d6/dc/d2b/d42/d47/d1f/f30 to d6/dc/d2b/d42/d47/d1f/d39/d6e/f77 0 2023-01-04T18:16:28.927 INFO:tasks.workunit.client.1.smithi098.stdout:8/245: dwrite d6/d11/d15/d1b/d2a/d3b/f3c [4194304,4194304] 0 2023-01-04T18:16:28.927 INFO:tasks.workunit.client.1.smithi098.stdout:9/330: creat d2/d5/d18/d1d/f71 x:0 0 0 2023-01-04T18:16:28.927 INFO:tasks.workunit.client.1.smithi098.stdout:9/331: read - d2/d5/d18/d4e/d2e/d26/d41/f6a zero size 2023-01-04T18:16:28.927 INFO:tasks.workunit.client.1.smithi098.stdout:9/332: truncate d2/d5/d18/d1d/f71 658348 0 2023-01-04T18:16:28.927 INFO:tasks.workunit.client.1.smithi098.stdout:9/333: write d2/d5/d18/d1d/d23/d66/f67 [403504,13955] 0 2023-01-04T18:16:28.929 INFO:tasks.workunit.client.1.smithi098.stdout:8/246: rmdir d6/d11/d15/d1b/d2a/d3b 39 2023-01-04T18:16:28.929 INFO:tasks.workunit.client.1.smithi098.stdout:8/247: readlink d6/dc/l14 0 2023-01-04T18:16:28.930 INFO:tasks.workunit.client.1.smithi098.stdout:9/334: mkdir d2/d5/d18/d4e/d2e/d26/d41/d57/d72 0 2023-01-04T18:16:28.932 INFO:tasks.workunit.client.1.smithi098.stdout:8/248: rename d6/dc/d12/l1c to d6/d11/l46 0 2023-01-04T18:16:28.933 INFO:tasks.workunit.client.1.smithi098.stdout:7/237: dwrite d1/d23/d24/d26/f30 [0,4194304] 0 2023-01-04T18:16:28.933 INFO:tasks.workunit.client.1.smithi098.stdout:0/299: dread df/d17/f1d [0,4194304] 0 2023-01-04T18:16:28.934 INFO:tasks.workunit.client.1.smithi098.stdout:8/249: dread d6/d11/d15/f1d [0,4194304] 0 2023-01-04T18:16:28.934 INFO:tasks.workunit.client.1.smithi098.stdout:9/335: unlink d2/d53/c5b 0 2023-01-04T18:16:28.934 INFO:tasks.workunit.client.1.smithi098.stdout:9/336: chown d2/c49 2899270 1 2023-01-04T18:16:28.937 INFO:tasks.workunit.client.1.smithi098.stdout:7/238: rename d1/l9 to d1/d4/l4d 0 2023-01-04T18:16:28.938 INFO:tasks.workunit.client.1.smithi098.stdout:7/239: write d1/f20 [915985,102855] 0 2023-01-04T18:16:28.938 INFO:tasks.workunit.client.1.smithi098.stdout:7/240: fdatasync d1/f49 0 2023-01-04T18:16:28.939 INFO:tasks.workunit.client.1.smithi098.stdout:0/300: unlink df/d17/d1c/f31 0 2023-01-04T18:16:28.942 INFO:tasks.workunit.client.1.smithi098.stdout:8/250: creat d6/dc/d12/d39/f47 x:0 0 0 2023-01-04T18:16:28.943 INFO:tasks.workunit.client.1.smithi098.stdout:9/337: mknod d2/d5/d18/d1d/d23/d66/c73 0 2023-01-04T18:16:28.946 INFO:tasks.workunit.client.1.smithi098.stdout:6/279: dwrite d9/dd/d15/f36 [0,4194304] 0 2023-01-04T18:16:28.946 INFO:tasks.workunit.client.1.smithi098.stdout:7/241: creat d1/d23/d37/d40/f4e x:0 0 0 2023-01-04T18:16:28.948 INFO:tasks.workunit.client.1.smithi098.stdout:0/301: mkdir df/d4f/d6e 0 2023-01-04T18:16:28.948 INFO:tasks.workunit.client.1.smithi098.stdout:5/295: dwrite d1/da/d44/f52 [0,4194304] 0 2023-01-04T18:16:28.948 INFO:tasks.workunit.client.1.smithi098.stdout:5/296: chown d1/d46/f49 165680 1 2023-01-04T18:16:28.948 INFO:tasks.workunit.client.1.smithi098.stdout:2/346: dwrite d6/dc/d2b/f2e [0,4194304] 0 2023-01-04T18:16:28.948 INFO:tasks.workunit.client.1.smithi098.stdout:8/251: getdents d6/d11/d15/d1b/d2a 0 2023-01-04T18:16:28.953 INFO:tasks.workunit.client.1.smithi098.stdout:9/338: symlink d2/d5/d6f/l74 0 2023-01-04T18:16:28.954 INFO:tasks.workunit.client.1.smithi098.stdout:6/280: dread d9/dd/de/f21 [0,4194304] 0 2023-01-04T18:16:28.954 INFO:tasks.workunit.client.1.smithi098.stdout:6/281: chown d9/dd/d15/f36 232260 1 2023-01-04T18:16:28.954 INFO:tasks.workunit.client.1.smithi098.stdout:6/282: fsync d9/dd/d15/f41 0 2023-01-04T18:16:28.956 INFO:tasks.workunit.client.1.smithi098.stdout:7/242: creat d1/d23/d21/f4f x:0 0 0 2023-01-04T18:16:28.956 INFO:tasks.workunit.client.1.smithi098.stdout:0/302: mknod df/d17/d68/c6f 0 2023-01-04T18:16:28.962 INFO:tasks.workunit.client.1.smithi098.stdout:5/297: mkdir d1/d2/d14/d59 0 2023-01-04T18:16:28.963 INFO:tasks.workunit.client.1.smithi098.stdout:5/298: write d1/d38/f41 [809526,92727] 0 2023-01-04T18:16:28.963 INFO:tasks.workunit.client.1.smithi098.stdout:5/299: write d1/f48 [831653,77077] 0 2023-01-04T18:16:28.964 INFO:tasks.workunit.client.1.smithi098.stdout:0/303: dread df/d17/d1c/f1e [0,4194304] 0 2023-01-04T18:16:28.965 INFO:tasks.workunit.client.1.smithi098.stdout:0/304: fdatasync df/d17/d1c/d2c/d41/d4a/d56/f69 0 2023-01-04T18:16:28.965 INFO:tasks.workunit.client.1.smithi098.stdout:0/305: fdatasync df/d17/f2d 0 2023-01-04T18:16:28.967 INFO:tasks.workunit.client.1.smithi098.stdout:2/347: creat d6/f78 x:0 0 0 2023-01-04T18:16:28.967 INFO:tasks.workunit.client.1.smithi098.stdout:2/348: readlink d6/dc/d2b/d42/d47/d1f/l76 0 2023-01-04T18:16:28.969 INFO:tasks.workunit.client.1.smithi098.stdout:8/252: creat d6/dc/d12/f48 x:0 0 0 2023-01-04T18:16:28.969 INFO:tasks.workunit.client.1.smithi098.stdout:8/253: write d6/d11/f1a [241614,66624] 0 2023-01-04T18:16:28.971 INFO:tasks.workunit.client.1.smithi098.stdout:9/339: rmdir d2/d5/d18/d4e 39 2023-01-04T18:16:28.972 INFO:tasks.workunit.client.1.smithi098.stdout:9/340: write d2/d5/d18/d19/f54 [1585596,93778] 0 2023-01-04T18:16:28.972 INFO:tasks.workunit.client.1.smithi098.stdout:9/341: write d2/d5/d18/d4e/d2e/d26/d41/d57/f59 [983255,111857] 0 2023-01-04T18:16:28.974 INFO:tasks.workunit.client.1.smithi098.stdout:5/300: unlink d1/f9 0 2023-01-04T18:16:28.974 INFO:tasks.workunit.client.1.smithi098.stdout:9/342: read d2/d5/d18/d19/f3b [2401675,75220] 0 2023-01-04T18:16:28.975 INFO:tasks.workunit.client.1.smithi098.stdout:0/306: truncate f1 2156839 0 2023-01-04T18:16:28.976 INFO:tasks.workunit.client.1.smithi098.stdout:2/349: mkdir d6/dc/d2b/d42/d51/d79 0 2023-01-04T18:16:28.978 INFO:tasks.workunit.client.1.smithi098.stdout:5/301: creat d1/f5a x:0 0 0 2023-01-04T18:16:28.981 INFO:tasks.workunit.client.1.smithi098.stdout:9/343: creat d2/d5/f75 x:0 0 0 2023-01-04T18:16:28.981 INFO:tasks.workunit.client.1.smithi098.stdout:0/307: truncate df/d4f/f51 2044625 0 2023-01-04T18:16:28.981 INFO:tasks.workunit.client.1.smithi098.stdout:0/308: write df/d4f/f55 [1288036,124044] 0 2023-01-04T18:16:28.981 INFO:tasks.workunit.client.1.smithi098.stdout:0/309: readlink ld 0 2023-01-04T18:16:28.981 INFO:tasks.workunit.client.1.smithi098.stdout:2/350: write f5 [3997920,66875] 0 2023-01-04T18:16:28.982 INFO:tasks.workunit.client.1.smithi098.stdout:5/302: rmdir d1/d1e/d51 0 2023-01-04T18:16:28.984 INFO:tasks.workunit.client.1.smithi098.stdout:9/344: mkdir d2/d5/d18/d4e/d2e/d26/d76 0 2023-01-04T18:16:28.984 INFO:tasks.workunit.client.1.smithi098.stdout:9/345: write d2/d5/f75 [609232,32950] 0 2023-01-04T18:16:28.984 INFO:tasks.workunit.client.1.smithi098.stdout:9/346: chown d2/d5/d18/d4e/d42 349 1 2023-01-04T18:16:28.986 INFO:tasks.workunit.client.1.smithi098.stdout:7/243: dwrite d1/d2e/f35 [0,4194304] 0 2023-01-04T18:16:28.987 INFO:tasks.workunit.client.1.smithi098.stdout:0/310: rmdir df/d17/d1c/d2c/d41 39 2023-01-04T18:16:28.987 INFO:tasks.workunit.client.1.smithi098.stdout:6/283: dwrite d9/dd/d15/f2d [0,4194304] 0 2023-01-04T18:16:28.988 INFO:tasks.workunit.client.1.smithi098.stdout:8/254: dwrite d6/dc/d12/d20/f40 [0,4194304] 0 2023-01-04T18:16:28.988 INFO:tasks.workunit.client.1.smithi098.stdout:8/255: write d6/d11/d15/f43 [120661,12588] 0 2023-01-04T18:16:28.991 INFO:tasks.workunit.client.1.smithi098.stdout:2/351: rename d6/dc/d2b/d46/f53 to d6/dc/d2b/d42/d47/d1f/f7a 0 2023-01-04T18:16:28.992 INFO:tasks.workunit.client.1.smithi098.stdout:2/352: truncate d6/dc/d2b/d32/f61 466530 0 2023-01-04T18:16:28.992 INFO:tasks.workunit.client.1.smithi098.stdout:2/353: fdatasync d6/dc/d2b/d42/d47/d1f/f22 0 2023-01-04T18:16:28.992 INFO:tasks.workunit.client.1.smithi098.stdout:0/311: read df/f14 [1402383,116680] 0 2023-01-04T18:16:28.992 INFO:tasks.workunit.client.1.smithi098.stdout:0/312: fdatasync df/d17/d1c/d2c/f5e 0 2023-01-04T18:16:28.993 INFO:tasks.workunit.client.1.smithi098.stdout:0/313: read df/d17/d1c/d2c/d41/d4a/d4c/f6c [1866575,69445] 0 2023-01-04T18:16:28.993 INFO:tasks.workunit.client.1.smithi098.stdout:0/314: read - df/d17/d1c/d2c/d41/d4a/d56/f5a zero size 2023-01-04T18:16:28.993 INFO:tasks.workunit.client.1.smithi098.stdout:0/315: write df/d17/d1c/f47 [724343,20778] 0 2023-01-04T18:16:28.994 INFO:tasks.workunit.client.1.smithi098.stdout:0/316: truncate df/d17/d1c/f3a 1029619 0 2023-01-04T18:16:28.994 INFO:tasks.workunit.client.1.smithi098.stdout:5/303: unlink d1/d38/c56 0 2023-01-04T18:16:28.994 INFO:tasks.workunit.client.1.smithi098.stdout:9/347: creat d2/d5/f77 x:0 0 0 2023-01-04T18:16:29.001 INFO:tasks.workunit.client.1.smithi098.stdout:1/218: sync 2023-01-04T18:16:29.002 INFO:tasks.workunit.client.1.smithi098.stdout:8/256: dwrite d6/d11/d15/d1b/d2a/d3b/f38 [0,4194304] 0 2023-01-04T18:16:29.005 INFO:tasks.workunit.client.1.smithi098.stdout:6/284: rename d9/dd/d15/d43 to d9/dd/d4e 0 2023-01-04T18:16:29.005 INFO:tasks.workunit.client.1.smithi098.stdout:9/348: dread d2/d5/d18/d4e/d2e/d26/f4a [0,4194304] 0 2023-01-04T18:16:29.006 INFO:tasks.workunit.client.1.smithi098.stdout:2/354: truncate d6/dc/d2b/f36 3681291 0 2023-01-04T18:16:29.006 INFO:tasks.workunit.client.1.smithi098.stdout:2/355: stat d6/dc/d2b/d42/d47/d1f/f3a 0 2023-01-04T18:16:29.008 INFO:tasks.workunit.client.1.smithi098.stdout:0/317: rmdir df/d4f 39 2023-01-04T18:16:29.011 INFO:tasks.workunit.client.1.smithi098.stdout:1/219: creat d1/d8/da/d12/f46 x:0 0 0 2023-01-04T18:16:29.013 INFO:tasks.workunit.client.1.smithi098.stdout:8/257: symlink d6/dc/d12/d1e/d37/l49 0 2023-01-04T18:16:29.014 INFO:tasks.workunit.client.1.smithi098.stdout:6/285: creat d9/dd/d4e/f4f x:0 0 0 2023-01-04T18:16:29.015 INFO:tasks.workunit.client.1.smithi098.stdout:9/349: mkdir d2/d5/d18/d4e/d2e/d78 0 2023-01-04T18:16:29.015 INFO:tasks.workunit.client.1.smithi098.stdout:5/304: dwrite d1/d2/f17 [0,4194304] 0 2023-01-04T18:16:29.015 INFO:tasks.workunit.client.1.smithi098.stdout:2/356: mknod d6/dc/d2b/d42/d47/d35/c7b 0 2023-01-04T18:16:29.017 INFO:tasks.workunit.client.1.smithi098.stdout:0/318: rmdir df/d17/d1c 39 2023-01-04T18:16:29.017 INFO:tasks.workunit.client.1.smithi098.stdout:0/319: chown df/d17/l35 2 1 2023-01-04T18:16:29.017 INFO:tasks.workunit.client.1.smithi098.stdout:7/244: dwrite d1/da/f1b [0,4194304] 0 2023-01-04T18:16:29.018 INFO:tasks.workunit.client.1.smithi098.stdout:1/220: rmdir d1/d25/d36 39 2023-01-04T18:16:29.019 INFO:tasks.workunit.client.1.smithi098.stdout:8/258: rename d6/d11/d15/l16 to d6/d11/l4a 0 2023-01-04T18:16:29.021 INFO:tasks.workunit.client.1.smithi098.stdout:6/286: mknod d9/c50 0 2023-01-04T18:16:29.021 INFO:tasks.workunit.client.1.smithi098.stdout:6/287: chown d9/dd/d24/d3e 2052192316 1 2023-01-04T18:16:29.021 INFO:tasks.workunit.client.1.smithi098.stdout:6/288: write d9/dd/d24/d3e/f46 [261518,44902] 0 2023-01-04T18:16:29.021 INFO:tasks.workunit.client.1.smithi098.stdout:6/289: chown d9/dd/d15/f41 18780 1 2023-01-04T18:16:29.022 INFO:tasks.workunit.client.1.smithi098.stdout:9/350: truncate d2/d53/f5e 98877 0 2023-01-04T18:16:29.023 INFO:tasks.workunit.client.1.smithi098.stdout:5/305: creat d1/da/d44/d45/f5b x:0 0 0 2023-01-04T18:16:29.023 INFO:tasks.workunit.client.1.smithi098.stdout:5/306: fdatasync d1/da/d44/d45/d4b/f4f 0 2023-01-04T18:16:29.023 INFO:tasks.workunit.client.1.smithi098.stdout:5/307: chown d1/d2/d14/f2d 2794063 1 2023-01-04T18:16:29.023 INFO:tasks.workunit.client.1.smithi098.stdout:5/308: fsync d1/da/d44/f52 0 2023-01-04T18:16:29.023 INFO:tasks.workunit.client.1.smithi098.stdout:5/309: stat d1/d2/d14/f27 0 2023-01-04T18:16:29.024 INFO:tasks.workunit.client.1.smithi098.stdout:2/357: creat d6/dc/d2b/d46/f7c x:0 0 0 2023-01-04T18:16:29.026 INFO:tasks.workunit.client.1.smithi098.stdout:0/320: symlink df/d17/d1c/d2c/d41/d4a/d4c/l70 0 2023-01-04T18:16:29.032 INFO:tasks.workunit.client.1.smithi098.stdout:9/351: dread d2/d5/f28 [0,4194304] 0 2023-01-04T18:16:29.032 INFO:tasks.workunit.client.1.smithi098.stdout:9/352: fsync d2/d5/f28 0 2023-01-04T18:16:29.039 INFO:tasks.workunit.client.1.smithi098.stdout:6/290: dwrite d9/dd/de/d26/f2e [0,4194304] 0 2023-01-04T18:16:29.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:27.760556+0000 mon.smithi050 (mon.0) 587 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:16:29.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:27.912607+0000 mgr.smithi098.vhfzum (mgr.24455) 15 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 283 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.9 MiB/s rd, 9.1 MiB/s wr, 398 op/s 2023-01-04T18:16:29.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:28.280265+0000 mon.smithi050 (mon.0) 588 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:16:29.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:28.293119+0000 mon.smithi050 (mon.0) 589 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:16:29.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:28.306288+0000 mon.smithi050 (mon.0) 590 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:16:29.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:28.320396+0000 mon.smithi050 (mon.0) 591 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:16:29.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:28.339343+0000 mon.smithi050 (mon.0) 592 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:16:29.041 INFO:tasks.workunit.client.1.smithi098.stdout:6/291: write d9/dd/d15/f41 [3821282,38432] 0 2023-01-04T18:16:29.042 INFO:tasks.workunit.client.1.smithi098.stdout:7/245: link d1/da/l3b d1/d23/d37/d40/l50 0 2023-01-04T18:16:29.043 INFO:tasks.workunit.client.1.smithi098.stdout:1/221: symlink d1/d8/da/l47 0 2023-01-04T18:16:29.045 INFO:tasks.workunit.client.1.smithi098.stdout:8/259: unlink d6/d11/d36/c3e 0 2023-01-04T18:16:29.048 INFO:tasks.workunit.client.1.smithi098.stdout:8/260: dread d6/d11/d15/f43 [0,4194304] 0 2023-01-04T18:16:29.048 INFO:tasks.workunit.client.1.smithi098.stdout:8/261: stat d6/d11/d15/f1d 0 2023-01-04T18:16:29.048 INFO:tasks.workunit.client.1.smithi098.stdout:5/310: truncate d1/f1d 490409 0 2023-01-04T18:16:29.049 INFO:tasks.workunit.client.1.smithi098.stdout:2/358: rmdir d6/dc/d2b/d42/d47/d31 39 2023-01-04T18:16:29.050 INFO:tasks.workunit.client.1.smithi098.stdout:2/359: write d6/dc/d2b/d42/d47/d35/f55 [250941,46301] 0 2023-01-04T18:16:29.050 INFO:tasks.workunit.client.1.smithi098.stdout:2/360: readlink d6/dc/d2b/d32/l3d 0 2023-01-04T18:16:29.051 INFO:tasks.workunit.client.1.smithi098.stdout:0/321: rename la to df/d4f/d6b/l71 0 2023-01-04T18:16:29.051 INFO:tasks.workunit.client.1.smithi098.stdout:0/322: write df/f3e [663702,45281] 0 2023-01-04T18:16:29.051 INFO:tasks.workunit.client.1.smithi098.stdout:3/368: sync 2023-01-04T18:16:29.052 INFO:tasks.workunit.client.1.smithi098.stdout:4/268: sync 2023-01-04T18:16:29.052 INFO:tasks.workunit.client.1.smithi098.stdout:3/369: write d6/d10/d19/d3f/d46/f5a [480449,87294] 0 2023-01-04T18:16:29.052 INFO:tasks.workunit.client.1.smithi098.stdout:9/353: creat d2/d5/d18/d4e/d2e/f79 x:0 0 0 2023-01-04T18:16:29.052 INFO:tasks.workunit.client.1.smithi098.stdout:9/354: stat d2/d5/d18/d4e/d2e/d26/d41/d57/d72 0 2023-01-04T18:16:29.056 INFO:tasks.workunit.client.1.smithi098.stdout:6/292: link d9/dd/de/c13 d9/dd/d24/c51 0 2023-01-04T18:16:29.057 INFO:tasks.workunit.client.1.smithi098.stdout:1/222: creat d1/d8/da/f48 x:0 0 0 2023-01-04T18:16:29.058 INFO:tasks.workunit.client.1.smithi098.stdout:8/262: mkdir d6/dc/d12/d1e/d37/d4b 0 2023-01-04T18:16:29.058 INFO:tasks.workunit.client.1.smithi098.stdout:8/263: fdatasync d6/dc/f2e 0 2023-01-04T18:16:29.059 INFO:tasks.workunit.client.1.smithi098.stdout:5/311: creat d1/d2/d14/f5c x:0 0 0 2023-01-04T18:16:29.059 INFO:tasks.workunit.client.1.smithi098.stdout:5/312: write d1/d2/d14/d19/f22 [4571455,23510] 0 2023-01-04T18:16:29.064 INFO:tasks.workunit.client.1.smithi098.stdout:7/246: rename d1/d23/d24 to d1/d51 0 2023-01-04T18:16:29.064 INFO:tasks.workunit.client.1.smithi098.stdout:0/323: symlink df/d17/d1c/d2c/d41/d4a/d4c/d5f/l72 0 2023-01-04T18:16:29.064 INFO:tasks.workunit.client.1.smithi098.stdout:0/324: fdatasync f1 0 2023-01-04T18:16:29.064 INFO:tasks.workunit.client.1.smithi098.stdout:2/361: read d6/f20 [1955699,108000] 0 2023-01-04T18:16:29.065 INFO:tasks.workunit.client.1.smithi098.stdout:4/269: creat d5/de/d2c/f57 x:0 0 0 2023-01-04T18:16:29.065 INFO:tasks.workunit.client.1.smithi098.stdout:4/270: write d5/de/d21/f39 [445313,34716] 0 2023-01-04T18:16:29.066 INFO:tasks.workunit.client.1.smithi098.stdout:3/370: link d6/d56/f68 d6/d10/f80 0 2023-01-04T18:16:29.070 INFO:tasks.workunit.client.1.smithi098.stdout:9/355: truncate d2/d5/d18/d4e/d2e/f4d 239824 0 2023-01-04T18:16:29.070 INFO:tasks.workunit.client.1.smithi098.stdout:9/356: fdatasync d2/d5/f77 0 2023-01-04T18:16:29.070 INFO:tasks.workunit.client.1.smithi098.stdout:0/325: dread df/f3e [0,4194304] 0 2023-01-04T18:16:29.070 INFO:tasks.workunit.client.1.smithi098.stdout:0/326: chown df/d4f/d6b/l71 64451909 1 2023-01-04T18:16:29.071 INFO:tasks.workunit.client.1.smithi098.stdout:6/293: symlink d9/dd/de/d44/l52 0 2023-01-04T18:16:29.071 INFO:tasks.workunit.client.1.smithi098.stdout:1/223: mknod d1/d8/c49 0 2023-01-04T18:16:29.072 INFO:tasks.workunit.client.1.smithi098.stdout:1/224: chown d1/d8/da/d12/c32 53158969 1 2023-01-04T18:16:29.074 INFO:tasks.workunit.client.1.smithi098.stdout:8/264: mkdir d6/d11/d15/d1b/d2a/d3b/d4c 0 2023-01-04T18:16:29.074 INFO:tasks.workunit.client.1.smithi098.stdout:4/271: dread d5/d9/f3b [0,4194304] 0 2023-01-04T18:16:29.076 INFO:tasks.workunit.client.1.smithi098.stdout:7/247: unlink d1/d23/f17 0 2023-01-04T18:16:29.077 INFO:tasks.workunit.client.1.smithi098.stdout:7/248: chown d1/d4/d11/f38 88946 1 2023-01-04T18:16:29.077 INFO:tasks.workunit.client.1.smithi098.stdout:7/249: chown d1/d4/l8 872953 1 2023-01-04T18:16:29.080 INFO:tasks.workunit.client.1.smithi098.stdout:2/362: rename d6/dc/d2b/d42/l75 to d6/dc/d2b/d42/d51/d79/l7d 0 2023-01-04T18:16:29.080 INFO:tasks.workunit.client.1.smithi098.stdout:7/250: rename d1/d51/d26/d28 to d1/d51/d26/d28/d52 22 2023-01-04T18:16:29.082 INFO:tasks.workunit.client.1.smithi098.stdout:3/371: creat d6/d10/d29/f81 x:0 0 0 2023-01-04T18:16:29.082 INFO:tasks.workunit.client.1.smithi098.stdout:3/372: read d6/d10/d29/f61 [469892,53459] 0 2023-01-04T18:16:29.087 INFO:tasks.workunit.client.1.smithi098.stdout:9/357: creat d2/d5/d18/d4e/d2e/d78/f7a x:0 0 0 2023-01-04T18:16:29.094 INFO:tasks.workunit.client.1.smithi098.stdout:0/327: dwrite df/d4f/f55 [0,4194304] 0 2023-01-04T18:16:29.095 INFO:tasks.workunit.client.1.smithi098.stdout:1/225: creat d1/d2e/f4a x:0 0 0 2023-01-04T18:16:29.095 INFO:tasks.workunit.client.1.smithi098.stdout:6/294: dwrite d9/dd/f29 [0,4194304] 0 2023-01-04T18:16:29.096 INFO:tasks.workunit.client.1.smithi098.stdout:6/295: write d9/f17 [7504389,124781] 0 2023-01-04T18:16:29.096 INFO:tasks.workunit.client.1.smithi098.stdout:6/296: chown d9/dd/de/d20/l35 30 1 2023-01-04T18:16:29.098 INFO:tasks.workunit.client.1.smithi098.stdout:7/251: symlink d1/l53 0 2023-01-04T18:16:29.098 INFO:tasks.workunit.client.1.smithi098.stdout:4/272: dwrite d5/d28/d40/f56 [0,4194304] 0 2023-01-04T18:16:29.100 INFO:tasks.workunit.client.1.smithi098.stdout:9/358: getdents d2/d5/d18/d4e/d2e 0 2023-01-04T18:16:29.101 INFO:tasks.workunit.client.1.smithi098.stdout:7/252: dread d1/f3c [0,4194304] 0 2023-01-04T18:16:29.101 INFO:tasks.workunit.client.1.smithi098.stdout:7/253: write d1/d51/d26/f30 [4341391,66923] 0 2023-01-04T18:16:29.103 INFO:tasks.workunit.client.1.smithi098.stdout:2/363: dwrite d6/dc/d2b/d32/f37 [0,4194304] 0 2023-01-04T18:16:29.103 INFO:tasks.workunit.client.1.smithi098.stdout:0/328: rmdir df/d17 39 2023-01-04T18:16:29.104 INFO:tasks.workunit.client.1.smithi098.stdout:1/226: getdents d1 0 2023-01-04T18:16:29.105 INFO:tasks.workunit.client.1.smithi098.stdout:1/227: chown d1/d8/da/f48 200714708 1 2023-01-04T18:16:29.108 INFO:tasks.workunit.client.1.smithi098.stdout:8/265: mkdir d6/d11/d15/d1b/d4d 0 2023-01-04T18:16:29.110 INFO:tasks.workunit.client.1.smithi098.stdout:8/266: write d6/d11/d15/f1f [379304,79819] 0 2023-01-04T18:16:29.110 INFO:tasks.workunit.client.1.smithi098.stdout:8/267: write d6/dc/d12/d1e/d37/f3a [66364,125430] 0 2023-01-04T18:16:29.111 INFO:tasks.workunit.client.1.smithi098.stdout:7/254: creat d1/d2e/f54 x:0 0 0 2023-01-04T18:16:29.115 INFO:tasks.workunit.client.1.smithi098.stdout:2/364: unlink d6/dc/d2b/d32/f37 0 2023-01-04T18:16:29.117 INFO:tasks.workunit.client.1.smithi098.stdout:1/228: creat d1/d8/da/d12/f4b x:0 0 0 2023-01-04T18:16:29.117 INFO:tasks.workunit.client.1.smithi098.stdout:1/229: fdatasync d1/d8/da/d12/f46 0 2023-01-04T18:16:29.118 INFO:tasks.workunit.client.1.smithi098.stdout:7/255: write d1/d2e/f35 [4024371,29279] 0 2023-01-04T18:16:29.123 INFO:tasks.workunit.client.1.smithi098.stdout:7/256: rmdir d1/da 39 2023-01-04T18:16:29.126 INFO:tasks.workunit.client.1.smithi098.stdout:0/329: dread df/d17/d24/f2e [0,4194304] 0 2023-01-04T18:16:29.127 INFO:tasks.workunit.client.1.smithi098.stdout:8/268: mknod d6/dc/d12/d1e/c4e 0 2023-01-04T18:16:29.127 INFO:tasks.workunit.client.1.smithi098.stdout:0/330: write df/d17/f1d [3382543,119622] 0 2023-01-04T18:16:29.127 INFO:tasks.workunit.client.1.smithi098.stdout:8/269: creat d6/dc/d12/f4f x:0 0 0 2023-01-04T18:16:29.127 INFO:tasks.workunit.client.1.smithi098.stdout:0/331: mknod df/d17/d1c/d2c/d41/d4a/d56/c73 0 2023-01-04T18:16:29.128 INFO:tasks.workunit.client.1.smithi098.stdout:3/373: dwrite d6/f6c [0,4194304] 0 2023-01-04T18:16:29.129 INFO:tasks.workunit.client.1.smithi098.stdout:0/332: rename df/d17/d24/c43 to df/d17/d1c/d2c/d41/d4a/d6d/c74 0 2023-01-04T18:16:29.129 INFO:tasks.workunit.client.1.smithi098.stdout:0/333: write df/d17/d1c/d2c/d41/d4a/d56/f6a [897199,120516] 0 2023-01-04T18:16:29.130 INFO:tasks.workunit.client.1.smithi098.stdout:2/365: dread d6/dc/d2b/d42/d47/d1f/d39/f64 [0,4194304] 0 2023-01-04T18:16:29.133 INFO:tasks.workunit.client.1.smithi098.stdout:0/334: mkdir df/d4f/d6b/d75 0 2023-01-04T18:16:29.133 INFO:tasks.workunit.client.1.smithi098.stdout:0/335: write df/d17/d1c/d2c/d41/d4a/d4c/f6c [1844353,76664] 0 2023-01-04T18:16:29.133 INFO:tasks.workunit.client.1.smithi098.stdout:4/273: dwrite d5/de/d21/f41 [0,4194304] 0 2023-01-04T18:16:29.133 INFO:tasks.workunit.client.1.smithi098.stdout:4/274: dread - d5/f42 zero size 2023-01-04T18:16:29.136 INFO:tasks.workunit.client.1.smithi098.stdout:2/366: getdents d6/dc/d2b 0 2023-01-04T18:16:29.136 INFO:tasks.workunit.client.1.smithi098.stdout:0/336: getdents df/d17/d68 0 2023-01-04T18:16:29.138 INFO:tasks.workunit.client.1.smithi098.stdout:8/270: dread d6/d11/d15/d1b/d2a/d3b/f38 [0,4194304] 0 2023-01-04T18:16:29.138 INFO:tasks.workunit.client.1.smithi098.stdout:4/275: mknod d5/de/d30/d4f/c58 0 2023-01-04T18:16:29.139 INFO:tasks.workunit.client.1.smithi098.stdout:2/367: creat d6/dc/f7e x:0 0 0 2023-01-04T18:16:29.139 INFO:tasks.workunit.client.1.smithi098.stdout:8/271: write d6/dc/d12/d20/f40 [2008206,43310] 0 2023-01-04T18:16:29.139 INFO:tasks.workunit.client.1.smithi098.stdout:2/368: write d6/dc/d2b/d42/d47/d1f/d39/d6e/f77 [2557312,84298] 0 2023-01-04T18:16:29.140 INFO:tasks.workunit.client.1.smithi098.stdout:0/337: creat df/d17/d1c/d2c/d41/d4a/d6d/f76 x:0 0 0 2023-01-04T18:16:29.140 INFO:tasks.workunit.client.1.smithi098.stdout:0/338: write df/f52 [758125,30203] 0 2023-01-04T18:16:29.141 INFO:tasks.workunit.client.1.smithi098.stdout:4/276: link d5/d9/c45 d5/d9/d13/c59 0 2023-01-04T18:16:29.141 INFO:tasks.workunit.client.1.smithi098.stdout:4/277: write d5/f1b [4829960,21315] 0 2023-01-04T18:16:29.142 INFO:tasks.workunit.client.1.smithi098.stdout:0/339: link df/d17/d1c/d2c/d41/d4a/d4c/l4d df/d17/d68/l77 0 2023-01-04T18:16:29.142 INFO:tasks.workunit.client.1.smithi098.stdout:0/340: write df/d17/d1c/d2c/d41/d4a/f65 [55277,126548] 0 2023-01-04T18:16:29.144 INFO:tasks.workunit.client.1.smithi098.stdout:7/257: fsync d1/d2e/f35 0 2023-01-04T18:16:29.145 INFO:tasks.workunit.client.1.smithi098.stdout:7/258: chown d1/d4/l4d 15 1 2023-01-04T18:16:29.146 INFO:tasks.workunit.client.1.smithi098.stdout:7/259: unlink d1/d4/d11/f38 0 2023-01-04T18:16:29.147 INFO:tasks.workunit.client.1.smithi098.stdout:7/260: rmdir d1/d51 39 2023-01-04T18:16:29.147 INFO:tasks.workunit.client.1.smithi098.stdout:7/261: chown d1/d51/d26/d28/d2d/f34 654752 1 2023-01-04T18:16:29.147 INFO:tasks.workunit.client.1.smithi098.stdout:7/262: chown d1/d4/f29 1 1 2023-01-04T18:16:29.147 INFO:tasks.workunit.client.1.smithi098.stdout:7/263: truncate d1/f3c 931256 0 2023-01-04T18:16:29.150 INFO:tasks.workunit.client.1.smithi098.stdout:7/264: write d1/d23/d37/f42 [1407594,55498] 0 2023-01-04T18:16:29.153 INFO:tasks.workunit.client.1.smithi098.stdout:3/374: dwrite d6/d10/d19/d3f/d5e/d74/f6e [0,4194304] 0 2023-01-04T18:16:29.153 INFO:tasks.workunit.client.1.smithi098.stdout:3/375: dread - d6/d10/d29/f81 zero size 2023-01-04T18:16:29.153 INFO:tasks.workunit.client.1.smithi098.stdout:3/376: write d6/d10/d19/f42 [767627,48968] 0 2023-01-04T18:16:29.153 INFO:tasks.workunit.client.1.smithi098.stdout:3/377: truncate d6/f41 4771283 0 2023-01-04T18:16:29.153 INFO:tasks.workunit.client.1.smithi098.stdout:9/359: dwrite d2/d5/d18/d4e/d2e/f4d [0,4194304] 0 2023-01-04T18:16:29.153 INFO:tasks.workunit.client.1.smithi098.stdout:9/360: truncate d2/d5/d18/f3f 638379 0 2023-01-04T18:16:29.153 INFO:tasks.workunit.client.1.smithi098.stdout:9/361: readlink d2/d5/d18/d4e/d2e/d26/d41/d57/l6b 0 2023-01-04T18:16:29.154 INFO:tasks.workunit.client.1.smithi098.stdout:7/265: symlink d1/l55 0 2023-01-04T18:16:29.159 INFO:tasks.workunit.client.1.smithi098.stdout:7/266: symlink d1/d51/l56 0 2023-01-04T18:16:29.161 INFO:tasks.workunit.client.1.smithi098.stdout:1/230: dwrite d1/f30 [0,4194304] 0 2023-01-04T18:16:29.164 INFO:tasks.workunit.client.1.smithi098.stdout:7/267: symlink d1/d51/d26/l57 0 2023-01-04T18:16:29.171 INFO:tasks.workunit.client.1.smithi098.stdout:2/369: dwrite d6/dc/d2b/d42/d47/d35/f67 [0,4194304] 0 2023-01-04T18:16:29.172 INFO:tasks.workunit.client.1.smithi098.stdout:8/272: dwrite d6/fe [0,4194304] 0 2023-01-04T18:16:29.176 INFO:tasks.workunit.client.1.smithi098.stdout:4/278: dwrite d5/d9/f36 [0,4194304] 0 2023-01-04T18:16:29.180 INFO:tasks.workunit.client.1.smithi098.stdout:0/341: dwrite df/d17/d24/f2e [0,4194304] 0 2023-01-04T18:16:29.181 INFO:tasks.workunit.client.1.smithi098.stdout:3/378: dwrite d6/d10/d19/f3a [0,4194304] 0 2023-01-04T18:16:29.182 INFO:tasks.workunit.client.1.smithi098.stdout:1/231: mknod d1/d25/d36/c4c 0 2023-01-04T18:16:29.182 INFO:tasks.workunit.client.1.smithi098.stdout:1/232: stat d1/d8/da/l47 0 2023-01-04T18:16:29.183 INFO:tasks.workunit.client.1.smithi098.stdout:7/268: mknod d1/da/c58 0 2023-01-04T18:16:29.183 INFO:tasks.workunit.client.1.smithi098.stdout:1/233: dread d1/f22 [0,4194304] 0 2023-01-04T18:16:29.188 INFO:tasks.workunit.client.1.smithi098.stdout:2/370: truncate d6/dc/d2b/d42/d47/d1f/d39/d6e/f74 2499260 0 2023-01-04T18:16:29.189 INFO:tasks.workunit.client.1.smithi098.stdout:2/371: write d6/dc/d2b/d42/d47/d1f/f24 [467314,66344] 0 2023-01-04T18:16:29.192 INFO:tasks.workunit.client.1.smithi098.stdout:8/273: creat d6/dc/d12/d1e/d37/d4b/f50 x:0 0 0 2023-01-04T18:16:29.196 INFO:tasks.workunit.client.1.smithi098.stdout:4/279: link d5/d28/f2b d5/de/f5a 0 2023-01-04T18:16:29.198 INFO:tasks.workunit.client.1.smithi098.stdout:0/342: link df/d17/d1c/d3b/f58 df/d17/d1c/d3b/f78 0 2023-01-04T18:16:29.199 INFO:tasks.workunit.client.1.smithi098.stdout:1/234: dwrite d1/d8/da/d12/f46 [0,4194304] 0 2023-01-04T18:16:29.199 INFO:tasks.workunit.client.1.smithi098.stdout:3/379: link d6/d10/d19/d3f/d5e/d74/f6e d6/d10/d19/d3f/f82 0 2023-01-04T18:16:29.201 INFO:tasks.workunit.client.1.smithi098.stdout:7/269: rename d1/f20 to d1/d51/f59 0 2023-01-04T18:16:29.202 INFO:tasks.workunit.client.1.smithi098.stdout:2/372: rmdir d6/dc/d2b/d46 39 2023-01-04T18:16:29.203 INFO:tasks.workunit.client.1.smithi098.stdout:8/274: mknod d6/d11/d15/d1b/d2a/d3b/c51 0 2023-01-04T18:16:29.203 INFO:tasks.workunit.client.1.smithi098.stdout:8/275: fsync d6/dc/d12/d1e/d37/d4b/f50 0 2023-01-04T18:16:29.205 INFO:tasks.workunit.client.1.smithi098.stdout:4/280: symlink d5/de/d2c/l5b 0 2023-01-04T18:16:29.205 INFO:tasks.workunit.client.1.smithi098.stdout:4/281: dread - d5/d9/d13/f50 zero size 2023-01-04T18:16:29.207 INFO:tasks.workunit.client.1.smithi098.stdout:0/343: symlink df/d17/d24/l79 0 2023-01-04T18:16:29.207 INFO:tasks.workunit.client.1.smithi098.stdout:0/344: chown df/d17/d1c/d3b/f58 481197745 1 2023-01-04T18:16:29.212 INFO:tasks.workunit.client.1.smithi098.stdout:3/380: creat d6/d56/f83 x:0 0 0 2023-01-04T18:16:29.214 INFO:tasks.workunit.client.1.smithi098.stdout:7/270: rename d1/d23/d21/c4a to d1/d23/d21/d43/c5a 0 2023-01-04T18:16:29.214 INFO:tasks.workunit.client.1.smithi098.stdout:5/313: sync 2023-01-04T18:16:29.214 INFO:tasks.workunit.client.1.smithi098.stdout:6/297: sync 2023-01-04T18:16:29.215 INFO:tasks.workunit.client.1.smithi098.stdout:8/276: getdents d6/d11/d15/d1b/d2a/d3b 0 2023-01-04T18:16:29.215 INFO:tasks.workunit.client.1.smithi098.stdout:8/277: chown d6/d11/l42 6060819 1 2023-01-04T18:16:29.216 INFO:tasks.workunit.client.1.smithi098.stdout:4/282: mkdir d5/de/d30/d4f/d5c 0 2023-01-04T18:16:29.217 INFO:tasks.workunit.client.1.smithi098.stdout:0/345: mkdir df/d17/d1c/d2c/d41/d4a/d7a 0 2023-01-04T18:16:29.217 INFO:tasks.workunit.client.1.smithi098.stdout:0/346: chown df/d17/d1c/d2c/d41/d4a/d56/f69 104916 1 2023-01-04T18:16:29.217 INFO:tasks.workunit.client.1.smithi098.stdout:0/347: readlink df/d4f/d6b/l71 0 2023-01-04T18:16:29.217 INFO:tasks.workunit.client.1.smithi098.stdout:3/381: symlink d6/d10/d19/d3f/d46/l84 0 2023-01-04T18:16:29.219 INFO:tasks.workunit.client.1.smithi098.stdout:1/235: dwrite d1/d8/da/d12/f3b [0,4194304] 0 2023-01-04T18:16:29.219 INFO:tasks.workunit.client.1.smithi098.stdout:7/271: mknod d1/d51/c5b 0 2023-01-04T18:16:29.219 INFO:tasks.workunit.client.1.smithi098.stdout:4/283: write d5/d28/d40/f4a [1885132,22583] 0 2023-01-04T18:16:29.219 INFO:tasks.workunit.client.1.smithi098.stdout:4/284: readlink d5/l18 0 2023-01-04T18:16:29.219 INFO:tasks.workunit.client.1.smithi098.stdout:6/298: mknod d9/c53 0 2023-01-04T18:16:29.220 INFO:tasks.workunit.client.1.smithi098.stdout:1/236: write f0 [4132517,78752] 0 2023-01-04T18:16:29.220 INFO:tasks.workunit.client.1.smithi098.stdout:8/278: symlink d6/l52 0 2023-01-04T18:16:29.220 INFO:tasks.workunit.client.1.smithi098.stdout:0/348: symlink df/d4f/d6e/l7b 0 2023-01-04T18:16:29.222 INFO:tasks.workunit.client.1.smithi098.stdout:3/382: rmdir d6/d10/d29 39 2023-01-04T18:16:29.223 INFO:tasks.workunit.client.1.smithi098.stdout:7/272: creat d1/d23/d37/d40/f5c x:0 0 0 2023-01-04T18:16:29.223 INFO:tasks.workunit.client.1.smithi098.stdout:7/273: readlink d1/d51/l56 0 2023-01-04T18:16:29.224 INFO:tasks.workunit.client.1.smithi098.stdout:4/285: mkdir d5/d28/d40/d5d 0 2023-01-04T18:16:29.224 INFO:tasks.workunit.client.1.smithi098.stdout:5/314: dread d1/d2/d14/d19/f22 [0,4194304] 0 2023-01-04T18:16:29.224 INFO:tasks.workunit.client.1.smithi098.stdout:6/299: mknod d9/dd/d4e/c54 0 2023-01-04T18:16:29.224 INFO:tasks.workunit.client.1.smithi098.stdout:4/286: read d5/de/d2c/f3e [1815441,22249] 0 2023-01-04T18:16:29.225 INFO:tasks.workunit.client.1.smithi098.stdout:1/237: symlink d1/d25/d39/l4d 0 2023-01-04T18:16:29.225 INFO:tasks.workunit.client.1.smithi098.stdout:2/373: dwrite d6/f78 [0,4194304] 0 2023-01-04T18:16:29.226 INFO:tasks.workunit.client.1.smithi098.stdout:1/238: write d1/d8/da/d12/f46 [944328,47141] 0 2023-01-04T18:16:29.226 INFO:tasks.workunit.client.1.smithi098.stdout:8/279: rename d6/dc/f29 to d6/dc/d12/d1e/d44/f53 0 2023-01-04T18:16:29.227 INFO:tasks.workunit.client.1.smithi098.stdout:0/349: rmdir df/d17/d1c/d2c 39 2023-01-04T18:16:29.228 INFO:tasks.workunit.client.1.smithi098.stdout:3/383: creat d6/d56/f85 x:0 0 0 2023-01-04T18:16:29.236 INFO:tasks.workunit.client.1.smithi098.stdout:5/315: mknod d1/da/d44/d45/d4b/c5d 0 2023-01-04T18:16:29.237 INFO:tasks.workunit.client.1.smithi098.stdout:6/300: creat d9/dd/d24/d3e/f55 x:0 0 0 2023-01-04T18:16:29.237 INFO:tasks.workunit.client.1.smithi098.stdout:6/301: chown d9/dd/d24/f30 0 1 2023-01-04T18:16:29.237 INFO:tasks.workunit.client.1.smithi098.stdout:4/287: mkdir d5/de/d21/d5e 0 2023-01-04T18:16:29.242 INFO:tasks.workunit.client.1.smithi098.stdout:7/274: rmdir d1 39 2023-01-04T18:16:29.242 INFO:tasks.workunit.client.1.smithi098.stdout:7/275: chown d1/f47 103215 1 2023-01-04T18:16:29.244 INFO:tasks.workunit.client.1.smithi098.stdout:1/239: mkdir d1/d25/d36/d4e 0 2023-01-04T18:16:29.244 INFO:tasks.workunit.client.1.smithi098.stdout:8/280: mkdir d6/d11/d15/d1b/d2a/d3b/d4c/d54 0 2023-01-04T18:16:29.247 INFO:tasks.workunit.client.1.smithi098.stdout:0/350: symlink df/d17/d24/l7c 0 2023-01-04T18:16:29.248 INFO:tasks.workunit.client.1.smithi098.stdout:3/384: mkdir d6/d86 0 2023-01-04T18:16:29.248 INFO:tasks.workunit.client.1.smithi098.stdout:3/385: chown d6/l43 22291989 1 2023-01-04T18:16:29.248 INFO:tasks.workunit.client.1.smithi098.stdout:3/386: truncate d6/d10/d19/f26 4494334 0 2023-01-04T18:16:29.248 INFO:tasks.workunit.client.1.smithi098.stdout:3/387: read - d6/d56/f85 zero size 2023-01-04T18:16:29.248 INFO:tasks.workunit.client.1.smithi098.stdout:3/388: chown d6/d10/c4f 1978474 1 2023-01-04T18:16:29.249 INFO:tasks.workunit.client.1.smithi098.stdout:5/316: creat d1/d2f/f5e x:0 0 0 2023-01-04T18:16:29.249 INFO:tasks.workunit.client.1.smithi098.stdout:6/302: mkdir d9/dd/d24/d56 0 2023-01-04T18:16:29.249 INFO:tasks.workunit.client.1.smithi098.stdout:6/303: chown d9/dd/d24/d3e/f46 800 1 2023-01-04T18:16:29.250 INFO:tasks.workunit.client.1.smithi098.stdout:4/288: mknod d5/d28/d40/c5f 0 2023-01-04T18:16:29.250 INFO:tasks.workunit.client.1.smithi098.stdout:4/289: truncate d5/d9/f43 231434 0 2023-01-04T18:16:29.250 INFO:tasks.workunit.client.1.smithi098.stdout:4/290: chown d5/d9/d13/f50 46 1 2023-01-04T18:16:29.250 INFO:tasks.workunit.client.1.smithi098.stdout:4/291: readlink d5/d9/lb 0 2023-01-04T18:16:29.251 INFO:tasks.workunit.client.1.smithi098.stdout:7/276: rmdir d1/d23/d21/d43 39 2023-01-04T18:16:29.251 INFO:tasks.workunit.client.1.smithi098.stdout:2/374: mknod d6/c7f 0 2023-01-04T18:16:29.252 INFO:tasks.workunit.client.1.smithi098.stdout:1/240: truncate d1/d25/f29 3475405 0 2023-01-04T18:16:29.252 INFO:tasks.workunit.client.1.smithi098.stdout:1/241: fsync d1/f30 0 2023-01-04T18:16:29.253 INFO:tasks.workunit.client.1.smithi098.stdout:8/281: rename d6/dc/d12/l22 to d6/dc/l55 0 2023-01-04T18:16:29.254 INFO:tasks.workunit.client.1.smithi098.stdout:0/351: creat df/d4f/f7d x:0 0 0 2023-01-04T18:16:29.254 INFO:tasks.workunit.client.1.smithi098.stdout:8/282: dread d6/f9 [0,4194304] 0 2023-01-04T18:16:29.259 INFO:tasks.workunit.client.1.smithi098.stdout:6/304: creat d9/dd/d24/f57 x:0 0 0 2023-01-04T18:16:29.260 INFO:tasks.workunit.client.1.smithi098.stdout:4/292: symlink d5/d9/l60 0 2023-01-04T18:16:29.261 INFO:tasks.workunit.client.1.smithi098.stdout:7/277: mkdir d1/d4/d11/d5d 0 2023-01-04T18:16:29.261 INFO:tasks.workunit.client.1.smithi098.stdout:7/278: truncate d1/d2e/f4c 818792 0 2023-01-04T18:16:29.262 INFO:tasks.workunit.client.1.smithi098.stdout:1/242: symlink d1/d25/l4f 0 2023-01-04T18:16:29.264 INFO:tasks.workunit.client.1.smithi098.stdout:5/317: rename d1/d2/f15 to d1/d2f/f5f 0 2023-01-04T18:16:29.265 INFO:tasks.workunit.client.1.smithi098.stdout:0/352: mknod df/d4f/d6e/c7e 0 2023-01-04T18:16:29.266 INFO:tasks.workunit.client.1.smithi098.stdout:0/353: write f1 [1610520,32494] 0 2023-01-04T18:16:29.266 INFO:tasks.workunit.client.1.smithi098.stdout:0/354: readlink df/d17/d1c/d2c/d41/d4a/d4c/l4d 0 2023-01-04T18:16:29.266 INFO:tasks.workunit.client.1.smithi098.stdout:3/389: mknod d6/d10/d19/c87 0 2023-01-04T18:16:29.268 INFO:tasks.workunit.client.1.smithi098.stdout:8/283: getdents d6 0 2023-01-04T18:16:29.268 INFO:tasks.workunit.client.1.smithi098.stdout:6/305: truncate d9/dd/f11 579875 0 2023-01-04T18:16:29.269 INFO:tasks.workunit.client.1.smithi098.stdout:7/279: symlink d1/d4/d11/l5e 0 2023-01-04T18:16:29.269 INFO:tasks.workunit.client.1.smithi098.stdout:7/280: chown d1/d4/l4d 12 1 2023-01-04T18:16:29.269 INFO:tasks.workunit.client.1.smithi098.stdout:1/243: creat d1/d25/d36/f50 x:0 0 0 2023-01-04T18:16:29.270 INFO:tasks.workunit.client.1.smithi098.stdout:1/244: write d1/f22 [402388,20569] 0 2023-01-04T18:16:29.270 INFO:tasks.workunit.client.1.smithi098.stdout:1/245: write d1/f1f [437659,75464] 0 2023-01-04T18:16:29.275 INFO:tasks.workunit.client.1.smithi098.stdout:2/375: rename d6/dc/d2b/d46/f7c to d6/dc/d2b/d42/d47/d1f/d39/f80 0 2023-01-04T18:16:29.277 INFO:tasks.workunit.client.1.smithi098.stdout:0/355: mknod df/d4f/d6b/c7f 0 2023-01-04T18:16:29.277 INFO:tasks.workunit.client.1.smithi098.stdout:0/356: chown df/d4f/d6e/c7e 2 1 2023-01-04T18:16:29.279 INFO:tasks.workunit.client.1.smithi098.stdout:6/306: creat d9/dd/d4e/f58 x:0 0 0 2023-01-04T18:16:29.279 INFO:tasks.workunit.client.1.smithi098.stdout:6/307: chown d9/dd/de 13280 1 2023-01-04T18:16:29.282 INFO:tasks.workunit.client.1.smithi098.stdout:4/293: rename d5/d9/d13/f3d to d5/de/d30/d4f/d5c/f61 0 2023-01-04T18:16:29.283 INFO:tasks.workunit.client.1.smithi098.stdout:3/390: dwrite d6/d10/f50 [0,4194304] 0 2023-01-04T18:16:29.286 INFO:tasks.workunit.client.1.smithi098.stdout:1/246: dread d1/f30 [0,4194304] 0 2023-01-04T18:16:29.286 INFO:tasks.workunit.client.1.smithi098.stdout:0/357: mkdir df/d17/d24/d80 0 2023-01-04T18:16:29.288 INFO:tasks.workunit.client.1.smithi098.stdout:6/308: creat d9/dd/d24/d56/f59 x:0 0 0 2023-01-04T18:16:29.289 INFO:tasks.workunit.client.1.smithi098.stdout:6/309: stat d9/dd/de/d20/c3d 0 2023-01-04T18:16:29.291 INFO:tasks.workunit.client.1.smithi098.stdout:5/318: rename d1/d2/d14/l16 to d1/da/d44/d45/d4b/l60 0 2023-01-04T18:16:29.291 INFO:tasks.workunit.client.1.smithi098.stdout:5/319: write d1/da/d44/d45/f55 [40316,30380] 0 2023-01-04T18:16:29.291 INFO:tasks.workunit.client.1.smithi098.stdout:5/320: write d1/d2f/f5e [333879,120447] 0 2023-01-04T18:16:29.292 INFO:tasks.workunit.client.1.smithi098.stdout:4/294: mknod d5/de/d21/d5e/c62 0 2023-01-04T18:16:29.292 INFO:tasks.workunit.client.1.smithi098.stdout:8/284: dwrite d6/dc/d12/d1e/d44/f53 [0,4194304] 0 2023-01-04T18:16:29.293 INFO:tasks.workunit.client.1.smithi098.stdout:8/285: truncate d6/dc/d12/f4f 699134 0 2023-01-04T18:16:29.294 INFO:tasks.workunit.client.1.smithi098.stdout:2/376: dwrite f3 [4194304,4194304] 0 2023-01-04T18:16:29.295 INFO:tasks.workunit.client.1.smithi098.stdout:4/295: write d5/d9/f36 [606908,78827] 0 2023-01-04T18:16:29.296 INFO:tasks.workunit.client.1.smithi098.stdout:9/362: sync 2023-01-04T18:16:29.297 INFO:tasks.workunit.client.1.smithi098.stdout:3/391: link d6/d10/d19/d3f/d5e/d7d/l5d d6/d10/d19/d3f/d5e/d7d/l88 0 2023-01-04T18:16:29.298 INFO:tasks.workunit.client.1.smithi098.stdout:3/392: dread d6/f25 [4194304,4194304] 0 2023-01-04T18:16:29.298 INFO:tasks.workunit.client.1.smithi098.stdout:1/247: symlink d1/d2e/l51 0 2023-01-04T18:16:29.300 INFO:tasks.workunit.client.1.smithi098.stdout:0/358: creat df/d17/d1c/d2c/d41/d4a/d56/f81 x:0 0 0 2023-01-04T18:16:29.300 INFO:tasks.workunit.client.1.smithi098.stdout:1/248: dread d1/f1f [0,4194304] 0 2023-01-04T18:16:29.301 INFO:tasks.workunit.client.1.smithi098.stdout:1/249: chown d1/d8/l26 20053454 1 2023-01-04T18:16:29.303 INFO:tasks.workunit.client.1.smithi098.stdout:6/310: symlink d9/dd/d24/d56/l5a 0 2023-01-04T18:16:29.304 INFO:tasks.workunit.client.1.smithi098.stdout:5/321: mkdir d1/da/d44/d45/d4b/d61 0 2023-01-04T18:16:29.310 INFO:tasks.workunit.client.1.smithi098.stdout:2/377: mkdir d6/dc/d2b/d42/d51/d81 0 2023-01-04T18:16:29.310 INFO:tasks.workunit.client.1.smithi098.stdout:2/378: chown d6/dc/d2b/d42/d47/d35/f72 13 1 2023-01-04T18:16:29.311 INFO:tasks.workunit.client.1.smithi098.stdout:4/296: symlink d5/de/d30/d4f/l63 0 2023-01-04T18:16:29.311 INFO:tasks.workunit.client.1.smithi098.stdout:4/297: chown d5/d9/d13/f17 2944590 1 2023-01-04T18:16:29.311 INFO:tasks.workunit.client.1.smithi098.stdout:4/298: read d5/d9/f3b [1573370,105455] 0 2023-01-04T18:16:29.311 INFO:tasks.workunit.client.1.smithi098.stdout:4/299: stat d5/de/d21/f22 0 2023-01-04T18:16:29.311 INFO:tasks.workunit.client.1.smithi098.stdout:4/300: fdatasync d5/de/d21/f41 0 2023-01-04T18:16:29.311 INFO:tasks.workunit.client.1.smithi098.stdout:9/363: rename d2/c3e to d2/d5/d18/d1d/d23/d5c/c7b 0 2023-01-04T18:16:29.313 INFO:tasks.workunit.client.1.smithi098.stdout:3/393: rmdir d6/d86 0 2023-01-04T18:16:29.314 INFO:tasks.workunit.client.1.smithi098.stdout:0/359: creat df/d17/d1c/d2c/d41/d4a/d56/f82 x:0 0 0 2023-01-04T18:16:29.315 INFO:tasks.workunit.client.1.smithi098.stdout:6/311: unlink d9/f17 0 2023-01-04T18:16:29.317 INFO:tasks.workunit.client.1.smithi098.stdout:5/322: link c0 d1/d2/d14/d19/c62 0 2023-01-04T18:16:29.318 INFO:tasks.workunit.client.1.smithi098.stdout:8/286: unlink d6/dc/d12/d1e/f2b 0 2023-01-04T18:16:29.320 INFO:tasks.workunit.client.1.smithi098.stdout:2/379: unlink d6/dc/d2b/d42/d47/c26 0 2023-01-04T18:16:29.320 INFO:tasks.workunit.client.1.smithi098.stdout:4/301: creat d5/d28/d40/f64 x:0 0 0 2023-01-04T18:16:29.321 INFO:tasks.workunit.client.1.smithi098.stdout:3/394: dread d6/d10/f1b [0,4194304] 0 2023-01-04T18:16:29.321 INFO:tasks.workunit.client.1.smithi098.stdout:3/395: fsync d6/d10/d19/d3f/d5e/d74/f6e 0 2023-01-04T18:16:29.321 INFO:tasks.workunit.client.1.smithi098.stdout:3/396: chown d6/d56/f85 36 1 2023-01-04T18:16:29.321 INFO:tasks.workunit.client.1.smithi098.stdout:3/397: fsync d6/d10/d19/d3f/f6d 0 2023-01-04T18:16:29.322 INFO:tasks.workunit.client.1.smithi098.stdout:1/250: rename d1/d8/da/f31 to d1/d25/d36/f52 0 2023-01-04T18:16:29.322 INFO:tasks.workunit.client.1.smithi098.stdout:9/364: stat d2/d5/d18/d1d/d23/l35 0 2023-01-04T18:16:29.322 INFO:tasks.workunit.client.1.smithi098.stdout:1/251: write d1/d8/da/d12/f46 [975935,21056] 0 2023-01-04T18:16:29.322 INFO:tasks.workunit.client.1.smithi098.stdout:1/252: read - d1/d25/d36/f40 zero size 2023-01-04T18:16:29.323 INFO:tasks.workunit.client.1.smithi098.stdout:6/312: dread d9/dd/d1f/f27 [0,4194304] 0 2023-01-04T18:16:29.323 INFO:tasks.workunit.client.1.smithi098.stdout:1/253: chown d1/d25/d39 5769 1 2023-01-04T18:16:29.323 INFO:tasks.workunit.client.1.smithi098.stdout:0/360: mknod df/d4f/d6e/c83 0 2023-01-04T18:16:29.323 INFO:tasks.workunit.client.1.smithi098.stdout:6/313: read d9/dd/d24/d3e/f46 [131671,19334] 0 2023-01-04T18:16:29.323 INFO:tasks.workunit.client.1.smithi098.stdout:5/323: unlink d1/le 0 2023-01-04T18:16:29.324 INFO:tasks.workunit.client.1.smithi098.stdout:8/287: truncate d6/d11/d15/d1b/d2a/d3b/f3c 2094014 0 2023-01-04T18:16:29.325 INFO:tasks.workunit.client.1.smithi098.stdout:3/398: creat d6/d10/d19/d3f/d5e/d74/f89 x:0 0 0 2023-01-04T18:16:29.327 INFO:tasks.workunit.client.1.smithi098.stdout:4/302: rename d5/de/d30/d4f/d5c to d5/d9/d13/d65 0 2023-01-04T18:16:29.327 INFO:tasks.workunit.client.1.smithi098.stdout:4/303: chown d5/de/f29 2128 1 2023-01-04T18:16:29.328 INFO:tasks.workunit.client.1.smithi098.stdout:4/304: write d5/d9/d13/f23 [363519,8078] 0 2023-01-04T18:16:29.328 INFO:tasks.workunit.client.1.smithi098.stdout:4/305: read - d5/de/d2c/f53 zero size 2023-01-04T18:16:29.328 INFO:tasks.workunit.client.1.smithi098.stdout:4/306: truncate d5/d9/d13/f23 1038437 0 2023-01-04T18:16:29.328 INFO:tasks.workunit.client.1.smithi098.stdout:3/399: write d6/d10/d19/d3f/d5e/d74/f52 [3375461,82991] 0 2023-01-04T18:16:29.328 INFO:tasks.workunit.client.1.smithi098.stdout:9/365: symlink d2/d5/d18/d1d/d23/l7c 0 2023-01-04T18:16:29.328 INFO:tasks.workunit.client.1.smithi098.stdout:8/288: dread d6/dc/d12/d1e/d37/f3a [0,4194304] 0 2023-01-04T18:16:29.329 INFO:tasks.workunit.client.1.smithi098.stdout:1/254: mkdir d1/d8/d53 0 2023-01-04T18:16:29.329 INFO:tasks.workunit.client.1.smithi098.stdout:1/255: getdents d1/d8/d53 0 2023-01-04T18:16:29.337 INFO:tasks.workunit.client.1.smithi098.stdout:0/361: mkdir df/d17/d1c/d2c/d41/d4a/d4c/d5f/d84 0 2023-01-04T18:16:29.339 INFO:tasks.workunit.client.1.smithi098.stdout:6/314: unlink d9/dd/d24/f57 0 2023-01-04T18:16:29.339 INFO:tasks.workunit.client.1.smithi098.stdout:6/315: write d9/dd/d1f/f27 [1709038,10546] 0 2023-01-04T18:16:29.339 INFO:tasks.workunit.client.1.smithi098.stdout:6/316: read - d9/dd/d24/d3e/f55 zero size 2023-01-04T18:16:29.341 INFO:tasks.workunit.client.1.smithi098.stdout:4/307: symlink d5/d9/l66 0 2023-01-04T18:16:29.341 INFO:tasks.workunit.client.1.smithi098.stdout:2/380: dread d6/dc/f5c [0,4194304] 0 2023-01-04T18:16:29.341 INFO:tasks.workunit.client.1.smithi098.stdout:2/381: write d6/dc/d2b/d42/d47/d1f/d39/f80 [394484,110403] 0 2023-01-04T18:16:29.341 INFO:tasks.workunit.client.1.smithi098.stdout:2/382: fdatasync d6/dc/f7e 0 2023-01-04T18:16:29.342 INFO:tasks.workunit.client.1.smithi098.stdout:3/400: unlink d6/d10/f75 0 2023-01-04T18:16:29.342 INFO:tasks.workunit.client.1.smithi098.stdout:3/401: fdatasync d6/d10/d29/f81 0 2023-01-04T18:16:29.344 INFO:tasks.workunit.client.1.smithi098.stdout:8/289: rmdir d6/dc/d12/d1e 39 2023-01-04T18:16:29.346 INFO:tasks.workunit.client.1.smithi098.stdout:0/362: mknod df/d17/d1c/d2c/d41/d4a/d7a/c85 0 2023-01-04T18:16:29.351 INFO:tasks.workunit.client.1.smithi098.stdout:4/308: creat d5/de/d2c/f67 x:0 0 0 2023-01-04T18:16:29.352 INFO:tasks.workunit.client.1.smithi098.stdout:2/383: mkdir d6/dc/d2b/d42/d47/d1f/d82 0 2023-01-04T18:16:29.353 INFO:tasks.workunit.client.1.smithi098.stdout:8/290: symlink d6/dc/d12/l56 0 2023-01-04T18:16:29.355 INFO:tasks.workunit.client.1.smithi098.stdout:0/363: mkdir df/d40/d86 0 2023-01-04T18:16:29.355 INFO:tasks.workunit.client.1.smithi098.stdout:0/364: truncate df/d17/f4b 1246643 0 2023-01-04T18:16:29.356 INFO:tasks.workunit.client.1.smithi098.stdout:8/291: creat d6/d11/d15/d1b/d2a/d3b/d4c/d54/f57 x:0 0 0 2023-01-04T18:16:29.357 INFO:tasks.workunit.client.1.smithi098.stdout:0/365: creat df/d4f/d6e/f87 x:0 0 0 2023-01-04T18:16:29.358 INFO:tasks.workunit.client.1.smithi098.stdout:2/384: symlink d6/l83 0 2023-01-04T18:16:29.359 INFO:tasks.workunit.client.1.smithi098.stdout:5/324: dwrite d1/d1e/f3e [0,4194304] 0 2023-01-04T18:16:29.359 INFO:tasks.workunit.client.1.smithi098.stdout:5/325: chown d1/d2f/f5e 0 1 2023-01-04T18:16:29.360 INFO:tasks.workunit.client.1.smithi098.stdout:2/385: write d6/dc/d2b/d42/d47/d35/f38 [2933276,60214] 0 2023-01-04T18:16:29.360 INFO:tasks.workunit.client.1.smithi098.stdout:1/256: dwrite d1/d8/da/f1a [4194304,4194304] 0 2023-01-04T18:16:29.360 INFO:tasks.workunit.client.1.smithi098.stdout:9/366: dwrite d2/f1e [8388608,4194304] 0 2023-01-04T18:16:29.360 INFO:tasks.workunit.client.1.smithi098.stdout:9/367: truncate d2/d2d/f5d 568615 0 2023-01-04T18:16:29.360 INFO:tasks.workunit.client.1.smithi098.stdout:9/368: chown d2/d5/d18/d4e/d2e/f4d 127 1 2023-01-04T18:16:29.361 INFO:tasks.workunit.client.1.smithi098.stdout:0/366: unlink df/d17/d68/l77 0 2023-01-04T18:16:29.361 INFO:tasks.workunit.client.1.smithi098.stdout:3/402: dwrite d6/d10/f62 [0,4194304] 0 2023-01-04T18:16:29.362 INFO:tasks.workunit.client.1.smithi098.stdout:5/326: getdents d1/da/d44/d45 0 2023-01-04T18:16:29.362 INFO:tasks.workunit.client.1.smithi098.stdout:5/327: chown d1/da/d44/d45/d4b/d61 8103 1 2023-01-04T18:16:29.363 INFO:tasks.workunit.client.1.smithi098.stdout:0/367: dread df/d17/d1c/f47 [0,4194304] 0 2023-01-04T18:16:29.363 INFO:tasks.workunit.client.1.smithi098.stdout:0/368: chown df/d17/d24/f57 6970025 1 2023-01-04T18:16:29.370 INFO:tasks.workunit.client.1.smithi098.stdout:1/257: mkdir d1/d8/da/d12/d54 0 2023-01-04T18:16:29.373 INFO:tasks.workunit.client.1.smithi098.stdout:4/309: dwrite d5/f1b [0,4194304] 0 2023-01-04T18:16:29.373 INFO:tasks.workunit.client.1.smithi098.stdout:6/317: creat d9/dd/d15/f5b x:0 0 0 2023-01-04T18:16:29.373 INFO:tasks.workunit.client.1.smithi098.stdout:6/318: write d9/dd/d15/f5b [318157,50334] 0 2023-01-04T18:16:29.374 INFO:tasks.workunit.client.1.smithi098.stdout:6/319: write d9/dd/de/f21 [6670897,23149] 0 2023-01-04T18:16:29.374 INFO:tasks.workunit.client.1.smithi098.stdout:6/320: getdents d9/dd/de/d26/d4c 0 2023-01-04T18:16:29.374 INFO:tasks.workunit.client.1.smithi098.stdout:6/321: chown d9/c50 22672191 1 2023-01-04T18:16:29.374 INFO:tasks.workunit.client.1.smithi098.stdout:8/292: dwrite d6/dc/d12/d1e/d44/f53 [0,4194304] 0 2023-01-04T18:16:29.375 INFO:tasks.workunit.client.1.smithi098.stdout:9/369: link d2/d5/d18/d1d/l48 d2/d5/d18/d1d/l7d 0 2023-01-04T18:16:29.378 INFO:tasks.workunit.client.1.smithi098.stdout:3/403: mkdir d6/d10/d19/d3f/d46/d8a 0 2023-01-04T18:16:29.380 INFO:tasks.workunit.client.1.smithi098.stdout:5/328: unlink d1/da/d44/f52 0 2023-01-04T18:16:29.380 INFO:tasks.workunit.client.1.smithi098.stdout:5/329: chown d1/f48 6 1 2023-01-04T18:16:29.381 INFO:tasks.workunit.client.1.smithi098.stdout:2/386: dwrite d6/dc/d2b/d42/f73 [0,4194304] 0 2023-01-04T18:16:29.383 INFO:tasks.workunit.client.1.smithi098.stdout:0/369: creat df/d17/d1c/d2c/d41/d4a/d7a/f88 x:0 0 0 2023-01-04T18:16:29.383 INFO:tasks.workunit.client.1.smithi098.stdout:2/387: dread d6/f7 [0,4194304] 0 2023-01-04T18:16:29.383 INFO:tasks.workunit.client.1.smithi098.stdout:2/388: truncate d6/f33 4598454 0 2023-01-04T18:16:29.383 INFO:tasks.workunit.client.1.smithi098.stdout:1/258: symlink d1/d8/da/d12/l55 0 2023-01-04T18:16:29.385 INFO:tasks.workunit.client.1.smithi098.stdout:4/310: link d5/de/d2c/f57 d5/de/d30/f68 0 2023-01-04T18:16:29.385 INFO:tasks.workunit.client.1.smithi098.stdout:4/311: truncate d5/f42 829774 0 2023-01-04T18:16:29.386 INFO:tasks.workunit.client.1.smithi098.stdout:6/322: rmdir d9/dd/de/d44 39 2023-01-04T18:16:29.389 INFO:tasks.workunit.client.1.smithi098.stdout:8/293: rename d6/d11/d15/d1b/d4d to d6/d11/d15/d1b/d2a/d3b/d4c/d54/d58 0 2023-01-04T18:16:29.389 INFO:tasks.workunit.client.1.smithi098.stdout:3/404: truncate d6/f25 1615191 0 2023-01-04T18:16:29.389 INFO:tasks.workunit.client.1.smithi098.stdout:3/405: chown d6/d10/f50 407 1 2023-01-04T18:16:29.391 INFO:tasks.workunit.client.1.smithi098.stdout:6/323: dread d9/dd/d15/f5b [0,4194304] 0 2023-01-04T18:16:29.395 INFO:tasks.workunit.client.1.smithi098.stdout:5/330: dwrite d1/da/f34 [0,4194304] 0 2023-01-04T18:16:29.403 INFO:tasks.workunit.client.1.smithi098.stdout:0/370: mkdir df/d4f/d6b/d89 0 2023-01-04T18:16:29.403 INFO:tasks.workunit.client.1.smithi098.stdout:0/371: write df/d17/d1c/d2c/d41/d4a/d56/f81 [495424,22010] 0 2023-01-04T18:16:29.403 INFO:tasks.workunit.client.1.smithi098.stdout:2/389: creat d6/dc/d2b/d46/f84 x:0 0 0 2023-01-04T18:16:29.404 INFO:tasks.workunit.client.1.smithi098.stdout:1/259: mkdir d1/d8/d56 0 2023-01-04T18:16:29.404 INFO:tasks.workunit.client.1.smithi098.stdout:4/312: mknod d5/de/d2c/c69 0 2023-01-04T18:16:29.408 INFO:tasks.workunit.client.1.smithi098.stdout:9/370: rename d2/f10 to d2/d5/d18/d4e/d2e/d26/f7e 0 2023-01-04T18:16:29.411 INFO:tasks.workunit.client.1.smithi098.stdout:8/294: mkdir d6/d11/d15/d1b/d2a/d3b/d59 0 2023-01-04T18:16:29.411 INFO:tasks.workunit.client.1.smithi098.stdout:3/406: chown d6/d10/d19/l28 726323 1 2023-01-04T18:16:29.411 INFO:tasks.workunit.client.1.smithi098.stdout:8/295: write d6/dc/d12/d1e/d37/f3a [380409,54348] 0 2023-01-04T18:16:29.412 INFO:tasks.workunit.client.1.smithi098.stdout:7/281: sync 2023-01-04T18:16:29.412 INFO:tasks.workunit.client.1.smithi098.stdout:7/282: stat d1/d51 0 2023-01-04T18:16:29.413 INFO:tasks.workunit.client.1.smithi098.stdout:9/371: dread d2/d5/d18/d4e/d2e/d26/f7e [4194304,4194304] 0 2023-01-04T18:16:29.414 INFO:tasks.workunit.client.1.smithi098.stdout:4/313: dread d5/d28/d40/f56 [0,4194304] 0 2023-01-04T18:16:29.414 INFO:tasks.workunit.client.1.smithi098.stdout:5/331: mknod d1/da/c63 0 2023-01-04T18:16:29.414 INFO:tasks.workunit.client.1.smithi098.stdout:0/372: link df/d17/d1c/d2c/d41/d4a/d4c/c61 df/d17/d24/d80/c8a 0 2023-01-04T18:16:29.415 INFO:tasks.workunit.client.1.smithi098.stdout:2/390: mknod d6/dc/d2b/d42/d47/d1f/d82/c85 0 2023-01-04T18:16:29.417 INFO:tasks.workunit.client.1.smithi098.stdout:3/407: link d6/d10/d6b/f7c d6/d10/f8b 0 2023-01-04T18:16:29.417 INFO:tasks.workunit.client.1.smithi098.stdout:3/408: fdatasync d6/d10/d19/f42 0 2023-01-04T18:16:29.417 INFO:tasks.workunit.client.1.smithi098.stdout:3/409: truncate d6/d10/d19/d3f/d5e/d74/f45 22440 0 2023-01-04T18:16:29.417 INFO:tasks.workunit.client.1.smithi098.stdout:3/410: readlink d6/d10/d19/d3f/d5e/l64 0 2023-01-04T18:16:29.418 INFO:tasks.workunit.client.1.smithi098.stdout:3/411: chown d6/d10/d19/d3f/d5e/l77 1 1 2023-01-04T18:16:29.418 INFO:tasks.workunit.client.1.smithi098.stdout:3/412: chown d6/d10/l13 22913 1 2023-01-04T18:16:29.420 INFO:tasks.workunit.client.1.smithi098.stdout:8/296: unlink d6/d11/l46 0 2023-01-04T18:16:29.421 INFO:tasks.workunit.client.1.smithi098.stdout:7/283: creat d1/d51/d26/d28/d2d/f5f x:0 0 0 2023-01-04T18:16:29.421 INFO:tasks.workunit.client.1.smithi098.stdout:7/284: stat d1/da 0 2023-01-04T18:16:29.421 INFO:tasks.workunit.client.1.smithi098.stdout:7/285: chown d1/da/c41 0 1 2023-01-04T18:16:29.421 INFO:tasks.workunit.client.1.smithi098.stdout:6/324: dread d9/dd/d15/f1a [4194304,4194304] 0 2023-01-04T18:16:29.422 INFO:tasks.workunit.client.1.smithi098.stdout:9/372: mknod d2/d5/d18/c7f 0 2023-01-04T18:16:29.422 INFO:tasks.workunit.client.1.smithi098.stdout:4/314: mknod d5/de/c6a 0 2023-01-04T18:16:29.422 INFO:tasks.workunit.client.1.smithi098.stdout:4/315: chown d5/de 1732 1 2023-01-04T18:16:29.422 INFO:tasks.workunit.client.1.smithi098.stdout:9/373: fsync d2/d2d/f5d 0 2023-01-04T18:16:29.425 INFO:tasks.workunit.client.1.smithi098.stdout:5/332: unlink d1/d2/d14/d19/c4a 0 2023-01-04T18:16:29.425 INFO:tasks.workunit.client.1.smithi098.stdout:5/333: stat d1/d2/d14/d19/f25 0 2023-01-04T18:16:29.426 INFO:tasks.workunit.client.1.smithi098.stdout:4/316: dread d5/f8 [0,4194304] 0 2023-01-04T18:16:29.426 INFO:tasks.workunit.client.1.smithi098.stdout:0/373: rmdir df/d17/d1c/d2c/d41/d4a/d4c/d5f/d84 0 2023-01-04T18:16:29.428 INFO:tasks.workunit.client.1.smithi098.stdout:7/286: getdents d1/d2e 0 2023-01-04T18:16:29.429 INFO:tasks.workunit.client.1.smithi098.stdout:1/260: dwrite d1/d25/f29 [0,4194304] 0 2023-01-04T18:16:29.430 INFO:tasks.workunit.client.1.smithi098.stdout:6/325: truncate d9/dd/d1f/f27 2886365 0 2023-01-04T18:16:29.430 INFO:tasks.workunit.client.1.smithi098.stdout:6/326: chown d9/dd/de/c13 58795 1 2023-01-04T18:16:29.432 INFO:tasks.workunit.client.1.smithi098.stdout:4/317: creat d5/de/d21/f6b x:0 0 0 2023-01-04T18:16:29.433 INFO:tasks.workunit.client.1.smithi098.stdout:5/334: dread d1/f1d [0,4194304] 0 2023-01-04T18:16:29.434 INFO:tasks.workunit.client.1.smithi098.stdout:0/374: rmdir df/d17/d1c/d2c/d41/d4a/d4c/d5f 39 2023-01-04T18:16:29.435 INFO:tasks.workunit.client.1.smithi098.stdout:2/391: dwrite d6/dc/d2b/d42/d47/d35/f49 [0,4194304] 0 2023-01-04T18:16:29.436 INFO:tasks.workunit.client.1.smithi098.stdout:3/413: link d6/d10/d19/d3f/d5e/d74/f3c d6/d10/d19/f8c 0 2023-01-04T18:16:29.437 INFO:tasks.workunit.client.1.smithi098.stdout:7/287: link d1/d23/f2c d1/d4/d11/f60 0 2023-01-04T18:16:29.437 INFO:tasks.workunit.client.1.smithi098.stdout:2/392: read d6/dc/d2b/d42/d47/d1f/d39/f64 [3899662,120164] 0 2023-01-04T18:16:29.445 INFO:tasks.workunit.client.1.smithi098.stdout:8/297: dwrite d6/fe [4194304,4194304] 0 2023-01-04T18:16:29.445 INFO:tasks.workunit.client.1.smithi098.stdout:1/261: symlink d1/d25/d36/d4e/l57 0 2023-01-04T18:16:29.446 INFO:tasks.workunit.client.1.smithi098.stdout:9/374: dwrite d2/d5/d18/d4e/d2e/d26/f7e [4194304,4194304] 0 2023-01-04T18:16:29.446 INFO:tasks.workunit.client.1.smithi098.stdout:9/375: write d2/d5/f77 [910585,4425] 0 2023-01-04T18:16:29.446 INFO:tasks.workunit.client.1.smithi098.stdout:6/327: symlink d9/dd/de/l5c 0 2023-01-04T18:16:29.447 INFO:tasks.workunit.client.1.smithi098.stdout:6/328: write d9/fa [7439310,100403] 0 2023-01-04T18:16:29.447 INFO:tasks.workunit.client.1.smithi098.stdout:4/318: mknod d5/d9/d13/c6c 0 2023-01-04T18:16:29.447 INFO:tasks.workunit.client.1.smithi098.stdout:4/319: chown d5/de/d2c/f3e 6 1 2023-01-04T18:16:29.447 INFO:tasks.workunit.client.1.smithi098.stdout:4/320: readlink d5/d9/d13/l35 0 2023-01-04T18:16:29.448 INFO:tasks.workunit.client.1.smithi098.stdout:5/335: creat d1/d2f/f64 x:0 0 0 2023-01-04T18:16:29.448 INFO:tasks.workunit.client.1.smithi098.stdout:5/336: write d1/d2f/f5e [1109629,76500] 0 2023-01-04T18:16:29.448 INFO:tasks.workunit.client.1.smithi098.stdout:0/375: truncate df/f52 80496 0 2023-01-04T18:16:29.450 INFO:tasks.workunit.client.1.smithi098.stdout:7/288: creat d1/d2e/f61 x:0 0 0 2023-01-04T18:16:29.450 INFO:tasks.workunit.client.1.smithi098.stdout:2/393: creat d6/dc/d2b/d46/f86 x:0 0 0 2023-01-04T18:16:29.457 INFO:tasks.workunit.client.1.smithi098.stdout:8/298: mkdir d6/dc/d5a 0 2023-01-04T18:16:29.457 INFO:tasks.workunit.client.1.smithi098.stdout:8/299: write d6/dc/d12/f41 [925472,4881] 0 2023-01-04T18:16:29.458 INFO:tasks.workunit.client.1.smithi098.stdout:1/262: creat d1/d2e/f58 x:0 0 0 2023-01-04T18:16:29.458 INFO:tasks.workunit.client.1.smithi098.stdout:1/263: chown d1/d8/l26 37140 1 2023-01-04T18:16:29.458 INFO:tasks.workunit.client.1.smithi098.stdout:8/300: dread d6/d11/d15/f1d [0,4194304] 0 2023-01-04T18:16:29.458 INFO:tasks.workunit.client.1.smithi098.stdout:9/376: symlink d2/d5/d18/d4e/d42/l80 0 2023-01-04T18:16:29.460 INFO:tasks.workunit.client.1.smithi098.stdout:6/329: creat d9/dd/de/d20/f5d x:0 0 0 2023-01-04T18:16:29.460 INFO:tasks.workunit.client.1.smithi098.stdout:6/330: chown d9 977026 1 2023-01-04T18:16:29.463 INFO:tasks.workunit.client.1.smithi098.stdout:4/321: creat d5/d28/d40/d5d/f6d x:0 0 0 2023-01-04T18:16:29.463 INFO:tasks.workunit.client.1.smithi098.stdout:4/322: chown d5/d9/f1a 12 1 2023-01-04T18:16:29.464 INFO:tasks.workunit.client.1.smithi098.stdout:5/337: mknod d1/da/c65 0 2023-01-04T18:16:29.465 INFO:tasks.workunit.client.1.smithi098.stdout:3/414: dread d6/d10/d19/d3f/d5e/d74/f45 [0,4194304] 0 2023-01-04T18:16:29.465 INFO:tasks.workunit.client.1.smithi098.stdout:0/376: truncate df/d17/d1c/d2c/d41/d4a/d4c/f66 282588 0 2023-01-04T18:16:29.466 INFO:tasks.workunit.client.1.smithi098.stdout:7/289: creat d1/f62 x:0 0 0 2023-01-04T18:16:29.467 INFO:tasks.workunit.client.1.smithi098.stdout:7/290: write d1/f62 [344150,51950] 0 2023-01-04T18:16:29.467 INFO:tasks.workunit.client.1.smithi098.stdout:7/291: truncate d1/d2e/f61 718492 0 2023-01-04T18:16:29.469 INFO:tasks.workunit.client.1.smithi098.stdout:1/264: unlink d1/d25/d39/l4d 0 2023-01-04T18:16:29.469 INFO:tasks.workunit.client.1.smithi098.stdout:8/301: symlink d6/d11/d15/d1b/d2a/d3b/d4c/d54/l5b 0 2023-01-04T18:16:29.469 INFO:tasks.workunit.client.1.smithi098.stdout:1/265: truncate d1/d8/f3e 364752 0 2023-01-04T18:16:29.469 INFO:tasks.workunit.client.1.smithi098.stdout:1/266: dread - d1/d25/d36/f40 zero size 2023-01-04T18:16:29.470 INFO:tasks.workunit.client.1.smithi098.stdout:5/338: mkdir d1/d2f/d66 0 2023-01-04T18:16:29.471 INFO:tasks.workunit.client.1.smithi098.stdout:3/415: creat d6/d10/d6b/f8d x:0 0 0 2023-01-04T18:16:29.471 INFO:tasks.workunit.client.1.smithi098.stdout:0/377: symlink df/d40/d86/l8b 0 2023-01-04T18:16:29.472 INFO:tasks.workunit.client.1.smithi098.stdout:1/267: write d1/d8/da/d12/f2b [892392,52751] 0 2023-01-04T18:16:29.472 INFO:tasks.workunit.client.1.smithi098.stdout:5/339: mknod d1/da/d44/c67 0 2023-01-04T18:16:29.472 INFO:tasks.workunit.client.1.smithi098.stdout:5/340: stat d1/d2/d14/d19/f22 0 2023-01-04T18:16:29.474 INFO:tasks.workunit.client.1.smithi098.stdout:0/378: truncate f3 53858 0 2023-01-04T18:16:29.477 INFO:tasks.workunit.client.1.smithi098.stdout:1/268: read d1/d8/da/f1a [4966620,98270] 0 2023-01-04T18:16:29.481 INFO:tasks.workunit.client.1.smithi098.stdout:3/416: write d6/d10/d19/d3f/d5e/d7d/f5c [432783,65562] 0 2023-01-04T18:16:29.481 INFO:tasks.workunit.client.1.smithi098.stdout:7/292: dread d1/d2e/f35 [0,4194304] 0 2023-01-04T18:16:29.482 INFO:tasks.workunit.client.1.smithi098.stdout:0/379: rename df/d4f/f51 to df/d4f/f8c 0 2023-01-04T18:16:29.484 INFO:tasks.workunit.client.1.smithi098.stdout:7/293: truncate d1/d51/d26/d28/d2d/f34 2851252 0 2023-01-04T18:16:29.486 INFO:tasks.workunit.client.1.smithi098.stdout:7/294: creat d1/d4/d11/d5d/f63 x:0 0 0 2023-01-04T18:16:29.487 INFO:tasks.workunit.client.1.smithi098.stdout:1/269: dread d1/f30 [0,4194304] 0 2023-01-04T18:16:29.487 INFO:tasks.workunit.client.1.smithi098.stdout:1/270: write d1/d8/f3e [267285,29837] 0 2023-01-04T18:16:29.487 INFO:tasks.workunit.client.1.smithi098.stdout:7/295: rmdir d1/d51 39 2023-01-04T18:16:29.488 INFO:tasks.workunit.client.1.smithi098.stdout:1/271: fsync d1/d8/da/d12/f46 0 2023-01-04T18:16:29.490 INFO:tasks.workunit.client.1.smithi098.stdout:1/272: link d1/d25/d36/f50 d1/d25/f59 0 2023-01-04T18:16:29.493 INFO:tasks.workunit.client.1.smithi098.stdout:0/380: dread df/d4f/f55 [0,4194304] 0 2023-01-04T18:16:29.495 INFO:tasks.workunit.client.1.smithi098.stdout:0/381: mknod df/d17/d68/c8d 0 2023-01-04T18:16:29.501 INFO:tasks.workunit.client.1.smithi098.stdout:6/331: dwrite d9/dd/de/f1e [0,4194304] 0 2023-01-04T18:16:29.501 INFO:tasks.workunit.client.1.smithi098.stdout:6/332: chown d9/c37 83631347 1 2023-01-04T18:16:29.502 INFO:tasks.workunit.client.1.smithi098.stdout:2/394: dwrite d6/f16 [0,4194304] 0 2023-01-04T18:16:29.503 INFO:tasks.workunit.client.1.smithi098.stdout:2/395: chown f5 79516 1 2023-01-04T18:16:29.503 INFO:tasks.workunit.client.1.smithi098.stdout:8/302: dwrite d6/dc/f2e [0,4194304] 0 2023-01-04T18:16:29.503 INFO:tasks.workunit.client.1.smithi098.stdout:4/323: dwrite d5/d28/f2b [0,4194304] 0 2023-01-04T18:16:29.504 INFO:tasks.workunit.client.1.smithi098.stdout:4/324: fdatasync d5/de/d21/f22 0 2023-01-04T18:16:29.507 INFO:tasks.workunit.client.1.smithi098.stdout:8/303: chown d6/d11/d15/d1b/c25 120999127 1 2023-01-04T18:16:29.508 INFO:tasks.workunit.client.1.smithi098.stdout:9/377: dwrite d2/d5/d18/d1d/f30 [0,4194304] 0 2023-01-04T18:16:29.508 INFO:tasks.workunit.client.1.smithi098.stdout:7/296: dwrite d1/d23/d21/f4f [0,4194304] 0 2023-01-04T18:16:29.516 INFO:tasks.workunit.client.1.smithi098.stdout:0/382: dwrite df/d4f/f7d [0,4194304] 0 2023-01-04T18:16:29.516 INFO:tasks.workunit.client.1.smithi098.stdout:0/383: truncate df/d17/d1c/d3b/f78 190829 0 2023-01-04T18:16:29.519 INFO:tasks.workunit.client.1.smithi098.stdout:8/304: creat d6/dc/d12/d1e/d37/d4b/f5c x:0 0 0 2023-01-04T18:16:29.519 INFO:tasks.workunit.client.1.smithi098.stdout:8/305: fsync d6/d11/d15/d1b/d2a/d3b/f3c 0 2023-01-04T18:16:29.519 INFO:tasks.workunit.client.1.smithi098.stdout:8/306: chown d6/dc/l14 759347 1 2023-01-04T18:16:29.521 INFO:tasks.workunit.client.1.smithi098.stdout:9/378: unlink d2/d5/d18/f1f 0 2023-01-04T18:16:29.521 INFO:tasks.workunit.client.1.smithi098.stdout:9/379: chown d2/d5/d18/d4e/d2e/d26/d41/d57/l6b 5534 1 2023-01-04T18:16:29.522 INFO:tasks.workunit.client.1.smithi098.stdout:7/297: symlink d1/da/l64 0 2023-01-04T18:16:29.522 INFO:tasks.workunit.client.1.smithi098.stdout:7/298: fdatasync d1/d23/d37/d40/f5c 0 2023-01-04T18:16:29.523 INFO:tasks.workunit.client.1.smithi098.stdout:1/273: dwrite d1/d8/da/d12/f2b [0,4194304] 0 2023-01-04T18:16:29.527 INFO:tasks.workunit.client.1.smithi098.stdout:6/333: rmdir d9/dd/de/d26/d4c 0 2023-01-04T18:16:29.529 INFO:tasks.workunit.client.1.smithi098.stdout:8/307: creat d6/d11/d15/d1b/d2a/d3b/f5d x:0 0 0 2023-01-04T18:16:29.529 INFO:tasks.workunit.client.1.smithi098.stdout:8/308: fdatasync d6/d11/d15/d1b/d2a/d3b/f35 0 2023-01-04T18:16:29.529 INFO:tasks.workunit.client.1.smithi098.stdout:9/380: getdents d2/d5/d18/d4e/d2e/d26 0 2023-01-04T18:16:29.530 INFO:tasks.workunit.client.1.smithi098.stdout:9/381: stat d2/d5/d18/d4e/d2e/d26/f7e 0 2023-01-04T18:16:29.531 INFO:tasks.workunit.client.1.smithi098.stdout:7/299: rename d1/d4/l4d to d1/d23/d21/l65 0 2023-01-04T18:16:29.533 INFO:tasks.workunit.client.1.smithi098.stdout:0/384: dwrite df/d17/f54 [0,4194304] 0 2023-01-04T18:16:29.533 INFO:tasks.workunit.client.1.smithi098.stdout:0/385: read df/d17/d1c/d2c/d41/d4a/d4c/f66 [62767,93402] 0 2023-01-04T18:16:29.536 INFO:tasks.workunit.client.1.smithi098.stdout:6/334: creat d9/dd/de/d44/f5e x:0 0 0 2023-01-04T18:16:29.537 INFO:tasks.workunit.client.1.smithi098.stdout:9/382: mknod d2/d53/c81 0 2023-01-04T18:16:29.539 INFO:tasks.workunit.client.1.smithi098.stdout:1/274: rename d1/d25/d36/f52 to d1/d8/da/d12/d54/f5a 0 2023-01-04T18:16:29.545 INFO:tasks.workunit.client.1.smithi098.stdout:7/300: creat d1/d51/d26/d28/f66 x:0 0 0 2023-01-04T18:16:29.546 INFO:tasks.workunit.client.1.smithi098.stdout:0/386: mkdir df/d17/d1c/d2c/d41/d4a/d4c/d8e 0 2023-01-04T18:16:29.549 INFO:tasks.workunit.client.1.smithi098.stdout:9/383: rename d2/d5/d18/d4e/d2e/d26/d76 to d2/d5/d18/d19/d82 0 2023-01-04T18:16:29.549 INFO:tasks.workunit.client.1.smithi098.stdout:9/384: truncate d2/d53/f65 777113 0 2023-01-04T18:16:29.551 INFO:tasks.workunit.client.1.smithi098.stdout:0/387: creat df/d17/d24/d80/f8f x:0 0 0 2023-01-04T18:16:29.551 INFO:tasks.workunit.client.1.smithi098.stdout:0/388: chown df/d17/d1c/d2c/d41/d4a/d7a/c85 2963 1 2023-01-04T18:16:29.553 INFO:tasks.workunit.client.1.smithi098.stdout:7/301: rename d1/d23/d21/l3e to d1/d51/l67 0 2023-01-04T18:16:29.553 INFO:tasks.workunit.client.1.smithi098.stdout:7/302: read - d1/f49 zero size 2023-01-04T18:16:29.553 INFO:tasks.workunit.client.1.smithi098.stdout:7/303: chown d1/da 3386739 1 2023-01-04T18:16:29.554 INFO:tasks.workunit.client.1.smithi098.stdout:0/389: mkdir df/d17/d1c/d2c/d41/d4a/d4c/d90 0 2023-01-04T18:16:29.554 INFO:tasks.workunit.client.1.smithi098.stdout:0/390: chown df/d17/d1c/d2c/d41/d4a/d4c/f66 272 1 2023-01-04T18:16:29.556 INFO:tasks.workunit.client.1.smithi098.stdout:7/304: rename d1/f3c to d1/da/f68 0 2023-01-04T18:16:29.558 INFO:tasks.workunit.client.1.smithi098.stdout:0/391: creat df/d40/d5c/f91 x:0 0 0 2023-01-04T18:16:29.558 INFO:tasks.workunit.client.1.smithi098.stdout:0/392: chown df/d17/f1d 48115470 1 2023-01-04T18:16:29.559 INFO:tasks.workunit.client.1.smithi098.stdout:0/393: creat df/d17/d1c/d2c/d41/f92 x:0 0 0 2023-01-04T18:16:29.559 INFO:tasks.workunit.client.1.smithi098.stdout:0/394: stat df/d17/d1c/d2c/d41/d4a/d56/f82 0 2023-01-04T18:16:29.560 INFO:tasks.workunit.client.1.smithi098.stdout:0/395: chown df/d17/l35 255112 1 2023-01-04T18:16:29.561 INFO:tasks.workunit.client.1.smithi098.stdout:0/396: rename df/f14 to df/d17/d1c/d2c/d41/d4a/d4c/d5f/f93 0 2023-01-04T18:16:29.562 INFO:tasks.workunit.client.1.smithi098.stdout:0/397: unlink df/d4f/f8c 0 2023-01-04T18:16:29.563 INFO:tasks.workunit.client.1.smithi098.stdout:0/398: mkdir df/d4f/d6b/d94 0 2023-01-04T18:16:29.564 INFO:tasks.workunit.client.1.smithi098.stdout:0/399: mknod df/d17/d1c/d3b/c95 0 2023-01-04T18:16:29.564 INFO:tasks.workunit.client.1.smithi098.stdout:0/400: dread - df/d17/d24/f34 zero size 2023-01-04T18:16:29.565 INFO:tasks.workunit.client.1.smithi098.stdout:0/401: truncate df/d17/d1c/f3a 137413 0 2023-01-04T18:16:29.565 INFO:tasks.workunit.client.1.smithi098.stdout:0/402: chown df/d40 503760 1 2023-01-04T18:16:29.565 INFO:tasks.workunit.client.1.smithi098.stdout:0/403: chown df/d17/d1c/f1e 2 1 2023-01-04T18:16:29.565 INFO:tasks.workunit.client.1.smithi098.stdout:0/404: fsync df/d17/f4b 0 2023-01-04T18:16:29.566 INFO:tasks.workunit.client.1.smithi098.stdout:0/405: creat df/d40/d5c/f96 x:0 0 0 2023-01-04T18:16:29.577 INFO:tasks.workunit.client.1.smithi098.stdout:1/275: dwrite d1/f22 [0,4194304] 0 2023-01-04T18:16:29.579 INFO:tasks.workunit.client.1.smithi098.stdout:1/276: creat d1/d8/da/d12/d54/f5b x:0 0 0 2023-01-04T18:16:29.581 INFO:tasks.workunit.client.1.smithi098.stdout:1/277: unlink d1/d25/f29 0 2023-01-04T18:16:29.583 INFO:tasks.workunit.client.1.smithi098.stdout:1/278: rmdir d1/d8/d56 0 2023-01-04T18:16:29.583 INFO:tasks.workunit.client.1.smithi098.stdout:1/279: mkdir d1/d25/d27/d5c 0 2023-01-04T18:16:29.584 INFO:tasks.workunit.client.1.smithi098.stdout:1/280: read d1/d8/da/d12/f41 [2021012,39533] 0 2023-01-04T18:16:29.585 INFO:tasks.workunit.client.1.smithi098.stdout:1/281: write d1/d8/f10 [168687,11349] 0 2023-01-04T18:16:29.585 INFO:tasks.workunit.client.1.smithi098.stdout:1/282: rename d1/d25/d36 to d1/d25/d36/d5d 22 2023-01-04T18:16:29.587 INFO:tasks.workunit.client.1.smithi098.stdout:9/385: dwrite d2/d5/d18/f39 [0,4194304] 0 2023-01-04T18:16:29.587 INFO:tasks.workunit.client.1.smithi098.stdout:6/335: dwrite d9/dd/f29 [0,4194304] 0 2023-01-04T18:16:29.589 INFO:tasks.workunit.client.1.smithi098.stdout:9/386: dread d2/d5/f77 [0,4194304] 0 2023-01-04T18:16:29.589 INFO:tasks.workunit.client.1.smithi098.stdout:9/387: readlink d2/d5/d18/d4e/d42/l80 0 2023-01-04T18:16:29.589 INFO:tasks.workunit.client.1.smithi098.stdout:9/388: write d2/d5/d18/d4e/d2e/f79 [954815,8596] 0 2023-01-04T18:16:29.592 INFO:tasks.workunit.client.1.smithi098.stdout:7/305: getdents d1/d51 0 2023-01-04T18:16:29.592 INFO:tasks.workunit.client.1.smithi098.stdout:7/306: read - d1/d4/d11/d5d/f63 zero size 2023-01-04T18:16:29.592 INFO:tasks.workunit.client.1.smithi098.stdout:7/307: fsync d1/d51/d26/d28/f66 0 2023-01-04T18:16:29.593 INFO:tasks.workunit.client.1.smithi098.stdout:7/308: readlink d1/d51/l67 0 2023-01-04T18:16:29.600 INFO:tasks.workunit.client.1.smithi098.stdout:1/283: dwrite d1/d2e/f4a [0,4194304] 0 2023-01-04T18:16:29.601 INFO:tasks.workunit.client.1.smithi098.stdout:6/336: creat d9/dd/d15/f5f x:0 0 0 2023-01-04T18:16:29.604 INFO:tasks.workunit.client.1.smithi098.stdout:9/389: mknod d2/d5/d18/d1d/d23/d66/c83 0 2023-01-04T18:16:29.605 INFO:tasks.workunit.client.1.smithi098.stdout:9/390: write d2/d5/d18/d4e/d2e/d26/f7e [5584072,67615] 0 2023-01-04T18:16:29.605 INFO:tasks.workunit.client.1.smithi098.stdout:7/309: creat d1/d4/d11/d5d/f69 x:0 0 0 2023-01-04T18:16:29.606 INFO:tasks.workunit.client.1.smithi098.stdout:7/310: write d1/d4/d11/f60 [3578967,31169] 0 2023-01-04T18:16:29.607 INFO:tasks.workunit.client.1.smithi098.stdout:1/284: unlink d1/d8/f3e 0 2023-01-04T18:16:29.608 INFO:tasks.workunit.client.1.smithi098.stdout:1/285: stat d1/d25/d36/c4c 0 2023-01-04T18:16:29.609 INFO:tasks.workunit.client.1.smithi098.stdout:6/337: creat d9/dd/d24/d3e/f60 x:0 0 0 2023-01-04T18:16:29.614 INFO:tasks.workunit.client.1.smithi098.stdout:9/391: creat d2/d5/d18/d19/d82/f84 x:0 0 0 2023-01-04T18:16:29.614 INFO:tasks.workunit.client.1.smithi098.stdout:9/392: chown d2/c11 4127 1 2023-01-04T18:16:29.615 INFO:tasks.workunit.client.1.smithi098.stdout:9/393: write d2/d5/d18/d4e/d2e/d26/f37 [680579,34616] 0 2023-01-04T18:16:29.617 INFO:tasks.workunit.client.1.smithi098.stdout:7/311: creat d1/d23/d21/f6a x:0 0 0 2023-01-04T18:16:29.617 INFO:tasks.workunit.client.1.smithi098.stdout:7/312: fsync d1/d4/d11/d5d/f69 0 2023-01-04T18:16:29.618 INFO:tasks.workunit.client.1.smithi098.stdout:1/286: mknod d1/d25/d36/c5e 0 2023-01-04T18:16:29.618 INFO:tasks.workunit.client.1.smithi098.stdout:6/338: symlink d9/dd/d4e/l61 0 2023-01-04T18:16:29.619 INFO:tasks.workunit.client.1.smithi098.stdout:9/394: getdents d2/d5/d18/d1d/d23/d5c 0 2023-01-04T18:16:29.620 INFO:tasks.workunit.client.1.smithi098.stdout:7/313: mkdir d1/d51/d26/d28/d2d/d6b 0 2023-01-04T18:16:29.621 INFO:tasks.workunit.client.1.smithi098.stdout:1/287: creat d1/d2e/f5f x:0 0 0 2023-01-04T18:16:29.621 INFO:tasks.workunit.client.1.smithi098.stdout:6/339: unlink d9/dd/d15/f5b 0 2023-01-04T18:16:29.622 INFO:tasks.workunit.client.1.smithi098.stdout:5/341: sync 2023-01-04T18:16:29.622 INFO:tasks.workunit.client.1.smithi098.stdout:2/396: sync 2023-01-04T18:16:29.623 INFO:tasks.workunit.client.1.smithi098.stdout:3/417: sync 2023-01-04T18:16:29.623 INFO:tasks.workunit.client.1.smithi098.stdout:2/397: read - d6/dc/d2b/d42/d47/d1f/f3a zero size 2023-01-04T18:16:29.623 INFO:tasks.workunit.client.1.smithi098.stdout:9/395: unlink d2/d5/d18/d1d/d23/l61 0 2023-01-04T18:16:29.623 INFO:tasks.workunit.client.1.smithi098.stdout:7/314: stat d1/d23/d37/d40/l50 0 2023-01-04T18:16:29.624 INFO:tasks.workunit.client.1.smithi098.stdout:4/325: sync 2023-01-04T18:16:29.625 INFO:tasks.workunit.client.1.smithi098.stdout:3/418: write d6/d10/f40 [2535271,84188] 0 2023-01-04T18:16:29.626 INFO:tasks.workunit.client.1.smithi098.stdout:7/315: symlink d1/d23/d21/d43/l6c 0 2023-01-04T18:16:29.628 INFO:tasks.workunit.client.1.smithi098.stdout:1/288: unlink d1/d8/da/d12/f41 0 2023-01-04T18:16:29.628 INFO:tasks.workunit.client.1.smithi098.stdout:1/289: truncate d1/f1f 1442949 0 2023-01-04T18:16:29.628 INFO:tasks.workunit.client.1.smithi098.stdout:1/290: read d1/d25/d27/f34 [3094346,1527] 0 2023-01-04T18:16:29.631 INFO:tasks.workunit.client.1.smithi098.stdout:3/419: symlink d6/d10/d19/l8e 0 2023-01-04T18:16:29.633 INFO:tasks.workunit.client.1.smithi098.stdout:7/316: rename d1/da/c58 to d1/c6d 0 2023-01-04T18:16:29.633 INFO:tasks.workunit.client.1.smithi098.stdout:9/396: dread d2/d5/d18/d4e/d42/f64 [0,4194304] 0 2023-01-04T18:16:29.633 INFO:tasks.workunit.client.1.smithi098.stdout:9/397: fdatasync d2/d5/d18/d19/f58 0 2023-01-04T18:16:29.633 INFO:tasks.workunit.client.1.smithi098.stdout:3/420: creat d6/d56/f8f x:0 0 0 2023-01-04T18:16:29.635 INFO:tasks.workunit.client.1.smithi098.stdout:7/317: creat d1/d51/d26/d28/f6e x:0 0 0 2023-01-04T18:16:29.636 INFO:tasks.workunit.client.1.smithi098.stdout:7/318: write d1/d51/d26/d28/d2d/f34 [737023,101399] 0 2023-01-04T18:16:29.637 INFO:tasks.workunit.client.1.smithi098.stdout:9/398: getdents d2/d5/d18/d4e/d2e/d26/d41/d57 0 2023-01-04T18:16:29.638 INFO:tasks.workunit.client.1.smithi098.stdout:9/399: truncate d2/d2d/f5d 1444720 0 2023-01-04T18:16:29.639 INFO:tasks.workunit.client.1.smithi098.stdout:7/319: rename d1/d23/d21/d43/l6c to d1/d51/d26/d28/d2d/l6f 0 2023-01-04T18:16:29.642 INFO:tasks.workunit.client.1.smithi098.stdout:9/400: rename d2/d5/d18/f3f to d2/d5/d18/d4e/d2e/d26/d41/f85 0 2023-01-04T18:16:29.644 INFO:tasks.workunit.client.1.smithi098.stdout:7/320: link d1/d51/f59 d1/d23/d21/d43/f70 0 2023-01-04T18:16:29.644 INFO:tasks.workunit.client.1.smithi098.stdout:6/340: dread d9/dd/d15/f41 [0,4194304] 0 2023-01-04T18:16:29.645 INFO:tasks.workunit.client.1.smithi098.stdout:9/401: symlink d2/d5/d18/d1d/d23/d66/l86 0 2023-01-04T18:16:29.646 INFO:tasks.workunit.client.1.smithi098.stdout:7/321: creat d1/d23/d37/f71 x:0 0 0 2023-01-04T18:16:29.647 INFO:tasks.workunit.client.1.smithi098.stdout:9/402: creat d2/d5/d18/d1d/d23/d5c/f87 x:0 0 0 2023-01-04T18:16:29.647 INFO:tasks.workunit.client.1.smithi098.stdout:9/403: stat d2/d5/d18/d4e/d42/l80 0 2023-01-04T18:16:29.648 INFO:tasks.workunit.client.1.smithi098.stdout:9/404: mknod d2/d2d/c88 0 2023-01-04T18:16:29.650 INFO:tasks.workunit.client.1.smithi098.stdout:9/405: mkdir d2/d5/d18/d4e/d42/d89 0 2023-01-04T18:16:29.651 INFO:tasks.workunit.client.1.smithi098.stdout:7/322: write d1/d51/d26/f30 [149909,7270] 0 2023-01-04T18:16:29.652 INFO:tasks.workunit.client.1.smithi098.stdout:2/398: dwrite d6/f20 [0,4194304] 0 2023-01-04T18:16:29.652 INFO:tasks.workunit.client.1.smithi098.stdout:9/406: unlink d2/d5/l68 0 2023-01-04T18:16:29.654 INFO:tasks.workunit.client.1.smithi098.stdout:7/323: mknod d1/d23/d21/d43/c72 0 2023-01-04T18:16:29.660 INFO:tasks.workunit.client.1.smithi098.stdout:2/399: rmdir d6/dc/d2b/d42/d47/d1f/d39/d6e 39 2023-01-04T18:16:29.662 INFO:tasks.workunit.client.1.smithi098.stdout:9/407: rename d2/d5/d18/d1d/f30 to d2/d5/d6f/f8a 0 2023-01-04T18:16:29.662 INFO:tasks.workunit.client.1.smithi098.stdout:0/406: sync 2023-01-04T18:16:29.662 INFO:tasks.workunit.client.1.smithi098.stdout:8/309: sync 2023-01-04T18:16:29.662 INFO:tasks.workunit.client.1.smithi098.stdout:0/407: chown df/d40 123669536 1 2023-01-04T18:16:29.663 INFO:tasks.workunit.client.1.smithi098.stdout:9/408: read d2/d5/f24 [2003276,115333] 0 2023-01-04T18:16:29.663 INFO:tasks.workunit.client.1.smithi098.stdout:5/342: dwrite d1/da/f33 [0,4194304] 0 2023-01-04T18:16:29.663 INFO:tasks.workunit.client.1.smithi098.stdout:7/324: mkdir d1/d23/d73 0 2023-01-04T18:16:29.664 INFO:tasks.workunit.client.1.smithi098.stdout:2/400: symlink d6/dc/d2b/d42/d47/d1f/d39/d6e/l87 0 2023-01-04T18:16:29.664 INFO:tasks.workunit.client.1.smithi098.stdout:2/401: fdatasync d6/dc/d2b/f40 0 2023-01-04T18:16:29.664 INFO:tasks.workunit.client.1.smithi098.stdout:2/402: readlink d6/dc/d2b/d42/d47/d1f/l76 0 2023-01-04T18:16:29.665 INFO:tasks.workunit.client.1.smithi098.stdout:0/408: creat df/d40/f97 x:0 0 0 2023-01-04T18:16:29.665 INFO:tasks.workunit.client.1.smithi098.stdout:0/409: write df/d17/d1c/f3a [1085394,125547] 0 2023-01-04T18:16:29.665 INFO:tasks.workunit.client.1.smithi098.stdout:8/310: creat d6/d11/d15/d1b/d2a/d3b/d59/f5e x:0 0 0 2023-01-04T18:16:29.665 INFO:tasks.workunit.client.1.smithi098.stdout:8/311: read - d6/dc/d12/d1e/d37/d4b/f5c zero size 2023-01-04T18:16:29.666 INFO:tasks.workunit.client.1.smithi098.stdout:9/409: truncate d2/d53/f5e 2922224 0 2023-01-04T18:16:29.668 INFO:tasks.workunit.client.1.smithi098.stdout:9/410: dread d2/d5/d18/d1d/d23/d66/f67 [0,4194304] 0 2023-01-04T18:16:29.668 INFO:tasks.workunit.client.1.smithi098.stdout:5/343: creat d1/d1e/f68 x:0 0 0 2023-01-04T18:16:29.669 INFO:tasks.workunit.client.1.smithi098.stdout:2/403: creat d6/dc/d2b/d42/d47/d1f/d39/d6e/f88 x:0 0 0 2023-01-04T18:16:29.671 INFO:tasks.workunit.client.1.smithi098.stdout:4/326: dwrite d5/f8 [0,4194304] 0 2023-01-04T18:16:29.671 INFO:tasks.workunit.client.1.smithi098.stdout:3/421: dwrite d6/d10/d19/d3f/d46/f5a [0,4194304] 0 2023-01-04T18:16:29.671 INFO:tasks.workunit.client.1.smithi098.stdout:0/410: rename df/d17/d1c/d2c/d41/d4a/d56 to df/d17/d1c/d3b/d98 0 2023-01-04T18:16:29.672 INFO:tasks.workunit.client.1.smithi098.stdout:6/341: dwrite d9/dd/de/f1e [4194304,4194304] 0 2023-01-04T18:16:29.672 INFO:tasks.workunit.client.1.smithi098.stdout:0/411: write df/d17/d1c/f1e [1005164,107879] 0 2023-01-04T18:16:29.673 INFO:tasks.workunit.client.1.smithi098.stdout:0/412: truncate df/d17/f4b 935052 0 2023-01-04T18:16:29.673 INFO:tasks.workunit.client.1.smithi098.stdout:0/413: truncate df/d17/d1c/d2c/d41/d4a/d4c/d5f/f63 486882 0 2023-01-04T18:16:29.673 INFO:tasks.workunit.client.1.smithi098.stdout:8/312: mknod d6/d11/d15/d1b/d2a/d3b/d4c/d54/c5f 0 2023-01-04T18:16:29.673 INFO:tasks.workunit.client.1.smithi098.stdout:6/342: write d9/dd/d15/f1a [4277376,72808] 0 2023-01-04T18:16:29.673 INFO:tasks.workunit.client.1.smithi098.stdout:6/343: write d9/dd/d24/d56/f59 [241869,9802] 0 2023-01-04T18:16:29.674 INFO:tasks.workunit.client.1.smithi098.stdout:9/411: creat d2/f8b x:0 0 0 2023-01-04T18:16:29.678 INFO:tasks.workunit.client.1.smithi098.stdout:2/404: mkdir d6/dc/d4b/d89 0 2023-01-04T18:16:29.679 INFO:tasks.workunit.client.1.smithi098.stdout:2/405: chown d6/dc/d2b/d42/d47/d1f 1 1 2023-01-04T18:16:29.691 INFO:tasks.workunit.client.1.smithi098.stdout:7/325: truncate d1/d51/d26/d28/d2d/f34 1123755 0 2023-01-04T18:16:29.691 INFO:tasks.workunit.client.1.smithi098.stdout:7/326: write d1/d2e/f61 [105486,21376] 0 2023-01-04T18:16:29.693 INFO:tasks.workunit.client.1.smithi098.stdout:3/422: mkdir d6/d10/d19/d3f/d5e/d7d/d90 0 2023-01-04T18:16:29.695 INFO:tasks.workunit.client.1.smithi098.stdout:5/344: rename d1/d2/d14/d19/f25 to d1/d38/f69 0 2023-01-04T18:16:29.696 INFO:tasks.workunit.client.1.smithi098.stdout:2/406: dwrite d6/dc/f12 [0,4194304] 0 2023-01-04T18:16:29.697 INFO:tasks.workunit.client.1.smithi098.stdout:5/345: dread d1/d38/f41 [0,4194304] 0 2023-01-04T18:16:29.699 INFO:tasks.workunit.client.1.smithi098.stdout:0/414: mknod df/d40/d5c/c99 0 2023-01-04T18:16:29.702 INFO:tasks.workunit.client.1.smithi098.stdout:8/313: mknod d6/d11/d15/d1b/d2a/c60 0 2023-01-04T18:16:29.709 INFO:tasks.workunit.client.1.smithi098.stdout:6/344: rmdir d9/dd 39 2023-01-04T18:16:29.709 INFO:tasks.workunit.client.1.smithi098.stdout:6/345: chown d9/dd/de/d44/l52 10695894 1 2023-01-04T18:16:29.711 INFO:tasks.workunit.client.1.smithi098.stdout:5/346: dwrite d1/d38/f41 [0,4194304] 0 2023-01-04T18:16:29.712 INFO:tasks.workunit.client.1.smithi098.stdout:5/347: chown d1/d2/d14/l21 2837889 1 2023-01-04T18:16:29.712 INFO:tasks.workunit.client.1.smithi098.stdout:5/348: write d1/d2/d14/f27 [4796368,15946] 0 2023-01-04T18:16:29.712 INFO:tasks.workunit.client.1.smithi098.stdout:9/412: rmdir d2/d5/d18/d1d/d23/d5c 39 2023-01-04T18:16:29.717 INFO:tasks.workunit.client.1.smithi098.stdout:7/327: mknod d1/da/c74 0 2023-01-04T18:16:29.718 INFO:tasks.workunit.client.1.smithi098.stdout:3/423: creat d6/d6f/f91 x:0 0 0 2023-01-04T18:16:29.718 INFO:tasks.workunit.client.1.smithi098.stdout:3/424: chown d6/d10/c3d 11 1 2023-01-04T18:16:29.719 INFO:tasks.workunit.client.1.smithi098.stdout:7/328: fdatasync d1/d51/d26/f30 0 2023-01-04T18:16:29.719 INFO:tasks.workunit.client.1.smithi098.stdout:7/329: dread - d1/d2e/f39 zero size 2023-01-04T18:16:29.719 INFO:tasks.workunit.client.1.smithi098.stdout:7/330: dread - d1/d4/d11/d5d/f69 zero size 2023-01-04T18:16:29.719 INFO:tasks.workunit.client.1.smithi098.stdout:7/331: dread - d1/f47 zero size 2023-01-04T18:16:29.721 INFO:tasks.workunit.client.1.smithi098.stdout:4/327: rename d5/d9/d13/c6c to d5/de/d21/c6e 0 2023-01-04T18:16:29.723 INFO:tasks.workunit.client.1.smithi098.stdout:2/407: creat d6/dc/d2b/d42/d47/d1f/d39/f8a x:0 0 0 2023-01-04T18:16:29.724 INFO:tasks.workunit.client.1.smithi098.stdout:0/415: creat df/d4f/d6b/d89/f9a x:0 0 0 2023-01-04T18:16:29.725 INFO:tasks.workunit.client.1.smithi098.stdout:8/314: creat d6/dc/d12/d20/f61 x:0 0 0 2023-01-04T18:16:29.726 INFO:tasks.workunit.client.1.smithi098.stdout:6/346: getdents d9/dd/de 0 2023-01-04T18:16:29.737 INFO:tasks.workunit.client.1.smithi098.stdout:5/349: mkdir d1/d46/d6a 0 2023-01-04T18:16:29.738 INFO:tasks.workunit.client.1.smithi098.stdout:5/350: write d1/da/f1c [841568,69825] 0 2023-01-04T18:16:29.738 INFO:tasks.workunit.client.1.smithi098.stdout:3/425: creat d6/d56/f92 x:0 0 0 2023-01-04T18:16:29.740 INFO:tasks.workunit.client.1.smithi098.stdout:7/332: mkdir d1/d51/d26/d28/d2d/d75 0 2023-01-04T18:16:29.740 INFO:tasks.workunit.client.1.smithi098.stdout:7/333: truncate d1/d4/f29 2471229 0 2023-01-04T18:16:29.742 INFO:tasks.workunit.client.1.smithi098.stdout:3/426: dread d6/d10/f40 [0,4194304] 0 2023-01-04T18:16:29.742 INFO:tasks.workunit.client.1.smithi098.stdout:2/408: creat d6/dc/d2b/d42/d47/d1f/f8b x:0 0 0 2023-01-04T18:16:29.743 INFO:tasks.workunit.client.1.smithi098.stdout:2/409: write d6/dc/d2b/d42/d47/d1f/d39/f65 [877613,33175] 0 2023-01-04T18:16:29.743 INFO:tasks.workunit.client.1.smithi098.stdout:1/291: sync 2023-01-04T18:16:29.743 INFO:tasks.workunit.client.1.smithi098.stdout:1/292: write d1/d8/da/f1a [3710425,21335] 0 2023-01-04T18:16:29.747 INFO:tasks.workunit.client.1.smithi098.stdout:0/416: rename df/d40 to df/d17/d9b 0 2023-01-04T18:16:29.747 INFO:tasks.workunit.client.1.smithi098.stdout:8/315: stat d6/d11/l4a 0 2023-01-04T18:16:29.748 INFO:tasks.workunit.client.1.smithi098.stdout:6/347: creat d9/dd/de/d26/f62 x:0 0 0 2023-01-04T18:16:29.750 INFO:tasks.workunit.client.1.smithi098.stdout:9/413: link d2/d5/d18/d19/f4b d2/d5/d18/d1d/d23/f8c 0 2023-01-04T18:16:29.752 INFO:tasks.workunit.client.1.smithi098.stdout:5/351: getdents d1/d1e 0 2023-01-04T18:16:29.753 INFO:tasks.workunit.client.1.smithi098.stdout:7/334: stat d1/d51/d26/d28/d2d/l6f 0 2023-01-04T18:16:29.755 INFO:tasks.workunit.client.1.smithi098.stdout:4/328: dread d5/d9/f43 [0,4194304] 0 2023-01-04T18:16:29.756 INFO:tasks.workunit.client.1.smithi098.stdout:2/410: truncate d6/dc/d2b/d42/d47/d1f/f24 172594 0 2023-01-04T18:16:29.757 INFO:tasks.workunit.client.1.smithi098.stdout:8/316: dread d6/dc/d12/d1e/d44/f53 [0,4194304] 0 2023-01-04T18:16:29.757 INFO:tasks.workunit.client.1.smithi098.stdout:8/317: chown d6/dc/d12/d20/f45 188 1 2023-01-04T18:16:29.758 INFO:tasks.workunit.client.1.smithi098.stdout:8/318: truncate d6/dc/d12/d20/f45 434220 0 2023-01-04T18:16:29.758 INFO:tasks.workunit.client.1.smithi098.stdout:1/293: mknod d1/d25/d39/c60 0 2023-01-04T18:16:29.758 INFO:tasks.workunit.client.1.smithi098.stdout:1/294: write d1/d25/f59 [696210,99654] 0 2023-01-04T18:16:29.758 INFO:tasks.workunit.client.1.smithi098.stdout:3/427: dwrite d6/d10/d19/d3f/d5e/d74/f45 [0,4194304] 0 2023-01-04T18:16:29.758 INFO:tasks.workunit.client.1.smithi098.stdout:3/428: chown d6/d56/f8f 0 1 2023-01-04T18:16:29.759 INFO:tasks.workunit.client.1.smithi098.stdout:0/417: mknod df/d4f/d6b/d94/c9c 0 2023-01-04T18:16:29.759 INFO:tasks.workunit.client.1.smithi098.stdout:0/418: chown f1 94212330 1 2023-01-04T18:16:29.761 INFO:tasks.workunit.client.1.smithi098.stdout:7/335: dread d1/d2e/f61 [0,4194304] 0 2023-01-04T18:16:29.761 INFO:tasks.workunit.client.1.smithi098.stdout:7/336: truncate d1/d23/d37/f71 86602 0 2023-01-04T18:16:29.761 INFO:tasks.workunit.client.1.smithi098.stdout:7/337: chown d1/d4/d11/l5e 932 1 2023-01-04T18:16:29.761 INFO:tasks.workunit.client.1.smithi098.stdout:4/329: creat d5/de/d30/f6f x:0 0 0 2023-01-04T18:16:29.762 INFO:tasks.workunit.client.1.smithi098.stdout:4/330: write d5/d28/f2b [4152147,109216] 0 2023-01-04T18:16:29.762 INFO:tasks.workunit.client.1.smithi098.stdout:5/352: dread d1/d2/f17 [0,4194304] 0 2023-01-04T18:16:29.762 INFO:tasks.workunit.client.1.smithi098.stdout:5/353: fsync d1/d2f/f5f 0 2023-01-04T18:16:29.765 INFO:tasks.workunit.client.1.smithi098.stdout:6/348: dread d9/dd/d24/d56/f59 [0,4194304] 0 2023-01-04T18:16:29.765 INFO:tasks.workunit.client.1.smithi098.stdout:6/349: readlink d9/dd/de/lf 0 2023-01-04T18:16:29.765 INFO:tasks.workunit.client.1.smithi098.stdout:6/350: write d9/dd/d24/d3e/f60 [1032250,14766] 0 2023-01-04T18:16:29.765 INFO:tasks.workunit.client.1.smithi098.stdout:6/351: fdatasync d9/fa 0 2023-01-04T18:16:29.766 INFO:tasks.workunit.client.1.smithi098.stdout:2/411: getdents d6/dc/d2b/d42/d47/d1f/d82 0 2023-01-04T18:16:29.766 INFO:tasks.workunit.client.1.smithi098.stdout:2/412: write d6/dc/d2b/d42/f71 [966355,43072] 0 2023-01-04T18:16:29.767 INFO:tasks.workunit.client.1.smithi098.stdout:1/295: mknod d1/d8/c61 0 2023-01-04T18:16:29.768 INFO:tasks.workunit.client.1.smithi098.stdout:3/429: creat d6/d10/d19/d3f/d5e/d7d/d90/f93 x:0 0 0 2023-01-04T18:16:29.769 INFO:tasks.workunit.client.1.smithi098.stdout:2/413: write d6/dc/d2b/d42/d47/d35/f38 [2023598,46688] 0 2023-01-04T18:16:29.770 INFO:tasks.workunit.client.1.smithi098.stdout:0/419: symlink df/d17/d68/l9d 0 2023-01-04T18:16:29.771 INFO:tasks.workunit.client.1.smithi098.stdout:9/414: dwrite d2/d53/f65 [0,4194304] 0 2023-01-04T18:16:29.772 INFO:tasks.workunit.client.1.smithi098.stdout:7/338: creat d1/d23/d73/f76 x:0 0 0 2023-01-04T18:16:29.775 INFO:tasks.workunit.client.1.smithi098.stdout:4/331: creat d5/d28/d40/d5d/f70 x:0 0 0 2023-01-04T18:16:29.775 INFO:tasks.workunit.client.1.smithi098.stdout:4/332: write d5/f37 [426502,21993] 0 2023-01-04T18:16:29.776 INFO:tasks.workunit.client.1.smithi098.stdout:6/352: truncate d9/dd/d24/d56/f59 32750 0 2023-01-04T18:16:29.776 INFO:tasks.workunit.client.1.smithi098.stdout:6/353: dread - d9/dd/d24/f30 zero size 2023-01-04T18:16:29.778 INFO:tasks.workunit.client.1.smithi098.stdout:8/319: rename d6/d11/d15/d1b/d2a/d3b/d59/f5e to d6/d11/d15/d1b/f62 0 2023-01-04T18:16:29.779 INFO:tasks.workunit.client.1.smithi098.stdout:8/320: read - d6/dc/d12/d1e/d37/d4b/f50 zero size 2023-01-04T18:16:29.779 INFO:tasks.workunit.client.1.smithi098.stdout:8/321: write d6/d11/d15/d1b/d2a/d3b/f5d [802468,108463] 0 2023-01-04T18:16:29.779 INFO:tasks.workunit.client.1.smithi098.stdout:8/322: fdatasync d6/d11/d15/d1b/d2a/d3b/d4c/d54/f57 0 2023-01-04T18:16:29.782 INFO:tasks.workunit.client.1.smithi098.stdout:3/430: creat d6/d6f/f94 x:0 0 0 2023-01-04T18:16:29.782 INFO:tasks.workunit.client.1.smithi098.stdout:3/431: dread - d6/d6f/f94 zero size 2023-01-04T18:16:29.782 INFO:tasks.workunit.client.1.smithi098.stdout:3/432: chown d6/d10/d19/d3f/d5e/d74/f89 7357089 1 2023-01-04T18:16:29.782 INFO:tasks.workunit.client.1.smithi098.stdout:3/433: readlink d6/d10/d19/l35 0 2023-01-04T18:16:29.783 INFO:tasks.workunit.client.1.smithi098.stdout:3/434: chown d6/d10/d19/d3f/d5e/d7d/d90 19532988 1 2023-01-04T18:16:29.785 INFO:tasks.workunit.client.1.smithi098.stdout:2/414: creat d6/dc/f8c x:0 0 0 2023-01-04T18:16:29.786 INFO:tasks.workunit.client.1.smithi098.stdout:2/415: dread - d6/dc/d2b/d42/d47/d1f/f6f zero size 2023-01-04T18:16:29.787 INFO:tasks.workunit.client.1.smithi098.stdout:0/420: symlink df/d17/d1c/d2c/d41/d4a/d4c/l9e 0 2023-01-04T18:16:29.791 INFO:tasks.workunit.client.1.smithi098.stdout:9/415: creat d2/d2d/f8d x:0 0 0 2023-01-04T18:16:29.800 INFO:tasks.workunit.client.1.smithi098.stdout:4/333: getdents d5/de/d30 0 2023-01-04T18:16:29.800 INFO:tasks.workunit.client.1.smithi098.stdout:4/334: write d5/d28/d40/f64 [148317,13293] 0 2023-01-04T18:16:29.800 INFO:tasks.workunit.client.1.smithi098.stdout:4/335: dread - d5/de/d21/f2d zero size 2023-01-04T18:16:29.800 INFO:tasks.workunit.client.1.smithi098.stdout:4/336: readlink d5/de/d30/d4f/l63 0 2023-01-04T18:16:29.801 INFO:tasks.workunit.client.1.smithi098.stdout:6/354: symlink d9/dd/de/l63 0 2023-01-04T18:16:29.804 INFO:tasks.workunit.client.1.smithi098.stdout:7/339: rename d1/d51/d26/d28/d2d/f34 to d1/d23/d21/f77 0 2023-01-04T18:16:29.806 INFO:tasks.workunit.client.1.smithi098.stdout:8/323: mknod d6/dc/d12/d1e/d44/c63 0 2023-01-04T18:16:29.807 INFO:tasks.workunit.client.1.smithi098.stdout:1/296: mknod d1/d8/da/d12/c62 0 2023-01-04T18:16:29.809 INFO:tasks.workunit.client.1.smithi098.stdout:8/324: dread d6/d11/d15/d1b/d2a/d3b/f38 [0,4194304] 0 2023-01-04T18:16:29.809 INFO:tasks.workunit.client.1.smithi098.stdout:8/325: truncate d6/dc/d12/f48 922840 0 2023-01-04T18:16:29.809 INFO:tasks.workunit.client.1.smithi098.stdout:8/326: fsync d6/d11/d15/f43 0 2023-01-04T18:16:29.809 INFO:tasks.workunit.client.1.smithi098.stdout:8/327: fsync d6/dc/f2e 0 2023-01-04T18:16:29.810 INFO:tasks.workunit.client.1.smithi098.stdout:8/328: getdents d6/dc/d5a 0 2023-01-04T18:16:29.810 INFO:tasks.workunit.client.1.smithi098.stdout:8/329: fdatasync d6/dc/d12/d1e/d37/d4b/f5c 0 2023-01-04T18:16:29.810 INFO:tasks.workunit.client.1.smithi098.stdout:2/416: creat d6/dc/d2b/d42/d51/d79/f8d x:0 0 0 2023-01-04T18:16:29.811 INFO:tasks.workunit.client.1.smithi098.stdout:0/421: creat df/d17/d1c/d2c/d41/d64/f9f x:0 0 0 2023-01-04T18:16:29.812 INFO:tasks.workunit.client.1.smithi098.stdout:9/416: symlink d2/d5/d18/d4e/d2e/d26/d41/d57/d72/l8e 0 2023-01-04T18:16:29.815 INFO:tasks.workunit.client.1.smithi098.stdout:3/435: rename d6/d10/d19/d3f/d5e/d74/l72 to d6/d10/d29/l95 0 2023-01-04T18:16:29.817 INFO:tasks.workunit.client.1.smithi098.stdout:1/297: truncate d1/fc 3232560 0 2023-01-04T18:16:29.818 INFO:tasks.workunit.client.1.smithi098.stdout:4/337: dwrite d5/d28/d40/d5d/f6d [0,4194304] 0 2023-01-04T18:16:29.819 INFO:tasks.workunit.client.1.smithi098.stdout:9/417: creat d2/d5/d18/f8f x:0 0 0 2023-01-04T18:16:29.819 INFO:tasks.workunit.client.1.smithi098.stdout:9/418: write d2/d2d/f8d [592217,96839] 0 2023-01-04T18:16:29.821 INFO:tasks.workunit.client.1.smithi098.stdout:3/436: creat d6/d10/d19/d3f/f96 x:0 0 0 2023-01-04T18:16:29.822 INFO:tasks.workunit.client.1.smithi098.stdout:1/298: mknod d1/d25/d27/c63 0 2023-01-04T18:16:29.824 INFO:tasks.workunit.client.1.smithi098.stdout:4/338: mknod d5/de/d2c/c71 0 2023-01-04T18:16:29.824 INFO:tasks.workunit.client.1.smithi098.stdout:4/339: read d5/d28/d40/f56 [2050922,17622] 0 2023-01-04T18:16:29.827 INFO:tasks.workunit.client.1.smithi098.stdout:8/330: rename d6/d11/d15/d1b/d2a/d3b/d4c/d54/d58 to d6/dc/d12/d1e/d64 0 2023-01-04T18:16:29.827 INFO:tasks.workunit.client.1.smithi098.stdout:3/437: stat d6/d10/d29/l95 0 2023-01-04T18:16:29.827 INFO:tasks.workunit.client.1.smithi098.stdout:8/331: write d6/d11/d15/d1b/d2a/d3b/f38 [369396,52285] 0 2023-01-04T18:16:29.828 INFO:tasks.workunit.client.1.smithi098.stdout:1/299: mkdir d1/d8/da/d64 0 2023-01-04T18:16:29.829 INFO:tasks.workunit.client.1.smithi098.stdout:9/419: write d2/d5/d6f/f8a [1693436,49950] 0 2023-01-04T18:16:29.830 INFO:tasks.workunit.client.1.smithi098.stdout:7/340: getdents d1/d51/d26/d28/d2d 0 2023-01-04T18:16:29.830 INFO:tasks.workunit.client.1.smithi098.stdout:2/417: dwrite d6/dc/f8c [0,4194304] 0 2023-01-04T18:16:29.831 INFO:tasks.workunit.client.1.smithi098.stdout:0/422: dwrite df/d17/d9b/f97 [0,4194304] 0 2023-01-04T18:16:29.832 INFO:tasks.workunit.client.1.smithi098.stdout:4/340: symlink d5/d28/l72 0 2023-01-04T18:16:29.832 INFO:tasks.workunit.client.1.smithi098.stdout:4/341: fdatasync d5/d28/f51 0 2023-01-04T18:16:29.832 INFO:tasks.workunit.client.1.smithi098.stdout:4/342: truncate d5/d28/d40/d5d/f6d 4346038 0 2023-01-04T18:16:29.834 INFO:tasks.workunit.client.1.smithi098.stdout:3/438: truncate d6/d10/d19/d3f/d5e/d7d/f5c 267243 0 2023-01-04T18:16:29.834 INFO:tasks.workunit.client.1.smithi098.stdout:7/341: dread d1/d23/f2c [0,4194304] 0 2023-01-04T18:16:29.840 INFO:tasks.workunit.client.1.smithi098.stdout:2/418: dread d6/f2d [0,4194304] 0 2023-01-04T18:16:29.840 INFO:tasks.workunit.client.1.smithi098.stdout:9/420: getdents d2/d53 0 2023-01-04T18:16:29.846 INFO:tasks.workunit.client.1.smithi098.stdout:0/423: mkdir df/d17/d1c/d2c/d41/da0 0 2023-01-04T18:16:29.846 INFO:tasks.workunit.client.1.smithi098.stdout:0/424: chown df/d17/d1c/d2c/d41/d4a/d4c/l4d 29009545 1 2023-01-04T18:16:29.846 INFO:tasks.workunit.client.1.smithi098.stdout:0/425: fdatasync df/f28 0 2023-01-04T18:16:29.847 INFO:tasks.workunit.client.1.smithi098.stdout:0/426: write df/d17/d9b/f97 [958300,62064] 0 2023-01-04T18:16:29.848 INFO:tasks.workunit.client.1.smithi098.stdout:0/427: write df/d17/d1c/d3b/d98/f69 [179106,14421] 0 2023-01-04T18:16:29.848 INFO:tasks.workunit.client.1.smithi098.stdout:0/428: chown df/d17/d68/l9d 4 1 2023-01-04T18:16:29.850 INFO:tasks.workunit.client.1.smithi098.stdout:4/343: rename d5/d9/d13/f23 to d5/d28/d44/f73 0 2023-01-04T18:16:29.850 INFO:tasks.workunit.client.1.smithi098.stdout:2/419: dread d6/f4a [0,4194304] 0 2023-01-04T18:16:29.851 INFO:tasks.workunit.client.1.smithi098.stdout:1/300: getdents d1/d8/da 0 2023-01-04T18:16:29.851 INFO:tasks.workunit.client.1.smithi098.stdout:3/439: unlink d6/d56/f68 0 2023-01-04T18:16:29.852 INFO:tasks.workunit.client.1.smithi098.stdout:3/440: write d6/d10/d19/f8c [166310,76268] 0 2023-01-04T18:16:29.852 INFO:tasks.workunit.client.1.smithi098.stdout:9/421: rename d2/d5/d6f/l74 to d2/d5/d6f/l90 0 2023-01-04T18:16:29.854 INFO:tasks.workunit.client.1.smithi098.stdout:2/420: write d6/dc/d2b/d42/d47/d1f/f29 [361290,150] 0 2023-01-04T18:16:29.854 INFO:tasks.workunit.client.1.smithi098.stdout:4/344: symlink d5/d9/d13/l74 0 2023-01-04T18:16:29.854 INFO:tasks.workunit.client.1.smithi098.stdout:4/345: write d5/f38 [560777,87854] 0 2023-01-04T18:16:29.854 INFO:tasks.workunit.client.1.smithi098.stdout:1/301: chown d1/d8/da/d12/c32 62 1 2023-01-04T18:16:29.855 INFO:tasks.workunit.client.1.smithi098.stdout:1/302: truncate d1/d8/da/f24 4671397 0 2023-01-04T18:16:29.855 INFO:tasks.workunit.client.1.smithi098.stdout:3/441: symlink d6/d10/d19/d3f/d46/d8a/l97 0 2023-01-04T18:16:29.855 INFO:tasks.workunit.client.1.smithi098.stdout:9/422: rmdir d2/d5/d18/d4e 39 2023-01-04T18:16:29.856 INFO:tasks.workunit.client.1.smithi098.stdout:9/423: chown d2/d5/d18/d1d/d23/l7c 36918496 1 2023-01-04T18:16:29.857 INFO:tasks.workunit.client.1.smithi098.stdout:4/346: mkdir d5/de/d21/d75 0 2023-01-04T18:16:29.859 INFO:tasks.workunit.client.1.smithi098.stdout:3/442: link d6/d10/d19/d3f/d46/l84 d6/d10/d19/d3f/d46/l98 0 2023-01-04T18:16:29.867 INFO:tasks.workunit.client.1.smithi098.stdout:8/332: dwrite d6/d11/d15/d1b/d2a/d3b/f35 [0,4194304] 0 2023-01-04T18:16:29.869 INFO:tasks.workunit.client.1.smithi098.stdout:8/333: read d6/dc/d12/d1e/d37/f3a [150432,110039] 0 2023-01-04T18:16:29.874 INFO:tasks.workunit.client.1.smithi098.stdout:8/334: rmdir d6/d11/d15 39 2023-01-04T18:16:29.876 INFO:tasks.workunit.client.1.smithi098.stdout:8/335: dread d6/dc/d12/d1e/d37/f3a [0,4194304] 0 2023-01-04T18:16:29.878 INFO:tasks.workunit.client.1.smithi098.stdout:8/336: rmdir d6/d11/d36 39 2023-01-04T18:16:29.880 INFO:tasks.workunit.client.1.smithi098.stdout:8/337: link d6/d11/d36/c3d d6/dc/d12/d20/c65 0 2023-01-04T18:16:29.880 INFO:tasks.workunit.client.1.smithi098.stdout:8/338: stat d6/d11/d36/c3f 0 2023-01-04T18:16:29.880 INFO:tasks.workunit.client.1.smithi098.stdout:8/339: read - d6/dc/d12/d39/f47 zero size 2023-01-04T18:16:29.880 INFO:tasks.workunit.client.1.smithi098.stdout:8/340: write d6/dc/d12/f4f [913180,15427] 0 2023-01-04T18:16:29.880 INFO:tasks.workunit.client.1.smithi098.stdout:8/341: chown d6/dc/d12/d39 106998 1 2023-01-04T18:16:29.893 INFO:tasks.workunit.client.1.smithi098.stdout:7/342: dwrite d1/d4/f29 [0,4194304] 0 2023-01-04T18:16:29.894 INFO:tasks.workunit.client.1.smithi098.stdout:0/429: dwrite df/d17/d24/f34 [0,4194304] 0 2023-01-04T18:16:29.894 INFO:tasks.workunit.client.1.smithi098.stdout:9/424: fdatasync d2/d53/f5e 0 2023-01-04T18:16:29.894 INFO:tasks.workunit.client.1.smithi098.stdout:3/443: dwrite d6/d10/d19/f3a [0,4194304] 0 2023-01-04T18:16:29.902 INFO:tasks.workunit.client.1.smithi098.stdout:7/343: dread d1/d2e/f4c [0,4194304] 0 2023-01-04T18:16:29.903 INFO:tasks.workunit.client.1.smithi098.stdout:7/344: mkdir d1/d23/d37/d78 0 2023-01-04T18:16:29.903 INFO:tasks.workunit.client.1.smithi098.stdout:9/425: dread d2/d53/f5e [0,4194304] 0 2023-01-04T18:16:29.904 INFO:tasks.workunit.client.1.smithi098.stdout:1/303: dwrite d1/f4 [0,4194304] 0 2023-01-04T18:16:29.905 INFO:tasks.workunit.client.1.smithi098.stdout:7/345: rename d1/d4/l10 to d1/d51/d26/d28/d2d/l79 0 2023-01-04T18:16:29.905 INFO:tasks.workunit.client.1.smithi098.stdout:7/346: fdatasync d1/d4/d11/d5d/f63 0 2023-01-04T18:16:29.910 INFO:tasks.workunit.client.1.smithi098.stdout:2/421: dwrite d6/f20 [0,4194304] 0 2023-01-04T18:16:29.912 INFO:tasks.workunit.client.1.smithi098.stdout:8/342: dwrite d6/dc/f18 [0,4194304] 0 2023-01-04T18:16:29.912 INFO:tasks.workunit.client.1.smithi098.stdout:2/422: creat d6/dc/d4b/d89/f8e x:0 0 0 2023-01-04T18:16:29.914 INFO:tasks.workunit.client.1.smithi098.stdout:9/426: dread d2/d5/d18/d19/f3b [0,4194304] 0 2023-01-04T18:16:29.915 INFO:tasks.workunit.client.1.smithi098.stdout:9/427: write d2/d5/d18/f39 [4401934,121943] 0 2023-01-04T18:16:29.915 INFO:tasks.workunit.client.1.smithi098.stdout:9/428: chown d2/d2d/l4f 371 1 2023-01-04T18:16:29.915 INFO:tasks.workunit.client.1.smithi098.stdout:8/343: symlink d6/d11/d15/d1b/d2a/d3b/d4c/d54/l66 0 2023-01-04T18:16:29.915 INFO:tasks.workunit.client.1.smithi098.stdout:2/423: mkdir d6/dc/d2b/d42/d51/d81/d8f 0 2023-01-04T18:16:29.921 INFO:tasks.workunit.client.1.smithi098.stdout:3/444: dwrite d6/d10/d19/f8c [0,4194304] 0 2023-01-04T18:16:29.921 INFO:tasks.workunit.client.1.smithi098.stdout:3/445: chown d6/d10/f8b 1922318427 1 2023-01-04T18:16:29.925 INFO:tasks.workunit.client.1.smithi098.stdout:3/446: creat d6/d56/f99 x:0 0 0 2023-01-04T18:16:29.928 INFO:tasks.workunit.client.1.smithi098.stdout:5/354: sync 2023-01-04T18:16:29.928 INFO:tasks.workunit.client.1.smithi098.stdout:7/347: dwrite d1/d2e/f39 [0,4194304] 0 2023-01-04T18:16:29.929 INFO:tasks.workunit.client.1.smithi098.stdout:5/355: write d1/d38/f69 [1437220,36366] 0 2023-01-04T18:16:29.929 INFO:tasks.workunit.client.1.smithi098.stdout:5/356: stat d1/d2f/f5e 0 2023-01-04T18:16:29.929 INFO:tasks.workunit.client.1.smithi098.stdout:5/357: dread - d1/da/d44/d45/f5b zero size 2023-01-04T18:16:29.929 INFO:tasks.workunit.client.1.smithi098.stdout:5/358: write d1/da/f34 [4779570,99043] 0 2023-01-04T18:16:29.929 INFO:tasks.workunit.client.1.smithi098.stdout:5/359: write d1/d46/f49 [484333,83880] 0 2023-01-04T18:16:29.930 INFO:tasks.workunit.client.1.smithi098.stdout:3/447: symlink d6/l9a 0 2023-01-04T18:16:29.931 INFO:tasks.workunit.client.1.smithi098.stdout:7/348: creat d1/f7a x:0 0 0 2023-01-04T18:16:29.933 INFO:tasks.workunit.client.1.smithi098.stdout:7/349: symlink d1/d23/d37/l7b 0 2023-01-04T18:16:29.945 INFO:tasks.workunit.client.1.smithi098.stdout:7/350: dread d1/d51/d26/d28/d2d/f32 [0,4194304] 0 2023-01-04T18:16:29.946 INFO:tasks.workunit.client.1.smithi098.stdout:7/351: chown d1/d4/f29 4 1 2023-01-04T18:16:29.947 INFO:tasks.workunit.client.1.smithi098.stdout:2/424: dwrite d6/dc/d2b/d42/d47/d35/f72 [0,4194304] 0 2023-01-04T18:16:29.950 INFO:tasks.workunit.client.1.smithi098.stdout:8/344: rmdir d6/d11 39 2023-01-04T18:16:29.953 INFO:tasks.workunit.client.1.smithi098.stdout:8/345: dread d6/d11/d15/f1d [0,4194304] 0 2023-01-04T18:16:29.957 INFO:tasks.workunit.client.1.smithi098.stdout:6/355: sync 2023-01-04T18:16:29.958 INFO:tasks.workunit.client.1.smithi098.stdout:6/356: mkdir d9/dd/d24/d64 0 2023-01-04T18:16:29.958 INFO:tasks.workunit.client.1.smithi098.stdout:6/357: fsync d9/dd/de/d44/f5e 0 2023-01-04T18:16:29.959 INFO:tasks.workunit.client.1.smithi098.stdout:2/425: dread d6/dc/d2b/d42/d47/d1f/d39/f64 [0,4194304] 0 2023-01-04T18:16:29.959 INFO:tasks.workunit.client.1.smithi098.stdout:6/358: mkdir d9/dd/d24/d65 0 2023-01-04T18:16:29.959 INFO:tasks.workunit.client.1.smithi098.stdout:6/359: fdatasync d9/dd/f11 0 2023-01-04T18:16:29.978 INFO:tasks.workunit.client.1.smithi098.stdout:2/426: dread d6/dc/f8c [0,4194304] 0 2023-01-04T18:16:29.978 INFO:tasks.workunit.client.1.smithi098.stdout:2/427: write d6/dc/d2b/d42/d47/d31/f5e [185444,75925] 0 2023-01-04T18:16:29.978 INFO:tasks.workunit.client.1.smithi098.stdout:2/428: fsync d6/dc/d2b/d46/f86 0 2023-01-04T18:16:29.979 INFO:tasks.workunit.client.1.smithi098.stdout:2/429: rmdir d6/dc/d2b/d42/d47/d1f/d39 39 2023-01-04T18:16:29.979 INFO:tasks.workunit.client.1.smithi098.stdout:2/430: chown d6/dc/d2b/d42/d47/d1f/d82/c85 24 1 2023-01-04T18:16:29.980 INFO:tasks.workunit.client.1.smithi098.stdout:2/431: truncate d6/dc/d2b/f2e 3654250 0 2023-01-04T18:16:29.980 INFO:tasks.workunit.client.1.smithi098.stdout:2/432: stat d6/dc/d2b/f36 0 2023-01-04T18:16:29.983 INFO:tasks.workunit.client.1.smithi098.stdout:2/433: dread d6/dc/d2b/d42/d47/d35/f38 [0,4194304] 0 2023-01-04T18:16:29.985 INFO:tasks.workunit.client.1.smithi098.stdout:5/360: dwrite d1/d2/d14/f5c [0,4194304] 0 2023-01-04T18:16:29.986 INFO:tasks.workunit.client.1.smithi098.stdout:5/361: chown d1/da/f1c 1 1 2023-01-04T18:16:29.986 INFO:tasks.workunit.client.1.smithi098.stdout:5/362: chown d1/da/d44/d45/d4b 10187 1 2023-01-04T18:16:29.986 INFO:tasks.workunit.client.1.smithi098.stdout:3/448: dwrite d6/d56/f83 [0,4194304] 0 2023-01-04T18:16:29.986 INFO:tasks.workunit.client.1.smithi098.stdout:7/352: dwrite d1/f49 [0,4194304] 0 2023-01-04T18:16:29.987 INFO:tasks.workunit.client.1.smithi098.stdout:8/346: dwrite d6/f9 [0,4194304] 0 2023-01-04T18:16:29.988 INFO:tasks.workunit.client.1.smithi098.stdout:2/434: dread d6/dc/d2b/d42/d47/f41 [0,4194304] 0 2023-01-04T18:16:29.988 INFO:tasks.workunit.client.1.smithi098.stdout:5/363: truncate d1/d2f/f5f 213519 0 2023-01-04T18:16:29.988 INFO:tasks.workunit.client.1.smithi098.stdout:6/360: dwrite d9/dd/d4e/f58 [0,4194304] 0 2023-01-04T18:16:29.988 INFO:tasks.workunit.client.1.smithi098.stdout:5/364: chown d1/d2/c7 3 1 2023-01-04T18:16:29.989 INFO:tasks.workunit.client.1.smithi098.stdout:6/361: chown d9/dd/de/d44 6 1 2023-01-04T18:16:29.992 INFO:tasks.workunit.client.1.smithi098.stdout:7/353: rmdir d1/d23/d21 39 2023-01-04T18:16:29.998 INFO:tasks.workunit.client.1.smithi098.stdout:5/365: truncate d1/d2/d14/d19/f22 4266324 0 2023-01-04T18:16:29.999 INFO:tasks.workunit.client.1.smithi098.stdout:6/362: mknod d9/dd/de/d44/c66 0 2023-01-04T18:16:29.999 INFO:tasks.workunit.client.1.smithi098.stdout:7/354: mknod d1/d4/c7c 0 2023-01-04T18:16:30.001 INFO:tasks.workunit.client.1.smithi098.stdout:2/435: mkdir d6/dc/d2b/d42/d47/d31/d90 0 2023-01-04T18:16:30.002 INFO:tasks.workunit.client.1.smithi098.stdout:5/366: creat d1/f6b x:0 0 0 2023-01-04T18:16:30.006 INFO:tasks.workunit.client.1.smithi098.stdout:3/449: dwrite d6/d56/f8f [0,4194304] 0 2023-01-04T18:16:30.006 INFO:tasks.workunit.client.1.smithi098.stdout:6/363: mkdir d9/dd/d4e/d67 0 2023-01-04T18:16:30.006 INFO:tasks.workunit.client.1.smithi098.stdout:6/364: fsync d9/dd/d24/f30 0 2023-01-04T18:16:30.007 INFO:tasks.workunit.client.1.smithi098.stdout:8/347: dwrite d6/d11/d15/f43 [0,4194304] 0 2023-01-04T18:16:30.007 INFO:tasks.workunit.client.1.smithi098.stdout:7/355: rename d1/l55 to d1/d51/d26/d28/l7d 0 2023-01-04T18:16:30.010 INFO:tasks.workunit.client.1.smithi098.stdout:2/436: creat d6/dc/d2b/d42/d47/d1f/f91 x:0 0 0 2023-01-04T18:16:30.012 INFO:tasks.workunit.client.1.smithi098.stdout:8/348: dread d6/dc/d12/d1e/d44/f53 [0,4194304] 0 2023-01-04T18:16:30.012 INFO:tasks.workunit.client.1.smithi098.stdout:5/367: mknod d1/c6c 0 2023-01-04T18:16:30.015 INFO:tasks.workunit.client.1.smithi098.stdout:6/365: creat d9/dd/d4e/d67/f68 x:0 0 0 2023-01-04T18:16:30.019 INFO:tasks.workunit.client.1.smithi098.stdout:7/356: rmdir d1/d23 39 2023-01-04T18:16:30.022 INFO:tasks.workunit.client.1.smithi098.stdout:8/349: mkdir d6/dc/d12/d1e/d37/d4b/d67 0 2023-01-04T18:16:30.023 INFO:tasks.workunit.client.1.smithi098.stdout:2/437: symlink d6/dc/d4b/l92 0 2023-01-04T18:16:30.023 INFO:tasks.workunit.client.1.smithi098.stdout:6/366: dread d9/dd/f42 [0,4194304] 0 2023-01-04T18:16:30.023 INFO:tasks.workunit.client.1.smithi098.stdout:4/347: sync 2023-01-04T18:16:30.023 INFO:tasks.workunit.client.1.smithi098.stdout:1/304: sync 2023-01-04T18:16:30.023 INFO:tasks.workunit.client.1.smithi098.stdout:0/430: sync 2023-01-04T18:16:30.024 INFO:tasks.workunit.client.1.smithi098.stdout:1/305: write d1/d8/f28 [15662,66326] 0 2023-01-04T18:16:30.024 INFO:tasks.workunit.client.1.smithi098.stdout:1/306: chown d1/d8/da/f24 1777675 1 2023-01-04T18:16:30.024 INFO:tasks.workunit.client.1.smithi098.stdout:1/307: write d1/d25/d36/f40 [260700,8059] 0 2023-01-04T18:16:30.026 INFO:tasks.workunit.client.1.smithi098.stdout:3/450: dread d6/d10/d29/f34 [0,4194304] 0 2023-01-04T18:16:30.026 INFO:tasks.workunit.client.1.smithi098.stdout:3/451: fsync d6/d56/f83 0 2023-01-04T18:16:30.028 INFO:tasks.workunit.client.1.smithi098.stdout:5/368: link d1/fc d1/d46/d6a/f6d 0 2023-01-04T18:16:30.028 INFO:tasks.workunit.client.1.smithi098.stdout:2/438: unlink d6/dc/d2b/d42/d47/d1f/f22 0 2023-01-04T18:16:30.028 INFO:tasks.workunit.client.1.smithi098.stdout:8/350: symlink d6/d11/d15/d1b/d2a/d3b/d4c/l68 0 2023-01-04T18:16:30.028 INFO:tasks.workunit.client.1.smithi098.stdout:6/367: link d9/dd/de/c13 d9/c69 0 2023-01-04T18:16:30.028 INFO:tasks.workunit.client.1.smithi098.stdout:0/431: mkdir df/d17/d9b/da1 0 2023-01-04T18:16:30.028 INFO:tasks.workunit.client.1.smithi098.stdout:0/432: write df/d17/d1c/d2c/d41/d4a/f65 [329630,13945] 0 2023-01-04T18:16:30.029 INFO:tasks.workunit.client.1.smithi098.stdout:6/368: read d9/dd/d24/d56/f59 [10203,116492] 0 2023-01-04T18:16:30.029 INFO:tasks.workunit.client.1.smithi098.stdout:0/433: creat df/d17/d1c/fa2 x:0 0 0 2023-01-04T18:16:30.029 INFO:tasks.workunit.client.1.smithi098.stdout:0/434: chown df/d17/d1c 87329 1 2023-01-04T18:16:30.030 INFO:tasks.workunit.client.1.smithi098.stdout:6/369: readlink d9/dd/d15/l2b 0 2023-01-04T18:16:30.033 INFO:tasks.workunit.client.1.smithi098.stdout:0/435: creat df/d17/d1c/d2c/d41/da0/fa3 x:0 0 0 2023-01-04T18:16:30.034 INFO:tasks.workunit.client.1.smithi098.stdout:6/370: creat d9/dd/d4e/f6a x:0 0 0 2023-01-04T18:16:30.035 INFO:tasks.workunit.client.1.smithi098.stdout:7/357: dwrite d1/d23/d21/f4f [4194304,4194304] 0 2023-01-04T18:16:30.037 INFO:tasks.workunit.client.1.smithi098.stdout:6/371: symlink d9/dd/de/d20/l6b 0 2023-01-04T18:16:30.037 INFO:tasks.workunit.client.1.smithi098.stdout:6/372: truncate d9/dd/de/d20/f5d 394393 0 2023-01-04T18:16:30.037 INFO:tasks.workunit.client.1.smithi098.stdout:6/373: chown d9/dd/de/l63 28551114 1 2023-01-04T18:16:30.037 INFO:tasks.workunit.client.1.smithi098.stdout:6/374: chown d9/dd/d4e/c4d 60709 1 2023-01-04T18:16:30.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:16:28.346041+0000 mgr.smithi098.vhfzum (mgr.24455) 16 : cephadm [INF] Reconfiguring prometheus.smithi050 (dependencies changed)... 2023-01-04T18:16:30.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:16:28.360992+0000 mgr.smithi098.vhfzum (mgr.24455) 17 : cephadm [INF] Reconfiguring daemon prometheus.smithi050 on smithi050 2023-01-04T18:16:30.042 INFO:tasks.workunit.client.1.smithi098.stdout:7/358: symlink d1/d51/d26/d28/d2d/d6b/l7e 0 2023-01-04T18:16:30.042 INFO:tasks.workunit.client.1.smithi098.stdout:7/359: write d1/f7a [561767,126665] 0 2023-01-04T18:16:30.045 INFO:tasks.workunit.client.1.smithi098.stdout:6/375: mknod d9/dd/d1f/c6c 0 2023-01-04T18:16:30.045 INFO:tasks.workunit.client.1.smithi098.stdout:6/376: fdatasync d9/dd/d4e/f6a 0 2023-01-04T18:16:30.046 INFO:tasks.workunit.client.1.smithi098.stdout:7/360: truncate d1/f49 1176969 0 2023-01-04T18:16:30.046 INFO:tasks.workunit.client.1.smithi098.stdout:7/361: dread - d1/d23/d21/f6a zero size 2023-01-04T18:16:30.049 INFO:tasks.workunit.client.1.smithi098.stdout:6/377: creat d9/dd/d24/f6d x:0 0 0 2023-01-04T18:16:30.049 INFO:tasks.workunit.client.1.smithi098.stdout:7/362: mkdir d1/d23/d21/d7f 0 2023-01-04T18:16:30.051 INFO:tasks.workunit.client.1.smithi098.stdout:7/363: unlink d1/d51/d26/d28/d2d/d6b/l7e 0 2023-01-04T18:16:30.054 INFO:tasks.workunit.client.1.smithi098.stdout:6/378: symlink d9/dd/d24/d65/l6e 0 2023-01-04T18:16:30.057 INFO:tasks.workunit.client.1.smithi098.stdout:8/351: dread d6/d11/d15/d1b/d2a/d3b/f35 [0,4194304] 0 2023-01-04T18:16:30.058 INFO:tasks.workunit.client.1.smithi098.stdout:4/348: dwrite d5/de/f29 [0,4194304] 0 2023-01-04T18:16:30.058 INFO:tasks.workunit.client.1.smithi098.stdout:4/349: truncate d5/de/d2c/f53 998053 0 2023-01-04T18:16:30.058 INFO:tasks.workunit.client.1.smithi098.stdout:4/350: write d5/d9/d13/f17 [2767137,5354] 0 2023-01-04T18:16:30.060 INFO:tasks.workunit.client.1.smithi098.stdout:0/436: dwrite f1 [0,4194304] 0 2023-01-04T18:16:30.060 INFO:tasks.workunit.client.1.smithi098.stdout:1/308: dwrite d1/d2e/f4a [0,4194304] 0 2023-01-04T18:16:30.062 INFO:tasks.workunit.client.1.smithi098.stdout:9/429: sync 2023-01-04T18:16:30.063 INFO:tasks.workunit.client.1.smithi098.stdout:6/379: creat d9/dd/d1f/f6f x:0 0 0 2023-01-04T18:16:30.063 INFO:tasks.workunit.client.1.smithi098.stdout:6/380: dread - d9/dd/d4e/d67/f68 zero size 2023-01-04T18:16:30.064 INFO:tasks.workunit.client.1.smithi098.stdout:8/352: chown d6/d11/d15/d1b/l27 3 1 2023-01-04T18:16:30.064 INFO:tasks.workunit.client.1.smithi098.stdout:5/369: dwrite d1/d38/f41 [0,4194304] 0 2023-01-04T18:16:30.064 INFO:tasks.workunit.client.1.smithi098.stdout:5/370: write d1/f2e [911240,15759] 0 2023-01-04T18:16:30.065 INFO:tasks.workunit.client.1.smithi098.stdout:5/371: chown d1/d2/d14/d19/f22 113439120 1 2023-01-04T18:16:30.066 INFO:tasks.workunit.client.1.smithi098.stdout:6/381: write d9/dd/de/d20/f3f [4171965,128434] 0 2023-01-04T18:16:30.067 INFO:tasks.workunit.client.1.smithi098.stdout:4/351: mknod d5/d28/d40/c76 0 2023-01-04T18:16:30.067 INFO:tasks.workunit.client.1.smithi098.stdout:4/352: write d5/f38 [1247107,78173] 0 2023-01-04T18:16:30.067 INFO:tasks.workunit.client.1.smithi098.stdout:4/353: chown d5/de/d2c/f46 2526 1 2023-01-04T18:16:30.068 INFO:tasks.workunit.client.1.smithi098.stdout:2/439: dread d6/dc/d2b/d42/d51/f54 [0,4194304] 0 2023-01-04T18:16:30.071 INFO:tasks.workunit.client.1.smithi098.stdout:0/437: rename df/d17/d1c/d2c/d41/d4a/d6d to df/d17/d9b/da4 0 2023-01-04T18:16:30.071 INFO:tasks.workunit.client.1.smithi098.stdout:0/438: dread - df/d17/d24/f25 zero size 2023-01-04T18:16:30.072 INFO:tasks.workunit.client.1.smithi098.stdout:1/309: mknod d1/d8/da/d64/c65 0 2023-01-04T18:16:30.072 INFO:tasks.workunit.client.1.smithi098.stdout:8/353: mknod d6/d11/c69 0 2023-01-04T18:16:30.073 INFO:tasks.workunit.client.1.smithi098.stdout:6/382: link d9/dd/de/c13 d9/dd/de/d44/c70 0 2023-01-04T18:16:30.074 INFO:tasks.workunit.client.1.smithi098.stdout:6/383: dread - d9/dd/de/d26/f62 zero size 2023-01-04T18:16:30.074 INFO:tasks.workunit.client.1.smithi098.stdout:3/452: dwrite d6/d56/f60 [0,4194304] 0 2023-01-04T18:16:30.074 INFO:tasks.workunit.client.1.smithi098.stdout:3/453: chown d6/d10/d19/d3f/d46/f5a 382756 1 2023-01-04T18:16:30.075 INFO:tasks.workunit.client.1.smithi098.stdout:4/354: creat d5/d28/d44/f77 x:0 0 0 2023-01-04T18:16:30.075 INFO:tasks.workunit.client.1.smithi098.stdout:7/364: dwrite d1/da/f1a [0,4194304] 0 2023-01-04T18:16:30.075 INFO:tasks.workunit.client.1.smithi098.stdout:7/365: fsync d1/d51/d26/d28/d2d/f5f 0 2023-01-04T18:16:30.076 INFO:tasks.workunit.client.1.smithi098.stdout:9/430: rename d2/d5/d18/d4e/d2e/d26/c32 to d2/d5/d18/d1d/d23/c91 0 2023-01-04T18:16:30.077 INFO:tasks.workunit.client.1.smithi098.stdout:0/439: mkdir df/d17/d1c/d3b/d98/da5 0 2023-01-04T18:16:30.078 INFO:tasks.workunit.client.1.smithi098.stdout:1/310: mkdir d1/d8/d66 0 2023-01-04T18:16:30.080 INFO:tasks.workunit.client.1.smithi098.stdout:8/354: rmdir d6/d11/d15/d1b 39 2023-01-04T18:16:30.080 INFO:tasks.workunit.client.1.smithi098.stdout:8/355: chown d6/d11/d15/d1b/d2a/d3b/f35 830055 1 2023-01-04T18:16:30.080 INFO:tasks.workunit.client.1.smithi098.stdout:8/356: readlink d6/d11/d15/d1b/l27 0 2023-01-04T18:16:30.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:16:28.346041+0000 mgr.smithi098.vhfzum (mgr.24455) 16 : cephadm [INF] Reconfiguring prometheus.smithi050 (dependencies changed)... 2023-01-04T18:16:30.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:16:28.360992+0000 mgr.smithi098.vhfzum (mgr.24455) 17 : cephadm [INF] Reconfiguring daemon prometheus.smithi050 on smithi050 2023-01-04T18:16:30.081 INFO:tasks.workunit.client.1.smithi098.stdout:6/384: mkdir d9/dd/de/d26/d71 0 2023-01-04T18:16:30.082 INFO:tasks.workunit.client.1.smithi098.stdout:6/385: write d9/fa [4877102,13847] 0 2023-01-04T18:16:30.083 INFO:tasks.workunit.client.1.smithi098.stdout:3/454: mkdir d6/d6f/d9b 0 2023-01-04T18:16:30.083 INFO:tasks.workunit.client.1.smithi098.stdout:3/455: readlink d6/d10/d19/d3f/d46/l98 0 2023-01-04T18:16:30.084 INFO:tasks.workunit.client.1.smithi098.stdout:7/366: rename d1/da/f1a to d1/f80 0 2023-01-04T18:16:30.085 INFO:tasks.workunit.client.1.smithi098.stdout:0/440: mkdir df/d17/d1c/d2c/da6 0 2023-01-04T18:16:30.090 INFO:tasks.workunit.client.1.smithi098.stdout:2/440: dwrite d6/dc/d4b/f63 [0,4194304] 0 2023-01-04T18:16:30.091 INFO:tasks.workunit.client.1.smithi098.stdout:8/357: truncate d6/f9 473464 0 2023-01-04T18:16:30.093 INFO:tasks.workunit.client.1.smithi098.stdout:3/456: rmdir d6/d10/d19/d3f/d5e/d7d/d90 39 2023-01-04T18:16:30.094 INFO:tasks.workunit.client.1.smithi098.stdout:4/355: dread d5/f42 [0,4194304] 0 2023-01-04T18:16:30.095 INFO:tasks.workunit.client.1.smithi098.stdout:1/311: rename d1/d8/f2f to d1/d2e/f67 0 2023-01-04T18:16:30.097 INFO:tasks.workunit.client.1.smithi098.stdout:6/386: dread d9/dd/d15/f2d [0,4194304] 0 2023-01-04T18:16:30.097 INFO:tasks.workunit.client.1.smithi098.stdout:2/441: creat d6/dc/d2b/d42/d51/d81/f93 x:0 0 0 2023-01-04T18:16:30.097 INFO:tasks.workunit.client.1.smithi098.stdout:8/358: dread d6/dc/d12/d1e/d44/f53 [0,4194304] 0 2023-01-04T18:16:30.097 INFO:tasks.workunit.client.1.smithi098.stdout:4/356: rmdir d5/d28/d40/d5d 39 2023-01-04T18:16:30.099 INFO:tasks.workunit.client.1.smithi098.stdout:7/367: rename d1/f62 to d1/d51/d26/f81 0 2023-01-04T18:16:30.099 INFO:tasks.workunit.client.1.smithi098.stdout:7/368: fdatasync d1/d4/d11/d5d/f69 0 2023-01-04T18:16:30.099 INFO:tasks.workunit.client.1.smithi098.stdout:8/359: dread d6/d11/d15/f1f [0,4194304] 0 2023-01-04T18:16:30.100 INFO:tasks.workunit.client.1.smithi098.stdout:1/312: symlink d1/d25/d36/d4e/l68 0 2023-01-04T18:16:30.101 INFO:tasks.workunit.client.1.smithi098.stdout:6/387: link d9/dd/c4a d9/dd/de/d26/d71/c72 0 2023-01-04T18:16:30.101 INFO:tasks.workunit.client.1.smithi098.stdout:9/431: dwrite d2/d5/d18/d1d/f71 [0,4194304] 0 2023-01-04T18:16:30.102 INFO:tasks.workunit.client.1.smithi098.stdout:4/357: creat d5/d28/d44/f78 x:0 0 0 2023-01-04T18:16:30.102 INFO:tasks.workunit.client.1.smithi098.stdout:1/313: dread d1/f1f [0,4194304] 0 2023-01-04T18:16:30.102 INFO:tasks.workunit.client.1.smithi098.stdout:1/314: chown d1/f30 3686320 1 2023-01-04T18:16:30.105 INFO:tasks.workunit.client.1.smithi098.stdout:0/441: dwrite df/d17/d1c/fa2 [0,4194304] 0 2023-01-04T18:16:30.107 INFO:tasks.workunit.client.1.smithi098.stdout:3/457: dread d6/d10/d19/d3f/f2f [0,4194304] 0 2023-01-04T18:16:30.107 INFO:tasks.workunit.client.1.smithi098.stdout:3/458: dread - d6/d56/f92 zero size 2023-01-04T18:16:30.107 INFO:tasks.workunit.client.1.smithi098.stdout:6/388: dread d9/dd/d15/f41 [0,4194304] 0 2023-01-04T18:16:30.107 INFO:tasks.workunit.client.1.smithi098.stdout:9/432: getdents d2/d5 0 2023-01-04T18:16:30.107 INFO:tasks.workunit.client.1.smithi098.stdout:9/433: stat d2/d5/d18/d4e/d2e/d26/l63 0 2023-01-04T18:16:30.108 INFO:tasks.workunit.client.1.smithi098.stdout:8/360: write d6/d11/d15/d1b/d2a/d3b/f38 [3836013,78400] 0 2023-01-04T18:16:30.108 INFO:tasks.workunit.client.1.smithi098.stdout:8/361: write d6/d11/d15/f1d [153589,129325] 0 2023-01-04T18:16:30.108 INFO:tasks.workunit.client.1.smithi098.stdout:8/362: dread - d6/d11/d15/d1b/d2a/d3b/d4c/d54/f57 zero size 2023-01-04T18:16:30.108 INFO:tasks.workunit.client.1.smithi098.stdout:8/363: write d6/d11/d15/f1f [1007456,25579] 0 2023-01-04T18:16:30.108 INFO:tasks.workunit.client.1.smithi098.stdout:1/315: link d1/d25/f3c d1/d25/d36/f69 0 2023-01-04T18:16:30.109 INFO:tasks.workunit.client.1.smithi098.stdout:7/369: write d1/d23/d21/f4b [3117509,35971] 0 2023-01-04T18:16:30.110 INFO:tasks.workunit.client.1.smithi098.stdout:7/370: fdatasync d1/d4/f29 0 2023-01-04T18:16:30.110 INFO:tasks.workunit.client.1.smithi098.stdout:8/364: write d6/dc/f18 [3418905,64031] 0 2023-01-04T18:16:30.110 INFO:tasks.workunit.client.1.smithi098.stdout:4/358: dread d5/d28/f2b [0,4194304] 0 2023-01-04T18:16:30.113 INFO:tasks.workunit.client.1.smithi098.stdout:7/371: write d1/f45 [3873000,64376] 0 2023-01-04T18:16:30.113 INFO:tasks.workunit.client.1.smithi098.stdout:2/442: dwrite d6/dc/d2b/f40 [0,4194304] 0 2023-01-04T18:16:30.116 INFO:tasks.workunit.client.1.smithi098.stdout:4/359: dread d5/d28/d40/f48 [0,4194304] 0 2023-01-04T18:16:30.116 INFO:tasks.workunit.client.1.smithi098.stdout:4/360: fdatasync d5/d9/f43 0 2023-01-04T18:16:30.116 INFO:tasks.workunit.client.1.smithi098.stdout:4/361: stat d5/de/d2c/l34 0 2023-01-04T18:16:30.117 INFO:tasks.workunit.client.1.smithi098.stdout:0/442: creat df/d17/d9b/d5c/fa7 x:0 0 0 2023-01-04T18:16:30.117 INFO:tasks.workunit.client.1.smithi098.stdout:0/443: truncate df/d17/d9b/d5c/f96 827944 0 2023-01-04T18:16:30.117 INFO:tasks.workunit.client.1.smithi098.stdout:0/444: readlink df/d17/d68/l9d 0 2023-01-04T18:16:30.118 INFO:tasks.workunit.client.1.smithi098.stdout:3/459: unlink d6/d10/d19/c87 0 2023-01-04T18:16:30.121 INFO:tasks.workunit.client.1.smithi098.stdout:9/434: creat d2/d5/d18/d19/f92 x:0 0 0 2023-01-04T18:16:30.121 INFO:tasks.workunit.client.1.smithi098.stdout:9/435: stat d2/d5/d18/d4e/d2e/d26/d41/d57/d72 0 2023-01-04T18:16:30.125 INFO:tasks.workunit.client.1.smithi098.stdout:1/316: mkdir d1/d25/d6a 0 2023-01-04T18:16:30.127 INFO:tasks.workunit.client.1.smithi098.stdout:8/365: mkdir d6/d11/d15/d1b/d2a/d3b/d4c/d54/d6a 0 2023-01-04T18:16:30.128 INFO:tasks.workunit.client.1.smithi098.stdout:7/372: creat d1/da/f82 x:0 0 0 2023-01-04T18:16:30.128 INFO:tasks.workunit.client.1.smithi098.stdout:6/389: dread d9/dd/d15/f36 [0,4194304] 0 2023-01-04T18:16:30.129 INFO:tasks.workunit.client.1.smithi098.stdout:6/390: fsync d9/dd/f11 0 2023-01-04T18:16:30.131 INFO:tasks.workunit.client.1.smithi098.stdout:2/443: getdents d6/dc/d2b/d32 0 2023-01-04T18:16:30.133 INFO:tasks.workunit.client.1.smithi098.stdout:4/362: rename d5/l3c to d5/d9/d13/d65/l79 0 2023-01-04T18:16:30.135 INFO:tasks.workunit.client.1.smithi098.stdout:0/445: mkdir df/d17/d1c/d2c/da8 0 2023-01-04T18:16:30.135 INFO:tasks.workunit.client.1.smithi098.stdout:3/460: creat d6/d10/d19/d3f/f9c x:0 0 0 2023-01-04T18:16:30.137 INFO:tasks.workunit.client.1.smithi098.stdout:9/436: creat d2/d2d/f93 x:0 0 0 2023-01-04T18:16:30.139 INFO:tasks.workunit.client.1.smithi098.stdout:1/317: creat d1/d25/d6a/f6b x:0 0 0 2023-01-04T18:16:30.140 INFO:tasks.workunit.client.1.smithi098.stdout:6/391: mknod d9/dd/d24/d65/c73 0 2023-01-04T18:16:30.140 INFO:tasks.workunit.client.1.smithi098.stdout:6/392: stat d9/c50 0 2023-01-04T18:16:30.143 INFO:tasks.workunit.client.1.smithi098.stdout:9/437: dread d2/d5/d18/d4e/d2e/d26/d41/d57/f59 [0,4194304] 0 2023-01-04T18:16:30.143 INFO:tasks.workunit.client.1.smithi098.stdout:8/366: rename d6/d11/d36 to d6/d11/d15/d1b/d2a/d6b 0 2023-01-04T18:16:30.144 INFO:tasks.workunit.client.1.smithi098.stdout:4/363: mkdir d5/de/d2c/d7a 0 2023-01-04T18:16:30.145 INFO:tasks.workunit.client.1.smithi098.stdout:3/461: creat d6/d10/d19/d3f/d5e/d7d/d90/f9d x:0 0 0 2023-01-04T18:16:30.147 INFO:tasks.workunit.client.1.smithi098.stdout:6/393: creat d9/dd/de/d26/f74 x:0 0 0 2023-01-04T18:16:30.147 INFO:tasks.workunit.client.1.smithi098.stdout:3/462: mkdir d6/d10/d6b/d9e 0 2023-01-04T18:16:30.148 INFO:tasks.workunit.client.1.smithi098.stdout:6/394: read d9/dd/d24/d3e/f46 [39677,100702] 0 2023-01-04T18:16:30.150 INFO:tasks.workunit.client.1.smithi098.stdout:3/463: mkdir d6/d56/d9f 0 2023-01-04T18:16:30.150 INFO:tasks.workunit.client.1.smithi098.stdout:3/464: fdatasync d6/d56/f92 0 2023-01-04T18:16:30.150 INFO:tasks.workunit.client.1.smithi098.stdout:4/364: dread d5/f38 [0,4194304] 0 2023-01-04T18:16:30.151 INFO:tasks.workunit.client.1.smithi098.stdout:1/318: dread d1/d25/f59 [0,4194304] 0 2023-01-04T18:16:30.159 INFO:tasks.workunit.client.1.smithi098.stdout:7/373: dwrite d1/d4/d11/f60 [0,4194304] 0 2023-01-04T18:16:30.161 INFO:tasks.workunit.client.1.smithi098.stdout:6/395: dread d9/dd/de/f1e [0,4194304] 0 2023-01-04T18:16:30.161 INFO:tasks.workunit.client.1.smithi098.stdout:8/367: dread d6/dc/d12/d20/f40 [0,4194304] 0 2023-01-04T18:16:30.163 INFO:tasks.workunit.client.1.smithi098.stdout:8/368: write d6/d11/d15/d1b/d2a/d3b/f3c [1356230,122699] 0 2023-01-04T18:16:30.166 INFO:tasks.workunit.client.1.smithi098.stdout:0/446: dwrite df/d17/d1c/d3b/d98/f69 [0,4194304] 0 2023-01-04T18:16:30.166 INFO:tasks.workunit.client.1.smithi098.stdout:7/374: mknod d1/d51/d26/d28/d2d/c83 0 2023-01-04T18:16:30.166 INFO:tasks.workunit.client.1.smithi098.stdout:6/396: getdents d9/dd/de/d44 0 2023-01-04T18:16:30.168 INFO:tasks.workunit.client.1.smithi098.stdout:8/369: rename d6/l17 to d6/dc/d5a/l6c 0 2023-01-04T18:16:30.168 INFO:tasks.workunit.client.1.smithi098.stdout:8/370: getdents d6/d11/d15/d1b/d2a/d3b/d4c/d54/d6a 0 2023-01-04T18:16:30.169 INFO:tasks.workunit.client.1.smithi098.stdout:0/447: symlink df/d4f/la9 0 2023-01-04T18:16:30.170 INFO:tasks.workunit.client.1.smithi098.stdout:7/375: symlink d1/d23/d37/l84 0 2023-01-04T18:16:30.172 INFO:tasks.workunit.client.1.smithi098.stdout:6/397: unlink d9/dd/d24/f6d 0 2023-01-04T18:16:30.172 INFO:tasks.workunit.client.1.smithi098.stdout:6/398: dread - d9/dd/d4e/f4f zero size 2023-01-04T18:16:30.172 INFO:tasks.workunit.client.1.smithi098.stdout:8/371: symlink d6/d11/d15/d1b/d2a/d6b/l6d 0 2023-01-04T18:16:30.173 INFO:tasks.workunit.client.1.smithi098.stdout:0/448: mknod df/d17/d1c/caa 0 2023-01-04T18:16:30.174 INFO:tasks.workunit.client.1.smithi098.stdout:6/399: link d9/dd/d4e/c54 d9/dd/d24/d64/c75 0 2023-01-04T18:16:30.175 INFO:tasks.workunit.client.1.smithi098.stdout:0/449: creat df/d17/d1c/d3b/d98/da5/fab x:0 0 0 2023-01-04T18:16:30.176 INFO:tasks.workunit.client.1.smithi098.stdout:6/400: mknod d9/dd/de/d20/c76 0 2023-01-04T18:16:30.177 INFO:tasks.workunit.client.1.smithi098.stdout:1/319: dread d1/f22 [0,4194304] 0 2023-01-04T18:16:30.178 INFO:tasks.workunit.client.1.smithi098.stdout:6/401: rename d9/dd/d15/f1a to d9/dd/de/d26/f77 0 2023-01-04T18:16:30.179 INFO:tasks.workunit.client.1.smithi098.stdout:6/402: write d9/dd/de/d20/f5d [33479,65863] 0 2023-01-04T18:16:30.179 INFO:tasks.workunit.client.1.smithi098.stdout:0/450: dread df/d17/d1c/d2c/d41/d4a/d4c/d5f/f63 [0,4194304] 0 2023-01-04T18:16:30.179 INFO:tasks.workunit.client.1.smithi098.stdout:8/372: dread d6/d11/d15/d1b/d2a/d3b/f35 [0,4194304] 0 2023-01-04T18:16:30.179 INFO:tasks.workunit.client.1.smithi098.stdout:8/373: stat d6/dc/d12/d20/f40 0 2023-01-04T18:16:30.181 INFO:tasks.workunit.client.1.smithi098.stdout:8/374: mkdir d6/d11/d15/d1b/d2a/d3b/d59/d6e 0 2023-01-04T18:16:30.181 INFO:tasks.workunit.client.1.smithi098.stdout:8/375: fdatasync d6/dc/d12/d1e/d44/f53 0 2023-01-04T18:16:30.183 INFO:tasks.workunit.client.1.smithi098.stdout:9/438: dwrite d2/d2d/f93 [0,4194304] 0 2023-01-04T18:16:30.185 INFO:tasks.workunit.client.1.smithi098.stdout:3/465: dwrite d6/d10/d19/d3f/d5e/d74/f7b [0,4194304] 0 2023-01-04T18:16:30.187 INFO:tasks.workunit.client.1.smithi098.stdout:9/439: creat d2/d53/f94 x:0 0 0 2023-01-04T18:16:30.187 INFO:tasks.workunit.client.1.smithi098.stdout:2/444: dwrite d6/dc/d2b/d42/d47/d1f/f3a [0,4194304] 0 2023-01-04T18:16:30.192 INFO:tasks.workunit.client.1.smithi098.stdout:7/376: dread d1/da/f1b [0,4194304] 0 2023-01-04T18:16:30.195 INFO:tasks.workunit.client.1.smithi098.stdout:4/365: dwrite d5/f1b [0,4194304] 0 2023-01-04T18:16:30.195 INFO:tasks.workunit.client.1.smithi098.stdout:7/377: write d1/d51/f19 [885366,66988] 0 2023-01-04T18:16:30.201 INFO:tasks.workunit.client.1.smithi098.stdout:5/372: sync 2023-01-04T18:16:30.202 INFO:tasks.workunit.client.1.smithi098.stdout:8/376: dread d6/dc/d12/d1e/d44/f53 [0,4194304] 0 2023-01-04T18:16:30.202 INFO:tasks.workunit.client.1.smithi098.stdout:8/377: readlink d6/dc/d12/d1e/d37/l49 0 2023-01-04T18:16:30.202 INFO:tasks.workunit.client.1.smithi098.stdout:8/378: fsync d6/fe 0 2023-01-04T18:16:30.202 INFO:tasks.workunit.client.1.smithi098.stdout:8/379: stat d6/d11/d15/d1b/d2a/d3b/f3c 0 2023-01-04T18:16:30.202 INFO:tasks.workunit.client.1.smithi098.stdout:2/445: unlink d6/dc/d2b/f40 0 2023-01-04T18:16:30.202 INFO:tasks.workunit.client.1.smithi098.stdout:2/446: readlink d6/dc/l21 0 2023-01-04T18:16:30.203 INFO:tasks.workunit.client.1.smithi098.stdout:2/447: dread d6/f15 [0,4194304] 0 2023-01-04T18:16:30.204 INFO:tasks.workunit.client.1.smithi098.stdout:4/366: creat d5/de/d30/d4f/f7b x:0 0 0 2023-01-04T18:16:30.206 INFO:tasks.workunit.client.1.smithi098.stdout:5/373: creat d1/d46/f6e x:0 0 0 2023-01-04T18:16:30.207 INFO:tasks.workunit.client.1.smithi098.stdout:2/448: creat d6/f94 x:0 0 0 2023-01-04T18:16:30.210 INFO:tasks.workunit.client.1.smithi098.stdout:0/451: dwrite df/d17/f4b [0,4194304] 0 2023-01-04T18:16:30.212 INFO:tasks.workunit.client.1.smithi098.stdout:1/320: dwrite d1/d25/d36/f40 [0,4194304] 0 2023-01-04T18:16:30.213 INFO:tasks.workunit.client.1.smithi098.stdout:3/466: dwrite d6/f15 [4194304,4194304] 0 2023-01-04T18:16:30.215 INFO:tasks.workunit.client.1.smithi098.stdout:6/403: dwrite d9/dd/d15/f5f [0,4194304] 0 2023-01-04T18:16:30.217 INFO:tasks.workunit.client.1.smithi098.stdout:9/440: getdents d2/d53 0 2023-01-04T18:16:30.218 INFO:tasks.workunit.client.1.smithi098.stdout:4/367: creat d5/d9/f7c x:0 0 0 2023-01-04T18:16:30.219 INFO:tasks.workunit.client.1.smithi098.stdout:5/374: creat d1/f6f x:0 0 0 2023-01-04T18:16:30.220 INFO:tasks.workunit.client.1.smithi098.stdout:5/375: dread d1/d2f/f5f [0,4194304] 0 2023-01-04T18:16:30.220 INFO:tasks.workunit.client.1.smithi098.stdout:5/376: fdatasync d1/d1e/f3e 0 2023-01-04T18:16:30.223 INFO:tasks.workunit.client.1.smithi098.stdout:1/321: creat d1/d2e/f6c x:0 0 0 2023-01-04T18:16:30.224 INFO:tasks.workunit.client.1.smithi098.stdout:8/380: dwrite d6/d11/d15/f43 [0,4194304] 0 2023-01-04T18:16:30.224 INFO:tasks.workunit.client.1.smithi098.stdout:8/381: chown d6/dc/d12/f48 232729 1 2023-01-04T18:16:30.225 INFO:tasks.workunit.client.1.smithi098.stdout:8/382: stat d6/dc/d12 0 2023-01-04T18:16:30.225 INFO:tasks.workunit.client.1.smithi098.stdout:8/383: fsync d6/d11/d15/d1b/d2a/d3b/f38 0 2023-01-04T18:16:30.225 INFO:tasks.workunit.client.1.smithi098.stdout:3/467: symlink d6/d10/d19/d3f/d5e/d74/la0 0 2023-01-04T18:16:30.228 INFO:tasks.workunit.client.1.smithi098.stdout:6/404: mknod d9/dd/de/d26/d71/c78 0 2023-01-04T18:16:30.231 INFO:tasks.workunit.client.1.smithi098.stdout:9/441: creat d2/d5/d18/d1d/d23/d5c/f95 x:0 0 0 2023-01-04T18:16:30.232 INFO:tasks.workunit.client.1.smithi098.stdout:4/368: mkdir d5/d28/d7d 0 2023-01-04T18:16:30.236 INFO:tasks.workunit.client.1.smithi098.stdout:5/377: creat d1/da/d44/f70 x:0 0 0 2023-01-04T18:16:30.236 INFO:tasks.workunit.client.1.smithi098.stdout:5/378: write d1/f5a [1035680,99881] 0 2023-01-04T18:16:30.237 INFO:tasks.workunit.client.1.smithi098.stdout:1/322: symlink d1/d8/da/d64/l6d 0 2023-01-04T18:16:30.238 INFO:tasks.workunit.client.1.smithi098.stdout:7/378: dwrite d1/f45 [4194304,4194304] 0 2023-01-04T18:16:30.238 INFO:tasks.workunit.client.1.smithi098.stdout:7/379: stat d1/d51/f19 0 2023-01-04T18:16:30.238 INFO:tasks.workunit.client.1.smithi098.stdout:7/380: write d1/d51/d26/d28/f6e [950958,127934] 0 2023-01-04T18:16:30.238 INFO:tasks.workunit.client.1.smithi098.stdout:7/381: stat d1/d23/f2c 0 2023-01-04T18:16:30.238 INFO:tasks.workunit.client.1.smithi098.stdout:8/384: unlink d6/dc/d5a/l6c 0 2023-01-04T18:16:30.238 INFO:tasks.workunit.client.1.smithi098.stdout:8/385: write d6/dc/d12/d1e/d37/f3a [1426012,39629] 0 2023-01-04T18:16:30.238 INFO:tasks.workunit.client.1.smithi098.stdout:5/379: dread d1/da/d44/d45/f55 [0,4194304] 0 2023-01-04T18:16:30.239 INFO:tasks.workunit.client.1.smithi098.stdout:3/468: rmdir d6/d10/d29 39 2023-01-04T18:16:30.241 INFO:tasks.workunit.client.1.smithi098.stdout:6/405: mkdir d9/dd/de/d44/d79 0 2023-01-04T18:16:30.241 INFO:tasks.workunit.client.1.smithi098.stdout:6/406: stat d9/dd/d24/f30 0 2023-01-04T18:16:30.242 INFO:tasks.workunit.client.1.smithi098.stdout:9/442: unlink d2/d5/d18/d4e/d42/l6d 0 2023-01-04T18:16:30.243 INFO:tasks.workunit.client.1.smithi098.stdout:4/369: creat d5/d9/f7e x:0 0 0 2023-01-04T18:16:30.243 INFO:tasks.workunit.client.1.smithi098.stdout:1/323: mkdir d1/d25/d36/d4e/d6e 0 2023-01-04T18:16:30.253 INFO:tasks.workunit.client.1.smithi098.stdout:7/382: rmdir d1/d23/d21/d43 39 2023-01-04T18:16:30.253 INFO:tasks.workunit.client.1.smithi098.stdout:5/380: creat d1/d2/d14/d59/f71 x:0 0 0 2023-01-04T18:16:30.253 INFO:tasks.workunit.client.1.smithi098.stdout:3/469: rename d6/d10/c33 to d6/d10/d19/d3f/d5e/d7d/d90/ca1 0 2023-01-04T18:16:30.253 INFO:tasks.workunit.client.1.smithi098.stdout:4/370: link d5/f38 d5/de/d2c/f7f 0 2023-01-04T18:16:30.253 INFO:tasks.workunit.client.1.smithi098.stdout:6/407: mkdir d9/dd/de/d44/d7a 0 2023-01-04T18:16:30.254 INFO:tasks.workunit.client.1.smithi098.stdout:4/371: stat d5/de/d2c/l5b 0 2023-01-04T18:16:30.254 INFO:tasks.workunit.client.1.smithi098.stdout:4/372: write d5/d28/d40/f48 [2031732,30179] 0 2023-01-04T18:16:30.254 INFO:tasks.workunit.client.1.smithi098.stdout:4/373: stat d5/de/d2c/l5b 0 2023-01-04T18:16:30.254 INFO:tasks.workunit.client.1.smithi098.stdout:6/408: write d9/dd/de/d20/f5d [1226165,97853] 0 2023-01-04T18:16:30.254 INFO:tasks.workunit.client.1.smithi098.stdout:1/324: creat d1/d25/d27/f6f x:0 0 0 2023-01-04T18:16:30.254 INFO:tasks.workunit.client.1.smithi098.stdout:4/374: read d5/de/d2c/f7f [1178252,121482] 0 2023-01-04T18:16:30.254 INFO:tasks.workunit.client.1.smithi098.stdout:4/375: dread - d5/d9/f7e zero size 2023-01-04T18:16:30.255 INFO:tasks.workunit.client.1.smithi098.stdout:8/386: dwrite d6/dc/d12/f4f [0,4194304] 0 2023-01-04T18:16:30.255 INFO:tasks.workunit.client.1.smithi098.stdout:8/387: stat d6/dc/d12/d1e/d44 0 2023-01-04T18:16:30.255 INFO:tasks.workunit.client.1.smithi098.stdout:5/381: symlink d1/l72 0 2023-01-04T18:16:30.255 INFO:tasks.workunit.client.1.smithi098.stdout:7/383: mkdir d1/d23/d73/d85 0 2023-01-04T18:16:30.255 INFO:tasks.workunit.client.1.smithi098.stdout:7/384: dread - d1/d23/d37/d40/f5c zero size 2023-01-04T18:16:30.256 INFO:tasks.workunit.client.1.smithi098.stdout:6/409: rmdir d9/dd/d1f 39 2023-01-04T18:16:30.257 INFO:tasks.workunit.client.1.smithi098.stdout:9/443: dwrite d2/d5/d18/d19/f58 [0,4194304] 0 2023-01-04T18:16:30.259 INFO:tasks.workunit.client.1.smithi098.stdout:1/325: mknod d1/d8/c70 0 2023-01-04T18:16:30.259 INFO:tasks.workunit.client.1.smithi098.stdout:4/376: rename d5/d9/d13/f33 to d5/de/d21/f80 0 2023-01-04T18:16:30.260 INFO:tasks.workunit.client.1.smithi098.stdout:4/377: readlink d5/de/d2c/l5b 0 2023-01-04T18:16:30.260 INFO:tasks.workunit.client.1.smithi098.stdout:9/444: read d2/d5/d18/d4e/d2e/d26/f4a [228964,18161] 0 2023-01-04T18:16:30.261 INFO:tasks.workunit.client.1.smithi098.stdout:5/382: unlink d1/d46/l4c 0 2023-01-04T18:16:30.265 INFO:tasks.workunit.client.1.smithi098.stdout:3/470: dread d6/f54 [0,4194304] 0 2023-01-04T18:16:30.265 INFO:tasks.workunit.client.1.smithi098.stdout:3/471: dread - d6/d10/d19/d3f/f9c zero size 2023-01-04T18:16:30.265 INFO:tasks.workunit.client.1.smithi098.stdout:3/472: fdatasync d6/d10/d19/d3f/d5e/d7d/f5c 0 2023-01-04T18:16:30.267 INFO:tasks.workunit.client.1.smithi098.stdout:8/388: dwrite d6/dc/d12/d39/f47 [0,4194304] 0 2023-01-04T18:16:30.268 INFO:tasks.workunit.client.1.smithi098.stdout:7/385: unlink d1/d4/d11/d5d/f69 0 2023-01-04T18:16:30.269 INFO:tasks.workunit.client.1.smithi098.stdout:4/378: dread d5/de/d2c/f3a [0,4194304] 0 2023-01-04T18:16:30.269 INFO:tasks.workunit.client.1.smithi098.stdout:7/386: write d1/d51/d26/d28/d2d/f32 [3483082,40238] 0 2023-01-04T18:16:30.269 INFO:tasks.workunit.client.1.smithi098.stdout:6/410: link d9/dd/de/l47 d9/dd/de/d20/l7b 0 2023-01-04T18:16:30.270 INFO:tasks.workunit.client.1.smithi098.stdout:6/411: truncate d9/dd/f29 5171157 0 2023-01-04T18:16:30.271 INFO:tasks.workunit.client.1.smithi098.stdout:1/326: symlink d1/d8/l71 0 2023-01-04T18:16:30.272 INFO:tasks.workunit.client.1.smithi098.stdout:9/445: mknod d2/d5/d18/d4e/d2e/d78/c96 0 2023-01-04T18:16:30.274 INFO:tasks.workunit.client.1.smithi098.stdout:5/383: mkdir d1/d2f/d73 0 2023-01-04T18:16:30.274 INFO:tasks.workunit.client.1.smithi098.stdout:5/384: write d1/da/d44/d45/f5b [335588,24432] 0 2023-01-04T18:16:30.277 INFO:tasks.workunit.client.1.smithi098.stdout:3/473: link d6/d10/d19/d3f/f9c d6/d10/d19/d3f/d46/d8a/fa2 0 2023-01-04T18:16:30.280 INFO:tasks.workunit.client.1.smithi098.stdout:8/389: creat d6/dc/d12/d1e/d37/f6f x:0 0 0 2023-01-04T18:16:30.281 INFO:tasks.workunit.client.1.smithi098.stdout:4/379: mknod d5/d28/d40/d5d/c81 0 2023-01-04T18:16:30.283 INFO:tasks.workunit.client.1.smithi098.stdout:7/387: getdents d1/da 0 2023-01-04T18:16:30.286 INFO:tasks.workunit.client.1.smithi098.stdout:6/412: unlink d9/dd/d24/c51 0 2023-01-04T18:16:30.286 INFO:tasks.workunit.client.1.smithi098.stdout:1/327: readlink d1/d8/da/d12/l55 0 2023-01-04T18:16:30.286 INFO:tasks.workunit.client.1.smithi098.stdout:6/413: truncate d9/dd/d1f/f27 3537974 0 2023-01-04T18:16:30.289 INFO:tasks.workunit.client.1.smithi098.stdout:8/390: mkdir d6/d11/d15/d70 0 2023-01-04T18:16:30.289 INFO:tasks.workunit.client.1.smithi098.stdout:3/474: rename d6/d10/d19/d3f/d5e/d74/l79 to d6/d10/d19/la3 0 2023-01-04T18:16:30.290 INFO:tasks.workunit.client.1.smithi098.stdout:8/391: creat d6/dc/f71 x:0 0 0 2023-01-04T18:16:30.291 INFO:tasks.workunit.client.1.smithi098.stdout:3/475: creat d6/d10/d6b/fa4 x:0 0 0 2023-01-04T18:16:30.291 INFO:tasks.workunit.client.1.smithi098.stdout:3/476: fdatasync d6/d10/d19/d3f/d5e/d74/f7b 0 2023-01-04T18:16:30.291 INFO:tasks.workunit.client.1.smithi098.stdout:3/477: truncate d6/d10/d19/d3f/d5e/d74/f89 553246 0 2023-01-04T18:16:30.305 INFO:tasks.workunit.client.1.smithi098.stdout:6/414: dwrite d9/dd/d4e/f4f [0,4194304] 0 2023-01-04T18:16:30.325 INFO:tasks.workunit.client.1.smithi098.stdout:1/328: dread d1/d8/da/d12/f2b [0,4194304] 0 2023-01-04T18:16:30.326 INFO:tasks.workunit.client.1.smithi098.stdout:6/415: dread d9/dd/d15/f41 [0,4194304] 0 2023-01-04T18:16:30.326 INFO:tasks.workunit.client.1.smithi098.stdout:1/329: write d1/d2e/f37 [4180866,94956] 0 2023-01-04T18:16:30.327 INFO:tasks.workunit.client.1.smithi098.stdout:4/380: dread d5/de/d21/f22 [0,4194304] 0 2023-01-04T18:16:30.327 INFO:tasks.workunit.client.1.smithi098.stdout:4/381: fdatasync d5/de/d21/f22 0 2023-01-04T18:16:30.327 INFO:tasks.workunit.client.1.smithi098.stdout:4/382: truncate d5/d28/d44/f77 847133 0 2023-01-04T18:16:30.327 INFO:tasks.workunit.client.1.smithi098.stdout:5/385: dwrite d1/da/d44/d45/f55 [0,4194304] 0 2023-01-04T18:16:30.328 INFO:tasks.workunit.client.1.smithi098.stdout:5/386: fsync d1/d2/d14/d59/f71 0 2023-01-04T18:16:30.328 INFO:tasks.workunit.client.1.smithi098.stdout:6/416: symlink d9/dd/d4e/d67/l7c 0 2023-01-04T18:16:30.328 INFO:tasks.workunit.client.1.smithi098.stdout:9/446: dwrite d2/d5/d18/d19/f4b [0,4194304] 0 2023-01-04T18:16:30.328 INFO:tasks.workunit.client.1.smithi098.stdout:3/478: write d6/d56/f83 [1743634,95042] 0 2023-01-04T18:16:30.328 INFO:tasks.workunit.client.1.smithi098.stdout:1/330: write d1/d25/d36/f40 [879865,124340] 0 2023-01-04T18:16:30.329 INFO:tasks.workunit.client.1.smithi098.stdout:3/479: read d6/d10/d19/f8c [3766331,69755] 0 2023-01-04T18:16:30.329 INFO:tasks.workunit.client.1.smithi098.stdout:3/480: fsync d6/d10/d29/f34 0 2023-01-04T18:16:30.340 INFO:tasks.workunit.client.1.smithi098.stdout:4/383: symlink d5/d28/d7d/l82 0 2023-01-04T18:16:30.344 INFO:tasks.workunit.client.1.smithi098.stdout:6/417: symlink d9/dd/d24/l7d 0 2023-01-04T18:16:30.346 INFO:tasks.workunit.client.1.smithi098.stdout:9/447: symlink d2/d5/l97 0 2023-01-04T18:16:30.351 INFO:tasks.workunit.client.1.smithi098.stdout:1/331: fdatasync d1/d8/da/d12/f3b 0 2023-01-04T18:16:30.352 INFO:tasks.workunit.client.1.smithi098.stdout:3/481: symlink d6/d56/d9f/la5 0 2023-01-04T18:16:30.354 INFO:tasks.workunit.client.1.smithi098.stdout:4/384: rmdir d5/de 39 2023-01-04T18:16:30.354 INFO:tasks.workunit.client.1.smithi098.stdout:4/385: fdatasync f4 0 2023-01-04T18:16:30.355 INFO:tasks.workunit.client.1.smithi098.stdout:6/418: getdents d9/dd/d24/d3e 0 2023-01-04T18:16:30.356 INFO:tasks.workunit.client.1.smithi098.stdout:9/448: symlink d2/d5/d18/d1d/d23/l98 0 2023-01-04T18:16:30.356 INFO:tasks.workunit.client.1.smithi098.stdout:6/419: write d9/dd/de/d26/f77 [278933,62089] 0 2023-01-04T18:16:30.356 INFO:tasks.workunit.client.1.smithi098.stdout:6/420: truncate d9/dd/f29 5615719 0 2023-01-04T18:16:30.357 INFO:tasks.workunit.client.1.smithi098.stdout:1/332: creat d1/d8/da/f72 x:0 0 0 2023-01-04T18:16:30.358 INFO:tasks.workunit.client.1.smithi098.stdout:3/482: creat d6/d10/d19/d3f/d5e/d74/fa6 x:0 0 0 2023-01-04T18:16:30.359 INFO:tasks.workunit.client.1.smithi098.stdout:4/386: rmdir d5/de/d2c/d7a 0 2023-01-04T18:16:30.359 INFO:tasks.workunit.client.1.smithi098.stdout:4/387: write d5/de/d2c/f67 [884913,92739] 0 2023-01-04T18:16:30.360 INFO:tasks.workunit.client.1.smithi098.stdout:4/388: readlink d5/d9/d13/l35 0 2023-01-04T18:16:30.360 INFO:tasks.workunit.client.1.smithi098.stdout:9/449: rename d2/d53/f94 to d2/d5/d18/d4e/d42/f99 0 2023-01-04T18:16:30.363 INFO:tasks.workunit.client.1.smithi098.stdout:6/421: mkdir d9/dd/de/d7e 0 2023-01-04T18:16:30.363 INFO:tasks.workunit.client.1.smithi098.stdout:1/333: creat d1/d8/d53/f73 x:0 0 0 2023-01-04T18:16:30.364 INFO:tasks.workunit.client.1.smithi098.stdout:1/334: fsync d1/d2e/f58 0 2023-01-04T18:16:30.364 INFO:tasks.workunit.client.1.smithi098.stdout:3/483: creat d6/d10/d19/d3f/d5e/d7d/fa7 x:0 0 0 2023-01-04T18:16:30.364 INFO:tasks.workunit.client.1.smithi098.stdout:9/450: dread d2/d5/d18/d4e/d2e/f79 [0,4194304] 0 2023-01-04T18:16:30.365 INFO:tasks.workunit.client.1.smithi098.stdout:4/389: mkdir d5/de/d21/d75/d83 0 2023-01-04T18:16:30.366 INFO:tasks.workunit.client.1.smithi098.stdout:6/422: mknod d9/dd/d4e/c7f 0 2023-01-04T18:16:30.366 INFO:tasks.workunit.client.1.smithi098.stdout:6/423: dread - d9/dd/d24/d3e/f55 zero size 2023-01-04T18:16:30.366 INFO:tasks.workunit.client.1.smithi098.stdout:6/424: chown d9/dd/d24/d64 348944 1 2023-01-04T18:16:30.367 INFO:tasks.workunit.client.1.smithi098.stdout:1/335: creat d1/d8/da/d12/f74 x:0 0 0 2023-01-04T18:16:30.367 INFO:tasks.workunit.client.1.smithi098.stdout:1/336: chown d1/d8/da/f24 7 1 2023-01-04T18:16:30.368 INFO:tasks.workunit.client.1.smithi098.stdout:9/451: creat d2/d5/d18/d4e/d2e/d26/f9a x:0 0 0 2023-01-04T18:16:30.368 INFO:tasks.workunit.client.1.smithi098.stdout:9/452: write d2/d5/d18/d19/f92 [79070,5288] 0 2023-01-04T18:16:30.368 INFO:tasks.workunit.client.1.smithi098.stdout:9/453: write d2/d5/d18/d1d/f2f [4419291,89571] 0 2023-01-04T18:16:30.368 INFO:tasks.workunit.client.1.smithi098.stdout:4/390: rmdir d5/d28/d40/d5d 39 2023-01-04T18:16:30.370 INFO:tasks.workunit.client.1.smithi098.stdout:6/425: creat d9/dd/de/d44/d79/f80 x:0 0 0 2023-01-04T18:16:30.370 INFO:tasks.workunit.client.1.smithi098.stdout:6/426: write d9/dd/de/d20/f5d [2318452,64768] 0 2023-01-04T18:16:30.371 INFO:tasks.workunit.client.1.smithi098.stdout:9/454: mknod d2/c9b 0 2023-01-04T18:16:30.372 INFO:tasks.workunit.client.1.smithi098.stdout:4/391: mknod d5/d9/d13/d65/c84 0 2023-01-04T18:16:30.374 INFO:tasks.workunit.client.1.smithi098.stdout:9/455: creat d2/f9c x:0 0 0 2023-01-04T18:16:30.376 INFO:tasks.workunit.client.1.smithi098.stdout:4/392: mknod d5/d9/d13/c85 0 2023-01-04T18:16:30.380 INFO:tasks.workunit.client.1.smithi098.stdout:9/456: mkdir d2/d5/d18/d4e/d2e/d26/d41/d57/d72/d9d 0 2023-01-04T18:16:30.380 INFO:tasks.workunit.client.1.smithi098.stdout:9/457: write d2/f9c [993170,5224] 0 2023-01-04T18:16:30.380 INFO:tasks.workunit.client.1.smithi098.stdout:9/458: chown d2/d5/d18/d1d/l48 590 1 2023-01-04T18:16:30.382 INFO:tasks.workunit.client.1.smithi098.stdout:9/459: write d2/d5/d18/d1d/d23/f8c [4071718,35010] 0 2023-01-04T18:16:30.386 INFO:tasks.workunit.client.1.smithi098.stdout:4/393: dread d5/d28/d40/f64 [0,4194304] 0 2023-01-04T18:16:30.386 INFO:tasks.workunit.client.1.smithi098.stdout:4/394: write d5/de/d21/f2d [842280,118605] 0 2023-01-04T18:16:30.390 INFO:tasks.workunit.client.1.smithi098.stdout:3/484: dread d6/f21 [0,4194304] 0 2023-01-04T18:16:30.396 INFO:tasks.workunit.client.1.smithi098.stdout:6/427: dwrite d9/fa [0,4194304] 0 2023-01-04T18:16:30.397 INFO:tasks.workunit.client.1.smithi098.stdout:1/337: dwrite d1/d8/da/f48 [0,4194304] 0 2023-01-04T18:16:30.407 INFO:tasks.workunit.client.1.smithi098.stdout:9/460: dwrite d2/d5/d18/d1d/d23/d66/f67 [0,4194304] 0 2023-01-04T18:16:30.410 INFO:tasks.workunit.client.1.smithi098.stdout:4/395: dwrite d5/de/d2c/f46 [0,4194304] 0 2023-01-04T18:16:30.411 INFO:tasks.workunit.client.1.smithi098.stdout:4/396: fsync d5/de/d2c/f3a 0 2023-01-04T18:16:30.411 INFO:tasks.workunit.client.1.smithi098.stdout:4/397: chown d5/f47 35655534 1 2023-01-04T18:16:30.411 INFO:tasks.workunit.client.1.smithi098.stdout:1/338: mknod d1/d25/d27/c75 0 2023-01-04T18:16:30.411 INFO:tasks.workunit.client.1.smithi098.stdout:1/339: stat d1/f1b 0 2023-01-04T18:16:30.415 INFO:tasks.workunit.client.1.smithi098.stdout:3/485: dwrite d6/d10/f50 [0,4194304] 0 2023-01-04T18:16:30.416 INFO:tasks.workunit.client.1.smithi098.stdout:4/398: unlink d5/de/d2c/f57 0 2023-01-04T18:16:30.416 INFO:tasks.workunit.client.1.smithi098.stdout:4/399: write d5/d9/d13/f2a [791166,88607] 0 2023-01-04T18:16:30.416 INFO:tasks.workunit.client.1.smithi098.stdout:4/400: write d5/d9/f43 [553896,17386] 0 2023-01-04T18:16:30.417 INFO:tasks.workunit.client.1.smithi098.stdout:4/401: chown d5/d9/l66 108414 1 2023-01-04T18:16:30.417 INFO:tasks.workunit.client.1.smithi098.stdout:1/340: getdents d1/d25/d6a 0 2023-01-04T18:16:30.419 INFO:tasks.workunit.client.1.smithi098.stdout:3/486: mkdir d6/d56/d9f/da8 0 2023-01-04T18:16:30.419 INFO:tasks.workunit.client.1.smithi098.stdout:3/487: fsync d6/d10/d19/d3f/f47 0 2023-01-04T18:16:30.421 INFO:tasks.workunit.client.1.smithi098.stdout:4/402: creat d5/de/d30/d4f/f86 x:0 0 0 2023-01-04T18:16:30.421 INFO:tasks.workunit.client.1.smithi098.stdout:1/341: write d1/d8/da/f48 [3662635,76729] 0 2023-01-04T18:16:30.426 INFO:tasks.workunit.client.1.smithi098.stdout:1/342: creat d1/d8/da/d12/d54/f76 x:0 0 0 2023-01-04T18:16:30.433 INFO:tasks.workunit.client.1.smithi098.stdout:4/403: dread d5/de/d2c/f46 [0,4194304] 0 2023-01-04T18:16:30.434 INFO:tasks.workunit.client.1.smithi098.stdout:4/404: creat d5/de/d21/d5e/f87 x:0 0 0 2023-01-04T18:16:30.435 INFO:tasks.workunit.client.1.smithi098.stdout:9/461: dwrite d2/d5/f24 [0,4194304] 0 2023-01-04T18:16:30.439 INFO:tasks.workunit.client.1.smithi098.stdout:6/428: dwrite d9/dd/d24/d3e/f46 [0,4194304] 0 2023-01-04T18:16:30.439 INFO:tasks.workunit.client.1.smithi098.stdout:3/488: dwrite d6/d10/d6b/f7c [0,4194304] 0 2023-01-04T18:16:30.443 INFO:tasks.workunit.client.1.smithi098.stdout:9/462: dread d2/d5/f6 [4194304,4194304] 0 2023-01-04T18:16:30.446 INFO:tasks.workunit.client.1.smithi098.stdout:6/429: mkdir d9/dd/d1f/d81 0 2023-01-04T18:16:30.452 INFO:tasks.workunit.client.1.smithi098.stdout:6/430: dread d9/dd/de/d26/f77 [4194304,4194304] 0 2023-01-04T18:16:30.452 INFO:tasks.workunit.client.1.smithi098.stdout:6/431: chown d9/dd/l22 114607 1 2023-01-04T18:16:30.454 INFO:tasks.workunit.client.1.smithi098.stdout:3/489: creat d6/d10/d19/d3f/d5e/fa9 x:0 0 0 2023-01-04T18:16:30.454 INFO:tasks.workunit.client.1.smithi098.stdout:3/490: fdatasync d6/d10/d19/d3f/d5e/d7d/f5c 0 2023-01-04T18:16:30.455 INFO:tasks.workunit.client.1.smithi098.stdout:3/491: link d6/d10/f32 d6/d6f/faa 0 2023-01-04T18:16:30.456 INFO:tasks.workunit.client.1.smithi098.stdout:3/492: creat d6/d10/d19/d3f/d46/fab x:0 0 0 2023-01-04T18:16:30.456 INFO:tasks.workunit.client.1.smithi098.stdout:3/493: write d6/f53 [709893,86085] 0 2023-01-04T18:16:30.456 INFO:tasks.workunit.client.1.smithi098.stdout:3/494: dread - d6/d10/d29/f81 zero size 2023-01-04T18:16:30.457 INFO:tasks.workunit.client.1.smithi098.stdout:3/495: dread - d6/d10/d19/d3f/d46/fab zero size 2023-01-04T18:16:30.460 INFO:tasks.workunit.client.1.smithi098.stdout:2/449: sync 2023-01-04T18:16:30.460 INFO:tasks.workunit.client.1.smithi098.stdout:0/452: sync 2023-01-04T18:16:30.460 INFO:tasks.workunit.client.1.smithi098.stdout:2/450: chown d6/f15 101 1 2023-01-04T18:16:30.460 INFO:tasks.workunit.client.1.smithi098.stdout:3/496: symlink d6/d56/d9f/lac 0 2023-01-04T18:16:30.461 INFO:tasks.workunit.client.1.smithi098.stdout:0/453: mknod df/d4f/d6b/cac 0 2023-01-04T18:16:30.462 INFO:tasks.workunit.client.1.smithi098.stdout:9/463: dwrite d2/d2d/f50 [4194304,4194304] 0 2023-01-04T18:16:30.464 INFO:tasks.workunit.client.1.smithi098.stdout:9/464: write d2/d5/d18/d4e/d2e/d26/f37 [3478481,109870] 0 2023-01-04T18:16:30.464 INFO:tasks.workunit.client.1.smithi098.stdout:3/497: mkdir d6/d10/dad 0 2023-01-04T18:16:30.465 INFO:tasks.workunit.client.1.smithi098.stdout:1/343: rename d1/d8/da/d12 to d1/d25/d27/d77 0 2023-01-04T18:16:30.467 INFO:tasks.workunit.client.1.smithi098.stdout:0/454: unlink df/d17/d1c/d2c/d41/d4a/d4c/f6c 0 2023-01-04T18:16:30.472 INFO:tasks.workunit.client.1.smithi098.stdout:9/465: mkdir d2/d5/d18/d4e/d2e/d26/d41/d57/d72/d9e 0 2023-01-04T18:16:30.473 INFO:tasks.workunit.client.1.smithi098.stdout:3/498: dread d6/f6c [0,4194304] 0 2023-01-04T18:16:30.476 INFO:tasks.workunit.client.1.smithi098.stdout:4/405: rename d5/d28/d44/f73 to d5/de/f88 0 2023-01-04T18:16:30.476 INFO:tasks.workunit.client.1.smithi098.stdout:4/406: write d5/de/d2c/f53 [1142797,118801] 0 2023-01-04T18:16:30.476 INFO:tasks.workunit.client.1.smithi098.stdout:3/499: write d6/d56/f8f [3934818,103393] 0 2023-01-04T18:16:30.476 INFO:tasks.workunit.client.1.smithi098.stdout:2/451: dwrite d6/dc/d2b/d42/f57 [0,4194304] 0 2023-01-04T18:16:30.477 INFO:tasks.workunit.client.1.smithi098.stdout:2/452: fsync d6/dc/f1b 0 2023-01-04T18:16:30.477 INFO:tasks.workunit.client.1.smithi098.stdout:1/344: mkdir d1/d25/d78 0 2023-01-04T18:16:30.478 INFO:tasks.workunit.client.1.smithi098.stdout:0/455: symlink df/d4f/d6b/lad 0 2023-01-04T18:16:30.478 INFO:tasks.workunit.client.1.smithi098.stdout:0/456: chown df/d17/d1c/f47 6790 1 2023-01-04T18:16:30.479 INFO:tasks.workunit.client.1.smithi098.stdout:9/466: unlink d2/d5/d18/l1b 0 2023-01-04T18:16:30.480 INFO:tasks.workunit.client.1.smithi098.stdout:9/467: stat d2/d5/d18/d1d/f2f 0 2023-01-04T18:16:30.484 INFO:tasks.workunit.client.1.smithi098.stdout:5/387: sync 2023-01-04T18:16:30.485 INFO:tasks.workunit.client.1.smithi098.stdout:7/388: sync 2023-01-04T18:16:30.485 INFO:tasks.workunit.client.1.smithi098.stdout:8/392: sync 2023-01-04T18:16:30.485 INFO:tasks.workunit.client.1.smithi098.stdout:5/388: read d1/d2/f17 [204880,65808] 0 2023-01-04T18:16:30.490 INFO:tasks.workunit.client.1.smithi098.stdout:2/453: rename d6/dc/d2b/d42/d51/d79/l7d to d6/dc/l95 0 2023-01-04T18:16:30.490 INFO:tasks.workunit.client.1.smithi098.stdout:2/454: stat d6/f15 0 2023-01-04T18:16:30.493 INFO:tasks.workunit.client.1.smithi098.stdout:1/345: stat d1/c14 0 2023-01-04T18:16:30.495 INFO:tasks.workunit.client.1.smithi098.stdout:9/468: mknod d2/d5/d18/d4e/c9f 0 2023-01-04T18:16:30.495 INFO:tasks.workunit.client.1.smithi098.stdout:7/389: symlink d1/d4/l86 0 2023-01-04T18:16:30.496 INFO:tasks.workunit.client.1.smithi098.stdout:8/393: symlink d6/dc/d12/d1e/d37/l72 0 2023-01-04T18:16:30.498 INFO:tasks.workunit.client.1.smithi098.stdout:6/432: rename d9/dd/d24/d56 to d9/dd/de/d20/d82 0 2023-01-04T18:16:30.498 INFO:tasks.workunit.client.1.smithi098.stdout:7/390: dread d1/d23/d21/f77 [0,4194304] 0 2023-01-04T18:16:30.499 INFO:tasks.workunit.client.1.smithi098.stdout:1/346: symlink d1/d2e/l79 0 2023-01-04T18:16:30.500 INFO:tasks.workunit.client.1.smithi098.stdout:1/347: fsync d1/fc 0 2023-01-04T18:16:30.501 INFO:tasks.workunit.client.1.smithi098.stdout:6/433: getdents d9/dd/d1f 0 2023-01-04T18:16:30.502 INFO:tasks.workunit.client.1.smithi098.stdout:7/391: symlink d1/d23/d37/d40/l87 0 2023-01-04T18:16:30.502 INFO:tasks.workunit.client.1.smithi098.stdout:7/392: stat d1/d23/d21/f4f 0 2023-01-04T18:16:30.502 INFO:tasks.workunit.client.1.smithi098.stdout:7/393: write d1/da/f1e [827386,9533] 0 2023-01-04T18:16:30.502 INFO:tasks.workunit.client.1.smithi098.stdout:7/394: fdatasync d1/d23/d21/f4b 0 2023-01-04T18:16:30.502 INFO:tasks.workunit.client.1.smithi098.stdout:7/395: write d1/d4/d11/d5d/f63 [487389,50979] 0 2023-01-04T18:16:30.503 INFO:tasks.workunit.client.1.smithi098.stdout:9/469: write d2/d5/d18/d19/f4b [3149300,58916] 0 2023-01-04T18:16:30.505 INFO:tasks.workunit.client.1.smithi098.stdout:2/455: dread d6/f4a [0,4194304] 0 2023-01-04T18:16:30.505 INFO:tasks.workunit.client.1.smithi098.stdout:6/434: rename d9/dd/d4e/d67/l7c to d9/dd/de/d26/d71/l83 0 2023-01-04T18:16:30.506 INFO:tasks.workunit.client.1.smithi098.stdout:7/396: creat d1/d51/d26/d28/f88 x:0 0 0 2023-01-04T18:16:30.506 INFO:tasks.workunit.client.1.smithi098.stdout:9/470: getdents d2/d53 0 2023-01-04T18:16:30.506 INFO:tasks.workunit.client.1.smithi098.stdout:0/457: dwrite df/d17/d1c/d2c/d41/d4a/d4c/d5f/f63 [0,4194304] 0 2023-01-04T18:16:30.508 INFO:tasks.workunit.client.1.smithi098.stdout:2/456: mknod d6/dc/d2b/d42/d47/d1f/d39/c96 0 2023-01-04T18:16:30.510 INFO:tasks.workunit.client.1.smithi098.stdout:6/435: mkdir d9/dd/de/d20/d82/d84 0 2023-01-04T18:16:30.511 INFO:tasks.workunit.client.1.smithi098.stdout:7/397: truncate d1/d4/d11/f60 330049 0 2023-01-04T18:16:30.514 INFO:tasks.workunit.client.1.smithi098.stdout:2/457: rmdir d6/dc/d2b/d42/d47/d1f/d82 39 2023-01-04T18:16:30.514 INFO:tasks.workunit.client.1.smithi098.stdout:2/458: chown d6/dc/d2b/d42/d47/d1f/f8b 11486 1 2023-01-04T18:16:30.515 INFO:tasks.workunit.client.1.smithi098.stdout:9/471: dread d2/d5/d18/d4e/d2e/d26/d41/f85 [0,4194304] 0 2023-01-04T18:16:30.515 INFO:tasks.workunit.client.1.smithi098.stdout:9/472: truncate d2/d5/d18/d1d/d23/d5c/f87 36783 0 2023-01-04T18:16:30.516 INFO:tasks.workunit.client.1.smithi098.stdout:4/407: dwrite d5/de/d2c/f46 [4194304,4194304] 0 2023-01-04T18:16:30.517 INFO:tasks.workunit.client.1.smithi098.stdout:5/389: dwrite d1/d2f/f5f [0,4194304] 0 2023-01-04T18:16:30.518 INFO:tasks.workunit.client.1.smithi098.stdout:3/500: dwrite d6/d10/d19/d3f/d5e/d74/f52 [0,4194304] 0 2023-01-04T18:16:30.519 INFO:tasks.workunit.client.1.smithi098.stdout:2/459: creat d6/dc/d4b/f97 x:0 0 0 2023-01-04T18:16:30.520 INFO:tasks.workunit.client.1.smithi098.stdout:9/473: creat d2/d5/d18/d4e/d2e/d26/d41/d57/d72/d9e/fa0 x:0 0 0 2023-01-04T18:16:30.522 INFO:tasks.workunit.client.1.smithi098.stdout:8/394: dwrite d6/dc/d12/d20/f45 [0,4194304] 0 2023-01-04T18:16:30.525 INFO:tasks.workunit.client.1.smithi098.stdout:5/390: rename d1/d2/d14/d19/f22 to d1/d1e/f74 0 2023-01-04T18:16:30.525 INFO:tasks.workunit.client.1.smithi098.stdout:3/501: creat d6/d10/d6b/d9e/fae x:0 0 0 2023-01-04T18:16:30.525 INFO:tasks.workunit.client.1.smithi098.stdout:2/460: read d6/dc/f14 [1233831,88073] 0 2023-01-04T18:16:30.525 INFO:tasks.workunit.client.1.smithi098.stdout:7/398: dread d1/d23/d21/f4b [0,4194304] 0 2023-01-04T18:16:30.525 INFO:tasks.workunit.client.1.smithi098.stdout:1/348: dwrite d1/d25/d27/d77/d54/f5b [0,4194304] 0 2023-01-04T18:16:30.526 INFO:tasks.workunit.client.1.smithi098.stdout:4/408: write d5/f1b [1947486,112102] 0 2023-01-04T18:16:30.526 INFO:tasks.workunit.client.1.smithi098.stdout:9/474: creat d2/d5/d18/d4e/d42/d89/fa1 x:0 0 0 2023-01-04T18:16:30.526 INFO:tasks.workunit.client.1.smithi098.stdout:7/399: write d1/d23/d21/f77 [268124,77688] 0 2023-01-04T18:16:30.534 INFO:tasks.workunit.client.1.smithi098.stdout:8/395: dread d6/dc/f18 [0,4194304] 0 2023-01-04T18:16:30.534 INFO:tasks.workunit.client.1.smithi098.stdout:8/396: dread - d6/dc/d12/d20/f61 zero size 2023-01-04T18:16:30.535 INFO:tasks.workunit.client.1.smithi098.stdout:5/391: mkdir d1/d2f/d66/d75 0 2023-01-04T18:16:30.535 INFO:tasks.workunit.client.1.smithi098.stdout:5/392: chown d1/l40 30816476 1 2023-01-04T18:16:30.535 INFO:tasks.workunit.client.1.smithi098.stdout:5/393: fsync d1/da/f2b 0 2023-01-04T18:16:30.536 INFO:tasks.workunit.client.1.smithi098.stdout:3/502: creat d6/d10/d6b/faf x:0 0 0 2023-01-04T18:16:30.542 INFO:tasks.workunit.client.1.smithi098.stdout:2/461: unlink c1 0 2023-01-04T18:16:30.543 INFO:tasks.workunit.client.1.smithi098.stdout:1/349: mknod d1/d25/d27/d77/d54/c7a 0 2023-01-04T18:16:30.543 INFO:tasks.workunit.client.1.smithi098.stdout:1/350: chown d1/d25/d27/d77/d54 118 1 2023-01-04T18:16:30.544 INFO:tasks.workunit.client.1.smithi098.stdout:4/409: link c3 d5/de/d21/d75/d83/c89 0 2023-01-04T18:16:30.547 INFO:tasks.workunit.client.1.smithi098.stdout:9/475: mknod d2/d5/ca2 0 2023-01-04T18:16:30.547 INFO:tasks.workunit.client.1.smithi098.stdout:9/476: chown d2/d5/d18/d4e/d2e/d26/d41/d57/d72/d9e 63 1 2023-01-04T18:16:30.547 INFO:tasks.workunit.client.1.smithi098.stdout:9/477: chown d2/d5/d18/d19 5 1 2023-01-04T18:16:30.548 INFO:tasks.workunit.client.1.smithi098.stdout:5/394: truncate d1/d1e/f74 397045 0 2023-01-04T18:16:30.549 INFO:tasks.workunit.client.1.smithi098.stdout:3/503: unlink d6/d10/f32 0 2023-01-04T18:16:30.551 INFO:tasks.workunit.client.1.smithi098.stdout:2/462: unlink d6/f2d 0 2023-01-04T18:16:30.551 INFO:tasks.workunit.client.1.smithi098.stdout:1/351: mknod d1/d8/d66/c7b 0 2023-01-04T18:16:30.552 INFO:tasks.workunit.client.1.smithi098.stdout:4/410: truncate d5/d9/f1a 458464 0 2023-01-04T18:16:30.553 INFO:tasks.workunit.client.1.smithi098.stdout:9/478: link d2/d2d/c62 d2/d5/d18/d4e/ca3 0 2023-01-04T18:16:30.555 INFO:tasks.workunit.client.1.smithi098.stdout:3/504: rmdir d6/d10/d19/d3f/d46/d8a 39 2023-01-04T18:16:30.555 INFO:tasks.workunit.client.1.smithi098.stdout:5/395: mknod d1/d2/d14/c76 0 2023-01-04T18:16:30.555 INFO:tasks.workunit.client.1.smithi098.stdout:3/505: dread - d6/d6f/f91 zero size 2023-01-04T18:16:30.556 INFO:tasks.workunit.client.1.smithi098.stdout:3/506: stat d6/d10/d6b/d9e 0 2023-01-04T18:16:30.556 INFO:tasks.workunit.client.1.smithi098.stdout:3/507: dread - d6/d10/d6b/fa4 zero size 2023-01-04T18:16:30.556 INFO:tasks.workunit.client.1.smithi098.stdout:2/463: rmdir d6/dc/d2b/d42/d51 39 2023-01-04T18:16:30.557 INFO:tasks.workunit.client.1.smithi098.stdout:8/397: dwrite d6/f9 [0,4194304] 0 2023-01-04T18:16:30.557 INFO:tasks.workunit.client.1.smithi098.stdout:4/411: creat d5/d28/d40/f8a x:0 0 0 2023-01-04T18:16:30.558 INFO:tasks.workunit.client.1.smithi098.stdout:7/400: dwrite d1/f47 [0,4194304] 0 2023-01-04T18:16:30.558 INFO:tasks.workunit.client.1.smithi098.stdout:9/479: creat d2/d5/d18/d4e/d42/d89/fa4 x:0 0 0 2023-01-04T18:16:30.558 INFO:tasks.workunit.client.1.smithi098.stdout:9/480: truncate d2/d5/d18/d4e/d2e/d26/d41/f6a 208520 0 2023-01-04T18:16:30.558 INFO:tasks.workunit.client.1.smithi098.stdout:0/458: dwrite df/f3e [0,4194304] 0 2023-01-04T18:16:30.559 INFO:tasks.workunit.client.1.smithi098.stdout:9/481: read d2/d5/d18/d4e/d2e/f79 [419599,93402] 0 2023-01-04T18:16:30.561 INFO:tasks.workunit.client.1.smithi098.stdout:3/508: creat d6/d10/d19/d3f/d5e/d74/fb0 x:0 0 0 2023-01-04T18:16:30.564 INFO:tasks.workunit.client.1.smithi098.stdout:7/401: creat d1/d51/f89 x:0 0 0 2023-01-04T18:16:30.564 INFO:tasks.workunit.client.1.smithi098.stdout:7/402: fdatasync d1/da/f1e 0 2023-01-04T18:16:30.564 INFO:tasks.workunit.client.1.smithi098.stdout:7/403: fdatasync d1/d51/f89 0 2023-01-04T18:16:30.566 INFO:tasks.workunit.client.1.smithi098.stdout:1/352: dwrite d1/f44 [0,4194304] 0 2023-01-04T18:16:30.566 INFO:tasks.workunit.client.1.smithi098.stdout:0/459: rename df/d17/d1c/d3b/d98/da5/fab to df/d17/d1c/d2c/d41/fae 0 2023-01-04T18:16:30.567 INFO:tasks.workunit.client.1.smithi098.stdout:8/398: dread d6/fe [0,4194304] 0 2023-01-04T18:16:30.568 INFO:tasks.workunit.client.1.smithi098.stdout:9/482: creat d2/d5/d18/fa5 x:0 0 0 2023-01-04T18:16:30.574 INFO:tasks.workunit.client.1.smithi098.stdout:3/509: creat d6/d6f/d9b/fb1 x:0 0 0 2023-01-04T18:16:30.577 INFO:tasks.workunit.client.1.smithi098.stdout:9/483: dread d2/d5/d18/f44 [0,4194304] 0 2023-01-04T18:16:30.577 INFO:tasks.workunit.client.1.smithi098.stdout:9/484: fsync f1 0 2023-01-04T18:16:30.580 INFO:tasks.workunit.client.1.smithi098.stdout:1/353: dwrite d1/d25/d27/d77/f2b [4194304,4194304] 0 2023-01-04T18:16:30.582 INFO:tasks.workunit.client.1.smithi098.stdout:5/396: write d1/d1e/f74 [1268335,40011] 0 2023-01-04T18:16:30.590 INFO:tasks.workunit.client.1.smithi098.stdout:0/460: rmdir df/d17/d1c/d2c/d41/d4a/d7a 39 2023-01-04T18:16:30.590 INFO:tasks.workunit.client.1.smithi098.stdout:0/461: truncate df/d17/d1c/d2c/d41/f92 235489 0 2023-01-04T18:16:30.598 INFO:tasks.workunit.client.1.smithi098.stdout:5/397: dwrite d1/f6f [0,4194304] 0 2023-01-04T18:16:30.601 INFO:tasks.workunit.client.1.smithi098.stdout:8/399: creat d6/dc/d12/d1e/d37/f73 x:0 0 0 2023-01-04T18:16:30.601 INFO:tasks.workunit.client.1.smithi098.stdout:8/400: chown d6/f9 7013971 1 2023-01-04T18:16:30.601 INFO:tasks.workunit.client.1.smithi098.stdout:8/401: readlink d6/d11/d15/d1b/d2a/d3b/d4c/l68 0 2023-01-04T18:16:30.605 INFO:tasks.workunit.client.1.smithi098.stdout:9/485: symlink d2/d2d/la6 0 2023-01-04T18:16:30.605 INFO:tasks.workunit.client.1.smithi098.stdout:9/486: fdatasync d2/d5/d18/d1d/d23/f8c 0 2023-01-04T18:16:30.606 INFO:tasks.workunit.client.1.smithi098.stdout:9/487: dread d2/d2d/f8d [0,4194304] 0 2023-01-04T18:16:30.608 INFO:tasks.workunit.client.1.smithi098.stdout:8/402: dread d6/dc/d12/f4f [0,4194304] 0 2023-01-04T18:16:30.608 INFO:tasks.workunit.client.1.smithi098.stdout:8/403: readlink d6/d11/d15/d1b/d2a/d3b/d4c/d54/l5b 0 2023-01-04T18:16:30.609 INFO:tasks.workunit.client.1.smithi098.stdout:1/354: rmdir d1/d25/d78 0 2023-01-04T18:16:30.611 INFO:tasks.workunit.client.1.smithi098.stdout:0/462: truncate df/d17/d1c/d2c/d41/d4a/d4c/d5f/f63 577182 0 2023-01-04T18:16:30.619 INFO:tasks.workunit.client.1.smithi098.stdout:3/510: unlink d6/d10/d19/d3f/d5e/d74/fb0 0 2023-01-04T18:16:30.620 INFO:tasks.workunit.client.1.smithi098.stdout:5/398: dwrite d1/f2e [0,4194304] 0 2023-01-04T18:16:30.621 INFO:tasks.workunit.client.1.smithi098.stdout:5/399: read d1/d46/f49 [377132,48747] 0 2023-01-04T18:16:30.621 INFO:tasks.workunit.client.1.smithi098.stdout:9/488: mknod d2/d5/d18/d4e/d2e/d26/d41/d57/d72/d9e/ca7 0 2023-01-04T18:16:30.621 INFO:tasks.workunit.client.1.smithi098.stdout:5/400: chown d1/da/d44/f70 0 1 2023-01-04T18:16:30.621 INFO:tasks.workunit.client.1.smithi098.stdout:9/489: readlink d2/d5/d18/d1d/d23/l35 0 2023-01-04T18:16:30.622 INFO:tasks.workunit.client.1.smithi098.stdout:0/463: mkdir df/d4f/d6e/daf 0 2023-01-04T18:16:30.624 INFO:tasks.workunit.client.1.smithi098.stdout:3/511: unlink d6/d10/d19/d3f/d5e/d7d/fa7 0 2023-01-04T18:16:30.626 INFO:tasks.workunit.client.1.smithi098.stdout:9/490: symlink d2/d53/la8 0 2023-01-04T18:16:30.626 INFO:tasks.workunit.client.1.smithi098.stdout:5/401: dread d1/f18 [0,4194304] 0 2023-01-04T18:16:30.628 INFO:tasks.workunit.client.1.smithi098.stdout:3/512: symlink d6/d10/d6b/lb2 0 2023-01-04T18:16:30.628 INFO:tasks.workunit.client.1.smithi098.stdout:1/355: link d1/d25/d27/d77/f74 d1/d25/d27/d77/f7c 0 2023-01-04T18:16:30.628 INFO:tasks.workunit.client.1.smithi098.stdout:1/356: getdents d1 0 2023-01-04T18:16:30.628 INFO:tasks.workunit.client.1.smithi098.stdout:1/357: write d1/d2e/f67 [297023,40463] 0 2023-01-04T18:16:30.628 INFO:tasks.workunit.client.1.smithi098.stdout:5/402: unlink d1/d2/l36 0 2023-01-04T18:16:30.629 INFO:tasks.workunit.client.1.smithi098.stdout:8/404: dwrite d6/d11/d15/d1b/d2a/d3b/f35 [0,4194304] 0 2023-01-04T18:16:30.633 INFO:tasks.workunit.client.1.smithi098.stdout:1/358: getdents d1/d25/d27/d77/d54 0 2023-01-04T18:16:30.635 INFO:tasks.workunit.client.1.smithi098.stdout:5/403: creat d1/da/f77 x:0 0 0 2023-01-04T18:16:30.635 INFO:tasks.workunit.client.1.smithi098.stdout:5/404: dread - d1/da/f2b zero size 2023-01-04T18:16:30.639 INFO:tasks.workunit.client.1.smithi098.stdout:8/405: mknod d6/d11/d15/c74 0 2023-01-04T18:16:30.640 INFO:tasks.workunit.client.1.smithi098.stdout:8/406: write d6/dc/d12/d20/f61 [214923,118266] 0 2023-01-04T18:16:30.640 INFO:tasks.workunit.client.1.smithi098.stdout:8/407: fsync d6/dc/d12/d1e/d37/d4b/f50 0 2023-01-04T18:16:30.641 INFO:tasks.workunit.client.1.smithi098.stdout:1/359: rename d1/d2e/f67 to d1/d8/da/f7d 0 2023-01-04T18:16:30.643 INFO:tasks.workunit.client.1.smithi098.stdout:1/360: write d1/d25/d27/f34 [483931,108044] 0 2023-01-04T18:16:30.643 INFO:tasks.workunit.client.1.smithi098.stdout:1/361: chown d1/d25/d27/f6f 118037325 1 2023-01-04T18:16:30.643 INFO:tasks.workunit.client.1.smithi098.stdout:5/405: symlink d1/d2f/d73/l78 0 2023-01-04T18:16:30.643 INFO:tasks.workunit.client.1.smithi098.stdout:5/406: write d1/da/d44/f70 [666437,95743] 0 2023-01-04T18:16:30.643 INFO:tasks.workunit.client.1.smithi098.stdout:5/407: dread - d1/f6b zero size 2023-01-04T18:16:30.643 INFO:tasks.workunit.client.1.smithi098.stdout:9/491: dwrite d2/d5/d18/d4e/d2e/d26/f9a [0,4194304] 0 2023-01-04T18:16:30.643 INFO:tasks.workunit.client.1.smithi098.stdout:9/492: fdatasync d2/d5/d18/d19/d82/f84 0 2023-01-04T18:16:30.644 INFO:tasks.workunit.client.1.smithi098.stdout:8/408: mkdir d6/d11/d15/d75 0 2023-01-04T18:16:30.649 INFO:tasks.workunit.client.1.smithi098.stdout:3/513: dwrite d6/d56/f99 [0,4194304] 0 2023-01-04T18:16:30.649 INFO:tasks.workunit.client.1.smithi098.stdout:3/514: fdatasync d6/f21 0 2023-01-04T18:16:30.650 INFO:tasks.workunit.client.1.smithi098.stdout:3/515: write d6/f41 [2412746,39634] 0 2023-01-04T18:16:30.650 INFO:tasks.workunit.client.1.smithi098.stdout:1/362: mknod d1/d25/d36/d4e/d6e/c7e 0 2023-01-04T18:16:30.650 INFO:tasks.workunit.client.1.smithi098.stdout:1/363: stat d1/d8/da/f48 0 2023-01-04T18:16:30.651 INFO:tasks.workunit.client.1.smithi098.stdout:5/408: creat d1/d2/d14/d19/f79 x:0 0 0 2023-01-04T18:16:30.651 INFO:tasks.workunit.client.1.smithi098.stdout:5/409: fsync d1/da/f37 0 2023-01-04T18:16:30.656 INFO:tasks.workunit.client.1.smithi098.stdout:9/493: rename d2/c11 to d2/d5/d18/d1d/ca9 0 2023-01-04T18:16:30.656 INFO:tasks.workunit.client.1.smithi098.stdout:9/494: write d2/d5/d18/d4e/d42/f64 [4478440,21858] 0 2023-01-04T18:16:30.658 INFO:tasks.workunit.client.1.smithi098.stdout:3/516: symlink d6/d10/dad/lb3 0 2023-01-04T18:16:30.659 INFO:tasks.workunit.client.1.smithi098.stdout:9/495: symlink d2/d5/d18/d4e/d2e/d26/d41/laa 0 2023-01-04T18:16:30.660 INFO:tasks.workunit.client.1.smithi098.stdout:6/436: sync 2023-01-04T18:16:30.661 INFO:tasks.workunit.client.1.smithi098.stdout:9/496: symlink d2/d5/d18/lab 0 2023-01-04T18:16:30.662 INFO:tasks.workunit.client.1.smithi098.stdout:1/364: dread d1/f30 [0,4194304] 0 2023-01-04T18:16:30.662 INFO:tasks.workunit.client.1.smithi098.stdout:1/365: fdatasync d1/d2e/f6c 0 2023-01-04T18:16:30.664 INFO:tasks.workunit.client.1.smithi098.stdout:1/366: creat d1/d25/d36/d4e/d6e/f7f x:0 0 0 2023-01-04T18:16:30.666 INFO:tasks.workunit.client.1.smithi098.stdout:1/367: mknod d1/d25/d27/c80 0 2023-01-04T18:16:30.667 INFO:tasks.workunit.client.1.smithi098.stdout:6/437: dread d9/dd/de/d20/f5d [0,4194304] 0 2023-01-04T18:16:30.669 INFO:tasks.workunit.client.1.smithi098.stdout:9/497: write d2/d5/d18/d4e/d2e/f4d [3882892,1896] 0 2023-01-04T18:16:30.669 INFO:tasks.workunit.client.1.smithi098.stdout:9/498: chown d2/d5/d18/d4e/d2e/d26/d41/l51 6 1 2023-01-04T18:16:30.669 INFO:tasks.workunit.client.1.smithi098.stdout:9/499: readlink d2/d5/d18/d1d/d23/d66/l86 0 2023-01-04T18:16:30.669 INFO:tasks.workunit.client.1.smithi098.stdout:1/368: symlink d1/d25/d27/d77/l81 0 2023-01-04T18:16:30.670 INFO:tasks.workunit.client.1.smithi098.stdout:6/438: mkdir d9/dd/de/d44/d7a/d85 0 2023-01-04T18:16:30.673 INFO:tasks.workunit.client.1.smithi098.stdout:9/500: unlink d2/d53/c81 0 2023-01-04T18:16:30.673 INFO:tasks.workunit.client.1.smithi098.stdout:9/501: dread - d2/d5/d18/d4e/d42/f99 zero size 2023-01-04T18:16:30.677 INFO:tasks.workunit.client.1.smithi098.stdout:5/410: dwrite d1/d46/d6a/f6d [0,4194304] 0 2023-01-04T18:16:30.680 INFO:tasks.workunit.client.1.smithi098.stdout:5/411: write d1/da/d44/d45/f5b [173678,10295] 0 2023-01-04T18:16:30.685 INFO:tasks.workunit.client.1.smithi098.stdout:1/369: mkdir d1/d25/d27/d77/d82 0 2023-01-04T18:16:30.687 INFO:tasks.workunit.client.1.smithi098.stdout:5/412: unlink d1/da/d44/d45/f55 0 2023-01-04T18:16:30.689 INFO:tasks.workunit.client.1.smithi098.stdout:1/370: link d1/d25/d27/d77/f3b d1/f83 0 2023-01-04T18:16:30.690 INFO:tasks.workunit.client.1.smithi098.stdout:1/371: truncate d1/d8/d53/f73 343059 0 2023-01-04T18:16:30.690 INFO:tasks.workunit.client.1.smithi098.stdout:1/372: write d1/d25/d27/f6f [1046973,93457] 0 2023-01-04T18:16:30.690 INFO:tasks.workunit.client.1.smithi098.stdout:1/373: truncate d1/d8/d53/f73 493248 0 2023-01-04T18:16:30.690 INFO:tasks.workunit.client.1.smithi098.stdout:5/413: creat d1/d2f/f7a x:0 0 0 2023-01-04T18:16:30.691 INFO:tasks.workunit.client.1.smithi098.stdout:3/517: dwrite d6/d10/d19/d3f/d46/f5a [0,4194304] 0 2023-01-04T18:16:30.692 INFO:tasks.workunit.client.1.smithi098.stdout:1/374: creat d1/d2e/f84 x:0 0 0 2023-01-04T18:16:30.692 INFO:tasks.workunit.client.1.smithi098.stdout:3/518: write d6/d6f/f94 [697878,25861] 0 2023-01-04T18:16:30.692 INFO:tasks.workunit.client.1.smithi098.stdout:3/519: write d6/d10/d19/d3f/d5e/d74/f48 [993091,1503] 0 2023-01-04T18:16:30.692 INFO:tasks.workunit.client.1.smithi098.stdout:3/520: fsync d6/d10/d6b/d9e/fae 0 2023-01-04T18:16:30.692 INFO:tasks.workunit.client.1.smithi098.stdout:6/439: dwrite d9/dd/de/d20/f3f [0,4194304] 0 2023-01-04T18:16:30.695 INFO:tasks.workunit.client.1.smithi098.stdout:6/440: dread d9/dd/d24/d3e/f60 [0,4194304] 0 2023-01-04T18:16:30.695 INFO:tasks.workunit.client.1.smithi098.stdout:9/502: dwrite d2/d5/d18/d4e/d2e/d26/f37 [0,4194304] 0 2023-01-04T18:16:30.695 INFO:tasks.workunit.client.1.smithi098.stdout:9/503: stat d2/d2d/f50 0 2023-01-04T18:16:30.696 INFO:tasks.workunit.client.1.smithi098.stdout:1/375: creat d1/d8/d53/f85 x:0 0 0 2023-01-04T18:16:30.696 INFO:tasks.workunit.client.1.smithi098.stdout:1/376: readlink d1/d25/d36/d4e/l57 0 2023-01-04T18:16:30.698 INFO:tasks.workunit.client.1.smithi098.stdout:6/441: mkdir d9/dd/d24/d3e/d86 0 2023-01-04T18:16:30.701 INFO:tasks.workunit.client.1.smithi098.stdout:6/442: dread d9/dd/de/d20/f5d [0,4194304] 0 2023-01-04T18:16:30.701 INFO:tasks.workunit.client.1.smithi098.stdout:9/504: rename d2/d5/d18/d4e/d2e to d2/d5/d18/d4e/d42/d89/dac 0 2023-01-04T18:16:30.705 INFO:tasks.workunit.client.1.smithi098.stdout:5/414: dwrite d1/d1e/f68 [0,4194304] 0 2023-01-04T18:16:30.706 INFO:tasks.workunit.client.1.smithi098.stdout:1/377: dread d1/d25/d36/f40 [0,4194304] 0 2023-01-04T18:16:30.710 INFO:tasks.workunit.client.1.smithi098.stdout:1/378: read d1/f1f [1256226,125419] 0 2023-01-04T18:16:30.716 INFO:tasks.workunit.client.1.smithi098.stdout:9/505: getdents d2/d5/d18/d4e/d42/d89/dac/d26/d41 0 2023-01-04T18:16:30.719 INFO:tasks.workunit.client.1.smithi098.stdout:6/443: dwrite d9/dd/d1f/f6f [0,4194304] 0 2023-01-04T18:16:30.719 INFO:tasks.workunit.client.1.smithi098.stdout:6/444: chown d9/dd/de/d20/c76 957 1 2023-01-04T18:16:30.720 INFO:tasks.workunit.client.1.smithi098.stdout:5/415: link d1/d1e/f68 d1/d2f/d66/d75/f7b 0 2023-01-04T18:16:30.723 INFO:tasks.workunit.client.1.smithi098.stdout:1/379: truncate d1/d8/f10 976867 0 2023-01-04T18:16:30.723 INFO:tasks.workunit.client.1.smithi098.stdout:4/412: sync 2023-01-04T18:16:30.723 INFO:tasks.workunit.client.1.smithi098.stdout:7/404: sync 2023-01-04T18:16:30.723 INFO:tasks.workunit.client.1.smithi098.stdout:2/464: sync 2023-01-04T18:16:30.725 INFO:tasks.workunit.client.1.smithi098.stdout:9/506: rename d2/d5/d18/d4e/d42/d89/dac/d26/d41/d57 to d2/d5/d18/d1d/d23/dad 0 2023-01-04T18:16:30.725 INFO:tasks.workunit.client.1.smithi098.stdout:9/507: fdatasync d2/d2d/f5d 0 2023-01-04T18:16:30.726 INFO:tasks.workunit.client.1.smithi098.stdout:1/380: dread d1/d25/d27/d77/d54/f5a [0,4194304] 0 2023-01-04T18:16:30.727 INFO:tasks.workunit.client.1.smithi098.stdout:6/445: unlink d9/dd/de/d26/f2e 0 2023-01-04T18:16:30.727 INFO:tasks.workunit.client.1.smithi098.stdout:6/446: fsync d9/dd/d24/f30 0 2023-01-04T18:16:30.728 INFO:tasks.workunit.client.1.smithi098.stdout:6/447: write d9/dd/de/d44/d79/f80 [532297,8267] 0 2023-01-04T18:16:30.728 INFO:tasks.workunit.client.1.smithi098.stdout:6/448: write d9/dd/d15/f36 [4830410,98412] 0 2023-01-04T18:16:30.728 INFO:tasks.workunit.client.1.smithi098.stdout:5/416: creat d1/da/d44/d45/f7c x:0 0 0 2023-01-04T18:16:30.728 INFO:tasks.workunit.client.1.smithi098.stdout:4/413: mknod d5/d9/d13/d65/c8b 0 2023-01-04T18:16:30.729 INFO:tasks.workunit.client.1.smithi098.stdout:4/414: chown d5/de/d21/f22 55 1 2023-01-04T18:16:30.730 INFO:tasks.workunit.client.1.smithi098.stdout:9/508: creat d2/d5/d18/d4e/d42/d89/dac/d26/fae x:0 0 0 2023-01-04T18:16:30.731 INFO:tasks.workunit.client.1.smithi098.stdout:1/381: read - d1/d25/d27/d77/f4b zero size 2023-01-04T18:16:30.732 INFO:tasks.workunit.client.1.smithi098.stdout:6/449: creat d9/dd/d24/d3e/f87 x:0 0 0 2023-01-04T18:16:30.732 INFO:tasks.workunit.client.1.smithi098.stdout:5/417: creat d1/d46/f7d x:0 0 0 2023-01-04T18:16:30.733 INFO:tasks.workunit.client.1.smithi098.stdout:9/509: truncate d2/d53/f65 953721 0 2023-01-04T18:16:30.733 INFO:tasks.workunit.client.1.smithi098.stdout:7/405: dread d1/d23/d37/f42 [0,4194304] 0 2023-01-04T18:16:30.740 INFO:tasks.workunit.client.1.smithi098.stdout:1/382: mknod d1/d25/d27/d77/d54/c86 0 2023-01-04T18:16:30.740 INFO:tasks.workunit.client.1.smithi098.stdout:6/450: mknod d9/dd/d1f/d81/c88 0 2023-01-04T18:16:30.740 INFO:tasks.workunit.client.1.smithi098.stdout:6/451: fdatasync d9/dd/d4e/f58 0 2023-01-04T18:16:30.740 INFO:tasks.workunit.client.1.smithi098.stdout:1/383: write d1/d25/d36/f40 [4321389,18842] 0 2023-01-04T18:16:30.743 INFO:tasks.workunit.client.1.smithi098.stdout:6/452: mknod d9/dd/d24/d3e/d86/c89 0 2023-01-04T18:16:30.743 INFO:tasks.workunit.client.1.smithi098.stdout:1/384: mknod d1/d8/d66/c87 0 2023-01-04T18:16:30.746 INFO:tasks.workunit.client.1.smithi098.stdout:6/453: dread d9/dd/f42 [0,4194304] 0 2023-01-04T18:16:30.747 INFO:tasks.workunit.client.1.smithi098.stdout:7/406: dread d1/d51/d26/f81 [0,4194304] 0 2023-01-04T18:16:30.747 INFO:tasks.workunit.client.1.smithi098.stdout:7/407: chown d1/d4/l8 54 1 2023-01-04T18:16:30.747 INFO:tasks.workunit.client.1.smithi098.stdout:7/408: readlink d1/d23/d37/d40/l50 0 2023-01-04T18:16:30.747 INFO:tasks.workunit.client.1.smithi098.stdout:7/409: fsync d1/d23/d21/f4b 0 2023-01-04T18:16:30.747 INFO:tasks.workunit.client.1.smithi098.stdout:7/410: write d1/d51/f19 [4780439,130745] 0 2023-01-04T18:16:30.748 INFO:tasks.workunit.client.1.smithi098.stdout:9/510: rmdir d2/d53 39 2023-01-04T18:16:30.752 INFO:tasks.workunit.client.1.smithi098.stdout:6/454: mkdir d9/dd/de/d20/d82/d84/d8a 0 2023-01-04T18:16:30.758 INFO:tasks.workunit.client.1.smithi098.stdout:7/411: creat d1/d51/d26/f8a x:0 0 0 2023-01-04T18:16:30.758 INFO:tasks.workunit.client.1.smithi098.stdout:7/412: write d1/d2e/f54 [569679,24004] 0 2023-01-04T18:16:30.759 INFO:tasks.workunit.client.1.smithi098.stdout:9/511: mkdir d2/d53/daf 0 2023-01-04T18:16:30.759 INFO:tasks.workunit.client.1.smithi098.stdout:7/413: read d1/d2e/f61 [204756,43961] 0 2023-01-04T18:16:30.760 INFO:tasks.workunit.client.1.smithi098.stdout:6/455: creat d9/dd/d4e/f8b x:0 0 0 2023-01-04T18:16:30.761 INFO:tasks.workunit.client.1.smithi098.stdout:7/414: symlink d1/d4/l8b 0 2023-01-04T18:16:30.761 INFO:tasks.workunit.client.1.smithi098.stdout:7/415: fdatasync d1/d23/d21/d43/f70 0 2023-01-04T18:16:30.762 INFO:tasks.workunit.client.1.smithi098.stdout:6/456: getdents d9/dd/d24 0 2023-01-04T18:16:30.763 INFO:tasks.workunit.client.1.smithi098.stdout:7/416: creat d1/d51/d26/f8c x:0 0 0 2023-01-04T18:16:30.764 INFO:tasks.workunit.client.1.smithi098.stdout:7/417: dread - d1/da/f82 zero size 2023-01-04T18:16:30.764 INFO:tasks.workunit.client.1.smithi098.stdout:7/418: fdatasync d1/d51/f89 0 2023-01-04T18:16:30.764 INFO:tasks.workunit.client.1.smithi098.stdout:6/457: rmdir d9/dd/d1f/d81 39 2023-01-04T18:16:30.764 INFO:tasks.workunit.client.1.smithi098.stdout:6/458: chown d9/dd/d4e/f58 141135097 1 2023-01-04T18:16:30.765 INFO:tasks.workunit.client.1.smithi098.stdout:6/459: readlink d9/dd/l33 0 2023-01-04T18:16:30.765 INFO:tasks.workunit.client.1.smithi098.stdout:7/419: rmdir d1/d23/d37 39 2023-01-04T18:16:30.765 INFO:tasks.workunit.client.1.smithi098.stdout:7/420: chown d1/d51/f19 0 1 2023-01-04T18:16:30.766 INFO:tasks.workunit.client.1.smithi098.stdout:6/460: symlink d9/dd/d15/l8c 0 2023-01-04T18:16:30.769 INFO:tasks.workunit.client.1.smithi098.stdout:2/465: dwrite d6/dc/d2b/d42/d47/d1f/d39/f65 [0,4194304] 0 2023-01-04T18:16:30.769 INFO:tasks.workunit.client.1.smithi098.stdout:2/466: truncate d6/dc/d4b/f97 182755 0 2023-01-04T18:16:30.769 INFO:tasks.workunit.client.1.smithi098.stdout:4/415: dwrite d5/de/d2c/f3a [4194304,4194304] 0 2023-01-04T18:16:30.770 INFO:tasks.workunit.client.1.smithi098.stdout:2/467: stat d6/dc/l19 0 2023-01-04T18:16:30.771 INFO:tasks.workunit.client.1.smithi098.stdout:6/461: rename d9/dd/d1f to d9/dd/d4e/d67/d8d 0 2023-01-04T18:16:30.785 INFO:tasks.workunit.client.1.smithi098.stdout:6/462: dread d9/dd/d4e/d67/d8d/f6f [0,4194304] 0 2023-01-04T18:16:30.786 INFO:tasks.workunit.client.1.smithi098.stdout:1/385: dwrite d1/d25/d27/f6f [0,4194304] 0 2023-01-04T18:16:30.787 INFO:tasks.workunit.client.1.smithi098.stdout:6/463: mkdir d9/dd/d4e/d67/d8d/d8e 0 2023-01-04T18:16:30.790 INFO:tasks.workunit.client.1.smithi098.stdout:1/386: dread f0 [4194304,4194304] 0 2023-01-04T18:16:30.792 INFO:tasks.workunit.client.1.smithi098.stdout:6/464: symlink d9/dd/d4e/d67/d8d/l8f 0 2023-01-04T18:16:30.794 INFO:tasks.workunit.client.1.smithi098.stdout:1/387: rename d1/d8/d66 to d1/d88 0 2023-01-04T18:16:30.795 INFO:tasks.workunit.client.1.smithi098.stdout:6/465: stat d9/dd/c48 0 2023-01-04T18:16:30.797 INFO:tasks.workunit.client.1.smithi098.stdout:6/466: symlink d9/dd/d15/l90 0 2023-01-04T18:16:30.797 INFO:tasks.workunit.client.1.smithi098.stdout:6/467: write d9/dd/d24/d3e/f87 [8567,3778] 0 2023-01-04T18:16:30.803 INFO:tasks.workunit.client.1.smithi098.stdout:2/468: dwrite d6/dc/d2b/f70 [0,4194304] 0 2023-01-04T18:16:30.803 INFO:tasks.workunit.client.1.smithi098.stdout:2/469: fsync d6/dc/d2b/d42/d47/d1f/d39/f56 0 2023-01-04T18:16:30.803 INFO:tasks.workunit.client.1.smithi098.stdout:2/470: read d6/dc/d2b/d42/d47/d1f/d39/f80 [81021,77970] 0 2023-01-04T18:16:30.805 INFO:tasks.workunit.client.1.smithi098.stdout:2/471: symlink d6/dc/d2b/d46/l98 0 2023-01-04T18:16:30.805 INFO:tasks.workunit.client.1.smithi098.stdout:2/472: truncate d6/dc/d2b/d42/d47/d1f/f6f 22802 0 2023-01-04T18:16:30.806 INFO:tasks.workunit.client.1.smithi098.stdout:7/421: dwrite d1/d51/d26/d28/f6e [0,4194304] 0 2023-01-04T18:16:30.806 INFO:tasks.workunit.client.1.smithi098.stdout:4/416: dwrite d5/de/d30/d4f/f86 [0,4194304] 0 2023-01-04T18:16:30.806 INFO:tasks.workunit.client.1.smithi098.stdout:4/417: chown d5/de/d21/f22 119271 1 2023-01-04T18:16:30.807 INFO:tasks.workunit.client.1.smithi098.stdout:2/473: symlink d6/dc/d2b/d46/l99 0 2023-01-04T18:16:30.808 INFO:tasks.workunit.client.1.smithi098.stdout:0/464: sync 2023-01-04T18:16:30.808 INFO:tasks.workunit.client.1.smithi098.stdout:8/409: sync 2023-01-04T18:16:30.808 INFO:tasks.workunit.client.1.smithi098.stdout:8/410: chown d6/dc/d12/d1e/d44/f53 0 1 2023-01-04T18:16:30.810 INFO:tasks.workunit.client.1.smithi098.stdout:8/411: read d6/d11/d15/d1b/d2a/d3b/f38 [3643921,79757] 0 2023-01-04T18:16:30.810 INFO:tasks.workunit.client.1.smithi098.stdout:7/422: mkdir d1/d51/d26/d28/d8d 0 2023-01-04T18:16:30.810 INFO:tasks.workunit.client.1.smithi098.stdout:8/412: write d6/dc/d12/d1e/d37/f3a [383085,101423] 0 2023-01-04T18:16:30.812 INFO:tasks.workunit.client.1.smithi098.stdout:4/418: link d5/d9/d13/l35 d5/de/d21/l8c 0 2023-01-04T18:16:30.812 INFO:tasks.workunit.client.1.smithi098.stdout:4/419: chown d5/d9/c45 734598 1 2023-01-04T18:16:30.814 INFO:tasks.workunit.client.1.smithi098.stdout:2/474: dread d6/dc/d2b/d42/d47/d1f/d39/d6e/f77 [0,4194304] 0 2023-01-04T18:16:30.816 INFO:tasks.workunit.client.1.smithi098.stdout:4/420: dread d5/de/d2c/f53 [0,4194304] 0 2023-01-04T18:16:30.822 INFO:tasks.workunit.client.1.smithi098.stdout:7/423: getdents d1/d23/d21 0 2023-01-04T18:16:30.822 INFO:tasks.workunit.client.1.smithi098.stdout:7/424: fsync d1/d4/d11/d5d/f63 0 2023-01-04T18:16:30.822 INFO:tasks.workunit.client.1.smithi098.stdout:8/413: unlink d6/d11/d15/d1b/c25 0 2023-01-04T18:16:30.823 INFO:tasks.workunit.client.1.smithi098.stdout:7/425: creat d1/d23/d37/d40/f8e x:0 0 0 2023-01-04T18:16:30.825 INFO:tasks.workunit.client.1.smithi098.stdout:4/421: dread d5/de/d21/f41 [0,4194304] 0 2023-01-04T18:16:30.825 INFO:tasks.workunit.client.1.smithi098.stdout:0/465: rmdir df/d17/d1c/d3b/d98/da5 0 2023-01-04T18:16:30.827 INFO:tasks.workunit.client.1.smithi098.stdout:8/414: creat d6/d11/d15/d1b/f76 x:0 0 0 2023-01-04T18:16:30.827 INFO:tasks.workunit.client.1.smithi098.stdout:8/415: stat d6/d11/d15/d1b/d2a/d3b/f5d 0 2023-01-04T18:16:30.827 INFO:tasks.workunit.client.1.smithi098.stdout:7/426: mknod d1/d51/d26/d28/c8f 0 2023-01-04T18:16:30.828 INFO:tasks.workunit.client.1.smithi098.stdout:0/466: mknod df/d17/d9b/cb0 0 2023-01-04T18:16:30.828 INFO:tasks.workunit.client.1.smithi098.stdout:0/467: truncate df/d17/d24/f2e 4914516 0 2023-01-04T18:16:30.829 INFO:tasks.workunit.client.1.smithi098.stdout:0/468: fsync df/d17/d1c/d2c/f5e 0 2023-01-04T18:16:30.829 INFO:tasks.workunit.client.1.smithi098.stdout:8/416: creat d6/dc/d12/d1e/d64/f77 x:0 0 0 2023-01-04T18:16:30.829 INFO:tasks.workunit.client.1.smithi098.stdout:8/417: getdents d6/d11/d15/d1b/d2a/d3b/d59/d6e 0 2023-01-04T18:16:30.829 INFO:tasks.workunit.client.1.smithi098.stdout:8/418: fsync d6/dc/d12/d1e/d37/f6f 0 2023-01-04T18:16:30.830 INFO:tasks.workunit.client.1.smithi098.stdout:2/475: dwrite d6/dc/d2b/d46/f48 [0,4194304] 0 2023-01-04T18:16:30.832 INFO:tasks.workunit.client.1.smithi098.stdout:4/422: dread d5/d9/d13/f17 [0,4194304] 0 2023-01-04T18:16:30.833 INFO:tasks.workunit.client.1.smithi098.stdout:7/427: creat d1/d23/d37/d78/f90 x:0 0 0 2023-01-04T18:16:30.833 INFO:tasks.workunit.client.1.smithi098.stdout:7/428: dread - d1/d23/d37/d40/f5c zero size 2023-01-04T18:16:30.835 INFO:tasks.workunit.client.1.smithi098.stdout:0/469: getdents df/d17/d24 0 2023-01-04T18:16:30.835 INFO:tasks.workunit.client.1.smithi098.stdout:0/470: write df/d4f/d6b/d89/f9a [514602,12151] 0 2023-01-04T18:16:30.836 INFO:tasks.workunit.client.1.smithi098.stdout:8/419: dread d6/dc/f2e [0,4194304] 0 2023-01-04T18:16:30.837 INFO:tasks.workunit.client.1.smithi098.stdout:8/420: write d6/dc/f2e [4397504,56077] 0 2023-01-04T18:16:30.838 INFO:tasks.workunit.client.1.smithi098.stdout:4/423: mknod d5/de/d30/d4f/c8d 0 2023-01-04T18:16:30.840 INFO:tasks.workunit.client.1.smithi098.stdout:8/421: mkdir d6/dc/d78 0 2023-01-04T18:16:30.847 INFO:tasks.workunit.client.1.smithi098.stdout:3/521: sync 2023-01-04T18:16:30.852 INFO:tasks.workunit.client.1.smithi098.stdout:2/476: dwrite d6/dc/d2b/d46/f86 [0,4194304] 0 2023-01-04T18:16:30.852 INFO:tasks.workunit.client.1.smithi098.stdout:2/477: write d6/dc/d4b/d89/f8e [302681,103903] 0 2023-01-04T18:16:30.853 INFO:tasks.workunit.client.1.smithi098.stdout:3/522: creat d6/d10/d6b/d9e/fb4 x:0 0 0 2023-01-04T18:16:30.853 INFO:tasks.workunit.client.1.smithi098.stdout:0/471: dread df/d17/d1c/f1e [0,4194304] 0 2023-01-04T18:16:30.856 INFO:tasks.workunit.client.1.smithi098.stdout:2/478: mknod d6/dc/d2b/c9a 0 2023-01-04T18:16:30.857 INFO:tasks.workunit.client.1.smithi098.stdout:0/472: dread df/d4f/f5d [0,4194304] 0 2023-01-04T18:16:30.857 INFO:tasks.workunit.client.1.smithi098.stdout:3/523: mknod d6/d10/d29/d6a/cb5 0 2023-01-04T18:16:30.857 INFO:tasks.workunit.client.1.smithi098.stdout:0/473: write df/d17/d1c/f47 [42262,55904] 0 2023-01-04T18:16:30.857 INFO:tasks.workunit.client.1.smithi098.stdout:3/524: chown d6/f44 1716788 1 2023-01-04T18:16:30.861 INFO:tasks.workunit.client.1.smithi098.stdout:4/424: dwrite d5/de/f31 [0,4194304] 0 2023-01-04T18:16:30.862 INFO:tasks.workunit.client.1.smithi098.stdout:3/525: dread d6/f6c [0,4194304] 0 2023-01-04T18:16:30.862 INFO:tasks.workunit.client.1.smithi098.stdout:8/422: dwrite d6/d11/d15/d1b/d2a/d3b/f35 [4194304,4194304] 0 2023-01-04T18:16:30.865 INFO:tasks.workunit.client.1.smithi098.stdout:0/474: getdents df/d17/d9b/da4 0 2023-01-04T18:16:30.869 INFO:tasks.workunit.client.1.smithi098.stdout:4/425: mknod d5/d9/c8e 0 2023-01-04T18:16:30.869 INFO:tasks.workunit.client.1.smithi098.stdout:4/426: chown d5/de/f31 3198 1 2023-01-04T18:16:30.869 INFO:tasks.workunit.client.1.smithi098.stdout:4/427: dread - d5/d28/d40/f52 zero size 2023-01-04T18:16:30.871 INFO:tasks.workunit.client.1.smithi098.stdout:8/423: mkdir d6/d11/d15/d1b/d2a/d3b/d79 0 2023-01-04T18:16:30.871 INFO:tasks.workunit.client.1.smithi098.stdout:0/475: mknod df/d17/d1c/d2c/d41/cb1 0 2023-01-04T18:16:30.873 INFO:tasks.workunit.client.1.smithi098.stdout:4/428: creat d5/de/d21/d75/d83/f8f x:0 0 0 2023-01-04T18:16:30.873 INFO:tasks.workunit.client.1.smithi098.stdout:3/526: mkdir d6/d6f/db6 0 2023-01-04T18:16:30.874 INFO:tasks.workunit.client.1.smithi098.stdout:4/429: write d5/de/f29 [2239129,101592] 0 2023-01-04T18:16:30.875 INFO:tasks.workunit.client.1.smithi098.stdout:8/424: getdents d6/dc/d12/d39 0 2023-01-04T18:16:30.877 INFO:tasks.workunit.client.1.smithi098.stdout:0/476: read f3 [26631,73024] 0 2023-01-04T18:16:30.877 INFO:tasks.workunit.client.1.smithi098.stdout:0/477: chown df/d17/d9b/d86 5 1 2023-01-04T18:16:30.878 INFO:tasks.workunit.client.1.smithi098.stdout:3/527: mkdir d6/d10/db7 0 2023-01-04T18:16:30.878 INFO:tasks.workunit.client.1.smithi098.stdout:3/528: stat l0 0 2023-01-04T18:16:30.883 INFO:tasks.workunit.client.1.smithi098.stdout:8/425: link d6/dc/l55 d6/dc/d5a/l7a 0 2023-01-04T18:16:30.883 INFO:tasks.workunit.client.1.smithi098.stdout:0/478: creat df/d17/d68/fb2 x:0 0 0 2023-01-04T18:16:30.883 INFO:tasks.workunit.client.1.smithi098.stdout:0/479: fsync df/d17/f1d 0 2023-01-04T18:16:30.884 INFO:tasks.workunit.client.1.smithi098.stdout:3/529: rename d6/fa to d6/d56/fb8 0 2023-01-04T18:16:30.888 INFO:tasks.workunit.client.1.smithi098.stdout:8/426: creat d6/d11/d15/d1b/d2a/d6b/f7b x:0 0 0 2023-01-04T18:16:30.889 INFO:tasks.workunit.client.1.smithi098.stdout:8/427: fsync d6/d11/f1a 0 2023-01-04T18:16:30.889 INFO:tasks.workunit.client.1.smithi098.stdout:0/480: truncate df/d4f/f5d 115121 0 2023-01-04T18:16:30.889 INFO:tasks.workunit.client.1.smithi098.stdout:8/428: fsync d6/dc/d12/f41 0 2023-01-04T18:16:30.889 INFO:tasks.workunit.client.1.smithi098.stdout:0/481: readlink ld 0 2023-01-04T18:16:30.889 INFO:tasks.workunit.client.1.smithi098.stdout:8/429: truncate d6/dc/d12/d1e/d37/d4b/f50 295944 0 2023-01-04T18:16:30.889 INFO:tasks.workunit.client.1.smithi098.stdout:2/479: dwrite d6/dc/d2b/d42/d47/d31/f6b [0,4194304] 0 2023-01-04T18:16:30.889 INFO:tasks.workunit.client.1.smithi098.stdout:3/530: mknod d6/d6f/cb9 0 2023-01-04T18:16:30.893 INFO:tasks.workunit.client.1.smithi098.stdout:0/482: unlink df/d17/d1c/c62 0 2023-01-04T18:16:30.894 INFO:tasks.workunit.client.1.smithi098.stdout:0/483: creat df/d17/d1c/d2c/d41/d4a/d4c/d5f/fb3 x:0 0 0 2023-01-04T18:16:30.897 INFO:tasks.workunit.client.1.smithi098.stdout:0/484: write f1 [4124143,6066] 0 2023-01-04T18:16:30.897 INFO:tasks.workunit.client.1.smithi098.stdout:0/485: chown df/f3e 2449112 1 2023-01-04T18:16:30.897 INFO:tasks.workunit.client.1.smithi098.stdout:0/486: chown df/d17/d68/l9d 6033590 1 2023-01-04T18:16:30.901 INFO:tasks.workunit.client.1.smithi098.stdout:2/480: dread d6/dc/d2b/d46/f86 [0,4194304] 0 2023-01-04T18:16:30.901 INFO:tasks.workunit.client.1.smithi098.stdout:4/430: dwrite d5/d28/d40/f4a [0,4194304] 0 2023-01-04T18:16:30.901 INFO:tasks.workunit.client.1.smithi098.stdout:4/431: write d5/f38 [2358444,29417] 0 2023-01-04T18:16:30.910 INFO:tasks.workunit.client.1.smithi098.stdout:8/430: dwrite d6/dc/d12/d20/f45 [4194304,4194304] 0 2023-01-04T18:16:30.911 INFO:tasks.workunit.client.1.smithi098.stdout:2/481: truncate d6/dc/d2b/d42/d47/d35/f67 1862504 0 2023-01-04T18:16:30.912 INFO:tasks.workunit.client.1.smithi098.stdout:3/531: dwrite d6/d10/d19/d3f/d5e/d7d/d90/f9d [0,4194304] 0 2023-01-04T18:16:30.912 INFO:tasks.workunit.client.1.smithi098.stdout:0/487: fsync f1 0 2023-01-04T18:16:30.912 INFO:tasks.workunit.client.1.smithi098.stdout:0/488: truncate df/d17/d1c/d2c/d41/d4a/d4c/f66 4663723 0 2023-01-04T18:16:30.913 INFO:tasks.workunit.client.1.smithi098.stdout:8/431: truncate d6/dc/f2e 576136 0 2023-01-04T18:16:30.913 INFO:tasks.workunit.client.1.smithi098.stdout:8/432: chown d6/d11/d15/d1b/d2a/d3b/d4c/d54/l5b 77076 1 2023-01-04T18:16:30.916 INFO:tasks.workunit.client.1.smithi098.stdout:5/418: sync 2023-01-04T18:16:30.916 INFO:tasks.workunit.client.1.smithi098.stdout:9/512: sync 2023-01-04T18:16:30.916 INFO:tasks.workunit.client.1.smithi098.stdout:5/419: truncate d1/d2/d14/d19/f79 23175 0 2023-01-04T18:16:30.918 INFO:tasks.workunit.client.1.smithi098.stdout:9/513: read d2/d5/d18/d4e/d42/d89/dac/d26/f37 [1268204,9233] 0 2023-01-04T18:16:30.919 INFO:tasks.workunit.client.1.smithi098.stdout:2/482: rename d6/dc/d2b/d42/d47/d31/f5e to d6/dc/d2b/d42/d51/d81/f9b 0 2023-01-04T18:16:30.924 INFO:tasks.workunit.client.1.smithi098.stdout:0/489: dread df/d17/d9b/f97 [0,4194304] 0 2023-01-04T18:16:30.926 INFO:tasks.workunit.client.1.smithi098.stdout:5/420: symlink d1/da/d44/l7e 0 2023-01-04T18:16:30.926 INFO:tasks.workunit.client.1.smithi098.stdout:5/421: chown d1/f5a 42965 1 2023-01-04T18:16:30.927 INFO:tasks.workunit.client.1.smithi098.stdout:9/514: mkdir d2/d5/d18/d19/d82/db0 0 2023-01-04T18:16:30.932 INFO:tasks.workunit.client.1.smithi098.stdout:8/433: symlink d6/d11/d15/d1b/d2a/d6b/l7c 0 2023-01-04T18:16:30.932 INFO:tasks.workunit.client.1.smithi098.stdout:5/422: unlink d1/d2/c7 0 2023-01-04T18:16:30.932 INFO:tasks.workunit.client.1.smithi098.stdout:8/434: write d6/dc/d12/d1e/d37/f73 [230034,47406] 0 2023-01-04T18:16:30.932 INFO:tasks.workunit.client.1.smithi098.stdout:1/388: sync 2023-01-04T18:16:30.932 INFO:tasks.workunit.client.1.smithi098.stdout:7/429: sync 2023-01-04T18:16:30.932 INFO:tasks.workunit.client.1.smithi098.stdout:6/468: sync 2023-01-04T18:16:30.933 INFO:tasks.workunit.client.1.smithi098.stdout:9/515: creat d2/d5/d18/d1d/fb1 x:0 0 0 2023-01-04T18:16:30.933 INFO:tasks.workunit.client.1.smithi098.stdout:9/516: readlink d2/d5/d18/d1d/d23/dad/d72/l8e 0 2023-01-04T18:16:30.933 INFO:tasks.workunit.client.1.smithi098.stdout:3/532: dwrite d6/d10/d19/f63 [0,4194304] 0 2023-01-04T18:16:30.934 INFO:tasks.workunit.client.1.smithi098.stdout:2/483: symlink d6/l9c 0 2023-01-04T18:16:30.935 INFO:tasks.workunit.client.1.smithi098.stdout:5/423: rmdir d1/d2f/d73 39 2023-01-04T18:16:30.935 INFO:tasks.workunit.client.1.smithi098.stdout:2/484: write d6/f8 [3703933,106920] 0 2023-01-04T18:16:30.935 INFO:tasks.workunit.client.1.smithi098.stdout:5/424: write d1/d2/d14/d19/f35 [1256218,117843] 0 2023-01-04T18:16:30.935 INFO:tasks.workunit.client.1.smithi098.stdout:8/435: rmdir d6/dc/d12/d39 39 2023-01-04T18:16:30.938 INFO:tasks.workunit.client.1.smithi098.stdout:7/430: unlink d1/f80 0 2023-01-04T18:16:30.939 INFO:tasks.workunit.client.1.smithi098.stdout:1/389: mkdir d1/d25/d36/d89 0 2023-01-04T18:16:30.940 INFO:tasks.workunit.client.1.smithi098.stdout:8/436: dread d6/dc/d12/d1e/d37/f3a [0,4194304] 0 2023-01-04T18:16:30.941 INFO:tasks.workunit.client.1.smithi098.stdout:9/517: rmdir d2/d5/d18/d19/d82/db0 0 2023-01-04T18:16:30.942 INFO:tasks.workunit.client.1.smithi098.stdout:9/518: read d2/d5/d18/d1d/f2f [1416008,64095] 0 2023-01-04T18:16:30.943 INFO:tasks.workunit.client.1.smithi098.stdout:8/437: dread d6/d11/d15/f1d [0,4194304] 0 2023-01-04T18:16:30.945 INFO:tasks.workunit.client.1.smithi098.stdout:3/533: symlink d6/d56/d9f/da8/lba 0 2023-01-04T18:16:30.946 INFO:tasks.workunit.client.1.smithi098.stdout:2/485: mknod d6/dc/d2b/d42/c9d 0 2023-01-04T18:16:30.947 INFO:tasks.workunit.client.1.smithi098.stdout:5/425: mknod d1/d38/d3b/c7f 0 2023-01-04T18:16:30.948 INFO:tasks.workunit.client.1.smithi098.stdout:7/431: symlink d1/d4/l91 0 2023-01-04T18:16:30.948 INFO:tasks.workunit.client.1.smithi098.stdout:1/390: creat d1/d2e/f8a x:0 0 0 2023-01-04T18:16:30.952 INFO:tasks.workunit.client.1.smithi098.stdout:6/469: dwrite d9/dd/d4e/f8b [0,4194304] 0 2023-01-04T18:16:30.952 INFO:tasks.workunit.client.1.smithi098.stdout:9/519: mknod d2/d5/d18/d1d/cb2 0 2023-01-04T18:16:30.952 INFO:tasks.workunit.client.1.smithi098.stdout:9/520: dread - d2/d5/d18/d1d/fb1 zero size 2023-01-04T18:16:30.953 INFO:tasks.workunit.client.1.smithi098.stdout:9/521: chown d2/d5/d18/d4e/d42/l80 100 1 2023-01-04T18:16:30.953 INFO:tasks.workunit.client.1.smithi098.stdout:8/438: getdents d6/dc/d5a 0 2023-01-04T18:16:30.954 INFO:tasks.workunit.client.1.smithi098.stdout:0/490: dwrite df/d17/d24/f25 [0,4194304] 0 2023-01-04T18:16:30.954 INFO:tasks.workunit.client.1.smithi098.stdout:3/534: unlink l0 0 2023-01-04T18:16:30.955 INFO:tasks.workunit.client.1.smithi098.stdout:2/486: symlink d6/dc/d2b/d46/l9e 0 2023-01-04T18:16:30.955 INFO:tasks.workunit.client.1.smithi098.stdout:1/391: mknod d1/d25/d36/d89/c8b 0 2023-01-04T18:16:30.958 INFO:tasks.workunit.client.1.smithi098.stdout:6/470: symlink d9/dd/de/d44/d7a/l91 0 2023-01-04T18:16:30.958 INFO:tasks.workunit.client.1.smithi098.stdout:6/471: chown d9/dd/c40 502591 1 2023-01-04T18:16:30.959 INFO:tasks.workunit.client.1.smithi098.stdout:8/439: mknod d6/d11/d15/d70/c7d 0 2023-01-04T18:16:30.959 INFO:tasks.workunit.client.1.smithi098.stdout:6/472: stat d9/dd/de/d44/c66 0 2023-01-04T18:16:30.959 INFO:tasks.workunit.client.1.smithi098.stdout:6/473: truncate d9/dd/de/d44/f5e 554102 0 2023-01-04T18:16:30.959 INFO:tasks.workunit.client.1.smithi098.stdout:8/440: dread - d6/d11/d15/d1b/d2a/d3b/d4c/d54/f57 zero size 2023-01-04T18:16:30.961 INFO:tasks.workunit.client.1.smithi098.stdout:0/491: truncate df/d17/f1d 922798 0 2023-01-04T18:16:30.961 INFO:tasks.workunit.client.1.smithi098.stdout:3/535: creat d6/d10/dad/fbb x:0 0 0 2023-01-04T18:16:30.962 INFO:tasks.workunit.client.1.smithi098.stdout:2/487: symlink d6/dc/d4b/l9f 0 2023-01-04T18:16:30.962 INFO:tasks.workunit.client.1.smithi098.stdout:5/426: dread d1/d38/f69 [0,4194304] 0 2023-01-04T18:16:30.962 INFO:tasks.workunit.client.1.smithi098.stdout:6/474: creat d9/dd/d4e/f92 x:0 0 0 2023-01-04T18:16:30.964 INFO:tasks.workunit.client.1.smithi098.stdout:7/432: dwrite d1/d51/f89 [0,4194304] 0 2023-01-04T18:16:30.965 INFO:tasks.workunit.client.1.smithi098.stdout:0/492: dread f3 [0,4194304] 0 2023-01-04T18:16:30.965 INFO:tasks.workunit.client.1.smithi098.stdout:8/441: creat d6/d11/d15/d1b/d2a/d3b/f7e x:0 0 0 2023-01-04T18:16:30.965 INFO:tasks.workunit.client.1.smithi098.stdout:8/442: write d6/d11/d15/f1d [383909,87486] 0 2023-01-04T18:16:30.966 INFO:tasks.workunit.client.1.smithi098.stdout:8/443: fdatasync d6/d11/d15/d1b/d2a/d3b/d4c/d54/f57 0 2023-01-04T18:16:30.966 INFO:tasks.workunit.client.1.smithi098.stdout:8/444: chown d6/dc/d12/f41 9190 1 2023-01-04T18:16:30.966 INFO:tasks.workunit.client.1.smithi098.stdout:3/536: link d6/d10/d29/l2b d6/d6f/db6/lbc 0 2023-01-04T18:16:30.967 INFO:tasks.workunit.client.1.smithi098.stdout:2/488: mknod d6/dc/d2b/d42/d47/d1f/d82/ca0 0 2023-01-04T18:16:30.968 INFO:tasks.workunit.client.1.smithi098.stdout:2/489: readlink d6/dc/l21 0 2023-01-04T18:16:30.968 INFO:tasks.workunit.client.1.smithi098.stdout:2/490: getdents d6/dc/d2b/d42/d47/d31/d90 0 2023-01-04T18:16:30.968 INFO:tasks.workunit.client.1.smithi098.stdout:5/427: rmdir d1/d2f/d73 39 2023-01-04T18:16:30.968 INFO:tasks.workunit.client.1.smithi098.stdout:5/428: truncate d1/d2f/f64 985329 0 2023-01-04T18:16:30.969 INFO:tasks.workunit.client.1.smithi098.stdout:6/475: creat d9/dd/de/d7e/f93 x:0 0 0 2023-01-04T18:16:30.970 INFO:tasks.workunit.client.1.smithi098.stdout:3/537: write d6/d10/d6b/f7c [880735,114874] 0 2023-01-04T18:16:30.970 INFO:tasks.workunit.client.1.smithi098.stdout:3/538: fdatasync d6/d10/d19/d3f/d46/fab 0 2023-01-04T18:16:30.971 INFO:tasks.workunit.client.1.smithi098.stdout:7/433: symlink d1/d4/d11/d5d/l92 0 2023-01-04T18:16:30.972 INFO:tasks.workunit.client.1.smithi098.stdout:9/522: dwrite d2/d5/d18/d1d/f71 [0,4194304] 0 2023-01-04T18:16:30.972 INFO:tasks.workunit.client.1.smithi098.stdout:9/523: fdatasync d2/f2b 0 2023-01-04T18:16:30.973 INFO:tasks.workunit.client.1.smithi098.stdout:0/493: rmdir df/d17/d24/d80 39 2023-01-04T18:16:30.974 INFO:tasks.workunit.client.1.smithi098.stdout:0/494: write df/d17/d9b/f97 [329403,19284] 0 2023-01-04T18:16:30.977 INFO:tasks.workunit.client.1.smithi098.stdout:2/491: mknod d6/dc/d2b/ca1 0 2023-01-04T18:16:30.977 INFO:tasks.workunit.client.1.smithi098.stdout:2/492: chown d6/f15 591090390 1 2023-01-04T18:16:30.984 INFO:tasks.workunit.client.1.smithi098.stdout:1/392: dwrite d1/d25/d36/f40 [0,4194304] 0 2023-01-04T18:16:30.984 INFO:tasks.workunit.client.1.smithi098.stdout:1/393: write d1/d25/d27/d77/d54/f5a [1268323,94799] 0 2023-01-04T18:16:30.987 INFO:tasks.workunit.client.1.smithi098.stdout:5/429: mkdir d1/da/d44/d80 0 2023-01-04T18:16:30.989 INFO:tasks.workunit.client.1.smithi098.stdout:6/476: mknod d9/dd/d24/d64/c94 0 2023-01-04T18:16:30.990 INFO:tasks.workunit.client.1.smithi098.stdout:9/524: mkdir d2/d53/daf/db3 0 2023-01-04T18:16:30.991 INFO:tasks.workunit.client.1.smithi098.stdout:0/495: truncate df/d17/d1c/d3b/d98/f69 3710290 0 2023-01-04T18:16:30.994 INFO:tasks.workunit.client.1.smithi098.stdout:8/445: rename d6/dc to d6/d11/d15/d1b/d2a/d6b/d7f 0 2023-01-04T18:16:30.996 INFO:tasks.workunit.client.1.smithi098.stdout:2/493: link d6/dc/d2b/d42/f57 d6/dc/d2b/d32/fa2 0 2023-01-04T18:16:30.997 INFO:tasks.workunit.client.1.smithi098.stdout:2/494: write d6/f20 [701175,128381] 0 2023-01-04T18:16:31.008 INFO:tasks.workunit.client.1.smithi098.stdout:1/394: symlink d1/d25/d36/d4e/d6e/l8c 0 2023-01-04T18:16:31.010 INFO:tasks.workunit.client.1.smithi098.stdout:5/430: mkdir d1/d1e/d81 0 2023-01-04T18:16:31.010 INFO:tasks.workunit.client.1.smithi098.stdout:5/431: dread - d1/d2f/f7a zero size 2023-01-04T18:16:31.012 INFO:tasks.workunit.client.1.smithi098.stdout:4/432: sync 2023-01-04T18:16:31.012 INFO:tasks.workunit.client.1.smithi098.stdout:4/433: fsync d5/de/f88 0 2023-01-04T18:16:31.016 INFO:tasks.workunit.client.1.smithi098.stdout:6/477: link d9/c2f d9/dd/d24/d3e/d86/c95 0 2023-01-04T18:16:31.016 INFO:tasks.workunit.client.1.smithi098.stdout:9/525: creat d2/d5/d18/d1d/d23/d5c/fb4 x:0 0 0 2023-01-04T18:16:31.016 INFO:tasks.workunit.client.1.smithi098.stdout:0/496: mknod df/d17/d24/cb4 0 2023-01-04T18:16:31.017 INFO:tasks.workunit.client.1.smithi098.stdout:8/446: readlink d6/d11/d15/d1b/d2a/d6b/l6d 0 2023-01-04T18:16:31.018 INFO:tasks.workunit.client.1.smithi098.stdout:3/539: rename d6/d10/f40 to d6/d10/d19/d3f/d46/fbd 0 2023-01-04T18:16:31.018 INFO:tasks.workunit.client.1.smithi098.stdout:3/540: stat d6/d56/f99 0 2023-01-04T18:16:31.020 INFO:tasks.workunit.client.1.smithi098.stdout:2/495: mkdir d6/dc/d2b/d42/d51/d79/da3 0 2023-01-04T18:16:31.021 INFO:tasks.workunit.client.1.smithi098.stdout:5/432: link d1/c11 d1/da/d44/c82 0 2023-01-04T18:16:31.021 INFO:tasks.workunit.client.1.smithi098.stdout:5/433: chown d1/d2/d14/d19/f35 835044682 1 2023-01-04T18:16:31.021 INFO:tasks.workunit.client.1.smithi098.stdout:4/434: getdents d5/d9/d13 0 2023-01-04T18:16:31.022 INFO:tasks.workunit.client.1.smithi098.stdout:0/497: mkdir df/d17/d9b/da4/db5 0 2023-01-04T18:16:31.028 INFO:tasks.workunit.client.1.smithi098.stdout:8/447: link d6/d11/d15/d1b/d2a/d6b/d7f/l14 d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/l80 0 2023-01-04T18:16:31.028 INFO:tasks.workunit.client.1.smithi098.stdout:1/395: dwrite d1/d25/d27/d77/f4b [0,4194304] 0 2023-01-04T18:16:31.029 INFO:tasks.workunit.client.1.smithi098.stdout:7/434: rename d1/d4/d11/d5d/f63 to d1/d51/d26/d28/d2d/d6b/f93 0 2023-01-04T18:16:31.029 INFO:tasks.workunit.client.1.smithi098.stdout:1/396: dread - d1/d25/d27/d77/f7c zero size 2023-01-04T18:16:31.029 INFO:tasks.workunit.client.1.smithi098.stdout:1/397: chown d1/d8/da/cb 257627 1 2023-01-04T18:16:31.030 INFO:tasks.workunit.client.1.smithi098.stdout:5/434: mkdir d1/da/d44/d83 0 2023-01-04T18:16:31.031 INFO:tasks.workunit.client.1.smithi098.stdout:4/435: mkdir d5/d9/d90 0 2023-01-04T18:16:31.031 INFO:tasks.workunit.client.1.smithi098.stdout:4/436: chown d5/f47 2 1 2023-01-04T18:16:31.033 INFO:tasks.workunit.client.1.smithi098.stdout:4/437: read d5/d28/d40/f4a [1435624,50725] 0 2023-01-04T18:16:31.034 INFO:tasks.workunit.client.1.smithi098.stdout:8/448: creat d6/d11/d15/d1b/d2a/d6b/d7f/f81 x:0 0 0 2023-01-04T18:16:31.034 INFO:tasks.workunit.client.1.smithi098.stdout:7/435: mkdir d1/d23/d37/d40/d94 0 2023-01-04T18:16:31.035 INFO:tasks.workunit.client.1.smithi098.stdout:1/398: creat d1/d2e/f8d x:0 0 0 2023-01-04T18:16:31.037 INFO:tasks.workunit.client.1.smithi098.stdout:6/478: rename d9/dd/de/c34 to d9/dd/d4e/d67/d8d/d8e/c96 0 2023-01-04T18:16:31.037 INFO:tasks.workunit.client.1.smithi098.stdout:6/479: readlink d9/dd/d15/l90 0 2023-01-04T18:16:31.039 INFO:tasks.workunit.client.1.smithi098.stdout:8/449: getdents d6/d11/d15/d1b/d2a/d3b/d4c/d54 0 2023-01-04T18:16:31.040 INFO:tasks.workunit.client.1.smithi098.stdout:8/450: write d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/f5c [241741,49532] 0 2023-01-04T18:16:31.040 INFO:tasks.workunit.client.1.smithi098.stdout:1/399: getdents d1/d88 0 2023-01-04T18:16:31.040 INFO:tasks.workunit.client.1.smithi098.stdout:1/400: fdatasync d1/f83 0 2023-01-04T18:16:31.042 INFO:tasks.workunit.client.1.smithi098.stdout:9/526: rename d2/d5/d18/d1d/d23/dad/d72/l8e to d2/d5/d18/d4e/d42/d89/dac/d78/lb5 0 2023-01-04T18:16:31.043 INFO:tasks.workunit.client.1.smithi098.stdout:1/401: mkdir d1/d25/d39/d8e 0 2023-01-04T18:16:31.046 INFO:tasks.workunit.client.1.smithi098.stdout:6/480: rename d9/dd/de/f21 to d9/dd/de/d26/f97 0 2023-01-04T18:16:31.049 INFO:tasks.workunit.client.1.smithi098.stdout:6/481: rename d9/dd/d4e/d67/d8d/l8f to d9/dd/d4e/d67/d8d/d8e/l98 0 2023-01-04T18:16:31.049 INFO:tasks.workunit.client.1.smithi098.stdout:7/436: dread d1/d2e/f35 [0,4194304] 0 2023-01-04T18:16:31.049 INFO:tasks.workunit.client.1.smithi098.stdout:7/437: chown d1/d51/d26/d28/d2d 19041 1 2023-01-04T18:16:31.049 INFO:tasks.workunit.client.1.smithi098.stdout:7/438: write d1/d23/d37/d40/f4e [797020,17042] 0 2023-01-04T18:16:31.049 INFO:tasks.workunit.client.1.smithi098.stdout:1/402: truncate d1/d25/d27/d77/f46 3306344 0 2023-01-04T18:16:31.050 INFO:tasks.workunit.client.1.smithi098.stdout:6/482: getdents d9/dd/de/d20/d82/d84 0 2023-01-04T18:16:31.051 INFO:tasks.workunit.client.1.smithi098.stdout:7/439: creat d1/d2e/f95 x:0 0 0 2023-01-04T18:16:31.053 INFO:tasks.workunit.client.1.smithi098.stdout:1/403: rename d1/d25/d27/d77/d54/f5b to d1/d25/d27/d77/f8f 0 2023-01-04T18:16:31.054 INFO:tasks.workunit.client.1.smithi098.stdout:2/496: dwrite d6/dc/d2b/d46/f48 [0,4194304] 0 2023-01-04T18:16:31.060 INFO:tasks.workunit.client.1.smithi098.stdout:0/498: dwrite df/d17/d1c/d2c/d41/d4a/d7a/f88 [0,4194304] 0 2023-01-04T18:16:31.060 INFO:tasks.workunit.client.1.smithi098.stdout:5/435: dwrite d1/d2f/f5f [0,4194304] 0 2023-01-04T18:16:31.060 INFO:tasks.workunit.client.1.smithi098.stdout:5/436: write d1/da/f77 [836229,14990] 0 2023-01-04T18:16:31.061 INFO:tasks.workunit.client.1.smithi098.stdout:4/438: dwrite d5/de/d21/d5e/f87 [0,4194304] 0 2023-01-04T18:16:31.063 INFO:tasks.workunit.client.1.smithi098.stdout:7/440: rename d1/d51/d26/f81 to d1/d51/d26/d28/d2d/d75/f96 0 2023-01-04T18:16:31.063 INFO:tasks.workunit.client.1.smithi098.stdout:1/404: creat d1/d25/d6a/f90 x:0 0 0 2023-01-04T18:16:31.064 INFO:tasks.workunit.client.1.smithi098.stdout:2/497: creat d6/dc/d4b/d89/fa4 x:0 0 0 2023-01-04T18:16:31.068 INFO:tasks.workunit.client.1.smithi098.stdout:3/541: rmdir d6/d10/d19/d3f/d46 39 2023-01-04T18:16:31.075 INFO:tasks.workunit.client.1.smithi098.stdout:9/527: dread d2/d5/d18/d19/f54 [0,4194304] 0 2023-01-04T18:16:31.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:29.913097+0000 mgr.smithi098.vhfzum (mgr.24455) 18 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 882 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 58 MiB/s rd, 105 MiB/s wr, 579 op/s 2023-01-04T18:16:31.081 INFO:tasks.workunit.client.1.smithi098.stdout:0/499: getdents df/d4f/d6e 0 2023-01-04T18:16:31.081 INFO:tasks.workunit.client.1.smithi098.stdout:6/483: dwrite d9/dd/d15/f41 [4194304,4194304] 0 2023-01-04T18:16:31.081 INFO:tasks.workunit.client.1.smithi098.stdout:8/451: dwrite d6/d11/d15/d1b/d2a/d3b/f3c [0,4194304] 0 2023-01-04T18:16:31.081 INFO:tasks.workunit.client.1.smithi098.stdout:6/484: truncate d9/dd/de/d26/f74 861247 0 2023-01-04T18:16:31.081 INFO:tasks.workunit.client.1.smithi098.stdout:8/452: truncate d6/d11/d15/d1b/f62 684215 0 2023-01-04T18:16:31.081 INFO:tasks.workunit.client.1.smithi098.stdout:6/485: write d9/dd/d4e/f4f [4275475,81863] 0 2023-01-04T18:16:31.081 INFO:tasks.workunit.client.1.smithi098.stdout:6/486: chown d9/dd/de/d20/f3f 234 1 2023-01-04T18:16:31.081 INFO:tasks.workunit.client.1.smithi098.stdout:6/487: fdatasync d9/dd/d24/d3e/f46 0 2023-01-04T18:16:31.081 INFO:tasks.workunit.client.1.smithi098.stdout:6/488: chown d9/l3a 38159793 1 2023-01-04T18:16:31.083 INFO:tasks.workunit.client.1.smithi098.stdout:5/437: creat d1/da/d44/f84 x:0 0 0 2023-01-04T18:16:31.088 INFO:tasks.workunit.client.1.smithi098.stdout:4/439: dwrite d5/d28/d44/f78 [0,4194304] 0 2023-01-04T18:16:31.091 INFO:tasks.workunit.client.1.smithi098.stdout:7/441: unlink d1/da/f1e 0 2023-01-04T18:16:31.092 INFO:tasks.workunit.client.1.smithi098.stdout:3/542: mknod d6/d56/d9f/da8/cbe 0 2023-01-04T18:16:31.092 INFO:tasks.workunit.client.1.smithi098.stdout:2/498: dwrite d6/dc/f14 [0,4194304] 0 2023-01-04T18:16:31.094 INFO:tasks.workunit.client.1.smithi098.stdout:9/528: mkdir d2/d5/d18/db6 0 2023-01-04T18:16:31.094 INFO:tasks.workunit.client.1.smithi098.stdout:0/500: read df/d17/d1c/d3b/f58 [64435,79639] 0 2023-01-04T18:16:31.094 INFO:tasks.workunit.client.1.smithi098.stdout:0/501: readlink df/d4f/d6b/l71 0 2023-01-04T18:16:31.094 INFO:tasks.workunit.client.1.smithi098.stdout:2/499: write d6/dc/fe [2638541,107600] 0 2023-01-04T18:16:31.095 INFO:tasks.workunit.client.1.smithi098.stdout:2/500: write f5 [6198134,96226] 0 2023-01-04T18:16:31.096 INFO:tasks.workunit.client.1.smithi098.stdout:0/502: dread df/f52 [0,4194304] 0 2023-01-04T18:16:31.097 INFO:tasks.workunit.client.1.smithi098.stdout:8/453: symlink d6/d11/d15/d1b/d2a/d6b/d7f/d5a/l82 0 2023-01-04T18:16:31.097 INFO:tasks.workunit.client.1.smithi098.stdout:8/454: fsync d6/d11/d15/d1b/f62 0 2023-01-04T18:16:31.098 INFO:tasks.workunit.client.1.smithi098.stdout:0/503: dread df/d17/d1c/d2c/d41/d4a/d4c/d5f/f63 [0,4194304] 0 2023-01-04T18:16:31.102 INFO:tasks.workunit.client.1.smithi098.stdout:7/442: dread d1/d23/d37/d40/f4e [0,4194304] 0 2023-01-04T18:16:31.102 INFO:tasks.workunit.client.1.smithi098.stdout:6/489: truncate d9/dd/d4e/f58 3832686 0 2023-01-04T18:16:31.102 INFO:tasks.workunit.client.1.smithi098.stdout:5/438: symlink d1/d38/d3b/l85 0 2023-01-04T18:16:31.102 INFO:tasks.workunit.client.1.smithi098.stdout:0/504: write df/d4f/f7d [1554456,131012] 0 2023-01-04T18:16:31.102 INFO:tasks.workunit.client.1.smithi098.stdout:0/505: truncate df/d17/d9b/d5c/fa7 168426 0 2023-01-04T18:16:31.106 INFO:tasks.workunit.client.1.smithi098.stdout:1/405: link d1/d2e/f8d d1/d8/da/f91 0 2023-01-04T18:16:31.106 INFO:tasks.workunit.client.1.smithi098.stdout:5/439: dread d1/d1e/f74 [0,4194304] 0 2023-01-04T18:16:31.109 INFO:tasks.workunit.client.1.smithi098.stdout:7/443: write d1/d51/f89 [2678251,45175] 0 2023-01-04T18:16:31.111 INFO:tasks.workunit.client.1.smithi098.stdout:5/440: write d1/da/f33 [978538,11630] 0 2023-01-04T18:16:31.112 INFO:tasks.workunit.client.1.smithi098.stdout:9/529: dwrite d2/d5/d18/d1d/f2f [4194304,4194304] 0 2023-01-04T18:16:31.113 INFO:tasks.workunit.client.1.smithi098.stdout:7/444: write d1/d23/d21/f4f [7313200,66904] 0 2023-01-04T18:16:31.127 INFO:tasks.workunit.client.1.smithi098.stdout:0/506: dwrite df/d17/d1c/d2c/d41/d64/f9f [0,4194304] 0 2023-01-04T18:16:31.150 INFO:tasks.workunit.client.1.smithi098.stdout:6/490: dwrite d9/dd/de/d26/f62 [0,4194304] 0 2023-01-04T18:16:31.158 INFO:tasks.workunit.client.1.smithi098.stdout:6/491: chown d9/dd/d24/d65/c73 208577 1 2023-01-04T18:16:31.158 INFO:tasks.workunit.client.1.smithi098.stdout:6/492: chown d9/dd/de/d26 225478513 1 2023-01-04T18:16:31.159 INFO:tasks.workunit.client.1.smithi098.stdout:7/445: dwrite d1/d23/d21/f77 [0,4194304] 0 2023-01-04T18:16:31.159 INFO:tasks.workunit.client.1.smithi098.stdout:7/446: chown d1/da/c41 61707153 1 2023-01-04T18:16:31.159 INFO:tasks.workunit.client.1.smithi098.stdout:6/493: dread d9/dd/de/d20/f5d [0,4194304] 0 2023-01-04T18:16:31.159 INFO:tasks.workunit.client.1.smithi098.stdout:6/494: stat d9/dd/de/d26 0 2023-01-04T18:16:31.169 INFO:tasks.workunit.client.1.smithi098.stdout:1/406: link d1/d25/d27/c35 d1/d25/d36/c92 0 2023-01-04T18:16:31.172 INFO:tasks.workunit.client.1.smithi098.stdout:3/543: rename d6/d10/d19/f63 to d6/d10/fbf 0 2023-01-04T18:16:31.172 INFO:tasks.workunit.client.1.smithi098.stdout:3/544: chown d6/d10/dad 8084957 1 2023-01-04T18:16:31.172 INFO:tasks.workunit.client.1.smithi098.stdout:2/501: mkdir d6/dc/d2b/d42/d47/da5 0 2023-01-04T18:16:31.172 INFO:tasks.workunit.client.1.smithi098.stdout:2/502: write d6/dc/d2b/d42/f71 [219029,111626] 0 2023-01-04T18:16:31.173 INFO:tasks.workunit.client.1.smithi098.stdout:5/441: creat d1/da/d44/d45/d4b/d61/f86 x:0 0 0 2023-01-04T18:16:31.173 INFO:tasks.workunit.client.1.smithi098.stdout:7/447: dwrite d1/f45 [4194304,4194304] 0 2023-01-04T18:16:31.174 INFO:tasks.workunit.client.1.smithi098.stdout:2/503: write d6/dc/d4b/d89/f8e [242891,36160] 0 2023-01-04T18:16:31.174 INFO:tasks.workunit.client.1.smithi098.stdout:2/504: read - d6/dc/d2b/d42/d47/d1f/f8b zero size 2023-01-04T18:16:31.174 INFO:tasks.workunit.client.1.smithi098.stdout:9/530: symlink d2/d5/d18/d4e/lb7 0 2023-01-04T18:16:31.178 INFO:tasks.workunit.client.1.smithi098.stdout:2/505: write d6/f2f [2633140,57916] 0 2023-01-04T18:16:31.178 INFO:tasks.workunit.client.1.smithi098.stdout:2/506: chown d6/dc/d2b/d46/l9e 22661 1 2023-01-04T18:16:31.178 INFO:tasks.workunit.client.1.smithi098.stdout:5/442: dread d1/f48 [0,4194304] 0 2023-01-04T18:16:31.178 INFO:tasks.workunit.client.1.smithi098.stdout:5/443: chown d1/da/d44 7 1 2023-01-04T18:16:31.178 INFO:tasks.workunit.client.1.smithi098.stdout:5/444: fdatasync d1/f5a 0 2023-01-04T18:16:31.178 INFO:tasks.workunit.client.1.smithi098.stdout:5/445: read d1/d46/f49 [327677,64282] 0 2023-01-04T18:16:31.179 INFO:tasks.workunit.client.1.smithi098.stdout:5/446: chown d1/d1e/c28 10 1 2023-01-04T18:16:31.179 INFO:tasks.workunit.client.1.smithi098.stdout:5/447: readlink d1/da/d44/d45/d4b/l60 0 2023-01-04T18:16:31.179 INFO:tasks.workunit.client.1.smithi098.stdout:5/448: stat d1/c6c 0 2023-01-04T18:16:31.182 INFO:tasks.workunit.client.1.smithi098.stdout:7/448: dread d1/d51/d26/f30 [0,4194304] 0 2023-01-04T18:16:31.185 INFO:tasks.workunit.client.1.smithi098.stdout:6/495: truncate d9/dd/d4e/d67/d8d/f27 3536243 0 2023-01-04T18:16:31.185 INFO:tasks.workunit.client.1.smithi098.stdout:6/496: truncate d9/dd/d24/f30 1005067 0 2023-01-04T18:16:31.186 INFO:tasks.workunit.client.1.smithi098.stdout:1/407: dwrite d1/d25/d27/d77/f46 [0,4194304] 0 2023-01-04T18:16:31.187 INFO:tasks.workunit.client.1.smithi098.stdout:8/455: rename d6/d11/d15/d1b/d2a/d6b/d7f/l14 to d6/d11/d15/d1b/d2a/d6b/d7f/d78/l83 0 2023-01-04T18:16:31.187 INFO:tasks.workunit.client.1.smithi098.stdout:8/456: write d6/d11/d15/d1b/d2a/d6b/f7b [778188,103689] 0 2023-01-04T18:16:31.194 INFO:tasks.workunit.client.1.smithi098.stdout:9/531: symlink d2/d5/d6f/lb8 0 2023-01-04T18:16:31.196 INFO:tasks.workunit.client.1.smithi098.stdout:2/507: readlink d6/dc/d2b/d42/d47/l34 0 2023-01-04T18:16:31.197 INFO:tasks.workunit.client.1.smithi098.stdout:0/507: dread df/d17/d9b/d5c/f96 [0,4194304] 0 2023-01-04T18:16:31.198 INFO:tasks.workunit.client.1.smithi098.stdout:4/440: sync 2023-01-04T18:16:31.199 INFO:tasks.workunit.client.1.smithi098.stdout:7/449: creat d1/d23/d73/f97 x:0 0 0 2023-01-04T18:16:31.200 INFO:tasks.workunit.client.1.smithi098.stdout:7/450: chown d1/d4/d11/c15 11 1 2023-01-04T18:16:31.202 INFO:tasks.workunit.client.1.smithi098.stdout:6/497: unlink d9/dd/de/d44/c70 0 2023-01-04T18:16:31.203 INFO:tasks.workunit.client.1.smithi098.stdout:6/498: truncate d9/dd/d4e/f92 714507 0 2023-01-04T18:16:31.203 INFO:tasks.workunit.client.1.smithi098.stdout:6/499: chown d9/dd/de/d20/l6b 116 1 2023-01-04T18:16:31.203 INFO:tasks.workunit.client.1.smithi098.stdout:6/500: fdatasync d9/dd/d4e/d67/d8d/f27 0 2023-01-04T18:16:31.204 INFO:tasks.workunit.client.1.smithi098.stdout:5/449: rename d1/da/d44/d45/d4b/c5d to d1/da/d44/d83/c87 0 2023-01-04T18:16:31.204 INFO:tasks.workunit.client.1.smithi098.stdout:5/450: fdatasync d1/f5a 0 2023-01-04T18:16:31.204 INFO:tasks.workunit.client.1.smithi098.stdout:5/451: dread - d1/da/f2b zero size 2023-01-04T18:16:31.205 INFO:tasks.workunit.client.1.smithi098.stdout:3/545: truncate d6/d10/d19/f8c 2147775 0 2023-01-04T18:16:31.206 INFO:tasks.workunit.client.1.smithi098.stdout:0/508: mkdir df/d4f/d6b/d89/db6 0 2023-01-04T18:16:31.207 INFO:tasks.workunit.client.1.smithi098.stdout:6/501: unlink d9/c53 0 2023-01-04T18:16:31.210 INFO:tasks.workunit.client.1.smithi098.stdout:2/508: rename d6/dc/d2b/d42/d51/d81/f9b to d6/dc/d2b/d42/d47/d1f/d39/fa6 0 2023-01-04T18:16:31.213 INFO:tasks.workunit.client.1.smithi098.stdout:3/546: mkdir d6/d10/dc0 0 2023-01-04T18:16:31.214 INFO:tasks.workunit.client.1.smithi098.stdout:3/547: write d6/d10/d19/d3f/f6d [710906,24017] 0 2023-01-04T18:16:31.214 INFO:tasks.workunit.client.1.smithi098.stdout:3/548: write d6/d56/f92 [562280,89132] 0 2023-01-04T18:16:31.214 INFO:tasks.workunit.client.1.smithi098.stdout:9/532: dread d2/d5/f24 [0,4194304] 0 2023-01-04T18:16:31.215 INFO:tasks.workunit.client.1.smithi098.stdout:6/502: mkdir d9/dd/d24/d3e/d99 0 2023-01-04T18:16:31.217 INFO:tasks.workunit.client.1.smithi098.stdout:1/408: dwrite d1/d25/f59 [0,4194304] 0 2023-01-04T18:16:31.217 INFO:tasks.workunit.client.1.smithi098.stdout:1/409: write d1/d25/d27/d77/f2b [9273076,23923] 0 2023-01-04T18:16:31.217 INFO:tasks.workunit.client.1.smithi098.stdout:2/509: symlink d6/dc/d2b/d42/d51/d81/la7 0 2023-01-04T18:16:31.217 INFO:tasks.workunit.client.1.smithi098.stdout:2/510: chown d6/c6d 158609731 1 2023-01-04T18:16:31.217 INFO:tasks.workunit.client.1.smithi098.stdout:3/549: getdents d6/d6f 0 2023-01-04T18:16:31.217 INFO:tasks.workunit.client.1.smithi098.stdout:6/503: write d9/dd/de/d20/f3f [994,15368] 0 2023-01-04T18:16:31.218 INFO:tasks.workunit.client.1.smithi098.stdout:5/452: dread d1/d1e/f68 [0,4194304] 0 2023-01-04T18:16:31.219 INFO:tasks.workunit.client.1.smithi098.stdout:9/533: symlink d2/d5/d18/d1d/d23/lb9 0 2023-01-04T18:16:31.220 INFO:tasks.workunit.client.1.smithi098.stdout:9/534: readlink d2/d5/d18/d4e/d42/d89/dac/d26/l3c 0 2023-01-04T18:16:31.221 INFO:tasks.workunit.client.1.smithi098.stdout:0/509: dread df/d17/f4b [0,4194304] 0 2023-01-04T18:16:31.221 INFO:tasks.workunit.client.1.smithi098.stdout:0/510: chown df/d17/d1c/d3b/c67 6 1 2023-01-04T18:16:31.222 INFO:tasks.workunit.client.1.smithi098.stdout:6/504: write d9/fa [2887188,130012] 0 2023-01-04T18:16:31.224 INFO:tasks.workunit.client.1.smithi098.stdout:4/441: dwrite d5/d9/f7e [0,4194304] 0 2023-01-04T18:16:31.225 INFO:tasks.workunit.client.1.smithi098.stdout:5/453: mknod d1/d2f/c88 0 2023-01-04T18:16:31.227 INFO:tasks.workunit.client.1.smithi098.stdout:1/410: dread d1/d25/d27/d77/f46 [0,4194304] 0 2023-01-04T18:16:31.227 INFO:tasks.workunit.client.1.smithi098.stdout:8/457: dwrite d6/d11/f1a [0,4194304] 0 2023-01-04T18:16:31.228 INFO:tasks.workunit.client.1.smithi098.stdout:8/458: dread d6/d11/d15/f1d [0,4194304] 0 2023-01-04T18:16:31.232 INFO:tasks.workunit.client.1.smithi098.stdout:9/535: dread d2/d5/d18/d4e/d42/d89/dac/d26/f4a [0,4194304] 0 2023-01-04T18:16:31.237 INFO:tasks.workunit.client.1.smithi098.stdout:2/511: rename d6/f7 to d6/dc/d2b/d42/d47/d31/fa8 0 2023-01-04T18:16:31.238 INFO:tasks.workunit.client.1.smithi098.stdout:0/511: mknod df/d4f/d6b/d89/db6/cb7 0 2023-01-04T18:16:31.241 INFO:tasks.workunit.client.1.smithi098.stdout:6/505: dwrite d9/dd/d4e/d67/d8d/f27 [4194304,4194304] 0 2023-01-04T18:16:31.241 INFO:tasks.workunit.client.1.smithi098.stdout:6/506: getdents d9/dd/d24 0 2023-01-04T18:16:31.244 INFO:tasks.workunit.client.1.smithi098.stdout:1/411: creat d1/d25/d6a/f93 x:0 0 0 2023-01-04T18:16:31.245 INFO:tasks.workunit.client.1.smithi098.stdout:8/459: rmdir d6/d11/d15/d1b/d2a/d3b 39 2023-01-04T18:16:31.246 INFO:tasks.workunit.client.1.smithi098.stdout:2/512: dread d6/dc/d2b/d42/d47/d35/f55 [0,4194304] 0 2023-01-04T18:16:31.247 INFO:tasks.workunit.client.1.smithi098.stdout:9/536: symlink d2/d5/d18/d1d/d23/d5c/lba 0 2023-01-04T18:16:31.248 INFO:tasks.workunit.client.1.smithi098.stdout:9/537: write d2/d5/d18/d4e/d42/d89/dac/d26/f9a [1952421,129534] 0 2023-01-04T18:16:31.249 INFO:tasks.workunit.client.1.smithi098.stdout:9/538: write d2/d2d/f8d [1704174,84402] 0 2023-01-04T18:16:31.249 INFO:tasks.workunit.client.1.smithi098.stdout:9/539: chown d2/d5/d18/d1d/d23/f8c 2230 1 2023-01-04T18:16:31.249 INFO:tasks.workunit.client.1.smithi098.stdout:0/512: getdents df/d4f/d6b/d89 0 2023-01-04T18:16:31.251 INFO:tasks.workunit.client.1.smithi098.stdout:6/507: mknod d9/dd/de/d20/d82/d84/d8a/c9a 0 2023-01-04T18:16:31.251 INFO:tasks.workunit.client.1.smithi098.stdout:6/508: write d9/dd/d15/f5f [4933934,10539] 0 2023-01-04T18:16:31.251 INFO:tasks.workunit.client.1.smithi098.stdout:6/509: chown d9/dd/c23 75473 1 2023-01-04T18:16:31.252 INFO:tasks.workunit.client.1.smithi098.stdout:5/454: dread d1/d2/d14/d19/f79 [0,4194304] 0 2023-01-04T18:16:31.252 INFO:tasks.workunit.client.1.smithi098.stdout:8/460: mkdir d6/d11/d15/d1b/d2a/d3b/d4c/d54/d6a/d84 0 2023-01-04T18:16:31.254 INFO:tasks.workunit.client.1.smithi098.stdout:2/513: rmdir d6/dc/d2b/d42/d47/d1f/d39 39 2023-01-04T18:16:31.255 INFO:tasks.workunit.client.1.smithi098.stdout:3/550: rename d6/d10/d19/l35 to d6/d56/d9f/lc1 0 2023-01-04T18:16:31.255 INFO:tasks.workunit.client.1.smithi098.stdout:3/551: write d6/f44 [776998,19360] 0 2023-01-04T18:16:31.256 INFO:tasks.workunit.client.1.smithi098.stdout:9/540: write d2/d5/d18/d4e/d42/d89/dac/d26/d41/f6a [1184712,81568] 0 2023-01-04T18:16:31.257 INFO:tasks.workunit.client.1.smithi098.stdout:0/513: truncate f5 2945351 0 2023-01-04T18:16:31.259 INFO:tasks.workunit.client.1.smithi098.stdout:6/510: mkdir d9/dd/d24/d3e/d86/d9b 0 2023-01-04T18:16:31.259 INFO:tasks.workunit.client.1.smithi098.stdout:6/511: write d9/dd/f42 [2857501,115013] 0 2023-01-04T18:16:31.260 INFO:tasks.workunit.client.1.smithi098.stdout:5/455: symlink d1/d38/l89 0 2023-01-04T18:16:31.261 INFO:tasks.workunit.client.1.smithi098.stdout:2/514: mknod d6/dc/d2b/ca9 0 2023-01-04T18:16:31.263 INFO:tasks.workunit.client.1.smithi098.stdout:4/442: rename d5/c6 to d5/de/d21/d5e/c91 0 2023-01-04T18:16:31.263 INFO:tasks.workunit.client.1.smithi098.stdout:3/552: dread d6/d10/f8b [0,4194304] 0 2023-01-04T18:16:31.263 INFO:tasks.workunit.client.1.smithi098.stdout:9/541: mkdir d2/d5/d18/d4e/d42/d89/dac/d78/dbb 0 2023-01-04T18:16:31.264 INFO:tasks.workunit.client.1.smithi098.stdout:6/512: rmdir d9/dd/d4e/d67/d8d 39 2023-01-04T18:16:31.267 INFO:tasks.workunit.client.1.smithi098.stdout:5/456: creat d1/d2/d14/d59/f8a x:0 0 0 2023-01-04T18:16:31.267 INFO:tasks.workunit.client.1.smithi098.stdout:5/457: truncate d1/da/d44/f70 1627988 0 2023-01-04T18:16:31.269 INFO:tasks.workunit.client.1.smithi098.stdout:1/412: rename d1/d25/d27/c35 to d1/d8/da/c94 0 2023-01-04T18:16:31.270 INFO:tasks.workunit.client.1.smithi098.stdout:4/443: creat d5/de/d2c/f92 x:0 0 0 2023-01-04T18:16:31.270 INFO:tasks.workunit.client.1.smithi098.stdout:4/444: truncate d5/d28/f51 4485186 0 2023-01-04T18:16:31.271 INFO:tasks.workunit.client.1.smithi098.stdout:8/461: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/f5c [0,4194304] 0 2023-01-04T18:16:31.272 INFO:tasks.workunit.client.1.smithi098.stdout:3/553: creat d6/d56/d9f/da8/fc2 x:0 0 0 2023-01-04T18:16:31.273 INFO:tasks.workunit.client.1.smithi098.stdout:9/542: dread d2/d5/f6 [8388608,4194304] 0 2023-01-04T18:16:31.274 INFO:tasks.workunit.client.1.smithi098.stdout:6/513: unlink d9/dd/de/d20/l39 0 2023-01-04T18:16:31.274 INFO:tasks.workunit.client.1.smithi098.stdout:5/458: stat d1/c11 0 2023-01-04T18:16:31.276 INFO:tasks.workunit.client.1.smithi098.stdout:0/514: rename df/d17/d24/f2e to df/d17/d1c/d3b/d98/fb8 0 2023-01-04T18:16:31.278 INFO:tasks.workunit.client.1.smithi098.stdout:1/413: truncate d1/d8/da/f1a 6031450 0 2023-01-04T18:16:31.280 INFO:tasks.workunit.client.1.smithi098.stdout:4/445: creat d5/f93 x:0 0 0 2023-01-04T18:16:31.285 INFO:tasks.workunit.client.1.smithi098.stdout:8/462: mknod d6/d11/d15/d1b/d2a/c85 0 2023-01-04T18:16:31.287 INFO:tasks.workunit.client.1.smithi098.stdout:3/554: unlink d6/d10/d29/f61 0 2023-01-04T18:16:31.287 INFO:tasks.workunit.client.1.smithi098.stdout:3/555: getdents d6/d10/dc0 0 2023-01-04T18:16:31.289 INFO:tasks.workunit.client.1.smithi098.stdout:6/514: rmdir d9/dd/d24/d3e/d99 0 2023-01-04T18:16:31.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:29.913097+0000 mgr.smithi098.vhfzum (mgr.24455) 18 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 882 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 58 MiB/s rd, 105 MiB/s wr, 579 op/s 2023-01-04T18:16:31.292 INFO:tasks.workunit.client.1.smithi098.stdout:5/459: dwrite d1/d1e/f74 [0,4194304] 0 2023-01-04T18:16:31.292 INFO:tasks.workunit.client.1.smithi098.stdout:0/515: unlink df/d17/d24/d80/c8a 0 2023-01-04T18:16:31.292 INFO:tasks.workunit.client.1.smithi098.stdout:5/460: getdents d1/d1e/d81 0 2023-01-04T18:16:31.293 INFO:tasks.workunit.client.1.smithi098.stdout:1/414: symlink d1/d25/d36/d4e/d6e/l95 0 2023-01-04T18:16:31.293 INFO:tasks.workunit.client.1.smithi098.stdout:1/415: chown d1/d25/d36/c42 161273767 1 2023-01-04T18:16:31.295 INFO:tasks.workunit.client.1.smithi098.stdout:4/446: creat d5/d28/d40/d5d/f94 x:0 0 0 2023-01-04T18:16:31.296 INFO:tasks.workunit.client.1.smithi098.stdout:3/556: mkdir d6/d10/d29/dc3 0 2023-01-04T18:16:31.298 INFO:tasks.workunit.client.1.smithi098.stdout:6/515: creat d9/dd/de/f9c x:0 0 0 2023-01-04T18:16:31.298 INFO:tasks.workunit.client.1.smithi098.stdout:6/516: write d9/dd/d4e/f8b [4576108,45534] 0 2023-01-04T18:16:31.299 INFO:tasks.workunit.client.1.smithi098.stdout:2/515: rename d6/dc/d2b/d42/d47/d1f/d39/c96 to d6/dc/d2b/d42/d47/d31/caa 0 2023-01-04T18:16:31.304 INFO:tasks.workunit.client.1.smithi098.stdout:5/461: dread d1/da/f3f [4194304,4194304] 0 2023-01-04T18:16:31.307 INFO:tasks.workunit.client.1.smithi098.stdout:4/447: creat d5/de/f95 x:0 0 0 2023-01-04T18:16:31.307 INFO:tasks.workunit.client.1.smithi098.stdout:3/557: creat d6/d10/dad/fc4 x:0 0 0 2023-01-04T18:16:31.307 INFO:tasks.workunit.client.1.smithi098.stdout:6/517: creat d9/dd/d24/d3e/f9d x:0 0 0 2023-01-04T18:16:31.307 INFO:tasks.workunit.client.1.smithi098.stdout:6/518: write d9/dd/de/d44/f5e [2584,122437] 22 2023-01-04T18:16:31.308 INFO:tasks.workunit.client.1.smithi098.stdout:9/543: rename d2/d5/d18/d4e/d42/d89/dac/d26/f4a to d2/d5/d18/d4e/d42/d89/dac/d78/fbc 0 2023-01-04T18:16:31.310 INFO:tasks.workunit.client.1.smithi098.stdout:4/448: fdatasync d5/de/d30/f68 0 2023-01-04T18:16:31.313 INFO:tasks.workunit.client.1.smithi098.stdout:8/463: truncate d6/d11/f1a 1142774 0 2023-01-04T18:16:31.315 INFO:tasks.workunit.client.1.smithi098.stdout:4/449: write d5/de/d2c/f3a [31234,57044] 0 2023-01-04T18:16:31.315 INFO:tasks.workunit.client.1.smithi098.stdout:2/516: rename d6/dc/d2b/ca9 to d6/dc/d2b/d42/d51/d79/cab 0 2023-01-04T18:16:31.317 INFO:tasks.workunit.client.1.smithi098.stdout:8/464: symlink d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d64/l86 0 2023-01-04T18:16:31.317 INFO:tasks.workunit.client.1.smithi098.stdout:8/465: chown d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/c4e 23337 1 2023-01-04T18:16:31.319 INFO:tasks.workunit.client.1.smithi098.stdout:4/450: mkdir d5/de/d21/d96 0 2023-01-04T18:16:31.322 INFO:tasks.workunit.client.1.smithi098.stdout:3/558: rename d6/d10/d6b/lb2 to d6/d10/d19/d3f/d5e/d7d/lc5 0 2023-01-04T18:16:31.325 INFO:tasks.workunit.client.1.smithi098.stdout:1/416: dwrite d1/f44 [0,4194304] 0 2023-01-04T18:16:31.325 INFO:tasks.workunit.client.1.smithi098.stdout:0/516: dwrite df/d17/d1c/d3b/d98/f69 [0,4194304] 0 2023-01-04T18:16:31.326 INFO:tasks.workunit.client.1.smithi098.stdout:9/544: dwrite d2/d5/d18/d1d/d23/d5c/fb4 [0,4194304] 0 2023-01-04T18:16:31.328 INFO:tasks.workunit.client.1.smithi098.stdout:2/517: symlink d6/dc/d2b/d42/d47/d35/lac 0 2023-01-04T18:16:31.328 INFO:tasks.workunit.client.1.smithi098.stdout:4/451: creat d5/d28/d40/d5d/f97 x:0 0 0 2023-01-04T18:16:31.328 INFO:tasks.workunit.client.1.smithi098.stdout:3/559: symlink d6/d10/d6b/d9e/lc6 0 2023-01-04T18:16:31.328 INFO:tasks.workunit.client.1.smithi098.stdout:4/452: truncate d5/de/d21/d75/d83/f8f 619117 0 2023-01-04T18:16:31.332 INFO:tasks.workunit.client.1.smithi098.stdout:3/560: write d6/d10/f62 [811096,130397] 0 2023-01-04T18:16:31.332 INFO:tasks.workunit.client.1.smithi098.stdout:3/561: readlink d6/d10/d19/d3f/d5e/d7d/l51 0 2023-01-04T18:16:31.334 INFO:tasks.workunit.client.1.smithi098.stdout:6/519: truncate d9/dd/d15/f5f 1385069 0 2023-01-04T18:16:31.336 INFO:tasks.workunit.client.1.smithi098.stdout:1/417: symlink d1/d8/d53/l96 0 2023-01-04T18:16:31.336 INFO:tasks.workunit.client.1.smithi098.stdout:4/453: dread d5/de/d21/f41 [0,4194304] 0 2023-01-04T18:16:31.336 INFO:tasks.workunit.client.1.smithi098.stdout:1/418: dread - d1/d25/f3c zero size 2023-01-04T18:16:31.336 INFO:tasks.workunit.client.1.smithi098.stdout:4/454: chown d5/de/d2c 100147099 1 2023-01-04T18:16:31.338 INFO:tasks.workunit.client.1.smithi098.stdout:0/517: creat df/d17/d1c/fb9 x:0 0 0 2023-01-04T18:16:31.338 INFO:tasks.workunit.client.1.smithi098.stdout:0/518: write df/d17/d9b/da4/f76 [694751,9565] 0 2023-01-04T18:16:31.338 INFO:tasks.workunit.client.1.smithi098.stdout:0/519: write df/d17/d24/d80/f8f [972752,16176] 0 2023-01-04T18:16:31.341 INFO:tasks.workunit.client.1.smithi098.stdout:9/545: dwrite d2/d5/d18/d4e/d42/d89/dac/d26/d41/f6a [0,4194304] 0 2023-01-04T18:16:31.341 INFO:tasks.workunit.client.1.smithi098.stdout:4/455: dread d5/d9/d13/f2a [0,4194304] 0 2023-01-04T18:16:31.348 INFO:tasks.workunit.client.1.smithi098.stdout:8/466: dwrite d6/d11/d15/d1b/d2a/d3b/f35 [0,4194304] 0 2023-01-04T18:16:31.349 INFO:tasks.workunit.client.1.smithi098.stdout:6/520: dwrite d9/dd/d24/d3e/f60 [0,4194304] 0 2023-01-04T18:16:31.357 INFO:tasks.workunit.client.1.smithi098.stdout:4/456: dread d5/f4d [0,4194304] 0 2023-01-04T18:16:31.357 INFO:tasks.workunit.client.1.smithi098.stdout:4/457: chown d5/d9/c45 4336291 1 2023-01-04T18:16:31.357 INFO:tasks.workunit.client.1.smithi098.stdout:4/458: chown d5/d28/d40/l54 2996 1 2023-01-04T18:16:31.357 INFO:tasks.workunit.client.1.smithi098.stdout:4/459: chown d5/d28/d40/f52 13417464 1 2023-01-04T18:16:31.383 INFO:tasks.workunit.client.1.smithi098.stdout:2/518: creat d6/dc/d2b/fad x:0 0 0 2023-01-04T18:16:31.385 INFO:tasks.workunit.client.1.smithi098.stdout:9/546: dwrite d2/d5/d18/f8f [0,4194304] 0 2023-01-04T18:16:31.387 INFO:tasks.workunit.client.1.smithi098.stdout:0/520: dwrite df/d17/d9b/da4/f76 [0,4194304] 0 2023-01-04T18:16:31.387 INFO:tasks.workunit.client.1.smithi098.stdout:0/521: chown df/d17/d24/c2b 73 1 2023-01-04T18:16:31.395 INFO:tasks.workunit.client.1.smithi098.stdout:7/451: sync 2023-01-04T18:16:31.397 INFO:tasks.workunit.client.1.smithi098.stdout:1/419: creat d1/d88/f97 x:0 0 0 2023-01-04T18:16:31.397 INFO:tasks.workunit.client.1.smithi098.stdout:1/420: truncate d1/d2e/f8d 656055 0 2023-01-04T18:16:31.399 INFO:tasks.workunit.client.1.smithi098.stdout:8/467: symlink d6/d11/d15/d1b/d2a/d3b/l87 0 2023-01-04T18:16:31.401 INFO:tasks.workunit.client.1.smithi098.stdout:6/521: symlink d9/dd/d24/d3e/d86/d9b/l9e 0 2023-01-04T18:16:31.402 INFO:tasks.workunit.client.1.smithi098.stdout:4/460: mkdir d5/d9/d13/d65/d98 0 2023-01-04T18:16:31.405 INFO:tasks.workunit.client.1.smithi098.stdout:4/461: write d5/d9/f1a [221971,13686] 0 2023-01-04T18:16:31.405 INFO:tasks.workunit.client.1.smithi098.stdout:2/519: unlink d6/dc/d2b/d42/d47/d1f/f68 0 2023-01-04T18:16:31.406 INFO:tasks.workunit.client.1.smithi098.stdout:9/547: dwrite d2/f8b [0,4194304] 0 2023-01-04T18:16:31.407 INFO:tasks.workunit.client.1.smithi098.stdout:9/548: stat d2/d5/d18/d1d/f2f 0 2023-01-04T18:16:31.407 INFO:tasks.workunit.client.1.smithi098.stdout:1/421: dread d1/d8/f28 [0,4194304] 0 2023-01-04T18:16:31.407 INFO:tasks.workunit.client.1.smithi098.stdout:9/549: write d2/d2d/f8d [1312756,62314] 0 2023-01-04T18:16:31.412 INFO:tasks.workunit.client.1.smithi098.stdout:0/522: unlink df/d17/d1c/d2c/d41/d4a/d4c/l4d 0 2023-01-04T18:16:31.414 INFO:tasks.workunit.client.1.smithi098.stdout:3/562: rename d6/d10/d19/la3 to d6/d56/d9f/lc7 0 2023-01-04T18:16:31.414 INFO:tasks.workunit.client.1.smithi098.stdout:8/468: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/d12/f48 [0,4194304] 0 2023-01-04T18:16:31.416 INFO:tasks.workunit.client.1.smithi098.stdout:4/462: creat d5/de/d21/d75/f99 x:0 0 0 2023-01-04T18:16:31.417 INFO:tasks.workunit.client.1.smithi098.stdout:4/463: chown d5/de/d21/c27 39011913 1 2023-01-04T18:16:31.417 INFO:tasks.workunit.client.1.smithi098.stdout:4/464: chown d5/de/d21/f39 15014555 1 2023-01-04T18:16:31.417 INFO:tasks.workunit.client.1.smithi098.stdout:4/465: fsync d5/d28/d40/f8a 0 2023-01-04T18:16:31.417 INFO:tasks.workunit.client.1.smithi098.stdout:7/452: dwrite d1/d23/d21/f4b [4194304,4194304] 0 2023-01-04T18:16:31.417 INFO:tasks.workunit.client.1.smithi098.stdout:4/466: read d5/de/d2c/f67 [421703,17214] 0 2023-01-04T18:16:31.419 INFO:tasks.workunit.client.1.smithi098.stdout:2/520: creat d6/dc/d2b/d42/d47/d31/d90/fae x:0 0 0 2023-01-04T18:16:31.422 INFO:tasks.workunit.client.1.smithi098.stdout:1/422: creat d1/d25/f98 x:0 0 0 2023-01-04T18:16:31.422 INFO:tasks.workunit.client.1.smithi098.stdout:1/423: readlink d1/d2e/l38 0 2023-01-04T18:16:31.422 INFO:tasks.workunit.client.1.smithi098.stdout:9/550: creat d2/d2d/fbd x:0 0 0 2023-01-04T18:16:31.424 INFO:tasks.workunit.client.1.smithi098.stdout:0/523: dread df/d4f/f7d [0,4194304] 0 2023-01-04T18:16:31.424 INFO:tasks.workunit.client.1.smithi098.stdout:3/563: truncate d6/f25 124385 0 2023-01-04T18:16:31.427 INFO:tasks.workunit.client.1.smithi098.stdout:8/469: dread d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/f5c [0,4194304] 0 2023-01-04T18:16:31.427 INFO:tasks.workunit.client.1.smithi098.stdout:8/470: dread - d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/f6f zero size 2023-01-04T18:16:31.428 INFO:tasks.workunit.client.1.smithi098.stdout:8/471: chown d6/d11/d15/d1b/f62 515919 1 2023-01-04T18:16:31.428 INFO:tasks.workunit.client.1.smithi098.stdout:8/472: fdatasync d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d44/f53 0 2023-01-04T18:16:31.430 INFO:tasks.workunit.client.1.smithi098.stdout:5/462: sync 2023-01-04T18:16:31.430 INFO:tasks.workunit.client.1.smithi098.stdout:5/463: chown d1/d2f 182 1 2023-01-04T18:16:31.430 INFO:tasks.workunit.client.1.smithi098.stdout:5/464: fdatasync d1/da/f33 0 2023-01-04T18:16:31.430 INFO:tasks.workunit.client.1.smithi098.stdout:9/551: dread d2/d2d/f93 [0,4194304] 0 2023-01-04T18:16:31.432 INFO:tasks.workunit.client.1.smithi098.stdout:1/424: dread d1/fc [0,4194304] 0 2023-01-04T18:16:31.438 INFO:tasks.workunit.client.1.smithi098.stdout:6/522: rename d9/dd/de/d20/c28 to d9/dd/d15/c9f 0 2023-01-04T18:16:31.438 INFO:tasks.workunit.client.1.smithi098.stdout:0/524: mkdir df/d17/d1c/d2c/dba 0 2023-01-04T18:16:31.438 INFO:tasks.workunit.client.1.smithi098.stdout:0/525: chown df/d17/d1c/d2c/d41/fae 628 1 2023-01-04T18:16:31.440 INFO:tasks.workunit.client.1.smithi098.stdout:8/473: creat d6/d11/d15/d1b/d2a/d3b/d4c/d54/f88 x:0 0 0 2023-01-04T18:16:31.444 INFO:tasks.workunit.client.1.smithi098.stdout:5/465: mknod d1/da/d44/d83/c8b 0 2023-01-04T18:16:31.445 INFO:tasks.workunit.client.1.smithi098.stdout:3/564: dwrite d6/d10/d19/d3f/d46/d8a/fa2 [0,4194304] 0 2023-01-04T18:16:31.446 INFO:tasks.workunit.client.1.smithi098.stdout:9/552: dwrite d2/d5/d18/d4e/d42/f64 [4194304,4194304] 0 2023-01-04T18:16:31.446 INFO:tasks.workunit.client.1.smithi098.stdout:7/453: rename d1/d2e/f61 to d1/d23/d21/d7f/f98 0 2023-01-04T18:16:31.446 INFO:tasks.workunit.client.1.smithi098.stdout:7/454: chown d1/d23/d73 718 1 2023-01-04T18:16:31.447 INFO:tasks.workunit.client.1.smithi098.stdout:6/523: creat d9/fa0 x:0 0 0 2023-01-04T18:16:31.449 INFO:tasks.workunit.client.1.smithi098.stdout:5/466: dread d1/d38/f69 [0,4194304] 0 2023-01-04T18:16:31.451 INFO:tasks.workunit.client.1.smithi098.stdout:0/526: creat df/d17/d24/fbb x:0 0 0 2023-01-04T18:16:31.451 INFO:tasks.workunit.client.1.smithi098.stdout:0/527: fsync df/d17/d1c/d2c/d41/da0/fa3 0 2023-01-04T18:16:31.452 INFO:tasks.workunit.client.1.smithi098.stdout:8/474: creat d6/d11/d15/d1b/d2a/d3b/d59/d6e/f89 x:0 0 0 2023-01-04T18:16:31.456 INFO:tasks.workunit.client.1.smithi098.stdout:9/553: rmdir d2/d5/d18/d1d/d23/dad/d72/d9d 0 2023-01-04T18:16:31.456 INFO:tasks.workunit.client.1.smithi098.stdout:9/554: chown d2/d5/d18/d1d/d23/d5c/c7b 167033 1 2023-01-04T18:16:31.457 INFO:tasks.workunit.client.1.smithi098.stdout:2/521: rename d6/f78 to d6/dc/d2b/d42/d47/d1f/faf 0 2023-01-04T18:16:31.458 INFO:tasks.workunit.client.1.smithi098.stdout:7/455: creat d1/d23/d21/f99 x:0 0 0 2023-01-04T18:16:31.459 INFO:tasks.workunit.client.1.smithi098.stdout:6/524: mknod d9/dd/de/d20/ca1 0 2023-01-04T18:16:31.460 INFO:tasks.workunit.client.1.smithi098.stdout:5/467: mknod d1/d46/c8c 0 2023-01-04T18:16:31.460 INFO:tasks.workunit.client.1.smithi098.stdout:5/468: write d1/d2/d14/d59/f71 [981926,76219] 0 2023-01-04T18:16:31.461 INFO:tasks.workunit.client.1.smithi098.stdout:0/528: unlink df/d17/d1c/d2c/f5e 0 2023-01-04T18:16:31.462 INFO:tasks.workunit.client.1.smithi098.stdout:0/529: stat df/d17/d1c/d2c/dba 0 2023-01-04T18:16:31.462 INFO:tasks.workunit.client.1.smithi098.stdout:0/530: write df/d17/f54 [4882733,2415] 0 2023-01-04T18:16:31.462 INFO:tasks.workunit.client.1.smithi098.stdout:0/531: fsync df/d17/d1c/f47 0 2023-01-04T18:16:31.462 INFO:tasks.workunit.client.1.smithi098.stdout:9/555: getdents d2/d5/d18/d4e/d42/d89 0 2023-01-04T18:16:31.465 INFO:tasks.workunit.client.1.smithi098.stdout:3/565: dwrite d6/d56/fb8 [0,4194304] 0 2023-01-04T18:16:31.466 INFO:tasks.workunit.client.1.smithi098.stdout:1/425: rename d1/d25/d27/d77/f7c to d1/d25/f99 0 2023-01-04T18:16:31.467 INFO:tasks.workunit.client.1.smithi098.stdout:2/522: creat d6/dc/d2b/d42/d47/d1f/d39/d6e/fb0 x:0 0 0 2023-01-04T18:16:31.469 INFO:tasks.workunit.client.1.smithi098.stdout:7/456: creat d1/d4/d11/f9a x:0 0 0 2023-01-04T18:16:31.469 INFO:tasks.workunit.client.1.smithi098.stdout:7/457: chown d1/d51/d26/d28/c8f 1006669805 1 2023-01-04T18:16:31.470 INFO:tasks.workunit.client.1.smithi098.stdout:8/475: dwrite d6/d11/d15/d1b/d2a/d3b/f38 [4194304,4194304] 0 2023-01-04T18:16:31.471 INFO:tasks.workunit.client.1.smithi098.stdout:5/469: symlink d1/d46/d6a/l8d 0 2023-01-04T18:16:31.472 INFO:tasks.workunit.client.1.smithi098.stdout:8/476: dread d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/f73 [0,4194304] 0 2023-01-04T18:16:31.473 INFO:tasks.workunit.client.1.smithi098.stdout:0/532: link df/d17/d1c/d2c/d41/cb1 df/d4f/d6b/d89/cbc 0 2023-01-04T18:16:31.473 INFO:tasks.workunit.client.1.smithi098.stdout:0/533: chown df/d4f/d6b/d89/db6 409450 1 2023-01-04T18:16:31.474 INFO:tasks.workunit.client.1.smithi098.stdout:9/556: rmdir d2/d5/d18/d4e 39 2023-01-04T18:16:31.479 INFO:tasks.workunit.client.1.smithi098.stdout:5/470: dread d1/d46/d6a/f6d [0,4194304] 0 2023-01-04T18:16:31.479 INFO:tasks.workunit.client.1.smithi098.stdout:3/566: mkdir d6/d56/dc8 0 2023-01-04T18:16:31.480 INFO:tasks.workunit.client.1.smithi098.stdout:6/525: rename d9/dd/d4e/d67/d8d/f27 to d9/dd/de/fa2 0 2023-01-04T18:16:31.482 INFO:tasks.workunit.client.1.smithi098.stdout:9/557: dread d2/f1e [0,4194304] 0 2023-01-04T18:16:31.482 INFO:tasks.workunit.client.1.smithi098.stdout:1/426: getdents d1/d25/d27 0 2023-01-04T18:16:31.483 INFO:tasks.workunit.client.1.smithi098.stdout:2/523: creat d6/dc/d2b/d42/d47/d35/fb1 x:0 0 0 2023-01-04T18:16:31.483 INFO:tasks.workunit.client.1.smithi098.stdout:2/524: write d6/dc/d4b/d89/fa4 [63232,80583] 0 2023-01-04T18:16:31.485 INFO:tasks.workunit.client.1.smithi098.stdout:7/458: link d1/d23/d73/f76 d1/d23/d73/d85/f9b 0 2023-01-04T18:16:31.487 INFO:tasks.workunit.client.1.smithi098.stdout:8/477: mkdir d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/d8a 0 2023-01-04T18:16:31.487 INFO:tasks.workunit.client.1.smithi098.stdout:8/478: write d6/d11/d15/d1b/d2a/d6b/f7b [916574,71261] 0 2023-01-04T18:16:31.488 INFO:tasks.workunit.client.1.smithi098.stdout:7/459: read d1/d23/d21/d43/f70 [891239,68220] 0 2023-01-04T18:16:31.489 INFO:tasks.workunit.client.1.smithi098.stdout:3/567: mknod d6/d6f/db6/cc9 0 2023-01-04T18:16:31.489 INFO:tasks.workunit.client.1.smithi098.stdout:3/568: chown d6/d10/c4f 3301 1 2023-01-04T18:16:31.489 INFO:tasks.workunit.client.1.smithi098.stdout:3/569: fdatasync d6/d56/f99 0 2023-01-04T18:16:31.490 INFO:tasks.workunit.client.1.smithi098.stdout:6/526: symlink d9/dd/d4e/d67/d8d/d8e/la3 0 2023-01-04T18:16:31.490 INFO:tasks.workunit.client.1.smithi098.stdout:6/527: stat d9/dd/d24/d3e/d86/c89 0 2023-01-04T18:16:31.491 INFO:tasks.workunit.client.1.smithi098.stdout:9/558: rename d2/d2d/f50 to d2/d5/d18/d4e/d42/d89/dac/d26/fbe 0 2023-01-04T18:16:31.492 INFO:tasks.workunit.client.1.smithi098.stdout:9/559: stat d2/d5/d18/d4e/d42/d89/dac/d78/f7a 0 2023-01-04T18:16:31.492 INFO:tasks.workunit.client.1.smithi098.stdout:2/525: creat d6/dc/d2b/d42/d51/fb2 x:0 0 0 2023-01-04T18:16:31.493 INFO:tasks.workunit.client.1.smithi098.stdout:8/479: getdents d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e 0 2023-01-04T18:16:31.495 INFO:tasks.workunit.client.1.smithi098.stdout:7/460: creat d1/d4/d11/f9c x:0 0 0 2023-01-04T18:16:31.495 INFO:tasks.workunit.client.1.smithi098.stdout:1/427: dread d1/d25/d27/d77/f8f [0,4194304] 0 2023-01-04T18:16:31.497 INFO:tasks.workunit.client.1.smithi098.stdout:3/570: creat d6/d10/d19/d3f/d46/fca x:0 0 0 2023-01-04T18:16:31.501 INFO:tasks.workunit.client.1.smithi098.stdout:6/528: creat d9/dd/d24/d3e/fa4 x:0 0 0 2023-01-04T18:16:31.504 INFO:tasks.workunit.client.1.smithi098.stdout:9/560: rename d2/d5/c17 to d2/d5/d18/d4e/d42/d89/dac/d78/dbb/cbf 0 2023-01-04T18:16:31.504 INFO:tasks.workunit.client.1.smithi098.stdout:5/471: dwrite d1/da/f34 [4194304,4194304] 0 2023-01-04T18:16:31.506 INFO:tasks.workunit.client.1.smithi098.stdout:2/526: dread d6/dc/d2b/d42/d47/d1f/d39/f65 [0,4194304] 0 2023-01-04T18:16:31.508 INFO:tasks.workunit.client.1.smithi098.stdout:7/461: mkdir d1/d4/d11/d9d 0 2023-01-04T18:16:31.508 INFO:tasks.workunit.client.1.smithi098.stdout:7/462: write d1/d4/d11/f9c [57891,83007] 0 2023-01-04T18:16:31.508 INFO:tasks.workunit.client.1.smithi098.stdout:1/428: creat d1/d25/d36/d4e/d6e/f9a x:0 0 0 2023-01-04T18:16:31.509 INFO:tasks.workunit.client.1.smithi098.stdout:1/429: chown d1/d8/da/cb 4295713 1 2023-01-04T18:16:31.509 INFO:tasks.workunit.client.1.smithi098.stdout:1/430: dread - d1/d2e/f8a zero size 2023-01-04T18:16:31.509 INFO:tasks.workunit.client.1.smithi098.stdout:1/431: read - d1/d2e/f6c zero size 2023-01-04T18:16:31.510 INFO:tasks.workunit.client.1.smithi098.stdout:6/529: unlink d9/dd/d24/d3e/d86/c95 0 2023-01-04T18:16:31.510 INFO:tasks.workunit.client.1.smithi098.stdout:6/530: fdatasync d9/dd/d4e/f58 0 2023-01-04T18:16:31.511 INFO:tasks.workunit.client.1.smithi098.stdout:9/561: mkdir d2/d5/d18/d1d/dc0 0 2023-01-04T18:16:31.514 INFO:tasks.workunit.client.1.smithi098.stdout:5/472: link d1/d46/d6a/l8d d1/d2/d14/l8e 0 2023-01-04T18:16:31.514 INFO:tasks.workunit.client.1.smithi098.stdout:2/527: mknod d6/dc/d2b/d42/d47/da5/cb3 0 2023-01-04T18:16:31.515 INFO:tasks.workunit.client.1.smithi098.stdout:0/534: dwrite df/d17/d1c/d3b/d98/fb8 [0,4194304] 0 2023-01-04T18:16:31.516 INFO:tasks.workunit.client.1.smithi098.stdout:8/480: dread d6/d11/d15/f43 [0,4194304] 0 2023-01-04T18:16:31.518 INFO:tasks.workunit.client.1.smithi098.stdout:7/463: getdents d1/d23/d21/d7f 0 2023-01-04T18:16:31.518 INFO:tasks.workunit.client.1.smithi098.stdout:7/464: truncate d1/d23/d37/d78/f90 920455 0 2023-01-04T18:16:31.518 INFO:tasks.workunit.client.1.smithi098.stdout:6/531: mkdir d9/dd/d4e/d67/d8d/da5 0 2023-01-04T18:16:31.518 INFO:tasks.workunit.client.1.smithi098.stdout:6/532: fsync d9/dd/de/d7e/f93 0 2023-01-04T18:16:31.518 INFO:tasks.workunit.client.1.smithi098.stdout:6/533: getdents d9/dd/d24 0 2023-01-04T18:16:31.519 INFO:tasks.workunit.client.1.smithi098.stdout:8/481: dread d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/f3a [0,4194304] 0 2023-01-04T18:16:31.519 INFO:tasks.workunit.client.1.smithi098.stdout:5/473: mkdir d1/d38/d3b/d8f 0 2023-01-04T18:16:31.520 INFO:tasks.workunit.client.1.smithi098.stdout:5/474: stat d1/da/f33 0 2023-01-04T18:16:31.522 INFO:tasks.workunit.client.1.smithi098.stdout:7/465: creat d1/d23/d21/d43/f9e x:0 0 0 2023-01-04T18:16:31.522 INFO:tasks.workunit.client.1.smithi098.stdout:7/466: stat d1/d51/d26/l57 0 2023-01-04T18:16:31.522 INFO:tasks.workunit.client.1.smithi098.stdout:7/467: dread - d1/d23/d21/d43/f9e zero size 2023-01-04T18:16:31.523 INFO:tasks.workunit.client.1.smithi098.stdout:6/534: link d9/dd/de/f9c d9/dd/de/d44/fa6 0 2023-01-04T18:16:31.524 INFO:tasks.workunit.client.1.smithi098.stdout:0/535: dread df/d17/d1c/d2c/d41/d4a/d4c/d5f/f93 [0,4194304] 0 2023-01-04T18:16:31.524 INFO:tasks.workunit.client.1.smithi098.stdout:5/475: write d1/d2/d14/f27 [185440,63592] 0 2023-01-04T18:16:31.525 INFO:tasks.workunit.client.1.smithi098.stdout:8/482: rmdir d6/d11/d15/d75 0 2023-01-04T18:16:31.528 INFO:tasks.workunit.client.1.smithi098.stdout:7/468: link d1/d23/d21/d43/c5a d1/d4/d11/d5d/c9f 0 2023-01-04T18:16:31.529 INFO:tasks.workunit.client.1.smithi098.stdout:6/535: symlink d9/dd/d24/d3e/d86/d9b/la7 0 2023-01-04T18:16:31.530 INFO:tasks.workunit.client.1.smithi098.stdout:5/476: rmdir d1/d46/d6a 39 2023-01-04T18:16:31.531 INFO:tasks.workunit.client.1.smithi098.stdout:8/483: rmdir d6/d11/d15/d1b/d2a/d6b/d7f/d78 39 2023-01-04T18:16:31.531 INFO:tasks.workunit.client.1.smithi098.stdout:8/484: write d6/d11/d15/d1b/d2a/d3b/f5d [1049290,92140] 0 2023-01-04T18:16:31.532 INFO:tasks.workunit.client.1.smithi098.stdout:7/469: symlink d1/d2e/la0 0 2023-01-04T18:16:31.532 INFO:tasks.workunit.client.1.smithi098.stdout:7/470: write d1/d51/f19 [5601374,127955] 0 2023-01-04T18:16:31.539 INFO:tasks.workunit.client.1.smithi098.stdout:6/536: creat d9/dd/d24/d3e/d86/fa8 x:0 0 0 2023-01-04T18:16:31.539 INFO:tasks.workunit.client.1.smithi098.stdout:8/485: mkdir d6/d11/d15/d1b/d2a/d3b/d59/d6e/d8b 0 2023-01-04T18:16:31.547 INFO:tasks.workunit.client.1.smithi098.stdout:7/471: write d1/d4/f29 [3365922,104967] 0 2023-01-04T18:16:31.547 INFO:tasks.workunit.client.1.smithi098.stdout:7/472: fsync d1/da/f82 0 2023-01-04T18:16:31.556 INFO:tasks.workunit.client.1.smithi098.stdout:9/562: dwrite d2/d5/f77 [0,4194304] 0 2023-01-04T18:16:31.557 INFO:tasks.workunit.client.1.smithi098.stdout:9/563: truncate d2/d5/d18/d19/d82/f84 508991 0 2023-01-04T18:16:31.557 INFO:tasks.workunit.client.1.smithi098.stdout:0/536: dwrite df/d17/d1c/d3b/d98/f6a [0,4194304] 0 2023-01-04T18:16:31.557 INFO:tasks.workunit.client.1.smithi098.stdout:0/537: fdatasync df/d4f/d6e/f87 0 2023-01-04T18:16:31.557 INFO:tasks.workunit.client.1.smithi098.stdout:3/571: dwrite d6/f15 [0,4194304] 0 2023-01-04T18:16:31.558 INFO:tasks.workunit.client.1.smithi098.stdout:9/564: write d2/d5/f6 [6774535,96146] 0 2023-01-04T18:16:31.558 INFO:tasks.workunit.client.1.smithi098.stdout:0/538: dread df/d17/d1c/d3b/d98/f81 [0,4194304] 0 2023-01-04T18:16:31.558 INFO:tasks.workunit.client.1.smithi098.stdout:0/539: fdatasync df/d17/d24/fbb 0 2023-01-04T18:16:31.559 INFO:tasks.workunit.client.1.smithi098.stdout:5/477: dwrite d1/da/f37 [0,4194304] 0 2023-01-04T18:16:31.567 INFO:tasks.workunit.client.1.smithi098.stdout:8/486: dwrite d6/d11/d15/d1b/d2a/d3b/f38 [0,4194304] 0 2023-01-04T18:16:31.567 INFO:tasks.workunit.client.1.smithi098.stdout:8/487: dread - d6/d11/d15/d1b/d2a/d3b/d4c/d54/f57 zero size 2023-01-04T18:16:31.568 INFO:tasks.workunit.client.1.smithi098.stdout:6/537: dwrite d9/dd/de/f1e [4194304,4194304] 0 2023-01-04T18:16:31.569 INFO:tasks.workunit.client.1.smithi098.stdout:3/572: link d6/d10/d19/f8c d6/d10/dc0/fcb 0 2023-01-04T18:16:31.569 INFO:tasks.workunit.client.1.smithi098.stdout:3/573: fsync d6/d56/f60 0 2023-01-04T18:16:31.569 INFO:tasks.workunit.client.1.smithi098.stdout:3/574: write d6/d10/d19/d3f/d5e/d74/f52 [4715016,30136] 0 2023-01-04T18:16:31.571 INFO:tasks.workunit.client.1.smithi098.stdout:6/538: write d9/dd/d4e/f4f [3944188,45326] 0 2023-01-04T18:16:31.572 INFO:tasks.workunit.client.1.smithi098.stdout:9/565: truncate d2/d5/d18/d4e/d42/d89/dac/d78/fbc 2911886 0 2023-01-04T18:16:31.572 INFO:tasks.workunit.client.1.smithi098.stdout:9/566: chown d2/d5/d18/d1d/d23/f8c 164858728 1 2023-01-04T18:16:31.573 INFO:tasks.workunit.client.1.smithi098.stdout:0/540: mknod df/d4f/d6e/daf/cbd 0 2023-01-04T18:16:31.580 INFO:tasks.workunit.client.1.smithi098.stdout:5/478: truncate d1/f6 5000769 0 2023-01-04T18:16:31.582 INFO:tasks.workunit.client.1.smithi098.stdout:5/479: dread d1/da/f77 [0,4194304] 0 2023-01-04T18:16:31.585 INFO:tasks.workunit.client.1.smithi098.stdout:0/541: dread df/d17/d1c/d3b/d98/f69 [0,4194304] 0 2023-01-04T18:16:31.587 INFO:tasks.workunit.client.1.smithi098.stdout:5/480: write d1/d2f/f5f [702966,58747] 0 2023-01-04T18:16:31.591 INFO:tasks.workunit.client.1.smithi098.stdout:8/488: dwrite d6/d11/d15/d1b/d2a/d3b/d4c/d54/f88 [0,4194304] 0 2023-01-04T18:16:31.592 INFO:tasks.workunit.client.1.smithi098.stdout:6/539: symlink d9/dd/d24/d3e/d86/la9 0 2023-01-04T18:16:31.598 INFO:tasks.workunit.client.1.smithi098.stdout:4/467: sync 2023-01-04T18:16:31.599 INFO:tasks.workunit.client.1.smithi098.stdout:3/575: dwrite d6/d10/f80 [4194304,4194304] 0 2023-01-04T18:16:31.603 INFO:tasks.workunit.client.1.smithi098.stdout:0/542: dwrite df/f28 [0,4194304] 0 2023-01-04T18:16:31.604 INFO:tasks.workunit.client.1.smithi098.stdout:5/481: rename d1/f5a to d1/d2/d14/f90 0 2023-01-04T18:16:31.604 INFO:tasks.workunit.client.1.smithi098.stdout:5/482: fdatasync d1/d1e/f3e 0 2023-01-04T18:16:31.604 INFO:tasks.workunit.client.1.smithi098.stdout:5/483: dread - d1/d46/f6e zero size 2023-01-04T18:16:31.606 INFO:tasks.workunit.client.1.smithi098.stdout:8/489: getdents d6/d11/d15/d1b/d2a/d3b 0 2023-01-04T18:16:31.608 INFO:tasks.workunit.client.1.smithi098.stdout:4/468: creat d5/de/d2c/f9a x:0 0 0 2023-01-04T18:16:31.608 INFO:tasks.workunit.client.1.smithi098.stdout:4/469: stat d5/de/d30/d4f 0 2023-01-04T18:16:31.608 INFO:tasks.workunit.client.1.smithi098.stdout:4/470: truncate d5/de/d21/d75/d83/f8f 1030658 0 2023-01-04T18:16:31.609 INFO:tasks.workunit.client.1.smithi098.stdout:9/567: mkdir d2/d5/d18/d4e/d42/d89/dac/d26/d41/dc1 0 2023-01-04T18:16:31.610 INFO:tasks.workunit.client.1.smithi098.stdout:6/540: dwrite d9/dd/de/d44/fa6 [0,4194304] 0 2023-01-04T18:16:31.610 INFO:tasks.workunit.client.1.smithi098.stdout:6/541: write d9/dd/de/d44/f5e [904473,2243] 0 2023-01-04T18:16:31.610 INFO:tasks.workunit.client.1.smithi098.stdout:6/542: stat d9/dd/d15/l2b 0 2023-01-04T18:16:31.613 INFO:tasks.workunit.client.1.smithi098.stdout:0/543: symlink df/d17/d1c/lbe 0 2023-01-04T18:16:31.613 INFO:tasks.workunit.client.1.smithi098.stdout:0/544: fdatasync df/d17/d9b/d5c/fa7 0 2023-01-04T18:16:31.613 INFO:tasks.workunit.client.1.smithi098.stdout:0/545: getdents df/d17/d1c/d2c/da8 0 2023-01-04T18:16:31.614 INFO:tasks.workunit.client.1.smithi098.stdout:0/546: readlink df/d17/d1c/d2c/d41/d4a/d4c/l70 0 2023-01-04T18:16:31.614 INFO:tasks.workunit.client.1.smithi098.stdout:3/576: dread d6/d10/f80 [0,4194304] 0 2023-01-04T18:16:31.619 INFO:tasks.workunit.client.1.smithi098.stdout:4/471: mkdir d5/de/d9b 0 2023-01-04T18:16:31.620 INFO:tasks.workunit.client.1.smithi098.stdout:9/568: creat d2/d5/d18/d4e/d42/d89/dac/d78/fc2 x:0 0 0 2023-01-04T18:16:31.622 INFO:tasks.workunit.client.1.smithi098.stdout:0/547: getdents df/d17/d1c/d2c/d41 0 2023-01-04T18:16:31.623 INFO:tasks.workunit.client.1.smithi098.stdout:3/577: dread d6/f1c [0,4194304] 0 2023-01-04T18:16:31.623 INFO:tasks.workunit.client.1.smithi098.stdout:3/578: fsync d6/d10/d19/d3f/d46/fbd 0 2023-01-04T18:16:31.623 INFO:tasks.workunit.client.1.smithi098.stdout:5/484: dwrite d1/d2/d14/f2d [4194304,4194304] 0 2023-01-04T18:16:31.624 INFO:tasks.workunit.client.1.smithi098.stdout:4/472: creat d5/de/d21/d5e/f9c x:0 0 0 2023-01-04T18:16:31.624 INFO:tasks.workunit.client.1.smithi098.stdout:4/473: chown d5 742 1 2023-01-04T18:16:31.625 INFO:tasks.workunit.client.1.smithi098.stdout:9/569: creat d2/d53/daf/db3/fc3 x:0 0 0 2023-01-04T18:16:31.625 INFO:tasks.workunit.client.1.smithi098.stdout:9/570: truncate d2/d5/d18/d19/f92 870235 0 2023-01-04T18:16:31.625 INFO:tasks.workunit.client.1.smithi098.stdout:6/543: mknod d9/dd/d15/caa 0 2023-01-04T18:16:31.627 INFO:tasks.workunit.client.1.smithi098.stdout:0/548: creat df/d17/d68/fbf x:0 0 0 2023-01-04T18:16:31.631 INFO:tasks.workunit.client.1.smithi098.stdout:8/490: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/f71 [0,4194304] 0 2023-01-04T18:16:31.632 INFO:tasks.workunit.client.1.smithi098.stdout:5/485: mknod d1/da/d44/d45/c91 0 2023-01-04T18:16:31.633 INFO:tasks.workunit.client.1.smithi098.stdout:4/474: dread d5/de/d30/d4f/f86 [0,4194304] 0 2023-01-04T18:16:31.634 INFO:tasks.workunit.client.1.smithi098.stdout:9/571: dread d2/d5/d18/d4e/d42/f64 [0,4194304] 0 2023-01-04T18:16:31.636 INFO:tasks.workunit.client.1.smithi098.stdout:6/544: unlink d9/dd/d24/d3e/f46 0 2023-01-04T18:16:31.636 INFO:tasks.workunit.client.1.smithi098.stdout:6/545: readlink d9/dd/de/d26/d71/l83 0 2023-01-04T18:16:31.636 INFO:tasks.workunit.client.1.smithi098.stdout:6/546: dread - d9/dd/d4e/d67/f68 zero size 2023-01-04T18:16:31.638 INFO:tasks.workunit.client.1.smithi098.stdout:0/549: creat df/d17/d1c/d2c/d41/d64/fc0 x:0 0 0 2023-01-04T18:16:31.638 INFO:tasks.workunit.client.1.smithi098.stdout:0/550: fsync df/d17/d24/f44 0 2023-01-04T18:16:31.638 INFO:tasks.workunit.client.1.smithi098.stdout:0/551: write df/d17/d68/fb2 [284024,112189] 0 2023-01-04T18:16:31.639 INFO:tasks.workunit.client.1.smithi098.stdout:8/491: dread d6/fe [0,4194304] 0 2023-01-04T18:16:31.639 INFO:tasks.workunit.client.1.smithi098.stdout:8/492: stat d6/d11/d15/d1b/d2a/d6b/d7f/l34 0 2023-01-04T18:16:31.639 INFO:tasks.workunit.client.1.smithi098.stdout:0/552: dread df/d4f/f5d [0,4194304] 0 2023-01-04T18:16:31.641 INFO:tasks.workunit.client.1.smithi098.stdout:3/579: dwrite d6/d10/d19/d3f/f82 [0,4194304] 0 2023-01-04T18:16:31.644 INFO:tasks.workunit.client.1.smithi098.stdout:9/572: write d2/d5/d18/d4e/d42/d89/dac/f79 [174292,116903] 0 2023-01-04T18:16:31.644 INFO:tasks.workunit.client.1.smithi098.stdout:9/573: fdatasync d2/d5/d18/f8f 0 2023-01-04T18:16:31.647 INFO:tasks.workunit.client.1.smithi098.stdout:5/486: rmdir d1/d2f 39 2023-01-04T18:16:31.647 INFO:tasks.workunit.client.1.smithi098.stdout:5/487: fdatasync d1/d46/d6a/f6d 0 2023-01-04T18:16:31.647 INFO:tasks.workunit.client.1.smithi098.stdout:5/488: chown d1/da/c1a 47 1 2023-01-04T18:16:31.648 INFO:tasks.workunit.client.1.smithi098.stdout:6/547: symlink d9/dd/de/d20/d82/d84/lab 0 2023-01-04T18:16:31.648 INFO:tasks.workunit.client.1.smithi098.stdout:6/548: fdatasync d9/dd/d4e/f58 0 2023-01-04T18:16:31.649 INFO:tasks.workunit.client.1.smithi098.stdout:8/493: truncate d6/d11/d15/d1b/d2a/d6b/d7f/f18 2903309 0 2023-01-04T18:16:31.651 INFO:tasks.workunit.client.1.smithi098.stdout:0/553: rename df/d17/d1c/d2c/d41/d4a/d4c/l9e to df/d17/d9b/da4/lc1 0 2023-01-04T18:16:31.651 INFO:tasks.workunit.client.1.smithi098.stdout:0/554: stat df/d4f/l53 0 2023-01-04T18:16:31.652 INFO:tasks.workunit.client.1.smithi098.stdout:8/494: write d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/f3a [949806,107277] 0 2023-01-04T18:16:31.652 INFO:tasks.workunit.client.1.smithi098.stdout:8/495: write d6/d11/d15/d1b/d2a/d3b/f5d [1624454,20417] 0 2023-01-04T18:16:31.653 INFO:tasks.workunit.client.1.smithi098.stdout:8/496: chown d6/d11/d15/d1b/d2a/d3b/d4c/d54/c5f 22703388 1 2023-01-04T18:16:31.653 INFO:tasks.workunit.client.1.smithi098.stdout:8/497: truncate d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/f73 863885 0 2023-01-04T18:16:31.653 INFO:tasks.workunit.client.1.smithi098.stdout:8/498: fsync d6/d11/d15/d1b/f76 0 2023-01-04T18:16:31.653 INFO:tasks.workunit.client.1.smithi098.stdout:8/499: readlink d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/l80 0 2023-01-04T18:16:31.653 INFO:tasks.workunit.client.1.smithi098.stdout:8/500: read - d6/d11/d15/d1b/f76 zero size 2023-01-04T18:16:31.654 INFO:tasks.workunit.client.1.smithi098.stdout:4/475: dwrite d5/de/d21/d5e/f87 [4194304,4194304] 0 2023-01-04T18:16:31.654 INFO:tasks.workunit.client.1.smithi098.stdout:3/580: creat d6/d10/d19/d3f/d46/d8a/fcc x:0 0 0 2023-01-04T18:16:31.655 INFO:tasks.workunit.client.1.smithi098.stdout:6/549: creat d9/dd/d24/d64/fac x:0 0 0 2023-01-04T18:16:31.656 INFO:tasks.workunit.client.1.smithi098.stdout:5/489: dread d1/da/d44/d45/d4b/f4f [0,4194304] 0 2023-01-04T18:16:31.657 INFO:tasks.workunit.client.1.smithi098.stdout:0/555: unlink df/d17/d1c/d3b/f78 0 2023-01-04T18:16:31.657 INFO:tasks.workunit.client.1.smithi098.stdout:1/432: sync 2023-01-04T18:16:31.664 INFO:tasks.workunit.client.1.smithi098.stdout:7/473: sync 2023-01-04T18:16:31.664 INFO:tasks.workunit.client.1.smithi098.stdout:2/528: sync 2023-01-04T18:16:31.664 INFO:tasks.workunit.client.1.smithi098.stdout:8/501: creat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/f8c x:0 0 0 2023-01-04T18:16:31.664 INFO:tasks.workunit.client.1.smithi098.stdout:8/502: write d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/f6f [896107,60187] 0 2023-01-04T18:16:31.668 INFO:tasks.workunit.client.1.smithi098.stdout:4/476: rename d5/de/d21/d5e to d5/de/d21/d9d 0 2023-01-04T18:16:31.670 INFO:tasks.workunit.client.1.smithi098.stdout:3/581: rename d6/d10/d19/d3f/d46/c78 to d6/d10/d6b/ccd 0 2023-01-04T18:16:31.671 INFO:tasks.workunit.client.1.smithi098.stdout:6/550: link d9/dd/de/c13 d9/dd/d4e/d67/d8d/d8e/cad 0 2023-01-04T18:16:31.673 INFO:tasks.workunit.client.1.smithi098.stdout:5/490: unlink d1/d2f/f7a 0 2023-01-04T18:16:31.674 INFO:tasks.workunit.client.1.smithi098.stdout:5/491: truncate d1/da/d44/f70 1854130 0 2023-01-04T18:16:31.674 INFO:tasks.workunit.client.1.smithi098.stdout:5/492: fdatasync d1/f6 0 2023-01-04T18:16:31.674 INFO:tasks.workunit.client.1.smithi098.stdout:0/556: symlink df/d17/d24/lc2 0 2023-01-04T18:16:31.677 INFO:tasks.workunit.client.1.smithi098.stdout:2/529: unlink d6/l83 0 2023-01-04T18:16:31.677 INFO:tasks.workunit.client.1.smithi098.stdout:0/557: write df/d17/d1c/d3b/d98/fb8 [1104151,112241] 0 2023-01-04T18:16:31.677 INFO:tasks.workunit.client.1.smithi098.stdout:2/530: write d6/dc/d2b/d42/d47/d1f/d39/f56 [251378,8945] 0 2023-01-04T18:16:31.677 INFO:tasks.workunit.client.1.smithi098.stdout:7/474: symlink d1/d23/d37/d40/d94/la1 0 2023-01-04T18:16:31.678 INFO:tasks.workunit.client.1.smithi098.stdout:1/433: dwrite d1/d2e/f5f [0,4194304] 0 2023-01-04T18:16:31.680 INFO:tasks.workunit.client.1.smithi098.stdout:3/582: rename d6/d56/f99 to d6/d10/dc0/fce 0 2023-01-04T18:16:31.680 INFO:tasks.workunit.client.1.smithi098.stdout:4/477: link d5/d28/d40/f52 d5/de/f9e 0 2023-01-04T18:16:31.681 INFO:tasks.workunit.client.1.smithi098.stdout:4/478: chown d5/de/d21/c27 54005923 1 2023-01-04T18:16:31.681 INFO:tasks.workunit.client.1.smithi098.stdout:8/503: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/f18 [0,4194304] 0 2023-01-04T18:16:31.681 INFO:tasks.workunit.client.1.smithi098.stdout:8/504: fsync d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/f50 0 2023-01-04T18:16:31.681 INFO:tasks.workunit.client.1.smithi098.stdout:1/434: dread d1/d8/f10 [0,4194304] 0 2023-01-04T18:16:31.687 INFO:tasks.workunit.client.1.smithi098.stdout:0/558: unlink df/d4f/d6b/cac 0 2023-01-04T18:16:31.687 INFO:tasks.workunit.client.1.smithi098.stdout:2/531: creat d6/dc/d2b/d42/d47/d1f/fb4 x:0 0 0 2023-01-04T18:16:31.688 INFO:tasks.workunit.client.1.smithi098.stdout:6/551: rmdir d9/dd/d4e/d67/d8d/d81 39 2023-01-04T18:16:31.688 INFO:tasks.workunit.client.1.smithi098.stdout:6/552: truncate d9/dd/d24/d64/fac 287307 0 2023-01-04T18:16:31.688 INFO:tasks.workunit.client.1.smithi098.stdout:6/553: write d9/dd/de/d26/f74 [1795423,75757] 0 2023-01-04T18:16:31.688 INFO:tasks.workunit.client.1.smithi098.stdout:6/554: chown d9/dd/de/d26/d71/l83 193424 1 2023-01-04T18:16:31.688 INFO:tasks.workunit.client.1.smithi098.stdout:6/555: dread - d9/dd/d24/d3e/f9d zero size 2023-01-04T18:16:31.688 INFO:tasks.workunit.client.1.smithi098.stdout:3/583: rename d6/d10/d19/d3f/f6d to d6/d10/d19/d3f/d5e/d7d/d90/fcf 0 2023-01-04T18:16:31.689 INFO:tasks.workunit.client.1.smithi098.stdout:4/479: creat d5/d9/d90/f9f x:0 0 0 2023-01-04T18:16:31.695 INFO:tasks.workunit.client.1.smithi098.stdout:5/493: dwrite d1/d2/d14/f5c [0,4194304] 0 2023-01-04T18:16:31.695 INFO:tasks.workunit.client.1.smithi098.stdout:5/494: stat d1/f1d 0 2023-01-04T18:16:31.695 INFO:tasks.workunit.client.1.smithi098.stdout:5/495: stat d1/d2f/d73 0 2023-01-04T18:16:31.698 INFO:tasks.workunit.client.1.smithi098.stdout:5/496: truncate d1/fc 3694962 0 2023-01-04T18:16:31.698 INFO:tasks.workunit.client.1.smithi098.stdout:2/532: mkdir d6/dc/d2b/d42/d51/d79/da3/db5 0 2023-01-04T18:16:31.699 INFO:tasks.workunit.client.1.smithi098.stdout:6/556: unlink d9/c32 0 2023-01-04T18:16:31.700 INFO:tasks.workunit.client.1.smithi098.stdout:5/497: rename d1/da/f2b to d1/d2/f92 0 2023-01-04T18:16:31.700 INFO:tasks.workunit.client.1.smithi098.stdout:2/533: creat d6/dc/d4b/d89/fb6 x:0 0 0 2023-01-04T18:16:31.702 INFO:tasks.workunit.client.1.smithi098.stdout:6/557: truncate d9/dd/f11 484708 0 2023-01-04T18:16:31.703 INFO:tasks.workunit.client.1.smithi098.stdout:5/498: truncate d1/d38/f69 496954 0 2023-01-04T18:16:31.706 INFO:tasks.workunit.client.1.smithi098.stdout:2/534: read - d6/dc/d2b/d42/d47/d31/f43 zero size 2023-01-04T18:16:31.706 INFO:tasks.workunit.client.1.smithi098.stdout:2/535: readlink d6/dc/d2b/d32/l3d 0 2023-01-04T18:16:31.707 INFO:tasks.workunit.client.1.smithi098.stdout:5/499: unlink d1/da/d44/f84 0 2023-01-04T18:16:31.707 INFO:tasks.workunit.client.1.smithi098.stdout:5/500: getdents d1/da/d44/d80 0 2023-01-04T18:16:31.708 INFO:tasks.workunit.client.1.smithi098.stdout:5/501: write d1/d2/d14/d59/f71 [1608786,841] 0 2023-01-04T18:16:31.717 INFO:tasks.workunit.client.1.smithi098.stdout:5/502: write d1/d2f/f5e [284599,45479] 0 2023-01-04T18:16:31.719 INFO:tasks.workunit.client.1.smithi098.stdout:5/503: unlink d1/da/f37 0 2023-01-04T18:16:31.721 INFO:tasks.workunit.client.1.smithi098.stdout:5/504: symlink d1/da/d44/d83/l93 0 2023-01-04T18:16:31.722 INFO:tasks.workunit.client.1.smithi098.stdout:5/505: symlink d1/d38/d3b/d8f/l94 0 2023-01-04T18:16:31.723 INFO:tasks.workunit.client.1.smithi098.stdout:5/506: link d1/d2/d14/d19/l50 d1/d38/d3b/d8f/l95 0 2023-01-04T18:16:31.733 INFO:tasks.workunit.client.1.smithi098.stdout:5/507: dread d1/f6f [0,4194304] 0 2023-01-04T18:16:31.733 INFO:tasks.workunit.client.1.smithi098.stdout:5/508: chown d1/d38/d3b/d8f/l94 63942 1 2023-01-04T18:16:31.734 INFO:tasks.workunit.client.1.smithi098.stdout:5/509: creat d1/f96 x:0 0 0 2023-01-04T18:16:31.734 INFO:tasks.workunit.client.1.smithi098.stdout:5/510: stat d1/da/f33 0 2023-01-04T18:16:31.734 INFO:tasks.workunit.client.1.smithi098.stdout:5/511: creat d1/da/f97 x:0 0 0 2023-01-04T18:16:31.742 INFO:tasks.workunit.client.1.smithi098.stdout:5/512: dread d1/d2/d14/f2d [0,4194304] 0 2023-01-04T18:16:31.745 INFO:tasks.workunit.client.1.smithi098.stdout:7/475: dwrite d1/d51/d26/f30 [0,4194304] 0 2023-01-04T18:16:31.745 INFO:tasks.workunit.client.1.smithi098.stdout:8/505: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/f47 [4194304,4194304] 0 2023-01-04T18:16:31.747 INFO:tasks.workunit.client.1.smithi098.stdout:0/559: dwrite df/d4f/d6b/d89/f9a [0,4194304] 0 2023-01-04T18:16:31.747 INFO:tasks.workunit.client.1.smithi098.stdout:0/560: dread - df/d17/d1c/d2c/d41/da0/fa3 zero size 2023-01-04T18:16:31.748 INFO:tasks.workunit.client.1.smithi098.stdout:6/558: dwrite d9/dd/de/f9c [0,4194304] 0 2023-01-04T18:16:31.748 INFO:tasks.workunit.client.1.smithi098.stdout:4/480: dwrite d5/f38 [0,4194304] 0 2023-01-04T18:16:31.748 INFO:tasks.workunit.client.1.smithi098.stdout:7/476: creat d1/d23/d37/fa2 x:0 0 0 2023-01-04T18:16:31.749 INFO:tasks.workunit.client.1.smithi098.stdout:2/536: dwrite d6/dc/d2b/d42/d47/d1f/f29 [0,4194304] 0 2023-01-04T18:16:31.749 INFO:tasks.workunit.client.1.smithi098.stdout:3/584: dwrite d6/d10/d19/d3f/d46/f5a [0,4194304] 0 2023-01-04T18:16:31.749 INFO:tasks.workunit.client.1.smithi098.stdout:1/435: dwrite d1/d25/d27/d77/f4b [4194304,4194304] 0 2023-01-04T18:16:31.749 INFO:tasks.workunit.client.1.smithi098.stdout:1/436: truncate d1/d2e/f84 753363 0 2023-01-04T18:16:31.758 INFO:tasks.workunit.client.1.smithi098.stdout:5/513: dread d1/da/f34 [4194304,4194304] 0 2023-01-04T18:16:31.760 INFO:tasks.workunit.client.1.smithi098.stdout:4/481: mkdir d5/de/da0 0 2023-01-04T18:16:31.761 INFO:tasks.workunit.client.1.smithi098.stdout:4/482: fdatasync d5/d9/f7e 0 2023-01-04T18:16:31.761 INFO:tasks.workunit.client.1.smithi098.stdout:6/559: dread d9/dd/d4e/f58 [0,4194304] 0 2023-01-04T18:16:31.763 INFO:tasks.workunit.client.1.smithi098.stdout:7/477: creat d1/d51/fa3 x:0 0 0 2023-01-04T18:16:31.780 INFO:tasks.workunit.client.1.smithi098.stdout:0/561: dwrite df/d17/d1c/d3b/d98/f82 [0,4194304] 0 2023-01-04T18:16:31.780 INFO:tasks.workunit.client.1.smithi098.stdout:0/562: fsync df/d17/d1c/d3b/d98/f81 0 2023-01-04T18:16:31.780 INFO:tasks.workunit.client.1.smithi098.stdout:2/537: creat d6/dc/d2b/d42/d47/fb7 x:0 0 0 2023-01-04T18:16:31.780 INFO:tasks.workunit.client.1.smithi098.stdout:8/506: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/f71 [4194304,4194304] 0 2023-01-04T18:16:31.781 INFO:tasks.workunit.client.1.smithi098.stdout:1/437: mknod d1/d25/d36/d4e/d6e/c9b 0 2023-01-04T18:16:31.781 INFO:tasks.workunit.client.1.smithi098.stdout:1/438: fdatasync d1/d25/d27/d77/f74 0 2023-01-04T18:16:31.783 INFO:tasks.workunit.client.1.smithi098.stdout:0/563: read df/f28 [109897,74393] 0 2023-01-04T18:16:31.783 INFO:tasks.workunit.client.1.smithi098.stdout:6/560: dwrite d9/dd/d15/f41 [0,4194304] 0 2023-01-04T18:16:31.784 INFO:tasks.workunit.client.1.smithi098.stdout:5/514: rename d1/da/f97 to d1/d2/d14/d59/f98 0 2023-01-04T18:16:31.787 INFO:tasks.workunit.client.1.smithi098.stdout:4/483: symlink d5/de/d21/la1 0 2023-01-04T18:16:31.788 INFO:tasks.workunit.client.1.smithi098.stdout:3/585: dread d6/d10/d19/f3a [0,4194304] 0 2023-01-04T18:16:31.788 INFO:tasks.workunit.client.1.smithi098.stdout:3/586: stat d6/d10/d19/d3f/d5e/l77 0 2023-01-04T18:16:31.788 INFO:tasks.workunit.client.1.smithi098.stdout:7/478: rmdir d1/d51/d26/d28/d2d 39 2023-01-04T18:16:31.788 INFO:tasks.workunit.client.1.smithi098.stdout:7/479: chown d1/d23/d37/d78 1 1 2023-01-04T18:16:31.788 INFO:tasks.workunit.client.1.smithi098.stdout:7/480: stat d1/f47 0 2023-01-04T18:16:31.789 INFO:tasks.workunit.client.1.smithi098.stdout:7/481: write d1/d23/d73/f76 [868398,1918] 0 2023-01-04T18:16:31.799 INFO:tasks.workunit.client.1.smithi098.stdout:9/574: sync 2023-01-04T18:16:31.799 INFO:tasks.workunit.client.1.smithi098.stdout:9/575: truncate d2/d5/d18/d4e/d42/d89/fa1 913343 0 2023-01-04T18:16:31.800 INFO:tasks.workunit.client.1.smithi098.stdout:8/507: creat d6/f8d x:0 0 0 2023-01-04T18:16:31.800 INFO:tasks.workunit.client.1.smithi098.stdout:9/576: write d2/d5/f6 [1254904,62899] 0 2023-01-04T18:16:31.802 INFO:tasks.workunit.client.1.smithi098.stdout:0/564: link df/d17/d1c/lbe df/d4f/d6e/lc3 0 2023-01-04T18:16:31.805 INFO:tasks.workunit.client.1.smithi098.stdout:6/561: creat d9/dd/de/d44/d7a/d85/fae x:0 0 0 2023-01-04T18:16:31.805 INFO:tasks.workunit.client.1.smithi098.stdout:2/538: rename d6/dc/d2b/d42/d47/d31/f43 to d6/dc/d2b/d42/fb8 0 2023-01-04T18:16:31.805 INFO:tasks.workunit.client.1.smithi098.stdout:6/562: write d9/dd/d4e/f92 [1324917,73353] 0 2023-01-04T18:16:31.805 INFO:tasks.workunit.client.1.smithi098.stdout:2/539: write d6/dc/d2b/d42/fb8 [910543,107826] 0 2023-01-04T18:16:31.807 INFO:tasks.workunit.client.1.smithi098.stdout:5/515: creat d1/d2f/d66/d75/f99 x:0 0 0 2023-01-04T18:16:31.809 INFO:tasks.workunit.client.1.smithi098.stdout:3/587: mknod d6/d6f/d9b/cd0 0 2023-01-04T18:16:31.809 INFO:tasks.workunit.client.1.smithi098.stdout:7/482: creat d1/d4/d11/fa4 x:0 0 0 2023-01-04T18:16:31.809 INFO:tasks.workunit.client.1.smithi098.stdout:7/483: read - d1/d4/d11/f9a zero size 2023-01-04T18:16:31.809 INFO:tasks.workunit.client.1.smithi098.stdout:8/508: mkdir d6/d11/d15/d1b/d2a/d3b/d8e 0 2023-01-04T18:16:31.810 INFO:tasks.workunit.client.1.smithi098.stdout:1/439: truncate d1/d25/d27/d77/f4b 7079668 0 2023-01-04T18:16:31.813 INFO:tasks.workunit.client.1.smithi098.stdout:4/484: rename d5/de/d30/d4f/c8d to d5/ca2 0 2023-01-04T18:16:31.814 INFO:tasks.workunit.client.1.smithi098.stdout:6/563: symlink d9/dd/de/d44/d7a/laf 0 2023-01-04T18:16:31.818 INFO:tasks.workunit.client.1.smithi098.stdout:5/516: unlink d1/d2f/d66/d75/f7b 0 2023-01-04T18:16:31.819 INFO:tasks.workunit.client.1.smithi098.stdout:8/509: write d6/d11/d15/d1b/d2a/d6b/d7f/d12/f41 [657912,60479] 0 2023-01-04T18:16:31.824 INFO:tasks.workunit.client.1.smithi098.stdout:2/540: dwrite d6/dc/d2b/d42/f57 [0,4194304] 0 2023-01-04T18:16:31.830 INFO:tasks.workunit.client.1.smithi098.stdout:3/588: mkdir d6/d10/d29/d6a/dd1 0 2023-01-04T18:16:31.830 INFO:tasks.workunit.client.1.smithi098.stdout:3/589: write d6/d10/d19/d3f/d5e/d74/f52 [5310336,32180] 0 2023-01-04T18:16:31.831 INFO:tasks.workunit.client.1.smithi098.stdout:7/484: creat d1/d51/d26/d28/d2d/fa5 x:0 0 0 2023-01-04T18:16:31.832 INFO:tasks.workunit.client.1.smithi098.stdout:1/440: mknod d1/c9c 0 2023-01-04T18:16:31.833 INFO:tasks.workunit.client.1.smithi098.stdout:8/510: creat d6/d11/d15/d1b/d2a/d6b/d7f/f8f x:0 0 0 2023-01-04T18:16:31.833 INFO:tasks.workunit.client.1.smithi098.stdout:8/511: dread - d6/f8d zero size 2023-01-04T18:16:31.836 INFO:tasks.workunit.client.1.smithi098.stdout:2/541: creat d6/dc/d2b/d32/fb9 x:0 0 0 2023-01-04T18:16:31.836 INFO:tasks.workunit.client.1.smithi098.stdout:7/485: rmdir d1/d23/d37/d40/d94 39 2023-01-04T18:16:31.836 INFO:tasks.workunit.client.1.smithi098.stdout:7/486: stat d1/da 0 2023-01-04T18:16:31.836 INFO:tasks.workunit.client.1.smithi098.stdout:1/441: symlink d1/d25/d39/l9d 0 2023-01-04T18:16:31.837 INFO:tasks.workunit.client.1.smithi098.stdout:1/442: getdents d1/d25/d27 0 2023-01-04T18:16:31.838 INFO:tasks.workunit.client.1.smithi098.stdout:8/512: link d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/l80 d6/d11/d15/d1b/d2a/d3b/d4c/d54/d6a/l90 0 2023-01-04T18:16:31.839 INFO:tasks.workunit.client.1.smithi098.stdout:7/487: symlink d1/d23/d73/la6 0 2023-01-04T18:16:31.839 INFO:tasks.workunit.client.1.smithi098.stdout:6/564: dwrite d9/dd/de/f9c [4194304,4194304] 0 2023-01-04T18:16:31.839 INFO:tasks.workunit.client.1.smithi098.stdout:0/565: dwrite df/f3e [0,4194304] 0 2023-01-04T18:16:31.842 INFO:tasks.workunit.client.1.smithi098.stdout:7/488: rmdir d1/d23/d21 39 2023-01-04T18:16:31.842 INFO:tasks.workunit.client.1.smithi098.stdout:8/513: chown d6/d11/d15/d1b/c28 777 1 2023-01-04T18:16:31.842 INFO:tasks.workunit.client.1.smithi098.stdout:7/489: getdents d1/d23/d21/d7f 0 2023-01-04T18:16:31.842 INFO:tasks.workunit.client.1.smithi098.stdout:7/490: chown d1/d23/d73 10073380 1 2023-01-04T18:16:31.845 INFO:tasks.workunit.client.1.smithi098.stdout:2/542: dread d6/dc/d2b/d42/d47/d1f/f3a [0,4194304] 0 2023-01-04T18:16:31.847 INFO:tasks.workunit.client.1.smithi098.stdout:8/514: rename d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d44/f53 to d6/d11/d15/d1b/d2a/d6b/d7f/d78/f91 0 2023-01-04T18:16:31.850 INFO:tasks.workunit.client.1.smithi098.stdout:7/491: mknod d1/d23/d21/d7f/ca7 0 2023-01-04T18:16:31.851 INFO:tasks.workunit.client.1.smithi098.stdout:2/543: dread d6/dc/d2b/d42/d47/d35/f55 [0,4194304] 0 2023-01-04T18:16:31.858 INFO:tasks.workunit.client.1.smithi098.stdout:7/492: getdents d1/d23/d37/d40 0 2023-01-04T18:16:31.858 INFO:tasks.workunit.client.1.smithi098.stdout:8/515: mkdir d6/d92 0 2023-01-04T18:16:31.858 INFO:tasks.workunit.client.1.smithi098.stdout:2/544: creat d6/dc/d2b/d42/d51/d79/fba x:0 0 0 2023-01-04T18:16:31.861 INFO:tasks.workunit.client.1.smithi098.stdout:8/516: rmdir d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d64 39 2023-01-04T18:16:31.861 INFO:tasks.workunit.client.1.smithi098.stdout:4/485: dwrite d5/de/d30/d4f/f86 [0,4194304] 0 2023-01-04T18:16:31.879 INFO:tasks.workunit.client.1.smithi098.stdout:5/517: dwrite d1/d1e/f68 [0,4194304] 0 2023-01-04T18:16:31.881 INFO:tasks.workunit.client.1.smithi098.stdout:5/518: rename d1/da/c1a to d1/d2/d14/d59/c9a 0 2023-01-04T18:16:31.882 INFO:tasks.workunit.client.1.smithi098.stdout:5/519: link d1/d46/c4d d1/d38/c9b 0 2023-01-04T18:16:31.883 INFO:tasks.workunit.client.1.smithi098.stdout:5/520: creat d1/da/d44/f9c x:0 0 0 2023-01-04T18:16:31.884 INFO:tasks.workunit.client.1.smithi098.stdout:5/521: rename d1/d46/f7d to d1/da/d44/d45/d4b/f9d 0 2023-01-04T18:16:31.884 INFO:tasks.workunit.client.1.smithi098.stdout:5/522: chown d1/d1e/f3e 1957750 1 2023-01-04T18:16:31.885 INFO:tasks.workunit.client.1.smithi098.stdout:5/523: chown d1/da/d44/d45/d4b/d61/f86 6349 1 2023-01-04T18:16:31.885 INFO:tasks.workunit.client.1.smithi098.stdout:5/524: chown d1/d1e 88 1 2023-01-04T18:16:31.885 INFO:tasks.workunit.client.1.smithi098.stdout:5/525: creat d1/d2/d14/f9e x:0 0 0 2023-01-04T18:16:31.889 INFO:tasks.workunit.client.1.smithi098.stdout:8/517: dread d6/d11/d15/d1b/d2a/d6b/d7f/f18 [0,4194304] 0 2023-01-04T18:16:31.889 INFO:tasks.workunit.client.1.smithi098.stdout:5/526: dread d1/da/d44/d45/f5b [0,4194304] 0 2023-01-04T18:16:31.891 INFO:tasks.workunit.client.1.smithi098.stdout:1/443: dwrite d1/d25/d6a/f90 [0,4194304] 0 2023-01-04T18:16:31.897 INFO:tasks.workunit.client.1.smithi098.stdout:1/444: symlink d1/d25/d36/d89/l9e 0 2023-01-04T18:16:31.897 INFO:tasks.workunit.client.1.smithi098.stdout:1/445: write d1/d2e/f6c [231228,78239] 0 2023-01-04T18:16:31.898 INFO:tasks.workunit.client.1.smithi098.stdout:7/493: dwrite d1/d23/f2c [0,4194304] 0 2023-01-04T18:16:31.898 INFO:tasks.workunit.client.1.smithi098.stdout:7/494: chown d1/d51/d26/c33 113262333 1 2023-01-04T18:16:31.898 INFO:tasks.workunit.client.1.smithi098.stdout:7/495: read d1/da/f68 [616855,27725] 0 2023-01-04T18:16:31.898 INFO:tasks.workunit.client.1.smithi098.stdout:6/565: dwrite d9/dd/f42 [0,4194304] 0 2023-01-04T18:16:31.898 INFO:tasks.workunit.client.1.smithi098.stdout:7/496: chown d1/d23/l1c 35367176 1 2023-01-04T18:16:31.898 INFO:tasks.workunit.client.1.smithi098.stdout:6/566: dread - d9/dd/d4e/f6a zero size 2023-01-04T18:16:31.898 INFO:tasks.workunit.client.1.smithi098.stdout:6/567: write d9/dd/de/d26/f74 [1723542,106414] 0 2023-01-04T18:16:31.898 INFO:tasks.workunit.client.1.smithi098.stdout:6/568: dread - d9/dd/de/d7e/f93 zero size 2023-01-04T18:16:31.898 INFO:tasks.workunit.client.1.smithi098.stdout:6/569: truncate d9/dd/d24/d3e/f9d 460739 0 2023-01-04T18:16:31.899 INFO:tasks.workunit.client.1.smithi098.stdout:1/446: mkdir d1/d25/d36/d4e/d9f 0 2023-01-04T18:16:31.899 INFO:tasks.workunit.client.1.smithi098.stdout:7/497: creat d1/d4/fa8 x:0 0 0 2023-01-04T18:16:31.900 INFO:tasks.workunit.client.1.smithi098.stdout:6/570: truncate d9/dd/d4e/f58 2042004 0 2023-01-04T18:16:31.900 INFO:tasks.workunit.client.1.smithi098.stdout:6/571: write d9/dd/f11 [959009,36529] 0 2023-01-04T18:16:31.901 INFO:tasks.workunit.client.1.smithi098.stdout:1/447: mknod d1/d8/d53/ca0 0 2023-01-04T18:16:31.902 INFO:tasks.workunit.client.1.smithi098.stdout:7/498: creat d1/d51/d26/d28/d2d/fa9 x:0 0 0 2023-01-04T18:16:31.903 INFO:tasks.workunit.client.1.smithi098.stdout:1/448: mknod d1/d2e/ca1 0 2023-01-04T18:16:31.905 INFO:tasks.workunit.client.1.smithi098.stdout:7/499: creat d1/d23/d21/d7f/faa x:0 0 0 2023-01-04T18:16:31.906 INFO:tasks.workunit.client.1.smithi098.stdout:7/500: fdatasync d1/d2e/f39 0 2023-01-04T18:16:31.907 INFO:tasks.workunit.client.1.smithi098.stdout:1/449: write d1/d2e/f5f [3554313,51086] 0 2023-01-04T18:16:31.907 INFO:tasks.workunit.client.1.smithi098.stdout:1/450: fsync d1/d25/d36/f40 0 2023-01-04T18:16:31.907 INFO:tasks.workunit.client.1.smithi098.stdout:1/451: truncate d1/d8/f10 1451633 0 2023-01-04T18:16:31.908 INFO:tasks.workunit.client.1.smithi098.stdout:4/486: dwrite d5/d28/d40/f8a [0,4194304] 0 2023-01-04T18:16:31.912 INFO:tasks.workunit.client.1.smithi098.stdout:7/501: rename d1/d51/d26/f30 to d1/d23/fab 0 2023-01-04T18:16:31.914 INFO:tasks.workunit.client.1.smithi098.stdout:1/452: symlink d1/d25/la2 0 2023-01-04T18:16:31.916 INFO:tasks.workunit.client.1.smithi098.stdout:8/518: dwrite d6/d11/d15/d1b/d2a/d3b/f5d [0,4194304] 0 2023-01-04T18:16:31.916 INFO:tasks.workunit.client.1.smithi098.stdout:8/519: read - d6/d11/d15/d1b/d2a/d3b/d59/d6e/f89 zero size 2023-01-04T18:16:31.917 INFO:tasks.workunit.client.1.smithi098.stdout:5/527: dwrite d1/da/f26 [4194304,4194304] 0 2023-01-04T18:16:31.917 INFO:tasks.workunit.client.1.smithi098.stdout:5/528: dread - d1/d2/d14/f9e zero size 2023-01-04T18:16:31.917 INFO:tasks.workunit.client.1.smithi098.stdout:4/487: dread d5/d28/d40/f8a [0,4194304] 0 2023-01-04T18:16:31.917 INFO:tasks.workunit.client.1.smithi098.stdout:7/502: creat d1/d51/d26/d28/d8d/fac x:0 0 0 2023-01-04T18:16:31.918 INFO:tasks.workunit.client.1.smithi098.stdout:6/572: dwrite d9/dd/d24/d3e/f60 [4194304,4194304] 0 2023-01-04T18:16:31.918 INFO:tasks.workunit.client.1.smithi098.stdout:5/529: write d1/d1e/f74 [462651,31878] 0 2023-01-04T18:16:31.920 INFO:tasks.workunit.client.1.smithi098.stdout:7/503: write d1/d23/d37/d40/f4e [383379,103756] 0 2023-01-04T18:16:31.920 INFO:tasks.workunit.client.1.smithi098.stdout:7/504: chown d1/d4/l44 21577 1 2023-01-04T18:16:31.932 INFO:tasks.workunit.client.1.smithi098.stdout:4/488: rmdir d5/de/d21 39 2023-01-04T18:16:31.934 INFO:tasks.workunit.client.1.smithi098.stdout:6/573: mkdir d9/dd/de/d26/d71/db0 0 2023-01-04T18:16:31.934 INFO:tasks.workunit.client.1.smithi098.stdout:6/574: chown d9/dd/d24/d3e/f87 9395 1 2023-01-04T18:16:31.935 INFO:tasks.workunit.client.1.smithi098.stdout:5/530: dwrite d1/da/f3f [4194304,4194304] 0 2023-01-04T18:16:31.939 INFO:tasks.workunit.client.1.smithi098.stdout:7/505: truncate d1/f47 3543089 0 2023-01-04T18:16:31.942 INFO:tasks.workunit.client.1.smithi098.stdout:8/520: rename d6/d11/d15/f1d to d6/d11/d15/d1b/f93 0 2023-01-04T18:16:31.942 INFO:tasks.workunit.client.1.smithi098.stdout:8/521: truncate d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/f8c 693049 0 2023-01-04T18:16:31.946 INFO:tasks.workunit.client.1.smithi098.stdout:5/531: creat d1/d46/d6a/f9f x:0 0 0 2023-01-04T18:16:31.946 INFO:tasks.workunit.client.1.smithi098.stdout:5/532: write d1/da/f77 [1178066,119532] 0 2023-01-04T18:16:31.951 INFO:tasks.workunit.client.1.smithi098.stdout:7/506: mknod d1/d4/d11/d9d/cad 0 2023-01-04T18:16:31.951 INFO:tasks.workunit.client.1.smithi098.stdout:7/507: write d1/d23/d37/fa2 [751942,21046] 0 2023-01-04T18:16:31.952 INFO:tasks.workunit.client.1.smithi098.stdout:6/575: rename d9/dd/d4e/d67/f68 to d9/fb1 0 2023-01-04T18:16:31.953 INFO:tasks.workunit.client.1.smithi098.stdout:5/533: truncate d1/da/f1c 3056209 0 2023-01-04T18:16:31.955 INFO:tasks.workunit.client.1.smithi098.stdout:7/508: rename d1/d4/d11/fa4 to d1/d51/d26/d28/d2d/d75/fae 0 2023-01-04T18:16:31.956 INFO:tasks.workunit.client.1.smithi098.stdout:6/576: truncate d9/dd/de/d26/f62 2593303 0 2023-01-04T18:16:31.957 INFO:tasks.workunit.client.1.smithi098.stdout:8/522: dwrite d6/d11/d15/d1b/d2a/d3b/f7e [0,4194304] 0 2023-01-04T18:16:31.958 INFO:tasks.workunit.client.1.smithi098.stdout:5/534: rmdir d1/da/d44 39 2023-01-04T18:16:31.958 INFO:tasks.workunit.client.1.smithi098.stdout:5/535: read d1/d2/d14/f27 [4715961,68771] 0 2023-01-04T18:16:31.959 INFO:tasks.workunit.client.1.smithi098.stdout:5/536: stat d1/d2/d14/d59/f8a 0 2023-01-04T18:16:31.960 INFO:tasks.workunit.client.1.smithi098.stdout:7/509: mknod d1/d51/d26/d28/d8d/caf 0 2023-01-04T18:16:31.962 INFO:tasks.workunit.client.1.smithi098.stdout:6/577: creat d9/dd/de/d7e/fb2 x:0 0 0 2023-01-04T18:16:31.962 INFO:tasks.workunit.client.1.smithi098.stdout:6/578: stat d9/dd/d24/d65/c73 0 2023-01-04T18:16:31.972 INFO:tasks.workunit.client.1.smithi098.stdout:8/523: mknod d6/d11/d15/d1b/d2a/d6b/d7f/d12/c94 0 2023-01-04T18:16:31.973 INFO:tasks.workunit.client.1.smithi098.stdout:8/524: chown d6/d11/d15/d1b/l27 0 1 2023-01-04T18:16:31.973 INFO:tasks.workunit.client.1.smithi098.stdout:8/525: read - d6/d11/d15/d1b/d2a/d3b/d59/d6e/f89 zero size 2023-01-04T18:16:31.973 INFO:tasks.workunit.client.1.smithi098.stdout:5/537: creat d1/d2f/d66/d75/fa0 x:0 0 0 2023-01-04T18:16:31.974 INFO:tasks.workunit.client.1.smithi098.stdout:7/510: rmdir d1/d23/d37/d40 39 2023-01-04T18:16:31.974 INFO:tasks.workunit.client.1.smithi098.stdout:7/511: stat d1/d23/d37/d40/l87 0 2023-01-04T18:16:31.974 INFO:tasks.workunit.client.1.smithi098.stdout:7/512: chown d1/d51/d26/d28/d2d/f32 385816192 1 2023-01-04T18:16:31.974 INFO:tasks.workunit.client.1.smithi098.stdout:7/513: fsync d1/d51/d26/d28/f6e 0 2023-01-04T18:16:31.975 INFO:tasks.workunit.client.1.smithi098.stdout:8/526: mknod d6/d11/d15/d1b/d2a/d3b/d4c/d54/d6a/c95 0 2023-01-04T18:16:31.976 INFO:tasks.workunit.client.1.smithi098.stdout:5/538: mkdir d1/d2/d14/da1 0 2023-01-04T18:16:31.977 INFO:tasks.workunit.client.1.smithi098.stdout:3/590: sync 2023-01-04T18:16:31.977 INFO:tasks.workunit.client.1.smithi098.stdout:0/566: sync 2023-01-04T18:16:31.977 INFO:tasks.workunit.client.1.smithi098.stdout:9/577: sync 2023-01-04T18:16:31.978 INFO:tasks.workunit.client.1.smithi098.stdout:9/578: chown d2/d5/d18/d1d/d23/l7c 1510178384 1 2023-01-04T18:16:31.979 INFO:tasks.workunit.client.1.smithi098.stdout:7/514: truncate d1/d4/d11/f60 3750131 0 2023-01-04T18:16:31.980 INFO:tasks.workunit.client.1.smithi098.stdout:5/539: creat d1/da/d44/d80/fa2 x:0 0 0 2023-01-04T18:16:31.981 INFO:tasks.workunit.client.1.smithi098.stdout:6/579: dwrite d9/dd/d24/d64/fac [0,4194304] 0 2023-01-04T18:16:31.982 INFO:tasks.workunit.client.1.smithi098.stdout:3/591: rmdir d6/d10/d19/d3f/d5e 39 2023-01-04T18:16:31.984 INFO:tasks.workunit.client.1.smithi098.stdout:0/567: dread df/d17/d1c/d2c/d41/d4a/d7a/f88 [0,4194304] 0 2023-01-04T18:16:31.984 INFO:tasks.workunit.client.1.smithi098.stdout:0/568: chown df/d17/d9b/da1 22 1 2023-01-04T18:16:31.988 INFO:tasks.workunit.client.1.smithi098.stdout:7/515: rename d1/d51/fa3 to d1/da/fb0 0 2023-01-04T18:16:31.991 INFO:tasks.workunit.client.1.smithi098.stdout:3/592: mknod d6/d10/cd2 0 2023-01-04T18:16:31.993 INFO:tasks.workunit.client.1.smithi098.stdout:5/540: rename d1/d2/d14/d19/l50 to d1/d38/d3b/la3 0 2023-01-04T18:16:31.993 INFO:tasks.workunit.client.1.smithi098.stdout:5/541: stat d1/c11 0 2023-01-04T18:16:31.995 INFO:tasks.workunit.client.1.smithi098.stdout:7/516: creat d1/da/fb1 x:0 0 0 2023-01-04T18:16:31.995 INFO:tasks.workunit.client.1.smithi098.stdout:7/517: readlink d1/d4/l8b 0 2023-01-04T18:16:31.995 INFO:tasks.workunit.client.1.smithi098.stdout:7/518: truncate d1/d23/d73/f76 1905373 0 2023-01-04T18:16:31.996 INFO:tasks.workunit.client.1.smithi098.stdout:3/593: symlink d6/d10/d19/d3f/d5e/ld3 0 2023-01-04T18:16:31.999 INFO:tasks.workunit.client.1.smithi098.stdout:9/579: dwrite d2/d5/f24 [0,4194304] 0 2023-01-04T18:16:31.999 INFO:tasks.workunit.client.1.smithi098.stdout:6/580: rename d9/dd/d15/l8c to d9/dd/de/d44/lb3 0 2023-01-04T18:16:32.001 INFO:tasks.workunit.client.1.smithi098.stdout:9/580: truncate d2/d5/d18/d4e/d42/d89/dac/d26/f9a 2656212 0 2023-01-04T18:16:32.002 INFO:tasks.workunit.client.1.smithi098.stdout:5/542: rename d1/d46/f49 to d1/da/fa4 0 2023-01-04T18:16:32.004 INFO:tasks.workunit.client.1.smithi098.stdout:6/581: symlink d9/dd/d24/d65/lb4 0 2023-01-04T18:16:32.007 INFO:tasks.workunit.client.1.smithi098.stdout:9/581: rename d2/d5/f6 to d2/d5/d18/d4e/d42/d89/dac/d78/fc4 0 2023-01-04T18:16:32.008 INFO:tasks.workunit.client.1.smithi098.stdout:5/543: mkdir d1/d2f/d66/d75/da5 0 2023-01-04T18:16:32.008 INFO:tasks.workunit.client.1.smithi098.stdout:3/594: dread d6/f41 [0,4194304] 0 2023-01-04T18:16:32.009 INFO:tasks.workunit.client.1.smithi098.stdout:6/582: creat d9/dd/d4e/d67/d8d/d81/fb5 x:0 0 0 2023-01-04T18:16:32.009 INFO:tasks.workunit.client.1.smithi098.stdout:6/583: truncate d9/dd/d4e/f92 1435915 0 2023-01-04T18:16:32.009 INFO:tasks.workunit.client.1.smithi098.stdout:6/584: getdents d9/dd/de/d26/d71/db0 0 2023-01-04T18:16:32.010 INFO:tasks.workunit.client.1.smithi098.stdout:6/585: dread - d9/dd/d24/d3e/fa4 zero size 2023-01-04T18:16:32.010 INFO:tasks.workunit.client.1.smithi098.stdout:0/569: dwrite df/d17/f4b [0,4194304] 0 2023-01-04T18:16:32.010 INFO:tasks.workunit.client.1.smithi098.stdout:6/586: write d9/dd/de/d44/f5e [136431,34209] 0 2023-01-04T18:16:32.011 INFO:tasks.workunit.client.1.smithi098.stdout:6/587: fsync d9/dd/de/d20/f5d 0 2023-01-04T18:16:32.011 INFO:tasks.workunit.client.1.smithi098.stdout:6/588: read - d9/fa0 zero size 2023-01-04T18:16:32.011 INFO:tasks.workunit.client.1.smithi098.stdout:9/582: symlink d2/d53/daf/lc5 0 2023-01-04T18:16:32.011 INFO:tasks.workunit.client.1.smithi098.stdout:7/519: dwrite d1/d23/d37/d40/f5c [0,4194304] 0 2023-01-04T18:16:32.011 INFO:tasks.workunit.client.1.smithi098.stdout:5/544: rmdir d1/da/d44/d83 39 2023-01-04T18:16:32.011 INFO:tasks.workunit.client.1.smithi098.stdout:5/545: chown d1/c6c 2 1 2023-01-04T18:16:32.011 INFO:tasks.workunit.client.1.smithi098.stdout:5/546: read d1/da/d44/f70 [374940,48364] 0 2023-01-04T18:16:32.012 INFO:tasks.workunit.client.1.smithi098.stdout:5/547: fdatasync d1/f6 0 2023-01-04T18:16:32.012 INFO:tasks.workunit.client.1.smithi098.stdout:3/595: mkdir d6/d10/d19/d3f/d5e/dd4 0 2023-01-04T18:16:32.017 INFO:tasks.workunit.client.1.smithi098.stdout:0/570: rmdir df/d17/d1c/d2c/da6 0 2023-01-04T18:16:32.017 INFO:tasks.workunit.client.1.smithi098.stdout:0/571: fdatasync df/d17/f4b 0 2023-01-04T18:16:32.017 INFO:tasks.workunit.client.1.smithi098.stdout:0/572: fsync df/d17/d9b/f97 0 2023-01-04T18:16:32.018 INFO:tasks.workunit.client.1.smithi098.stdout:0/573: dread df/d17/f4b [4194304,4194304] 0 2023-01-04T18:16:32.020 INFO:tasks.workunit.client.1.smithi098.stdout:6/589: mkdir d9/dd/d4e/d67/db6 0 2023-01-04T18:16:32.022 INFO:tasks.workunit.client.1.smithi098.stdout:9/583: rmdir d2/d2d 39 2023-01-04T18:16:32.022 INFO:tasks.workunit.client.1.smithi098.stdout:9/584: write d2/d5/d18/d4e/d42/d89/dac/d26/fae [780638,80659] 0 2023-01-04T18:16:32.022 INFO:tasks.workunit.client.1.smithi098.stdout:9/585: write d2/d5/d18/d19/f54 [4402938,61374] 0 2023-01-04T18:16:32.025 INFO:tasks.workunit.client.1.smithi098.stdout:7/520: mkdir d1/db2 0 2023-01-04T18:16:32.027 INFO:tasks.workunit.client.1.smithi098.stdout:5/548: creat d1/d2/d14/d19/fa6 x:0 0 0 2023-01-04T18:16:32.027 INFO:tasks.workunit.client.1.smithi098.stdout:5/549: fdatasync d1/da/d44/d45/f5b 0 2023-01-04T18:16:32.030 INFO:tasks.workunit.client.1.smithi098.stdout:3/596: creat d6/d10/d29/fd5 x:0 0 0 2023-01-04T18:16:32.031 INFO:tasks.workunit.client.1.smithi098.stdout:0/574: symlink df/d17/d68/lc4 0 2023-01-04T18:16:32.032 INFO:tasks.workunit.client.1.smithi098.stdout:6/590: symlink d9/dd/de/d26/lb7 0 2023-01-04T18:16:32.032 INFO:tasks.workunit.client.1.smithi098.stdout:9/586: mkdir d2/d5/d18/dc6 0 2023-01-04T18:16:32.033 INFO:tasks.workunit.client.1.smithi098.stdout:7/521: creat d1/fb3 x:0 0 0 2023-01-04T18:16:32.033 INFO:tasks.workunit.client.1.smithi098.stdout:9/587: write d2/d5/d18/d4e/d42/d89/dac/d26/f7e [2241474,48008] 0 2023-01-04T18:16:32.033 INFO:tasks.workunit.client.1.smithi098.stdout:9/588: fsync d2/d5/d18/d19/f4b 0 2023-01-04T18:16:32.034 INFO:tasks.workunit.client.1.smithi098.stdout:5/550: mknod d1/d2/d14/d59/ca7 0 2023-01-04T18:16:32.034 INFO:tasks.workunit.client.1.smithi098.stdout:3/597: symlink d6/d10/d29/d6a/dd1/ld6 0 2023-01-04T18:16:32.036 INFO:tasks.workunit.client.1.smithi098.stdout:0/575: unlink df/d17/d1c/lbe 0 2023-01-04T18:16:32.037 INFO:tasks.workunit.client.1.smithi098.stdout:6/591: mknod d9/dd/d24/d65/cb8 0 2023-01-04T18:16:32.037 INFO:tasks.workunit.client.1.smithi098.stdout:6/592: stat d9/dd/d4e/c7f 0 2023-01-04T18:16:32.037 INFO:tasks.workunit.client.1.smithi098.stdout:6/593: chown d9/dd/d24/d3e/f87 2829 1 2023-01-04T18:16:32.038 INFO:tasks.workunit.client.1.smithi098.stdout:7/522: creat d1/d51/d26/d28/d2d/d6b/fb4 x:0 0 0 2023-01-04T18:16:32.038 INFO:tasks.workunit.client.1.smithi098.stdout:7/523: chown d1/da/c41 1411 1 2023-01-04T18:16:32.039 INFO:tasks.workunit.client.1.smithi098.stdout:7/524: chown d1/c3f 25609 1 2023-01-04T18:16:32.041 INFO:tasks.workunit.client.1.smithi098.stdout:9/589: getdents d2/d5/d18/d19 0 2023-01-04T18:16:32.042 INFO:tasks.workunit.client.1.smithi098.stdout:3/598: rename d6/cb to d6/d10/d19/d3f/d5e/d7d/cd7 0 2023-01-04T18:16:32.044 INFO:tasks.workunit.client.1.smithi098.stdout:0/576: link df/d17/d1c/d2c/d41/da0/fa3 df/d17/d9b/d86/fc5 0 2023-01-04T18:16:32.045 INFO:tasks.workunit.client.1.smithi098.stdout:0/577: write df/d17/d1c/f1e [2153591,21685] 0 2023-01-04T18:16:32.046 INFO:tasks.workunit.client.1.smithi098.stdout:7/525: unlink d1/d2e/c3a 0 2023-01-04T18:16:32.047 INFO:tasks.workunit.client.1.smithi098.stdout:9/590: truncate d2/d5/d18/d4e/d42/d89/dac/d26/f37 406127 0 2023-01-04T18:16:32.051 INFO:tasks.workunit.client.1.smithi098.stdout:3/599: unlink d6/d10/c2c 0 2023-01-04T18:16:32.052 INFO:tasks.workunit.client.1.smithi098.stdout:0/578: symlink df/d17/d1c/d2c/dba/lc6 0 2023-01-04T18:16:32.054 INFO:tasks.workunit.client.1.smithi098.stdout:9/591: mknod d2/d5/d18/d1d/d23/d5c/cc7 0 2023-01-04T18:16:32.054 INFO:tasks.workunit.client.1.smithi098.stdout:9/592: stat d2/d5/d18/d1d/d23/d5c/fb4 0 2023-01-04T18:16:32.054 INFO:tasks.workunit.client.1.smithi098.stdout:9/593: readlink d2/d5/d18/d1d/d23/l40 0 2023-01-04T18:16:32.054 INFO:tasks.workunit.client.1.smithi098.stdout:0/579: write df/d17/d24/d80/f8f [649687,105760] 0 2023-01-04T18:16:32.056 INFO:tasks.workunit.client.1.smithi098.stdout:9/594: dread d2/d5/d18/d19/f92 [0,4194304] 0 2023-01-04T18:16:32.056 INFO:tasks.workunit.client.1.smithi098.stdout:9/595: chown d2/d5/d18/d4e/d42/d89/dac 0 1 2023-01-04T18:16:32.056 INFO:tasks.workunit.client.1.smithi098.stdout:9/596: write d2/d5/d18/d4e/d42/d89/fa4 [220567,42297] 0 2023-01-04T18:16:32.056 INFO:tasks.workunit.client.1.smithi098.stdout:0/580: mkdir df/d4f/dc7 0 2023-01-04T18:16:32.056 INFO:tasks.workunit.client.1.smithi098.stdout:0/581: stat df/d17/d1c/d2c/d41/d4a/d4c/d90 0 2023-01-04T18:16:32.058 INFO:tasks.workunit.client.1.smithi098.stdout:9/597: link d2/d5/d18/d1d/d23/dad/d72/d9e/fa0 d2/d5/d18/d4e/fc8 0 2023-01-04T18:16:32.058 INFO:tasks.workunit.client.1.smithi098.stdout:9/598: readlink d2/d5/d6f/lb8 0 2023-01-04T18:16:32.058 INFO:tasks.workunit.client.1.smithi098.stdout:0/582: write df/d17/d9b/f97 [734580,121467] 0 2023-01-04T18:16:32.059 INFO:tasks.workunit.client.1.smithi098.stdout:5/551: dwrite d1/f2e [0,4194304] 0 2023-01-04T18:16:32.059 INFO:tasks.workunit.client.1.smithi098.stdout:9/599: mknod d2/d5/d18/d19/d82/cc9 0 2023-01-04T18:16:32.059 INFO:tasks.workunit.client.1.smithi098.stdout:7/526: dwrite d1/d23/d73/d85/f9b [0,4194304] 0 2023-01-04T18:16:32.061 INFO:tasks.workunit.client.1.smithi098.stdout:0/583: creat df/d17/d9b/d86/fc8 x:0 0 0 2023-01-04T18:16:32.066 INFO:tasks.workunit.client.1.smithi098.stdout:3/600: dwrite d6/d10/f80 [4194304,4194304] 0 2023-01-04T18:16:32.066 INFO:tasks.workunit.client.1.smithi098.stdout:5/552: truncate d1/d38/f41 1438202 0 2023-01-04T18:16:32.075 INFO:tasks.workunit.client.1.smithi098.stdout:5/553: dread d1/f2e [0,4194304] 0 2023-01-04T18:16:32.076 INFO:tasks.workunit.client.1.smithi098.stdout:9/600: dwrite d2/d5/d18/d4e/d42/f64 [0,4194304] 0 2023-01-04T18:16:32.076 INFO:tasks.workunit.client.1.smithi098.stdout:9/601: dread - d2/d2d/fbd zero size 2023-01-04T18:16:32.076 INFO:tasks.workunit.client.1.smithi098.stdout:9/602: fsync d2/f8b 0 2023-01-04T18:16:32.086 INFO:tasks.workunit.client.1.smithi098.stdout:7/527: read d1/d23/d37/f71 [54404,56743] 0 2023-01-04T18:16:32.089 INFO:tasks.workunit.client.1.smithi098.stdout:3/601: mkdir d6/d10/dad/dd8 0 2023-01-04T18:16:32.089 INFO:tasks.workunit.client.1.smithi098.stdout:3/602: write d6/d10/d6b/fa4 [783970,107479] 0 2023-01-04T18:16:32.092 INFO:tasks.workunit.client.1.smithi098.stdout:5/554: creat d1/da/d44/d45/d4b/fa8 x:0 0 0 2023-01-04T18:16:32.093 INFO:tasks.workunit.client.1.smithi098.stdout:9/603: mkdir d2/d5/d18/d1d/d23/dad/d72/d9e/dca 0 2023-01-04T18:16:32.093 INFO:tasks.workunit.client.1.smithi098.stdout:2/545: sync 2023-01-04T18:16:32.093 INFO:tasks.workunit.client.1.smithi098.stdout:1/453: sync 2023-01-04T18:16:32.093 INFO:tasks.workunit.client.1.smithi098.stdout:7/528: getdents d1/d23/d21/d43 0 2023-01-04T18:16:32.098 INFO:tasks.workunit.client.1.smithi098.stdout:3/603: mknod d6/d10/d19/d3f/d5e/d74/cd9 0 2023-01-04T18:16:32.099 INFO:tasks.workunit.client.1.smithi098.stdout:9/604: mkdir d2/d5/d18/d4e/d42/d89/dcb 0 2023-01-04T18:16:32.099 INFO:tasks.workunit.client.1.smithi098.stdout:0/584: dread df/d17/d1c/d2c/d41/f92 [0,4194304] 0 2023-01-04T18:16:32.099 INFO:tasks.workunit.client.1.smithi098.stdout:0/585: write df/d17/d24/fbb [547835,101123] 0 2023-01-04T18:16:32.099 INFO:tasks.workunit.client.1.smithi098.stdout:7/529: symlink d1/da/lb5 0 2023-01-04T18:16:32.104 INFO:tasks.workunit.client.1.smithi098.stdout:3/604: mkdir d6/d10/dad/dda 0 2023-01-04T18:16:32.104 INFO:tasks.workunit.client.1.smithi098.stdout:2/546: symlink d6/dc/d2b/d42/d47/d31/lbb 0 2023-01-04T18:16:32.104 INFO:tasks.workunit.client.1.smithi098.stdout:3/605: stat d6/d10/dad/dda 0 2023-01-04T18:16:32.104 INFO:tasks.workunit.client.1.smithi098.stdout:0/586: symlink df/d17/d1c/d3b/lc9 0 2023-01-04T18:16:32.104 INFO:tasks.workunit.client.1.smithi098.stdout:2/547: truncate d6/dc/d2b/d42/d47/d35/f38 5057401 0 2023-01-04T18:16:32.104 INFO:tasks.workunit.client.1.smithi098.stdout:1/454: rename d1/d25/f59 to d1/d25/d27/d77/fa3 0 2023-01-04T18:16:32.105 INFO:tasks.workunit.client.1.smithi098.stdout:3/606: rmdir d6/d56/d9f 39 2023-01-04T18:16:32.106 INFO:tasks.workunit.client.1.smithi098.stdout:3/607: creat d6/d10/d19/d3f/fdb x:0 0 0 2023-01-04T18:16:32.108 INFO:tasks.workunit.client.1.smithi098.stdout:3/608: symlink d6/d10/d19/d3f/d5e/d7d/ldc 0 2023-01-04T18:16:32.109 INFO:tasks.workunit.client.1.smithi098.stdout:2/548: dread d6/dc/f1b [0,4194304] 0 2023-01-04T18:16:32.111 INFO:tasks.workunit.client.1.smithi098.stdout:2/549: getdents d6/dc/d2b/d42/d51 0 2023-01-04T18:16:32.112 INFO:tasks.workunit.client.1.smithi098.stdout:7/530: dread d1/d4/f29 [0,4194304] 0 2023-01-04T18:16:32.113 INFO:tasks.workunit.client.1.smithi098.stdout:5/555: dwrite d1/d2/d14/d19/fa6 [0,4194304] 0 2023-01-04T18:16:32.114 INFO:tasks.workunit.client.1.smithi098.stdout:2/550: symlink d6/dc/d2b/d42/d47/da5/lbc 0 2023-01-04T18:16:32.115 INFO:tasks.workunit.client.1.smithi098.stdout:7/531: write d1/f45 [4642278,53476] 0 2023-01-04T18:16:32.115 INFO:tasks.workunit.client.1.smithi098.stdout:5/556: write d1/f6f [373494,22400] 0 2023-01-04T18:16:32.121 INFO:tasks.workunit.client.1.smithi098.stdout:9/605: dwrite d2/d5/d18/d1d/fb1 [0,4194304] 0 2023-01-04T18:16:32.129 INFO:tasks.workunit.client.1.smithi098.stdout:2/551: symlink d6/dc/d2b/d42/d51/d79/da3/db5/lbd 0 2023-01-04T18:16:32.130 INFO:tasks.workunit.client.1.smithi098.stdout:7/532: rename d1/d4/d11/f9c to d1/d51/d26/d28/d2d/d75/fb6 0 2023-01-04T18:16:32.131 INFO:tasks.workunit.client.1.smithi098.stdout:7/533: write d1/d2e/f35 [4931539,84744] 0 2023-01-04T18:16:32.131 INFO:tasks.workunit.client.1.smithi098.stdout:7/534: dread - d1/d51/d26/f8c zero size 2023-01-04T18:16:32.131 INFO:tasks.workunit.client.1.smithi098.stdout:1/455: dwrite d1/d25/d27/d77/fa3 [0,4194304] 0 2023-01-04T18:16:32.132 INFO:tasks.workunit.client.1.smithi098.stdout:5/557: link d1/l72 d1/d2f/la9 0 2023-01-04T18:16:32.132 INFO:tasks.workunit.client.1.smithi098.stdout:5/558: chown d1/d2f/f64 3958 1 2023-01-04T18:16:32.132 INFO:tasks.workunit.client.1.smithi098.stdout:5/559: write d1/d2/d14/d59/f8a [84417,65222] 0 2023-01-04T18:16:32.133 INFO:tasks.workunit.client.1.smithi098.stdout:0/587: dwrite df/d17/d1c/d2c/d41/d4a/f65 [0,4194304] 0 2023-01-04T18:16:32.134 INFO:tasks.workunit.client.1.smithi098.stdout:2/552: truncate d6/f3e 3235810 0 2023-01-04T18:16:32.134 INFO:tasks.workunit.client.1.smithi098.stdout:2/553: chown d6/dc/d2b/d42/d47/d31 15869845 1 2023-01-04T18:16:32.135 INFO:tasks.workunit.client.1.smithi098.stdout:1/456: write d1/d8/da/f48 [3604797,13580] 0 2023-01-04T18:16:32.135 INFO:tasks.workunit.client.1.smithi098.stdout:3/609: dwrite d6/d10/d19/d3f/f9c [0,4194304] 0 2023-01-04T18:16:32.135 INFO:tasks.workunit.client.1.smithi098.stdout:3/610: fdatasync d6/d10/d19/d3f/d5e/d74/f48 0 2023-01-04T18:16:32.135 INFO:tasks.workunit.client.1.smithi098.stdout:3/611: chown d6/d10/d19/d3f/d5e/d7d/f5c 315 1 2023-01-04T18:16:32.136 INFO:tasks.workunit.client.1.smithi098.stdout:9/606: dread d2/d5/d18/d4e/d42/d89/fa4 [0,4194304] 0 2023-01-04T18:16:32.138 INFO:tasks.workunit.client.1.smithi098.stdout:8/527: sync 2023-01-04T18:16:32.138 INFO:tasks.workunit.client.1.smithi098.stdout:4/489: sync 2023-01-04T18:16:32.138 INFO:tasks.workunit.client.1.smithi098.stdout:8/528: chown d6/d11/d15/d1b/d2a/d3b/l87 26846 1 2023-01-04T18:16:32.138 INFO:tasks.workunit.client.1.smithi098.stdout:4/490: write d5/de/d21/d75/d83/f8f [1548,47824] 22 2023-01-04T18:16:32.139 INFO:tasks.workunit.client.1.smithi098.stdout:7/535: mkdir d1/d23/d21/db7 0 2023-01-04T18:16:32.140 INFO:tasks.workunit.client.1.smithi098.stdout:5/560: rmdir d1/d38/d3b/d8f 39 2023-01-04T18:16:32.143 INFO:tasks.workunit.client.1.smithi098.stdout:0/588: getdents df/d17 0 2023-01-04T18:16:32.144 INFO:tasks.workunit.client.1.smithi098.stdout:1/457: dread d1/f1b [0,4194304] 0 2023-01-04T18:16:32.144 INFO:tasks.workunit.client.1.smithi098.stdout:2/554: creat d6/dc/fbe x:0 0 0 2023-01-04T18:16:32.150 INFO:tasks.workunit.client.1.smithi098.stdout:9/607: creat d2/d5/d18/d1d/dc0/fcc x:0 0 0 2023-01-04T18:16:32.150 INFO:tasks.workunit.client.1.smithi098.stdout:9/608: chown d2/d5/c15 9965917 1 2023-01-04T18:16:32.151 INFO:tasks.workunit.client.1.smithi098.stdout:8/529: getdents d6/d11/d15/d1b/d2a/d6b/d7f/d12 0 2023-01-04T18:16:32.153 INFO:tasks.workunit.client.1.smithi098.stdout:4/491: unlink d5/d9/lb 0 2023-01-04T18:16:32.153 INFO:tasks.workunit.client.1.smithi098.stdout:4/492: dread - d5/de/d21/d75/f99 zero size 2023-01-04T18:16:32.154 INFO:tasks.workunit.client.1.smithi098.stdout:3/612: dwrite d6/d10/d19/f3a [0,4194304] 0 2023-01-04T18:16:32.154 INFO:tasks.workunit.client.1.smithi098.stdout:5/561: creat d1/da/d44/d45/d4b/d61/faa x:0 0 0 2023-01-04T18:16:32.156 INFO:tasks.workunit.client.1.smithi098.stdout:7/536: creat d1/d2e/fb8 x:0 0 0 2023-01-04T18:16:32.156 INFO:tasks.workunit.client.1.smithi098.stdout:7/537: fsync d1/d51/d26/d28/d2d/fa9 0 2023-01-04T18:16:32.156 INFO:tasks.workunit.client.1.smithi098.stdout:7/538: chown d1/f7a 0 1 2023-01-04T18:16:32.157 INFO:tasks.workunit.client.1.smithi098.stdout:1/458: symlink d1/d8/d53/la4 0 2023-01-04T18:16:32.158 INFO:tasks.workunit.client.1.smithi098.stdout:5/562: dread d1/d2/d14/d19/f35 [0,4194304] 0 2023-01-04T18:16:32.161 INFO:tasks.workunit.client.1.smithi098.stdout:6/594: sync 2023-01-04T18:16:32.162 INFO:tasks.workunit.client.1.smithi098.stdout:5/563: dread d1/da/d44/f70 [0,4194304] 0 2023-01-04T18:16:32.162 INFO:tasks.workunit.client.1.smithi098.stdout:5/564: chown d1/da/d44/d83 37 1 2023-01-04T18:16:32.163 INFO:tasks.workunit.client.1.smithi098.stdout:8/530: unlink d6/d11/d15/d1b/d2a/d6b/d7f/d78/l83 0 2023-01-04T18:16:32.166 INFO:tasks.workunit.client.1.smithi098.stdout:4/493: rename d5/d9/d13/l3f to d5/d9/d13/d65/d98/la3 0 2023-01-04T18:16:32.166 INFO:tasks.workunit.client.1.smithi098.stdout:4/494: rename d5 to d5/d28/d40/d5d/da4 22 2023-01-04T18:16:32.167 INFO:tasks.workunit.client.1.smithi098.stdout:7/539: unlink d1/d2e/f95 0 2023-01-04T18:16:32.170 INFO:tasks.workunit.client.1.smithi098.stdout:1/459: link d1/d25/d39/c3d d1/d8/d53/ca5 0 2023-01-04T18:16:32.170 INFO:tasks.workunit.client.1.smithi098.stdout:4/495: write d5/de/d2c/f7f [763213,66796] 0 2023-01-04T18:16:32.172 INFO:tasks.workunit.client.1.smithi098.stdout:2/555: link d6/dc/d2b/d42/d47/d1f/d39/d6e/f77 d6/fbf 0 2023-01-04T18:16:32.173 INFO:tasks.workunit.client.1.smithi098.stdout:5/565: mkdir d1/d1e/dab 0 2023-01-04T18:16:32.174 INFO:tasks.workunit.client.1.smithi098.stdout:5/566: chown d1/d2f/f64 0 1 2023-01-04T18:16:32.174 INFO:tasks.workunit.client.1.smithi098.stdout:5/567: chown d1/da/d44/d45/d4b/f4f 5635622 1 2023-01-04T18:16:32.174 INFO:tasks.workunit.client.1.smithi098.stdout:8/531: symlink d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/l96 0 2023-01-04T18:16:32.174 INFO:tasks.workunit.client.1.smithi098.stdout:8/532: write d6/d11/d15/d1b/d2a/d6b/d7f/f2e [1059593,76142] 0 2023-01-04T18:16:32.175 INFO:tasks.workunit.client.1.smithi098.stdout:1/460: symlink d1/la6 0 2023-01-04T18:16:32.175 INFO:tasks.workunit.client.1.smithi098.stdout:4/496: creat d5/d9/fa5 x:0 0 0 2023-01-04T18:16:32.177 INFO:tasks.workunit.client.1.smithi098.stdout:2/556: link d6/dc/d2b/d42/d47/l34 d6/dc/d2b/d42/d47/d1f/d39/lc0 0 2023-01-04T18:16:32.177 INFO:tasks.workunit.client.1.smithi098.stdout:2/557: dread - d6/dc/d2b/d42/d51/d79/f8d zero size 2023-01-04T18:16:32.177 INFO:tasks.workunit.client.1.smithi098.stdout:2/558: dread - d6/dc/d2b/d42/d51/d79/fba zero size 2023-01-04T18:16:32.178 INFO:tasks.workunit.client.1.smithi098.stdout:5/568: symlink d1/d2f/d66/lac 0 2023-01-04T18:16:32.178 INFO:tasks.workunit.client.1.smithi098.stdout:5/569: dread - d1/d2f/d66/d75/fa0 zero size 2023-01-04T18:16:32.178 INFO:tasks.workunit.client.1.smithi098.stdout:5/570: read d1/d2/d14/d19/f79 [14506,67092] 0 2023-01-04T18:16:32.179 INFO:tasks.workunit.client.1.smithi098.stdout:3/613: dwrite d6/d10/d19/d3f/d5e/d74/f45 [0,4194304] 0 2023-01-04T18:16:32.179 INFO:tasks.workunit.client.1.smithi098.stdout:0/589: dwrite df/d17/d24/d80/f8f [0,4194304] 0 2023-01-04T18:16:32.180 INFO:tasks.workunit.client.1.smithi098.stdout:8/533: rename d6/d11/d15/c2d to d6/d11/d15/d1b/d2a/d3b/c97 0 2023-01-04T18:16:32.180 INFO:tasks.workunit.client.1.smithi098.stdout:6/595: dwrite d9/dd/de/d20/f5d [0,4194304] 0 2023-01-04T18:16:32.180 INFO:tasks.workunit.client.1.smithi098.stdout:1/461: creat d1/d25/d27/fa7 x:0 0 0 2023-01-04T18:16:32.181 INFO:tasks.workunit.client.1.smithi098.stdout:4/497: mkdir d5/d28/da6 0 2023-01-04T18:16:32.182 INFO:tasks.workunit.client.1.smithi098.stdout:2/559: symlink d6/dc/d2b/d42/d51/d81/d8f/lc1 0 2023-01-04T18:16:32.183 INFO:tasks.workunit.client.1.smithi098.stdout:2/560: dread d6/dc/d2b/d42/d47/d1f/d39/f56 [0,4194304] 0 2023-01-04T18:16:32.185 INFO:tasks.workunit.client.1.smithi098.stdout:3/614: creat d6/d6f/fdd x:0 0 0 2023-01-04T18:16:32.187 INFO:tasks.workunit.client.1.smithi098.stdout:4/498: dread d5/de/f5a [0,4194304] 0 2023-01-04T18:16:32.187 INFO:tasks.workunit.client.1.smithi098.stdout:3/615: dread d6/f53 [0,4194304] 0 2023-01-04T18:16:32.188 INFO:tasks.workunit.client.1.smithi098.stdout:3/616: write d6/d10/d6b/f7c [1865293,48944] 0 2023-01-04T18:16:32.189 INFO:tasks.workunit.client.1.smithi098.stdout:0/590: write df/d4f/d6e/f87 [958721,45663] 0 2023-01-04T18:16:32.190 INFO:tasks.workunit.client.1.smithi098.stdout:6/596: mknod d9/dd/de/d20/cb9 0 2023-01-04T18:16:32.190 INFO:tasks.workunit.client.1.smithi098.stdout:6/597: fsync d9/dd/d15/f41 0 2023-01-04T18:16:32.190 INFO:tasks.workunit.client.1.smithi098.stdout:6/598: dread - d9/dd/d4e/f6a zero size 2023-01-04T18:16:32.191 INFO:tasks.workunit.client.1.smithi098.stdout:6/599: write d9/fa [8543803,3063] 0 2023-01-04T18:16:32.193 INFO:tasks.workunit.client.1.smithi098.stdout:4/499: symlink d5/d28/da6/la7 0 2023-01-04T18:16:32.193 INFO:tasks.workunit.client.1.smithi098.stdout:3/617: symlink d6/d10/d19/d3f/d5e/lde 0 2023-01-04T18:16:32.195 INFO:tasks.workunit.client.1.smithi098.stdout:0/591: truncate df/d17/d1c/f22 223122 0 2023-01-04T18:16:32.195 INFO:tasks.workunit.client.1.smithi098.stdout:0/592: fsync df/d4f/f55 0 2023-01-04T18:16:32.195 INFO:tasks.workunit.client.1.smithi098.stdout:6/600: symlink d9/lba 0 2023-01-04T18:16:32.197 INFO:tasks.workunit.client.1.smithi098.stdout:1/462: rename d1/d25/d27/d77/d54 to d1/d25/d27/d77/da8 0 2023-01-04T18:16:32.197 INFO:tasks.workunit.client.1.smithi098.stdout:1/463: write d1/f22 [4195223,81005] 0 2023-01-04T18:16:32.199 INFO:tasks.workunit.client.1.smithi098.stdout:2/561: rename d6/dc/d2b/d42/d47/c4c to d6/dc/d2b/d42/d47/da5/cc2 0 2023-01-04T18:16:32.201 INFO:tasks.workunit.client.1.smithi098.stdout:8/534: dread d6/d11/d15/d1b/d2a/d3b/f5d [0,4194304] 0 2023-01-04T18:16:32.201 INFO:tasks.workunit.client.1.smithi098.stdout:8/535: fdatasync d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/f3a 0 2023-01-04T18:16:32.201 INFO:tasks.workunit.client.1.smithi098.stdout:3/618: unlink d6/f41 0 2023-01-04T18:16:32.205 INFO:tasks.workunit.client.1.smithi098.stdout:0/593: mknod df/d17/d1c/d3b/cca 0 2023-01-04T18:16:32.207 INFO:tasks.workunit.client.1.smithi098.stdout:4/500: rename d5/f47 to d5/d9/d13/d65/d98/fa8 0 2023-01-04T18:16:32.208 INFO:tasks.workunit.client.1.smithi098.stdout:4/501: write d5/f8 [2440182,66987] 0 2023-01-04T18:16:32.208 INFO:tasks.workunit.client.1.smithi098.stdout:4/502: readlink d5/d9/d13/l19 0 2023-01-04T18:16:32.214 INFO:tasks.workunit.client.1.smithi098.stdout:8/536: unlink d6/d11/d15/d1b/d2a/c60 0 2023-01-04T18:16:32.214 INFO:tasks.workunit.client.1.smithi098.stdout:8/537: chown d6/d11/d15/d1b/d2a/d3b/d4c/d54/d6a/l90 227504779 1 2023-01-04T18:16:32.220 INFO:tasks.workunit.client.1.smithi098.stdout:0/594: unlink df/f60 0 2023-01-04T18:16:32.224 INFO:tasks.workunit.client.1.smithi098.stdout:6/601: rename d9/dd/de/d20/l35 to d9/dd/de/d26/d71/lbb 0 2023-01-04T18:16:32.224 INFO:tasks.workunit.client.1.smithi098.stdout:2/562: dread d6/dc/d2b/d42/d47/d1f/d39/f64 [0,4194304] 0 2023-01-04T18:16:32.224 INFO:tasks.workunit.client.1.smithi098.stdout:4/503: symlink d5/de/d21/d75/la9 0 2023-01-04T18:16:32.224 INFO:tasks.workunit.client.1.smithi098.stdout:4/504: chown d5/de/d21/c6e 121974 1 2023-01-04T18:16:32.226 INFO:tasks.workunit.client.1.smithi098.stdout:0/595: mkdir df/d17/d24/dcb 0 2023-01-04T18:16:32.228 INFO:tasks.workunit.client.1.smithi098.stdout:6/602: rename d9/dd/d4e/d67/d8d/d81/c88 to d9/dd/de/d44/d79/cbc 0 2023-01-04T18:16:32.229 INFO:tasks.workunit.client.1.smithi098.stdout:2/563: creat d6/dc/d2b/d42/d51/d81/fc3 x:0 0 0 2023-01-04T18:16:32.229 INFO:tasks.workunit.client.1.smithi098.stdout:2/564: stat d6/dc/d2b/d42/d47/d31/l50 0 2023-01-04T18:16:32.229 INFO:tasks.workunit.client.1.smithi098.stdout:2/565: fsync d6/dc/fe 0 2023-01-04T18:16:32.231 INFO:tasks.workunit.client.1.smithi098.stdout:0/596: mkdir df/d17/d24/dcc 0 2023-01-04T18:16:32.232 INFO:tasks.workunit.client.1.smithi098.stdout:6/603: rmdir d9/dd/de/d20/d82/d84/d8a 39 2023-01-04T18:16:32.233 INFO:tasks.workunit.client.1.smithi098.stdout:3/619: dwrite d6/d10/d19/d3f/d5e/d74/f89 [0,4194304] 0 2023-01-04T18:16:32.236 INFO:tasks.workunit.client.1.smithi098.stdout:0/597: rmdir df/d17/d24/dcc 0 2023-01-04T18:16:32.236 INFO:tasks.workunit.client.1.smithi098.stdout:8/538: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/f8c [0,4194304] 0 2023-01-04T18:16:32.238 INFO:tasks.workunit.client.1.smithi098.stdout:6/604: mknod d9/dd/de/d44/d7a/cbd 0 2023-01-04T18:16:32.241 INFO:tasks.workunit.client.1.smithi098.stdout:4/505: dwrite d5/de/d21/d9d/f9c [0,4194304] 0 2023-01-04T18:16:32.241 INFO:tasks.workunit.client.1.smithi098.stdout:4/506: chown d5/l18 874179 1 2023-01-04T18:16:32.247 INFO:tasks.workunit.client.1.smithi098.stdout:3/620: rmdir d6/d10/dad/dd8 0 2023-01-04T18:16:32.249 INFO:tasks.workunit.client.1.smithi098.stdout:2/566: dwrite d6/dc/d2b/d46/f86 [0,4194304] 0 2023-01-04T18:16:32.253 INFO:tasks.workunit.client.1.smithi098.stdout:0/598: rename df/d17/d1c/d2c/d41/d4a/d4c/d5f/f63 to df/d17/fcd 0 2023-01-04T18:16:32.256 INFO:tasks.workunit.client.1.smithi098.stdout:8/539: fsync d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/f47 0 2023-01-04T18:16:32.256 INFO:tasks.workunit.client.1.smithi098.stdout:8/540: chown d6/l52 15 1 2023-01-04T18:16:32.257 INFO:tasks.workunit.client.1.smithi098.stdout:8/541: read d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/f61 [21716,89284] 0 2023-01-04T18:16:32.258 INFO:tasks.workunit.client.1.smithi098.stdout:4/507: dwrite d5/f37 [0,4194304] 0 2023-01-04T18:16:32.259 INFO:tasks.workunit.client.1.smithi098.stdout:6/605: dwrite d9/dd/de/d20/f3f [4194304,4194304] 0 2023-01-04T18:16:32.259 INFO:tasks.workunit.client.1.smithi098.stdout:6/606: fdatasync d9/dd/d4e/d67/d8d/f6f 0 2023-01-04T18:16:32.266 INFO:tasks.workunit.client.1.smithi098.stdout:0/599: creat df/d17/d1c/d2c/d41/d64/fce x:0 0 0 2023-01-04T18:16:32.266 INFO:tasks.workunit.client.1.smithi098.stdout:0/600: readlink df/d17/d24/l39 0 2023-01-04T18:16:32.266 INFO:tasks.workunit.client.1.smithi098.stdout:8/542: truncate d6/d11/d15/d1b/d2a/d3b/f38 5741411 0 2023-01-04T18:16:32.268 INFO:tasks.workunit.client.1.smithi098.stdout:0/601: dread df/f52 [0,4194304] 0 2023-01-04T18:16:32.271 INFO:tasks.workunit.client.1.smithi098.stdout:8/543: mknod d6/d11/d15/d1b/d2a/d3b/d79/c98 0 2023-01-04T18:16:32.273 INFO:tasks.workunit.client.1.smithi098.stdout:0/602: unlink df/d17/d24/c36 0 2023-01-04T18:16:32.275 INFO:tasks.workunit.client.1.smithi098.stdout:8/544: getdents d6/d11/d15/d1b/d2a/d3b/d59/d6e 0 2023-01-04T18:16:32.277 INFO:tasks.workunit.client.1.smithi098.stdout:0/603: mknod df/d17/d1c/d2c/d41/d4a/d4c/d90/ccf 0 2023-01-04T18:16:32.277 INFO:tasks.workunit.client.1.smithi098.stdout:8/545: mknod d6/d11/d15/d1b/d2a/c99 0 2023-01-04T18:16:32.282 INFO:tasks.workunit.client.1.smithi098.stdout:8/546: write d6/d11/d15/d1b/d2a/d6b/d7f/d12/f4f [1977588,75766] 0 2023-01-04T18:16:32.282 INFO:tasks.workunit.client.1.smithi098.stdout:8/547: chown d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d64/l86 2 1 2023-01-04T18:16:32.289 INFO:tasks.workunit.client.1.smithi098.stdout:9/609: sync 2023-01-04T18:16:32.293 INFO:tasks.workunit.client.1.smithi098.stdout:2/567: dwrite d6/dc/d2b/d32/f61 [0,4194304] 0 2023-01-04T18:16:32.293 INFO:tasks.workunit.client.1.smithi098.stdout:4/508: dwrite f4 [0,4194304] 0 2023-01-04T18:16:32.294 INFO:tasks.workunit.client.1.smithi098.stdout:3/621: dwrite d6/d10/d19/f76 [0,4194304] 0 2023-01-04T18:16:32.294 INFO:tasks.workunit.client.1.smithi098.stdout:4/509: write d5/d9/f1a [454336,126964] 0 2023-01-04T18:16:32.295 INFO:tasks.workunit.client.1.smithi098.stdout:0/604: dwrite df/d17/d24/f34 [4194304,4194304] 0 2023-01-04T18:16:32.295 INFO:tasks.workunit.client.1.smithi098.stdout:6/607: dwrite d9/dd/d24/d3e/f87 [0,4194304] 0 2023-01-04T18:16:32.296 INFO:tasks.workunit.client.1.smithi098.stdout:0/605: read df/d4f/f5d [113995,34291] 0 2023-01-04T18:16:32.297 INFO:tasks.workunit.client.1.smithi098.stdout:0/606: chown df/d17/d24/f44 3797 1 2023-01-04T18:16:32.301 INFO:tasks.workunit.client.1.smithi098.stdout:4/510: symlink d5/d9/d13/d65/laa 0 2023-01-04T18:16:32.305 INFO:tasks.workunit.client.1.smithi098.stdout:6/608: link d9/dd/d24/d3e/f55 d9/dd/de/d20/d82/fbe 0 2023-01-04T18:16:32.305 INFO:tasks.workunit.client.1.smithi098.stdout:6/609: write d9/dd/d24/d3e/fa4 [922612,6539] 0 2023-01-04T18:16:32.307 INFO:tasks.workunit.client.1.smithi098.stdout:4/511: mkdir d5/d9/d13/dab 0 2023-01-04T18:16:32.308 INFO:tasks.workunit.client.1.smithi098.stdout:6/610: mknod d9/dd/d4e/d67/cbf 0 2023-01-04T18:16:32.311 INFO:tasks.workunit.client.1.smithi098.stdout:0/607: rename df/d17/d1c/d2c/d41/d4a/d4c/d5f/f93 to df/d4f/d6e/daf/fd0 0 2023-01-04T18:16:32.311 INFO:tasks.workunit.client.1.smithi098.stdout:0/608: write df/d17/f2a [4035569,37937] 0 2023-01-04T18:16:32.313 INFO:tasks.workunit.client.1.smithi098.stdout:4/512: link d5/de/d30/d4f/c58 d5/d28/da6/cac 0 2023-01-04T18:16:32.313 INFO:tasks.workunit.client.1.smithi098.stdout:4/513: chown d5/de/d21/la1 93 1 2023-01-04T18:16:32.313 INFO:tasks.workunit.client.1.smithi098.stdout:4/514: truncate d5/d28/d40/f64 250364 0 2023-01-04T18:16:32.313 INFO:tasks.workunit.client.1.smithi098.stdout:4/515: chown d5/de/d30/f68 966834892 1 2023-01-04T18:16:32.314 INFO:tasks.workunit.client.1.smithi098.stdout:8/548: dwrite d6/f8d [0,4194304] 0 2023-01-04T18:16:32.314 INFO:tasks.workunit.client.1.smithi098.stdout:8/549: chown d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e 342 1 2023-01-04T18:16:32.319 INFO:tasks.workunit.client.1.smithi098.stdout:4/516: rename d5/de/d21/d75 to d5/dad 0 2023-01-04T18:16:32.319 INFO:tasks.workunit.client.1.smithi098.stdout:0/609: dread df/d17/d1c/d2c/d41/d4a/f65 [0,4194304] 0 2023-01-04T18:16:32.324 INFO:tasks.workunit.client.1.smithi098.stdout:8/550: dread d6/fe [0,4194304] 0 2023-01-04T18:16:32.327 INFO:tasks.workunit.client.1.smithi098.stdout:0/610: truncate df/d4f/d6e/daf/fd0 1272709 0 2023-01-04T18:16:32.327 INFO:tasks.workunit.client.1.smithi098.stdout:8/551: getdents d6/d11/d15/d1b/d2a/d3b/d4c 0 2023-01-04T18:16:32.329 INFO:tasks.workunit.client.1.smithi098.stdout:8/552: getdents d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67 0 2023-01-04T18:16:32.329 INFO:tasks.workunit.client.1.smithi098.stdout:8/553: stat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d44/c63 0 2023-01-04T18:16:32.330 INFO:tasks.workunit.client.1.smithi098.stdout:8/554: creat d6/d11/d15/f9a x:0 0 0 2023-01-04T18:16:32.330 INFO:tasks.workunit.client.1.smithi098.stdout:8/555: chown d6/d11/d15/d1b/d2a/d6b/d7f/f2e 61047217 1 2023-01-04T18:16:32.336 INFO:tasks.workunit.client.1.smithi098.stdout:0/611: dread df/f3e [0,4194304] 0 2023-01-04T18:16:32.342 INFO:tasks.workunit.client.1.smithi098.stdout:8/556: dread d6/d11/d15/d1b/d2a/d3b/f35 [4194304,4194304] 0 2023-01-04T18:16:32.344 INFO:tasks.workunit.client.1.smithi098.stdout:8/557: rename d6/l31 to d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/l9b 0 2023-01-04T18:16:32.346 INFO:tasks.workunit.client.1.smithi098.stdout:8/558: mkdir d6/d11/d15/d1b/d2a/d6b/d9c 0 2023-01-04T18:16:32.346 INFO:tasks.workunit.client.1.smithi098.stdout:0/612: dread df/d17/d24/d80/f8f [0,4194304] 0 2023-01-04T18:16:32.347 INFO:tasks.workunit.client.1.smithi098.stdout:8/559: mkdir d6/d11/d15/d1b/d2a/d6b/d7f/d78/d9d 0 2023-01-04T18:16:32.347 INFO:tasks.workunit.client.1.smithi098.stdout:0/613: write df/d17/d1c/d3b/d98/f81 [275156,30914] 0 2023-01-04T18:16:32.347 INFO:tasks.workunit.client.1.smithi098.stdout:0/614: fdatasync f3 0 2023-01-04T18:16:32.348 INFO:tasks.workunit.client.1.smithi098.stdout:8/560: mknod d6/d11/d15/d1b/d2a/d6b/d9c/c9e 0 2023-01-04T18:16:32.349 INFO:tasks.workunit.client.1.smithi098.stdout:0/615: symlink df/d17/d1c/d2c/d41/d64/ld1 0 2023-01-04T18:16:32.349 INFO:tasks.workunit.client.1.smithi098.stdout:0/616: chown df/d17/d1c/d2c/d41/fae 4634 1 2023-01-04T18:16:32.350 INFO:tasks.workunit.client.1.smithi098.stdout:0/617: creat df/d17/d1c/d2c/d41/fd2 x:0 0 0 2023-01-04T18:16:32.352 INFO:tasks.workunit.client.1.smithi098.stdout:0/618: rename df/c29 to df/d4f/d6e/cd3 0 2023-01-04T18:16:32.361 INFO:tasks.workunit.client.1.smithi098.stdout:9/610: dwrite d2/d53/f5e [0,4194304] 0 2023-01-04T18:16:32.362 INFO:tasks.workunit.client.1.smithi098.stdout:9/611: truncate d2/d5/d18/d4e/d42/d89/dac/d78/fbc 1446293 0 2023-01-04T18:16:32.363 INFO:tasks.workunit.client.1.smithi098.stdout:9/612: mknod d2/d5/d18/d4e/d42/d89/ccd 0 2023-01-04T18:16:32.363 INFO:tasks.workunit.client.1.smithi098.stdout:9/613: write d2/f9c [1002608,21437] 0 2023-01-04T18:16:32.365 INFO:tasks.workunit.client.1.smithi098.stdout:4/517: dwrite f4 [0,4194304] 0 2023-01-04T18:16:32.365 INFO:tasks.workunit.client.1.smithi098.stdout:3/622: dwrite d6/d10/d19/f76 [0,4194304] 0 2023-01-04T18:16:32.367 INFO:tasks.workunit.client.1.smithi098.stdout:6/611: dwrite d9/fb1 [0,4194304] 0 2023-01-04T18:16:32.368 INFO:tasks.workunit.client.1.smithi098.stdout:8/561: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/f81 [0,4194304] 0 2023-01-04T18:16:32.378 INFO:tasks.workunit.client.1.smithi098.stdout:7/540: sync 2023-01-04T18:16:32.388 INFO:tasks.workunit.client.1.smithi098.stdout:3/623: dwrite d6/d56/f92 [0,4194304] 0 2023-01-04T18:16:32.391 INFO:tasks.workunit.client.1.smithi098.stdout:6/612: dread d9/dd/de/d26/f97 [0,4194304] 0 2023-01-04T18:16:32.391 INFO:tasks.workunit.client.1.smithi098.stdout:8/562: symlink d6/d11/d15/d1b/d2a/d3b/d4c/d54/l9f 0 2023-01-04T18:16:32.392 INFO:tasks.workunit.client.1.smithi098.stdout:7/541: rmdir d1/d51/d26 39 2023-01-04T18:16:32.395 INFO:tasks.workunit.client.1.smithi098.stdout:6/613: truncate d9/dd/d4e/f58 1294721 0 2023-01-04T18:16:32.397 INFO:tasks.workunit.client.1.smithi098.stdout:7/542: symlink d1/d51/lb9 0 2023-01-04T18:16:32.398 INFO:tasks.workunit.client.1.smithi098.stdout:9/614: dwrite d2/d5/d18/f44 [0,4194304] 0 2023-01-04T18:16:32.400 INFO:tasks.workunit.client.1.smithi098.stdout:0/619: dwrite df/d17/d1c/d3b/d98/f81 [0,4194304] 0 2023-01-04T18:16:32.401 INFO:tasks.workunit.client.1.smithi098.stdout:0/620: readlink df/d4f/d6b/l71 0 2023-01-04T18:16:32.401 INFO:tasks.workunit.client.1.smithi098.stdout:4/518: dwrite d5/de/f9e [0,4194304] 0 2023-01-04T18:16:32.402 INFO:tasks.workunit.client.1.smithi098.stdout:7/543: mkdir d1/d23/d73/dba 0 2023-01-04T18:16:32.404 INFO:tasks.workunit.client.1.smithi098.stdout:1/464: sync 2023-01-04T18:16:32.404 INFO:tasks.workunit.client.1.smithi098.stdout:5/571: sync 2023-01-04T18:16:32.407 INFO:tasks.workunit.client.1.smithi098.stdout:4/519: truncate f4 3911892 0 2023-01-04T18:16:32.407 INFO:tasks.workunit.client.1.smithi098.stdout:4/520: write d5/de/d21/f2d [1260121,48397] 0 2023-01-04T18:16:32.408 INFO:tasks.workunit.client.1.smithi098.stdout:9/615: dread d2/d5/d18/d4e/d42/d89/dac/d78/fbc [0,4194304] 0 2023-01-04T18:16:32.408 INFO:tasks.workunit.client.1.smithi098.stdout:9/616: chown d2/d5/d18/d4e/d42/d89/ccd 117 1 2023-01-04T18:16:32.413 INFO:tasks.workunit.client.1.smithi098.stdout:7/544: unlink d1/d23/d21/d43/c5a 0 2023-01-04T18:16:32.413 INFO:tasks.workunit.client.1.smithi098.stdout:1/465: mkdir d1/da9 0 2023-01-04T18:16:32.413 INFO:tasks.workunit.client.1.smithi098.stdout:5/572: creat d1/d2/d14/fad x:0 0 0 2023-01-04T18:16:32.414 INFO:tasks.workunit.client.1.smithi098.stdout:4/521: creat d5/dad/d83/fae x:0 0 0 2023-01-04T18:16:32.414 INFO:tasks.workunit.client.1.smithi098.stdout:4/522: chown d5/d9/d13/c85 113 1 2023-01-04T18:16:32.414 INFO:tasks.workunit.client.1.smithi098.stdout:4/523: chown d5/d9/c8e 13397383 1 2023-01-04T18:16:32.416 INFO:tasks.workunit.client.1.smithi098.stdout:3/624: dwrite d6/d10/d29/f2d [0,4194304] 0 2023-01-04T18:16:32.418 INFO:tasks.workunit.client.1.smithi098.stdout:7/545: unlink d1/d23/d21/l65 0 2023-01-04T18:16:32.419 INFO:tasks.workunit.client.1.smithi098.stdout:6/614: dwrite d9/dd/de/d26/f74 [0,4194304] 0 2023-01-04T18:16:32.421 INFO:tasks.workunit.client.1.smithi098.stdout:8/563: dwrite d6/d11/d15/d1b/d2a/d3b/f5d [0,4194304] 0 2023-01-04T18:16:32.422 INFO:tasks.workunit.client.1.smithi098.stdout:0/621: dwrite df/d17/d9b/d5c/f96 [0,4194304] 0 2023-01-04T18:16:32.424 INFO:tasks.workunit.client.1.smithi098.stdout:5/573: rename d1/d38/d3b/d8f/l94 to d1/d46/lae 0 2023-01-04T18:16:32.426 INFO:tasks.workunit.client.1.smithi098.stdout:1/466: link d1/d25/l4f d1/d25/d36/d89/laa 0 2023-01-04T18:16:32.426 INFO:tasks.workunit.client.1.smithi098.stdout:1/467: fsync d1/d8/da/f24 0 2023-01-04T18:16:32.428 INFO:tasks.workunit.client.1.smithi098.stdout:4/524: symlink d5/dad/laf 0 2023-01-04T18:16:32.429 INFO:tasks.workunit.client.1.smithi098.stdout:9/617: dread d2/d5/d18/d19/d82/f84 [0,4194304] 0 2023-01-04T18:16:32.429 INFO:tasks.workunit.client.1.smithi098.stdout:9/618: write d2/d5/d18/f44 [4345848,4039] 0 2023-01-04T18:16:32.431 INFO:tasks.workunit.client.1.smithi098.stdout:1/468: dread d1/d2e/f37 [0,4194304] 0 2023-01-04T18:16:32.434 INFO:tasks.workunit.client.1.smithi098.stdout:1/469: dread d1/d25/d27/d77/da8/f5a [0,4194304] 0 2023-01-04T18:16:32.435 INFO:tasks.workunit.client.1.smithi098.stdout:7/546: symlink d1/db2/lbb 0 2023-01-04T18:16:32.435 INFO:tasks.workunit.client.1.smithi098.stdout:1/470: dread d1/d8/f10 [0,4194304] 0 2023-01-04T18:16:32.438 INFO:tasks.workunit.client.1.smithi098.stdout:6/615: mknod d9/cc0 0 2023-01-04T18:16:32.439 INFO:tasks.workunit.client.1.smithi098.stdout:6/616: write d9/dd/d15/f2d [2692727,93220] 0 2023-01-04T18:16:32.441 INFO:tasks.workunit.client.1.smithi098.stdout:8/564: mknod d6/d11/d15/d1b/d2a/d6b/d9c/ca0 0 2023-01-04T18:16:32.444 INFO:tasks.workunit.client.1.smithi098.stdout:0/622: unlink df/d17/d1c/d3b/d98/fb8 0 2023-01-04T18:16:32.447 INFO:tasks.workunit.client.1.smithi098.stdout:3/625: rename d6/d10/d19/d3f/d5e/d7d/f5c to d6/d56/fdf 0 2023-01-04T18:16:32.456 INFO:tasks.workunit.client.1.smithi098.stdout:6/617: dwrite d9/dd/f11 [0,4194304] 0 2023-01-04T18:16:32.456 INFO:tasks.workunit.client.1.smithi098.stdout:9/619: unlink d2/d5/d18/d1d/ca9 0 2023-01-04T18:16:32.456 INFO:tasks.workunit.client.1.smithi098.stdout:4/525: truncate d5/d28/d40/f4a 5763870 0 2023-01-04T18:16:32.457 INFO:tasks.workunit.client.1.smithi098.stdout:8/565: truncate d6/d11/d15/d1b/d2a/d6b/d7f/d12/f48 2994457 0 2023-01-04T18:16:32.459 INFO:tasks.workunit.client.1.smithi098.stdout:5/574: rename d1/da/d44/d45/d4b/fa8 to d1/d2/d14/d59/faf 0 2023-01-04T18:16:32.459 INFO:tasks.workunit.client.1.smithi098.stdout:5/575: readlink d1/d38/d3b/l85 0 2023-01-04T18:16:32.461 INFO:tasks.workunit.client.1.smithi098.stdout:4/526: truncate d5/d28/f2b 2350127 0 2023-01-04T18:16:32.463 INFO:tasks.workunit.client.1.smithi098.stdout:9/620: mkdir d2/d5/d18/d19/d82/dce 0 2023-01-04T18:16:32.465 INFO:tasks.workunit.client.1.smithi098.stdout:1/471: link d1/d25/d27/d77/c1e d1/d25/d6a/cab 0 2023-01-04T18:16:32.465 INFO:tasks.workunit.client.1.smithi098.stdout:1/472: chown d1/la6 1 1 2023-01-04T18:16:32.465 INFO:tasks.workunit.client.1.smithi098.stdout:8/566: symlink d6/d11/d15/d1b/d2a/la1 0 2023-01-04T18:16:32.466 INFO:tasks.workunit.client.1.smithi098.stdout:9/621: dread d2/f1e [8388608,4194304] 0 2023-01-04T18:16:32.466 INFO:tasks.workunit.client.1.smithi098.stdout:7/547: rename d1/d51/d26/d28/f6e to d1/d23/d21/d7f/fbc 0 2023-01-04T18:16:32.466 INFO:tasks.workunit.client.1.smithi098.stdout:7/548: truncate d1/d23/d21/d7f/faa 519200 0 2023-01-04T18:16:32.467 INFO:tasks.workunit.client.1.smithi098.stdout:5/576: mkdir d1/db0 0 2023-01-04T18:16:32.467 INFO:tasks.workunit.client.1.smithi098.stdout:5/577: fsync d1/d2/d14/fad 0 2023-01-04T18:16:32.469 INFO:tasks.workunit.client.1.smithi098.stdout:7/549: dread d1/d23/d37/d40/f4e [0,4194304] 0 2023-01-04T18:16:32.469 INFO:tasks.workunit.client.1.smithi098.stdout:3/626: dwrite d6/d10/d19/d3f/f82 [0,4194304] 0 2023-01-04T18:16:32.469 INFO:tasks.workunit.client.1.smithi098.stdout:3/627: fsync d6/d10/d19/f8c 0 2023-01-04T18:16:32.476 INFO:tasks.workunit.client.1.smithi098.stdout:4/527: creat d5/de/d30/d4f/fb0 x:0 0 0 2023-01-04T18:16:32.476 INFO:tasks.workunit.client.1.smithi098.stdout:4/528: stat d5/d28/d40/f8a 0 2023-01-04T18:16:32.477 INFO:tasks.workunit.client.1.smithi098.stdout:1/473: mkdir d1/d8/dac 0 2023-01-04T18:16:32.478 INFO:tasks.workunit.client.1.smithi098.stdout:8/567: creat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/fa2 x:0 0 0 2023-01-04T18:16:32.478 INFO:tasks.workunit.client.1.smithi098.stdout:8/568: write d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/fa2 [916821,126953] 0 2023-01-04T18:16:32.479 INFO:tasks.workunit.client.1.smithi098.stdout:0/623: rename df/d17/d24/l39 to df/d4f/d6b/d75/ld4 0 2023-01-04T18:16:32.480 INFO:tasks.workunit.client.1.smithi098.stdout:0/624: chown df/f3e 4126 1 2023-01-04T18:16:32.480 INFO:tasks.workunit.client.1.smithi098.stdout:0/625: chown f5 112912 1 2023-01-04T18:16:32.482 INFO:tasks.workunit.client.1.smithi098.stdout:3/628: creat d6/d10/d29/d6a/fe0 x:0 0 0 2023-01-04T18:16:32.483 INFO:tasks.workunit.client.1.smithi098.stdout:1/474: creat d1/d8/dac/fad x:0 0 0 2023-01-04T18:16:32.483 INFO:tasks.workunit.client.1.smithi098.stdout:1/475: write d1/d8/da/f91 [502169,93686] 0 2023-01-04T18:16:32.483 INFO:tasks.workunit.client.1.smithi098.stdout:2/568: sync 2023-01-04T18:16:32.484 INFO:tasks.workunit.client.1.smithi098.stdout:8/569: stat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/l80 0 2023-01-04T18:16:32.484 INFO:tasks.workunit.client.1.smithi098.stdout:1/476: read d1/d2e/f37 [800525,48904] 0 2023-01-04T18:16:32.485 INFO:tasks.workunit.client.1.smithi098.stdout:1/477: read d1/d25/d27/d77/f3b [3693150,78953] 0 2023-01-04T18:16:32.486 INFO:tasks.workunit.client.1.smithi098.stdout:3/629: mkdir d6/d10/db7/de1 0 2023-01-04T18:16:32.486 INFO:tasks.workunit.client.1.smithi098.stdout:4/529: dread d5/de/f31 [0,4194304] 0 2023-01-04T18:16:32.487 INFO:tasks.workunit.client.1.smithi098.stdout:3/630: write d6/d10/fbf [77277,114904] 0 2023-01-04T18:16:32.487 INFO:tasks.workunit.client.1.smithi098.stdout:3/631: stat d6/d10/d19/d3f/d46/fab 0 2023-01-04T18:16:32.487 INFO:tasks.workunit.client.1.smithi098.stdout:2/569: unlink d6/dc/d2b/d42/d47/d35/fb1 0 2023-01-04T18:16:32.487 INFO:tasks.workunit.client.1.smithi098.stdout:2/570: dread - d6/f94 zero size 2023-01-04T18:16:32.490 INFO:tasks.workunit.client.1.smithi098.stdout:5/578: dwrite d1/d46/d6a/f9f [0,4194304] 0 2023-01-04T18:16:32.491 INFO:tasks.workunit.client.1.smithi098.stdout:9/622: dwrite d2/d5/d18/d4e/d42/d89/dac/d78/fc4 [0,4194304] 0 2023-01-04T18:16:32.491 INFO:tasks.workunit.client.1.smithi098.stdout:9/623: stat d2/f1e 0 2023-01-04T18:16:32.493 INFO:tasks.workunit.client.1.smithi098.stdout:3/632: creat d6/d10/dad/dda/fe2 x:0 0 0 2023-01-04T18:16:32.495 INFO:tasks.workunit.client.1.smithi098.stdout:2/571: rename d6/dc/d2b/d32/f61 to d6/dc/d2b/d42/d47/d31/d90/fc4 0 2023-01-04T18:16:32.497 INFO:tasks.workunit.client.1.smithi098.stdout:8/570: symlink d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/la3 0 2023-01-04T18:16:32.498 INFO:tasks.workunit.client.1.smithi098.stdout:1/478: rmdir d1/d25 39 2023-01-04T18:16:32.505 INFO:tasks.workunit.client.1.smithi098.stdout:5/579: unlink d1/d2f/f64 0 2023-01-04T18:16:32.508 INFO:tasks.workunit.client.1.smithi098.stdout:9/624: write d2/d5/d18/d4e/d42/d89/dac/d26/d41/f43 [2305886,26920] 0 2023-01-04T18:16:32.510 INFO:tasks.workunit.client.1.smithi098.stdout:2/572: link d6/dc/l19 d6/dc/d2b/d42/d47/d35/lc5 0 2023-01-04T18:16:32.513 INFO:tasks.workunit.client.1.smithi098.stdout:1/479: rename d1/d2e to d1/d8/da/dae 0 2023-01-04T18:16:32.515 INFO:tasks.workunit.client.1.smithi098.stdout:5/580: creat d1/d2f/d66/fb1 x:0 0 0 2023-01-04T18:16:32.517 INFO:tasks.workunit.client.1.smithi098.stdout:9/625: mknod d2/d5/d18/d1d/ccf 0 2023-01-04T18:16:32.517 INFO:tasks.workunit.client.1.smithi098.stdout:9/626: getdents d2/d5/d18/d4e/d42/d89/dac/d26/d41/dc1 0 2023-01-04T18:16:32.518 INFO:tasks.workunit.client.1.smithi098.stdout:2/573: creat d6/dc/d2b/d42/d47/d1f/d82/fc6 x:0 0 0 2023-01-04T18:16:32.518 INFO:tasks.workunit.client.1.smithi098.stdout:2/574: readlink d6/dc/d4b/l9f 0 2023-01-04T18:16:32.519 INFO:tasks.workunit.client.1.smithi098.stdout:4/530: dwrite d5/f37 [0,4194304] 0 2023-01-04T18:16:32.519 INFO:tasks.workunit.client.1.smithi098.stdout:4/531: chown d5/f1b 5167434 1 2023-01-04T18:16:32.520 INFO:tasks.workunit.client.1.smithi098.stdout:1/480: creat d1/d8/da/dae/faf x:0 0 0 2023-01-04T18:16:32.521 INFO:tasks.workunit.client.1.smithi098.stdout:4/532: write d5/d9/d13/f24 [314772,96284] 0 2023-01-04T18:16:32.523 INFO:tasks.workunit.client.1.smithi098.stdout:5/581: creat d1/d2/d14/da1/fb2 x:0 0 0 2023-01-04T18:16:32.524 INFO:tasks.workunit.client.1.smithi098.stdout:9/627: truncate d2/d5/f24 673969 0 2023-01-04T18:16:32.525 INFO:tasks.workunit.client.1.smithi098.stdout:9/628: read d2/d53/f65 [311814,54077] 0 2023-01-04T18:16:32.526 INFO:tasks.workunit.client.1.smithi098.stdout:2/575: creat d6/dc/d2b/d42/d51/d79/fc7 x:0 0 0 2023-01-04T18:16:32.527 INFO:tasks.workunit.client.1.smithi098.stdout:8/571: dwrite d6/d11/d15/d1b/d2a/d3b/d59/d6e/f89 [0,4194304] 0 2023-01-04T18:16:32.527 INFO:tasks.workunit.client.1.smithi098.stdout:8/572: chown d6/d11/d15/d1b/d2a/d6b/d7f/d5a 123 1 2023-01-04T18:16:32.529 INFO:tasks.workunit.client.1.smithi098.stdout:1/481: creat d1/d25/d6a/fb0 x:0 0 0 2023-01-04T18:16:32.532 INFO:tasks.workunit.client.1.smithi098.stdout:4/533: mknod d5/de/d30/d4f/cb1 0 2023-01-04T18:16:32.533 INFO:tasks.workunit.client.1.smithi098.stdout:5/582: truncate d1/d2/d14/f90 20724 0 2023-01-04T18:16:32.534 INFO:tasks.workunit.client.1.smithi098.stdout:9/629: mknod d2/d53/daf/db3/cd0 0 2023-01-04T18:16:32.536 INFO:tasks.workunit.client.1.smithi098.stdout:2/576: rename d6/dc/d2b/d42/d47/d1f/d39/c5f to d6/dc/d2b/d42/d47/d31/d90/cc8 0 2023-01-04T18:16:32.536 INFO:tasks.workunit.client.1.smithi098.stdout:2/577: chown d6/dc/d2b/d42/d47/d1f/l76 76 1 2023-01-04T18:16:32.536 INFO:tasks.workunit.client.1.smithi098.stdout:2/578: chown d6/dc/d2b/d42/d47/da5/cb3 16877 1 2023-01-04T18:16:32.537 INFO:tasks.workunit.client.1.smithi098.stdout:1/482: dread d1/f4 [0,4194304] 0 2023-01-04T18:16:32.538 INFO:tasks.workunit.client.1.smithi098.stdout:4/534: write d5/de/f29 [2733208,79589] 0 2023-01-04T18:16:32.540 INFO:tasks.workunit.client.1.smithi098.stdout:5/583: creat d1/d1e/dab/fb3 x:0 0 0 2023-01-04T18:16:32.542 INFO:tasks.workunit.client.1.smithi098.stdout:1/483: getdents d1/d8/dac 0 2023-01-04T18:16:32.542 INFO:tasks.workunit.client.1.smithi098.stdout:1/484: write d1/d25/f3c [638716,31323] 0 2023-01-04T18:16:32.544 INFO:tasks.workunit.client.1.smithi098.stdout:8/573: dwrite d6/d11/d15/d1b/d2a/d3b/d4c/d54/f57 [0,4194304] 0 2023-01-04T18:16:32.547 INFO:tasks.workunit.client.1.smithi098.stdout:4/535: rename d5/de/d2c/f3e to d5/dad/fb2 0 2023-01-04T18:16:32.547 INFO:tasks.workunit.client.1.smithi098.stdout:4/536: fdatasync d5/de/d30/d4f/fb0 0 2023-01-04T18:16:32.549 INFO:tasks.workunit.client.1.smithi098.stdout:1/485: getdents d1/d25/d36/d4e/d6e 0 2023-01-04T18:16:32.553 INFO:tasks.workunit.client.1.smithi098.stdout:5/584: rename d1/da/d44/c82 to d1/d1e/d81/cb4 0 2023-01-04T18:16:32.553 INFO:tasks.workunit.client.1.smithi098.stdout:1/486: creat d1/d8/fb1 x:0 0 0 2023-01-04T18:16:32.554 INFO:tasks.workunit.client.1.smithi098.stdout:4/537: symlink d5/de/d30/lb3 0 2023-01-04T18:16:32.554 INFO:tasks.workunit.client.1.smithi098.stdout:1/487: truncate d1/f1f 1423286 0 2023-01-04T18:16:32.562 INFO:tasks.workunit.client.1.smithi098.stdout:8/574: dread d6/d11/d15/d1b/d2a/d3b/f38 [0,4194304] 0 2023-01-04T18:16:32.562 INFO:tasks.workunit.client.1.smithi098.stdout:8/575: stat d6/d11/d15/d1b/d2a/d3b/d4c/d54/c5f 0 2023-01-04T18:16:32.564 INFO:tasks.workunit.client.1.smithi098.stdout:8/576: symlink d6/d11/d15/d1b/d2a/d3b/d4c/la4 0 2023-01-04T18:16:32.565 INFO:tasks.workunit.client.1.smithi098.stdout:2/579: dwrite d6/dc/d2b/d42/d47/d1f/f7a [0,4194304] 0 2023-01-04T18:16:32.566 INFO:tasks.workunit.client.1.smithi098.stdout:9/630: dwrite d2/d5/d18/d4e/d42/d89/dac/f79 [0,4194304] 0 2023-01-04T18:16:32.566 INFO:tasks.workunit.client.1.smithi098.stdout:9/631: write d2/d5/f24 [1087233,39691] 0 2023-01-04T18:16:32.567 INFO:tasks.workunit.client.1.smithi098.stdout:9/632: write d2/d5/d6f/f8a [3443114,114878] 0 2023-01-04T18:16:32.568 INFO:tasks.workunit.client.1.smithi098.stdout:8/577: write d6/d11/d15/d1b/d2a/d3b/f7e [2895322,40991] 0 2023-01-04T18:16:32.571 INFO:tasks.workunit.client.1.smithi098.stdout:8/578: mknod d6/d92/ca5 0 2023-01-04T18:16:32.572 INFO:tasks.workunit.client.1.smithi098.stdout:8/579: rmdir d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d64 39 2023-01-04T18:16:32.574 INFO:tasks.workunit.client.1.smithi098.stdout:8/580: unlink d6/d11/d15/d70/c7d 0 2023-01-04T18:16:32.577 INFO:tasks.workunit.client.1.smithi098.stdout:9/633: dread d2/d5/d18/d1d/d23/d66/f67 [0,4194304] 0 2023-01-04T18:16:32.578 INFO:tasks.workunit.client.1.smithi098.stdout:2/580: dread d6/f8 [0,4194304] 0 2023-01-04T18:16:32.578 INFO:tasks.workunit.client.1.smithi098.stdout:2/581: fdatasync d6/dc/d2b/d42/d47/d1f/d39/f64 0 2023-01-04T18:16:32.578 INFO:tasks.workunit.client.1.smithi098.stdout:9/634: creat d2/d5/d6f/fd1 x:0 0 0 2023-01-04T18:16:32.579 INFO:tasks.workunit.client.1.smithi098.stdout:2/582: mknod d6/dc/d2b/cc9 0 2023-01-04T18:16:32.579 INFO:tasks.workunit.client.1.smithi098.stdout:2/583: readlink d6/dc/d2b/d42/d47/d35/lc5 0 2023-01-04T18:16:32.580 INFO:tasks.workunit.client.1.smithi098.stdout:9/635: truncate d2/f8b 2046736 0 2023-01-04T18:16:32.580 INFO:tasks.workunit.client.1.smithi098.stdout:9/636: chown d2/d5/c15 76 1 2023-01-04T18:16:32.582 INFO:tasks.workunit.client.1.smithi098.stdout:9/637: symlink d2/d5/d18/d1d/d23/dad/ld2 0 2023-01-04T18:16:32.583 INFO:tasks.workunit.client.1.smithi098.stdout:2/584: dread d6/dc/d2b/d42/d47/f41 [0,4194304] 0 2023-01-04T18:16:32.583 INFO:tasks.workunit.client.1.smithi098.stdout:2/585: fdatasync d6/dc/d2b/d42/d47/d1f/d39/f80 0 2023-01-04T18:16:32.587 INFO:tasks.workunit.client.1.smithi098.stdout:2/586: rmdir d6/dc/d2b/d42/d47 39 2023-01-04T18:16:32.587 INFO:tasks.workunit.client.1.smithi098.stdout:2/587: chown d6/dc/d2b/d42/d47/d1f/d39/f56 2735 1 2023-01-04T18:16:32.588 INFO:tasks.workunit.client.1.smithi098.stdout:2/588: mkdir d6/dc/d2b/d42/d47/d35/dca 0 2023-01-04T18:16:32.588 INFO:tasks.workunit.client.1.smithi098.stdout:2/589: fdatasync d6/f3e 0 2023-01-04T18:16:32.592 INFO:tasks.workunit.client.1.smithi098.stdout:2/590: rename d6/f45 to d6/dc/d4b/d89/fcb 0 2023-01-04T18:16:32.592 INFO:tasks.workunit.client.1.smithi098.stdout:2/591: write d6/dc/d4b/d89/f8e [912654,76510] 0 2023-01-04T18:16:32.593 INFO:tasks.workunit.client.1.smithi098.stdout:5/585: dwrite d1/da/d44/d45/f7c [0,4194304] 0 2023-01-04T18:16:32.593 INFO:tasks.workunit.client.1.smithi098.stdout:1/488: dwrite d1/d25/f98 [0,4194304] 0 2023-01-04T18:16:32.594 INFO:tasks.workunit.client.1.smithi098.stdout:4/538: dwrite d5/d9/d13/f17 [0,4194304] 0 2023-01-04T18:16:32.594 INFO:tasks.workunit.client.1.smithi098.stdout:4/539: fdatasync d5/d28/f51 0 2023-01-04T18:16:32.594 INFO:tasks.workunit.client.1.smithi098.stdout:8/581: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/f6f [0,4194304] 0 2023-01-04T18:16:32.594 INFO:tasks.workunit.client.1.smithi098.stdout:8/582: write d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/f61 [189946,81410] 0 2023-01-04T18:16:32.595 INFO:tasks.workunit.client.1.smithi098.stdout:4/540: write d5/f8 [1103763,33598] 0 2023-01-04T18:16:32.596 INFO:tasks.workunit.client.1.smithi098.stdout:5/586: dread d1/d2/d14/d19/f35 [0,4194304] 0 2023-01-04T18:16:32.596 INFO:tasks.workunit.client.1.smithi098.stdout:5/587: truncate d1/d2/d14/d19/fa6 4762446 0 2023-01-04T18:16:32.606 INFO:tasks.workunit.client.1.smithi098.stdout:1/489: mknod d1/d25/d36/d4e/cb2 0 2023-01-04T18:16:32.606 INFO:tasks.workunit.client.1.smithi098.stdout:1/490: chown d1/d8/da/l45 5878 1 2023-01-04T18:16:32.606 INFO:tasks.workunit.client.1.smithi098.stdout:1/491: chown d1/d25/d36/d89/laa 2 1 2023-01-04T18:16:32.610 INFO:tasks.workunit.client.1.smithi098.stdout:8/583: rename d6/d11/d15/d1b/d2a/d3b/d4c to d6/d11/d15/d1b/d2a/d6b/d7f/da6 0 2023-01-04T18:16:32.611 INFO:tasks.workunit.client.1.smithi098.stdout:5/588: symlink d1/da/d44/d45/d4b/lb5 0 2023-01-04T18:16:32.611 INFO:tasks.workunit.client.1.smithi098.stdout:5/589: fdatasync d1/d1e/f68 0 2023-01-04T18:16:32.612 INFO:tasks.workunit.client.1.smithi098.stdout:1/492: mkdir d1/d25/d36/d89/db3 0 2023-01-04T18:16:32.612 INFO:tasks.workunit.client.1.smithi098.stdout:1/493: write d1/d88/f97 [682893,46853] 0 2023-01-04T18:16:32.613 INFO:tasks.workunit.client.1.smithi098.stdout:4/541: rename d5/de/d30/d4f/f86 to d5/d28/d44/fb4 0 2023-01-04T18:16:32.618 INFO:tasks.workunit.client.1.smithi098.stdout:8/584: link d6/d11/d15/d1b/d2a/d6b/d7f/d12/c94 d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/ca7 0 2023-01-04T18:16:32.618 INFO:tasks.workunit.client.1.smithi098.stdout:8/585: truncate d6/d11/d15/f1f 1225080 0 2023-01-04T18:16:32.618 INFO:tasks.workunit.client.1.smithi098.stdout:8/586: stat d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/l9f 0 2023-01-04T18:16:32.618 INFO:tasks.workunit.client.1.smithi098.stdout:4/542: symlink d5/d28/d40/d5d/lb5 0 2023-01-04T18:16:32.620 INFO:tasks.workunit.client.1.smithi098.stdout:8/587: rmdir d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a 39 2023-01-04T18:16:32.622 INFO:tasks.workunit.client.1.smithi098.stdout:8/588: creat d6/d11/d15/d1b/d2a/d6b/d7f/d78/d9d/fa8 x:0 0 0 2023-01-04T18:16:32.625 INFO:tasks.workunit.client.1.smithi098.stdout:8/589: link d6/d11/d15/d1b/d2a/d6b/d7f/f8f d6/d11/d15/d1b/d2a/d6b/d7f/da6/fa9 0 2023-01-04T18:16:32.636 INFO:tasks.workunit.client.1.smithi098.stdout:1/494: dwrite d1/d25/d6a/f90 [0,4194304] 0 2023-01-04T18:16:32.636 INFO:tasks.workunit.client.1.smithi098.stdout:1/495: readlink d1/d25/d39/l9d 0 2023-01-04T18:16:32.638 INFO:tasks.workunit.client.1.smithi098.stdout:1/496: mknod d1/d8/da/d64/cb4 0 2023-01-04T18:16:32.639 INFO:tasks.workunit.client.1.smithi098.stdout:5/590: dwrite d1/d1e/f3e [4194304,4194304] 0 2023-01-04T18:16:32.639 INFO:tasks.workunit.client.1.smithi098.stdout:5/591: fdatasync d1/d2/d14/f27 0 2023-01-04T18:16:32.639 INFO:tasks.workunit.client.1.smithi098.stdout:5/592: readlink d1/l47 0 2023-01-04T18:16:32.641 INFO:tasks.workunit.client.1.smithi098.stdout:5/593: symlink d1/d2f/d66/lb6 0 2023-01-04T18:16:32.641 INFO:tasks.workunit.client.1.smithi098.stdout:5/594: chown d1/da/c29 3544 1 2023-01-04T18:16:32.641 INFO:tasks.workunit.client.1.smithi098.stdout:5/595: readlink d1/d2f/d66/lac 0 2023-01-04T18:16:32.641 INFO:tasks.workunit.client.1.smithi098.stdout:5/596: chown d1/da/d44/d45/d4b/lb5 1842750 1 2023-01-04T18:16:32.641 INFO:tasks.workunit.client.1.smithi098.stdout:6/618: sync 2023-01-04T18:16:32.643 INFO:tasks.workunit.client.1.smithi098.stdout:5/597: dread d1/f1d [0,4194304] 0 2023-01-04T18:16:32.643 INFO:tasks.workunit.client.1.smithi098.stdout:5/598: chown d1/da/d44/l53 509 1 2023-01-04T18:16:32.643 INFO:tasks.workunit.client.1.smithi098.stdout:8/590: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/f18 [4194304,4194304] 0 2023-01-04T18:16:32.649 INFO:tasks.workunit.client.1.smithi098.stdout:5/599: creat d1/d2/d14/d59/fb7 x:0 0 0 2023-01-04T18:16:32.652 INFO:tasks.workunit.client.1.smithi098.stdout:4/543: rmdir d5/d28/d40/d5d 39 2023-01-04T18:16:32.657 INFO:tasks.workunit.client.1.smithi098.stdout:7/550: sync 2023-01-04T18:16:32.657 INFO:tasks.workunit.client.1.smithi098.stdout:3/633: sync 2023-01-04T18:16:32.657 INFO:tasks.workunit.client.1.smithi098.stdout:0/626: sync 2023-01-04T18:16:32.658 INFO:tasks.workunit.client.1.smithi098.stdout:8/591: symlink d6/d11/d15/d1b/d2a/laa 0 2023-01-04T18:16:32.658 INFO:tasks.workunit.client.1.smithi098.stdout:7/551: write d1/d23/d21/f99 [136849,70622] 0 2023-01-04T18:16:32.660 INFO:tasks.workunit.client.1.smithi098.stdout:5/600: creat d1/da/d44/d45/fb8 x:0 0 0 2023-01-04T18:16:32.662 INFO:tasks.workunit.client.1.smithi098.stdout:4/544: mkdir d5/d28/d7d/db6 0 2023-01-04T18:16:32.663 INFO:tasks.workunit.client.1.smithi098.stdout:3/634: rename d6/d10/d19/d3f/d46/d8a/fcc to d6/d56/dc8/fe3 0 2023-01-04T18:16:32.667 INFO:tasks.workunit.client.1.smithi098.stdout:8/592: rename d6/d11/d15/d1b/d2a/d3b/c51 to d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/cab 0 2023-01-04T18:16:32.670 INFO:tasks.workunit.client.1.smithi098.stdout:3/635: rename d6/d56/fdf to d6/d10/d29/d6a/fe4 0 2023-01-04T18:16:32.670 INFO:tasks.workunit.client.1.smithi098.stdout:3/636: chown d6/d10/d19/d3f/d46/f5a 452 1 2023-01-04T18:16:32.671 INFO:tasks.workunit.client.1.smithi098.stdout:7/552: dread d1/d4/d11/f60 [0,4194304] 0 2023-01-04T18:16:32.671 INFO:tasks.workunit.client.1.smithi098.stdout:7/553: readlink d1/d51/l56 0 2023-01-04T18:16:32.671 INFO:tasks.workunit.client.1.smithi098.stdout:7/554: stat d1/da/f1b 0 2023-01-04T18:16:32.671 INFO:tasks.workunit.client.1.smithi098.stdout:8/593: creat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/fac x:0 0 0 2023-01-04T18:16:32.671 INFO:tasks.workunit.client.1.smithi098.stdout:6/619: dwrite d9/dd/de/d20/d82/fbe [0,4194304] 0 2023-01-04T18:16:32.672 INFO:tasks.workunit.client.1.smithi098.stdout:3/637: mkdir d6/d10/d19/d3f/d5e/de5 0 2023-01-04T18:16:32.673 INFO:tasks.workunit.client.1.smithi098.stdout:5/601: dread d1/d1e/f68 [0,4194304] 0 2023-01-04T18:16:32.674 INFO:tasks.workunit.client.1.smithi098.stdout:7/555: symlink d1/d51/d26/d28/lbd 0 2023-01-04T18:16:32.677 INFO:tasks.workunit.client.1.smithi098.stdout:8/594: link d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/f8c d6/d92/fad 0 2023-01-04T18:16:32.680 INFO:tasks.workunit.client.1.smithi098.stdout:4/545: dwrite d5/de/d2c/f9a [0,4194304] 0 2023-01-04T18:16:32.681 INFO:tasks.workunit.client.1.smithi098.stdout:3/638: mkdir d6/d10/d19/d3f/d5e/d7d/d90/de6 0 2023-01-04T18:16:32.681 INFO:tasks.workunit.client.1.smithi098.stdout:0/627: dwrite df/d4f/f5d [0,4194304] 0 2023-01-04T18:16:32.681 INFO:tasks.workunit.client.1.smithi098.stdout:3/639: truncate d6/d6f/d9b/fb1 158103 0 2023-01-04T18:16:32.685 INFO:tasks.workunit.client.1.smithi098.stdout:5/602: mknod d1/d2/d14/cb9 0 2023-01-04T18:16:32.685 INFO:tasks.workunit.client.1.smithi098.stdout:7/556: creat d1/d2e/fbe x:0 0 0 2023-01-04T18:16:32.686 INFO:tasks.workunit.client.1.smithi098.stdout:8/595: mkdir d6/d11/d15/d1b/d2a/dae 0 2023-01-04T18:16:32.686 INFO:tasks.workunit.client.1.smithi098.stdout:8/596: fsync d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/f3a 0 2023-01-04T18:16:32.691 INFO:tasks.workunit.client.1.smithi098.stdout:4/546: dread d5/d28/d44/fb4 [0,4194304] 0 2023-01-04T18:16:32.691 INFO:tasks.workunit.client.1.smithi098.stdout:6/620: dwrite d9/fa [4194304,4194304] 0 2023-01-04T18:16:32.698 INFO:tasks.workunit.client.1.smithi098.stdout:0/628: mknod df/d17/d1c/d2c/d41/d4a/d4c/d90/cd5 0 2023-01-04T18:16:32.698 INFO:tasks.workunit.client.1.smithi098.stdout:3/640: creat d6/d56/d9f/da8/fe7 x:0 0 0 2023-01-04T18:16:32.698 INFO:tasks.workunit.client.1.smithi098.stdout:3/641: write d6/d10/d19/d3f/d5e/d7d/d90/f93 [702786,93896] 0 2023-01-04T18:16:32.698 INFO:tasks.workunit.client.1.smithi098.stdout:5/603: mkdir d1/da/d44/d45/d4b/dba 0 2023-01-04T18:16:32.699 INFO:tasks.workunit.client.1.smithi098.stdout:3/642: dread d6/d10/d19/d3f/f47 [0,4194304] 0 2023-01-04T18:16:32.701 INFO:tasks.workunit.client.1.smithi098.stdout:8/597: rename d6/d11/d15/d1b/d2a/d6b/l7c to d6/d11/d15/d1b/d2a/d6b/d7f/da6/laf 0 2023-01-04T18:16:32.708 INFO:tasks.workunit.client.1.smithi098.stdout:4/547: creat d5/d28/d40/d5d/fb7 x:0 0 0 2023-01-04T18:16:32.708 INFO:tasks.workunit.client.1.smithi098.stdout:4/548: stat d5/d28/da6 0 2023-01-04T18:16:32.708 INFO:tasks.workunit.client.1.smithi098.stdout:4/549: truncate d5/de/f9e 4434501 0 2023-01-04T18:16:32.708 INFO:tasks.workunit.client.1.smithi098.stdout:4/550: dread - d5/dad/d83/fae zero size 2023-01-04T18:16:32.708 INFO:tasks.workunit.client.1.smithi098.stdout:6/621: symlink d9/dd/d4e/d67/lc1 0 2023-01-04T18:16:32.712 INFO:tasks.workunit.client.1.smithi098.stdout:0/629: creat df/d4f/d6b/fd6 x:0 0 0 2023-01-04T18:16:32.712 INFO:tasks.workunit.client.1.smithi098.stdout:4/551: creat d5/dad/d83/fb8 x:0 0 0 2023-01-04T18:16:32.717 INFO:tasks.workunit.client.1.smithi098.stdout:0/630: creat df/d4f/d6e/fd7 x:0 0 0 2023-01-04T18:16:32.721 INFO:tasks.workunit.client.1.smithi098.stdout:4/552: getdents d5/de 0 2023-01-04T18:16:32.721 INFO:tasks.workunit.client.1.smithi098.stdout:4/553: fdatasync d5/d9/f7c 0 2023-01-04T18:16:32.723 INFO:tasks.workunit.client.1.smithi098.stdout:9/638: sync 2023-01-04T18:16:32.723 INFO:tasks.workunit.client.1.smithi098.stdout:7/557: dwrite d1/d23/d37/f42 [0,4194304] 0 2023-01-04T18:16:32.728 INFO:tasks.workunit.client.1.smithi098.stdout:7/558: symlink d1/d4/d11/d9d/lbf 0 2023-01-04T18:16:32.728 INFO:tasks.workunit.client.1.smithi098.stdout:7/559: chown d1/d23 1667053 1 2023-01-04T18:16:32.732 INFO:tasks.workunit.client.1.smithi098.stdout:6/622: dread d9/dd/de/d26/f62 [0,4194304] 0 2023-01-04T18:16:32.732 INFO:tasks.workunit.client.1.smithi098.stdout:6/623: stat d9/dd/de/d26/f77 0 2023-01-04T18:16:32.735 INFO:tasks.workunit.client.1.smithi098.stdout:8/598: dwrite d6/d11/d15/d1b/d2a/d3b/d59/d6e/f89 [0,4194304] 0 2023-01-04T18:16:32.735 INFO:tasks.workunit.client.1.smithi098.stdout:8/599: fsync d6/d92/fad 0 2023-01-04T18:16:32.737 INFO:tasks.workunit.client.1.smithi098.stdout:8/600: write d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/f45 [4972328,124154] 0 2023-01-04T18:16:32.738 INFO:tasks.workunit.client.1.smithi098.stdout:8/601: getdents d6/d11 0 2023-01-04T18:16:32.738 INFO:tasks.workunit.client.1.smithi098.stdout:8/602: getdents d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/d8a 0 2023-01-04T18:16:32.741 INFO:tasks.workunit.client.1.smithi098.stdout:8/603: mkdir d6/d11/d15/db0 0 2023-01-04T18:16:32.742 INFO:tasks.workunit.client.1.smithi098.stdout:8/604: mknod d6/d11/d15/cb1 0 2023-01-04T18:16:32.742 INFO:tasks.workunit.client.1.smithi098.stdout:8/605: dread - d6/d11/d15/d1b/f76 zero size 2023-01-04T18:16:32.743 INFO:tasks.workunit.client.1.smithi098.stdout:8/606: getdents d6/d11/d15/d1b/d2a/d6b/d7f 0 2023-01-04T18:16:32.744 INFO:tasks.workunit.client.1.smithi098.stdout:8/607: write d6/d11/d15/d1b/f76 [392537,105390] 0 2023-01-04T18:16:32.745 INFO:tasks.workunit.client.1.smithi098.stdout:8/608: symlink d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/d8a/lb2 0 2023-01-04T18:16:32.745 INFO:tasks.workunit.client.1.smithi098.stdout:8/609: chown d6/d11/d15/d1b/d2a/d6b/d7f/d78 7067057 1 2023-01-04T18:16:32.746 INFO:tasks.workunit.client.1.smithi098.stdout:8/610: link d6/d11/d15/d1b/d2a/d6b/d9c/ca0 d6/d11/d15/cb3 0 2023-01-04T18:16:32.771 INFO:tasks.workunit.client.1.smithi098.stdout:8/611: write d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/f88 [825794,65241] 0 2023-01-04T18:16:32.774 INFO:tasks.workunit.client.1.smithi098.stdout:8/612: write d6/d11/d15/d1b/d2a/d3b/f35 [5451792,65345] 0 2023-01-04T18:16:32.776 INFO:tasks.workunit.client.1.smithi098.stdout:8/613: mkdir d6/d11/d15/db4 0 2023-01-04T18:16:32.776 INFO:tasks.workunit.client.1.smithi098.stdout:7/560: dwrite d1/d4/d11/f9a [0,4194304] 0 2023-01-04T18:16:32.776 INFO:tasks.workunit.client.1.smithi098.stdout:7/561: readlink d1/d51/l67 0 2023-01-04T18:16:32.778 INFO:tasks.workunit.client.1.smithi098.stdout:4/554: dwrite d5/de/d21/f80 [0,4194304] 0 2023-01-04T18:16:32.778 INFO:tasks.workunit.client.1.smithi098.stdout:4/555: fsync d5/de/d21/f22 0 2023-01-04T18:16:32.778 INFO:tasks.workunit.client.1.smithi098.stdout:4/556: chown d5/de/f29 75360 1 2023-01-04T18:16:32.779 INFO:tasks.workunit.client.1.smithi098.stdout:8/614: creat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/fb5 x:0 0 0 2023-01-04T18:16:32.781 INFO:tasks.workunit.client.1.smithi098.stdout:7/562: mkdir d1/d51/dc0 0 2023-01-04T18:16:32.781 INFO:tasks.workunit.client.1.smithi098.stdout:4/557: creat d5/dad/fb9 x:0 0 0 2023-01-04T18:16:32.783 INFO:tasks.workunit.client.1.smithi098.stdout:8/615: write d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/f57 [3053450,130456] 0 2023-01-04T18:16:32.784 INFO:tasks.workunit.client.1.smithi098.stdout:2/592: sync 2023-01-04T18:16:32.784 INFO:tasks.workunit.client.1.smithi098.stdout:1/497: sync 2023-01-04T18:16:32.790 INFO:tasks.workunit.client.1.smithi098.stdout:7/563: mkdir d1/dc1 0 2023-01-04T18:16:32.792 INFO:tasks.workunit.client.1.smithi098.stdout:2/593: unlink d6/dc/c13 0 2023-01-04T18:16:32.792 INFO:tasks.workunit.client.1.smithi098.stdout:2/594: write d6/dc/f7e [615312,125573] 0 2023-01-04T18:16:32.793 INFO:tasks.workunit.client.1.smithi098.stdout:4/558: dread d5/dad/fb2 [0,4194304] 0 2023-01-04T18:16:32.795 INFO:tasks.workunit.client.1.smithi098.stdout:7/564: creat d1/d23/d21/d7f/fc2 x:0 0 0 2023-01-04T18:16:32.795 INFO:tasks.workunit.client.1.smithi098.stdout:7/565: chown d1/d23/d37/d40/d94 19 1 2023-01-04T18:16:32.796 INFO:tasks.workunit.client.1.smithi098.stdout:7/566: rmdir d1/d23/d21/d43 39 2023-01-04T18:16:32.797 INFO:tasks.workunit.client.1.smithi098.stdout:7/567: symlink d1/d51/d26/d28/d2d/d75/lc3 0 2023-01-04T18:16:32.798 INFO:tasks.workunit.client.1.smithi098.stdout:7/568: mkdir d1/db2/dc4 0 2023-01-04T18:16:32.799 INFO:tasks.workunit.client.1.smithi098.stdout:7/569: symlink d1/d23/d37/d40/lc5 0 2023-01-04T18:16:32.800 INFO:tasks.workunit.client.1.smithi098.stdout:7/570: mkdir d1/d51/d26/d28/dc6 0 2023-01-04T18:16:32.800 INFO:tasks.workunit.client.1.smithi098.stdout:7/571: stat d1/d4/d11/d9d 0 2023-01-04T18:16:32.800 INFO:tasks.workunit.client.1.smithi098.stdout:7/572: chown c0 3852313 1 2023-01-04T18:16:32.827 INFO:tasks.workunit.client.1.smithi098.stdout:7/573: write d1/d23/d73/f76 [1964436,31801] 0 2023-01-04T18:16:32.834 INFO:tasks.workunit.client.1.smithi098.stdout:1/498: dwrite d1/d8/da/dae/f37 [0,4194304] 0 2023-01-04T18:16:32.842 INFO:tasks.workunit.client.1.smithi098.stdout:1/499: link d1/d8/da/f24 d1/d25/d36/d89/db3/fb5 0 2023-01-04T18:16:32.844 INFO:tasks.workunit.client.1.smithi098.stdout:1/500: creat d1/d25/d27/d5c/fb6 x:0 0 0 2023-01-04T18:16:32.845 INFO:tasks.workunit.client.1.smithi098.stdout:1/501: mkdir d1/d25/d36/d4e/d9f/db7 0 2023-01-04T18:16:32.854 INFO:tasks.workunit.client.1.smithi098.stdout:7/574: dwrite d1/d23/d21/d7f/fbc [0,4194304] 0 2023-01-04T18:16:32.855 INFO:tasks.workunit.client.1.smithi098.stdout:7/575: chown d1/d23/d37/d40/d94 1336521 1 2023-01-04T18:16:32.857 INFO:tasks.workunit.client.1.smithi098.stdout:7/576: creat d1/d2e/fc7 x:0 0 0 2023-01-04T18:16:32.858 INFO:tasks.workunit.client.1.smithi098.stdout:7/577: mknod d1/d51/d26/d28/d2d/d6b/cc8 0 2023-01-04T18:16:32.860 INFO:tasks.workunit.client.1.smithi098.stdout:7/578: getdents d1/d51 0 2023-01-04T18:16:32.862 INFO:tasks.workunit.client.1.smithi098.stdout:3/643: sync 2023-01-04T18:16:32.862 INFO:tasks.workunit.client.1.smithi098.stdout:5/604: sync 2023-01-04T18:16:32.863 INFO:tasks.workunit.client.1.smithi098.stdout:7/579: unlink d1/f49 0 2023-01-04T18:16:32.865 INFO:tasks.workunit.client.1.smithi098.stdout:7/580: rename d1/d51/d26/d28/lbd to d1/lc9 0 2023-01-04T18:16:32.866 INFO:tasks.workunit.client.1.smithi098.stdout:1/502: dwrite d1/d88/f97 [0,4194304] 0 2023-01-04T18:16:32.866 INFO:tasks.workunit.client.1.smithi098.stdout:1/503: write d1/d8/da/f72 [528537,104210] 0 2023-01-04T18:16:32.866 INFO:tasks.workunit.client.1.smithi098.stdout:1/504: write d1/d25/f99 [560618,110442] 0 2023-01-04T18:16:32.867 INFO:tasks.workunit.client.1.smithi098.stdout:7/581: creat d1/dc1/fca x:0 0 0 2023-01-04T18:16:32.867 INFO:tasks.workunit.client.1.smithi098.stdout:1/505: write d1/f1b [1589749,117267] 0 2023-01-04T18:16:32.875 INFO:tasks.workunit.client.1.smithi098.stdout:5/605: write d1/d2/d14/d19/fa6 [2510862,94803] 0 2023-01-04T18:16:32.875 INFO:tasks.workunit.client.1.smithi098.stdout:3/644: dread d6/d10/f1b [0,4194304] 0 2023-01-04T18:16:32.918 INFO:tasks.workunit.client.1.smithi098.stdout:7/582: rename d1/d23/f2c to d1/d23/d37/fcb 0 2023-01-04T18:16:32.919 INFO:tasks.workunit.client.1.smithi098.stdout:0/631: sync 2023-01-04T18:16:32.919 INFO:tasks.workunit.client.1.smithi098.stdout:6/624: sync 2023-01-04T18:16:32.919 INFO:tasks.workunit.client.1.smithi098.stdout:6/625: dread d9/dd/de/d20/d82/f59 [0,4194304] 0 2023-01-04T18:16:32.919 INFO:tasks.workunit.client.1.smithi098.stdout:1/506: creat d1/d25/d36/d4e/d9f/fb8 x:0 0 0 2023-01-04T18:16:32.920 INFO:tasks.workunit.client.1.smithi098.stdout:1/507: write d1/d8/da/dae/f8d [1097736,47771] 0 2023-01-04T18:16:32.920 INFO:tasks.workunit.client.1.smithi098.stdout:3/645: mknod d6/d6f/ce8 0 2023-01-04T18:16:32.922 INFO:tasks.workunit.client.1.smithi098.stdout:9/639: sync 2023-01-04T18:16:32.925 INFO:tasks.workunit.client.1.smithi098.stdout:7/583: creat d1/db2/dc4/fcc x:0 0 0 2023-01-04T18:16:32.926 INFO:tasks.workunit.client.1.smithi098.stdout:0/632: creat df/d17/d9b/da1/fd8 x:0 0 0 2023-01-04T18:16:32.926 INFO:tasks.workunit.client.1.smithi098.stdout:0/633: fdatasync df/d17/d1c/f22 0 2023-01-04T18:16:32.927 INFO:tasks.workunit.client.1.smithi098.stdout:0/634: chown df/d17/d1c/d3b/d98/f82 16 1 2023-01-04T18:16:32.927 INFO:tasks.workunit.client.1.smithi098.stdout:0/635: truncate df/d4f/d6e/f87 1229022 0 2023-01-04T18:16:32.929 INFO:tasks.workunit.client.1.smithi098.stdout:6/626: mknod d9/dd/d24/cc2 0 2023-01-04T18:16:32.931 INFO:tasks.workunit.client.1.smithi098.stdout:1/508: link d1/d8/fb1 d1/d25/fb9 0 2023-01-04T18:16:32.931 INFO:tasks.workunit.client.1.smithi098.stdout:6/627: write d9/dd/d24/d3e/f55 [1755963,117157] 0 2023-01-04T18:16:32.932 INFO:tasks.workunit.client.1.smithi098.stdout:6/628: readlink d9/dd/d24/d3e/d86/d9b/l9e 0 2023-01-04T18:16:32.932 INFO:tasks.workunit.client.1.smithi098.stdout:6/629: fsync d9/dd/f42 0 2023-01-04T18:16:32.932 INFO:tasks.workunit.client.1.smithi098.stdout:3/646: mknod d6/d10/dad/ce9 0 2023-01-04T18:16:32.932 INFO:tasks.workunit.client.1.smithi098.stdout:3/647: chown d6/d10/dad/dda 779924074 1 2023-01-04T18:16:32.933 INFO:tasks.workunit.client.1.smithi098.stdout:2/595: sync 2023-01-04T18:16:32.933 INFO:tasks.workunit.client.1.smithi098.stdout:4/559: sync 2023-01-04T18:16:32.933 INFO:tasks.workunit.client.1.smithi098.stdout:8/616: sync 2023-01-04T18:16:32.933 INFO:tasks.workunit.client.1.smithi098.stdout:8/617: fsync d6/d11/f1a 0 2023-01-04T18:16:32.934 INFO:tasks.workunit.client.1.smithi098.stdout:7/584: rename d1/d23/d21/d43/c72 to d1/db2/dc4/ccd 0 2023-01-04T18:16:32.934 INFO:tasks.workunit.client.1.smithi098.stdout:7/585: chown d1/da/f1b 1143 1 2023-01-04T18:16:32.934 INFO:tasks.workunit.client.1.smithi098.stdout:7/586: fsync d1/d51/f59 0 2023-01-04T18:16:32.936 INFO:tasks.workunit.client.1.smithi098.stdout:1/509: symlink d1/d25/d39/d8e/lba 0 2023-01-04T18:16:32.936 INFO:tasks.workunit.client.1.smithi098.stdout:1/510: fdatasync d1/d25/d27/d5c/fb6 0 2023-01-04T18:16:32.937 INFO:tasks.workunit.client.1.smithi098.stdout:6/630: unlink d9/dd/de/d26/d71/lbb 0 2023-01-04T18:16:32.938 INFO:tasks.workunit.client.1.smithi098.stdout:6/631: chown d9/dd/d4e/d67/d8d/d8e/la3 13055763 1 2023-01-04T18:16:32.938 INFO:tasks.workunit.client.1.smithi098.stdout:3/648: mknod d6/d10/d29/d6a/cea 0 2023-01-04T18:16:32.938 INFO:tasks.workunit.client.1.smithi098.stdout:3/649: readlink d6/d10/d19/d3f/d5e/d7d/l5d 0 2023-01-04T18:16:32.939 INFO:tasks.workunit.client.1.smithi098.stdout:4/560: creat d5/d9/d90/fba x:0 0 0 2023-01-04T18:16:32.939 INFO:tasks.workunit.client.1.smithi098.stdout:4/561: chown d5/d9/d13/d65/d98/la3 912 1 2023-01-04T18:16:32.939 INFO:tasks.workunit.client.1.smithi098.stdout:4/562: readlink d5/d28/d40/d5d/lb5 0 2023-01-04T18:16:32.939 INFO:tasks.workunit.client.1.smithi098.stdout:4/563: chown d5/d9/d13/l19 11 1 2023-01-04T18:16:32.939 INFO:tasks.workunit.client.1.smithi098.stdout:9/640: dwrite d2/d2d/f93 [4194304,4194304] 0 2023-01-04T18:16:32.939 INFO:tasks.workunit.client.1.smithi098.stdout:9/641: read d2/d5/d18/d19/d82/f84 [78486,71812] 0 2023-01-04T18:16:32.940 INFO:tasks.workunit.client.1.smithi098.stdout:8/618: creat d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/fb6 x:0 0 0 2023-01-04T18:16:32.940 INFO:tasks.workunit.client.1.smithi098.stdout:7/587: dread d1/d51/d26/d28/d2d/d75/fb6 [0,4194304] 0 2023-01-04T18:16:32.940 INFO:tasks.workunit.client.1.smithi098.stdout:0/636: dread df/d17/d1c/d3b/d98/f81 [0,4194304] 0 2023-01-04T18:16:32.940 INFO:tasks.workunit.client.1.smithi098.stdout:0/637: chown df/d17/d1c/d3b/cca 466 1 2023-01-04T18:16:32.941 INFO:tasks.workunit.client.1.smithi098.stdout:1/511: mknod d1/d8/da/dae/cbb 0 2023-01-04T18:16:32.942 INFO:tasks.workunit.client.1.smithi098.stdout:3/650: rename d6/d10/d19/d3f/f9c to d6/d6f/db6/feb 0 2023-01-04T18:16:32.942 INFO:tasks.workunit.client.1.smithi098.stdout:3/651: stat d6/d56/f85 0 2023-01-04T18:16:32.943 INFO:tasks.workunit.client.1.smithi098.stdout:4/564: truncate d5/de/f88 385758 0 2023-01-04T18:16:32.943 INFO:tasks.workunit.client.1.smithi098.stdout:4/565: dread - d5/d9/fa5 zero size 2023-01-04T18:16:32.943 INFO:tasks.workunit.client.1.smithi098.stdout:4/566: truncate d5/d9/d13/d65/d98/fa8 4683322 0 2023-01-04T18:16:32.944 INFO:tasks.workunit.client.1.smithi098.stdout:9/642: symlink d2/d5/d18/d1d/dc0/ld3 0 2023-01-04T18:16:32.944 INFO:tasks.workunit.client.1.smithi098.stdout:9/643: fsync d2/d5/d18/f8f 0 2023-01-04T18:16:32.944 INFO:tasks.workunit.client.1.smithi098.stdout:9/644: stat d2/d5/d18/d19/f58 0 2023-01-04T18:16:32.946 INFO:tasks.workunit.client.1.smithi098.stdout:7/588: creat d1/d51/dc0/fce x:0 0 0 2023-01-04T18:16:32.947 INFO:tasks.workunit.client.1.smithi098.stdout:0/638: mknod df/d17/cd9 0 2023-01-04T18:16:32.947 INFO:tasks.workunit.client.1.smithi098.stdout:0/639: write df/d4f/f7d [4521116,95514] 0 2023-01-04T18:16:32.947 INFO:tasks.workunit.client.1.smithi098.stdout:0/640: truncate f3 386902 0 2023-01-04T18:16:32.948 INFO:tasks.workunit.client.1.smithi098.stdout:3/652: read d6/d10/d6b/fa4 [683599,127415] 0 2023-01-04T18:16:32.948 INFO:tasks.workunit.client.1.smithi098.stdout:4/567: creat d5/fbb x:0 0 0 2023-01-04T18:16:32.949 INFO:tasks.workunit.client.1.smithi098.stdout:4/568: chown d5/de/d2c/f46 2745781 1 2023-01-04T18:16:32.950 INFO:tasks.workunit.client.1.smithi098.stdout:8/619: dread d6/d11/d15/d1b/d2a/d6b/d7f/f81 [0,4194304] 0 2023-01-04T18:16:32.950 INFO:tasks.workunit.client.1.smithi098.stdout:8/620: fsync d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/f8c 0 2023-01-04T18:16:32.951 INFO:tasks.workunit.client.1.smithi098.stdout:8/621: readlink d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/l9f 0 2023-01-04T18:16:32.951 INFO:tasks.workunit.client.1.smithi098.stdout:7/589: unlink d1/d23/d21/d7f/ca7 0 2023-01-04T18:16:32.952 INFO:tasks.workunit.client.1.smithi098.stdout:2/596: dwrite f5 [4194304,4194304] 0 2023-01-04T18:16:32.952 INFO:tasks.workunit.client.1.smithi098.stdout:2/597: write d6/dc/d4b/d89/fcb [1189548,58095] 0 2023-01-04T18:16:32.952 INFO:tasks.workunit.client.1.smithi098.stdout:0/641: chown df/d4f/d6e/lc3 5 1 2023-01-04T18:16:32.953 INFO:tasks.workunit.client.1.smithi098.stdout:1/512: dread d1/d8/da/f17 [0,4194304] 0 2023-01-04T18:16:32.957 INFO:tasks.workunit.client.1.smithi098.stdout:0/642: write df/d4f/d6b/d89/f9a [2637035,98089] 0 2023-01-04T18:16:32.957 INFO:tasks.workunit.client.1.smithi098.stdout:3/653: rename d6/d10/dad to d6/d10/d19/d3f/d5e/d7d/dec 0 2023-01-04T18:16:32.959 INFO:tasks.workunit.client.1.smithi098.stdout:4/569: rmdir d5/de/d2c 39 2023-01-04T18:16:32.959 INFO:tasks.workunit.client.1.smithi098.stdout:4/570: readlink d5/dad/laf 0 2023-01-04T18:16:32.961 INFO:tasks.workunit.client.1.smithi098.stdout:9/645: dwrite d2/d5/f75 [0,4194304] 0 2023-01-04T18:16:32.964 INFO:tasks.workunit.client.1.smithi098.stdout:8/622: creat d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/fb7 x:0 0 0 2023-01-04T18:16:32.966 INFO:tasks.workunit.client.1.smithi098.stdout:7/590: truncate d1/d2e/f39 2575637 0 2023-01-04T18:16:32.966 INFO:tasks.workunit.client.1.smithi098.stdout:7/591: write d1/d2e/f54 [1151476,113287] 0 2023-01-04T18:16:32.966 INFO:tasks.workunit.client.1.smithi098.stdout:1/513: dread d1/d25/d27/d77/fa3 [0,4194304] 0 2023-01-04T18:16:32.966 INFO:tasks.workunit.client.1.smithi098.stdout:1/514: fsync d1/d25/d6a/f93 0 2023-01-04T18:16:32.967 INFO:tasks.workunit.client.1.smithi098.stdout:0/643: dread df/d17/d1c/d3b/d98/f82 [0,4194304] 0 2023-01-04T18:16:32.980 INFO:tasks.workunit.client.1.smithi098.stdout:2/598: rename d6/f3e to d6/dc/d2b/fcc 0 2023-01-04T18:16:32.980 INFO:tasks.workunit.client.1.smithi098.stdout:2/599: fdatasync d6/dc/d2b/fcc 0 2023-01-04T18:16:32.981 INFO:tasks.workunit.client.1.smithi098.stdout:3/654: mkdir d6/d10/d19/d3f/d5e/d7d/d90/de6/ded 0 2023-01-04T18:16:32.982 INFO:tasks.workunit.client.1.smithi098.stdout:4/571: symlink d5/d28/d40/lbc 0 2023-01-04T18:16:32.984 INFO:tasks.workunit.client.1.smithi098.stdout:8/623: mkdir d6/d11/d15/d1b/d2a/dae/db8 0 2023-01-04T18:16:32.986 INFO:tasks.workunit.client.1.smithi098.stdout:1/515: creat d1/d25/d36/d4e/d9f/db7/fbc x:0 0 0 2023-01-04T18:16:32.987 INFO:tasks.workunit.client.1.smithi098.stdout:2/600: creat d6/dc/d2b/d42/d51/d79/da3/fcd x:0 0 0 2023-01-04T18:16:32.988 INFO:tasks.workunit.client.1.smithi098.stdout:3/655: mknod d6/d10/d19/d3f/d5e/d7d/dec/dda/cee 0 2023-01-04T18:16:32.988 INFO:tasks.workunit.client.1.smithi098.stdout:3/656: chown d6/d10/d19/d3f/d5e/d74/l73 2 1 2023-01-04T18:16:32.989 INFO:tasks.workunit.client.1.smithi098.stdout:4/572: mkdir d5/d28/d7d/db6/dbd 0 2023-01-04T18:16:32.989 INFO:tasks.workunit.client.1.smithi098.stdout:0/644: dwrite df/d17/fcd [0,4194304] 0 2023-01-04T18:16:32.990 INFO:tasks.workunit.client.1.smithi098.stdout:9/646: dwrite f1 [0,4194304] 0 2023-01-04T18:16:32.990 INFO:tasks.workunit.client.1.smithi098.stdout:9/647: dread - d2/d5/d18/d4e/d42/f99 zero size 2023-01-04T18:16:32.990 INFO:tasks.workunit.client.1.smithi098.stdout:9/648: chown d2/d5/d18/d1d/dc0/ld3 236731 1 2023-01-04T18:16:32.990 INFO:tasks.workunit.client.1.smithi098.stdout:9/649: chown d2/d5/d18/d4e 52037 1 2023-01-04T18:16:32.990 INFO:tasks.workunit.client.1.smithi098.stdout:1/516: rename d1/d25/d6a/f93 to d1/d25/d27/fbd 0 2023-01-04T18:16:32.991 INFO:tasks.workunit.client.1.smithi098.stdout:7/592: dwrite d1/d23/d21/f4b [4194304,4194304] 0 2023-01-04T18:16:32.992 INFO:tasks.workunit.client.1.smithi098.stdout:2/601: creat d6/dc/d2b/fce x:0 0 0 2023-01-04T18:16:32.992 INFO:tasks.workunit.client.1.smithi098.stdout:7/593: truncate d1/da/fb0 936072 0 2023-01-04T18:16:32.993 INFO:tasks.workunit.client.1.smithi098.stdout:3/657: mknod d6/d10/d19/d3f/d5e/d7d/d90/de6/cef 0 2023-01-04T18:16:32.997 INFO:tasks.workunit.client.1.smithi098.stdout:3/658: dread d6/d10/d19/d3f/d46/fbd [0,4194304] 0 2023-01-04T18:16:32.997 INFO:tasks.workunit.client.1.smithi098.stdout:3/659: write d6/d10/d19/d3f/d5e/f67 [991357,9003] 0 2023-01-04T18:16:33.000 INFO:tasks.workunit.client.1.smithi098.stdout:0/645: creat df/d17/d1c/d2c/d41/d4a/fda x:0 0 0 2023-01-04T18:16:33.001 INFO:tasks.workunit.client.1.smithi098.stdout:1/517: getdents d1/d25/d36/d4e 0 2023-01-04T18:16:33.006 INFO:tasks.workunit.client.1.smithi098.stdout:8/624: dwrite d6/d11/f1a [0,4194304] 0 2023-01-04T18:16:33.006 INFO:tasks.workunit.client.1.smithi098.stdout:7/594: creat d1/da/fcf x:0 0 0 2023-01-04T18:16:33.009 INFO:tasks.workunit.client.1.smithi098.stdout:4/573: truncate d5/d28/f51 1000993 0 2023-01-04T18:16:33.009 INFO:tasks.workunit.client.1.smithi098.stdout:2/602: creat d6/dc/d2b/d42/d51/d79/fcf x:0 0 0 2023-01-04T18:16:33.010 INFO:tasks.workunit.client.1.smithi098.stdout:2/603: stat d6/f33 0 2023-01-04T18:16:33.010 INFO:tasks.workunit.client.1.smithi098.stdout:2/604: chown d6/dc/d2b/d32/fa2 58 1 2023-01-04T18:16:33.013 INFO:tasks.workunit.client.1.smithi098.stdout:7/595: getdents d1/d23/d37/d78 0 2023-01-04T18:16:33.014 INFO:tasks.workunit.client.1.smithi098.stdout:4/574: creat d5/d28/d40/d5d/fbe x:0 0 0 2023-01-04T18:16:33.015 INFO:tasks.workunit.client.1.smithi098.stdout:4/575: fsync d5/de/f29 0 2023-01-04T18:16:33.015 INFO:tasks.workunit.client.1.smithi098.stdout:2/605: getdents d6/dc/d2b/d42/d47/d35 0 2023-01-04T18:16:33.018 INFO:tasks.workunit.client.1.smithi098.stdout:4/576: write d5/dad/fb2 [2026169,120590] 0 2023-01-04T18:16:33.026 INFO:tasks.workunit.client.1.smithi098.stdout:4/577: dread d5/f4d [0,4194304] 0 2023-01-04T18:16:33.026 INFO:tasks.workunit.client.1.smithi098.stdout:4/578: chown d5/de/d30/d4f/l55 8 1 2023-01-04T18:16:33.027 INFO:tasks.workunit.client.1.smithi098.stdout:9/650: dwrite d2/f1e [12582912,4194304] 0 2023-01-04T18:16:33.028 INFO:tasks.workunit.client.1.smithi098.stdout:9/651: readlink d2/d5/d18/d1d/l48 0 2023-01-04T18:16:33.028 INFO:tasks.workunit.client.1.smithi098.stdout:2/606: creat d6/dc/d2b/d42/d47/d1f/fd0 x:0 0 0 2023-01-04T18:16:33.028 INFO:tasks.workunit.client.1.smithi098.stdout:1/518: dwrite d1/d25/d6a/f6b [0,4194304] 0 2023-01-04T18:16:33.028 INFO:tasks.workunit.client.1.smithi098.stdout:1/519: fsync d1/d8/f10 0 2023-01-04T18:16:33.031 INFO:tasks.workunit.client.1.smithi098.stdout:4/579: mkdir d5/de/d21/d96/dbf 0 2023-01-04T18:16:33.032 INFO:tasks.workunit.client.1.smithi098.stdout:3/660: dwrite d6/d6f/f94 [0,4194304] 0 2023-01-04T18:16:33.033 INFO:tasks.workunit.client.1.smithi098.stdout:5/606: sync 2023-01-04T18:16:33.035 INFO:tasks.workunit.client.1.smithi098.stdout:6/632: sync 2023-01-04T18:16:33.037 INFO:tasks.workunit.client.1.smithi098.stdout:9/652: link d2/d5/c15 d2/d5/d6f/cd4 0 2023-01-04T18:16:33.041 INFO:tasks.workunit.client.1.smithi098.stdout:4/580: symlink d5/lc0 0 2023-01-04T18:16:33.042 INFO:tasks.workunit.client.1.smithi098.stdout:8/625: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/f8c [0,4194304] 0 2023-01-04T18:16:33.042 INFO:tasks.workunit.client.1.smithi098.stdout:8/626: fdatasync d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/fb6 0 2023-01-04T18:16:33.043 INFO:tasks.workunit.client.1.smithi098.stdout:3/661: rmdir d6/d10/d19/d3f/d5e/d7d 39 2023-01-04T18:16:33.043 INFO:tasks.workunit.client.1.smithi098.stdout:3/662: chown d6/l5f 90 1 2023-01-04T18:16:33.043 INFO:tasks.workunit.client.1.smithi098.stdout:3/663: read - d6/d10/d29/f81 zero size 2023-01-04T18:16:33.045 INFO:tasks.workunit.client.1.smithi098.stdout:5/607: rmdir d1/da 39 2023-01-04T18:16:33.045 INFO:tasks.workunit.client.1.smithi098.stdout:5/608: dread - d1/d2f/d66/fb1 zero size 2023-01-04T18:16:33.046 INFO:tasks.workunit.client.1.smithi098.stdout:6/633: getdents d9/dd/de/d20/d82/d84 0 2023-01-04T18:16:33.046 INFO:tasks.workunit.client.1.smithi098.stdout:6/634: chown d9/dd/d4e/d67/d8d 293 1 2023-01-04T18:16:33.047 INFO:tasks.workunit.client.1.smithi098.stdout:0/646: dwrite df/d17/d1c/f1e [0,4194304] 0 2023-01-04T18:16:33.048 INFO:tasks.workunit.client.1.smithi098.stdout:1/520: dwrite d1/d25/d27/d77/da8/f76 [0,4194304] 0 2023-01-04T18:16:33.048 INFO:tasks.workunit.client.1.smithi098.stdout:1/521: fdatasync d1/d25/fb9 0 2023-01-04T18:16:33.048 INFO:tasks.workunit.client.1.smithi098.stdout:9/653: getdents d2/d5/d18/d1d/d23/d5c 0 2023-01-04T18:16:33.048 INFO:tasks.workunit.client.1.smithi098.stdout:9/654: chown d2/d5/d18/d4e/d42/d89/fa4 63723 1 2023-01-04T18:16:33.049 INFO:tasks.workunit.client.1.smithi098.stdout:4/581: getdents d5/d28/d7d 0 2023-01-04T18:16:33.049 INFO:tasks.workunit.client.1.smithi098.stdout:4/582: truncate d5/dad/f99 1028154 0 2023-01-04T18:16:33.051 INFO:tasks.workunit.client.1.smithi098.stdout:3/664: dread d6/d10/f62 [0,4194304] 0 2023-01-04T18:16:33.051 INFO:tasks.workunit.client.1.smithi098.stdout:3/665: write d6/d10/d19/d3f/fdb [479565,121419] 0 2023-01-04T18:16:33.052 INFO:tasks.workunit.client.1.smithi098.stdout:3/666: truncate d6/f54 1204302 0 2023-01-04T18:16:33.052 INFO:tasks.workunit.client.1.smithi098.stdout:3/667: write d6/d10/f62 [4789129,93527] 0 2023-01-04T18:16:33.053 INFO:tasks.workunit.client.1.smithi098.stdout:8/627: creat d6/d11/d15/d1b/d2a/d6b/d7f/fb9 x:0 0 0 2023-01-04T18:16:33.058 INFO:tasks.workunit.client.1.smithi098.stdout:5/609: rmdir d1 39 2023-01-04T18:16:33.058 INFO:tasks.workunit.client.1.smithi098.stdout:5/610: chown d1/d1e/f68 261 1 2023-01-04T18:16:33.059 INFO:tasks.workunit.client.1.smithi098.stdout:6/635: creat d9/fc3 x:0 0 0 2023-01-04T18:16:33.059 INFO:tasks.workunit.client.1.smithi098.stdout:6/636: chown d9/dd/d4e/d67/d8d/d8e/cad 4 1 2023-01-04T18:16:33.060 INFO:tasks.workunit.client.1.smithi098.stdout:0/647: symlink df/d17/d24/d80/ldb 0 2023-01-04T18:16:33.060 INFO:tasks.workunit.client.1.smithi098.stdout:0/648: readlink df/d4f/l53 0 2023-01-04T18:16:33.062 INFO:tasks.workunit.client.1.smithi098.stdout:1/522: symlink d1/da9/lbe 0 2023-01-04T18:16:33.063 INFO:tasks.workunit.client.1.smithi098.stdout:9/655: rmdir d2/d5/d6f 39 2023-01-04T18:16:33.064 INFO:tasks.workunit.client.1.smithi098.stdout:4/583: rmdir d5/d28/da6 39 2023-01-04T18:16:33.064 INFO:tasks.workunit.client.1.smithi098.stdout:4/584: dread - d5/fbb zero size 2023-01-04T18:16:33.065 INFO:tasks.workunit.client.1.smithi098.stdout:3/668: mknod d6/d10/d19/d3f/d5e/d7d/dec/cf0 0 2023-01-04T18:16:33.066 INFO:tasks.workunit.client.1.smithi098.stdout:8/628: mkdir d6/d11/d15/db4/dba 0 2023-01-04T18:16:33.066 INFO:tasks.workunit.client.1.smithi098.stdout:8/629: dread - d6/d11/d15/d1b/d2a/d6b/d7f/f8f zero size 2023-01-04T18:16:33.067 INFO:tasks.workunit.client.1.smithi098.stdout:3/669: write d6/d10/d19/d3f/d5e/d74/f6e [3591812,19792] 0 2023-01-04T18:16:33.067 INFO:tasks.workunit.client.1.smithi098.stdout:3/670: stat d6/d10/d19/d3f/d5e/d74/f89 0 2023-01-04T18:16:33.067 INFO:tasks.workunit.client.1.smithi098.stdout:5/611: mkdir d1/da/d44/d80/dbb 0 2023-01-04T18:16:33.067 INFO:tasks.workunit.client.1.smithi098.stdout:8/630: dread d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/f73 [0,4194304] 0 2023-01-04T18:16:33.067 INFO:tasks.workunit.client.1.smithi098.stdout:8/631: fdatasync d6/f8d 0 2023-01-04T18:16:33.067 INFO:tasks.workunit.client.1.smithi098.stdout:8/632: dread - d6/d11/d15/d1b/d2a/d6b/d7f/f8f zero size 2023-01-04T18:16:33.067 INFO:tasks.workunit.client.1.smithi098.stdout:3/671: write d6/d10/dc0/fcb [118070,32771] 0 2023-01-04T18:16:33.068 INFO:tasks.workunit.client.1.smithi098.stdout:6/637: symlink d9/dd/d24/d3e/d86/lc4 0 2023-01-04T18:16:33.069 INFO:tasks.workunit.client.1.smithi098.stdout:0/649: mkdir df/d17/d1c/d3b/d98/ddc 0 2023-01-04T18:16:33.071 INFO:tasks.workunit.client.1.smithi098.stdout:1/523: symlink d1/d25/d39/d8e/lbf 0 2023-01-04T18:16:33.072 INFO:tasks.workunit.client.1.smithi098.stdout:9/656: rename d2/d5/d18/f8f to d2/d5/d18/d4e/d42/d89/dac/d78/dbb/fd5 0 2023-01-04T18:16:33.073 INFO:tasks.workunit.client.1.smithi098.stdout:4/585: mknod d5/de/d30/d4f/cc1 0 2023-01-04T18:16:33.074 INFO:tasks.workunit.client.1.smithi098.stdout:4/586: readlink d5/d9/l60 0 2023-01-04T18:16:33.074 INFO:tasks.workunit.client.1.smithi098.stdout:4/587: fsync d5/d28/d40/f64 0 2023-01-04T18:16:33.074 INFO:tasks.workunit.client.1.smithi098.stdout:5/612: symlink d1/da/d44/d83/lbc 0 2023-01-04T18:16:33.076 INFO:tasks.workunit.client.1.smithi098.stdout:8/633: unlink d6/d11/d15/d1b/d2a/d6b/d7f/d12/l56 0 2023-01-04T18:16:33.077 INFO:tasks.workunit.client.1.smithi098.stdout:3/672: getdents d6/d10/d29 0 2023-01-04T18:16:33.079 INFO:tasks.workunit.client.1.smithi098.stdout:6/638: mkdir d9/dd/d4e/d67/d8d/d81/dc5 0 2023-01-04T18:16:33.080 INFO:tasks.workunit.client.1.smithi098.stdout:0/650: mkdir df/d17/d9b/da4/ddd 0 2023-01-04T18:16:33.081 INFO:tasks.workunit.client.1.smithi098.stdout:6/639: dread d9/dd/d24/d3e/fa4 [0,4194304] 0 2023-01-04T18:16:33.084 INFO:tasks.workunit.client.1.smithi098.stdout:9/657: readlink d2/d5/d18/d4e/d42/d89/dac/d26/d41/l46 0 2023-01-04T18:16:33.085 INFO:tasks.workunit.client.1.smithi098.stdout:4/588: mknod d5/d9/d90/cc2 0 2023-01-04T18:16:33.088 INFO:tasks.workunit.client.1.smithi098.stdout:5/613: mkdir d1/da/d44/d80/dbd 0 2023-01-04T18:16:33.089 INFO:tasks.workunit.client.1.smithi098.stdout:8/634: link d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/f40 d6/d11/fbb 0 2023-01-04T18:16:33.089 INFO:tasks.workunit.client.1.smithi098.stdout:8/635: truncate d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/f61 1364204 0 2023-01-04T18:16:33.090 INFO:tasks.workunit.client.1.smithi098.stdout:8/636: read d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/f6f [3531151,18787] 0 2023-01-04T18:16:33.091 INFO:tasks.workunit.client.1.smithi098.stdout:3/673: link d6/d56/d9f/da8/cbe d6/d10/d29/dc3/cf1 0 2023-01-04T18:16:33.093 INFO:tasks.workunit.client.1.smithi098.stdout:0/651: mknod df/d17/d1c/d2c/da8/cde 0 2023-01-04T18:16:33.093 INFO:tasks.workunit.client.1.smithi098.stdout:6/640: truncate d9/dd/f42 14946 0 2023-01-04T18:16:33.095 INFO:tasks.workunit.client.1.smithi098.stdout:9/658: mknod d2/d5/d18/d19/d82/cd6 0 2023-01-04T18:16:33.096 INFO:tasks.workunit.client.1.smithi098.stdout:3/674: write d6/d10/fbf [4400861,12639] 0 2023-01-04T18:16:33.096 INFO:tasks.workunit.client.1.smithi098.stdout:3/675: chown d6/d10/d19/d3f/fdb 8637 1 2023-01-04T18:16:33.097 INFO:tasks.workunit.client.1.smithi098.stdout:8/637: unlink d6/d11/d15/d1b/d2a/d6b/d7f/da6/l68 0 2023-01-04T18:16:33.098 INFO:tasks.workunit.client.1.smithi098.stdout:0/652: mkdir df/d17/d9b/ddf 0 2023-01-04T18:16:33.099 INFO:tasks.workunit.client.1.smithi098.stdout:6/641: creat d9/dd/de/d44/d7a/fc6 x:0 0 0 2023-01-04T18:16:33.101 INFO:tasks.workunit.client.1.smithi098.stdout:9/659: creat d2/d2d/fd7 x:0 0 0 2023-01-04T18:16:33.101 INFO:tasks.workunit.client.1.smithi098.stdout:9/660: chown d2/d5/d6f/lb8 27960778 1 2023-01-04T18:16:33.102 INFO:tasks.workunit.client.1.smithi098.stdout:3/676: creat d6/d10/d19/d3f/d46/ff2 x:0 0 0 2023-01-04T18:16:33.103 INFO:tasks.workunit.client.1.smithi098.stdout:1/524: dwrite d1/d8/d53/f73 [0,4194304] 0 2023-01-04T18:16:33.103 INFO:tasks.workunit.client.1.smithi098.stdout:8/638: creat d6/d11/d15/d70/fbc x:0 0 0 2023-01-04T18:16:33.105 INFO:tasks.workunit.client.1.smithi098.stdout:0/653: creat df/d17/d9b/da4/fe0 x:0 0 0 2023-01-04T18:16:33.105 INFO:tasks.workunit.client.1.smithi098.stdout:0/654: truncate df/d17/d9b/d86/fc8 835203 0 2023-01-04T18:16:33.106 INFO:tasks.workunit.client.1.smithi098.stdout:4/589: dwrite d5/de/d21/f80 [0,4194304] 0 2023-01-04T18:16:33.106 INFO:tasks.workunit.client.1.smithi098.stdout:5/614: dwrite d1/d1e/f68 [4194304,4194304] 0 2023-01-04T18:16:33.106 INFO:tasks.workunit.client.1.smithi098.stdout:6/642: truncate d9/dd/d24/d3e/f87 29389 0 2023-01-04T18:16:33.109 INFO:tasks.workunit.client.1.smithi098.stdout:0/655: dread df/d17/d1c/f3a [0,4194304] 0 2023-01-04T18:16:33.113 INFO:tasks.workunit.client.1.smithi098.stdout:9/661: creat d2/d5/d18/d4e/fd8 x:0 0 0 2023-01-04T18:16:33.113 INFO:tasks.workunit.client.1.smithi098.stdout:9/662: stat d2/d5/d6f 0 2023-01-04T18:16:33.115 INFO:tasks.workunit.client.1.smithi098.stdout:3/677: link d6/d10/d19/d3f/d5e/d7d/dec/lb3 d6/d6f/lf3 0 2023-01-04T18:16:33.122 INFO:tasks.workunit.client.1.smithi098.stdout:1/525: creat d1/d25/d36/d4e/d6e/fc0 x:0 0 0 2023-01-04T18:16:33.125 INFO:tasks.workunit.client.1.smithi098.stdout:8/639: rename d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/fb5 to d6/d11/d15/d1b/d2a/d6b/d7f/da6/fbd 0 2023-01-04T18:16:33.125 INFO:tasks.workunit.client.1.smithi098.stdout:8/640: chown d6/d11/l4a 19249655 1 2023-01-04T18:16:33.130 INFO:tasks.workunit.client.1.smithi098.stdout:4/590: mknod d5/de/d9b/cc3 0 2023-01-04T18:16:33.131 INFO:tasks.workunit.client.1.smithi098.stdout:0/656: dwrite df/d17/d1c/d3b/d98/f81 [0,4194304] 0 2023-01-04T18:16:33.131 INFO:tasks.workunit.client.1.smithi098.stdout:0/657: fdatasync df/d17/d1c/d2c/d41/da0/fa3 0 2023-01-04T18:16:33.131 INFO:tasks.workunit.client.1.smithi098.stdout:0/658: readlink df/l20 0 2023-01-04T18:16:33.138 INFO:tasks.workunit.client.1.smithi098.stdout:9/663: creat d2/d5/d18/d4e/d42/d89/dac/d26/fd9 x:0 0 0 2023-01-04T18:16:33.138 INFO:tasks.workunit.client.1.smithi098.stdout:3/678: creat d6/d6f/d9b/ff4 x:0 0 0 2023-01-04T18:16:33.139 INFO:tasks.workunit.client.1.smithi098.stdout:3/679: chown d6/d10/d6b/d9e/fae 2934910 1 2023-01-04T18:16:33.141 INFO:tasks.workunit.client.1.smithi098.stdout:4/591: getdents d5/de/d30 0 2023-01-04T18:16:33.142 INFO:tasks.workunit.client.1.smithi098.stdout:1/526: dwrite d1/d8/f28 [4194304,4194304] 0 2023-01-04T18:16:33.142 INFO:tasks.workunit.client.1.smithi098.stdout:1/527: read - d1/d8/dac/fad zero size 2023-01-04T18:16:33.142 INFO:tasks.workunit.client.1.smithi098.stdout:1/528: chown d1/d25/d6a/cab 167 1 2023-01-04T18:16:33.144 INFO:tasks.workunit.client.1.smithi098.stdout:3/680: creat d6/d6f/db6/ff5 x:0 0 0 2023-01-04T18:16:33.147 INFO:tasks.workunit.client.1.smithi098.stdout:8/641: mkdir d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/dbe 0 2023-01-04T18:16:33.148 INFO:tasks.workunit.client.1.smithi098.stdout:4/592: creat d5/d28/d44/fc4 x:0 0 0 2023-01-04T18:16:33.150 INFO:tasks.workunit.client.1.smithi098.stdout:3/681: creat d6/d6f/d9b/ff6 x:0 0 0 2023-01-04T18:16:33.151 INFO:tasks.workunit.client.1.smithi098.stdout:3/682: fdatasync d6/d10/d19/d3f/d5e/d7d/dec/dda/fe2 0 2023-01-04T18:16:33.152 INFO:tasks.workunit.client.1.smithi098.stdout:4/593: mkdir d5/d28/d7d/db6/dbd/dc5 0 2023-01-04T18:16:33.152 INFO:tasks.workunit.client.1.smithi098.stdout:4/594: fdatasync d5/f93 0 2023-01-04T18:16:33.154 INFO:tasks.workunit.client.1.smithi098.stdout:3/683: rename d6/d10/c4f to d6/d10/d19/d3f/d5e/d7d/d90/de6/ded/cf7 0 2023-01-04T18:16:33.154 INFO:tasks.workunit.client.1.smithi098.stdout:3/684: stat d6/d10/d29/d6a/dd1 0 2023-01-04T18:16:33.154 INFO:tasks.workunit.client.1.smithi098.stdout:3/685: readlink d6/d56/d9f/lc1 0 2023-01-04T18:16:33.156 INFO:tasks.workunit.client.1.smithi098.stdout:3/686: mkdir d6/d10/df8 0 2023-01-04T18:16:33.156 INFO:tasks.workunit.client.1.smithi098.stdout:3/687: write d6/f25 [211041,120888] 0 2023-01-04T18:16:33.164 INFO:tasks.workunit.client.1.smithi098.stdout:4/595: dread d5/f1b [0,4194304] 0 2023-01-04T18:16:33.165 INFO:tasks.workunit.client.1.smithi098.stdout:4/596: stat d5/de/d30/d4f/c58 0 2023-01-04T18:16:33.165 INFO:tasks.workunit.client.1.smithi098.stdout:3/688: dread d6/d10/d19/d3f/d5e/d74/f3c [0,4194304] 0 2023-01-04T18:16:33.165 INFO:tasks.workunit.client.1.smithi098.stdout:3/689: fdatasync d6/d10/d19/d3f/d5e/fa9 0 2023-01-04T18:16:33.166 INFO:tasks.workunit.client.1.smithi098.stdout:4/597: mknod d5/d28/d44/cc6 0 2023-01-04T18:16:33.166 INFO:tasks.workunit.client.1.smithi098.stdout:4/598: rmdir d5/de 39 2023-01-04T18:16:33.167 INFO:tasks.workunit.client.1.smithi098.stdout:4/599: symlink d5/de/d30/lc7 0 2023-01-04T18:16:33.168 INFO:tasks.workunit.client.1.smithi098.stdout:4/600: chown d5/d9/d13/d65/d98/la3 557595 1 2023-01-04T18:16:33.168 INFO:tasks.workunit.client.1.smithi098.stdout:4/601: rmdir d5/d9/d13/d65/d98 39 2023-01-04T18:16:33.169 INFO:tasks.workunit.client.1.smithi098.stdout:4/602: mknod d5/d9/d13/dab/cc8 0 2023-01-04T18:16:33.170 INFO:tasks.workunit.client.1.smithi098.stdout:1/529: dwrite d1/d88/f97 [0,4194304] 0 2023-01-04T18:16:33.171 INFO:tasks.workunit.client.1.smithi098.stdout:9/664: dwrite d2/d5/d18/d4e/d42/f99 [0,4194304] 0 2023-01-04T18:16:33.171 INFO:tasks.workunit.client.1.smithi098.stdout:8/642: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/f40 [0,4194304] 0 2023-01-04T18:16:33.172 INFO:tasks.workunit.client.1.smithi098.stdout:4/603: rename d5/de/d30/d4f/f7b to d5/d28/d7d/db6/dbd/fc9 0 2023-01-04T18:16:33.172 INFO:tasks.workunit.client.1.smithi098.stdout:1/530: creat d1/d8/da/fc1 x:0 0 0 2023-01-04T18:16:33.174 INFO:tasks.workunit.client.1.smithi098.stdout:8/643: getdents d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39 0 2023-01-04T18:16:33.174 INFO:tasks.workunit.client.1.smithi098.stdout:8/644: chown d6/d11/d15/d1b/d2a/d6b/f7b 7439834 1 2023-01-04T18:16:33.175 INFO:tasks.workunit.client.1.smithi098.stdout:8/645: write d6/d11/d15/d1b/f93 [741195,80072] 0 2023-01-04T18:16:33.175 INFO:tasks.workunit.client.1.smithi098.stdout:9/665: dread d2/d5/d18/d4e/d42/d89/dac/d26/f37 [0,4194304] 0 2023-01-04T18:16:33.177 INFO:tasks.workunit.client.1.smithi098.stdout:4/604: link d5/de/d2c/f3a d5/de/d21/d9d/fca 0 2023-01-04T18:16:33.178 INFO:tasks.workunit.client.1.smithi098.stdout:1/531: symlink d1/d25/d36/d89/lc2 0 2023-01-04T18:16:33.179 INFO:tasks.workunit.client.1.smithi098.stdout:9/666: dread d2/d2d/f8d [0,4194304] 0 2023-01-04T18:16:33.180 INFO:tasks.workunit.client.1.smithi098.stdout:8/646: rename d6/d11/d15/cb1 to d6/d11/d15/d1b/d2a/d3b/d59/cbf 0 2023-01-04T18:16:33.182 INFO:tasks.workunit.client.1.smithi098.stdout:4/605: unlink d5/d9/f1a 0 2023-01-04T18:16:33.182 INFO:tasks.workunit.client.1.smithi098.stdout:3/690: dwrite d6/d10/d19/f3a [0,4194304] 0 2023-01-04T18:16:33.182 INFO:tasks.workunit.client.1.smithi098.stdout:3/691: chown d6/l4a 789 1 2023-01-04T18:16:33.183 INFO:tasks.workunit.client.1.smithi098.stdout:1/532: mkdir d1/d25/d27/d5c/dc3 0 2023-01-04T18:16:33.185 INFO:tasks.workunit.client.1.smithi098.stdout:9/667: mknod d2/d53/daf/db3/cda 0 2023-01-04T18:16:33.188 INFO:tasks.workunit.client.1.smithi098.stdout:3/692: dread d6/d10/d19/d3f/d46/fbd [0,4194304] 0 2023-01-04T18:16:33.190 INFO:tasks.workunit.client.1.smithi098.stdout:4/606: mkdir d5/de/d2c/dcb 0 2023-01-04T18:16:33.191 INFO:tasks.workunit.client.1.smithi098.stdout:1/533: truncate d1/d25/d27/d77/f4b 768273 0 2023-01-04T18:16:33.192 INFO:tasks.workunit.client.1.smithi098.stdout:9/668: mknod d2/d5/d18/d1d/d23/d66/cdb 0 2023-01-04T18:16:33.192 INFO:tasks.workunit.client.1.smithi098.stdout:3/693: mknod d6/d10/db7/de1/cf9 0 2023-01-04T18:16:33.194 INFO:tasks.workunit.client.1.smithi098.stdout:4/607: rename d5/d28/d44/cc6 to d5/de/d30/d4f/ccc 0 2023-01-04T18:16:33.195 INFO:tasks.workunit.client.1.smithi098.stdout:4/608: write d5/d28/f2b [835342,129088] 0 2023-01-04T18:16:33.196 INFO:tasks.workunit.client.1.smithi098.stdout:4/609: fdatasync d5/de/f88 0 2023-01-04T18:16:33.198 INFO:tasks.workunit.client.1.smithi098.stdout:9/669: mkdir d2/d5/d18/d1d/dc0/ddc 0 2023-01-04T18:16:33.202 INFO:tasks.workunit.client.1.smithi098.stdout:1/534: dread d1/d25/d27/d77/da8/f76 [0,4194304] 0 2023-01-04T18:16:33.202 INFO:tasks.workunit.client.1.smithi098.stdout:2/607: sync 2023-01-04T18:16:33.202 INFO:tasks.workunit.client.1.smithi098.stdout:5/615: sync 2023-01-04T18:16:33.202 INFO:tasks.workunit.client.1.smithi098.stdout:7/596: sync 2023-01-04T18:16:33.203 INFO:tasks.workunit.client.1.smithi098.stdout:5/616: chown d1/d38/d3b/l85 1100291 1 2023-01-04T18:16:33.203 INFO:tasks.workunit.client.1.smithi098.stdout:7/597: chown d1/db2/lbb 851769151 1 2023-01-04T18:16:33.203 INFO:tasks.workunit.client.1.smithi098.stdout:2/608: chown d6/dc/d4b/f97 713 1 2023-01-04T18:16:33.203 INFO:tasks.workunit.client.1.smithi098.stdout:6/643: sync 2023-01-04T18:16:33.203 INFO:tasks.workunit.client.1.smithi098.stdout:2/609: read d6/f20 [2061657,83933] 0 2023-01-04T18:16:33.206 INFO:tasks.workunit.client.1.smithi098.stdout:4/610: rename d5/d9/f7e to d5/d28/fcd 0 2023-01-04T18:16:33.206 INFO:tasks.workunit.client.1.smithi098.stdout:4/611: stat d5/d9/l66 0 2023-01-04T18:16:33.206 INFO:tasks.workunit.client.1.smithi098.stdout:4/612: fsync d5/de/d21/f39 0 2023-01-04T18:16:33.208 INFO:tasks.workunit.client.1.smithi098.stdout:5/617: link d1/da/d44/f9c d1/d2/fbe 0 2023-01-04T18:16:33.209 INFO:tasks.workunit.client.1.smithi098.stdout:7/598: mkdir d1/d4/d11/d9d/dd0 0 2023-01-04T18:16:33.209 INFO:tasks.workunit.client.1.smithi098.stdout:0/659: sync 2023-01-04T18:16:33.210 INFO:tasks.workunit.client.1.smithi098.stdout:0/660: write df/d17/d9b/d5c/f91 [863750,84969] 0 2023-01-04T18:16:33.211 INFO:tasks.workunit.client.1.smithi098.stdout:6/644: unlink d9/dd/d24/d3e/d86/lc4 0 2023-01-04T18:16:33.211 INFO:tasks.workunit.client.1.smithi098.stdout:6/645: getdents d9/dd/d4e/d67/db6 0 2023-01-04T18:16:33.213 INFO:tasks.workunit.client.1.smithi098.stdout:2/610: mknod d6/dc/d2b/d42/d47/da5/cd1 0 2023-01-04T18:16:33.214 INFO:tasks.workunit.client.1.smithi098.stdout:9/670: rename d2/d53/daf/lc5 to d2/d5/d18/d1d/d23/dad/d72/d9e/dca/ldd 0 2023-01-04T18:16:33.215 INFO:tasks.workunit.client.1.smithi098.stdout:9/671: chown d2/d5/d18/d19/c1c 1742768 1 2023-01-04T18:16:33.215 INFO:tasks.workunit.client.1.smithi098.stdout:4/613: mknod d5/de/d2c/cce 0 2023-01-04T18:16:33.216 INFO:tasks.workunit.client.1.smithi098.stdout:5/618: unlink d1/d2/d14/d19/f79 0 2023-01-04T18:16:33.217 INFO:tasks.workunit.client.1.smithi098.stdout:7/599: creat d1/d23/d21/d7f/fd1 x:0 0 0 2023-01-04T18:16:33.217 INFO:tasks.workunit.client.1.smithi098.stdout:7/600: stat d1/d51/dc0/fce 0 2023-01-04T18:16:33.218 INFO:tasks.workunit.client.1.smithi098.stdout:0/661: symlink df/d17/d1c/d3b/d98/le1 0 2023-01-04T18:16:33.218 INFO:tasks.workunit.client.1.smithi098.stdout:6/646: creat d9/dd/de/d44/d7a/d85/fc7 x:0 0 0 2023-01-04T18:16:33.219 INFO:tasks.workunit.client.1.smithi098.stdout:2/611: mkdir d6/dc/d2b/d46/dd2 0 2023-01-04T18:16:33.220 INFO:tasks.workunit.client.1.smithi098.stdout:2/612: stat d6/dc/d2b/d42/d47/d35/c6c 0 2023-01-04T18:16:33.221 INFO:tasks.workunit.client.1.smithi098.stdout:6/647: dread d9/dd/d24/d3e/fa4 [0,4194304] 0 2023-01-04T18:16:33.222 INFO:tasks.workunit.client.1.smithi098.stdout:5/619: symlink d1/da/d44/d45/d4b/dba/lbf 0 2023-01-04T18:16:33.222 INFO:tasks.workunit.client.1.smithi098.stdout:5/620: truncate d1/da/d44/f9c 272244 0 2023-01-04T18:16:33.222 INFO:tasks.workunit.client.1.smithi098.stdout:5/621: stat d1/da/d44/l57 0 2023-01-04T18:16:33.222 INFO:tasks.workunit.client.1.smithi098.stdout:7/601: dread d1/d4/d11/f60 [0,4194304] 0 2023-01-04T18:16:33.222 INFO:tasks.workunit.client.1.smithi098.stdout:0/662: truncate df/d17/f4b 4305719 0 2023-01-04T18:16:33.223 INFO:tasks.workunit.client.1.smithi098.stdout:0/663: write df/f52 [754908,78585] 0 2023-01-04T18:16:33.223 INFO:tasks.workunit.client.1.smithi098.stdout:9/672: write d2/d5/d18/d4e/d42/d89/dac/d26/f9a [1850236,52293] 0 2023-01-04T18:16:33.223 INFO:tasks.workunit.client.1.smithi098.stdout:1/535: dwrite d1/d25/d27/d5c/fb6 [0,4194304] 0 2023-01-04T18:16:33.224 INFO:tasks.workunit.client.1.smithi098.stdout:3/694: dwrite d6/d6f/f94 [0,4194304] 0 2023-01-04T18:16:33.226 INFO:tasks.workunit.client.1.smithi098.stdout:2/613: creat d6/dc/d2b/d42/d51/d81/fd3 x:0 0 0 2023-01-04T18:16:33.226 INFO:tasks.workunit.client.1.smithi098.stdout:6/648: rename d9/dd/d24/d64/c94 to d9/dd/d24/d65/cc8 0 2023-01-04T18:16:33.226 INFO:tasks.workunit.client.1.smithi098.stdout:5/622: creat d1/d1e/fc0 x:0 0 0 2023-01-04T18:16:33.227 INFO:tasks.workunit.client.1.smithi098.stdout:9/673: symlink d2/d5/lde 0 2023-01-04T18:16:33.227 INFO:tasks.workunit.client.1.smithi098.stdout:9/674: stat d2/d5/f24 0 2023-01-04T18:16:33.227 INFO:tasks.workunit.client.1.smithi098.stdout:9/675: dread d2/d5/d18/d19/f92 [0,4194304] 0 2023-01-04T18:16:33.227 INFO:tasks.workunit.client.1.smithi098.stdout:9/676: fsync d2/f9c 0 2023-01-04T18:16:33.230 INFO:tasks.workunit.client.1.smithi098.stdout:1/536: symlink d1/d25/d36/d4e/d9f/db7/lc4 0 2023-01-04T18:16:33.232 INFO:tasks.workunit.client.1.smithi098.stdout:3/695: rmdir d6/d10/d19/d3f/d5e/d7d/d90/de6 39 2023-01-04T18:16:33.232 INFO:tasks.workunit.client.1.smithi098.stdout:3/696: fdatasync d6/d10/d19/d3f/d5e/d7d/d90/f93 0 2023-01-04T18:16:33.232 INFO:tasks.workunit.client.1.smithi098.stdout:3/697: dread - d6/d56/d9f/da8/fc2 zero size 2023-01-04T18:16:33.233 INFO:tasks.workunit.client.1.smithi098.stdout:6/649: mknod d9/dd/d4e/cc9 0 2023-01-04T18:16:33.235 INFO:tasks.workunit.client.1.smithi098.stdout:5/623: creat d1/d38/fc1 x:0 0 0 2023-01-04T18:16:33.235 INFO:tasks.workunit.client.1.smithi098.stdout:4/614: dwrite d5/d9/d13/f50 [0,4194304] 0 2023-01-04T18:16:33.236 INFO:tasks.workunit.client.1.smithi098.stdout:3/698: creat d6/d10/dc0/ffa x:0 0 0 2023-01-04T18:16:33.236 INFO:tasks.workunit.client.1.smithi098.stdout:3/699: chown d6/d10/d29/dc3/cf1 26654 1 2023-01-04T18:16:33.237 INFO:tasks.workunit.client.1.smithi098.stdout:2/614: symlink d6/dc/d2b/d42/d47/ld4 0 2023-01-04T18:16:33.240 INFO:tasks.workunit.client.1.smithi098.stdout:6/650: rename d9/dd/d24/d64/fac to d9/fca 0 2023-01-04T18:16:33.244 INFO:tasks.workunit.client.1.smithi098.stdout:5/624: link d1/da/d44/d83/c8b d1/d38/d3b/d8f/cc2 0 2023-01-04T18:16:33.244 INFO:tasks.workunit.client.1.smithi098.stdout:5/625: write d1/da/d44/f9c [306914,22462] 0 2023-01-04T18:16:33.250 INFO:tasks.workunit.client.1.smithi098.stdout:3/700: creat d6/ffb x:0 0 0 2023-01-04T18:16:33.251 INFO:tasks.workunit.client.1.smithi098.stdout:4/615: write d5/d28/d40/d5d/f6d [2989316,93227] 0 2023-01-04T18:16:33.251 INFO:tasks.workunit.client.1.smithi098.stdout:4/616: write d5/f93 [573884,18939] 0 2023-01-04T18:16:33.253 INFO:tasks.workunit.client.1.smithi098.stdout:6/651: dread d9/dd/d4e/f4f [0,4194304] 0 2023-01-04T18:16:33.256 INFO:tasks.workunit.client.1.smithi098.stdout:2/615: getdents d6/dc/d4b/d89 0 2023-01-04T18:16:33.256 INFO:tasks.workunit.client.1.smithi098.stdout:2/616: write d6/dc/d2b/d42/d47/d1f/f8b [368289,59181] 0 2023-01-04T18:16:33.256 INFO:tasks.workunit.client.1.smithi098.stdout:2/617: dread - d6/dc/d2b/d46/f84 zero size 2023-01-04T18:16:33.258 INFO:tasks.workunit.client.1.smithi098.stdout:5/626: creat d1/fc3 x:0 0 0 2023-01-04T18:16:33.275 INFO:tasks.workunit.client.1.smithi098.stdout:9/677: dwrite d2/d5/d18/d4e/fd8 [0,4194304] 0 2023-01-04T18:16:33.275 INFO:tasks.workunit.client.1.smithi098.stdout:6/652: dwrite d9/dd/f11 [4194304,4194304] 0 2023-01-04T18:16:33.275 INFO:tasks.workunit.client.1.smithi098.stdout:7/602: dwrite d1/d51/d26/d28/f88 [0,4194304] 0 2023-01-04T18:16:33.275 INFO:tasks.workunit.client.1.smithi098.stdout:1/537: dwrite d1/d8/f28 [4194304,4194304] 0 2023-01-04T18:16:33.275 INFO:tasks.workunit.client.1.smithi098.stdout:1/538: readlink d1/d8/da/dae/l51 0 2023-01-04T18:16:33.276 INFO:tasks.workunit.client.1.smithi098.stdout:9/678: write d2/d5/d18/d4e/d42/f99 [1317681,110791] 0 2023-01-04T18:16:33.276 INFO:tasks.workunit.client.1.smithi098.stdout:1/539: read d1/d25/d27/d5c/fb6 [2305129,49841] 0 2023-01-04T18:16:33.288 INFO:tasks.workunit.client.1.smithi098.stdout:3/701: creat d6/d10/d19/d3f/d5e/d7d/ffc x:0 0 0 2023-01-04T18:16:33.289 INFO:tasks.workunit.client.1.smithi098.stdout:4/617: mkdir d5/d28/d40/d5d/dcf 0 2023-01-04T18:16:33.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:31.913492+0000 mgr.smithi098.vhfzum (mgr.24455) 19 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 882 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 56 MiB/s rd, 100 MiB/s wr, 555 op/s 2023-01-04T18:16:33.292 INFO:tasks.workunit.client.1.smithi098.stdout:2/618: rename d6/dc/d2b/d42/d47/d1f/f24 to d6/dc/d2b/d42/fd5 0 2023-01-04T18:16:33.292 INFO:tasks.workunit.client.1.smithi098.stdout:2/619: fdatasync d6/dc/d2b/d42/d47/d1f/d39/f8a 0 2023-01-04T18:16:33.292 INFO:tasks.workunit.client.1.smithi098.stdout:5/627: mkdir d1/d46/dc4 0 2023-01-04T18:16:33.305 INFO:tasks.workunit.client.1.smithi098.stdout:3/702: dwrite d6/d10/d19/d3f/fdb [0,4194304] 0 2023-01-04T18:16:33.306 INFO:tasks.workunit.client.1.smithi098.stdout:6/653: link d9/dd/d24/d3e/d86/la9 d9/dd/de/d44/d7a/lcb 0 2023-01-04T18:16:33.309 INFO:tasks.workunit.client.1.smithi098.stdout:7/603: mkdir d1/d4/d11/d9d/dd2 0 2023-01-04T18:16:33.310 INFO:tasks.workunit.client.1.smithi098.stdout:7/604: truncate d1/d23/d37/fa2 1655462 0 2023-01-04T18:16:33.311 INFO:tasks.workunit.client.1.smithi098.stdout:2/620: dwrite d6/dc/d2b/d42/d47/d1f/d39/d6e/f74 [0,4194304] 0 2023-01-04T18:16:33.312 INFO:tasks.workunit.client.1.smithi098.stdout:9/679: symlink d2/d5/d18/d1d/d23/dad/d72/ldf 0 2023-01-04T18:16:33.312 INFO:tasks.workunit.client.1.smithi098.stdout:9/680: write d2/d5/d18/d1d/dc0/fcc [700115,98882] 0 2023-01-04T18:16:33.312 INFO:tasks.workunit.client.1.smithi098.stdout:1/540: creat d1/d8/d53/fc5 x:0 0 0 2023-01-04T18:16:33.316 INFO:tasks.workunit.client.1.smithi098.stdout:4/618: mknod d5/d9/d13/cd0 0 2023-01-04T18:16:33.318 INFO:tasks.workunit.client.1.smithi098.stdout:6/654: symlink d9/dd/de/d44/d7a/lcc 0 2023-01-04T18:16:33.319 INFO:tasks.workunit.client.1.smithi098.stdout:6/655: readlink d9/dd/de/d44/d7a/laf 0 2023-01-04T18:16:33.319 INFO:tasks.workunit.client.1.smithi098.stdout:7/605: creat d1/d51/d26/d28/dc6/fd3 x:0 0 0 2023-01-04T18:16:33.320 INFO:tasks.workunit.client.1.smithi098.stdout:4/619: rmdir d5/de/d9b 39 2023-01-04T18:16:33.321 INFO:tasks.workunit.client.1.smithi098.stdout:7/606: symlink d1/da/ld4 0 2023-01-04T18:16:33.323 INFO:tasks.workunit.client.1.smithi098.stdout:1/541: dread d1/d25/d36/f40 [0,4194304] 0 2023-01-04T18:16:33.323 INFO:tasks.workunit.client.1.smithi098.stdout:4/620: symlink d5/de/ld1 0 2023-01-04T18:16:33.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:31.913492+0000 mgr.smithi098.vhfzum (mgr.24455) 19 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 882 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 56 MiB/s rd, 100 MiB/s wr, 555 op/s 2023-01-04T18:16:33.371 INFO:tasks.workunit.client.1.smithi098.stdout:7/607: mkdir d1/d4/d11/d9d/dd0/dd5 0 2023-01-04T18:16:33.376 INFO:tasks.workunit.client.1.smithi098.stdout:5/628: dwrite d1/da/d44/f9c [0,4194304] 0 2023-01-04T18:16:33.376 INFO:tasks.workunit.client.1.smithi098.stdout:5/629: write d1/f6b [839042,24006] 0 2023-01-04T18:16:33.379 INFO:tasks.workunit.client.1.smithi098.stdout:9/681: dread d2/d5/d18/d4e/d42/d89/dac/d26/fbe [4194304,4194304] 0 2023-01-04T18:16:33.379 INFO:tasks.workunit.client.1.smithi098.stdout:2/621: dwrite d6/dc/d2b/d42/d47/d31/d90/fc4 [4194304,4194304] 0 2023-01-04T18:16:33.380 INFO:tasks.workunit.client.1.smithi098.stdout:7/608: dread d1/da/f1b [0,4194304] 0 2023-01-04T18:16:33.380 INFO:tasks.workunit.client.1.smithi098.stdout:7/609: write d1/d23/d37/d40/f4e [1433522,2385] 0 2023-01-04T18:16:33.381 INFO:tasks.workunit.client.1.smithi098.stdout:7/610: write d1/da/f1b [2511132,86029] 0 2023-01-04T18:16:33.385 INFO:tasks.workunit.client.1.smithi098.stdout:6/656: dwrite d9/dd/f42 [0,4194304] 0 2023-01-04T18:16:33.389 INFO:tasks.workunit.client.1.smithi098.stdout:2/622: dread d6/dc/f12 [0,4194304] 0 2023-01-04T18:16:33.389 INFO:tasks.workunit.client.1.smithi098.stdout:6/657: dread d9/dd/f29 [4194304,4194304] 0 2023-01-04T18:16:33.389 INFO:tasks.workunit.client.1.smithi098.stdout:6/658: write d9/dd/de/d7e/fb2 [211723,31428] 0 2023-01-04T18:16:33.391 INFO:tasks.workunit.client.1.smithi098.stdout:2/623: dread d6/dc/d2b/d42/d47/d1f/d39/f56 [0,4194304] 0 2023-01-04T18:16:33.391 INFO:tasks.workunit.client.1.smithi098.stdout:7/611: dread d1/d23/d21/d7f/fbc [0,4194304] 0 2023-01-04T18:16:33.409 INFO:tasks.workunit.client.1.smithi098.stdout:1/542: creat d1/da9/fc6 x:0 0 0 2023-01-04T18:16:33.409 INFO:tasks.workunit.client.1.smithi098.stdout:1/543: truncate d1/da9/fc6 671980 0 2023-01-04T18:16:33.409 INFO:tasks.workunit.client.1.smithi098.stdout:1/544: write d1/d25/d27/fbd [506302,99228] 0 2023-01-04T18:16:33.410 INFO:tasks.workunit.client.1.smithi098.stdout:4/621: creat d5/d9/d13/d65/fd2 x:0 0 0 2023-01-04T18:16:33.414 INFO:tasks.workunit.client.1.smithi098.stdout:5/630: symlink d1/d1e/lc5 0 2023-01-04T18:16:33.423 INFO:tasks.workunit.client.1.smithi098.stdout:8/647: sync 2023-01-04T18:16:33.425 INFO:tasks.workunit.client.1.smithi098.stdout:6/659: dwrite d9/dd/d4e/f92 [0,4194304] 0 2023-01-04T18:16:33.425 INFO:tasks.workunit.client.1.smithi098.stdout:6/660: readlink d9/dd/de/l47 0 2023-01-04T18:16:33.425 INFO:tasks.workunit.client.1.smithi098.stdout:6/661: write d9/dd/de/d44/d7a/fc6 [424573,106625] 0 2023-01-04T18:16:33.431 INFO:tasks.workunit.client.1.smithi098.stdout:1/545: dwrite d1/d25/d27/d5c/fb6 [0,4194304] 0 2023-01-04T18:16:33.435 INFO:tasks.workunit.client.1.smithi098.stdout:9/682: dwrite d2/d5/d18/d4e/d42/d89/dac/d26/d41/f85 [0,4194304] 0 2023-01-04T18:16:33.447 INFO:tasks.workunit.client.1.smithi098.stdout:7/612: unlink d1/d23/d37/fa2 0 2023-01-04T18:16:33.451 INFO:tasks.workunit.client.1.smithi098.stdout:4/622: symlink d5/d28/d7d/db6/dbd/ld3 0 2023-01-04T18:16:33.460 INFO:tasks.workunit.client.1.smithi098.stdout:5/631: mkdir d1/da/d44/d80/dc6 0 2023-01-04T18:16:33.466 INFO:tasks.workunit.client.1.smithi098.stdout:7/613: dwrite d1/d2e/fbe [0,4194304] 0 2023-01-04T18:16:33.467 INFO:tasks.workunit.client.1.smithi098.stdout:7/614: write d1/d23/d37/f42 [2455712,78617] 0 2023-01-04T18:16:33.467 INFO:tasks.workunit.client.1.smithi098.stdout:7/615: truncate d1/d23/d21/d7f/f98 1076863 0 2023-01-04T18:16:33.469 INFO:tasks.workunit.client.1.smithi098.stdout:5/632: dread d1/da/d44/d45/f7c [0,4194304] 0 2023-01-04T18:16:33.469 INFO:tasks.workunit.client.1.smithi098.stdout:5/633: fsync d1/f2e 0 2023-01-04T18:16:33.581 INFO:tasks.workunit.client.1.smithi098.stdout:8/648: creat d6/d11/d15/d1b/d2a/d6b/d7f/d5a/fc0 x:0 0 0 2023-01-04T18:16:33.604 INFO:tasks.workunit.client.1.smithi098.stdout:0/664: sync 2023-01-04T18:16:33.604 INFO:tasks.workunit.client.1.smithi098.stdout:0/665: read df/d17/d24/fbb [527735,39260] 0 2023-01-04T18:16:33.625 INFO:tasks.workunit.client.1.smithi098.stdout:6/662: unlink d9/dd/f42 0 2023-01-04T18:16:33.626 INFO:tasks.workunit.client.1.smithi098.stdout:1/546: creat d1/d25/d36/d4e/d9f/fc7 x:0 0 0 2023-01-04T18:16:33.631 INFO:tasks.workunit.client.1.smithi098.stdout:6/663: dread d9/dd/de/d44/fa6 [4194304,4194304] 0 2023-01-04T18:16:33.632 INFO:tasks.workunit.client.1.smithi098.stdout:6/664: chown d9/dd/d4e/f4f 13913 1 2023-01-04T18:16:33.632 INFO:tasks.workunit.client.1.smithi098.stdout:9/683: rmdir d2/d5/d18/d1d/dc0 39 2023-01-04T18:16:33.633 INFO:tasks.workunit.client.1.smithi098.stdout:4/623: creat d5/d9/d90/fd4 x:0 0 0 2023-01-04T18:16:33.640 INFO:tasks.workunit.client.1.smithi098.stdout:9/684: dread d2/d5/d18/d4e/d42/d89/dac/d26/d41/f6a [0,4194304] 0 2023-01-04T18:16:33.640 INFO:tasks.workunit.client.1.smithi098.stdout:9/685: dread - d2/d5/d18/fa5 zero size 2023-01-04T18:16:33.641 INFO:tasks.workunit.client.1.smithi098.stdout:7/616: rename d1/da/lb5 to d1/d51/d26/d28/d8d/ld6 0 2023-01-04T18:16:33.641 INFO:tasks.workunit.client.1.smithi098.stdout:7/617: readlink d1/d51/lb9 0 2023-01-04T18:16:33.641 INFO:tasks.workunit.client.1.smithi098.stdout:5/634: mknod d1/d1e/dab/cc7 0 2023-01-04T18:16:33.641 INFO:tasks.workunit.client.1.smithi098.stdout:5/635: truncate d1/d1e/fc0 426875 0 2023-01-04T18:16:33.643 INFO:tasks.workunit.client.1.smithi098.stdout:8/649: rmdir d6/d11/d15/d1b/d2a/d6b/d9c 39 2023-01-04T18:16:33.644 INFO:tasks.workunit.client.1.smithi098.stdout:5/636: dread d1/da/f77 [0,4194304] 0 2023-01-04T18:16:33.644 INFO:tasks.workunit.client.1.smithi098.stdout:5/637: read - d1/da/d44/d45/d4b/d61/f86 zero size 2023-01-04T18:16:33.645 INFO:tasks.workunit.client.1.smithi098.stdout:5/638: read - d1/d2/d14/da1/fb2 zero size 2023-01-04T18:16:33.645 INFO:tasks.workunit.client.1.smithi098.stdout:0/666: mkdir df/d17/d1c/d3b/de2 0 2023-01-04T18:16:33.645 INFO:tasks.workunit.client.1.smithi098.stdout:1/547: dwrite d1/d25/d27/d77/da8/f76 [0,4194304] 0 2023-01-04T18:16:33.646 INFO:tasks.workunit.client.1.smithi098.stdout:6/665: unlink d9/dd/de/d7e/fb2 0 2023-01-04T18:16:33.646 INFO:tasks.workunit.client.1.smithi098.stdout:6/666: chown d9/dd/de/d26/d71/c78 22756062 1 2023-01-04T18:16:33.646 INFO:tasks.workunit.client.1.smithi098.stdout:6/667: chown d9/dd/de/d7e/f93 446 1 2023-01-04T18:16:33.648 INFO:tasks.workunit.client.1.smithi098.stdout:4/624: truncate d5/d9/d13/f24 3103501 0 2023-01-04T18:16:33.649 INFO:tasks.workunit.client.1.smithi098.stdout:9/686: getdents d2/d5/d18/d1d/d23 0 2023-01-04T18:16:33.650 INFO:tasks.workunit.client.1.smithi098.stdout:7/618: dread d1/d23/d37/d40/f5c [0,4194304] 0 2023-01-04T18:16:33.650 INFO:tasks.workunit.client.1.smithi098.stdout:9/687: write d2/d5/d18/d4e/d42/d89/dac/d26/d41/f85 [723280,119187] 0 2023-01-04T18:16:33.651 INFO:tasks.workunit.client.1.smithi098.stdout:2/624: sync 2023-01-04T18:16:33.651 INFO:tasks.workunit.client.1.smithi098.stdout:3/703: sync 2023-01-04T18:16:33.652 INFO:tasks.workunit.client.1.smithi098.stdout:8/650: creat d6/d11/d15/d1b/d2a/d6b/fc1 x:0 0 0 2023-01-04T18:16:33.653 INFO:tasks.workunit.client.1.smithi098.stdout:3/704: write d6/d10/d29/f34 [5104930,65089] 0 2023-01-04T18:16:33.653 INFO:tasks.workunit.client.1.smithi098.stdout:3/705: readlink d6/d10/l13 0 2023-01-04T18:16:33.653 INFO:tasks.workunit.client.1.smithi098.stdout:0/667: dread df/d4f/f7d [0,4194304] 0 2023-01-04T18:16:33.655 INFO:tasks.workunit.client.1.smithi098.stdout:5/639: symlink d1/d38/d3b/d8f/lc8 0 2023-01-04T18:16:33.655 INFO:tasks.workunit.client.1.smithi098.stdout:8/651: dread d6/d11/d15/f1f [0,4194304] 0 2023-01-04T18:16:33.655 INFO:tasks.workunit.client.1.smithi098.stdout:1/548: truncate d1/f83 3170703 0 2023-01-04T18:16:33.655 INFO:tasks.workunit.client.1.smithi098.stdout:1/549: fsync d1/d25/d27/d77/da8/f76 0 2023-01-04T18:16:33.657 INFO:tasks.workunit.client.1.smithi098.stdout:6/668: creat d9/dd/de/d44/d79/fcd x:0 0 0 2023-01-04T18:16:33.657 INFO:tasks.workunit.client.1.smithi098.stdout:4/625: creat d5/de/d9b/fd5 x:0 0 0 2023-01-04T18:16:33.658 INFO:tasks.workunit.client.1.smithi098.stdout:6/669: write d9/dd/de/d20/f3f [685008,121421] 0 2023-01-04T18:16:33.659 INFO:tasks.workunit.client.1.smithi098.stdout:7/619: link d1/d23/d37/d78/f90 d1/d51/d26/fd7 0 2023-01-04T18:16:33.659 INFO:tasks.workunit.client.1.smithi098.stdout:7/620: readlink d1/d51/d26/d28/l7d 0 2023-01-04T18:16:33.661 INFO:tasks.workunit.client.1.smithi098.stdout:9/688: creat d2/d5/d18/d4e/d42/fe0 x:0 0 0 2023-01-04T18:16:33.663 INFO:tasks.workunit.client.1.smithi098.stdout:2/625: rename d6/dc/d2b/d46/f48 to d6/dc/d2b/d42/d47/d1f/fd6 0 2023-01-04T18:16:33.668 INFO:tasks.workunit.client.1.smithi098.stdout:3/706: mkdir d6/d56/d9f/da8/dfd 0 2023-01-04T18:16:33.668 INFO:tasks.workunit.client.1.smithi098.stdout:0/668: symlink df/d17/d1c/d2c/le3 0 2023-01-04T18:16:33.669 INFO:tasks.workunit.client.1.smithi098.stdout:4/626: creat d5/d28/d7d/db6/dbd/fd6 x:0 0 0 2023-01-04T18:16:33.669 INFO:tasks.workunit.client.1.smithi098.stdout:4/627: dread - d5/de/d21/f6b zero size 2023-01-04T18:16:33.670 INFO:tasks.workunit.client.1.smithi098.stdout:5/640: dread d1/da/f3f [4194304,4194304] 0 2023-01-04T18:16:33.670 INFO:tasks.workunit.client.1.smithi098.stdout:8/652: dread d6/d11/d15/f43 [0,4194304] 0 2023-01-04T18:16:33.670 INFO:tasks.workunit.client.1.smithi098.stdout:5/641: chown d1/d2/d14/d59/faf 6445 1 2023-01-04T18:16:33.670 INFO:tasks.workunit.client.1.smithi098.stdout:7/621: rmdir d1/d2e 39 2023-01-04T18:16:33.674 INFO:tasks.workunit.client.1.smithi098.stdout:9/689: rename d2/d5/d18/d1d/d23/dad/l6b to d2/d53/daf/le1 0 2023-01-04T18:16:33.674 INFO:tasks.workunit.client.1.smithi098.stdout:0/669: rmdir df/d17/d1c/d2c/d41/d4a/d7a 39 2023-01-04T18:16:33.675 INFO:tasks.workunit.client.1.smithi098.stdout:2/626: dread d6/dc/d2b/d42/d47/d1f/d39/d6e/f74 [0,4194304] 0 2023-01-04T18:16:33.676 INFO:tasks.workunit.client.1.smithi098.stdout:4/628: truncate d5/f42 374118 0 2023-01-04T18:16:33.677 INFO:tasks.workunit.client.1.smithi098.stdout:8/653: mkdir d6/d11/d15/d1b/d2a/d6b/d7f/d12/dc2 0 2023-01-04T18:16:33.678 INFO:tasks.workunit.client.1.smithi098.stdout:9/690: mknod d2/d5/d18/d4e/d42/ce2 0 2023-01-04T18:16:33.678 INFO:tasks.workunit.client.1.smithi098.stdout:9/691: truncate d2/d5/d18/d4e/fc8 201837 0 2023-01-04T18:16:33.679 INFO:tasks.workunit.client.1.smithi098.stdout:0/670: symlink df/d4f/d6b/d89/le4 0 2023-01-04T18:16:33.682 INFO:tasks.workunit.client.1.smithi098.stdout:2/627: creat d6/dc/d2b/d42/d47/fd7 x:0 0 0 2023-01-04T18:16:33.682 INFO:tasks.workunit.client.1.smithi098.stdout:4/629: mknod d5/de/cd7 0 2023-01-04T18:16:33.683 INFO:tasks.workunit.client.1.smithi098.stdout:4/630: truncate d5/d28/f51 1602444 0 2023-01-04T18:16:33.686 INFO:tasks.workunit.client.1.smithi098.stdout:8/654: rmdir d6 39 2023-01-04T18:16:33.686 INFO:tasks.workunit.client.1.smithi098.stdout:8/655: fdatasync d6/d11/d15/d1b/d2a/d3b/f3c 0 2023-01-04T18:16:33.688 INFO:tasks.workunit.client.1.smithi098.stdout:5/642: dread d1/d2/fbe [0,4194304] 0 2023-01-04T18:16:33.688 INFO:tasks.workunit.client.1.smithi098.stdout:2/628: creat d6/fd8 x:0 0 0 2023-01-04T18:16:33.688 INFO:tasks.workunit.client.1.smithi098.stdout:2/629: write d6/dc/d2b/d42/d47/d1f/d39/fa6 [250318,102727] 0 2023-01-04T18:16:33.688 INFO:tasks.workunit.client.1.smithi098.stdout:6/670: dwrite d9/dd/d24/d3e/f55 [4194304,4194304] 0 2023-01-04T18:16:33.689 INFO:tasks.workunit.client.1.smithi098.stdout:4/631: mkdir d5/d28/d7d/db6/dd8 0 2023-01-04T18:16:33.689 INFO:tasks.workunit.client.1.smithi098.stdout:4/632: readlink d5/d28/d7d/l82 0 2023-01-04T18:16:33.689 INFO:tasks.workunit.client.1.smithi098.stdout:8/656: stat d6/d11/d15/d1b/c2f 0 2023-01-04T18:16:33.693 INFO:tasks.workunit.client.1.smithi098.stdout:5/643: symlink d1/d2/d14/d19/lc9 0 2023-01-04T18:16:33.695 INFO:tasks.workunit.client.1.smithi098.stdout:2/630: symlink d6/dc/d2b/d42/d51/d79/ld9 0 2023-01-04T18:16:33.700 INFO:tasks.workunit.client.1.smithi098.stdout:4/633: mknod d5/de/d2c/dcb/cd9 0 2023-01-04T18:16:33.701 INFO:tasks.workunit.client.1.smithi098.stdout:4/634: readlink d5/de/d30/lc7 0 2023-01-04T18:16:33.702 INFO:tasks.workunit.client.1.smithi098.stdout:4/635: write d5/d28/d44/fb4 [2927641,45571] 0 2023-01-04T18:16:33.702 INFO:tasks.workunit.client.1.smithi098.stdout:4/636: dread - d5/d28/d40/d5d/f94 zero size 2023-01-04T18:16:33.702 INFO:tasks.workunit.client.1.smithi098.stdout:5/644: creat d1/da/d44/d80/dc6/fca x:0 0 0 2023-01-04T18:16:33.703 INFO:tasks.workunit.client.1.smithi098.stdout:4/637: creat d5/d28/d44/fda x:0 0 0 2023-01-04T18:16:33.704 INFO:tasks.workunit.client.1.smithi098.stdout:7/622: dwrite d1/d51/f19 [0,4194304] 0 2023-01-04T18:16:33.706 INFO:tasks.workunit.client.1.smithi098.stdout:5/645: mknod d1/d2f/d66/d75/ccb 0 2023-01-04T18:16:33.706 INFO:tasks.workunit.client.1.smithi098.stdout:5/646: fdatasync d1/d46/d6a/f9f 0 2023-01-04T18:16:33.706 INFO:tasks.workunit.client.1.smithi098.stdout:2/631: dread d6/dc/d2b/f70 [0,4194304] 0 2023-01-04T18:16:33.708 INFO:tasks.workunit.client.1.smithi098.stdout:5/647: truncate d1/fc 303073 0 2023-01-04T18:16:33.709 INFO:tasks.workunit.client.1.smithi098.stdout:5/648: write d1/d2/f17 [131098,53254] 0 2023-01-04T18:16:33.709 INFO:tasks.workunit.client.1.smithi098.stdout:2/632: unlink d6/dc/d2b/d42/d51/d81/fc3 0 2023-01-04T18:16:33.710 INFO:tasks.workunit.client.1.smithi098.stdout:5/649: truncate d1/f6 1594335 0 2023-01-04T18:16:33.711 INFO:tasks.workunit.client.1.smithi098.stdout:4/638: dread d5/d28/d40/f8a [0,4194304] 0 2023-01-04T18:16:33.711 INFO:tasks.workunit.client.1.smithi098.stdout:4/639: dread - d5/de/d21/f6b zero size 2023-01-04T18:16:33.711 INFO:tasks.workunit.client.1.smithi098.stdout:2/633: mkdir d6/dc/d2b/d42/d47/da5/dda 0 2023-01-04T18:16:33.711 INFO:tasks.workunit.client.1.smithi098.stdout:5/650: rmdir d1/d2 39 2023-01-04T18:16:33.713 INFO:tasks.workunit.client.1.smithi098.stdout:4/640: rmdir d5/de/da0 0 2023-01-04T18:16:33.714 INFO:tasks.workunit.client.1.smithi098.stdout:5/651: creat d1/d2/d14/da1/fcc x:0 0 0 2023-01-04T18:16:33.716 INFO:tasks.workunit.client.1.smithi098.stdout:5/652: rename d1/d2/d14/d59/f8a to d1/d2/d14/d59/fcd 0 2023-01-04T18:16:33.716 INFO:tasks.workunit.client.1.smithi098.stdout:0/671: dwrite df/d17/d68/fb2 [0,4194304] 0 2023-01-04T18:16:33.717 INFO:tasks.workunit.client.1.smithi098.stdout:5/653: mkdir d1/d38/dce 0 2023-01-04T18:16:33.723 INFO:tasks.workunit.client.1.smithi098.stdout:0/672: unlink df/d17/d1c/d2c/d41/d4a/d4c/d5f/fb3 0 2023-01-04T18:16:33.723 INFO:tasks.workunit.client.1.smithi098.stdout:3/707: dwrite d6/d10/d19/d3f/d5e/fa9 [0,4194304] 0 2023-01-04T18:16:33.723 INFO:tasks.workunit.client.1.smithi098.stdout:3/708: chown d6/d56/d9f/da8/fc2 27663 1 2023-01-04T18:16:33.723 INFO:tasks.workunit.client.1.smithi098.stdout:3/709: chown d6/d6f/db6/lbc 2939609 1 2023-01-04T18:16:33.723 INFO:tasks.workunit.client.1.smithi098.stdout:3/710: read d6/d10/d19/d3f/f47 [39341,22553] 0 2023-01-04T18:16:33.727 INFO:tasks.workunit.client.1.smithi098.stdout:4/641: dread d5/d9/f3b [0,4194304] 0 2023-01-04T18:16:33.727 INFO:tasks.workunit.client.1.smithi098.stdout:4/642: readlink d5/de/d30/lb3 0 2023-01-04T18:16:33.727 INFO:tasks.workunit.client.1.smithi098.stdout:4/643: fsync d5/d28/d40/f4a 0 2023-01-04T18:16:33.729 INFO:tasks.workunit.client.1.smithi098.stdout:4/644: mkdir d5/d28/d7d/ddb 0 2023-01-04T18:16:33.729 INFO:tasks.workunit.client.1.smithi098.stdout:4/645: fdatasync d5/d28/d7d/db6/dbd/fd6 0 2023-01-04T18:16:33.729 INFO:tasks.workunit.client.1.smithi098.stdout:4/646: mknod d5/de/d21/d96/cdc 0 2023-01-04T18:16:33.730 INFO:tasks.workunit.client.1.smithi098.stdout:4/647: readlink d5/d28/d7d/db6/dbd/ld3 0 2023-01-04T18:16:33.730 INFO:tasks.workunit.client.1.smithi098.stdout:4/648: truncate d5/de/d21/d9d/f9c 1026011 0 2023-01-04T18:16:33.730 INFO:tasks.workunit.client.1.smithi098.stdout:4/649: dread - d5/fbb zero size 2023-01-04T18:16:33.731 INFO:tasks.workunit.client.1.smithi098.stdout:4/650: symlink d5/dad/d83/ldd 0 2023-01-04T18:16:33.734 INFO:tasks.workunit.client.1.smithi098.stdout:8/657: dwrite d6/d11/d15/d1b/d2a/d3b/f3c [0,4194304] 0 2023-01-04T18:16:33.736 INFO:tasks.workunit.client.1.smithi098.stdout:7/623: dwrite d1/da/f82 [0,4194304] 0 2023-01-04T18:16:33.737 INFO:tasks.workunit.client.1.smithi098.stdout:8/658: getdents d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d64 0 2023-01-04T18:16:33.737 INFO:tasks.workunit.client.1.smithi098.stdout:8/659: readlink d6/d11/d15/d1b/d2a/d6b/d7f/l34 0 2023-01-04T18:16:33.737 INFO:tasks.workunit.client.1.smithi098.stdout:8/660: write d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d64/f77 [756984,34232] 0 2023-01-04T18:16:33.738 INFO:tasks.workunit.client.1.smithi098.stdout:8/661: read d6/d11/d15/d1b/d2a/d3b/f38 [2303400,91280] 0 2023-01-04T18:16:33.743 INFO:tasks.workunit.client.1.smithi098.stdout:7/624: rename d1/d2e/fc7 to d1/d4/d11/d9d/dd2/fd8 0 2023-01-04T18:16:33.746 INFO:tasks.workunit.client.1.smithi098.stdout:8/662: rename d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d44 to d6/d11/d15/d70/dc3 0 2023-01-04T18:16:33.746 INFO:tasks.workunit.client.1.smithi098.stdout:8/663: write d6/d11/d15/d1b/d2a/d6b/d7f/da6/fbd [263064,72114] 0 2023-01-04T18:16:33.747 INFO:tasks.workunit.client.1.smithi098.stdout:5/654: dread d1/d2f/f5f [0,4194304] 0 2023-01-04T18:16:33.747 INFO:tasks.workunit.client.1.smithi098.stdout:4/651: dwrite d5/d9/f43 [0,4194304] 0 2023-01-04T18:16:33.747 INFO:tasks.workunit.client.1.smithi098.stdout:4/652: fdatasync d5/de/f5a 0 2023-01-04T18:16:33.747 INFO:tasks.workunit.client.1.smithi098.stdout:4/653: stat d5/d28/da6/cac 0 2023-01-04T18:16:33.748 INFO:tasks.workunit.client.1.smithi098.stdout:8/664: getdents d6 0 2023-01-04T18:16:33.749 INFO:tasks.workunit.client.1.smithi098.stdout:5/655: dread d1/da/fa4 [0,4194304] 0 2023-01-04T18:16:33.765 INFO:tasks.workunit.client.1.smithi098.stdout:7/625: dwrite d1/da/fb1 [0,4194304] 0 2023-01-04T18:16:33.765 INFO:tasks.workunit.client.1.smithi098.stdout:7/626: readlink d1/db2/lbb 0 2023-01-04T18:16:33.788 INFO:tasks.workunit.client.1.smithi098.stdout:8/665: dwrite d6/d11/d15/f1f [0,4194304] 0 2023-01-04T18:16:33.788 INFO:tasks.workunit.client.1.smithi098.stdout:8/666: chown d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/l66 17 1 2023-01-04T18:16:33.789 INFO:tasks.workunit.client.1.smithi098.stdout:4/654: creat d5/d28/d7d/db6/fde x:0 0 0 2023-01-04T18:16:33.790 INFO:tasks.workunit.client.1.smithi098.stdout:5/656: mkdir d1/da/d44/d80/dcf 0 2023-01-04T18:16:33.799 INFO:tasks.workunit.client.1.smithi098.stdout:7/627: symlink d1/d23/d73/d85/ld9 0 2023-01-04T18:16:33.801 INFO:tasks.workunit.client.1.smithi098.stdout:8/667: mkdir d6/d11/d15/d1b/d2a/d6b/d7f/d78/d9d/dc4 0 2023-01-04T18:16:33.804 INFO:tasks.workunit.client.1.smithi098.stdout:4/655: creat d5/fdf x:0 0 0 2023-01-04T18:16:33.805 INFO:tasks.workunit.client.1.smithi098.stdout:8/668: read d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/f6f [3393168,16129] 0 2023-01-04T18:16:33.805 INFO:tasks.workunit.client.1.smithi098.stdout:8/669: chown d6/d11/d15/c74 1669218 1 2023-01-04T18:16:33.805 INFO:tasks.workunit.client.1.smithi098.stdout:4/656: creat d5/d9/d13/d65/d98/fe0 x:0 0 0 2023-01-04T18:16:33.806 INFO:tasks.workunit.client.1.smithi098.stdout:7/628: dread d1/d51/f89 [0,4194304] 0 2023-01-04T18:16:33.806 INFO:tasks.workunit.client.1.smithi098.stdout:8/670: symlink d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/lc5 0 2023-01-04T18:16:33.806 INFO:tasks.workunit.client.1.smithi098.stdout:8/671: stat d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/f88 0 2023-01-04T18:16:33.806 INFO:tasks.workunit.client.1.smithi098.stdout:8/672: write d6/d11/d15/d1b/d2a/d6b/f7b [966922,18255] 0 2023-01-04T18:16:33.806 INFO:tasks.workunit.client.1.smithi098.stdout:8/673: write d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/f61 [2186887,111970] 0 2023-01-04T18:16:33.807 INFO:tasks.workunit.client.1.smithi098.stdout:4/657: creat d5/de/d30/d4f/fe1 x:0 0 0 2023-01-04T18:16:33.809 INFO:tasks.workunit.client.1.smithi098.stdout:5/657: dwrite d1/f1d [0,4194304] 0 2023-01-04T18:16:33.809 INFO:tasks.workunit.client.1.smithi098.stdout:5/658: write d1/f6b [975368,43942] 0 2023-01-04T18:16:33.809 INFO:tasks.workunit.client.1.smithi098.stdout:7/629: rmdir d1/d4/d11/d9d 39 2023-01-04T18:16:33.809 INFO:tasks.workunit.client.1.smithi098.stdout:3/711: sync 2023-01-04T18:16:33.809 INFO:tasks.workunit.client.1.smithi098.stdout:6/671: sync 2023-01-04T18:16:33.810 INFO:tasks.workunit.client.1.smithi098.stdout:9/692: sync 2023-01-04T18:16:33.810 INFO:tasks.workunit.client.1.smithi098.stdout:1/550: sync 2023-01-04T18:16:33.810 INFO:tasks.workunit.client.1.smithi098.stdout:2/634: sync 2023-01-04T18:16:33.810 INFO:tasks.workunit.client.1.smithi098.stdout:2/635: truncate d6/dc/d4b/d89/fb6 170569 0 2023-01-04T18:16:33.810 INFO:tasks.workunit.client.1.smithi098.stdout:0/673: sync 2023-01-04T18:16:33.810 INFO:tasks.workunit.client.1.smithi098.stdout:8/674: mknod d6/d11/d15/d1b/d2a/d6b/d7f/d78/d9d/dc4/cc6 0 2023-01-04T18:16:33.811 INFO:tasks.workunit.client.1.smithi098.stdout:9/693: write d2/d5/d18/d4e/d42/d89/dac/d26/f7e [1404914,96554] 0 2023-01-04T18:16:33.812 INFO:tasks.workunit.client.1.smithi098.stdout:8/675: dread d6/d11/d15/d1b/d2a/d6b/d7f/f2e [0,4194304] 0 2023-01-04T18:16:33.812 INFO:tasks.workunit.client.1.smithi098.stdout:4/658: rmdir d5/de/d21/d96/dbf 0 2023-01-04T18:16:33.812 INFO:tasks.workunit.client.1.smithi098.stdout:4/659: chown d5/d28/d40/d5d/fbe 50 1 2023-01-04T18:16:33.812 INFO:tasks.workunit.client.1.smithi098.stdout:4/660: readlink d5/d9/l4b 0 2023-01-04T18:16:33.813 INFO:tasks.workunit.client.1.smithi098.stdout:4/661: write d5/de/f5a [273297,64187] 0 2023-01-04T18:16:33.813 INFO:tasks.workunit.client.1.smithi098.stdout:7/630: dread d1/d23/d37/f71 [0,4194304] 0 2023-01-04T18:16:33.814 INFO:tasks.workunit.client.1.smithi098.stdout:3/712: symlink d6/d10/d19/d3f/d46/d8a/lfe 0 2023-01-04T18:16:33.815 INFO:tasks.workunit.client.1.smithi098.stdout:3/713: truncate d6/f53 1159564 0 2023-01-04T18:16:33.816 INFO:tasks.workunit.client.1.smithi098.stdout:1/551: rename d1/d25/d27/d77/f4b to d1/d8/d53/fc8 0 2023-01-04T18:16:33.819 INFO:tasks.workunit.client.1.smithi098.stdout:8/676: unlink d6/d11/fbb 0 2023-01-04T18:16:33.820 INFO:tasks.workunit.client.1.smithi098.stdout:8/677: read - d6/d11/d15/d1b/d2a/d6b/d7f/d78/d9d/fa8 zero size 2023-01-04T18:16:33.823 INFO:tasks.workunit.client.1.smithi098.stdout:6/672: rename d9/dd/d24/d65 to d9/dd/d24/d3e/d86/d9b/dce 0 2023-01-04T18:16:33.823 INFO:tasks.workunit.client.1.smithi098.stdout:0/674: truncate df/d17/d1c/d3b/f58 5912 0 2023-01-04T18:16:33.826 INFO:tasks.workunit.client.1.smithi098.stdout:8/678: link d6/d11/d15/d1b/d2a/d6b/d7f/da6/laf d6/d11/d15/d1b/lc7 0 2023-01-04T18:16:33.828 INFO:tasks.workunit.client.1.smithi098.stdout:6/673: link d9/fc3 d9/dd/d24/fcf 0 2023-01-04T18:16:33.828 INFO:tasks.workunit.client.1.smithi098.stdout:2/636: dread d6/dc/d2b/d42/d47/d1f/faf [0,4194304] 0 2023-01-04T18:16:33.828 INFO:tasks.workunit.client.1.smithi098.stdout:0/675: mkdir df/d17/d9b/de5 0 2023-01-04T18:16:33.831 INFO:tasks.workunit.client.1.smithi098.stdout:9/694: rename d2/d5/d18/d4e/d42/d89/dac/d26/l3c to d2/d5/d18/d1d/d23/d66/le3 0 2023-01-04T18:16:33.832 INFO:tasks.workunit.client.1.smithi098.stdout:2/637: write d6/dc/d2b/d42/d47/d31/d90/fc4 [2144928,81121] 0 2023-01-04T18:16:33.832 INFO:tasks.workunit.client.1.smithi098.stdout:2/638: stat d6/dc/d2b/d42/d47/fb7 0 2023-01-04T18:16:33.833 INFO:tasks.workunit.client.1.smithi098.stdout:8/679: symlink d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/lc8 0 2023-01-04T18:16:33.833 INFO:tasks.workunit.client.1.smithi098.stdout:8/680: fsync d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d64/f77 0 2023-01-04T18:16:33.833 INFO:tasks.workunit.client.1.smithi098.stdout:8/681: stat d6/d11/f1a 0 2023-01-04T18:16:33.833 INFO:tasks.workunit.client.1.smithi098.stdout:8/682: truncate d6/d11/d15/d1b/d2a/d6b/d7f/fb9 153599 0 2023-01-04T18:16:33.833 INFO:tasks.workunit.client.1.smithi098.stdout:0/676: mknod df/d17/d9b/da1/ce6 0 2023-01-04T18:16:33.835 INFO:tasks.workunit.client.1.smithi098.stdout:4/662: rename d5/d28/d40/c76 to d5/d28/da6/ce2 0 2023-01-04T18:16:33.836 INFO:tasks.workunit.client.1.smithi098.stdout:9/695: symlink d2/d5/d18/db6/le4 0 2023-01-04T18:16:33.837 INFO:tasks.workunit.client.1.smithi098.stdout:2/639: getdents d6/dc/d2b/d42/d47/da5 0 2023-01-04T18:16:33.839 INFO:tasks.workunit.client.1.smithi098.stdout:8/683: creat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/fc9 x:0 0 0 2023-01-04T18:16:33.840 INFO:tasks.workunit.client.1.smithi098.stdout:4/663: creat d5/d9/d13/d65/fe3 x:0 0 0 2023-01-04T18:16:33.840 INFO:tasks.workunit.client.1.smithi098.stdout:4/664: stat d5/dad/fb2 0 2023-01-04T18:16:33.840 INFO:tasks.workunit.client.1.smithi098.stdout:3/714: dwrite d6/d6f/d9b/fb1 [0,4194304] 0 2023-01-04T18:16:33.841 INFO:tasks.workunit.client.1.smithi098.stdout:9/696: write f1 [13094721,63010] 0 2023-01-04T18:16:33.844 INFO:tasks.workunit.client.1.smithi098.stdout:4/665: mkdir d5/d28/d7d/db6/de4 0 2023-01-04T18:16:33.847 INFO:tasks.workunit.client.1.smithi098.stdout:3/715: unlink d6/d10/d19/d3f/d5e/d7d/cd7 0 2023-01-04T18:16:33.848 INFO:tasks.workunit.client.1.smithi098.stdout:9/697: creat d2/d53/fe5 x:0 0 0 2023-01-04T18:16:33.850 INFO:tasks.workunit.client.1.smithi098.stdout:4/666: mkdir d5/d28/d40/de5 0 2023-01-04T18:16:33.850 INFO:tasks.workunit.client.1.smithi098.stdout:5/659: dwrite d1/d2/d14/f27 [0,4194304] 0 2023-01-04T18:16:33.851 INFO:tasks.workunit.client.1.smithi098.stdout:3/716: creat d6/d10/d19/d3f/d5e/d7d/fff x:0 0 0 2023-01-04T18:16:33.851 INFO:tasks.workunit.client.1.smithi098.stdout:3/717: chown d6/d10/d19/d3f/d5e/d7d/l51 2576 1 2023-01-04T18:16:33.852 INFO:tasks.workunit.client.1.smithi098.stdout:9/698: mknod d2/d53/ce6 0 2023-01-04T18:16:33.854 INFO:tasks.workunit.client.1.smithi098.stdout:5/660: mkdir d1/d1e/dab/dd0 0 2023-01-04T18:16:33.854 INFO:tasks.workunit.client.1.smithi098.stdout:5/661: dread - d1/d46/f6e zero size 2023-01-04T18:16:33.855 INFO:tasks.workunit.client.1.smithi098.stdout:5/662: write d1/d1e/dab/fb3 [693060,66614] 0 2023-01-04T18:16:33.857 INFO:tasks.workunit.client.1.smithi098.stdout:3/718: rename d6/d10/d29/d6a/dd1/ld6 to d6/d10/dc0/l100 0 2023-01-04T18:16:33.857 INFO:tasks.workunit.client.1.smithi098.stdout:3/719: truncate d6/d10/d6b/faf 602919 0 2023-01-04T18:16:33.857 INFO:tasks.workunit.client.1.smithi098.stdout:3/720: truncate d6/d10/d29/d6a/fe4 1229190 0 2023-01-04T18:16:33.858 INFO:tasks.workunit.client.1.smithi098.stdout:5/663: creat d1/d2/d14/fd1 x:0 0 0 2023-01-04T18:16:33.859 INFO:tasks.workunit.client.1.smithi098.stdout:3/721: getdents d6 0 2023-01-04T18:16:33.861 INFO:tasks.workunit.client.1.smithi098.stdout:3/722: link d6/d10/dc0/fcb d6/d56/d9f/da8/dfd/f101 0 2023-01-04T18:16:33.863 INFO:tasks.workunit.client.1.smithi098.stdout:3/723: symlink d6/d6f/d9b/l102 0 2023-01-04T18:16:33.865 INFO:tasks.workunit.client.1.smithi098.stdout:1/552: dwrite f0 [4194304,4194304] 0 2023-01-04T18:16:33.866 INFO:tasks.workunit.client.1.smithi098.stdout:7/631: dwrite d1/d4/d11/d9d/dd2/fd8 [0,4194304] 0 2023-01-04T18:16:33.866 INFO:tasks.workunit.client.1.smithi098.stdout:7/632: fsync d1/d2e/fb8 0 2023-01-04T18:16:33.866 INFO:tasks.workunit.client.1.smithi098.stdout:7/633: fdatasync d1/f45 0 2023-01-04T18:16:33.867 INFO:tasks.workunit.client.1.smithi098.stdout:1/553: write d1/d8/da/dae/f4a [764383,107] 0 2023-01-04T18:16:33.869 INFO:tasks.workunit.client.1.smithi098.stdout:7/634: creat d1/d23/d73/d85/fda x:0 0 0 2023-01-04T18:16:33.869 INFO:tasks.workunit.client.1.smithi098.stdout:7/635: dread - d1/d51/d26/d28/d2d/d75/fae zero size 2023-01-04T18:16:33.870 INFO:tasks.workunit.client.1.smithi098.stdout:1/554: getdents d1/d25/d27/d5c 0 2023-01-04T18:16:33.872 INFO:tasks.workunit.client.1.smithi098.stdout:7/636: mkdir d1/db2/dc4/ddb 0 2023-01-04T18:16:33.872 INFO:tasks.workunit.client.1.smithi098.stdout:7/637: dread - d1/d4/fa8 zero size 2023-01-04T18:16:33.874 INFO:tasks.workunit.client.1.smithi098.stdout:3/724: dread d6/d6f/f94 [0,4194304] 0 2023-01-04T18:16:33.874 INFO:tasks.workunit.client.1.smithi098.stdout:3/725: write d6/d6f/fdd [992736,59298] 0 2023-01-04T18:16:33.874 INFO:tasks.workunit.client.1.smithi098.stdout:3/726: write d6/d10/d19/f3a [4196709,41748] 0 2023-01-04T18:16:33.874 INFO:tasks.workunit.client.1.smithi098.stdout:1/555: mknod d1/d25/d36/d89/db3/cc9 0 2023-01-04T18:16:33.874 INFO:tasks.workunit.client.1.smithi098.stdout:1/556: read - d1/d8/da/dae/f8a zero size 2023-01-04T18:16:33.876 INFO:tasks.workunit.client.1.smithi098.stdout:1/557: write d1/d8/da/f24 [881096,84337] 0 2023-01-04T18:16:33.876 INFO:tasks.workunit.client.1.smithi098.stdout:7/638: link d1/d51/c5b d1/d23/d21/d7f/cdc 0 2023-01-04T18:16:33.878 INFO:tasks.workunit.client.1.smithi098.stdout:1/558: dread d1/d25/d27/d77/da8/f5a [0,4194304] 0 2023-01-04T18:16:33.879 INFO:tasks.workunit.client.1.smithi098.stdout:3/727: link d6/d10/d19/d3f/fdb d6/d10/d19/d3f/d5e/d7d/d90/de6/f103 0 2023-01-04T18:16:33.879 INFO:tasks.workunit.client.1.smithi098.stdout:7/639: dread d1/d23/d21/d7f/f98 [0,4194304] 0 2023-01-04T18:16:33.880 INFO:tasks.workunit.client.1.smithi098.stdout:1/559: rename d1/d25/d39/d8e to d1/d25/d27/d77/da8/dca 0 2023-01-04T18:16:33.881 INFO:tasks.workunit.client.1.smithi098.stdout:3/728: mknod d6/d10/db7/de1/c104 0 2023-01-04T18:16:33.882 INFO:tasks.workunit.client.1.smithi098.stdout:7/640: creat d1/d51/dc0/fdd x:0 0 0 2023-01-04T18:16:33.883 INFO:tasks.workunit.client.1.smithi098.stdout:3/729: mknod d6/d10/df8/c105 0 2023-01-04T18:16:33.883 INFO:tasks.workunit.client.1.smithi098.stdout:3/730: chown d6/d10/db7/de1/c104 5 1 2023-01-04T18:16:33.884 INFO:tasks.workunit.client.1.smithi098.stdout:3/731: rmdir d6/d10/df8 39 2023-01-04T18:16:33.890 INFO:tasks.workunit.client.1.smithi098.stdout:3/732: write d6/d10/d19/d3f/fdb [215160,64090] 0 2023-01-04T18:16:33.891 INFO:tasks.workunit.client.1.smithi098.stdout:3/733: creat d6/d10/d19/d3f/d5e/d7d/f106 x:0 0 0 2023-01-04T18:16:33.893 INFO:tasks.workunit.client.1.smithi098.stdout:3/734: creat d6/d10/d19/d3f/d5e/d7d/d90/f107 x:0 0 0 2023-01-04T18:16:33.893 INFO:tasks.workunit.client.1.smithi098.stdout:3/735: write d6/d6f/f91 [625382,22073] 0 2023-01-04T18:16:33.902 INFO:tasks.workunit.client.1.smithi098.stdout:2/640: dwrite d6/dc/d2b/d32/fb9 [0,4194304] 0 2023-01-04T18:16:33.902 INFO:tasks.workunit.client.1.smithi098.stdout:2/641: chown d6/dc/d2b/d42/d47/d1f/d82/fc6 3508 1 2023-01-04T18:16:33.904 INFO:tasks.workunit.client.1.smithi098.stdout:2/642: truncate d6/dc/d2b/f36 4008603 0 2023-01-04T18:16:33.931 INFO:tasks.workunit.client.1.smithi098.stdout:0/677: dwrite df/f3e [0,4194304] 0 2023-01-04T18:16:33.931 INFO:tasks.workunit.client.1.smithi098.stdout:6/674: dwrite d9/dd/de/d44/d79/f80 [0,4194304] 0 2023-01-04T18:16:33.931 INFO:tasks.workunit.client.1.smithi098.stdout:6/675: write d9/fc3 [21972,96089] 0 2023-01-04T18:16:33.931 INFO:tasks.workunit.client.1.smithi098.stdout:9/699: dwrite d2/d5/d18/d1d/f2f [4194304,4194304] 0 2023-01-04T18:16:33.933 INFO:tasks.workunit.client.1.smithi098.stdout:5/664: dwrite d1/da/d44/d45/d4b/f9d [0,4194304] 0 2023-01-04T18:16:33.933 INFO:tasks.workunit.client.1.smithi098.stdout:8/684: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/da6/fbd [0,4194304] 0 2023-01-04T18:16:33.938 INFO:tasks.workunit.client.1.smithi098.stdout:1/560: dwrite d1/d25/d36/f50 [0,4194304] 0 2023-01-04T18:16:33.938 INFO:tasks.workunit.client.1.smithi098.stdout:7/641: dwrite d1/f47 [0,4194304] 0 2023-01-04T18:16:33.938 INFO:tasks.workunit.client.1.smithi098.stdout:5/665: write d1/da/d44/d45/d4b/f4f [2776999,56825] 0 2023-01-04T18:16:33.939 INFO:tasks.workunit.client.1.smithi098.stdout:3/736: dwrite d6/d56/d9f/da8/fe7 [0,4194304] 0 2023-01-04T18:16:33.944 INFO:tasks.workunit.client.1.smithi098.stdout:4/667: truncate d5/f4d 738329 0 2023-01-04T18:16:33.944 INFO:tasks.workunit.client.1.smithi098.stdout:4/668: chown d5/de/d30/d4f/l63 326330573 1 2023-01-04T18:16:33.944 INFO:tasks.workunit.client.1.smithi098.stdout:4/669: chown d5/de/d2c/f53 93 1 2023-01-04T18:16:33.946 INFO:tasks.workunit.client.1.smithi098.stdout:1/561: dread d1/d8/da/f1a [0,4194304] 0 2023-01-04T18:16:33.947 INFO:tasks.workunit.client.1.smithi098.stdout:6/676: mknod d9/dd/d24/d3e/cd0 0 2023-01-04T18:16:33.950 INFO:tasks.workunit.client.1.smithi098.stdout:9/700: dwrite d2/d5/d18/d19/d82/f84 [0,4194304] 0 2023-01-04T18:16:33.950 INFO:tasks.workunit.client.1.smithi098.stdout:9/701: read d2/d5/d18/d4e/d42/d89/dac/d78/fc4 [1777445,3711] 0 2023-01-04T18:16:33.951 INFO:tasks.workunit.client.1.smithi098.stdout:9/702: fdatasync d2/d5/d18/d4e/d42/f64 0 2023-01-04T18:16:33.958 INFO:tasks.workunit.client.1.smithi098.stdout:8/685: link d6/d11/d15/d70/dc3/c63 d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/cca 0 2023-01-04T18:16:33.958 INFO:tasks.workunit.client.1.smithi098.stdout:8/686: chown d6/d11/d15/d1b/d2a/d6b/d7f/d78/d9d/fa8 47712 1 2023-01-04T18:16:33.959 INFO:tasks.workunit.client.1.smithi098.stdout:9/703: dread d2/d5/d6f/f8a [0,4194304] 0 2023-01-04T18:16:33.964 INFO:tasks.workunit.client.1.smithi098.stdout:7/642: mknod d1/d51/dc0/cde 0 2023-01-04T18:16:33.965 INFO:tasks.workunit.client.1.smithi098.stdout:5/666: mkdir d1/da/d44/d80/dd2 0 2023-01-04T18:16:33.971 INFO:tasks.workunit.client.1.smithi098.stdout:3/737: mknod d6/d56/c108 0 2023-01-04T18:16:33.971 INFO:tasks.workunit.client.1.smithi098.stdout:3/738: truncate d6/d10/d19/d3f/d5e/d7d/d90/f107 791443 0 2023-01-04T18:16:33.974 INFO:tasks.workunit.client.1.smithi098.stdout:4/670: mkdir d5/de/d2c/dcb/de6 0 2023-01-04T18:16:33.974 INFO:tasks.workunit.client.1.smithi098.stdout:4/671: dread - d5/de/d30/f68 zero size 2023-01-04T18:16:33.974 INFO:tasks.workunit.client.1.smithi098.stdout:6/677: mkdir d9/dd/de/d44/dd1 0 2023-01-04T18:16:33.976 INFO:tasks.workunit.client.1.smithi098.stdout:9/704: dwrite d2/d53/fe5 [0,4194304] 0 2023-01-04T18:16:33.977 INFO:tasks.workunit.client.1.smithi098.stdout:4/672: write d5/d28/d40/f48 [812339,63755] 0 2023-01-04T18:16:33.977 INFO:tasks.workunit.client.1.smithi098.stdout:4/673: write d5/d9/d90/f9f [181105,59770] 0 2023-01-04T18:16:33.982 INFO:tasks.workunit.client.1.smithi098.stdout:5/667: dwrite d1/f96 [0,4194304] 0 2023-01-04T18:16:33.984 INFO:tasks.workunit.client.1.smithi098.stdout:5/668: dread d1/d1e/dab/fb3 [0,4194304] 0 2023-01-04T18:16:33.988 INFO:tasks.workunit.client.1.smithi098.stdout:8/687: rmdir d6/d11/d15/d70 39 2023-01-04T18:16:33.990 INFO:tasks.workunit.client.1.smithi098.stdout:2/643: rename d6/dc/d2b/f36 to d6/dc/fdb 0 2023-01-04T18:16:33.990 INFO:tasks.workunit.client.1.smithi098.stdout:7/643: dread d1/d2e/f4c [0,4194304] 0 2023-01-04T18:16:33.990 INFO:tasks.workunit.client.1.smithi098.stdout:7/644: fdatasync d1/d51/d26/d28/d2d/d75/fae 0 2023-01-04T18:16:33.991 INFO:tasks.workunit.client.1.smithi098.stdout:3/739: mkdir d6/d10/d19/d3f/d46/d109 0 2023-01-04T18:16:33.992 INFO:tasks.workunit.client.1.smithi098.stdout:3/740: write d6/d10/d19/d3f/d46/d8a/fa2 [2591605,109194] 0 2023-01-04T18:16:33.992 INFO:tasks.workunit.client.1.smithi098.stdout:3/741: dread - d6/d10/d19/d3f/d5e/d7d/ffc zero size 2023-01-04T18:16:33.993 INFO:tasks.workunit.client.1.smithi098.stdout:3/742: write d6/d10/d19/d3f/f2f [3691172,116043] 0 2023-01-04T18:16:33.993 INFO:tasks.workunit.client.1.smithi098.stdout:6/678: creat d9/dd/fd2 x:0 0 0 2023-01-04T18:16:33.993 INFO:tasks.workunit.client.1.smithi098.stdout:6/679: chown d9/dd/d15/l2b 686 1 2023-01-04T18:16:33.997 INFO:tasks.workunit.client.1.smithi098.stdout:6/680: write d9/dd/de/d26/f62 [1215543,126254] 0 2023-01-04T18:16:33.997 INFO:tasks.workunit.client.1.smithi098.stdout:5/669: stat d1/d38/d3b/d8f/cc2 0 2023-01-04T18:16:33.998 INFO:tasks.workunit.client.1.smithi098.stdout:5/670: truncate d1/f18 5137747 0 2023-01-04T18:16:33.998 INFO:tasks.workunit.client.1.smithi098.stdout:5/671: dread - d1/d2/d14/d59/fb7 zero size 2023-01-04T18:16:33.999 INFO:tasks.workunit.client.1.smithi098.stdout:9/705: rename d2/d5/d6f/f8a to d2/d5/d18/d4e/d42/d89/fe7 0 2023-01-04T18:16:34.000 INFO:tasks.workunit.client.1.smithi098.stdout:2/644: getdents d6/dc/d2b/d42/d47/d1f 0 2023-01-04T18:16:34.001 INFO:tasks.workunit.client.1.smithi098.stdout:7/645: creat d1/db2/dc4/ddb/fdf x:0 0 0 2023-01-04T18:16:34.001 INFO:tasks.workunit.client.1.smithi098.stdout:8/688: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/fb9 [0,4194304] 0 2023-01-04T18:16:34.007 INFO:tasks.workunit.client.1.smithi098.stdout:6/681: creat d9/dd/de/d7e/fd3 x:0 0 0 2023-01-04T18:16:34.008 INFO:tasks.workunit.client.1.smithi098.stdout:3/743: creat d6/d10/db7/f10a x:0 0 0 2023-01-04T18:16:34.008 INFO:tasks.workunit.client.1.smithi098.stdout:5/672: unlink d1/d2f/f5e 0 2023-01-04T18:16:34.008 INFO:tasks.workunit.client.1.smithi098.stdout:3/744: chown d6/d56/f60 14 1 2023-01-04T18:16:34.008 INFO:tasks.workunit.client.1.smithi098.stdout:5/673: chown d1/f18 2764 1 2023-01-04T18:16:34.008 INFO:tasks.workunit.client.1.smithi098.stdout:3/745: readlink d6/d10/dc0/l100 0 2023-01-04T18:16:34.008 INFO:tasks.workunit.client.1.smithi098.stdout:9/706: mknod d2/d5/d18/ce8 0 2023-01-04T18:16:34.008 INFO:tasks.workunit.client.1.smithi098.stdout:9/707: fsync d2/d2d/fbd 0 2023-01-04T18:16:34.008 INFO:tasks.workunit.client.1.smithi098.stdout:9/708: write d2/d5/f28 [5036601,75988] 0 2023-01-04T18:16:34.008 INFO:tasks.workunit.client.1.smithi098.stdout:4/674: dread d5/dad/d83/f8f [0,4194304] 0 2023-01-04T18:16:34.008 INFO:tasks.workunit.client.1.smithi098.stdout:2/645: mknod d6/dc/d2b/d42/d51/d81/cdc 0 2023-01-04T18:16:34.009 INFO:tasks.workunit.client.1.smithi098.stdout:7/646: mknod d1/da/ce0 0 2023-01-04T18:16:34.009 INFO:tasks.workunit.client.1.smithi098.stdout:9/709: write d2/d5/d18/d1d/d23/dad/f59 [446842,39070] 0 2023-01-04T18:16:34.009 INFO:tasks.workunit.client.1.smithi098.stdout:7/647: write d1/d4/d11/d9d/dd2/fd8 [1560533,57387] 0 2023-01-04T18:16:34.010 INFO:tasks.workunit.client.1.smithi098.stdout:3/746: mkdir d6/d10/d19/d3f/d46/d10b 0 2023-01-04T18:16:34.011 INFO:tasks.workunit.client.1.smithi098.stdout:2/646: write d6/f33 [1486221,7560] 0 2023-01-04T18:16:34.012 INFO:tasks.workunit.client.1.smithi098.stdout:4/675: mknod d5/dad/ce7 0 2023-01-04T18:16:34.012 INFO:tasks.workunit.client.1.smithi098.stdout:4/676: readlink d5/d9/d13/d65/d98/la3 0 2023-01-04T18:16:34.015 INFO:tasks.workunit.client.1.smithi098.stdout:7/648: rename d1/d4/l86 to d1/d4/d11/d9d/dd2/le1 0 2023-01-04T18:16:34.017 INFO:tasks.workunit.client.1.smithi098.stdout:4/677: creat d5/de/d2c/dcb/fe8 x:0 0 0 2023-01-04T18:16:34.017 INFO:tasks.workunit.client.1.smithi098.stdout:2/647: write d6/dc/d2b/d42/d47/d1f/d39/d6e/f77 [455886,96305] 0 2023-01-04T18:16:34.018 INFO:tasks.workunit.client.1.smithi098.stdout:7/649: symlink d1/d51/le2 0 2023-01-04T18:16:34.018 INFO:tasks.workunit.client.1.smithi098.stdout:7/650: write d1/d2e/f4c [600894,17657] 0 2023-01-04T18:16:34.018 INFO:tasks.workunit.client.1.smithi098.stdout:7/651: stat d1/d51/d26/d28/d2d/d6b/cc8 0 2023-01-04T18:16:34.018 INFO:tasks.workunit.client.1.smithi098.stdout:7/652: write d1/db2/dc4/ddb/fdf [505914,88445] 0 2023-01-04T18:16:34.018 INFO:tasks.workunit.client.1.smithi098.stdout:7/653: rename d1/d4/d11/d9d to d1/d4/d11/d9d/dd2/de3 22 2023-01-04T18:16:34.019 INFO:tasks.workunit.client.1.smithi098.stdout:4/678: mkdir d5/d28/d40/d5d/dcf/de9 0 2023-01-04T18:16:34.019 INFO:tasks.workunit.client.1.smithi098.stdout:9/710: fdatasync d2/d5/f28 0 2023-01-04T18:16:34.019 INFO:tasks.workunit.client.1.smithi098.stdout:8/689: dwrite d6/fe [4194304,4194304] 0 2023-01-04T18:16:34.020 INFO:tasks.workunit.client.1.smithi098.stdout:9/711: chown d2/d5/d18/d4e/d42/fe0 147 1 2023-01-04T18:16:34.021 INFO:tasks.workunit.client.1.smithi098.stdout:2/648: creat d6/dc/d2b/d42/d51/d79/da3/fdd x:0 0 0 2023-01-04T18:16:34.024 INFO:tasks.workunit.client.1.smithi098.stdout:7/654: mkdir d1/d23/d21/d7f/de4 0 2023-01-04T18:16:34.025 INFO:tasks.workunit.client.1.smithi098.stdout:8/690: dread d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/fa2 [0,4194304] 0 2023-01-04T18:16:34.025 INFO:tasks.workunit.client.1.smithi098.stdout:8/691: read - d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/fb6 zero size 2023-01-04T18:16:34.029 INFO:tasks.workunit.client.1.smithi098.stdout:2/649: getdents d6/dc/d2b/d42/d47/d1f/d39/d6e 0 2023-01-04T18:16:34.029 INFO:tasks.workunit.client.1.smithi098.stdout:4/679: creat d5/de/d21/d9d/fea x:0 0 0 2023-01-04T18:16:34.031 INFO:tasks.workunit.client.1.smithi098.stdout:7/655: mknod d1/d23/d37/d40/d94/ce5 0 2023-01-04T18:16:34.031 INFO:tasks.workunit.client.1.smithi098.stdout:7/656: write d1/d23/d21/d7f/faa [30440,80723] 0 2023-01-04T18:16:34.031 INFO:tasks.workunit.client.1.smithi098.stdout:3/747: dwrite d6/d10/d19/d3f/d46/fab [0,4194304] 0 2023-01-04T18:16:34.031 INFO:tasks.workunit.client.1.smithi098.stdout:6/682: dwrite d9/dd/d4e/f92 [0,4194304] 0 2023-01-04T18:16:34.031 INFO:tasks.workunit.client.1.smithi098.stdout:6/683: chown d9/dd/d24/d3e/d86/d9b/la7 1593895516 1 2023-01-04T18:16:34.032 INFO:tasks.workunit.client.1.smithi098.stdout:2/650: unlink d6/dc/d4b/l92 0 2023-01-04T18:16:34.035 INFO:tasks.workunit.client.1.smithi098.stdout:7/657: mknod d1/d4/d11/d5d/ce6 0 2023-01-04T18:16:34.035 INFO:tasks.workunit.client.1.smithi098.stdout:7/658: chown d1/d23/d21/d43 52049 1 2023-01-04T18:16:34.037 INFO:tasks.workunit.client.1.smithi098.stdout:9/712: dread d2/d5/d18/d19/f54 [0,4194304] 0 2023-01-04T18:16:34.037 INFO:tasks.workunit.client.1.smithi098.stdout:9/713: truncate d2/d5/d18/d4e/d42/d89/fa4 271341 0 2023-01-04T18:16:34.038 INFO:tasks.workunit.client.1.smithi098.stdout:7/659: symlink d1/d51/le7 0 2023-01-04T18:16:34.038 INFO:tasks.workunit.client.1.smithi098.stdout:7/660: chown d1/d23/d37 9532 1 2023-01-04T18:16:34.039 INFO:tasks.workunit.client.1.smithi098.stdout:9/714: creat d2/d5/d18/d4e/d42/d89/dcb/fe9 x:0 0 0 2023-01-04T18:16:34.039 INFO:tasks.workunit.client.1.smithi098.stdout:9/715: chown d2/d5/d18/d1d/d23/d5c/fb4 268940 1 2023-01-04T18:16:34.049 INFO:tasks.workunit.client.1.smithi098.stdout:9/716: dread d2/d5/d18/d4e/d42/d89/dac/d26/d41/f85 [0,4194304] 0 2023-01-04T18:16:34.050 INFO:tasks.workunit.client.1.smithi098.stdout:9/717: link d2/d5/d18/d1d/l7d d2/d5/d18/d1d/d23/dad/lea 0 2023-01-04T18:16:34.050 INFO:tasks.workunit.client.1.smithi098.stdout:9/718: write d2/d5/d18/d1d/d23/d5c/f95 [931637,103105] 0 2023-01-04T18:16:34.051 INFO:tasks.workunit.client.1.smithi098.stdout:7/661: dread d1/d23/d21/f4f [4194304,4194304] 0 2023-01-04T18:16:34.052 INFO:tasks.workunit.client.1.smithi098.stdout:4/680: dwrite d5/de/d2c/f46 [4194304,4194304] 0 2023-01-04T18:16:34.053 INFO:tasks.workunit.client.1.smithi098.stdout:4/681: getdents d5/de/d30 0 2023-01-04T18:16:34.053 INFO:tasks.workunit.client.1.smithi098.stdout:4/682: fsync d5/de/f88 0 2023-01-04T18:16:34.053 INFO:tasks.workunit.client.1.smithi098.stdout:9/719: write d2/d5/f24 [82515,61151] 0 2023-01-04T18:16:34.054 INFO:tasks.workunit.client.1.smithi098.stdout:9/720: mkdir d2/d5/d18/d1d/d23/d5c/deb 0 2023-01-04T18:16:34.056 INFO:tasks.workunit.client.1.smithi098.stdout:9/721: rename d2/d5/d18/d4e/d42/d89/dac/c6e to d2/d5/d6f/cec 0 2023-01-04T18:16:34.060 INFO:tasks.workunit.client.1.smithi098.stdout:6/684: dwrite d9/dd/de/d7e/fd3 [0,4194304] 0 2023-01-04T18:16:34.060 INFO:tasks.workunit.client.1.smithi098.stdout:5/674: dwrite d1/d2/d14/d19/f35 [0,4194304] 0 2023-01-04T18:16:34.060 INFO:tasks.workunit.client.1.smithi098.stdout:6/685: dread - d9/dd/de/d44/d79/fcd zero size 2023-01-04T18:16:34.060 INFO:tasks.workunit.client.1.smithi098.stdout:2/651: dwrite d6/f20 [0,4194304] 0 2023-01-04T18:16:34.072 INFO:tasks.workunit.client.1.smithi098.stdout:2/652: creat d6/dc/d2b/d42/d47/da5/dda/fde x:0 0 0 2023-01-04T18:16:34.073 INFO:tasks.workunit.client.1.smithi098.stdout:2/653: dread - d6/dc/d2b/d42/d51/d79/fba zero size 2023-01-04T18:16:34.073 INFO:tasks.workunit.client.1.smithi098.stdout:6/686: symlink d9/dd/de/d20/d82/d84/ld4 0 2023-01-04T18:16:34.075 INFO:tasks.workunit.client.1.smithi098.stdout:2/654: creat d6/dc/d4b/fdf x:0 0 0 2023-01-04T18:16:34.076 INFO:tasks.workunit.client.1.smithi098.stdout:6/687: rename d9/dd/de/d44/d79/cbc to d9/dd/d24/d3e/cd5 0 2023-01-04T18:16:34.076 INFO:tasks.workunit.client.1.smithi098.stdout:6/688: write d9/dd/de/d44/d7a/d85/fc7 [470077,100808] 0 2023-01-04T18:16:34.078 INFO:tasks.workunit.client.1.smithi098.stdout:7/662: dwrite d1/d51/d26/d28/d2d/f32 [4194304,4194304] 0 2023-01-04T18:16:34.078 INFO:tasks.workunit.client.1.smithi098.stdout:5/675: dread d1/f2e [0,4194304] 0 2023-01-04T18:16:34.078 INFO:tasks.workunit.client.1.smithi098.stdout:6/689: symlink d9/dd/d15/ld6 0 2023-01-04T18:16:34.078 INFO:tasks.workunit.client.1.smithi098.stdout:9/722: dwrite d2/d5/d18/d4e/d42/d89/dac/d26/f9a [0,4194304] 0 2023-01-04T18:16:34.079 INFO:tasks.workunit.client.1.smithi098.stdout:4/683: dwrite d5/dad/fb9 [0,4194304] 0 2023-01-04T18:16:34.081 INFO:tasks.workunit.client.1.smithi098.stdout:7/663: rmdir d1/d4/d11/d9d/dd0 39 2023-01-04T18:16:34.083 INFO:tasks.workunit.client.1.smithi098.stdout:9/723: truncate d2/d5/d18/d19/f4b 3845966 0 2023-01-04T18:16:34.085 INFO:tasks.workunit.client.1.smithi098.stdout:2/655: dread d6/dc/f14 [0,4194304] 0 2023-01-04T18:16:34.089 INFO:tasks.workunit.client.1.smithi098.stdout:6/690: write d9/dd/f11 [1635448,113495] 0 2023-01-04T18:16:34.089 INFO:tasks.workunit.client.1.smithi098.stdout:6/691: chown d9/dd/de/d7e 23 1 2023-01-04T18:16:34.089 INFO:tasks.workunit.client.1.smithi098.stdout:6/692: write d9/dd/de/d44/f5e [1468529,36503] 0 2023-01-04T18:16:34.091 INFO:tasks.workunit.client.1.smithi098.stdout:0/678: sync 2023-01-04T18:16:34.091 INFO:tasks.workunit.client.1.smithi098.stdout:0/679: fdatasync df/d17/d1c/f1e 0 2023-01-04T18:16:34.095 INFO:tasks.workunit.client.1.smithi098.stdout:4/684: link d5/d28/d40/d5d/c81 d5/de/d30/d4f/ceb 0 2023-01-04T18:16:34.097 INFO:tasks.workunit.client.1.smithi098.stdout:7/664: mknod d1/d4/d11/ce8 0 2023-01-04T18:16:34.099 INFO:tasks.workunit.client.1.smithi098.stdout:2/656: unlink d6/dc/d2b/d42/d51/d81/la7 0 2023-01-04T18:16:34.099 INFO:tasks.workunit.client.1.smithi098.stdout:2/657: fsync d6/dc/d2b/d42/d47/d31/fa8 0 2023-01-04T18:16:34.101 INFO:tasks.workunit.client.1.smithi098.stdout:6/693: dread d9/dd/de/fa2 [4194304,4194304] 0 2023-01-04T18:16:34.101 INFO:tasks.workunit.client.1.smithi098.stdout:5/676: dwrite d1/d1e/f68 [4194304,4194304] 0 2023-01-04T18:16:34.103 INFO:tasks.workunit.client.1.smithi098.stdout:4/685: creat d5/d28/d7d/db6/de4/fec x:0 0 0 2023-01-04T18:16:34.103 INFO:tasks.workunit.client.1.smithi098.stdout:7/665: symlink d1/d23/d21/d43/le9 0 2023-01-04T18:16:34.106 INFO:tasks.workunit.client.1.smithi098.stdout:6/694: write d9/dd/de/f9c [610619,119160] 0 2023-01-04T18:16:34.108 INFO:tasks.workunit.client.1.smithi098.stdout:4/686: getdents d5/d9/d90 0 2023-01-04T18:16:34.109 INFO:tasks.workunit.client.1.smithi098.stdout:9/724: dwrite d2/f9c [0,4194304] 0 2023-01-04T18:16:34.110 INFO:tasks.workunit.client.1.smithi098.stdout:7/666: creat d1/d4/d11/d9d/dd2/fea x:0 0 0 2023-01-04T18:16:34.111 INFO:tasks.workunit.client.1.smithi098.stdout:0/680: dwrite df/d4f/d6e/fd7 [0,4194304] 0 2023-01-04T18:16:34.112 INFO:tasks.workunit.client.1.smithi098.stdout:6/695: unlink d9/dd/de/d26/lb7 0 2023-01-04T18:16:34.114 INFO:tasks.workunit.client.1.smithi098.stdout:5/677: dread d1/d2/d14/d19/fa6 [0,4194304] 0 2023-01-04T18:16:34.115 INFO:tasks.workunit.client.1.smithi098.stdout:5/678: readlink d1/l72 0 2023-01-04T18:16:34.115 INFO:tasks.workunit.client.1.smithi098.stdout:5/679: truncate d1/d2f/d66/fb1 553194 0 2023-01-04T18:16:34.115 INFO:tasks.workunit.client.1.smithi098.stdout:5/680: dread - d1/da/d44/d45/d4b/d61/f86 zero size 2023-01-04T18:16:34.116 INFO:tasks.workunit.client.1.smithi098.stdout:4/687: link d5/d28/d7d/l82 d5/d28/d7d/db6/de4/led 0 2023-01-04T18:16:34.116 INFO:tasks.workunit.client.1.smithi098.stdout:2/658: rmdir d6 39 2023-01-04T18:16:34.119 INFO:tasks.workunit.client.1.smithi098.stdout:1/562: sync 2023-01-04T18:16:34.123 INFO:tasks.workunit.client.1.smithi098.stdout:7/667: rename d1/d4/l8 to d1/d23/d21/leb 0 2023-01-04T18:16:34.125 INFO:tasks.workunit.client.1.smithi098.stdout:6/696: symlink d9/dd/ld7 0 2023-01-04T18:16:34.125 INFO:tasks.workunit.client.1.smithi098.stdout:6/697: truncate d9/dd/de/d26/f62 2967540 0 2023-01-04T18:16:34.129 INFO:tasks.workunit.client.1.smithi098.stdout:5/681: creat d1/d2f/fd3 x:0 0 0 2023-01-04T18:16:34.129 INFO:tasks.workunit.client.1.smithi098.stdout:5/682: chown d1/d1e/dab/cc7 6824 1 2023-01-04T18:16:34.130 INFO:tasks.workunit.client.1.smithi098.stdout:2/659: symlink d6/dc/d2b/d42/d47/d31/d90/le0 0 2023-01-04T18:16:34.130 INFO:tasks.workunit.client.1.smithi098.stdout:2/660: read d6/dc/f7e [394295,92829] 0 2023-01-04T18:16:34.132 INFO:tasks.workunit.client.1.smithi098.stdout:1/563: mknod d1/d25/d27/d5c/dc3/ccb 0 2023-01-04T18:16:34.132 INFO:tasks.workunit.client.1.smithi098.stdout:0/681: dwrite df/d17/d68/fbf [0,4194304] 0 2023-01-04T18:16:34.133 INFO:tasks.workunit.client.1.smithi098.stdout:7/668: creat d1/d23/fec x:0 0 0 2023-01-04T18:16:34.134 INFO:tasks.workunit.client.1.smithi098.stdout:2/661: dread d6/f8 [0,4194304] 0 2023-01-04T18:16:34.134 INFO:tasks.workunit.client.1.smithi098.stdout:2/662: stat d6/dc/l21 0 2023-01-04T18:16:34.134 INFO:tasks.workunit.client.1.smithi098.stdout:6/698: chown d9/dd/d15/l31 78878 1 2023-01-04T18:16:34.134 INFO:tasks.workunit.client.1.smithi098.stdout:6/699: chown d9/dd/d24/d3e/cd5 0 1 2023-01-04T18:16:34.134 INFO:tasks.workunit.client.1.smithi098.stdout:6/700: stat d9/l3a 0 2023-01-04T18:16:34.139 INFO:tasks.workunit.client.1.smithi098.stdout:5/683: creat d1/d46/dc4/fd4 x:0 0 0 2023-01-04T18:16:34.140 INFO:tasks.workunit.client.1.smithi098.stdout:5/684: write d1/f18 [3070302,67129] 0 2023-01-04T18:16:34.140 INFO:tasks.workunit.client.1.smithi098.stdout:5/685: dread - d1/d2f/d66/d75/f99 zero size 2023-01-04T18:16:34.140 INFO:tasks.workunit.client.1.smithi098.stdout:5/686: read d1/fc [214597,54593] 0 2023-01-04T18:16:34.141 INFO:tasks.workunit.client.1.smithi098.stdout:4/688: dwrite d5/d28/d40/d5d/f6d [0,4194304] 0 2023-01-04T18:16:34.141 INFO:tasks.workunit.client.1.smithi098.stdout:4/689: chown d5/d9/d13/c85 129945713 1 2023-01-04T18:16:34.142 INFO:tasks.workunit.client.1.smithi098.stdout:0/682: mkdir df/d17/d9b/d86/de7 0 2023-01-04T18:16:34.142 INFO:tasks.workunit.client.1.smithi098.stdout:0/683: fsync df/d17/f1d 0 2023-01-04T18:16:34.142 INFO:tasks.workunit.client.1.smithi098.stdout:7/669: stat d1/d51/d26/d28/l7d 0 2023-01-04T18:16:34.142 INFO:tasks.workunit.client.1.smithi098.stdout:7/670: write d1/d51/d26/d28/f66 [41503,65118] 0 2023-01-04T18:16:34.144 INFO:tasks.workunit.client.1.smithi098.stdout:2/663: mkdir d6/dc/d2b/d42/d51/de1 0 2023-01-04T18:16:34.145 INFO:tasks.workunit.client.1.smithi098.stdout:0/684: read df/d17/d9b/d5c/f96 [2116261,62461] 0 2023-01-04T18:16:34.145 INFO:tasks.workunit.client.1.smithi098.stdout:1/564: dread d1/d25/d27/f6f [0,4194304] 0 2023-01-04T18:16:34.146 INFO:tasks.workunit.client.1.smithi098.stdout:7/671: write d1/d51/d26/d28/d2d/d75/fb6 [46181,57783] 0 2023-01-04T18:16:34.146 INFO:tasks.workunit.client.1.smithi098.stdout:1/565: read - d1/d8/da/fc1 zero size 2023-01-04T18:16:34.146 INFO:tasks.workunit.client.1.smithi098.stdout:1/566: read d1/da9/fc6 [446274,7331] 0 2023-01-04T18:16:34.146 INFO:tasks.workunit.client.1.smithi098.stdout:1/567: readlink d1/d25/d36/d4e/l57 0 2023-01-04T18:16:34.150 INFO:tasks.workunit.client.1.smithi098.stdout:4/690: symlink d5/de/d21/lee 0 2023-01-04T18:16:34.150 INFO:tasks.workunit.client.1.smithi098.stdout:4/691: dread - d5/d28/d40/d5d/f70 zero size 2023-01-04T18:16:34.151 INFO:tasks.workunit.client.1.smithi098.stdout:2/664: creat d6/dc/d2b/d42/d47/fe2 x:0 0 0 2023-01-04T18:16:34.170 INFO:tasks.workunit.client.1.smithi098.stdout:5/687: dwrite d1/d38/f41 [0,4194304] 0 2023-01-04T18:16:34.170 INFO:tasks.workunit.client.1.smithi098.stdout:5/688: stat d1/d2/d14/fad 0 2023-01-04T18:16:34.170 INFO:tasks.workunit.client.1.smithi098.stdout:2/665: dwrite d6/dc/d2b/d42/d47/d1f/d39/f64 [0,4194304] 0 2023-01-04T18:16:34.170 INFO:tasks.workunit.client.1.smithi098.stdout:5/689: write d1/d1e/f3e [8862274,92155] 0 2023-01-04T18:16:34.224 INFO:tasks.workunit.client.1.smithi098.stdout:0/685: rename f3 to df/d17/d9b/d86/fe8 0 2023-01-04T18:16:34.224 INFO:tasks.workunit.client.1.smithi098.stdout:0/686: write df/d17/f2d [5022822,99411] 0 2023-01-04T18:16:34.225 INFO:tasks.workunit.client.1.smithi098.stdout:1/568: unlink d1/d25/d27/d77/l55 0 2023-01-04T18:16:34.227 INFO:tasks.workunit.client.1.smithi098.stdout:6/701: link d9/cc0 d9/dd/d15/cd8 0 2023-01-04T18:16:34.227 INFO:tasks.workunit.client.1.smithi098.stdout:6/702: dread - d9/dd/de/d44/d79/fcd zero size 2023-01-04T18:16:34.227 INFO:tasks.workunit.client.1.smithi098.stdout:6/703: readlink d9/dd/de/d20/l7b 0 2023-01-04T18:16:34.228 INFO:tasks.workunit.client.1.smithi098.stdout:2/666: truncate d6/dc/d2b/d42/d47/d1f/f8b 108892 0 2023-01-04T18:16:34.229 INFO:tasks.workunit.client.1.smithi098.stdout:5/690: mkdir d1/d1e/dab/dd5 0 2023-01-04T18:16:34.229 INFO:tasks.workunit.client.1.smithi098.stdout:5/691: getdents d1/d1e/dab/dd0 0 2023-01-04T18:16:34.230 INFO:tasks.workunit.client.1.smithi098.stdout:0/687: stat df/d4f/d6e/l7b 0 2023-01-04T18:16:34.231 INFO:tasks.workunit.client.1.smithi098.stdout:7/672: dread d1/d23/d37/d78/f90 [0,4194304] 0 2023-01-04T18:16:34.235 INFO:tasks.workunit.client.1.smithi098.stdout:1/569: getdents d1/d8/d53 0 2023-01-04T18:16:34.235 INFO:tasks.workunit.client.1.smithi098.stdout:1/570: write d1/d8/d53/fc8 [1532387,23685] 0 2023-01-04T18:16:34.237 INFO:tasks.workunit.client.1.smithi098.stdout:8/692: sync 2023-01-04T18:16:34.237 INFO:tasks.workunit.client.1.smithi098.stdout:3/748: sync 2023-01-04T18:16:34.237 INFO:tasks.workunit.client.1.smithi098.stdout:3/749: stat d6/d10/d19/d3f/d5e 0 2023-01-04T18:16:34.238 INFO:tasks.workunit.client.1.smithi098.stdout:6/704: rmdir d9/dd/de/d20/d82/d84 39 2023-01-04T18:16:34.240 INFO:tasks.workunit.client.1.smithi098.stdout:2/667: rename d6/dc/f1b to d6/dc/d2b/d42/d51/fe3 0 2023-01-04T18:16:34.241 INFO:tasks.workunit.client.1.smithi098.stdout:4/692: sync 2023-01-04T18:16:34.241 INFO:tasks.workunit.client.1.smithi098.stdout:9/725: sync 2023-01-04T18:16:34.242 INFO:tasks.workunit.client.1.smithi098.stdout:7/673: rename d1/d51/d26/d28/d2d/fa9 to d1/d51/d26/d28/d2d/fed 0 2023-01-04T18:16:34.242 INFO:tasks.workunit.client.1.smithi098.stdout:7/674: chown d1/d23/d21/f77 103055 1 2023-01-04T18:16:34.243 INFO:tasks.workunit.client.1.smithi098.stdout:7/675: write d1/d23/fab [2028160,86765] 0 2023-01-04T18:16:34.244 INFO:tasks.workunit.client.1.smithi098.stdout:7/676: fsync d1/d23/d37/d40/f5c 0 2023-01-04T18:16:34.244 INFO:tasks.workunit.client.1.smithi098.stdout:7/677: fsync d1/d51/f59 0 2023-01-04T18:16:34.244 INFO:tasks.workunit.client.1.smithi098.stdout:7/678: chown d1/d23/d21/d7f/f98 0 1 2023-01-04T18:16:34.244 INFO:tasks.workunit.client.1.smithi098.stdout:3/750: truncate d6/f6c 3475613 0 2023-01-04T18:16:34.245 INFO:tasks.workunit.client.1.smithi098.stdout:3/751: dread - d6/d10/d29/fd5 zero size 2023-01-04T18:16:34.245 INFO:tasks.workunit.client.1.smithi098.stdout:3/752: chown d6/d10/d19/d3f/d46/d8a 7461 1 2023-01-04T18:16:34.245 INFO:tasks.workunit.client.1.smithi098.stdout:3/753: write d6/d6f/f91 [340794,36509] 0 2023-01-04T18:16:34.246 INFO:tasks.workunit.client.1.smithi098.stdout:7/679: dread d1/d2e/f4c [0,4194304] 0 2023-01-04T18:16:34.246 INFO:tasks.workunit.client.1.smithi098.stdout:1/571: rename d1/d25/d27/d77/da8/c86 to d1/d8/d53/ccc 0 2023-01-04T18:16:34.247 INFO:tasks.workunit.client.1.smithi098.stdout:2/668: creat d6/dc/d2b/d42/fe4 x:0 0 0 2023-01-04T18:16:34.247 INFO:tasks.workunit.client.1.smithi098.stdout:2/669: chown d6/dc/l21 514246896 1 2023-01-04T18:16:34.247 INFO:tasks.workunit.client.1.smithi098.stdout:2/670: fdatasync d6/dc/d2b/d42/d47/d1f/f29 0 2023-01-04T18:16:34.249 INFO:tasks.workunit.client.1.smithi098.stdout:4/693: mknod d5/d28/d40/d5d/dcf/de9/cef 0 2023-01-04T18:16:34.250 INFO:tasks.workunit.client.1.smithi098.stdout:9/726: mkdir d2/d5/d18/d4e/ded 0 2023-01-04T18:16:34.251 INFO:tasks.workunit.client.1.smithi098.stdout:5/692: dread d1/d1e/fc0 [0,4194304] 0 2023-01-04T18:16:34.251 INFO:tasks.workunit.client.1.smithi098.stdout:5/693: stat d1/d38/f41 0 2023-01-04T18:16:34.252 INFO:tasks.workunit.client.1.smithi098.stdout:3/754: truncate d6/d10/d19/f76 587969 0 2023-01-04T18:16:34.253 INFO:tasks.workunit.client.1.smithi098.stdout:7/680: creat d1/d23/d37/fee x:0 0 0 2023-01-04T18:16:34.255 INFO:tasks.workunit.client.1.smithi098.stdout:8/693: rename d6/d11/d15/d1b/d2a/l2c to d6/d11/d15/d1b/d2a/d6b/d7f/d78/d9d/dc4/lcb 0 2023-01-04T18:16:34.255 INFO:tasks.workunit.client.1.smithi098.stdout:8/694: truncate d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/f73 1068309 0 2023-01-04T18:16:34.255 INFO:tasks.workunit.client.1.smithi098.stdout:8/695: readlink d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/l9f 0 2023-01-04T18:16:34.256 INFO:tasks.workunit.client.1.smithi098.stdout:6/705: dwrite d9/dd/de/d44/d7a/fc6 [0,4194304] 0 2023-01-04T18:16:34.257 INFO:tasks.workunit.client.1.smithi098.stdout:1/572: link d1/d25/d36/d89/db3/cc9 d1/d8/da/dae/ccd 0 2023-01-04T18:16:34.257 INFO:tasks.workunit.client.1.smithi098.stdout:1/573: chown d1/da9 11 1 2023-01-04T18:16:34.258 INFO:tasks.workunit.client.1.smithi098.stdout:2/671: creat d6/dc/d2b/d42/d47/d35/fe5 x:0 0 0 2023-01-04T18:16:34.265 INFO:tasks.workunit.client.1.smithi098.stdout:4/694: unlink d5/fdf 0 2023-01-04T18:16:34.265 INFO:tasks.workunit.client.1.smithi098.stdout:4/695: truncate d5/de/d2c/f92 190661 0 2023-01-04T18:16:34.265 INFO:tasks.workunit.client.1.smithi098.stdout:4/696: dread - d5/de/f95 zero size 2023-01-04T18:16:34.266 INFO:tasks.workunit.client.1.smithi098.stdout:9/727: creat d2/d5/d18/d1d/d23/dad/fee x:0 0 0 2023-01-04T18:16:34.267 INFO:tasks.workunit.client.1.smithi098.stdout:5/694: symlink d1/d1e/d81/ld6 0 2023-01-04T18:16:34.267 INFO:tasks.workunit.client.1.smithi098.stdout:1/574: dread d1/d8/da/dae/f4a [0,4194304] 0 2023-01-04T18:16:34.267 INFO:tasks.workunit.client.1.smithi098.stdout:3/755: write d6/d10/d19/f26 [795747,10668] 0 2023-01-04T18:16:34.270 INFO:tasks.workunit.client.1.smithi098.stdout:6/706: unlink d9/dd/d24/d3e/d86/c89 0 2023-01-04T18:16:34.271 INFO:tasks.workunit.client.1.smithi098.stdout:2/672: creat d6/dc/d2b/d46/dd2/fe6 x:0 0 0 2023-01-04T18:16:34.273 INFO:tasks.workunit.client.1.smithi098.stdout:5/695: creat d1/d2/fd7 x:0 0 0 2023-01-04T18:16:34.274 INFO:tasks.workunit.client.1.smithi098.stdout:3/756: getdents d6/d56/d9f/da8 0 2023-01-04T18:16:34.274 INFO:tasks.workunit.client.1.smithi098.stdout:3/757: read d6/d10/d19/f8c [502525,4237] 0 2023-01-04T18:16:34.284 INFO:tasks.workunit.client.1.smithi098.stdout:1/575: creat d1/d25/d36/d4e/d9f/db7/fce x:0 0 0 2023-01-04T18:16:34.284 INFO:tasks.workunit.client.1.smithi098.stdout:1/576: truncate d1/d25/d6a/f90 4239091 0 2023-01-04T18:16:34.284 INFO:tasks.workunit.client.1.smithi098.stdout:2/673: write d6/dc/d2b/d32/fb9 [4115679,33612] 0 2023-01-04T18:16:34.284 INFO:tasks.workunit.client.1.smithi098.stdout:8/696: dwrite d6/fe [4194304,4194304] 0 2023-01-04T18:16:34.284 INFO:tasks.workunit.client.1.smithi098.stdout:1/577: creat d1/d88/fcf x:0 0 0 2023-01-04T18:16:34.284 INFO:tasks.workunit.client.1.smithi098.stdout:7/681: dwrite d1/fb3 [0,4194304] 0 2023-01-04T18:16:34.285 INFO:tasks.workunit.client.1.smithi098.stdout:7/682: dread - d1/d23/d21/d43/f9e zero size 2023-01-04T18:16:34.285 INFO:tasks.workunit.client.1.smithi098.stdout:2/674: symlink d6/dc/d2b/d42/d47/d1f/d39/d6e/le7 0 2023-01-04T18:16:34.285 INFO:tasks.workunit.client.1.smithi098.stdout:6/707: dread d9/dd/d15/f2d [0,4194304] 0 2023-01-04T18:16:34.285 INFO:tasks.workunit.client.1.smithi098.stdout:8/697: creat d6/d11/d15/d1b/d2a/d6b/d7f/d5a/fcc x:0 0 0 2023-01-04T18:16:34.285 INFO:tasks.workunit.client.1.smithi098.stdout:8/698: chown d6/d11/d15/d1b/d2a/d6b/d7f/f2e 404 1 2023-01-04T18:16:34.286 INFO:tasks.workunit.client.1.smithi098.stdout:9/728: dwrite d2/d53/daf/db3/fc3 [0,4194304] 0 2023-01-04T18:16:34.288 INFO:tasks.workunit.client.1.smithi098.stdout:3/758: unlink d6/d10/d19/c20 0 2023-01-04T18:16:34.288 INFO:tasks.workunit.client.1.smithi098.stdout:3/759: fdatasync d6/d10/d19/d3f/d5e/d7d/dec/dda/fe2 0 2023-01-04T18:16:34.293 INFO:tasks.workunit.client.1.smithi098.stdout:5/696: dwrite d1/d1e/f74 [0,4194304] 0 2023-01-04T18:16:34.294 INFO:tasks.workunit.client.1.smithi098.stdout:1/578: rename d1/d8/da/dae/l38 to d1/d8/ld0 0 2023-01-04T18:16:34.294 INFO:tasks.workunit.client.1.smithi098.stdout:1/579: readlink d1/d25/d39/l43 0 2023-01-04T18:16:34.294 INFO:tasks.workunit.client.1.smithi098.stdout:1/580: fdatasync d1/f1f 0 2023-01-04T18:16:34.294 INFO:tasks.workunit.client.1.smithi098.stdout:1/581: read d1/d25/d36/f69 [460764,99340] 0 2023-01-04T18:16:34.294 INFO:tasks.workunit.client.1.smithi098.stdout:1/582: chown d1/c18 495 1 2023-01-04T18:16:34.294 INFO:tasks.workunit.client.1.smithi098.stdout:1/583: stat d1/d8/da/cb 0 2023-01-04T18:16:34.294 INFO:tasks.workunit.client.1.smithi098.stdout:7/683: creat d1/d23/d73/dba/fef x:0 0 0 2023-01-04T18:16:34.303 INFO:tasks.workunit.client.1.smithi098.stdout:1/584: dread d1/d8/f28 [4194304,4194304] 0 2023-01-04T18:16:34.303 INFO:tasks.workunit.client.1.smithi098.stdout:1/585: readlink d1/da9/lbe 0 2023-01-04T18:16:34.304 INFO:tasks.workunit.client.1.smithi098.stdout:2/675: unlink d6/f16 0 2023-01-04T18:16:34.305 INFO:tasks.workunit.client.1.smithi098.stdout:6/708: creat d9/dd/d24/d3e/d86/d9b/dce/fd9 x:0 0 0 2023-01-04T18:16:34.309 INFO:tasks.workunit.client.1.smithi098.stdout:8/699: unlink d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/l49 0 2023-01-04T18:16:34.309 INFO:tasks.workunit.client.1.smithi098.stdout:8/700: stat d6/fe 0 2023-01-04T18:16:34.314 INFO:tasks.workunit.client.1.smithi098.stdout:3/760: symlink d6/d10/d19/d3f/l10c 0 2023-01-04T18:16:34.314 INFO:tasks.workunit.client.1.smithi098.stdout:5/697: link d1/da/d44/l53 d1/d2/d14/ld8 0 2023-01-04T18:16:34.314 INFO:tasks.workunit.client.1.smithi098.stdout:9/729: mknod d2/d5/d18/d1d/d23/dad/d72/cef 0 2023-01-04T18:16:34.315 INFO:tasks.workunit.client.1.smithi098.stdout:2/676: mkdir d6/dc/d2b/d42/d51/d81/d8f/de8 0 2023-01-04T18:16:34.316 INFO:tasks.workunit.client.1.smithi098.stdout:1/586: dread d1/d25/d6a/f90 [0,4194304] 0 2023-01-04T18:16:34.316 INFO:tasks.workunit.client.1.smithi098.stdout:9/730: write d2/d5/d18/d1d/f2f [252866,12625] 0 2023-01-04T18:16:34.317 INFO:tasks.workunit.client.1.smithi098.stdout:3/761: rename d6/f53 to d6/d10/dc0/f10d 0 2023-01-04T18:16:34.317 INFO:tasks.workunit.client.1.smithi098.stdout:2/677: rmdir d6/dc/d2b/d42/d51 39 2023-01-04T18:16:34.318 INFO:tasks.workunit.client.1.smithi098.stdout:9/731: write d2/d5/d18/d4e/d42/d89/dac/d26/d41/f43 [672155,79726] 0 2023-01-04T18:16:34.319 INFO:tasks.workunit.client.1.smithi098.stdout:1/587: creat d1/d25/fd1 x:0 0 0 2023-01-04T18:16:34.321 INFO:tasks.workunit.client.1.smithi098.stdout:1/588: write d1/d8/da/f1a [3491482,65279] 0 2023-01-04T18:16:34.321 INFO:tasks.workunit.client.1.smithi098.stdout:1/589: chown d1/d8/f28 2934848 1 2023-01-04T18:16:34.322 INFO:tasks.workunit.client.1.smithi098.stdout:1/590: mknod d1/d8/da/d64/cd2 0 2023-01-04T18:16:34.328 INFO:tasks.workunit.client.1.smithi098.stdout:5/698: dread d1/da/f26 [4194304,4194304] 0 2023-01-04T18:16:34.330 INFO:tasks.workunit.client.1.smithi098.stdout:7/684: dwrite d1/d23/fab [4194304,4194304] 0 2023-01-04T18:16:34.330 INFO:tasks.workunit.client.1.smithi098.stdout:5/699: creat d1/d1e/dab/dd0/fd9 x:0 0 0 2023-01-04T18:16:34.331 INFO:tasks.workunit.client.1.smithi098.stdout:5/700: stat d1/d2/d14/d59/c9a 0 2023-01-04T18:16:34.338 INFO:tasks.workunit.client.1.smithi098.stdout:1/591: dread d1/d25/d27/d77/f2b [0,4194304] 0 2023-01-04T18:16:34.338 INFO:tasks.workunit.client.1.smithi098.stdout:1/592: write d1/d8/da/f1a [6629145,73068] 0 2023-01-04T18:16:34.338 INFO:tasks.workunit.client.1.smithi098.stdout:1/593: write d1/d25/d27/fa7 [619639,17716] 0 2023-01-04T18:16:34.338 INFO:tasks.workunit.client.1.smithi098.stdout:1/594: write d1/d25/fb9 [493762,34107] 0 2023-01-04T18:16:34.340 INFO:tasks.workunit.client.1.smithi098.stdout:1/595: write d1/d8/f28 [7313482,104126] 0 2023-01-04T18:16:34.340 INFO:tasks.workunit.client.1.smithi098.stdout:1/596: read d1/d25/fb9 [124315,67005] 0 2023-01-04T18:16:34.344 INFO:tasks.workunit.client.1.smithi098.stdout:1/597: dread d1/d25/f99 [0,4194304] 0 2023-01-04T18:16:34.348 INFO:tasks.workunit.client.1.smithi098.stdout:1/598: rmdir d1/d25/d27/d77/d82 0 2023-01-04T18:16:34.350 INFO:tasks.workunit.client.1.smithi098.stdout:1/599: symlink d1/d25/ld3 0 2023-01-04T18:16:34.350 INFO:tasks.workunit.client.1.smithi098.stdout:1/600: getdents d1/d25/d36/d4e 0 2023-01-04T18:16:34.352 INFO:tasks.workunit.client.1.smithi098.stdout:1/601: rename d1/d25/d36/d4e/d6e/l8c to d1/d8/dac/ld4 0 2023-01-04T18:16:34.357 INFO:tasks.workunit.client.1.smithi098.stdout:6/709: dwrite d9/dd/de/f9c [4194304,4194304] 0 2023-01-04T18:16:34.357 INFO:tasks.workunit.client.1.smithi098.stdout:6/710: stat d9/dd/de/d20/ca1 0 2023-01-04T18:16:34.357 INFO:tasks.workunit.client.1.smithi098.stdout:3/762: dwrite d6/d6f/fdd [0,4194304] 0 2023-01-04T18:16:34.357 INFO:tasks.workunit.client.1.smithi098.stdout:1/602: write d1/d8/da/dae/f5f [1250461,109403] 0 2023-01-04T18:16:34.358 INFO:tasks.workunit.client.1.smithi098.stdout:9/732: dwrite d2/d53/daf/db3/fc3 [0,4194304] 0 2023-01-04T18:16:34.358 INFO:tasks.workunit.client.1.smithi098.stdout:9/733: fsync d2/d5/d18/d4e/d42/d89/dac/d78/f7a 0 2023-01-04T18:16:34.358 INFO:tasks.workunit.client.1.smithi098.stdout:9/734: chown d2/d5/d18/d4e/d42/c47 1790003 1 2023-01-04T18:16:34.358 INFO:tasks.workunit.client.1.smithi098.stdout:8/701: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/d12/f4f [0,4194304] 0 2023-01-04T18:16:34.359 INFO:tasks.workunit.client.1.smithi098.stdout:2/678: dwrite d6/dc/d2b/d42/d47/d35/f55 [0,4194304] 0 2023-01-04T18:16:34.365 INFO:tasks.workunit.client.1.smithi098.stdout:6/711: mkdir d9/dda 0 2023-01-04T18:16:34.367 INFO:tasks.workunit.client.1.smithi098.stdout:0/688: sync 2023-01-04T18:16:34.369 INFO:tasks.workunit.client.1.smithi098.stdout:7/685: dwrite d1/da/f82 [0,4194304] 0 2023-01-04T18:16:34.369 INFO:tasks.workunit.client.1.smithi098.stdout:8/702: dread d6/d11/d15/d1b/d2a/d3b/d59/d6e/f89 [0,4194304] 0 2023-01-04T18:16:34.371 INFO:tasks.workunit.client.1.smithi098.stdout:3/763: mknod d6/d56/d9f/da8/dfd/c10e 0 2023-01-04T18:16:34.374 INFO:tasks.workunit.client.1.smithi098.stdout:3/764: write d6/d10/dc0/fce [3525726,37530] 0 2023-01-04T18:16:34.374 INFO:tasks.workunit.client.1.smithi098.stdout:9/735: link d2/d5/d18/d4e/d42/d89/dac/d26/d41/f85 d2/d53/daf/ff0 0 2023-01-04T18:16:34.375 INFO:tasks.workunit.client.1.smithi098.stdout:0/689: write df/d17/d1c/d2c/d41/d4a/d7a/f88 [1909996,92249] 0 2023-01-04T18:16:34.375 INFO:tasks.workunit.client.1.smithi098.stdout:0/690: write df/d17/d1c/d3b/f58 [503997,36886] 0 2023-01-04T18:16:34.377 INFO:tasks.workunit.client.1.smithi098.stdout:6/712: getdents d9/dd/d4e/d67/d8d/d81 0 2023-01-04T18:16:34.378 INFO:tasks.workunit.client.1.smithi098.stdout:2/679: dwrite d6/fbf [0,4194304] 0 2023-01-04T18:16:34.378 INFO:tasks.workunit.client.1.smithi098.stdout:2/680: write d6/dc/d2b/d42/f71 [600629,31367] 0 2023-01-04T18:16:34.379 INFO:tasks.workunit.client.1.smithi098.stdout:1/603: dwrite d1/d25/d36/d4e/d6e/f9a [0,4194304] 0 2023-01-04T18:16:34.379 INFO:tasks.workunit.client.1.smithi098.stdout:1/604: dread - d1/d8/dac/fad zero size 2023-01-04T18:16:34.380 INFO:tasks.workunit.client.1.smithi098.stdout:8/703: link d6/d11/c69 d6/d11/d15/d1b/d2a/dae/db8/ccd 0 2023-01-04T18:16:34.380 INFO:tasks.workunit.client.1.smithi098.stdout:2/681: read d6/dc/d2b/d42/d47/d35/f55 [1250522,60322] 0 2023-01-04T18:16:34.381 INFO:tasks.workunit.client.1.smithi098.stdout:2/682: fdatasync d6/dc/d2b/d42/d47/d31/d90/fc4 0 2023-01-04T18:16:34.384 INFO:tasks.workunit.client.1.smithi098.stdout:7/686: mknod d1/d23/d73/cf0 0 2023-01-04T18:16:34.388 INFO:tasks.workunit.client.1.smithi098.stdout:3/765: creat d6/d56/d9f/da8/f10f x:0 0 0 2023-01-04T18:16:34.389 INFO:tasks.workunit.client.1.smithi098.stdout:4/697: sync 2023-01-04T18:16:34.392 INFO:tasks.workunit.client.1.smithi098.stdout:0/691: symlink df/d17/d1c/d2c/d41/d4a/le9 0 2023-01-04T18:16:34.394 INFO:tasks.workunit.client.1.smithi098.stdout:6/713: creat d9/dd/d4e/d67/d8d/da5/fdb x:0 0 0 2023-01-04T18:16:34.396 INFO:tasks.workunit.client.1.smithi098.stdout:1/605: rmdir d1/da9 39 2023-01-04T18:16:34.398 INFO:tasks.workunit.client.1.smithi098.stdout:8/704: creat d6/d11/d15/d1b/d2a/d3b/d59/fce x:0 0 0 2023-01-04T18:16:34.398 INFO:tasks.workunit.client.1.smithi098.stdout:8/705: stat d6/f9 0 2023-01-04T18:16:34.399 INFO:tasks.workunit.client.1.smithi098.stdout:7/687: symlink d1/d51/dc0/lf1 0 2023-01-04T18:16:34.401 INFO:tasks.workunit.client.1.smithi098.stdout:7/688: write d1/d51/f59 [1396358,98092] 0 2023-01-04T18:16:34.401 INFO:tasks.workunit.client.1.smithi098.stdout:3/766: creat d6/d56/dc8/f110 x:0 0 0 2023-01-04T18:16:34.401 INFO:tasks.workunit.client.1.smithi098.stdout:7/689: chown d1/d23/d37/f71 82369705 1 2023-01-04T18:16:34.401 INFO:tasks.workunit.client.1.smithi098.stdout:4/698: rmdir d5/d28 39 2023-01-04T18:16:34.402 INFO:tasks.workunit.client.1.smithi098.stdout:4/699: chown d5/de/d30/d4f/ccc 21 1 2023-01-04T18:16:34.402 INFO:tasks.workunit.client.1.smithi098.stdout:7/690: write d1/d23/d37/fcb [2785879,18929] 0 2023-01-04T18:16:34.403 INFO:tasks.workunit.client.1.smithi098.stdout:0/692: creat df/d17/d1c/d2c/dba/fea x:0 0 0 2023-01-04T18:16:34.403 INFO:tasks.workunit.client.1.smithi098.stdout:0/693: chown df/d4f/d6b/d89/f9a 6556325 1 2023-01-04T18:16:34.404 INFO:tasks.workunit.client.1.smithi098.stdout:6/714: symlink d9/dd/ldc 0 2023-01-04T18:16:34.405 INFO:tasks.workunit.client.1.smithi098.stdout:8/706: creat d6/d11/d15/fcf x:0 0 0 2023-01-04T18:16:34.405 INFO:tasks.workunit.client.1.smithi098.stdout:2/683: mknod d6/dc/d2b/d42/d47/ce9 0 2023-01-04T18:16:34.407 INFO:tasks.workunit.client.1.smithi098.stdout:7/691: getdents d1/da 0 2023-01-04T18:16:34.407 INFO:tasks.workunit.client.1.smithi098.stdout:7/692: truncate d1/d51/d26/d28/d2d/d6b/f93 1386149 0 2023-01-04T18:16:34.412 INFO:tasks.workunit.client.1.smithi098.stdout:8/707: symlink d6/d11/d15/d1b/d2a/d3b/d8e/ld0 0 2023-01-04T18:16:34.413 INFO:tasks.workunit.client.1.smithi098.stdout:8/708: dread - d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/fc9 zero size 2023-01-04T18:16:34.413 INFO:tasks.workunit.client.1.smithi098.stdout:6/715: link d9/fca d9/dd/d24/d3e/d86/fdd 0 2023-01-04T18:16:34.413 INFO:tasks.workunit.client.1.smithi098.stdout:6/716: readlink d9/dd/de/d44/lb3 0 2023-01-04T18:16:34.413 INFO:tasks.workunit.client.1.smithi098.stdout:2/684: read d6/dc/d2b/d42/fd5 [76180,9408] 0 2023-01-04T18:16:34.413 INFO:tasks.workunit.client.1.smithi098.stdout:7/693: creat d1/d23/d21/ff2 x:0 0 0 2023-01-04T18:16:34.414 INFO:tasks.workunit.client.1.smithi098.stdout:1/606: write d1/d25/d27/d77/f2b [7331684,76416] 0 2023-01-04T18:16:34.415 INFO:tasks.workunit.client.1.smithi098.stdout:3/767: dread d6/d10/d19/d3f/d46/f5a [0,4194304] 0 2023-01-04T18:16:34.416 INFO:tasks.workunit.client.1.smithi098.stdout:3/768: read d6/d10/d19/d3f/d5e/d74/f3c [2081128,5697] 0 2023-01-04T18:16:34.417 INFO:tasks.workunit.client.1.smithi098.stdout:6/717: mkdir d9/dda/dde 0 2023-01-04T18:16:34.418 INFO:tasks.workunit.client.1.smithi098.stdout:2/685: creat d6/dc/d2b/d42/d51/d81/d8f/fea x:0 0 0 2023-01-04T18:16:34.419 INFO:tasks.workunit.client.1.smithi098.stdout:0/694: dread df/d17/d1c/fa2 [0,4194304] 0 2023-01-04T18:16:34.419 INFO:tasks.workunit.client.1.smithi098.stdout:0/695: fsync df/d17/d1c/d3b/d98/f69 0 2023-01-04T18:16:34.419 INFO:tasks.workunit.client.1.smithi098.stdout:3/769: dread d6/d10/f62 [4194304,4194304] 0 2023-01-04T18:16:34.419 INFO:tasks.workunit.client.1.smithi098.stdout:1/607: write f0 [3745463,3215] 0 2023-01-04T18:16:34.419 INFO:tasks.workunit.client.1.smithi098.stdout:7/694: truncate d1/da/f1b 2857664 0 2023-01-04T18:16:34.419 INFO:tasks.workunit.client.1.smithi098.stdout:1/608: write d1/d25/d27/d77/fa3 [216340,118822] 0 2023-01-04T18:16:34.420 INFO:tasks.workunit.client.1.smithi098.stdout:1/609: dread d1/d25/d27/d77/f74 [0,4194304] 0 2023-01-04T18:16:34.420 INFO:tasks.workunit.client.1.smithi098.stdout:1/610: fdatasync d1/d25/d36/f40 0 2023-01-04T18:16:34.421 INFO:tasks.workunit.client.1.smithi098.stdout:7/695: read d1/d23/d73/d85/f9b [3367182,52131] 0 2023-01-04T18:16:34.421 INFO:tasks.workunit.client.1.smithi098.stdout:7/696: fsync d1/d51/dc0/fce 0 2023-01-04T18:16:34.421 INFO:tasks.workunit.client.1.smithi098.stdout:8/709: rename d6/d11/d15/d1b/d2a/d6b/c3d to d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/cd1 0 2023-01-04T18:16:34.424 INFO:tasks.workunit.client.1.smithi098.stdout:3/770: write d6/d6f/fdd [3668707,25041] 0 2023-01-04T18:16:34.424 INFO:tasks.workunit.client.1.smithi098.stdout:3/771: chown d6/d6f/db6 310059 1 2023-01-04T18:16:34.424 INFO:tasks.workunit.client.1.smithi098.stdout:3/772: truncate d6/d10/d19/d3f/f96 184892 0 2023-01-04T18:16:34.424 INFO:tasks.workunit.client.1.smithi098.stdout:3/773: dread - d6/ffb zero size 2023-01-04T18:16:34.424 INFO:tasks.workunit.client.1.smithi098.stdout:3/774: write d6/d56/f85 [854391,75949] 0 2023-01-04T18:16:34.424 INFO:tasks.workunit.client.1.smithi098.stdout:6/718: symlink d9/dd/de/d44/d79/ldf 0 2023-01-04T18:16:34.426 INFO:tasks.workunit.client.1.smithi098.stdout:2/686: creat d6/dc/d2b/d42/d51/d81/d8f/de8/feb x:0 0 0 2023-01-04T18:16:34.427 INFO:tasks.workunit.client.1.smithi098.stdout:4/700: dwrite d5/f1b [4194304,4194304] 0 2023-01-04T18:16:34.427 INFO:tasks.workunit.client.1.smithi098.stdout:4/701: fsync d5/de/f9e 0 2023-01-04T18:16:34.427 INFO:tasks.workunit.client.1.smithi098.stdout:4/702: chown d5/d9/d13/l19 492 1 2023-01-04T18:16:34.428 INFO:tasks.workunit.client.1.smithi098.stdout:0/696: rmdir df/d4f/d6e/daf 39 2023-01-04T18:16:34.432 INFO:tasks.workunit.client.1.smithi098.stdout:7/697: symlink d1/d51/d26/d28/dc6/lf3 0 2023-01-04T18:16:34.442 INFO:tasks.workunit.client.1.smithi098.stdout:1/611: rename d1/d25/d27/c75 to d1/d8/da/d64/cd5 0 2023-01-04T18:16:34.447 INFO:tasks.workunit.client.1.smithi098.stdout:3/775: creat d6/d56/dc8/f111 x:0 0 0 2023-01-04T18:16:34.448 INFO:tasks.workunit.client.1.smithi098.stdout:6/719: truncate d9/dd/de/d44/fa6 5689521 0 2023-01-04T18:16:34.448 INFO:tasks.workunit.client.1.smithi098.stdout:1/612: dread d1/d8/da/dae/f4a [0,4194304] 0 2023-01-04T18:16:34.448 INFO:tasks.workunit.client.1.smithi098.stdout:1/613: chown d1/d8/da/d64/l6d 22108 1 2023-01-04T18:16:34.448 INFO:tasks.workunit.client.1.smithi098.stdout:1/614: truncate d1/d8/da/dae/f8a 1027262 0 2023-01-04T18:16:34.449 INFO:tasks.workunit.client.1.smithi098.stdout:0/697: dwrite df/f52 [0,4194304] 0 2023-01-04T18:16:34.450 INFO:tasks.workunit.client.1.smithi098.stdout:1/615: dread d1/d25/d27/d77/da8/f5a [0,4194304] 0 2023-01-04T18:16:34.452 INFO:tasks.workunit.client.1.smithi098.stdout:0/698: write f1 [3614651,30627] 0 2023-01-04T18:16:34.452 INFO:tasks.workunit.client.1.smithi098.stdout:2/687: creat d6/dc/d2b/d42/d47/d31/fec x:0 0 0 2023-01-04T18:16:34.459 INFO:tasks.workunit.client.1.smithi098.stdout:4/703: unlink d5/d28/d7d/l82 0 2023-01-04T18:16:34.459 INFO:tasks.workunit.client.1.smithi098.stdout:4/704: readlink d5/d28/da6/la7 0 2023-01-04T18:16:34.459 INFO:tasks.workunit.client.1.smithi098.stdout:4/705: write d5/f93 [134461,33163] 0 2023-01-04T18:16:34.460 INFO:tasks.workunit.client.1.smithi098.stdout:1/616: dread d1/d25/d27/f34 [0,4194304] 0 2023-01-04T18:16:34.461 INFO:tasks.workunit.client.1.smithi098.stdout:1/617: write d1/f1f [1145081,34288] 0 2023-01-04T18:16:34.465 INFO:tasks.workunit.client.1.smithi098.stdout:0/699: dwrite df/d17/d9b/d86/fe8 [0,4194304] 0 2023-01-04T18:16:34.469 INFO:tasks.workunit.client.1.smithi098.stdout:8/710: dread d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/f50 [0,4194304] 0 2023-01-04T18:16:34.471 INFO:tasks.workunit.client.1.smithi098.stdout:3/776: unlink d6/d10/d6b/fa4 0 2023-01-04T18:16:34.473 INFO:tasks.workunit.client.1.smithi098.stdout:6/720: mkdir d9/dd/de/d44/d7a/de0 0 2023-01-04T18:16:34.478 INFO:tasks.workunit.client.1.smithi098.stdout:1/618: rename d1/d25/d36/d89/laa to d1/d25/d36/d4e/ld6 0 2023-01-04T18:16:34.479 INFO:tasks.workunit.client.1.smithi098.stdout:1/619: write d1/d8/da/dae/f6c [385877,55895] 0 2023-01-04T18:16:34.480 INFO:tasks.workunit.client.1.smithi098.stdout:0/700: creat df/d4f/d6b/d94/feb x:0 0 0 2023-01-04T18:16:34.481 INFO:tasks.workunit.client.1.smithi098.stdout:6/721: symlink d9/dd/de/d44/d79/le1 0 2023-01-04T18:16:34.482 INFO:tasks.workunit.client.1.smithi098.stdout:2/688: mkdir d6/ded 0 2023-01-04T18:16:34.482 INFO:tasks.workunit.client.1.smithi098.stdout:2/689: truncate d6/dc/d2b/d42/d47/d31/f59 5091127 0 2023-01-04T18:16:34.485 INFO:tasks.workunit.client.1.smithi098.stdout:3/777: rename d6/d10/d19/d3f/d46/f5a to d6/d10/d19/d3f/d5e/d7d/dec/dda/f112 0 2023-01-04T18:16:34.486 INFO:tasks.workunit.client.1.smithi098.stdout:1/620: unlink d1/d25/d27/d77/da8/f5a 0 2023-01-04T18:16:34.487 INFO:tasks.workunit.client.1.smithi098.stdout:2/690: mkdir d6/dc/d2b/d42/d47/d1f/dee 0 2023-01-04T18:16:34.488 INFO:tasks.workunit.client.1.smithi098.stdout:3/778: mkdir d6/d10/d29/d6a/dd1/d113 0 2023-01-04T18:16:34.488 INFO:tasks.workunit.client.1.smithi098.stdout:3/779: fsync d6/d10/d19/d3f/d5e/d74/f45 0 2023-01-04T18:16:34.488 INFO:tasks.workunit.client.1.smithi098.stdout:3/780: getdents d6/d10/d19/d3f/d5e/dd4 0 2023-01-04T18:16:34.490 INFO:tasks.workunit.client.1.smithi098.stdout:1/621: mkdir d1/d25/d36/d4e/d9f/dd7 0 2023-01-04T18:16:34.495 INFO:tasks.workunit.client.1.smithi098.stdout:0/701: read df/d17/d1c/d3b/d98/f69 [1195604,66160] 0 2023-01-04T18:16:34.521 INFO:tasks.workunit.client.1.smithi098.stdout:8/711: dwrite d6/d11/d15/d1b/f93 [0,4194304] 0 2023-01-04T18:16:34.521 INFO:tasks.workunit.client.1.smithi098.stdout:8/712: dread - d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/fb6 zero size 2023-01-04T18:16:34.524 INFO:tasks.workunit.client.1.smithi098.stdout:8/713: mknod d6/d11/d15/d1b/d2a/d3b/d59/d6e/d8b/cd2 0 2023-01-04T18:16:34.524 INFO:tasks.workunit.client.1.smithi098.stdout:8/714: readlink d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/l90 0 2023-01-04T18:16:34.526 INFO:tasks.workunit.client.1.smithi098.stdout:8/715: write d6/d11/d15/d1b/d2a/d6b/d7f/fb9 [223471,105375] 0 2023-01-04T18:16:34.526 INFO:tasks.workunit.client.1.smithi098.stdout:8/716: truncate d6/d11/d15/d1b/d2a/d6b/d7f/d5a/fc0 715112 0 2023-01-04T18:16:34.528 INFO:tasks.workunit.client.1.smithi098.stdout:8/717: creat d6/fd3 x:0 0 0 2023-01-04T18:16:34.528 INFO:tasks.workunit.client.1.smithi098.stdout:8/718: fsync d6/d11/d15/d1b/d2a/d6b/d7f/d12/f4f 0 2023-01-04T18:16:34.528 INFO:tasks.workunit.client.1.smithi098.stdout:8/719: fsync d6/f9 0 2023-01-04T18:16:34.528 INFO:tasks.workunit.client.1.smithi098.stdout:8/720: symlink d6/d11/d15/db4/dba/ld4 0 2023-01-04T18:16:34.529 INFO:tasks.workunit.client.1.smithi098.stdout:8/721: write d6/d11/d15/d1b/d2a/d3b/d59/d6e/f89 [1006115,43239] 0 2023-01-04T18:16:34.531 INFO:tasks.workunit.client.1.smithi098.stdout:8/722: symlink d6/d11/d15/db4/ld5 0 2023-01-04T18:16:34.531 INFO:tasks.workunit.client.1.smithi098.stdout:8/723: write d6/d11/d15/d70/fbc [988411,89826] 0 2023-01-04T18:16:34.531 INFO:tasks.workunit.client.1.smithi098.stdout:8/724: stat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/l9b 0 2023-01-04T18:16:34.532 INFO:tasks.workunit.client.1.smithi098.stdout:5/701: sync 2023-01-04T18:16:34.534 INFO:tasks.workunit.client.1.smithi098.stdout:0/702: dwrite df/d17/d1c/f47 [0,4194304] 0 2023-01-04T18:16:34.534 INFO:tasks.workunit.client.1.smithi098.stdout:3/781: dwrite d6/d10/fbf [4194304,4194304] 0 2023-01-04T18:16:34.534 INFO:tasks.workunit.client.1.smithi098.stdout:0/703: readlink df/d4f/d6e/lc3 0 2023-01-04T18:16:34.536 INFO:tasks.workunit.client.1.smithi098.stdout:6/722: dwrite d9/dd/d15/f36 [4194304,4194304] 0 2023-01-04T18:16:34.537 INFO:tasks.workunit.client.1.smithi098.stdout:6/723: readlink d9/dd/de/d26/d71/l83 0 2023-01-04T18:16:34.538 INFO:tasks.workunit.client.1.smithi098.stdout:6/724: fdatasync d9/dd/de/d26/f97 0 2023-01-04T18:16:34.538 INFO:tasks.workunit.client.1.smithi098.stdout:6/725: stat d9/dd/d4e/cc9 0 2023-01-04T18:16:34.538 INFO:tasks.workunit.client.1.smithi098.stdout:1/622: dwrite d1/d25/d36/f40 [0,4194304] 0 2023-01-04T18:16:34.538 INFO:tasks.workunit.client.1.smithi098.stdout:2/691: dwrite d6/dc/d2b/d42/d47/d1f/f3a [0,4194304] 0 2023-01-04T18:16:34.538 INFO:tasks.workunit.client.1.smithi098.stdout:0/704: getdents df/d4f/d6e/daf 0 2023-01-04T18:16:34.539 INFO:tasks.workunit.client.1.smithi098.stdout:3/782: getdents d6/d10/d19/d3f/d46/d8a 0 2023-01-04T18:16:34.543 INFO:tasks.workunit.client.1.smithi098.stdout:1/623: dread d1/d8/da/dae/f6c [0,4194304] 0 2023-01-04T18:16:34.548 INFO:tasks.workunit.client.1.smithi098.stdout:6/726: dread d9/dd/d15/f36 [0,4194304] 0 2023-01-04T18:16:34.548 INFO:tasks.workunit.client.1.smithi098.stdout:6/727: write d9/dd/d24/d3e/d86/fa8 [181649,122380] 0 2023-01-04T18:16:34.558 INFO:tasks.workunit.client.1.smithi098.stdout:2/692: creat d6/dc/d2b/d46/fef x:0 0 0 2023-01-04T18:16:34.559 INFO:tasks.workunit.client.1.smithi098.stdout:0/705: creat df/d17/d1c/d3b/fec x:0 0 0 2023-01-04T18:16:34.559 INFO:tasks.workunit.client.1.smithi098.stdout:6/728: rmdir d9/dd/d4e/d67/d8d 39 2023-01-04T18:16:34.561 INFO:tasks.workunit.client.1.smithi098.stdout:2/693: mknod d6/dc/d2b/d42/d51/d81/d8f/cf0 0 2023-01-04T18:16:34.561 INFO:tasks.workunit.client.1.smithi098.stdout:2/694: chown d6/dc/fdb 44737148 1 2023-01-04T18:16:34.561 INFO:tasks.workunit.client.1.smithi098.stdout:0/706: creat df/d17/d1c/d2c/d41/d4a/d4c/d5f/fed x:0 0 0 2023-01-04T18:16:34.562 INFO:tasks.workunit.client.1.smithi098.stdout:8/725: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/d78/f91 [0,4194304] 0 2023-01-04T18:16:34.562 INFO:tasks.workunit.client.1.smithi098.stdout:6/729: rmdir d9/dd/de/d26 39 2023-01-04T18:16:34.564 INFO:tasks.workunit.client.1.smithi098.stdout:0/707: creat df/d17/d1c/d2c/d41/d4a/d4c/d90/fee x:0 0 0 2023-01-04T18:16:34.565 INFO:tasks.workunit.client.1.smithi098.stdout:2/695: dread d6/dc/d2b/d42/d47/d35/f67 [0,4194304] 0 2023-01-04T18:16:34.565 INFO:tasks.workunit.client.1.smithi098.stdout:2/696: truncate d6/dc/d4b/d89/fa4 823742 0 2023-01-04T18:16:34.566 INFO:tasks.workunit.client.1.smithi098.stdout:2/697: stat d6/dc/d2b/f2e 0 2023-01-04T18:16:34.566 INFO:tasks.workunit.client.1.smithi098.stdout:2/698: read d6/dc/fdb [1007327,35373] 0 2023-01-04T18:16:34.566 INFO:tasks.workunit.client.1.smithi098.stdout:2/699: truncate d6/dc/d2b/d42/d47/d1f/f8b 249060 0 2023-01-04T18:16:34.570 INFO:tasks.workunit.client.1.smithi098.stdout:1/624: dwrite d1/d8/da/f48 [0,4194304] 0 2023-01-04T18:16:34.570 INFO:tasks.workunit.client.1.smithi098.stdout:1/625: fdatasync d1/d8/d53/fc8 0 2023-01-04T18:16:34.570 INFO:tasks.workunit.client.1.smithi098.stdout:5/702: dwrite d1/d2/d14/f90 [0,4194304] 0 2023-01-04T18:16:34.571 INFO:tasks.workunit.client.1.smithi098.stdout:3/783: dwrite d6/d10/f80 [0,4194304] 0 2023-01-04T18:16:34.582 INFO:tasks.workunit.client.1.smithi098.stdout:3/784: dread d6/d10/d19/d3f/d5e/d74/f52 [0,4194304] 0 2023-01-04T18:16:34.585 INFO:tasks.workunit.client.1.smithi098.stdout:0/708: dwrite df/d17/d1c/f47 [0,4194304] 0 2023-01-04T18:16:34.585 INFO:tasks.workunit.client.1.smithi098.stdout:0/709: dread - df/d17/d1c/d2c/d41/da0/fa3 zero size 2023-01-04T18:16:34.586 INFO:tasks.workunit.client.1.smithi098.stdout:0/710: write df/f52 [1176274,116853] 0 2023-01-04T18:16:34.613 INFO:tasks.workunit.client.1.smithi098.stdout:8/726: mkdir d6/d11/d15/d1b/d2a/dae/dd6 0 2023-01-04T18:16:34.615 INFO:tasks.workunit.client.1.smithi098.stdout:6/730: creat d9/dda/fe2 x:0 0 0 2023-01-04T18:16:34.616 INFO:tasks.workunit.client.1.smithi098.stdout:2/700: mknod d6/dc/d2b/d32/cf1 0 2023-01-04T18:16:34.618 INFO:tasks.workunit.client.1.smithi098.stdout:9/736: sync 2023-01-04T18:16:34.618 INFO:tasks.workunit.client.1.smithi098.stdout:7/698: sync 2023-01-04T18:16:34.618 INFO:tasks.workunit.client.1.smithi098.stdout:7/699: write d1/da/f68 [1333508,111612] 0 2023-01-04T18:16:34.618 INFO:tasks.workunit.client.1.smithi098.stdout:7/700: dread - d1/d51/d26/f8a zero size 2023-01-04T18:16:34.619 INFO:tasks.workunit.client.1.smithi098.stdout:7/701: chown d1/d51/d26/c33 9 1 2023-01-04T18:16:34.620 INFO:tasks.workunit.client.1.smithi098.stdout:1/626: truncate f0 2990655 0 2023-01-04T18:16:34.623 INFO:tasks.workunit.client.1.smithi098.stdout:5/703: unlink d1/f2e 0 2023-01-04T18:16:34.623 INFO:tasks.workunit.client.1.smithi098.stdout:3/785: mknod d6/d10/dc0/c114 0 2023-01-04T18:16:34.624 INFO:tasks.workunit.client.1.smithi098.stdout:3/786: write d6/d10/d29/fd5 [563859,14586] 0 2023-01-04T18:16:34.624 INFO:tasks.workunit.client.1.smithi098.stdout:3/787: dread - d6/ffb zero size 2023-01-04T18:16:34.630 INFO:tasks.workunit.client.1.smithi098.stdout:0/711: unlink df/d17/d1c/d2c/d41/f92 0 2023-01-04T18:16:34.633 INFO:tasks.workunit.client.1.smithi098.stdout:6/731: symlink d9/dd/de/d44/d79/le3 0 2023-01-04T18:16:34.634 INFO:tasks.workunit.client.1.smithi098.stdout:2/701: getdents d6/dc/d2b/d42/d51/d79/da3/db5 0 2023-01-04T18:16:34.634 INFO:tasks.workunit.client.1.smithi098.stdout:2/702: write d6/dc/d2b/d42/d47/d1f/d82/fc6 [360801,112123] 0 2023-01-04T18:16:34.634 INFO:tasks.workunit.client.1.smithi098.stdout:2/703: readlink d6/l9c 0 2023-01-04T18:16:34.634 INFO:tasks.workunit.client.1.smithi098.stdout:4/706: sync 2023-01-04T18:16:34.635 INFO:tasks.workunit.client.1.smithi098.stdout:9/737: mknod d2/d5/d18/d19/d82/dce/cf1 0 2023-01-04T18:16:34.636 INFO:tasks.workunit.client.1.smithi098.stdout:7/702: truncate d1/f45 8357527 0 2023-01-04T18:16:34.638 INFO:tasks.workunit.client.1.smithi098.stdout:1/627: creat d1/da9/fd8 x:0 0 0 2023-01-04T18:16:34.639 INFO:tasks.workunit.client.1.smithi098.stdout:5/704: mkdir d1/dda 0 2023-01-04T18:16:34.639 INFO:tasks.workunit.client.1.smithi098.stdout:5/705: readlink d1/d2f/la9 0 2023-01-04T18:16:34.640 INFO:tasks.workunit.client.1.smithi098.stdout:3/788: mkdir d6/d10/d6b/d115 0 2023-01-04T18:16:34.640 INFO:tasks.workunit.client.1.smithi098.stdout:0/712: getdents df/d4f/d6b/d89/db6 0 2023-01-04T18:16:34.641 INFO:tasks.workunit.client.1.smithi098.stdout:0/713: write df/d17/d1c/d2c/d41/d4a/d7a/f88 [2165963,14831] 0 2023-01-04T18:16:34.642 INFO:tasks.workunit.client.1.smithi098.stdout:0/714: truncate df/d17/d1c/d2c/dba/fea 44576 0 2023-01-04T18:16:34.643 INFO:tasks.workunit.client.1.smithi098.stdout:8/727: truncate d6/d11/d15/d1b/d2a/d6b/d7f/d78/f91 4952 0 2023-01-04T18:16:34.644 INFO:tasks.workunit.client.1.smithi098.stdout:6/732: creat d9/dd/de/d26/fe4 x:0 0 0 2023-01-04T18:16:34.648 INFO:tasks.workunit.client.1.smithi098.stdout:2/704: link d6/dc/d2b/d42/d47/d1f/l4f d6/dc/d2b/d42/d47/d35/dca/lf2 0 2023-01-04T18:16:34.648 INFO:tasks.workunit.client.1.smithi098.stdout:2/705: dread - d6/fd8 zero size 2023-01-04T18:16:34.650 INFO:tasks.workunit.client.1.smithi098.stdout:4/707: truncate d5/d28/f51 174621 0 2023-01-04T18:16:34.650 INFO:tasks.workunit.client.1.smithi098.stdout:4/708: chown d5/d28/d44/fda 1 1 2023-01-04T18:16:34.650 INFO:tasks.workunit.client.1.smithi098.stdout:4/709: chown d5/d9 2 1 2023-01-04T18:16:34.651 INFO:tasks.workunit.client.1.smithi098.stdout:4/710: write d5/de/d21/d9d/fea [921768,59816] 0 2023-01-04T18:16:34.651 INFO:tasks.workunit.client.1.smithi098.stdout:7/703: truncate d1/d51/f19 4316877 0 2023-01-04T18:16:34.651 INFO:tasks.workunit.client.1.smithi098.stdout:7/704: stat d1/c2f 0 2023-01-04T18:16:34.651 INFO:tasks.workunit.client.1.smithi098.stdout:7/705: write d1/d23/d21/d7f/faa [1233517,59072] 0 2023-01-04T18:16:34.652 INFO:tasks.workunit.client.1.smithi098.stdout:0/715: write df/d17/d9b/d5c/f96 [3392188,15133] 0 2023-01-04T18:16:34.652 INFO:tasks.workunit.client.1.smithi098.stdout:1/628: read d1/d8/da/dae/f8a [106812,9490] 0 2023-01-04T18:16:34.653 INFO:tasks.workunit.client.1.smithi098.stdout:5/706: unlink d1/d2/d14/f90 0 2023-01-04T18:16:34.653 INFO:tasks.workunit.client.1.smithi098.stdout:5/707: write d1/f6b [1290811,86167] 0 2023-01-04T18:16:34.653 INFO:tasks.workunit.client.1.smithi098.stdout:5/708: write d1/d2/d14/da1/fcc [570897,11446] 0 2023-01-04T18:16:34.653 INFO:tasks.workunit.client.1.smithi098.stdout:5/709: truncate d1/d2/d14/d59/fb7 247332 0 2023-01-04T18:16:34.653 INFO:tasks.workunit.client.1.smithi098.stdout:5/710: write d1/d2/d14/d59/f71 [986964,18730] 0 2023-01-04T18:16:34.653 INFO:tasks.workunit.client.1.smithi098.stdout:5/711: chown d1/da/d44/d80/dbb 5081965 1 2023-01-04T18:16:34.653 INFO:tasks.workunit.client.1.smithi098.stdout:9/738: dwrite d2/d5/f24 [0,4194304] 0 2023-01-04T18:16:34.656 INFO:tasks.workunit.client.1.smithi098.stdout:8/728: creat d6/d11/d15/d1b/d2a/d6b/d7f/d78/d9d/fd7 x:0 0 0 2023-01-04T18:16:34.658 INFO:tasks.workunit.client.1.smithi098.stdout:6/733: unlink d9/dd/de/d44/d7a/cbd 0 2023-01-04T18:16:34.661 INFO:tasks.workunit.client.1.smithi098.stdout:2/706: getdents d6/dc/d2b/d42/d47/d1f 0 2023-01-04T18:16:34.661 INFO:tasks.workunit.client.1.smithi098.stdout:3/789: dwrite d6/d10/dc0/f10d [0,4194304] 0 2023-01-04T18:16:34.661 INFO:tasks.workunit.client.1.smithi098.stdout:3/790: chown d6/d10/d19/d3f/d5e/d7d/dec 7925198 1 2023-01-04T18:16:34.666 INFO:tasks.workunit.client.1.smithi098.stdout:0/716: dread df/d17/d1c/d3b/d98/f81 [0,4194304] 0 2023-01-04T18:16:34.667 INFO:tasks.workunit.client.1.smithi098.stdout:4/711: mknod d5/d9/d13/cf0 0 2023-01-04T18:16:34.668 INFO:tasks.workunit.client.1.smithi098.stdout:5/712: dwrite d1/d2/d14/d19/f35 [4194304,4194304] 0 2023-01-04T18:16:34.669 INFO:tasks.workunit.client.1.smithi098.stdout:2/707: dread d6/dc/d2b/d42/d47/d1f/d82/fc6 [0,4194304] 0 2023-01-04T18:16:34.669 INFO:tasks.workunit.client.1.smithi098.stdout:2/708: write d6/dc/d2b/d42/d47/f41 [1664311,19825] 0 2023-01-04T18:16:34.669 INFO:tasks.workunit.client.1.smithi098.stdout:2/709: fsync d6/dc/d2b/d42/d47/fb7 0 2023-01-04T18:16:34.670 INFO:tasks.workunit.client.1.smithi098.stdout:7/706: creat d1/d4/d11/d9d/dd0/ff4 x:0 0 0 2023-01-04T18:16:34.678 INFO:tasks.workunit.client.1.smithi098.stdout:1/629: mkdir d1/d25/d39/dd9 0 2023-01-04T18:16:34.678 INFO:tasks.workunit.client.1.smithi098.stdout:9/739: creat d2/d5/d18/d4e/d42/ff2 x:0 0 0 2023-01-04T18:16:34.678 INFO:tasks.workunit.client.1.smithi098.stdout:8/729: creat d6/d11/d15/d1b/d2a/d3b/d59/d6e/fd8 x:0 0 0 2023-01-04T18:16:34.678 INFO:tasks.workunit.client.1.smithi098.stdout:9/740: chown d2/d5/d18/d4e/d42/d89/dac/d26/c3d 112975 1 2023-01-04T18:16:34.678 INFO:tasks.workunit.client.1.smithi098.stdout:6/734: rmdir d9/dd/de/d44/d7a/de0 0 2023-01-04T18:16:34.681 INFO:tasks.workunit.client.1.smithi098.stdout:0/717: link df/d17/d24/f34 df/d17/d1c/d2c/d41/d4a/d4c/d90/fef 0 2023-01-04T18:16:34.681 INFO:tasks.workunit.client.1.smithi098.stdout:3/791: rmdir d6/d10/d6b/d115 0 2023-01-04T18:16:34.681 INFO:tasks.workunit.client.1.smithi098.stdout:0/718: fsync df/d17/d1c/d2c/d41/fae 0 2023-01-04T18:16:34.682 INFO:tasks.workunit.client.1.smithi098.stdout:0/719: chown df/d17/d9b/d5c/c99 0 1 2023-01-04T18:16:34.683 INFO:tasks.workunit.client.1.smithi098.stdout:2/710: truncate d6/dc/d2b/d32/fb9 2322424 0 2023-01-04T18:16:34.685 INFO:tasks.workunit.client.1.smithi098.stdout:7/707: creat d1/d51/dc0/ff5 x:0 0 0 2023-01-04T18:16:34.685 INFO:tasks.workunit.client.1.smithi098.stdout:7/708: fsync d1/da/fb1 0 2023-01-04T18:16:34.685 INFO:tasks.workunit.client.1.smithi098.stdout:7/709: readlink d1/d23/d73/d85/ld9 0 2023-01-04T18:16:34.687 INFO:tasks.workunit.client.1.smithi098.stdout:1/630: rmdir d1/d8 39 2023-01-04T18:16:34.687 INFO:tasks.workunit.client.1.smithi098.stdout:1/631: fsync d1/f44 0 2023-01-04T18:16:34.687 INFO:tasks.workunit.client.1.smithi098.stdout:6/735: dread d9/fb1 [0,4194304] 0 2023-01-04T18:16:34.687 INFO:tasks.workunit.client.1.smithi098.stdout:6/736: truncate d9/dd/de/d26/fe4 787690 0 2023-01-04T18:16:34.689 INFO:tasks.workunit.client.1.smithi098.stdout:8/730: mkdir d6/d11/d15/d1b/d2a/dae/db8/dd9 0 2023-01-04T18:16:34.689 INFO:tasks.workunit.client.1.smithi098.stdout:8/731: chown d6/d11/d15/d1b/d2a/dae/dd6 2 1 2023-01-04T18:16:34.691 INFO:tasks.workunit.client.1.smithi098.stdout:4/712: symlink d5/d28/d7d/db6/de4/lf1 0 2023-01-04T18:16:34.693 INFO:tasks.workunit.client.1.smithi098.stdout:5/713: dwrite d1/f96 [0,4194304] 0 2023-01-04T18:16:34.694 INFO:tasks.workunit.client.1.smithi098.stdout:0/720: dread df/d17/d68/fb2 [0,4194304] 0 2023-01-04T18:16:34.694 INFO:tasks.workunit.client.1.smithi098.stdout:3/792: mkdir d6/d10/d19/d3f/d5e/d7d/d116 0 2023-01-04T18:16:34.694 INFO:tasks.workunit.client.1.smithi098.stdout:3/793: chown d6/d10/d29/d6a 108 1 2023-01-04T18:16:34.695 INFO:tasks.workunit.client.1.smithi098.stdout:7/710: creat d1/d4/ff6 x:0 0 0 2023-01-04T18:16:34.697 INFO:tasks.workunit.client.1.smithi098.stdout:1/632: symlink d1/d8/da/lda 0 2023-01-04T18:16:34.698 INFO:tasks.workunit.client.1.smithi098.stdout:6/737: mknod d9/dd/d4e/ce5 0 2023-01-04T18:16:34.698 INFO:tasks.workunit.client.1.smithi098.stdout:6/738: readlink d9/dd/d4e/d67/d8d/d8e/la3 0 2023-01-04T18:16:34.699 INFO:tasks.workunit.client.1.smithi098.stdout:8/732: mkdir d6/d11/d15/d1b/d2a/d6b/d7f/d12/dc2/dda 0 2023-01-04T18:16:34.700 INFO:tasks.workunit.client.1.smithi098.stdout:4/713: creat d5/d28/d7d/db6/dbd/ff2 x:0 0 0 2023-01-04T18:16:34.702 INFO:tasks.workunit.client.1.smithi098.stdout:5/714: creat d1/d2f/d66/fdb x:0 0 0 2023-01-04T18:16:34.702 INFO:tasks.workunit.client.1.smithi098.stdout:5/715: readlink d1/d1e/l42 0 2023-01-04T18:16:34.702 INFO:tasks.workunit.client.1.smithi098.stdout:0/721: dread df/d17/d1c/f47 [0,4194304] 0 2023-01-04T18:16:34.702 INFO:tasks.workunit.client.1.smithi098.stdout:0/722: read - df/d17/d1c/fb9 zero size 2023-01-04T18:16:34.702 INFO:tasks.workunit.client.1.smithi098.stdout:3/794: rename d6/d10/d19/d3f/fdb to d6/d56/f117 0 2023-01-04T18:16:34.703 INFO:tasks.workunit.client.1.smithi098.stdout:3/795: write d6/d56/d9f/da8/f10f [590016,52251] 0 2023-01-04T18:16:34.703 INFO:tasks.workunit.client.1.smithi098.stdout:6/739: write d9/dd/de/d20/d82/fbe [4619942,52805] 0 2023-01-04T18:16:34.706 INFO:tasks.workunit.client.1.smithi098.stdout:7/711: rename d1/d51/d26/d28/d2d/d6b/fb4 to d1/d51/d26/d28/d2d/ff7 0 2023-01-04T18:16:34.706 INFO:tasks.workunit.client.1.smithi098.stdout:0/723: symlink df/d17/d68/lf0 0 2023-01-04T18:16:34.707 INFO:tasks.workunit.client.1.smithi098.stdout:3/796: mknod d6/d6f/d9b/c118 0 2023-01-04T18:16:34.710 INFO:tasks.workunit.client.1.smithi098.stdout:2/711: dwrite d6/dc/fdb [0,4194304] 0 2023-01-04T18:16:34.710 INFO:tasks.workunit.client.1.smithi098.stdout:9/741: dwrite d2/d5/d18/d4e/d42/d89/dac/d78/fbc [0,4194304] 0 2023-01-04T18:16:34.711 INFO:tasks.workunit.client.1.smithi098.stdout:1/633: rename d1/d25/d27/d5c/dc3 to d1/d25/ddb 0 2023-01-04T18:16:34.711 INFO:tasks.workunit.client.1.smithi098.stdout:0/724: dread df/d4f/d6e/f87 [0,4194304] 0 2023-01-04T18:16:34.713 INFO:tasks.workunit.client.1.smithi098.stdout:5/716: dread d1/d46/d6a/f9f [0,4194304] 0 2023-01-04T18:16:34.713 INFO:tasks.workunit.client.1.smithi098.stdout:5/717: write d1/d1e/dab/fb3 [754571,86850] 0 2023-01-04T18:16:34.714 INFO:tasks.workunit.client.1.smithi098.stdout:1/634: link d1/d8/da/f91 d1/d25/d27/fdc 0 2023-01-04T18:16:34.714 INFO:tasks.workunit.client.1.smithi098.stdout:5/718: write d1/d2/d14/d19/f35 [7423344,75745] 0 2023-01-04T18:16:34.716 INFO:tasks.workunit.client.1.smithi098.stdout:8/733: rename d6/d11/d15/d1b/d2a/d6b/d7f/f71 to d6/d92/fdb 0 2023-01-04T18:16:34.716 INFO:tasks.workunit.client.1.smithi098.stdout:8/734: fsync d6/d11/d15/d1b/d2a/d3b/f5d 0 2023-01-04T18:16:34.718 INFO:tasks.workunit.client.1.smithi098.stdout:0/725: link df/d4f/d6e/l7b df/d17/d1c/d2c/d41/d4a/d4c/lf1 0 2023-01-04T18:16:34.719 INFO:tasks.workunit.client.1.smithi098.stdout:1/635: getdents d1/d88 0 2023-01-04T18:16:34.720 INFO:tasks.workunit.client.1.smithi098.stdout:5/719: mkdir d1/db0/ddc 0 2023-01-04T18:16:34.720 INFO:tasks.workunit.client.1.smithi098.stdout:2/712: dread d6/dc/d2b/d42/d47/d1f/d39/d6e/f77 [0,4194304] 0 2023-01-04T18:16:34.722 INFO:tasks.workunit.client.1.smithi098.stdout:7/712: rename d1/d23/d21/d7f/f98 to d1/d51/d26/d28/d2d/d75/ff8 0 2023-01-04T18:16:34.722 INFO:tasks.workunit.client.1.smithi098.stdout:7/713: dread - d1/d51/d26/d28/d2d/ff7 zero size 2023-01-04T18:16:34.722 INFO:tasks.workunit.client.1.smithi098.stdout:7/714: write d1/d23/d21/d7f/fbc [4188057,110033] 0 2023-01-04T18:16:34.723 INFO:tasks.workunit.client.1.smithi098.stdout:8/735: creat d6/d11/d15/d1b/d2a/dae/db8/fdc x:0 0 0 2023-01-04T18:16:34.724 INFO:tasks.workunit.client.1.smithi098.stdout:0/726: mkdir df/d4f/dc7/df2 0 2023-01-04T18:16:34.725 INFO:tasks.workunit.client.1.smithi098.stdout:1/636: read d1/f4 [3670377,40730] 0 2023-01-04T18:16:34.728 INFO:tasks.workunit.client.1.smithi098.stdout:8/736: dread d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d64/f77 [0,4194304] 0 2023-01-04T18:16:34.730 INFO:tasks.workunit.client.1.smithi098.stdout:7/715: mknod d1/d4/d11/d9d/dd2/cf9 0 2023-01-04T18:16:34.730 INFO:tasks.workunit.client.1.smithi098.stdout:9/742: rename d2/f2b to d2/d5/d18/d4e/d42/d89/dac/d26/d41/ff3 0 2023-01-04T18:16:34.730 INFO:tasks.workunit.client.1.smithi098.stdout:0/727: creat df/d17/d9b/d86/de7/ff3 x:0 0 0 2023-01-04T18:16:34.733 INFO:tasks.workunit.client.1.smithi098.stdout:8/737: rmdir d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54 39 2023-01-04T18:16:34.735 INFO:tasks.workunit.client.1.smithi098.stdout:7/716: mknod d1/d23/d37/d40/cfa 0 2023-01-04T18:16:34.735 INFO:tasks.workunit.client.1.smithi098.stdout:7/717: truncate d1/d23/d21/d43/f9e 370555 0 2023-01-04T18:16:34.735 INFO:tasks.workunit.client.1.smithi098.stdout:7/718: chown d1/d4/ff6 12 1 2023-01-04T18:16:34.736 INFO:tasks.workunit.client.1.smithi098.stdout:5/720: rename d1/da/d44/d45/d4b/lb5 to d1/d38/dce/ldd 0 2023-01-04T18:16:34.736 INFO:tasks.workunit.client.1.smithi098.stdout:8/738: read d6/d11/d15/d1b/d2a/d3b/f5d [3294280,95625] 0 2023-01-04T18:16:34.737 INFO:tasks.workunit.client.1.smithi098.stdout:9/743: creat d2/d5/d6f/ff4 x:0 0 0 2023-01-04T18:16:34.737 INFO:tasks.workunit.client.1.smithi098.stdout:0/728: creat df/d17/d9b/d86/ff4 x:0 0 0 2023-01-04T18:16:34.738 INFO:tasks.workunit.client.1.smithi098.stdout:7/719: creat d1/d4/d11/d9d/ffb x:0 0 0 2023-01-04T18:16:34.738 INFO:tasks.workunit.client.1.smithi098.stdout:7/720: write d1/d51/d26/d28/d2d/f5f [1024843,110498] 0 2023-01-04T18:16:34.739 INFO:tasks.workunit.client.1.smithi098.stdout:5/721: dread d1/d2f/f5f [0,4194304] 0 2023-01-04T18:16:34.740 INFO:tasks.workunit.client.1.smithi098.stdout:6/740: dwrite d9/dd/d24/fcf [0,4194304] 0 2023-01-04T18:16:34.740 INFO:tasks.workunit.client.1.smithi098.stdout:6/741: fdatasync d9/dd/de/fa2 0 2023-01-04T18:16:34.740 INFO:tasks.workunit.client.1.smithi098.stdout:8/739: mkdir d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/d8a/ddd 0 2023-01-04T18:16:34.742 INFO:tasks.workunit.client.1.smithi098.stdout:4/714: dwrite d5/d9/f43 [0,4194304] 0 2023-01-04T18:16:34.742 INFO:tasks.workunit.client.1.smithi098.stdout:9/744: rename d2/d53/daf/db3 to d2/d5/d18/d1d/d23/dad/d72/d9e/dca/df5 0 2023-01-04T18:16:34.742 INFO:tasks.workunit.client.1.smithi098.stdout:2/713: dwrite d6/dc/d2b/d42/d47/d1f/d39/f8a [0,4194304] 0 2023-01-04T18:16:34.742 INFO:tasks.workunit.client.1.smithi098.stdout:2/714: write d6/dc/d2b/d42/d47/da5/dda/fde [343387,78503] 0 2023-01-04T18:16:34.743 INFO:tasks.workunit.client.1.smithi098.stdout:0/729: mknod df/d4f/cf5 0 2023-01-04T18:16:34.743 INFO:tasks.workunit.client.1.smithi098.stdout:3/797: dwrite d6/d10/d19/d3f/d5e/d7d/dec/dda/f112 [0,4194304] 0 2023-01-04T18:16:34.745 INFO:tasks.workunit.client.1.smithi098.stdout:7/721: symlink d1/dc1/lfc 0 2023-01-04T18:16:34.745 INFO:tasks.workunit.client.1.smithi098.stdout:3/798: write d6/d10/f80 [6691091,56528] 0 2023-01-04T18:16:34.748 INFO:tasks.workunit.client.1.smithi098.stdout:5/722: dread d1/f6b [0,4194304] 0 2023-01-04T18:16:34.748 INFO:tasks.workunit.client.1.smithi098.stdout:5/723: write d1/d46/f6e [627494,51166] 0 2023-01-04T18:16:34.748 INFO:tasks.workunit.client.1.smithi098.stdout:5/724: chown d1/d38 21 1 2023-01-04T18:16:34.748 INFO:tasks.workunit.client.1.smithi098.stdout:5/725: chown d1/d2/d14/f5c 2 1 2023-01-04T18:16:34.757 INFO:tasks.workunit.client.1.smithi098.stdout:4/715: dread d5/d28/fcd [0,4194304] 0 2023-01-04T18:16:34.757 INFO:tasks.workunit.client.1.smithi098.stdout:4/716: stat d5/de/d21/f6b 0 2023-01-04T18:16:34.757 INFO:tasks.workunit.client.1.smithi098.stdout:4/717: chown d5/de/d21/f2d 358707 1 2023-01-04T18:16:34.758 INFO:tasks.workunit.client.1.smithi098.stdout:9/745: truncate d2/d5/d18/d1d/d23/d66/f67 191139 0 2023-01-04T18:16:34.758 INFO:tasks.workunit.client.1.smithi098.stdout:9/746: fdatasync d2/d5/f75 0 2023-01-04T18:16:34.760 INFO:tasks.workunit.client.1.smithi098.stdout:8/740: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/fb7 [0,4194304] 0 2023-01-04T18:16:34.760 INFO:tasks.workunit.client.1.smithi098.stdout:8/741: chown d6/d11/d15/d1b/d2a/d6b/d7f/d5a/fcc 0 1 2023-01-04T18:16:34.762 INFO:tasks.workunit.client.1.smithi098.stdout:6/742: dwrite d9/dd/de/d26/f77 [0,4194304] 0 2023-01-04T18:16:34.762 INFO:tasks.workunit.client.1.smithi098.stdout:6/743: chown d9/dd/de/d44 128 1 2023-01-04T18:16:34.762 INFO:tasks.workunit.client.1.smithi098.stdout:6/744: chown d9/dd/d4e/c4d 9 1 2023-01-04T18:16:34.762 INFO:tasks.workunit.client.1.smithi098.stdout:6/745: dread - d9/dd/de/d44/d79/fcd zero size 2023-01-04T18:16:34.763 INFO:tasks.workunit.client.1.smithi098.stdout:6/746: write d9/dd/de/d44/d79/fcd [617894,121091] 0 2023-01-04T18:16:34.764 INFO:tasks.workunit.client.1.smithi098.stdout:2/715: truncate d6/dc/d2b/d42/d47/d35/f38 1011595 0 2023-01-04T18:16:34.768 INFO:tasks.workunit.client.1.smithi098.stdout:5/726: dwrite d1/d2/d14/d19/f35 [4194304,4194304] 0 2023-01-04T18:16:34.771 INFO:tasks.workunit.client.1.smithi098.stdout:0/730: creat df/d17/d1c/d2c/dba/ff6 x:0 0 0 2023-01-04T18:16:34.786 INFO:tasks.workunit.client.1.smithi098.stdout:7/722: rmdir d1/d23/d21/db7 0 2023-01-04T18:16:34.786 INFO:tasks.workunit.client.1.smithi098.stdout:7/723: truncate d1/d4/d11/d9d/dd0/ff4 309042 0 2023-01-04T18:16:34.786 INFO:tasks.workunit.client.1.smithi098.stdout:7/724: write d1/d23/d21/d43/f9e [338785,85109] 0 2023-01-04T18:16:34.787 INFO:tasks.workunit.client.1.smithi098.stdout:3/799: link d6/ffb d6/d56/d9f/da8/f119 0 2023-01-04T18:16:34.789 INFO:tasks.workunit.client.1.smithi098.stdout:4/718: truncate d5/de/d21/f80 2550402 0 2023-01-04T18:16:34.791 INFO:tasks.workunit.client.1.smithi098.stdout:9/747: rename d2/d5/d18/d4e/d42/d89/dac to d2/df6 0 2023-01-04T18:16:34.800 INFO:tasks.workunit.client.1.smithi098.stdout:8/742: creat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/d8a/fde x:0 0 0 2023-01-04T18:16:34.802 INFO:tasks.workunit.client.1.smithi098.stdout:6/747: truncate d9/dd/de/d26/f62 38034 0 2023-01-04T18:16:34.803 INFO:tasks.workunit.client.1.smithi098.stdout:6/748: read d9/dd/de/d44/d7a/d85/fc7 [457602,61407] 0 2023-01-04T18:16:34.803 INFO:tasks.workunit.client.1.smithi098.stdout:6/749: chown d9/dd/d24/d3e/d86/d9b/dce/cb8 45456 1 2023-01-04T18:16:34.805 INFO:tasks.workunit.client.1.smithi098.stdout:2/716: link d6/dc/d4b/f97 d6/dc/d2b/d42/d51/d79/da3/ff3 0 2023-01-04T18:16:34.810 INFO:tasks.workunit.client.1.smithi098.stdout:0/731: mkdir df/d17/d68/df7 0 2023-01-04T18:16:34.810 INFO:tasks.workunit.client.1.smithi098.stdout:0/732: getdents df/d17/d1c/d2c/d41/d4a/d4c/d8e 0 2023-01-04T18:16:34.810 INFO:tasks.workunit.client.1.smithi098.stdout:0/733: dread - df/d17/d1c/d2c/d41/fae zero size 2023-01-04T18:16:34.812 INFO:tasks.workunit.client.1.smithi098.stdout:7/725: mkdir d1/d23/d73/d85/dfd 0 2023-01-04T18:16:34.812 INFO:tasks.workunit.client.1.smithi098.stdout:3/800: creat d6/d10/d19/d3f/d46/f11a x:0 0 0 2023-01-04T18:16:34.813 INFO:tasks.workunit.client.1.smithi098.stdout:4/719: creat d5/d28/da6/ff3 x:0 0 0 2023-01-04T18:16:34.813 INFO:tasks.workunit.client.1.smithi098.stdout:4/720: write d5/de/d2c/f92 [1022107,104135] 0 2023-01-04T18:16:34.815 INFO:tasks.workunit.client.1.smithi098.stdout:5/727: rename d1/da/d44/l7e to d1/d38/dce/lde 0 2023-01-04T18:16:34.815 INFO:tasks.workunit.client.1.smithi098.stdout:5/728: read d1/d2/d14/d19/fa6 [3780797,45269] 0 2023-01-04T18:16:34.816 INFO:tasks.workunit.client.1.smithi098.stdout:8/743: symlink d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/ldf 0 2023-01-04T18:16:34.816 INFO:tasks.workunit.client.1.smithi098.stdout:0/734: getdents df/d17/d24/d80 0 2023-01-04T18:16:34.817 INFO:tasks.workunit.client.1.smithi098.stdout:8/744: write d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d64/f77 [80416,109577] 0 2023-01-04T18:16:34.817 INFO:tasks.workunit.client.1.smithi098.stdout:7/726: mknod d1/db2/dc4/cfe 0 2023-01-04T18:16:34.818 INFO:tasks.workunit.client.1.smithi098.stdout:3/801: creat d6/d10/d19/d3f/d5e/d7d/dec/dda/f11b x:0 0 0 2023-01-04T18:16:34.819 INFO:tasks.workunit.client.1.smithi098.stdout:5/729: rename d1/da/d44/d45/c91 to d1/d46/dc4/cdf 0 2023-01-04T18:16:34.820 INFO:tasks.workunit.client.1.smithi098.stdout:8/745: mkdir d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/d84/de0 0 2023-01-04T18:16:34.820 INFO:tasks.workunit.client.1.smithi098.stdout:7/727: creat d1/d23/d73/fff x:0 0 0 2023-01-04T18:16:34.821 INFO:tasks.workunit.client.1.smithi098.stdout:8/746: creat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/d8a/fe1 x:0 0 0 2023-01-04T18:16:34.822 INFO:tasks.workunit.client.1.smithi098.stdout:7/728: creat d1/d23/f100 x:0 0 0 2023-01-04T18:16:34.823 INFO:tasks.workunit.client.1.smithi098.stdout:8/747: creat d6/d11/d15/d1b/d2a/d3b/d79/fe2 x:0 0 0 2023-01-04T18:16:34.823 INFO:tasks.workunit.client.1.smithi098.stdout:5/730: write d1/d1e/f68 [7489157,114348] 0 2023-01-04T18:16:34.824 INFO:tasks.workunit.client.1.smithi098.stdout:7/729: link d1/d23/d37/d40/lc5 d1/d23/l101 0 2023-01-04T18:16:34.824 INFO:tasks.workunit.client.1.smithi098.stdout:7/730: read d1/d23/d21/d43/f70 [1027478,19308] 0 2023-01-04T18:16:34.825 INFO:tasks.workunit.client.1.smithi098.stdout:7/731: write d1/d23/d21/d7f/faa [1321732,116681] 0 2023-01-04T18:16:34.825 INFO:tasks.workunit.client.1.smithi098.stdout:7/732: chown d1/da/c41 9932941 1 2023-01-04T18:16:34.825 INFO:tasks.workunit.client.1.smithi098.stdout:8/748: link d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/f40 d6/d11/d15/d1b/d2a/d3b/d59/fe3 0 2023-01-04T18:16:34.825 INFO:tasks.workunit.client.1.smithi098.stdout:5/731: creat d1/d2f/d66/fe0 x:0 0 0 2023-01-04T18:16:34.826 INFO:tasks.workunit.client.1.smithi098.stdout:0/735: write df/d17/d1c/fa2 [1334427,91810] 0 2023-01-04T18:16:34.826 INFO:tasks.workunit.client.1.smithi098.stdout:8/749: symlink d6/d11/d15/d1b/d2a/d3b/d59/d6e/d8b/le4 0 2023-01-04T18:16:34.827 INFO:tasks.workunit.client.1.smithi098.stdout:0/736: creat df/d17/d1c/d2c/d41/ff8 x:0 0 0 2023-01-04T18:16:34.827 INFO:tasks.workunit.client.1.smithi098.stdout:8/750: truncate d6/d11/d15/f1f 2260811 0 2023-01-04T18:16:34.829 INFO:tasks.workunit.client.1.smithi098.stdout:0/737: symlink df/d17/d1c/d3b/d98/ddc/lf9 0 2023-01-04T18:16:34.830 INFO:tasks.workunit.client.1.smithi098.stdout:8/751: mknod d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/d84/ce5 0 2023-01-04T18:16:34.831 INFO:tasks.workunit.client.1.smithi098.stdout:8/752: creat d6/d11/d15/d1b/d2a/d3b/d59/fe6 x:0 0 0 2023-01-04T18:16:34.831 INFO:tasks.workunit.client.1.smithi098.stdout:0/738: dread df/d17/d9b/d5c/fa7 [0,4194304] 0 2023-01-04T18:16:34.832 INFO:tasks.workunit.client.1.smithi098.stdout:3/802: dread d6/d56/f83 [0,4194304] 0 2023-01-04T18:16:34.832 INFO:tasks.workunit.client.1.smithi098.stdout:3/803: readlink d6/l55 0 2023-01-04T18:16:34.832 INFO:tasks.workunit.client.1.smithi098.stdout:8/753: mkdir d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/d84/de0/de7 0 2023-01-04T18:16:34.833 INFO:tasks.workunit.client.1.smithi098.stdout:0/739: mkdir df/dfa 0 2023-01-04T18:16:34.833 INFO:tasks.workunit.client.1.smithi098.stdout:6/750: dwrite d9/dd/d24/d3e/fa4 [0,4194304] 0 2023-01-04T18:16:34.834 INFO:tasks.workunit.client.1.smithi098.stdout:3/804: rename d6/d56/d9f/da8/lba to d6/d56/dc8/l11c 0 2023-01-04T18:16:34.836 INFO:tasks.workunit.client.1.smithi098.stdout:0/740: symlink df/d17/d9b/da4/lfb 0 2023-01-04T18:16:34.837 INFO:tasks.workunit.client.1.smithi098.stdout:9/748: dwrite d2/df6/f4d [0,4194304] 0 2023-01-04T18:16:34.839 INFO:tasks.workunit.client.1.smithi098.stdout:2/717: dwrite d6/f11 [4194304,4194304] 0 2023-01-04T18:16:34.844 INFO:tasks.workunit.client.1.smithi098.stdout:5/732: dwrite d1/fc [0,4194304] 0 2023-01-04T18:16:34.844 INFO:tasks.workunit.client.1.smithi098.stdout:5/733: write d1/da/d44/d45/d4b/d61/f86 [352975,97085] 0 2023-01-04T18:16:34.844 INFO:tasks.workunit.client.1.smithi098.stdout:5/734: truncate d1/d38/f69 723186 0 2023-01-04T18:16:34.849 INFO:tasks.workunit.client.1.smithi098.stdout:2/718: dread d6/dc/d2b/d42/d47/d1f/d39/f8a [0,4194304] 0 2023-01-04T18:16:34.849 INFO:tasks.workunit.client.1.smithi098.stdout:2/719: stat d6/dc/d2b/f70 0 2023-01-04T18:16:34.867 INFO:tasks.workunit.client.1.smithi098.stdout:8/754: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/f47 [4194304,4194304] 0 2023-01-04T18:16:34.867 INFO:tasks.workunit.client.1.smithi098.stdout:8/755: stat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/f5c 0 2023-01-04T18:16:34.868 INFO:tasks.workunit.client.1.smithi098.stdout:8/756: write d6/d92/fad [2810129,91606] 0 2023-01-04T18:16:34.877 INFO:tasks.workunit.client.1.smithi098.stdout:9/749: dwrite d2/d53/fe5 [4194304,4194304] 0 2023-01-04T18:16:34.880 INFO:tasks.workunit.client.1.smithi098.stdout:2/720: dwrite d6/f8 [4194304,4194304] 0 2023-01-04T18:16:34.880 INFO:tasks.workunit.client.1.smithi098.stdout:7/733: dwrite d1/d51/d26/d28/d2d/d75/fb6 [0,4194304] 0 2023-01-04T18:16:34.880 INFO:tasks.workunit.client.1.smithi098.stdout:5/735: dwrite d1/d2/d14/d59/fcd [0,4194304] 0 2023-01-04T18:16:34.880 INFO:tasks.workunit.client.1.smithi098.stdout:7/734: chown d1/d4/fa8 3471 1 2023-01-04T18:16:34.880 INFO:tasks.workunit.client.1.smithi098.stdout:8/757: dread d6/d11/d15/d1b/f93 [0,4194304] 0 2023-01-04T18:16:34.891 INFO:tasks.workunit.client.1.smithi098.stdout:7/735: write d1/d23/d37/d40/f5c [1345899,75531] 0 2023-01-04T18:16:34.896 INFO:tasks.workunit.client.1.smithi098.stdout:8/758: dwrite d6/d11/d15/d1b/f62 [0,4194304] 0 2023-01-04T18:16:34.896 INFO:tasks.workunit.client.1.smithi098.stdout:1/637: sync 2023-01-04T18:16:34.897 INFO:tasks.workunit.client.1.smithi098.stdout:1/638: write d1/d8/da/dae/f5f [5104708,11023] 0 2023-01-04T18:16:34.899 INFO:tasks.workunit.client.1.smithi098.stdout:3/805: link d6/d10/d19/d3f/d5e/d74/f89 d6/d10/dc0/f11d 0 2023-01-04T18:16:34.901 INFO:tasks.workunit.client.1.smithi098.stdout:6/751: rename d9/dd/d4e/d67/d8d/d8e/l98 to d9/dd/de/d20/le6 0 2023-01-04T18:16:34.904 INFO:tasks.workunit.client.1.smithi098.stdout:0/741: mknod df/d17/d9b/da4/db5/cfc 0 2023-01-04T18:16:34.923 INFO:tasks.workunit.client.1.smithi098.stdout:3/806: dwrite d6/d56/f60 [4194304,4194304] 0 2023-01-04T18:16:34.923 INFO:tasks.workunit.client.1.smithi098.stdout:3/807: dread - d6/d10/dc0/ffa zero size 2023-01-04T18:16:34.923 INFO:tasks.workunit.client.1.smithi098.stdout:9/750: creat d2/d5/d18/ff7 x:0 0 0 2023-01-04T18:16:34.926 INFO:tasks.workunit.client.1.smithi098.stdout:2/721: creat d6/ded/ff4 x:0 0 0 2023-01-04T18:16:34.931 INFO:tasks.workunit.client.1.smithi098.stdout:5/736: symlink d1/da/d44/d80/dd2/le1 0 2023-01-04T18:16:34.937 INFO:tasks.workunit.client.1.smithi098.stdout:8/759: unlink d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/f5c 0 2023-01-04T18:16:34.937 INFO:tasks.workunit.client.1.smithi098.stdout:8/760: dread - d6/d11/d15/d1b/d2a/dae/db8/fdc zero size 2023-01-04T18:16:34.938 INFO:tasks.workunit.client.1.smithi098.stdout:1/639: creat d1/d8/da/dae/fdd x:0 0 0 2023-01-04T18:16:34.941 INFO:tasks.workunit.client.1.smithi098.stdout:7/736: rename d1/da/l64 to d1/d51/l102 0 2023-01-04T18:16:34.941 INFO:tasks.workunit.client.1.smithi098.stdout:7/737: write d1/d23/d37/f71 [302783,36141] 0 2023-01-04T18:16:34.941 INFO:tasks.workunit.client.1.smithi098.stdout:7/738: dread - d1/d23/d21/ff2 zero size 2023-01-04T18:16:34.942 INFO:tasks.workunit.client.1.smithi098.stdout:6/752: mknod d9/dd/d24/d3e/d86/ce7 0 2023-01-04T18:16:34.942 INFO:tasks.workunit.client.1.smithi098.stdout:1/640: dread d1/d25/d27/d77/f2b [0,4194304] 0 2023-01-04T18:16:34.945 INFO:tasks.workunit.client.1.smithi098.stdout:8/761: dread d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/f88 [0,4194304] 0 2023-01-04T18:16:34.946 INFO:tasks.workunit.client.1.smithi098.stdout:3/808: symlink d6/d10/d19/d3f/d46/l11e 0 2023-01-04T18:16:34.946 INFO:tasks.workunit.client.1.smithi098.stdout:3/809: write d6/d10/d6b/f7c [4450232,64398] 0 2023-01-04T18:16:34.947 INFO:tasks.workunit.client.1.smithi098.stdout:9/751: mknod d2/d2d/cf8 0 2023-01-04T18:16:34.947 INFO:tasks.workunit.client.1.smithi098.stdout:2/722: mknod d6/dc/cf5 0 2023-01-04T18:16:34.949 INFO:tasks.workunit.client.1.smithi098.stdout:0/742: rename df/d4f/l53 to df/d17/lfd 0 2023-01-04T18:16:34.949 INFO:tasks.workunit.client.1.smithi098.stdout:6/753: creat d9/dd/d24/d3e/fe8 x:0 0 0 2023-01-04T18:16:34.950 INFO:tasks.workunit.client.1.smithi098.stdout:5/737: dwrite d1/d2/f17 [0,4194304] 0 2023-01-04T18:16:34.950 INFO:tasks.workunit.client.1.smithi098.stdout:5/738: chown d1/d2/d14/da1/fb2 638820 1 2023-01-04T18:16:34.950 INFO:tasks.workunit.client.1.smithi098.stdout:5/739: chown d1/d1e/dab/dd0 3456428 1 2023-01-04T18:16:34.950 INFO:tasks.workunit.client.1.smithi098.stdout:1/641: mknod d1/d25/d36/d4e/d6e/cde 0 2023-01-04T18:16:34.951 INFO:tasks.workunit.client.1.smithi098.stdout:2/723: rename d6/dc/f7e to d6/dc/ff6 0 2023-01-04T18:16:34.954 INFO:tasks.workunit.client.1.smithi098.stdout:7/739: rename d1/db2/dc4/ddb to d1/d23/d37/d78/d103 0 2023-01-04T18:16:34.957 INFO:tasks.workunit.client.1.smithi098.stdout:0/743: truncate df/d17/d24/d80/f8f 1931968 0 2023-01-04T18:16:34.957 INFO:tasks.workunit.client.1.smithi098.stdout:8/762: dread d6/d11/d15/d1b/d2a/d3b/d59/d6e/f89 [0,4194304] 0 2023-01-04T18:16:34.958 INFO:tasks.workunit.client.1.smithi098.stdout:6/754: mkdir d9/dd/d4e/d67/db6/de9 0 2023-01-04T18:16:34.959 INFO:tasks.workunit.client.1.smithi098.stdout:6/755: write d9/dd/d4e/d67/d8d/da5/fdb [297384,93819] 0 2023-01-04T18:16:34.961 INFO:tasks.workunit.client.1.smithi098.stdout:5/740: creat d1/d1e/d81/fe2 x:0 0 0 2023-01-04T18:16:34.964 INFO:tasks.workunit.client.1.smithi098.stdout:1/642: symlink d1/ldf 0 2023-01-04T18:16:34.967 INFO:tasks.workunit.client.1.smithi098.stdout:1/643: write d1/d25/d27/fa7 [370732,72251] 0 2023-01-04T18:16:34.967 INFO:tasks.workunit.client.1.smithi098.stdout:1/644: chown d1/d25/d36/d4e 20807 1 2023-01-04T18:16:34.967 INFO:tasks.workunit.client.1.smithi098.stdout:2/724: mknod d6/dc/d2b/d42/d47/d35/dca/cf7 0 2023-01-04T18:16:34.968 INFO:tasks.workunit.client.1.smithi098.stdout:2/725: write d6/dc/d2b/d42/d47/d1f/fd0 [65577,75194] 0 2023-01-04T18:16:34.968 INFO:tasks.workunit.client.1.smithi098.stdout:7/740: rmdir d1 39 2023-01-04T18:16:34.968 INFO:tasks.workunit.client.1.smithi098.stdout:7/741: write d1/da/fb0 [539806,53072] 0 2023-01-04T18:16:34.970 INFO:tasks.workunit.client.1.smithi098.stdout:4/721: sync 2023-01-04T18:16:34.970 INFO:tasks.workunit.client.1.smithi098.stdout:7/742: write d1/d23/d21/d43/f70 [2176097,14640] 0 2023-01-04T18:16:34.972 INFO:tasks.workunit.client.1.smithi098.stdout:5/741: mknod d1/da/d44/d80/dbd/ce3 0 2023-01-04T18:16:34.974 INFO:tasks.workunit.client.1.smithi098.stdout:1/645: creat d1/d25/d27/d77/da8/dca/fe0 x:0 0 0 2023-01-04T18:16:34.975 INFO:tasks.workunit.client.1.smithi098.stdout:2/726: mknod d6/dc/d2b/d42/d51/d79/cf8 0 2023-01-04T18:16:34.976 INFO:tasks.workunit.client.1.smithi098.stdout:5/742: creat d1/d2f/d66/d75/da5/fe4 x:0 0 0 2023-01-04T18:16:34.979 INFO:tasks.workunit.client.1.smithi098.stdout:2/727: rename d6/dc/d2b/d42/d47/d31 to d6/ded/df9 0 2023-01-04T18:16:34.980 INFO:tasks.workunit.client.1.smithi098.stdout:5/743: mknod d1/da/d44/d45/ce5 0 2023-01-04T18:16:34.982 INFO:tasks.workunit.client.1.smithi098.stdout:9/752: dwrite d2/d5/d18/d1d/dc0/fcc [0,4194304] 0 2023-01-04T18:16:34.983 INFO:tasks.workunit.client.1.smithi098.stdout:2/728: mknod d6/dc/d2b/d42/d51/de1/cfa 0 2023-01-04T18:16:34.983 INFO:tasks.workunit.client.1.smithi098.stdout:2/729: write d6/dc/d2b/d42/f71 [1121084,31585] 0 2023-01-04T18:16:34.983 INFO:tasks.workunit.client.1.smithi098.stdout:2/730: write d6/dc/d2b/d42/d51/d79/da3/fcd [55135,45087] 0 2023-01-04T18:16:34.985 INFO:tasks.workunit.client.1.smithi098.stdout:3/810: dwrite d6/d10/fbf [4194304,4194304] 0 2023-01-04T18:16:34.985 INFO:tasks.workunit.client.1.smithi098.stdout:3/811: fsync d6/d10/d19/d3f/d5e/d7d/dec/dda/f112 0 2023-01-04T18:16:34.985 INFO:tasks.workunit.client.1.smithi098.stdout:0/744: dwrite df/d17/fcd [0,4194304] 0 2023-01-04T18:16:34.986 INFO:tasks.workunit.client.1.smithi098.stdout:5/744: rename d1/da/d44/d45/f5b to d1/d2/d14/da1/fe6 0 2023-01-04T18:16:34.987 INFO:tasks.workunit.client.1.smithi098.stdout:5/745: dread d1/f18 [4194304,4194304] 0 2023-01-04T18:16:34.993 INFO:tasks.workunit.client.1.smithi098.stdout:2/731: dread d6/dc/d4b/d89/f8e [0,4194304] 0 2023-01-04T18:16:34.993 INFO:tasks.workunit.client.1.smithi098.stdout:3/812: getdents d6/d10/d19/d3f/d5e/d7d/dec 0 2023-01-04T18:16:34.995 INFO:tasks.workunit.client.1.smithi098.stdout:5/746: mkdir d1/d1e/de7 0 2023-01-04T18:16:34.995 INFO:tasks.workunit.client.1.smithi098.stdout:3/813: write d6/d10/d19/d3f/d5e/d7d/dec/dda/f112 [3713493,1250] 0 2023-01-04T18:16:34.996 INFO:tasks.workunit.client.1.smithi098.stdout:2/732: creat d6/dc/d2b/d42/d47/d35/dca/ffb x:0 0 0 2023-01-04T18:16:34.997 INFO:tasks.workunit.client.1.smithi098.stdout:5/747: rename d1/d2f/d66/fb1 to d1/d2f/d66/d75/da5/fe8 0 2023-01-04T18:16:34.998 INFO:tasks.workunit.client.1.smithi098.stdout:5/748: chown d1/da/d44/d45 985162937 1 2023-01-04T18:16:34.998 INFO:tasks.workunit.client.1.smithi098.stdout:7/743: dwrite d1/d4/d11/d9d/dd0/ff4 [0,4194304] 0 2023-01-04T18:16:34.999 INFO:tasks.workunit.client.1.smithi098.stdout:3/814: read d6/f21 [1638292,83276] 0 2023-01-04T18:16:35.000 INFO:tasks.workunit.client.1.smithi098.stdout:2/733: rename d6/dc/d2b/d42/d47/d1f/d39/d6e/le7 to d6/dc/d2b/d42/d47/d1f/d82/lfc 0 2023-01-04T18:16:35.000 INFO:tasks.workunit.client.1.smithi098.stdout:5/749: rmdir d1/d2/d14/d59 39 2023-01-04T18:16:35.001 INFO:tasks.workunit.client.1.smithi098.stdout:0/745: dread df/d17/d24/f25 [0,4194304] 0 2023-01-04T18:16:35.003 INFO:tasks.workunit.client.1.smithi098.stdout:7/744: mknod d1/d23/d73/dba/c104 0 2023-01-04T18:16:35.003 INFO:tasks.workunit.client.1.smithi098.stdout:7/745: readlink d1/dc1/lfc 0 2023-01-04T18:16:35.003 INFO:tasks.workunit.client.1.smithi098.stdout:7/746: truncate d1/d51/d26/f8c 144774 0 2023-01-04T18:16:35.004 INFO:tasks.workunit.client.1.smithi098.stdout:4/722: dwrite d5/d28/da6/ff3 [0,4194304] 0 2023-01-04T18:16:35.004 INFO:tasks.workunit.client.1.smithi098.stdout:7/747: read d1/d51/f89 [122624,96841] 0 2023-01-04T18:16:35.004 INFO:tasks.workunit.client.1.smithi098.stdout:7/748: fsync d1/d23/d21/d43/f9e 0 2023-01-04T18:16:35.004 INFO:tasks.workunit.client.1.smithi098.stdout:7/749: write d1/d23/d21/d7f/fd1 [279875,79168] 0 2023-01-04T18:16:35.004 INFO:tasks.workunit.client.1.smithi098.stdout:7/750: fdatasync d1/d4/d11/d9d/dd2/fd8 0 2023-01-04T18:16:35.004 INFO:tasks.workunit.client.1.smithi098.stdout:7/751: write d1/d51/d26/d28/d8d/fac [465422,34541] 0 2023-01-04T18:16:35.005 INFO:tasks.workunit.client.1.smithi098.stdout:7/752: truncate d1/d51/d26/d28/f88 4784689 0 2023-01-04T18:16:35.005 INFO:tasks.workunit.client.1.smithi098.stdout:7/753: truncate d1/d4/d11/d9d/ffb 894570 0 2023-01-04T18:16:35.005 INFO:tasks.workunit.client.1.smithi098.stdout:6/756: dwrite d9/dd/d24/d3e/f55 [0,4194304] 0 2023-01-04T18:16:35.005 INFO:tasks.workunit.client.1.smithi098.stdout:3/815: unlink d6/d10/db7/de1/cf9 0 2023-01-04T18:16:35.006 INFO:tasks.workunit.client.1.smithi098.stdout:1/646: dwrite d1/d25/d6a/f6b [0,4194304] 0 2023-01-04T18:16:35.007 INFO:tasks.workunit.client.1.smithi098.stdout:2/734: link d6/dc/d2b/d42/d47/d35/f72 d6/dc/d2b/d42/d51/d79/ffd 0 2023-01-04T18:16:35.010 INFO:tasks.workunit.client.1.smithi098.stdout:5/750: mkdir d1/d2f/d73/de9 0 2023-01-04T18:16:35.012 INFO:tasks.workunit.client.1.smithi098.stdout:4/723: write d5/de/d21/f41 [3475892,23171] 0 2023-01-04T18:16:35.012 INFO:tasks.workunit.client.1.smithi098.stdout:4/724: stat d5/de/d21 0 2023-01-04T18:16:35.017 INFO:tasks.workunit.client.1.smithi098.stdout:2/735: dread d6/dc/f8c [0,4194304] 0 2023-01-04T18:16:35.018 INFO:tasks.workunit.client.1.smithi098.stdout:7/754: mkdir d1/d23/d73/d85/dfd/d105 0 2023-01-04T18:16:35.019 INFO:tasks.workunit.client.1.smithi098.stdout:0/746: dwrite f5 [0,4194304] 0 2023-01-04T18:16:35.019 INFO:tasks.workunit.client.1.smithi098.stdout:0/747: stat df/d17/d24/l7c 0 2023-01-04T18:16:35.026 INFO:tasks.workunit.client.1.smithi098.stdout:3/816: creat d6/d10/d19/d3f/d5e/d7d/d116/f11f x:0 0 0 2023-01-04T18:16:35.026 INFO:tasks.workunit.client.1.smithi098.stdout:3/817: stat d6/d10/d19/d3f/d5e/d7d/dec/fbb 0 2023-01-04T18:16:35.027 INFO:tasks.workunit.client.1.smithi098.stdout:3/818: write d6/d10/d19/d3f/d5e/d74/f52 [1806419,22258] 0 2023-01-04T18:16:35.030 INFO:tasks.workunit.client.1.smithi098.stdout:0/748: dread df/d17/d1c/d3b/d98/f69 [0,4194304] 0 2023-01-04T18:16:35.030 INFO:tasks.workunit.client.1.smithi098.stdout:0/749: chown df/d17/d68/c6f 11407162 1 2023-01-04T18:16:35.033 INFO:tasks.workunit.client.1.smithi098.stdout:1/647: rename d1/d25/d39/l43 to d1/d8/dac/le1 0 2023-01-04T18:16:35.034 INFO:tasks.workunit.client.1.smithi098.stdout:2/736: dwrite d6/ded/ff4 [0,4194304] 0 2023-01-04T18:16:35.041 INFO:tasks.workunit.client.1.smithi098.stdout:5/751: dread d1/d1e/fc0 [0,4194304] 0 2023-01-04T18:16:35.043 INFO:tasks.workunit.client.1.smithi098.stdout:5/752: dread d1/d1e/dab/fb3 [0,4194304] 0 2023-01-04T18:16:35.043 INFO:tasks.workunit.client.1.smithi098.stdout:4/725: rmdir d5/d28/d40/d5d 39 2023-01-04T18:16:35.043 INFO:tasks.workunit.client.1.smithi098.stdout:4/726: dread - d5/d28/d44/fc4 zero size 2023-01-04T18:16:35.043 INFO:tasks.workunit.client.1.smithi098.stdout:0/750: dwrite df/d17/d1c/f3a [0,4194304] 0 2023-01-04T18:16:35.044 INFO:tasks.workunit.client.1.smithi098.stdout:7/755: symlink d1/d23/d21/l106 0 2023-01-04T18:16:35.050 INFO:tasks.workunit.client.1.smithi098.stdout:3/819: mkdir d6/d56/d9f/da8/dfd/d120 0 2023-01-04T18:16:35.051 INFO:tasks.workunit.client.1.smithi098.stdout:1/648: truncate d1/fc 2232649 0 2023-01-04T18:16:35.052 INFO:tasks.workunit.client.1.smithi098.stdout:1/649: write d1/d25/d27/d77/f8f [786673,36243] 0 2023-01-04T18:16:35.052 INFO:tasks.workunit.client.1.smithi098.stdout:1/650: readlink d1/d8/da/l47 0 2023-01-04T18:16:35.053 INFO:tasks.workunit.client.1.smithi098.stdout:2/737: symlink d6/dc/d2b/d42/d47/d1f/lfe 0 2023-01-04T18:16:35.053 INFO:tasks.workunit.client.1.smithi098.stdout:2/738: stat d6/dc/d2b/d42/d47/da5/cd1 0 2023-01-04T18:16:35.054 INFO:tasks.workunit.client.1.smithi098.stdout:5/753: mknod d1/d38/d3b/d8f/cea 0 2023-01-04T18:16:35.054 INFO:tasks.workunit.client.1.smithi098.stdout:5/754: dread - d1/da/d44/d80/dc6/fca zero size 2023-01-04T18:16:35.054 INFO:tasks.workunit.client.1.smithi098.stdout:2/739: write d6/dc/d2b/d42/d47/d35/f38 [206568,28041] 0 2023-01-04T18:16:35.056 INFO:tasks.workunit.client.1.smithi098.stdout:4/727: creat d5/d28/d40/d5d/ff4 x:0 0 0 2023-01-04T18:16:35.056 INFO:tasks.workunit.client.1.smithi098.stdout:4/728: write d5/de/f5a [1761244,55489] 0 2023-01-04T18:16:35.057 INFO:tasks.workunit.client.1.smithi098.stdout:4/729: dread - d5/dad/d83/fb8 zero size 2023-01-04T18:16:35.059 INFO:tasks.workunit.client.1.smithi098.stdout:0/751: creat df/d17/d1c/d2c/d41/d4a/d4c/d5f/ffe x:0 0 0 2023-01-04T18:16:35.060 INFO:tasks.workunit.client.1.smithi098.stdout:0/752: write df/f3e [1581446,106321] 0 2023-01-04T18:16:35.061 INFO:tasks.workunit.client.1.smithi098.stdout:6/757: rmdir d9/dd/de/d26/d71/db0 0 2023-01-04T18:16:35.062 INFO:tasks.workunit.client.1.smithi098.stdout:3/820: mkdir d6/d10/d19/d3f/d5e/d74/d121 0 2023-01-04T18:16:35.066 INFO:tasks.workunit.client.1.smithi098.stdout:1/651: rmdir d1/d88 39 2023-01-04T18:16:35.066 INFO:tasks.workunit.client.1.smithi098.stdout:1/652: dread - d1/d88/fcf zero size 2023-01-04T18:16:35.069 INFO:tasks.workunit.client.1.smithi098.stdout:2/740: creat d6/dc/d4b/fff x:0 0 0 2023-01-04T18:16:35.070 INFO:tasks.workunit.client.1.smithi098.stdout:4/730: mknod d5/d28/d7d/db6/dbd/dc5/cf5 0 2023-01-04T18:16:35.072 INFO:tasks.workunit.client.1.smithi098.stdout:3/821: truncate d6/d10/d19/d3f/d5e/d7d/d90/f93 389586 0 2023-01-04T18:16:35.074 INFO:tasks.workunit.client.1.smithi098.stdout:1/653: creat d1/d25/d36/d4e/d9f/dd7/fe2 x:0 0 0 2023-01-04T18:16:35.074 INFO:tasks.workunit.client.1.smithi098.stdout:1/654: readlink d1/d25/d36/d89/l9e 0 2023-01-04T18:16:35.075 INFO:tasks.workunit.client.1.smithi098.stdout:2/741: rename d6/dc/d2b/d42/d51/de1/cfa to d6/dc/d2b/c100 0 2023-01-04T18:16:35.076 INFO:tasks.workunit.client.1.smithi098.stdout:2/742: chown d6/f8 125 1 2023-01-04T18:16:35.076 INFO:tasks.workunit.client.1.smithi098.stdout:4/731: truncate d5/dad/f99 590230 0 2023-01-04T18:16:35.077 INFO:tasks.workunit.client.1.smithi098.stdout:3/822: creat d6/d56/f122 x:0 0 0 2023-01-04T18:16:35.077 INFO:tasks.workunit.client.1.smithi098.stdout:3/823: fdatasync d6/d6f/f91 0 2023-01-04T18:16:35.078 INFO:tasks.workunit.client.1.smithi098.stdout:1/655: mkdir d1/da9/de3 0 2023-01-04T18:16:35.078 INFO:tasks.workunit.client.1.smithi098.stdout:3/824: write d6/d10/d19/d3f/d5e/d74/f48 [160471,125178] 0 2023-01-04T18:16:35.080 INFO:tasks.workunit.client.1.smithi098.stdout:2/743: rmdir d6/dc/d2b/d42/d51/d81/d8f/de8 39 2023-01-04T18:16:35.080 INFO:tasks.workunit.client.1.smithi098.stdout:2/744: fdatasync d6/ded/ff4 0 2023-01-04T18:16:35.080 INFO:tasks.workunit.client.1.smithi098.stdout:1/656: mknod d1/d25/d36/d89/ce4 0 2023-01-04T18:16:35.081 INFO:tasks.workunit.client.1.smithi098.stdout:2/745: link d6/dc/d2b/d42/d47/d1f/f7a d6/dc/d2b/d46/f101 0 2023-01-04T18:16:35.083 INFO:tasks.workunit.client.1.smithi098.stdout:2/746: symlink d6/l102 0 2023-01-04T18:16:35.101 INFO:tasks.workunit.client.1.smithi098.stdout:2/747: write d6/f20 [2815567,127044] 0 2023-01-04T18:16:35.102 INFO:tasks.workunit.client.1.smithi098.stdout:2/748: mkdir d6/dc/d2b/d42/d47/d35/dca/d103 0 2023-01-04T18:16:35.103 INFO:tasks.workunit.client.1.smithi098.stdout:2/749: symlink d6/dc/d2b/d42/d51/de1/l104 0 2023-01-04T18:16:35.103 INFO:tasks.workunit.client.1.smithi098.stdout:3/825: dread d6/d10/d19/f3a [0,4194304] 0 2023-01-04T18:16:35.104 INFO:tasks.workunit.client.1.smithi098.stdout:3/826: write d6/d6f/db6/feb [1256124,20324] 0 2023-01-04T18:16:35.105 INFO:tasks.workunit.client.1.smithi098.stdout:3/827: mknod d6/d10/d19/d3f/d46/c123 0 2023-01-04T18:16:35.107 INFO:tasks.workunit.client.1.smithi098.stdout:3/828: link d6/f1c d6/d10/d19/d3f/d46/f124 0 2023-01-04T18:16:35.107 INFO:tasks.workunit.client.1.smithi098.stdout:3/829: chown d6/f6c 48539456 1 2023-01-04T18:16:35.109 INFO:tasks.workunit.client.1.smithi098.stdout:3/830: rename d6/l9a to d6/d10/df8/l125 0 2023-01-04T18:16:35.110 INFO:tasks.workunit.client.1.smithi098.stdout:3/831: symlink d6/d10/d19/d3f/d5e/d74/d121/l126 0 2023-01-04T18:16:35.110 INFO:tasks.workunit.client.1.smithi098.stdout:3/832: fdatasync d6/d10/d29/fd5 0 2023-01-04T18:16:35.110 INFO:tasks.workunit.client.1.smithi098.stdout:3/833: write d6/d10/d19/f76 [686401,38861] 0 2023-01-04T18:16:35.110 INFO:tasks.workunit.client.1.smithi098.stdout:3/834: chown d6/d56/d9f/da8/dfd 0 1 2023-01-04T18:16:35.111 INFO:tasks.workunit.client.1.smithi098.stdout:3/835: creat d6/d10/d19/d3f/d5e/d7d/dec/f127 x:0 0 0 2023-01-04T18:16:35.114 INFO:tasks.workunit.client.1.smithi098.stdout:3/836: rmdir d6/d10/d19/d3f/d5e/dd4 0 2023-01-04T18:16:35.117 INFO:tasks.workunit.client.1.smithi098.stdout:3/837: dread d6/d10/d19/f3a [0,4194304] 0 2023-01-04T18:16:35.118 INFO:tasks.workunit.client.1.smithi098.stdout:3/838: dread d6/d6f/faa [0,4194304] 0 2023-01-04T18:16:35.118 INFO:tasks.workunit.client.1.smithi098.stdout:3/839: symlink d6/l128 0 2023-01-04T18:16:35.119 INFO:tasks.workunit.client.1.smithi098.stdout:3/840: dread d6/d6f/faa [0,4194304] 0 2023-01-04T18:16:35.120 INFO:tasks.workunit.client.1.smithi098.stdout:3/841: mkdir d6/d10/d29/d6a/dd1/d129 0 2023-01-04T18:16:35.121 INFO:tasks.workunit.client.1.smithi098.stdout:3/842: mknod d6/d10/d6b/d9e/c12a 0 2023-01-04T18:16:35.127 INFO:tasks.workunit.client.1.smithi098.stdout:6/758: dwrite d9/dd/d24/fcf [0,4194304] 0 2023-01-04T18:16:35.127 INFO:tasks.workunit.client.1.smithi098.stdout:1/657: dwrite d1/d25/fb9 [0,4194304] 0 2023-01-04T18:16:35.127 INFO:tasks.workunit.client.1.smithi098.stdout:0/753: dwrite df/d17/d68/fbf [4194304,4194304] 0 2023-01-04T18:16:35.127 INFO:tasks.workunit.client.1.smithi098.stdout:2/750: dwrite d6/dc/d2b/d42/d47/d35/f72 [0,4194304] 0 2023-01-04T18:16:35.127 INFO:tasks.workunit.client.1.smithi098.stdout:2/751: fdatasync d6/dc/d2b/fad 0 2023-01-04T18:16:35.130 INFO:tasks.workunit.client.1.smithi098.stdout:3/843: dread d6/d56/f92 [0,4194304] 0 2023-01-04T18:16:35.137 INFO:tasks.workunit.client.1.smithi098.stdout:6/759: creat d9/dd/d24/d3e/d86/fea x:0 0 0 2023-01-04T18:16:35.137 INFO:tasks.workunit.client.1.smithi098.stdout:6/760: truncate d9/dd/d4e/d67/d8d/da5/fdb 1161336 0 2023-01-04T18:16:35.137 INFO:tasks.workunit.client.1.smithi098.stdout:6/761: fsync d9/dd/d24/d3e/f9d 0 2023-01-04T18:16:35.141 INFO:tasks.workunit.client.1.smithi098.stdout:0/754: dread df/d17/d24/f44 [0,4194304] 0 2023-01-04T18:16:35.141 INFO:tasks.workunit.client.1.smithi098.stdout:0/755: fsync df/d17/d24/f57 0 2023-01-04T18:16:35.142 INFO:tasks.workunit.client.1.smithi098.stdout:1/658: dread d1/d8/d53/f73 [0,4194304] 0 2023-01-04T18:16:35.142 INFO:tasks.workunit.client.1.smithi098.stdout:1/659: write d1/d25/d36/d4e/d6e/f7f [200109,90315] 0 2023-01-04T18:16:35.142 INFO:tasks.workunit.client.1.smithi098.stdout:1/660: readlink d1/d8/l26 0 2023-01-04T18:16:35.142 INFO:tasks.workunit.client.1.smithi098.stdout:1/661: write d1/d25/d36/f50 [1680346,99987] 0 2023-01-04T18:16:35.174 INFO:tasks.workunit.client.1.smithi098.stdout:2/752: mknod d6/dc/d2b/d42/d47/d35/dca/d103/c105 0 2023-01-04T18:16:35.176 INFO:tasks.workunit.client.1.smithi098.stdout:9/753: sync 2023-01-04T18:16:35.176 INFO:tasks.workunit.client.1.smithi098.stdout:8/763: sync 2023-01-04T18:16:35.176 INFO:tasks.workunit.client.1.smithi098.stdout:9/754: dread - d2/d5/d18/d4e/d42/fe0 zero size 2023-01-04T18:16:35.197 INFO:tasks.workunit.client.1.smithi098.stdout:9/755: dwrite d2/d5/d18/d1d/d23/d5c/f95 [0,4194304] 0 2023-01-04T18:16:35.197 INFO:tasks.workunit.client.1.smithi098.stdout:9/756: chown d2/d5/d6f/ff4 16662 1 2023-01-04T18:16:35.198 INFO:tasks.workunit.client.1.smithi098.stdout:8/764: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/f88 [0,4194304] 0 2023-01-04T18:16:35.217 INFO:tasks.workunit.client.1.smithi098.stdout:3/844: link d6/d10/df8/l125 d6/d10/d19/d3f/d5e/d7d/l12b 0 2023-01-04T18:16:35.218 INFO:tasks.workunit.client.1.smithi098.stdout:6/762: symlink d9/dda/dde/leb 0 2023-01-04T18:16:35.218 INFO:tasks.workunit.client.1.smithi098.stdout:0/756: mkdir df/dff 0 2023-01-04T18:16:35.219 INFO:tasks.workunit.client.1.smithi098.stdout:1/662: creat d1/d25/d39/dd9/fe5 x:0 0 0 2023-01-04T18:16:35.222 INFO:tasks.workunit.client.1.smithi098.stdout:9/757: dwrite f1 [12582912,4194304] 0 2023-01-04T18:16:35.224 INFO:tasks.workunit.client.1.smithi098.stdout:8/765: rename d6/d11/d15/d1b/d2a/dae/db8 to d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d64/de8 0 2023-01-04T18:16:35.225 INFO:tasks.workunit.client.1.smithi098.stdout:3/845: getdents d6/d10/d6b/d9e 0 2023-01-04T18:16:35.225 INFO:tasks.workunit.client.1.smithi098.stdout:3/846: fsync d6/d10/d19/d3f/d46/f124 0 2023-01-04T18:16:35.226 INFO:tasks.workunit.client.1.smithi098.stdout:3/847: dread - d6/d10/d6b/f8d zero size 2023-01-04T18:16:35.227 INFO:tasks.workunit.client.1.smithi098.stdout:0/757: unlink df/d17/d1c/d2c/d41/d64/fc0 0 2023-01-04T18:16:35.227 INFO:tasks.workunit.client.1.smithi098.stdout:0/758: write df/d17/d1c/d3b/fec [128675,82993] 0 2023-01-04T18:16:35.228 INFO:tasks.workunit.client.1.smithi098.stdout:1/663: link d1/d8/da/f48 d1/d25/d27/d77/da8/fe6 0 2023-01-04T18:16:35.228 INFO:tasks.workunit.client.1.smithi098.stdout:1/664: write d1/d8/da/dae/f8a [408510,25041] 0 2023-01-04T18:16:35.229 INFO:tasks.workunit.client.1.smithi098.stdout:6/763: dread d9/dd/de/d7e/fd3 [0,4194304] 0 2023-01-04T18:16:35.230 INFO:tasks.workunit.client.1.smithi098.stdout:2/753: mkdir d6/dc/d2b/d42/d47/d106 0 2023-01-04T18:16:35.232 INFO:tasks.workunit.client.1.smithi098.stdout:6/764: write d9/fca [1635844,79921] 0 2023-01-04T18:16:35.234 INFO:tasks.workunit.client.1.smithi098.stdout:9/758: link d2/c49 d2/d5/d18/d4e/d42/d89/cf9 0 2023-01-04T18:16:35.237 INFO:tasks.workunit.client.1.smithi098.stdout:8/766: creat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d64/fe9 x:0 0 0 2023-01-04T18:16:35.238 INFO:tasks.workunit.client.1.smithi098.stdout:5/755: sync 2023-01-04T18:16:35.238 INFO:tasks.workunit.client.1.smithi098.stdout:4/732: sync 2023-01-04T18:16:35.238 INFO:tasks.workunit.client.1.smithi098.stdout:7/756: sync 2023-01-04T18:16:35.238 INFO:tasks.workunit.client.1.smithi098.stdout:0/759: link df/d17/d1c/d2c/dba/lc6 df/dfa/l100 0 2023-01-04T18:16:35.240 INFO:tasks.workunit.client.1.smithi098.stdout:3/848: dwrite d6/d6f/faa [0,4194304] 0 2023-01-04T18:16:35.244 INFO:tasks.workunit.client.1.smithi098.stdout:1/665: link d1/d8/da/dae/l51 d1/da9/de3/le7 0 2023-01-04T18:16:35.247 INFO:tasks.workunit.client.1.smithi098.stdout:2/754: rename d6/dc/d4b/d89 to d6/dc/d2b/d42/d47/d1f/d39/d6e/d107 0 2023-01-04T18:16:35.247 INFO:tasks.workunit.client.1.smithi098.stdout:0/760: dread df/d17/d9b/d5c/f96 [0,4194304] 0 2023-01-04T18:16:35.248 INFO:tasks.workunit.client.1.smithi098.stdout:6/765: mknod d9/dd/d4e/d67/d8d/d81/dc5/cec 0 2023-01-04T18:16:35.249 INFO:tasks.workunit.client.1.smithi098.stdout:6/766: truncate d9/dd/d24/d3e/fe8 568963 0 2023-01-04T18:16:35.249 INFO:tasks.workunit.client.1.smithi098.stdout:5/756: getdents d1/d1e/dab 0 2023-01-04T18:16:35.249 INFO:tasks.workunit.client.1.smithi098.stdout:5/757: fdatasync d1/f6b 0 2023-01-04T18:16:35.250 INFO:tasks.workunit.client.1.smithi098.stdout:7/757: getdents d1/d23/d21 0 2023-01-04T18:16:35.250 INFO:tasks.workunit.client.1.smithi098.stdout:7/758: write d1/d23/f100 [961489,119509] 0 2023-01-04T18:16:35.252 INFO:tasks.workunit.client.1.smithi098.stdout:3/849: creat d6/d10/d19/d3f/d5e/d74/d121/f12c x:0 0 0 2023-01-04T18:16:35.254 INFO:tasks.workunit.client.1.smithi098.stdout:2/755: symlink d6/dc/d2b/d42/d47/d35/l108 0 2023-01-04T18:16:35.255 INFO:tasks.workunit.client.1.smithi098.stdout:6/767: symlink d9/dd/de/d44/led 0 2023-01-04T18:16:35.256 INFO:tasks.workunit.client.1.smithi098.stdout:6/768: chown d9/dd/d4e/f4f 3785 1 2023-01-04T18:16:35.256 INFO:tasks.workunit.client.1.smithi098.stdout:6/769: fsync d9/dd/d24/d3e/d86/fdd 0 2023-01-04T18:16:35.256 INFO:tasks.workunit.client.1.smithi098.stdout:6/770: chown d9/dd/de/d44/d7a 40 1 2023-01-04T18:16:35.256 INFO:tasks.workunit.client.1.smithi098.stdout:8/767: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/d12/f48 [0,4194304] 0 2023-01-04T18:16:35.256 INFO:tasks.workunit.client.1.smithi098.stdout:6/771: write d9/dd/d15/f5f [1325345,65835] 0 2023-01-04T18:16:35.257 INFO:tasks.workunit.client.1.smithi098.stdout:8/768: chown d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/c4e 30 1 2023-01-04T18:16:35.257 INFO:tasks.workunit.client.1.smithi098.stdout:5/758: link d1/d2/fd7 d1/da/d44/d80/feb 0 2023-01-04T18:16:35.258 INFO:tasks.workunit.client.1.smithi098.stdout:9/759: rename d2/d5/d18/d4e to d2/d5/d18/d1d/d23/dad/dfa 0 2023-01-04T18:16:35.260 INFO:tasks.workunit.client.1.smithi098.stdout:7/759: dread d1/d2e/f39 [0,4194304] 0 2023-01-04T18:16:35.260 INFO:tasks.workunit.client.1.smithi098.stdout:3/850: mkdir d6/d6f/d9b/d12d 0 2023-01-04T18:16:35.262 INFO:tasks.workunit.client.1.smithi098.stdout:2/756: creat d6/dc/d2b/d42/d51/f109 x:0 0 0 2023-01-04T18:16:35.263 INFO:tasks.workunit.client.1.smithi098.stdout:9/760: dread d2/df6/d26/d41/f43 [0,4194304] 0 2023-01-04T18:16:35.263 INFO:tasks.workunit.client.1.smithi098.stdout:9/761: stat d2/d5/d18/d1d/d23/dad/d72/d9e/dca/df5/fc3 0 2023-01-04T18:16:35.263 INFO:tasks.workunit.client.1.smithi098.stdout:9/762: fdatasync d2/df6/d26/f9a 0 2023-01-04T18:16:35.265 INFO:tasks.workunit.client.1.smithi098.stdout:6/772: mknod d9/dd/de/d20/cee 0 2023-01-04T18:16:35.266 INFO:tasks.workunit.client.1.smithi098.stdout:8/769: creat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/fea x:0 0 0 2023-01-04T18:16:35.266 INFO:tasks.workunit.client.1.smithi098.stdout:5/759: mkdir d1/da/d44/d45/d4b/dec 0 2023-01-04T18:16:35.268 INFO:tasks.workunit.client.1.smithi098.stdout:4/733: rename d5/de/d2c/f7f to d5/d28/d7d/db6/dbd/dc5/ff6 0 2023-01-04T18:16:35.268 INFO:tasks.workunit.client.1.smithi098.stdout:3/851: rename d6/d10/d19/d3f to d6/d10/d19/d3f/d5e/d7d/dec/d12e 22 2023-01-04T18:16:35.268 INFO:tasks.workunit.client.1.smithi098.stdout:3/852: chown d6/d10/d19/d3f/d5e/d7d/dec/f127 208173 1 2023-01-04T18:16:35.271 INFO:tasks.workunit.client.1.smithi098.stdout:7/760: symlink d1/d23/d37/d40/l107 0 2023-01-04T18:16:35.272 INFO:tasks.workunit.client.1.smithi098.stdout:2/757: mkdir d6/dc/d2b/d32/d10a 0 2023-01-04T18:16:35.272 INFO:tasks.workunit.client.1.smithi098.stdout:2/758: chown d6/dc/d2b/d42/d51/f109 21736069 1 2023-01-04T18:16:35.273 INFO:tasks.workunit.client.1.smithi098.stdout:9/763: creat d2/d5/d18/d19/ffb x:0 0 0 2023-01-04T18:16:35.275 INFO:tasks.workunit.client.1.smithi098.stdout:6/773: mknod d9/dd/de/d20/d82/d84/d8a/cef 0 2023-01-04T18:16:35.276 INFO:tasks.workunit.client.1.smithi098.stdout:8/770: creat d6/d11/d15/d1b/d2a/d6b/d7f/d78/d9d/feb x:0 0 0 2023-01-04T18:16:35.278 INFO:tasks.workunit.client.1.smithi098.stdout:5/760: mknod d1/d1e/dab/ced 0 2023-01-04T18:16:35.278 INFO:tasks.workunit.client.1.smithi098.stdout:5/761: stat d1/d38/f41 0 2023-01-04T18:16:35.279 INFO:tasks.workunit.client.1.smithi098.stdout:3/853: symlink d6/d10/db7/l12f 0 2023-01-04T18:16:35.283 INFO:tasks.workunit.client.1.smithi098.stdout:7/761: creat d1/d4/d11/d9d/dd0/f108 x:0 0 0 2023-01-04T18:16:35.285 INFO:tasks.workunit.client.1.smithi098.stdout:9/764: creat d2/d5/d18/d1d/d23/d5c/ffc x:0 0 0 2023-01-04T18:16:35.286 INFO:tasks.workunit.client.1.smithi098.stdout:5/762: getdents d1/d38/dce 0 2023-01-04T18:16:35.286 INFO:tasks.workunit.client.1.smithi098.stdout:4/734: dwrite d5/d28/d40/d5d/f97 [0,4194304] 0 2023-01-04T18:16:35.287 INFO:tasks.workunit.client.1.smithi098.stdout:3/854: creat d6/d10/db7/f130 x:0 0 0 2023-01-04T18:16:35.288 INFO:tasks.workunit.client.1.smithi098.stdout:7/762: unlink d1/d23/d21/ff2 0 2023-01-04T18:16:35.289 INFO:tasks.workunit.client.1.smithi098.stdout:9/765: creat d2/d5/d18/d1d/d23/dad/dfa/d42/d89/ffd x:0 0 0 2023-01-04T18:16:35.289 INFO:tasks.workunit.client.1.smithi098.stdout:9/766: write d2/d5/d18/d1d/f71 [5067075,11925] 0 2023-01-04T18:16:35.289 INFO:tasks.workunit.client.1.smithi098.stdout:7/763: dread d1/f7a [0,4194304] 0 2023-01-04T18:16:35.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:33.913792+0000 mgr.smithi098.vhfzum (mgr.24455) 20 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 882 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 56 MiB/s rd, 100 MiB/s wr, 555 op/s 2023-01-04T18:16:35.290 INFO:tasks.workunit.client.1.smithi098.stdout:5/763: creat d1/d1e/dab/dd5/fee x:0 0 0 2023-01-04T18:16:35.291 INFO:tasks.workunit.client.1.smithi098.stdout:4/735: truncate d5/de/f88 197277 0 2023-01-04T18:16:35.293 INFO:tasks.workunit.client.1.smithi098.stdout:3/855: unlink d6/c1d 0 2023-01-04T18:16:35.295 INFO:tasks.workunit.client.1.smithi098.stdout:9/767: creat d2/d5/d18/d1d/d23/dad/dfa/d42/d89/dcb/ffe x:0 0 0 2023-01-04T18:16:35.295 INFO:tasks.workunit.client.1.smithi098.stdout:9/768: chown d2/d5/d18/d19/f3b 115024 1 2023-01-04T18:16:35.295 INFO:tasks.workunit.client.1.smithi098.stdout:9/769: dread - d2/d2d/fbd zero size 2023-01-04T18:16:35.296 INFO:tasks.workunit.client.1.smithi098.stdout:5/764: mknod d1/da/d44/d45/d4b/cef 0 2023-01-04T18:16:35.296 INFO:tasks.workunit.client.1.smithi098.stdout:9/770: write d2/d5/d18/d1d/d23/f8c [1878155,67568] 0 2023-01-04T18:16:35.303 INFO:tasks.workunit.client.1.smithi098.stdout:3/856: creat d6/d56/d9f/da8/dfd/f131 x:0 0 0 2023-01-04T18:16:35.303 INFO:tasks.workunit.client.1.smithi098.stdout:3/857: fsync d6/d10/d19/d3f/d5e/f67 0 2023-01-04T18:16:35.305 INFO:tasks.workunit.client.1.smithi098.stdout:3/858: getdents d6/d10/d19/d3f/d5e/d7d/d90 0 2023-01-04T18:16:35.307 INFO:tasks.workunit.client.1.smithi098.stdout:3/859: unlink d6/d10/d19/d3f/d5e/d7d/dec/fc4 0 2023-01-04T18:16:35.308 INFO:tasks.workunit.client.1.smithi098.stdout:5/765: dread d1/da/f77 [0,4194304] 0 2023-01-04T18:16:35.309 INFO:tasks.workunit.client.1.smithi098.stdout:3/860: truncate d6/f54 519192 0 2023-01-04T18:16:35.309 INFO:tasks.workunit.client.1.smithi098.stdout:3/861: readlink d6/l43 0 2023-01-04T18:16:35.309 INFO:tasks.workunit.client.1.smithi098.stdout:3/862: chown d6/d56/d9f/da8/dfd/d120 115 1 2023-01-04T18:16:35.309 INFO:tasks.workunit.client.1.smithi098.stdout:3/863: write d6/d10/d19/d3f/d5e/d7d/ffc [756951,19055] 0 2023-01-04T18:16:35.309 INFO:tasks.workunit.client.1.smithi098.stdout:3/864: creat d6/d56/d9f/da8/dfd/f132 x:0 0 0 2023-01-04T18:16:35.310 INFO:tasks.workunit.client.1.smithi098.stdout:5/766: read d1/d38/f41 [1360523,93712] 0 2023-01-04T18:16:35.311 INFO:tasks.workunit.client.1.smithi098.stdout:5/767: mknod d1/d2f/d66/d75/da5/cf0 0 2023-01-04T18:16:35.311 INFO:tasks.workunit.client.1.smithi098.stdout:5/768: stat d1/d2/d14/fad 0 2023-01-04T18:16:35.312 INFO:tasks.workunit.client.1.smithi098.stdout:5/769: creat d1/d46/dc4/ff1 x:0 0 0 2023-01-04T18:16:35.312 INFO:tasks.workunit.client.1.smithi098.stdout:5/770: truncate d1/f6f 3175719 0 2023-01-04T18:16:35.314 INFO:tasks.workunit.client.1.smithi098.stdout:5/771: creat d1/da/d44/ff2 x:0 0 0 2023-01-04T18:16:35.314 INFO:tasks.workunit.client.1.smithi098.stdout:5/772: stat d1/d2/d14/d19/lc9 0 2023-01-04T18:16:35.317 INFO:tasks.workunit.client.1.smithi098.stdout:4/736: dwrite d5/d28/da6/ff3 [4194304,4194304] 0 2023-01-04T18:16:35.318 INFO:tasks.workunit.client.1.smithi098.stdout:9/771: dwrite d2/d5/d18/d19/ffb [0,4194304] 0 2023-01-04T18:16:35.318 INFO:tasks.workunit.client.1.smithi098.stdout:3/865: dread d6/d6f/db6/feb [0,4194304] 0 2023-01-04T18:16:35.318 INFO:tasks.workunit.client.1.smithi098.stdout:3/866: truncate d6/d56/d9f/da8/dfd/f132 1010807 0 2023-01-04T18:16:35.319 INFO:tasks.workunit.client.1.smithi098.stdout:3/867: dread - d6/d10/d19/d3f/d5e/d74/fa6 zero size 2023-01-04T18:16:35.320 INFO:tasks.workunit.client.1.smithi098.stdout:5/773: dread d1/da/d44/d45/d4b/d61/f86 [0,4194304] 0 2023-01-04T18:16:35.321 INFO:tasks.workunit.client.1.smithi098.stdout:4/737: rename d5/de/d2c/f53 to d5/d9/d90/ff7 0 2023-01-04T18:16:35.321 INFO:tasks.workunit.client.1.smithi098.stdout:4/738: getdents d5/de/d30 0 2023-01-04T18:16:35.327 INFO:tasks.workunit.client.1.smithi098.stdout:9/772: dread d2/df6/d26/d41/ff3 [4194304,4194304] 0 2023-01-04T18:16:35.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:33.913792+0000 mgr.smithi098.vhfzum (mgr.24455) 20 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 882 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 56 MiB/s rd, 100 MiB/s wr, 555 op/s 2023-01-04T18:16:35.331 INFO:tasks.workunit.client.1.smithi098.stdout:5/774: creat d1/d38/d3b/ff3 x:0 0 0 2023-01-04T18:16:35.333 INFO:tasks.workunit.client.1.smithi098.stdout:4/739: rename d5/de/d30/d4f/l55 to d5/lf8 0 2023-01-04T18:16:35.336 INFO:tasks.workunit.client.1.smithi098.stdout:9/773: mkdir d2/d53/daf/dff 0 2023-01-04T18:16:35.336 INFO:tasks.workunit.client.1.smithi098.stdout:9/774: fdatasync d2/df6/d26/fd9 0 2023-01-04T18:16:35.336 INFO:tasks.workunit.client.1.smithi098.stdout:9/775: fsync d2/d5/d18/d1d/d23/dad/dfa/d42/f64 0 2023-01-04T18:16:35.336 INFO:tasks.workunit.client.1.smithi098.stdout:5/775: truncate d1/da/d44/d45/f7c 3306702 0 2023-01-04T18:16:35.336 INFO:tasks.workunit.client.1.smithi098.stdout:5/776: fsync d1/d2f/d66/d75/fa0 0 2023-01-04T18:16:35.337 INFO:tasks.workunit.client.1.smithi098.stdout:4/740: mkdir d5/d28/d7d/ddb/df9 0 2023-01-04T18:16:35.337 INFO:tasks.workunit.client.1.smithi098.stdout:5/777: getdents d1 0 2023-01-04T18:16:35.339 INFO:tasks.workunit.client.1.smithi098.stdout:4/741: unlink d5/d28/d40/d5d/dcf/de9/cef 0 2023-01-04T18:16:35.339 INFO:tasks.workunit.client.1.smithi098.stdout:4/742: chown d5 790097996 1 2023-01-04T18:16:35.339 INFO:tasks.workunit.client.1.smithi098.stdout:4/743: chown d5/de/d21/d9d/fca 893761931 1 2023-01-04T18:16:35.340 INFO:tasks.workunit.client.1.smithi098.stdout:5/778: symlink d1/da/d44/d80/dbd/lf4 0 2023-01-04T18:16:35.340 INFO:tasks.workunit.client.1.smithi098.stdout:4/744: mkdir d5/d28/d7d/ddb/dfa 0 2023-01-04T18:16:35.340 INFO:tasks.workunit.client.1.smithi098.stdout:4/745: write d5/d9/d13/d65/fd2 [203648,1956] 0 2023-01-04T18:16:35.341 INFO:tasks.workunit.client.1.smithi098.stdout:5/779: link d1/d38/dce/lde d1/da/d44/d45/d4b/lf5 0 2023-01-04T18:16:35.342 INFO:tasks.workunit.client.1.smithi098.stdout:4/746: creat d5/d28/d40/d5d/dcf/ffb x:0 0 0 2023-01-04T18:16:35.350 INFO:tasks.workunit.client.1.smithi098.stdout:5/780: dread d1/da/d44/d45/d4b/f4f [0,4194304] 0 2023-01-04T18:16:35.350 INFO:tasks.workunit.client.1.smithi098.stdout:5/781: fdatasync d1/da/d44/d80/feb 0 2023-01-04T18:16:35.350 INFO:tasks.workunit.client.1.smithi098.stdout:5/782: chown d1/d2/d14/l21 1 1 2023-01-04T18:16:35.351 INFO:tasks.workunit.client.1.smithi098.stdout:5/783: write d1/d2/d14/d59/f71 [730295,12527] 0 2023-01-04T18:16:35.351 INFO:tasks.workunit.client.1.smithi098.stdout:5/784: read - d1/d2/f92 zero size 2023-01-04T18:16:35.352 INFO:tasks.workunit.client.1.smithi098.stdout:5/785: creat d1/d2f/d66/d75/da5/ff6 x:0 0 0 2023-01-04T18:16:35.353 INFO:tasks.workunit.client.1.smithi098.stdout:5/786: creat d1/db0/ddc/ff7 x:0 0 0 2023-01-04T18:16:35.353 INFO:tasks.workunit.client.1.smithi098.stdout:5/787: dread - d1/d2f/d66/fe0 zero size 2023-01-04T18:16:35.354 INFO:tasks.workunit.client.1.smithi098.stdout:5/788: link d1/da/f34 d1/da/d44/d80/dbd/ff8 0 2023-01-04T18:16:35.355 INFO:tasks.workunit.client.1.smithi098.stdout:5/789: write d1/f6 [825074,84082] 0 2023-01-04T18:16:35.355 INFO:tasks.workunit.client.1.smithi098.stdout:5/790: creat d1/d38/d3b/d8f/ff9 x:0 0 0 2023-01-04T18:16:35.357 INFO:tasks.workunit.client.1.smithi098.stdout:5/791: mkdir d1/da/d44/d45/d4b/dba/dfa 0 2023-01-04T18:16:35.357 INFO:tasks.workunit.client.1.smithi098.stdout:5/792: truncate d1/d2f/d66/d75/da5/fe4 445102 0 2023-01-04T18:16:35.357 INFO:tasks.workunit.client.1.smithi098.stdout:5/793: chown d1/d2/d14/d59/ca7 67358 1 2023-01-04T18:16:35.357 INFO:tasks.workunit.client.1.smithi098.stdout:5/794: stat d1/d2/d14/d59/ca7 0 2023-01-04T18:16:35.357 INFO:tasks.workunit.client.1.smithi098.stdout:5/795: creat d1/d2f/d73/ffb x:0 0 0 2023-01-04T18:16:35.359 INFO:tasks.workunit.client.1.smithi098.stdout:4/747: dwrite d5/d9/f3b [0,4194304] 0 2023-01-04T18:16:35.359 INFO:tasks.workunit.client.1.smithi098.stdout:4/748: stat d5/d28/d7d/db6/dbd/fd6 0 2023-01-04T18:16:35.360 INFO:tasks.workunit.client.1.smithi098.stdout:1/666: sync 2023-01-04T18:16:35.360 INFO:tasks.workunit.client.1.smithi098.stdout:0/761: sync 2023-01-04T18:16:35.360 INFO:tasks.workunit.client.1.smithi098.stdout:0/762: dread - df/d17/d1c/fb9 zero size 2023-01-04T18:16:35.361 INFO:tasks.workunit.client.1.smithi098.stdout:4/749: dread d5/d9/d90/ff7 [0,4194304] 0 2023-01-04T18:16:35.361 INFO:tasks.workunit.client.1.smithi098.stdout:4/750: chown d5/d28/d44/fda 1276 1 2023-01-04T18:16:35.361 INFO:tasks.workunit.client.1.smithi098.stdout:4/751: stat d5/d9/c8e 0 2023-01-04T18:16:35.364 INFO:tasks.workunit.client.1.smithi098.stdout:1/667: symlink d1/d25/ddb/le8 0 2023-01-04T18:16:35.364 INFO:tasks.workunit.client.1.smithi098.stdout:4/752: truncate d5/d9/d13/d65/d98/fa8 66744 0 2023-01-04T18:16:35.364 INFO:tasks.workunit.client.1.smithi098.stdout:0/763: dread df/d17/d1c/f47 [0,4194304] 0 2023-01-04T18:16:35.366 INFO:tasks.workunit.client.1.smithi098.stdout:1/668: getdents d1/d25/d39/dd9 0 2023-01-04T18:16:35.367 INFO:tasks.workunit.client.1.smithi098.stdout:0/764: rename df/c23 to df/d17/d9b/d5c/c101 0 2023-01-04T18:16:35.368 INFO:tasks.workunit.client.1.smithi098.stdout:1/669: mkdir d1/d25/d6a/de9 0 2023-01-04T18:16:35.369 INFO:tasks.workunit.client.1.smithi098.stdout:1/670: chown d1/d88/c7b 4528 1 2023-01-04T18:16:35.370 INFO:tasks.workunit.client.1.smithi098.stdout:0/765: creat df/d4f/dc7/df2/f102 x:0 0 0 2023-01-04T18:16:35.373 INFO:tasks.workunit.client.1.smithi098.stdout:4/753: dread d5/de/d21/d9d/f87 [0,4194304] 0 2023-01-04T18:16:35.373 INFO:tasks.workunit.client.1.smithi098.stdout:1/671: rename d1/d25/d36/d4e/d9f/db7 to d1/d8/dac/dea 0 2023-01-04T18:16:35.374 INFO:tasks.workunit.client.1.smithi098.stdout:1/672: write d1/d25/d27/fbd [1514461,49057] 0 2023-01-04T18:16:35.374 INFO:tasks.workunit.client.1.smithi098.stdout:1/673: write d1/d8/da/f91 [939487,15157] 0 2023-01-04T18:16:35.374 INFO:tasks.workunit.client.1.smithi098.stdout:1/674: chown d1/d8/d53/fc8 1859580 1 2023-01-04T18:16:35.379 INFO:tasks.workunit.client.1.smithi098.stdout:0/766: creat df/d17/d9b/da4/f103 x:0 0 0 2023-01-04T18:16:35.383 INFO:tasks.workunit.client.1.smithi098.stdout:4/754: unlink d5/d9/fa5 0 2023-01-04T18:16:35.384 INFO:tasks.workunit.client.1.smithi098.stdout:1/675: creat d1/d8/d53/feb x:0 0 0 2023-01-04T18:16:35.384 INFO:tasks.workunit.client.1.smithi098.stdout:1/676: fsync d1/f30 0 2023-01-04T18:16:35.385 INFO:tasks.workunit.client.1.smithi098.stdout:1/677: chown d1/d25/d36/d4e/d9f/dd7 14532 1 2023-01-04T18:16:35.386 INFO:tasks.workunit.client.1.smithi098.stdout:0/767: rename df/d17/d9b/d5c to df/d17/d1c/d2c/d104 0 2023-01-04T18:16:35.387 INFO:tasks.workunit.client.1.smithi098.stdout:0/768: readlink df/l1a 0 2023-01-04T18:16:35.387 INFO:tasks.workunit.client.1.smithi098.stdout:4/755: mknod d5/d28/d40/de5/cfc 0 2023-01-04T18:16:35.389 INFO:tasks.workunit.client.1.smithi098.stdout:1/678: rmdir d1/d25/d6a/de9 0 2023-01-04T18:16:35.391 INFO:tasks.workunit.client.1.smithi098.stdout:1/679: write d1/f1b [4046320,16733] 0 2023-01-04T18:16:35.393 INFO:tasks.workunit.client.1.smithi098.stdout:1/680: dread d1/d25/d27/fa7 [0,4194304] 0 2023-01-04T18:16:35.394 INFO:tasks.workunit.client.1.smithi098.stdout:1/681: rename d1/d8/da/d64 to d1/da9/de3/dec 0 2023-01-04T18:16:35.396 INFO:tasks.workunit.client.1.smithi098.stdout:4/756: dread d5/d28/d40/f52 [0,4194304] 0 2023-01-04T18:16:35.396 INFO:tasks.workunit.client.1.smithi098.stdout:4/757: dread - d5/de/d30/f68 zero size 2023-01-04T18:16:35.399 INFO:tasks.workunit.client.1.smithi098.stdout:1/682: unlink d1/d8/ld0 0 2023-01-04T18:16:35.399 INFO:tasks.workunit.client.1.smithi098.stdout:1/683: fsync d1/d8/da/dae/faf 0 2023-01-04T18:16:35.400 INFO:tasks.workunit.client.1.smithi098.stdout:4/758: creat d5/de/d30/ffd x:0 0 0 2023-01-04T18:16:35.400 INFO:tasks.workunit.client.1.smithi098.stdout:1/684: write d1/d8/da/dae/f37 [1229149,111679] 0 2023-01-04T18:16:35.401 INFO:tasks.workunit.client.1.smithi098.stdout:1/685: creat d1/d25/d6a/fed x:0 0 0 2023-01-04T18:16:35.402 INFO:tasks.workunit.client.1.smithi098.stdout:1/686: write d1/fc [134189,75887] 0 2023-01-04T18:16:35.403 INFO:tasks.workunit.client.1.smithi098.stdout:1/687: creat d1/d25/fee x:0 0 0 2023-01-04T18:16:35.404 INFO:tasks.workunit.client.1.smithi098.stdout:1/688: rename d1/d8/da/cb to d1/d25/d27/d77/cef 0 2023-01-04T18:16:35.405 INFO:tasks.workunit.client.1.smithi098.stdout:1/689: dread - d1/d8/dac/dea/fbc zero size 2023-01-04T18:16:35.406 INFO:tasks.workunit.client.1.smithi098.stdout:1/690: mkdir d1/d8/df0 0 2023-01-04T18:16:35.406 INFO:tasks.workunit.client.1.smithi098.stdout:1/691: rmdir d1/d25/d27/d5c 39 2023-01-04T18:16:35.407 INFO:tasks.workunit.client.1.smithi098.stdout:1/692: mkdir d1/da9/de3/dec/df1 0 2023-01-04T18:16:35.407 INFO:tasks.workunit.client.1.smithi098.stdout:1/693: dread - d1/d25/d39/dd9/fe5 zero size 2023-01-04T18:16:35.408 INFO:tasks.workunit.client.1.smithi098.stdout:1/694: write d1/d25/d27/d77/da8/fe6 [1637354,46277] 0 2023-01-04T18:16:35.409 INFO:tasks.workunit.client.1.smithi098.stdout:1/695: unlink d1/d25/d36/d89/db3/cc9 0 2023-01-04T18:16:35.411 INFO:tasks.workunit.client.1.smithi098.stdout:1/696: fdatasync d1/d25/d27/d77/da8/fe6 0 2023-01-04T18:16:35.411 INFO:tasks.workunit.client.1.smithi098.stdout:1/697: read - d1/d8/da/fc1 zero size 2023-01-04T18:16:35.412 INFO:tasks.workunit.client.1.smithi098.stdout:1/698: mknod d1/d25/d27/d5c/cf2 0 2023-01-04T18:16:35.412 INFO:tasks.workunit.client.1.smithi098.stdout:1/699: chown d1/d25/fee 154796 1 2023-01-04T18:16:35.413 INFO:tasks.workunit.client.1.smithi098.stdout:1/700: mkdir d1/d25/d6a/df3 0 2023-01-04T18:16:35.414 INFO:tasks.workunit.client.1.smithi098.stdout:1/701: mkdir d1/d25/d36/d89/df4 0 2023-01-04T18:16:35.414 INFO:tasks.workunit.client.1.smithi098.stdout:1/702: mknod d1/da9/de3/dec/df1/cf5 0 2023-01-04T18:16:35.415 INFO:tasks.workunit.client.1.smithi098.stdout:1/703: write d1/d8/d53/fc5 [648666,20418] 0 2023-01-04T18:16:35.415 INFO:tasks.workunit.client.1.smithi098.stdout:1/704: symlink d1/d25/d6a/lf6 0 2023-01-04T18:16:35.416 INFO:tasks.workunit.client.1.smithi098.stdout:1/705: symlink d1/da9/de3/dec/df1/lf7 0 2023-01-04T18:16:35.417 INFO:tasks.workunit.client.1.smithi098.stdout:1/706: link d1/d8/l26 d1/d25/d27/d77/da8/dca/lf8 0 2023-01-04T18:16:35.419 INFO:tasks.workunit.client.1.smithi098.stdout:1/707: dread d1/d8/f10 [0,4194304] 0 2023-01-04T18:16:35.420 INFO:tasks.workunit.client.1.smithi098.stdout:1/708: mkdir d1/da9/de3/dec/df9 0 2023-01-04T18:16:35.421 INFO:tasks.workunit.client.1.smithi098.stdout:1/709: mkdir d1/d8/da/dae/dfa 0 2023-01-04T18:16:35.421 INFO:tasks.workunit.client.1.smithi098.stdout:1/710: write d1/d8/dac/dea/fce [482755,39597] 0 2023-01-04T18:16:35.422 INFO:tasks.workunit.client.1.smithi098.stdout:1/711: mkdir d1/d8/dac/dea/dfb 0 2023-01-04T18:16:35.437 INFO:tasks.workunit.client.1.smithi098.stdout:1/712: rename d1/d25 to d1/d8/dac/dfc 0 2023-01-04T18:16:35.437 INFO:tasks.workunit.client.1.smithi098.stdout:1/713: chown d1/d8/dac/dfc/fb9 56112552 1 2023-01-04T18:16:35.443 INFO:tasks.workunit.client.1.smithi098.stdout:1/714: link d1/d8/dac/dfc/d27/d77/f3b d1/d8/dac/dfc/d27/d77/ffd 0 2023-01-04T18:16:35.444 INFO:tasks.workunit.client.1.smithi098.stdout:1/715: fdatasync d1/d8/fb1 0 2023-01-04T18:16:35.445 INFO:tasks.workunit.client.1.smithi098.stdout:1/716: mkdir d1/d8/dac/dfc/d27/dfe 0 2023-01-04T18:16:35.452 INFO:tasks.workunit.client.1.smithi098.stdout:8/771: sync 2023-01-04T18:16:35.452 INFO:tasks.workunit.client.1.smithi098.stdout:6/774: sync 2023-01-04T18:16:35.452 INFO:tasks.workunit.client.1.smithi098.stdout:2/759: sync 2023-01-04T18:16:35.452 INFO:tasks.workunit.client.1.smithi098.stdout:7/764: sync 2023-01-04T18:16:35.452 INFO:tasks.workunit.client.1.smithi098.stdout:6/775: fsync d9/dd/d24/d3e/f55 0 2023-01-04T18:16:35.452 INFO:tasks.workunit.client.1.smithi098.stdout:2/760: write d6/dc/d2b/d42/d47/d35/f67 [2257835,84012] 0 2023-01-04T18:16:35.454 INFO:tasks.workunit.client.1.smithi098.stdout:7/765: unlink d1/d23/d21/d7f/fbc 0 2023-01-04T18:16:35.457 INFO:tasks.workunit.client.1.smithi098.stdout:6/776: rename d9/dd/de/d44/d7a to d9/dd/de/d44/df0 0 2023-01-04T18:16:35.458 INFO:tasks.workunit.client.1.smithi098.stdout:2/761: mknod d6/dc/d2b/d42/d47/d106/c10b 0 2023-01-04T18:16:35.458 INFO:tasks.workunit.client.1.smithi098.stdout:2/762: dread - d6/dc/d2b/d42/d47/d1f/fb4 zero size 2023-01-04T18:16:35.458 INFO:tasks.workunit.client.1.smithi098.stdout:6/777: write d9/dd/de/d20/d82/fbe [11779,40343] 0 2023-01-04T18:16:35.460 INFO:tasks.workunit.client.1.smithi098.stdout:2/763: rmdir d6/dc/d2b/d46 39 2023-01-04T18:16:35.460 INFO:tasks.workunit.client.1.smithi098.stdout:7/766: dread d1/da/f1b [0,4194304] 0 2023-01-04T18:16:35.460 INFO:tasks.workunit.client.1.smithi098.stdout:8/772: dread d6/d11/d15/d1b/d2a/d6b/d7f/fb9 [0,4194304] 0 2023-01-04T18:16:35.460 INFO:tasks.workunit.client.1.smithi098.stdout:7/767: write d1/da/f68 [694193,72612] 0 2023-01-04T18:16:35.461 INFO:tasks.workunit.client.1.smithi098.stdout:1/717: dwrite d1/d8/dac/dfc/d6a/fb0 [0,4194304] 0 2023-01-04T18:16:35.461 INFO:tasks.workunit.client.1.smithi098.stdout:6/778: truncate d9/dd/de/d44/d79/f80 1184338 0 2023-01-04T18:16:35.461 INFO:tasks.workunit.client.1.smithi098.stdout:1/718: truncate d1/d8/dac/dfc/fee 502119 0 2023-01-04T18:16:35.462 INFO:tasks.workunit.client.1.smithi098.stdout:2/764: rename d6/dc/d2b/d42/d47/da5/cc2 to d6/dc/d2b/d42/d47/da5/dda/c10c 0 2023-01-04T18:16:35.462 INFO:tasks.workunit.client.1.smithi098.stdout:2/765: getdents d6/dc/d2b/d42/d51/d79/da3/db5 0 2023-01-04T18:16:35.463 INFO:tasks.workunit.client.1.smithi098.stdout:8/773: rmdir d6/d11/d15/d1b/d2a/d3b/d8e 39 2023-01-04T18:16:35.466 INFO:tasks.workunit.client.1.smithi098.stdout:7/768: mkdir d1/d4/d11/d9d/dd2/d109 0 2023-01-04T18:16:35.472 INFO:tasks.workunit.client.1.smithi098.stdout:6/779: symlink d9/lf1 0 2023-01-04T18:16:35.472 INFO:tasks.workunit.client.1.smithi098.stdout:6/780: read d9/dd/de/d44/f5e [1051732,14886] 0 2023-01-04T18:16:35.473 INFO:tasks.workunit.client.1.smithi098.stdout:1/719: creat d1/fff x:0 0 0 2023-01-04T18:16:35.474 INFO:tasks.workunit.client.1.smithi098.stdout:2/766: link d6/dc/d2b/d42/d47/d1f/f6f d6/dc/d2b/d42/d47/da5/dda/f10d 0 2023-01-04T18:16:35.477 INFO:tasks.workunit.client.1.smithi098.stdout:8/774: symlink d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/d84/de0/lec 0 2023-01-04T18:16:35.478 INFO:tasks.workunit.client.1.smithi098.stdout:9/776: sync 2023-01-04T18:16:35.478 INFO:tasks.workunit.client.1.smithi098.stdout:3/868: sync 2023-01-04T18:16:35.478 INFO:tasks.workunit.client.1.smithi098.stdout:5/796: sync 2023-01-04T18:16:35.478 INFO:tasks.workunit.client.1.smithi098.stdout:5/797: write d1/d2f/d66/fdb [462290,19297] 0 2023-01-04T18:16:35.479 INFO:tasks.workunit.client.1.smithi098.stdout:7/769: unlink d1/d4/d11/d9d/ffb 0 2023-01-04T18:16:35.480 INFO:tasks.workunit.client.1.smithi098.stdout:1/720: mkdir d1/d8/dac/dfc/d36/d100 0 2023-01-04T18:16:35.480 INFO:tasks.workunit.client.1.smithi098.stdout:1/721: chown d1/d8/dac/dfc/d36/f40 114518 1 2023-01-04T18:16:35.482 INFO:tasks.workunit.client.1.smithi098.stdout:3/869: write d6/d10/d19/d3f/f2f [3258508,57688] 0 2023-01-04T18:16:35.482 INFO:tasks.workunit.client.1.smithi098.stdout:3/870: chown d6/d10/d19/f26 392840632 1 2023-01-04T18:16:35.482 INFO:tasks.workunit.client.1.smithi098.stdout:6/781: dread d9/dd/d24/d3e/fa4 [0,4194304] 0 2023-01-04T18:16:35.483 INFO:tasks.workunit.client.1.smithi098.stdout:3/871: dread - d6/d10/d6b/d9e/fb4 zero size 2023-01-04T18:16:35.483 INFO:tasks.workunit.client.1.smithi098.stdout:6/782: dread - d9/dd/de/d7e/f93 zero size 2023-01-04T18:16:35.483 INFO:tasks.workunit.client.1.smithi098.stdout:6/783: chown d9/dd/d4e/d67/d8d/d81 450944207 1 2023-01-04T18:16:35.484 INFO:tasks.workunit.client.1.smithi098.stdout:8/775: unlink d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d64/l86 0 2023-01-04T18:16:35.485 INFO:tasks.workunit.client.1.smithi098.stdout:2/767: creat d6/dc/d2b/d42/d51/de1/f10e x:0 0 0 2023-01-04T18:16:35.485 INFO:tasks.workunit.client.1.smithi098.stdout:5/798: creat d1/da/d44/d80/dcf/ffc x:0 0 0 2023-01-04T18:16:35.485 INFO:tasks.workunit.client.1.smithi098.stdout:5/799: chown d1/d2/f17 466780927 1 2023-01-04T18:16:35.485 INFO:tasks.workunit.client.1.smithi098.stdout:7/770: creat d1/d23/d37/d40/f10a x:0 0 0 2023-01-04T18:16:35.485 INFO:tasks.workunit.client.1.smithi098.stdout:8/776: write d6/d11/d15/d1b/d2a/d6b/d7f/d5a/fcc [372219,86112] 0 2023-01-04T18:16:35.486 INFO:tasks.workunit.client.1.smithi098.stdout:1/722: creat d1/da9/de3/dec/df1/f101 x:0 0 0 2023-01-04T18:16:35.487 INFO:tasks.workunit.client.1.smithi098.stdout:3/872: truncate d6/d10/f62 2905379 0 2023-01-04T18:16:35.487 INFO:tasks.workunit.client.1.smithi098.stdout:6/784: creat d9/dd/de/d20/d82/d84/ff2 x:0 0 0 2023-01-04T18:16:35.488 INFO:tasks.workunit.client.1.smithi098.stdout:7/771: rename d1/d23/d73/d85/fda to d1/d23/d73/d85/f10b 0 2023-01-04T18:16:35.489 INFO:tasks.workunit.client.1.smithi098.stdout:6/785: getdents d9 0 2023-01-04T18:16:35.489 INFO:tasks.workunit.client.1.smithi098.stdout:7/772: getdents d1/db2 0 2023-01-04T18:16:35.490 INFO:tasks.workunit.client.1.smithi098.stdout:7/773: truncate d1/d23/d73/dba/fef 294648 0 2023-01-04T18:16:35.490 INFO:tasks.workunit.client.1.smithi098.stdout:2/768: write d6/f2f [3320779,18842] 0 2023-01-04T18:16:35.490 INFO:tasks.workunit.client.1.smithi098.stdout:1/723: write d1/d8/dac/dfc/d27/d77/f74 [182135,89854] 0 2023-01-04T18:16:35.491 INFO:tasks.workunit.client.1.smithi098.stdout:7/774: mknod d1/d51/d26/d28/c10c 0 2023-01-04T18:16:35.491 INFO:tasks.workunit.client.1.smithi098.stdout:6/786: dread d9/dd/d24/f30 [0,4194304] 0 2023-01-04T18:16:35.495 INFO:tasks.workunit.client.1.smithi098.stdout:1/724: unlink d1/d8/d53/ca0 0 2023-01-04T18:16:35.496 INFO:tasks.workunit.client.1.smithi098.stdout:2/769: read d6/ded/df9/f59 [4261977,7623] 0 2023-01-04T18:16:35.496 INFO:tasks.workunit.client.1.smithi098.stdout:7/775: rmdir d1/d51/d26/d28/d2d/d6b 39 2023-01-04T18:16:35.498 INFO:tasks.workunit.client.1.smithi098.stdout:1/725: creat d1/d8/dac/dfc/f102 x:0 0 0 2023-01-04T18:16:35.498 INFO:tasks.workunit.client.1.smithi098.stdout:1/726: write d1/d8/dac/dfc/fd1 [154917,91720] 0 2023-01-04T18:16:35.498 INFO:tasks.workunit.client.1.smithi098.stdout:1/727: dread - d1/da9/fd8 zero size 2023-01-04T18:16:35.498 INFO:tasks.workunit.client.1.smithi098.stdout:3/873: dread d6/d56/fb8 [0,4194304] 0 2023-01-04T18:16:35.498 INFO:tasks.workunit.client.1.smithi098.stdout:3/874: dread - d6/d10/d19/d3f/d5e/d7d/dec/dda/fe2 zero size 2023-01-04T18:16:35.498 INFO:tasks.workunit.client.1.smithi098.stdout:3/875: truncate d6/f44 1431993 0 2023-01-04T18:16:35.498 INFO:tasks.workunit.client.1.smithi098.stdout:2/770: creat d6/dc/d4b/f10f x:0 0 0 2023-01-04T18:16:35.498 INFO:tasks.workunit.client.1.smithi098.stdout:2/771: read d6/dc/d2b/d42/d47/d1f/d39/fa6 [301750,60801] 0 2023-01-04T18:16:35.498 INFO:tasks.workunit.client.1.smithi098.stdout:2/772: stat d6/dc/d2b/d42/d47/d1f/d82/ca0 0 2023-01-04T18:16:35.499 INFO:tasks.workunit.client.1.smithi098.stdout:7/776: symlink d1/d23/d21/d7f/de4/l10d 0 2023-01-04T18:16:35.499 INFO:tasks.workunit.client.1.smithi098.stdout:1/728: fsync d1/d8/da/dae/faf 0 2023-01-04T18:16:35.500 INFO:tasks.workunit.client.1.smithi098.stdout:3/876: creat d6/d6f/db6/f133 x:0 0 0 2023-01-04T18:16:35.502 INFO:tasks.workunit.client.1.smithi098.stdout:7/777: creat d1/d23/d37/d78/f10e x:0 0 0 2023-01-04T18:16:35.502 INFO:tasks.workunit.client.1.smithi098.stdout:7/778: chown d1/d4/d11/d9d/dd0/f108 1102579638 1 2023-01-04T18:16:35.504 INFO:tasks.workunit.client.1.smithi098.stdout:1/729: rename d1/d8/dac/dfc/ld3 to d1/d8/dac/dfc/d36/l103 0 2023-01-04T18:16:35.506 INFO:tasks.workunit.client.1.smithi098.stdout:3/877: rmdir d6/d10/d19/d3f/d46 39 2023-01-04T18:16:35.506 INFO:tasks.workunit.client.1.smithi098.stdout:3/878: chown d6/d10/d29/d6a/fe0 0 1 2023-01-04T18:16:35.506 INFO:tasks.workunit.client.1.smithi098.stdout:3/879: chown d6/d56/d9f/da8/dfd 90 1 2023-01-04T18:16:35.507 INFO:tasks.workunit.client.1.smithi098.stdout:7/779: symlink d1/d4/d11/d9d/dd0/l10f 0 2023-01-04T18:16:35.508 INFO:tasks.workunit.client.1.smithi098.stdout:7/780: dread - d1/d51/d26/d28/d2d/ff7 zero size 2023-01-04T18:16:35.508 INFO:tasks.workunit.client.1.smithi098.stdout:1/730: symlink d1/d8/d53/l104 0 2023-01-04T18:16:35.509 INFO:tasks.workunit.client.1.smithi098.stdout:7/781: creat d1/d23/d73/d85/f110 x:0 0 0 2023-01-04T18:16:35.510 INFO:tasks.workunit.client.1.smithi098.stdout:7/782: fdatasync d1/d23/d37/d78/d103/fdf 0 2023-01-04T18:16:35.511 INFO:tasks.workunit.client.1.smithi098.stdout:1/731: unlink d1/d8/dac/dfc/ddb/ccb 0 2023-01-04T18:16:35.512 INFO:tasks.workunit.client.1.smithi098.stdout:1/732: stat d1/d8/da/dae/f5f 0 2023-01-04T18:16:35.512 INFO:tasks.workunit.client.1.smithi098.stdout:1/733: chown d1/d8/dac/dfc/d6a/f6b 36710620 1 2023-01-04T18:16:35.522 INFO:tasks.workunit.client.1.smithi098.stdout:9/777: dwrite d2/d5/d18/ff7 [0,4194304] 0 2023-01-04T18:16:35.522 INFO:tasks.workunit.client.1.smithi098.stdout:9/778: write d2/d5/d18/d1d/d23/dad/dfa/d42/d89/dcb/fe9 [121262,63812] 0 2023-01-04T18:16:35.524 INFO:tasks.workunit.client.1.smithi098.stdout:6/787: read d9/dd/d15/f36 [3375168,109145] 0 2023-01-04T18:16:35.524 INFO:tasks.workunit.client.1.smithi098.stdout:6/788: fsync d9/dd/d24/d3e/fe8 0 2023-01-04T18:16:35.525 INFO:tasks.workunit.client.1.smithi098.stdout:6/789: write d9/dd/d15/f2d [5188010,68411] 0 2023-01-04T18:16:35.531 INFO:tasks.workunit.client.1.smithi098.stdout:2/773: write f5 [8324151,60998] 0 2023-01-04T18:16:35.533 INFO:tasks.workunit.client.1.smithi098.stdout:6/790: write d9/dd/de/d20/d82/fbe [5872610,88686] 0 2023-01-04T18:16:35.536 INFO:tasks.workunit.client.1.smithi098.stdout:9/779: read d2/d5/d18/d19/ffb [532143,76426] 0 2023-01-04T18:16:35.553 INFO:tasks.workunit.client.1.smithi098.stdout:7/783: dwrite d1/d23/d73/dba/fef [0,4194304] 0 2023-01-04T18:16:35.554 INFO:tasks.workunit.client.1.smithi098.stdout:3/880: dwrite d6/d10/d19/d3f/d5e/d7d/d90/fcf [0,4194304] 0 2023-01-04T18:16:35.554 INFO:tasks.workunit.client.1.smithi098.stdout:3/881: fsync d6/d10/d19/d3f/d5e/d74/f52 0 2023-01-04T18:16:35.554 INFO:tasks.workunit.client.1.smithi098.stdout:8/777: dwrite d6/d11/d15/d1b/d2a/d3b/f35 [4194304,4194304] 0 2023-01-04T18:16:35.554 INFO:tasks.workunit.client.1.smithi098.stdout:8/778: chown d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/d8a/ddd 0 1 2023-01-04T18:16:35.559 INFO:tasks.workunit.client.1.smithi098.stdout:1/734: dwrite d1/d8/d53/fc8 [0,4194304] 0 2023-01-04T18:16:35.560 INFO:tasks.workunit.client.1.smithi098.stdout:6/791: dwrite d9/dd/de/d44/df0/d85/fae [0,4194304] 0 2023-01-04T18:16:35.560 INFO:tasks.workunit.client.1.smithi098.stdout:3/882: rename d6/d10/d6b/d9e to d6/d10/d19/d3f/d5e/d7d/dec/dda/d134 0 2023-01-04T18:16:35.562 INFO:tasks.workunit.client.1.smithi098.stdout:8/779: rmdir d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/d84 39 2023-01-04T18:16:35.562 INFO:tasks.workunit.client.1.smithi098.stdout:7/784: dread d1/d4/d11/d9d/dd2/fd8 [0,4194304] 0 2023-01-04T18:16:35.572 INFO:tasks.workunit.client.1.smithi098.stdout:1/735: creat d1/da9/de3/dec/df1/f105 x:0 0 0 2023-01-04T18:16:35.574 INFO:tasks.workunit.client.1.smithi098.stdout:6/792: creat d9/dd/d24/d64/ff3 x:0 0 0 2023-01-04T18:16:35.577 INFO:tasks.workunit.client.1.smithi098.stdout:8/780: rename d6/d11/d15/d1b/d2a/d3b/d59 to d6/d11/d15/db4/dba/ded 0 2023-01-04T18:16:35.578 INFO:tasks.workunit.client.1.smithi098.stdout:8/781: readlink d6/d11/d15/d1b/d2a/laa 0 2023-01-04T18:16:35.578 INFO:tasks.workunit.client.1.smithi098.stdout:1/736: rmdir d1/d8/dac/dea 39 2023-01-04T18:16:35.578 INFO:tasks.workunit.client.1.smithi098.stdout:3/883: dwrite d6/d56/fb8 [0,4194304] 0 2023-01-04T18:16:35.579 INFO:tasks.workunit.client.1.smithi098.stdout:6/793: creat d9/dd/d4e/d67/db6/de9/ff4 x:0 0 0 2023-01-04T18:16:35.579 INFO:tasks.workunit.client.1.smithi098.stdout:6/794: dread - d9/dda/fe2 zero size 2023-01-04T18:16:35.580 INFO:tasks.workunit.client.1.smithi098.stdout:7/785: rename d1/d51/d26/d28/d2d/d75/fae to d1/d4/d11/d9d/dd0/f111 0 2023-01-04T18:16:35.581 INFO:tasks.workunit.client.1.smithi098.stdout:8/782: unlink d6/d11/d15/c74 0 2023-01-04T18:16:35.584 INFO:tasks.workunit.client.1.smithi098.stdout:1/737: mkdir d1/d8/dac/dfc/d6a/d106 0 2023-01-04T18:16:35.585 INFO:tasks.workunit.client.1.smithi098.stdout:0/769: sync 2023-01-04T18:16:35.585 INFO:tasks.workunit.client.1.smithi098.stdout:4/759: sync 2023-01-04T18:16:35.586 INFO:tasks.workunit.client.1.smithi098.stdout:3/884: getdents d6/d56/dc8 0 2023-01-04T18:16:35.586 INFO:tasks.workunit.client.1.smithi098.stdout:4/760: write d5/d9/f3b [4098893,105293] 0 2023-01-04T18:16:35.587 INFO:tasks.workunit.client.1.smithi098.stdout:6/795: unlink d9/dd/d15/ld6 0 2023-01-04T18:16:35.589 INFO:tasks.workunit.client.1.smithi098.stdout:7/786: creat d1/d23/d37/d78/d103/f112 x:0 0 0 2023-01-04T18:16:35.589 INFO:tasks.workunit.client.1.smithi098.stdout:6/796: write d9/dd/de/d26/f97 [6548762,26026] 0 2023-01-04T18:16:35.589 INFO:tasks.workunit.client.1.smithi098.stdout:6/797: write d9/dda/fe2 [179167,32751] 0 2023-01-04T18:16:35.589 INFO:tasks.workunit.client.1.smithi098.stdout:6/798: read d9/dd/de/d44/f5e [1326431,19076] 0 2023-01-04T18:16:35.590 INFO:tasks.workunit.client.1.smithi098.stdout:6/799: write d9/dd/d4e/d67/d8d/f6f [3753475,73643] 0 2023-01-04T18:16:35.590 INFO:tasks.workunit.client.1.smithi098.stdout:6/800: chown d9/dd/d24/d3e/fe8 19385544 1 2023-01-04T18:16:35.590 INFO:tasks.workunit.client.1.smithi098.stdout:6/801: stat d9/dd/d24/d3e/d86/d9b/dce/cb8 0 2023-01-04T18:16:35.590 INFO:tasks.workunit.client.1.smithi098.stdout:6/802: chown d9/dd/de/d20/d82/d84/ld4 217312682 1 2023-01-04T18:16:35.591 INFO:tasks.workunit.client.1.smithi098.stdout:8/783: truncate d6/d11/d15/d1b/d2a/d3b/f38 5663260 0 2023-01-04T18:16:35.593 INFO:tasks.workunit.client.1.smithi098.stdout:1/738: creat d1/d8/dac/dfc/d27/d77/f107 x:0 0 0 2023-01-04T18:16:35.593 INFO:tasks.workunit.client.1.smithi098.stdout:1/739: chown d1/d8/dac/dfc/fd1 5558 1 2023-01-04T18:16:35.593 INFO:tasks.workunit.client.1.smithi098.stdout:1/740: write d1/d8/dac/dfc/d27/d5c/fb6 [4923055,4466] 0 2023-01-04T18:16:35.593 INFO:tasks.workunit.client.1.smithi098.stdout:1/741: readlink d1/d8/dac/dfc/d36/d89/l9e 0 2023-01-04T18:16:35.594 INFO:tasks.workunit.client.1.smithi098.stdout:5/800: sync 2023-01-04T18:16:35.594 INFO:tasks.workunit.client.1.smithi098.stdout:9/780: sync 2023-01-04T18:16:35.594 INFO:tasks.workunit.client.1.smithi098.stdout:2/774: sync 2023-01-04T18:16:35.594 INFO:tasks.workunit.client.1.smithi098.stdout:5/801: fsync d1/db0/ddc/ff7 0 2023-01-04T18:16:35.594 INFO:tasks.workunit.client.1.smithi098.stdout:2/775: fdatasync f5 0 2023-01-04T18:16:35.595 INFO:tasks.workunit.client.1.smithi098.stdout:0/770: mkdir df/d17/d1c/d2c/d41/d105 0 2023-01-04T18:16:35.596 INFO:tasks.workunit.client.1.smithi098.stdout:0/771: dread - df/d17/d9b/d86/fc5 zero size 2023-01-04T18:16:35.600 INFO:tasks.workunit.client.1.smithi098.stdout:3/885: rename d6/d6f/db6/cc9 to d6/d56/d9f/da8/dfd/d120/c135 0 2023-01-04T18:16:35.601 INFO:tasks.workunit.client.1.smithi098.stdout:4/761: getdents d5/d9/d13 0 2023-01-04T18:16:35.602 INFO:tasks.workunit.client.1.smithi098.stdout:6/803: mknod d9/dd/d4e/d67/db6/de9/cf5 0 2023-01-04T18:16:35.603 INFO:tasks.workunit.client.1.smithi098.stdout:1/742: creat d1/d8/dac/dfc/d36/d89/df4/f108 x:0 0 0 2023-01-04T18:16:35.606 INFO:tasks.workunit.client.1.smithi098.stdout:8/784: rename d6/d11/d15/d1b/d2a/d6b/d7f/d12/f4f to d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/fee 0 2023-01-04T18:16:35.606 INFO:tasks.workunit.client.1.smithi098.stdout:3/886: mknod d6/d10/d19/d3f/d5e/d7d/dec/c136 0 2023-01-04T18:16:35.607 INFO:tasks.workunit.client.1.smithi098.stdout:4/762: creat d5/de/d9b/ffe x:0 0 0 2023-01-04T18:16:35.608 INFO:tasks.workunit.client.1.smithi098.stdout:6/804: symlink d9/dd/d4e/d67/db6/de9/lf6 0 2023-01-04T18:16:35.608 INFO:tasks.workunit.client.1.smithi098.stdout:6/805: chown d9/dd/c40 1752288186 1 2023-01-04T18:16:35.609 INFO:tasks.workunit.client.1.smithi098.stdout:1/743: creat d1/d8/dac/dfc/d36/d89/db3/f109 x:0 0 0 2023-01-04T18:16:35.609 INFO:tasks.workunit.client.1.smithi098.stdout:9/781: dread d2/d5/d18/d1d/d23/dad/dfa/fc8 [0,4194304] 0 2023-01-04T18:16:35.610 INFO:tasks.workunit.client.1.smithi098.stdout:9/782: chown d2/df6/d26/f7e 503219626 1 2023-01-04T18:16:35.610 INFO:tasks.workunit.client.1.smithi098.stdout:9/783: write d2/df6/d26/f37 [631317,94225] 0 2023-01-04T18:16:35.610 INFO:tasks.workunit.client.1.smithi098.stdout:2/776: mknod d6/dc/d2b/d42/d47/c110 0 2023-01-04T18:16:35.611 INFO:tasks.workunit.client.1.smithi098.stdout:0/772: rename df/d17/d1c/c32 to df/d17/d1c/d2c/da8/c106 0 2023-01-04T18:16:35.612 INFO:tasks.workunit.client.1.smithi098.stdout:8/785: getdents d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20 0 2023-01-04T18:16:35.612 INFO:tasks.workunit.client.1.smithi098.stdout:8/786: chown d6/d92 50 1 2023-01-04T18:16:35.613 INFO:tasks.workunit.client.1.smithi098.stdout:3/887: link d6/d56/fb8 d6/d10/dc0/f137 0 2023-01-04T18:16:35.613 INFO:tasks.workunit.client.1.smithi098.stdout:4/763: mkdir d5/d28/dff 0 2023-01-04T18:16:35.614 INFO:tasks.workunit.client.1.smithi098.stdout:6/806: mknod d9/dd/de/d44/dd1/cf7 0 2023-01-04T18:16:35.614 INFO:tasks.workunit.client.1.smithi098.stdout:6/807: chown d9/dd/de/d26/d71/c72 41801424 1 2023-01-04T18:16:35.615 INFO:tasks.workunit.client.1.smithi098.stdout:1/744: mknod d1/d8/dac/dfc/d36/d89/db3/c10a 0 2023-01-04T18:16:35.615 INFO:tasks.workunit.client.1.smithi098.stdout:5/802: dwrite d1/d2/d14/f5c [0,4194304] 0 2023-01-04T18:16:35.616 INFO:tasks.workunit.client.1.smithi098.stdout:7/787: dwrite d1/d51/dc0/fdd [0,4194304] 0 2023-01-04T18:16:35.616 INFO:tasks.workunit.client.1.smithi098.stdout:9/784: getdents d2/df6 0 2023-01-04T18:16:35.616 INFO:tasks.workunit.client.1.smithi098.stdout:9/785: fsync d2/d2d/fd7 0 2023-01-04T18:16:35.617 INFO:tasks.workunit.client.1.smithi098.stdout:0/773: unlink df/d4f/d6b/d89/f9a 0 2023-01-04T18:16:35.618 INFO:tasks.workunit.client.1.smithi098.stdout:0/774: stat df/d4f/dc7 0 2023-01-04T18:16:35.619 INFO:tasks.workunit.client.1.smithi098.stdout:3/888: creat d6/d10/d19/d3f/d46/f138 x:0 0 0 2023-01-04T18:16:35.619 INFO:tasks.workunit.client.1.smithi098.stdout:3/889: dread - d6/d10/dc0/ffa zero size 2023-01-04T18:16:35.619 INFO:tasks.workunit.client.1.smithi098.stdout:3/890: fdatasync d6/d10/d6b/f8d 0 2023-01-04T18:16:35.622 INFO:tasks.workunit.client.1.smithi098.stdout:4/764: creat d5/d9/d13/d65/d98/f100 x:0 0 0 2023-01-04T18:16:35.624 INFO:tasks.workunit.client.1.smithi098.stdout:5/803: dread d1/d46/d6a/f9f [0,4194304] 0 2023-01-04T18:16:35.627 INFO:tasks.workunit.client.1.smithi098.stdout:7/788: rmdir d1/d4/d11/d9d/dd0/dd5 0 2023-01-04T18:16:35.627 INFO:tasks.workunit.client.1.smithi098.stdout:9/786: creat d2/d5/d18/d1d/d23/d66/f100 x:0 0 0 2023-01-04T18:16:35.627 INFO:tasks.workunit.client.1.smithi098.stdout:3/891: mknod d6/d56/d9f/da8/c139 0 2023-01-04T18:16:35.631 INFO:tasks.workunit.client.1.smithi098.stdout:6/808: dread d9/fb1 [0,4194304] 0 2023-01-04T18:16:35.633 INFO:tasks.workunit.client.1.smithi098.stdout:7/789: link d1/dc1/fca d1/d51/d26/d28/d2d/d75/f113 0 2023-01-04T18:16:35.633 INFO:tasks.workunit.client.1.smithi098.stdout:5/804: symlink d1/da/d44/d45/d4b/d61/lfd 0 2023-01-04T18:16:35.633 INFO:tasks.workunit.client.1.smithi098.stdout:3/892: creat d6/d10/d19/f13a x:0 0 0 2023-01-04T18:16:35.633 INFO:tasks.workunit.client.1.smithi098.stdout:3/893: dread - d6/d10/d19/f13a zero size 2023-01-04T18:16:35.633 INFO:tasks.workunit.client.1.smithi098.stdout:4/765: getdents d5/de/d21/d96 0 2023-01-04T18:16:35.637 INFO:tasks.workunit.client.1.smithi098.stdout:5/805: mknod d1/dda/cfe 0 2023-01-04T18:16:35.637 INFO:tasks.workunit.client.1.smithi098.stdout:7/790: getdents d1/d51 0 2023-01-04T18:16:35.637 INFO:tasks.workunit.client.1.smithi098.stdout:5/806: dread - d1/d2/d14/da1/fb2 zero size 2023-01-04T18:16:35.638 INFO:tasks.workunit.client.1.smithi098.stdout:3/894: read d6/d10/d29/f2d [1103222,88107] 0 2023-01-04T18:16:35.638 INFO:tasks.workunit.client.1.smithi098.stdout:4/766: truncate d5/f38 206127 0 2023-01-04T18:16:35.641 INFO:tasks.workunit.client.1.smithi098.stdout:7/791: rename d1/d51/d26/d28/d2d/d6b/f93 to d1/d23/d73/dba/f114 0 2023-01-04T18:16:35.642 INFO:tasks.workunit.client.1.smithi098.stdout:5/807: creat d1/da/d44/d45/d4b/dba/fff x:0 0 0 2023-01-04T18:16:35.642 INFO:tasks.workunit.client.1.smithi098.stdout:5/808: fsync d1/db0/ddc/ff7 0 2023-01-04T18:16:35.643 INFO:tasks.workunit.client.1.smithi098.stdout:4/767: mknod d5/d9/d13/d65/c101 0 2023-01-04T18:16:35.643 INFO:tasks.workunit.client.1.smithi098.stdout:7/792: truncate d1/d23/d21/d7f/faa 537468 0 2023-01-04T18:16:35.644 INFO:tasks.workunit.client.1.smithi098.stdout:7/793: stat d1/d23/d37/d78/f90 0 2023-01-04T18:16:35.645 INFO:tasks.workunit.client.1.smithi098.stdout:5/809: rename d1/d2/d14/da1/fe6 to d1/d46/f100 0 2023-01-04T18:16:35.645 INFO:tasks.workunit.client.1.smithi098.stdout:5/810: chown d1/da/d44/d45/d4b/d61/lfd 393 1 2023-01-04T18:16:35.645 INFO:tasks.workunit.client.1.smithi098.stdout:2/777: dwrite d6/dc/d4b/f10f [0,4194304] 0 2023-01-04T18:16:35.645 INFO:tasks.workunit.client.1.smithi098.stdout:7/794: creat d1/d23/d37/d78/d103/f115 x:0 0 0 2023-01-04T18:16:35.647 INFO:tasks.workunit.client.1.smithi098.stdout:4/768: rename d5/d9/c2f to d5/d28/d7d/c102 0 2023-01-04T18:16:35.648 INFO:tasks.workunit.client.1.smithi098.stdout:5/811: mknod d1/d2f/d66/d75/da5/c101 0 2023-01-04T18:16:35.650 INFO:tasks.workunit.client.1.smithi098.stdout:2/778: mkdir d6/dc/d2b/d42/d47/da5/dda/d111 0 2023-01-04T18:16:35.650 INFO:tasks.workunit.client.1.smithi098.stdout:2/779: fsync d6/dc/d2b/d42/d47/d1f/f3a 0 2023-01-04T18:16:35.651 INFO:tasks.workunit.client.1.smithi098.stdout:7/795: mknod d1/d23/d37/d40/c116 0 2023-01-04T18:16:35.651 INFO:tasks.workunit.client.1.smithi098.stdout:7/796: dread - d1/d23/d73/fff zero size 2023-01-04T18:16:35.651 INFO:tasks.workunit.client.1.smithi098.stdout:4/769: mkdir d5/d9/d103 0 2023-01-04T18:16:35.652 INFO:tasks.workunit.client.1.smithi098.stdout:5/812: truncate d1/f6b 517646 0 2023-01-04T18:16:35.653 INFO:tasks.workunit.client.1.smithi098.stdout:2/780: creat d6/dc/d2b/d42/d47/d1f/d39/d6e/f112 x:0 0 0 2023-01-04T18:16:35.654 INFO:tasks.workunit.client.1.smithi098.stdout:7/797: mknod d1/c117 0 2023-01-04T18:16:35.656 INFO:tasks.workunit.client.1.smithi098.stdout:2/781: link d6/dc/d2b/fcc d6/dc/d2b/d42/d47/da5/dda/d111/f113 0 2023-01-04T18:16:35.657 INFO:tasks.workunit.client.1.smithi098.stdout:7/798: creat d1/d23/d37/f118 x:0 0 0 2023-01-04T18:16:35.658 INFO:tasks.workunit.client.1.smithi098.stdout:2/782: creat d6/dc/d2b/d42/d51/d79/da3/f114 x:0 0 0 2023-01-04T18:16:35.658 INFO:tasks.workunit.client.1.smithi098.stdout:1/745: dwrite d1/d8/da/f72 [0,4194304] 0 2023-01-04T18:16:35.658 INFO:tasks.workunit.client.1.smithi098.stdout:1/746: dread - d1/d8/dac/dfc/d36/d4e/d9f/fb8 zero size 2023-01-04T18:16:35.661 INFO:tasks.workunit.client.1.smithi098.stdout:8/787: dwrite d6/d11/d15/db4/dba/ded/fce [0,4194304] 0 2023-01-04T18:16:35.662 INFO:tasks.workunit.client.1.smithi098.stdout:2/783: creat d6/dc/d2b/d42/d47/da5/f115 x:0 0 0 2023-01-04T18:16:35.663 INFO:tasks.workunit.client.1.smithi098.stdout:1/747: mknod d1/d8/dac/dfc/d36/d89/df4/c10b 0 2023-01-04T18:16:35.663 INFO:tasks.workunit.client.1.smithi098.stdout:9/787: dwrite d2/d5/d18/d1d/dc0/fcc [0,4194304] 0 2023-01-04T18:16:35.665 INFO:tasks.workunit.client.1.smithi098.stdout:8/788: mkdir d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/d84/def 0 2023-01-04T18:16:35.665 INFO:tasks.workunit.client.1.smithi098.stdout:8/789: chown d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/d84/de0 523699396 1 2023-01-04T18:16:35.665 INFO:tasks.workunit.client.1.smithi098.stdout:8/790: write d6/d11/d15/db4/dba/ded/d6e/fd8 [1045948,98407] 0 2023-01-04T18:16:35.667 INFO:tasks.workunit.client.1.smithi098.stdout:1/748: creat d1/d8/dac/dfc/d36/d4e/f10c x:0 0 0 2023-01-04T18:16:35.668 INFO:tasks.workunit.client.1.smithi098.stdout:0/775: dwrite df/d17/d1c/f22 [0,4194304] 0 2023-01-04T18:16:35.668 INFO:tasks.workunit.client.1.smithi098.stdout:3/895: dwrite d6/d56/f8f [4194304,4194304] 0 2023-01-04T18:16:35.668 INFO:tasks.workunit.client.1.smithi098.stdout:3/896: write d6/d10/d29/d6a/fe4 [1328053,42646] 0 2023-01-04T18:16:35.668 INFO:tasks.workunit.client.1.smithi098.stdout:3/897: write d6/d10/d29/f81 [12765,117133] 0 2023-01-04T18:16:35.668 INFO:tasks.workunit.client.1.smithi098.stdout:3/898: chown d6/d10/d19/d3f/d46/d8a/l97 924 1 2023-01-04T18:16:35.673 INFO:tasks.workunit.client.1.smithi098.stdout:4/770: rename d5/de/d9b to d5/d28/d7d/db6/dbd/dc5/d104 0 2023-01-04T18:16:35.674 INFO:tasks.workunit.client.1.smithi098.stdout:7/799: dwrite d1/d51/dc0/fce [0,4194304] 0 2023-01-04T18:16:35.674 INFO:tasks.workunit.client.1.smithi098.stdout:9/788: dread d2/d5/f75 [0,4194304] 0 2023-01-04T18:16:35.674 INFO:tasks.workunit.client.1.smithi098.stdout:7/800: write d1/da/f68 [281930,8294] 0 2023-01-04T18:16:35.675 INFO:tasks.workunit.client.1.smithi098.stdout:9/789: write d2/df6/d26/fbe [2809963,18681] 0 2023-01-04T18:16:35.675 INFO:tasks.workunit.client.1.smithi098.stdout:8/791: mknod d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/d84/def/cf0 0 2023-01-04T18:16:35.675 INFO:tasks.workunit.client.1.smithi098.stdout:2/784: dread d6/dc/d2b/d42/d47/d1f/d39/d6e/d107/fb6 [0,4194304] 0 2023-01-04T18:16:35.677 INFO:tasks.workunit.client.1.smithi098.stdout:1/749: mkdir d1/d8/dac/dfc/d39/d10d 0 2023-01-04T18:16:35.682 INFO:tasks.workunit.client.1.smithi098.stdout:4/771: dread f4 [0,4194304] 0 2023-01-04T18:16:35.695 INFO:tasks.workunit.client.1.smithi098.stdout:3/899: link d6/d10/d19/d3f/d5e/d7d/d90/de6/ded/cf7 d6/d6f/d9b/d12d/c13b 0 2023-01-04T18:16:35.698 INFO:tasks.workunit.client.1.smithi098.stdout:5/813: rename d1/da to d1/d1e/dab/dd5/d102 0 2023-01-04T18:16:35.698 INFO:tasks.workunit.client.1.smithi098.stdout:5/814: getdents d1/d38/dce 0 2023-01-04T18:16:35.708 INFO:tasks.workunit.client.1.smithi098.stdout:7/801: mkdir d1/d23/d21/d7f/de4/d119 0 2023-01-04T18:16:35.709 INFO:tasks.workunit.client.1.smithi098.stdout:9/790: symlink d2/d5/d18/d1d/d23/dad/d72/l101 0 2023-01-04T18:16:35.710 INFO:tasks.workunit.client.1.smithi098.stdout:2/785: creat d6/dc/d2b/d32/f116 x:0 0 0 2023-01-04T18:16:35.711 INFO:tasks.workunit.client.1.smithi098.stdout:2/786: dread d6/ded/df9/f59 [4194304,4194304] 0 2023-01-04T18:16:35.711 INFO:tasks.workunit.client.1.smithi098.stdout:2/787: chown d6/dc/d2b/d42/d47/f41 3281 1 2023-01-04T18:16:35.711 INFO:tasks.workunit.client.1.smithi098.stdout:2/788: chown d6/dc/d2b/d42/d51/d81/f93 248 1 2023-01-04T18:16:35.711 INFO:tasks.workunit.client.1.smithi098.stdout:3/900: dwrite d6/d10/d19/f3a [4194304,4194304] 0 2023-01-04T18:16:35.713 INFO:tasks.workunit.client.1.smithi098.stdout:0/776: rename df/d17/d1c/d2c/d41/d4a/d4c/d5f/ffe to df/d17/d1c/d3b/f107 0 2023-01-04T18:16:35.713 INFO:tasks.workunit.client.1.smithi098.stdout:0/777: dread - df/d17/d1c/d2c/d41/fae zero size 2023-01-04T18:16:35.715 INFO:tasks.workunit.client.1.smithi098.stdout:7/802: creat d1/d23/d73/d85/f11a x:0 0 0 2023-01-04T18:16:35.716 INFO:tasks.workunit.client.1.smithi098.stdout:9/791: symlink d2/df6/d26/d41/dc1/l102 0 2023-01-04T18:16:35.716 INFO:tasks.workunit.client.1.smithi098.stdout:9/792: read - d2/d5/d18/d1d/d23/dad/dfa/d42/d89/ffd zero size 2023-01-04T18:16:35.717 INFO:tasks.workunit.client.1.smithi098.stdout:2/789: mknod d6/dc/d2b/d42/d51/d79/da3/db5/c117 0 2023-01-04T18:16:35.719 INFO:tasks.workunit.client.1.smithi098.stdout:9/793: dread d2/df6/d26/d41/f6a [0,4194304] 0 2023-01-04T18:16:35.721 INFO:tasks.workunit.client.1.smithi098.stdout:4/772: rename d5/d28/d7d/db6/dbd/dc5/ff6 to d5/d28/d40/d5d/dcf/de9/f105 0 2023-01-04T18:16:35.722 INFO:tasks.workunit.client.1.smithi098.stdout:0/778: symlink df/d4f/l108 0 2023-01-04T18:16:35.725 INFO:tasks.workunit.client.1.smithi098.stdout:7/803: mknod d1/d4/d11/d9d/dd0/c11b 0 2023-01-04T18:16:35.726 INFO:tasks.workunit.client.1.smithi098.stdout:2/790: getdents d6/dc/d2b/d46 0 2023-01-04T18:16:35.729 INFO:tasks.workunit.client.1.smithi098.stdout:0/779: creat df/d17/d9b/f109 x:0 0 0 2023-01-04T18:16:35.730 INFO:tasks.workunit.client.1.smithi098.stdout:7/804: mknod d1/d23/d73/d85/dfd/c11c 0 2023-01-04T18:16:35.731 INFO:tasks.workunit.client.1.smithi098.stdout:2/791: creat d6/dc/d4b/f118 x:0 0 0 2023-01-04T18:16:35.734 INFO:tasks.workunit.client.1.smithi098.stdout:0/780: rename df/d17/d1c/d2c/d41/d4a/d4c/d5f/l72 to df/d17/d1c/d3b/d98/l10a 0 2023-01-04T18:16:35.735 INFO:tasks.workunit.client.1.smithi098.stdout:7/805: mknod d1/d51/d26/d28/dc6/c11d 0 2023-01-04T18:16:35.737 INFO:tasks.workunit.client.1.smithi098.stdout:0/781: link df/d17/d1c/d2c/d41/d4a/d4c/f66 df/d17/d9b/da1/f10b 0 2023-01-04T18:16:35.738 INFO:tasks.workunit.client.1.smithi098.stdout:7/806: truncate d1/d23/d21/f4b 1238241 0 2023-01-04T18:16:35.738 INFO:tasks.workunit.client.1.smithi098.stdout:7/807: fsync d1/db2/dc4/fcc 0 2023-01-04T18:16:35.739 INFO:tasks.workunit.client.1.smithi098.stdout:2/792: dread d6/dc/d2b/d42/d47/d1f/fd6 [0,4194304] 0 2023-01-04T18:16:35.741 INFO:tasks.workunit.client.1.smithi098.stdout:0/782: symlink df/d4f/d6b/d89/l10c 0 2023-01-04T18:16:35.741 INFO:tasks.workunit.client.1.smithi098.stdout:0/783: fdatasync df/d4f/f7d 0 2023-01-04T18:16:35.741 INFO:tasks.workunit.client.1.smithi098.stdout:8/792: dwrite d6/fd3 [0,4194304] 0 2023-01-04T18:16:35.741 INFO:tasks.workunit.client.1.smithi098.stdout:8/793: readlink d6/d11/d15/d1b/lc7 0 2023-01-04T18:16:35.743 INFO:tasks.workunit.client.1.smithi098.stdout:8/794: write d6/d11/d15/d1b/d2a/d6b/d7f/f81 [3748190,70401] 0 2023-01-04T18:16:35.744 INFO:tasks.workunit.client.1.smithi098.stdout:2/793: creat d6/dc/d2b/d42/d47/da5/dda/f119 x:0 0 0 2023-01-04T18:16:35.750 INFO:tasks.workunit.client.1.smithi098.stdout:8/795: mkdir d6/d11/d15/db4/dba/df1 0 2023-01-04T18:16:35.750 INFO:tasks.workunit.client.1.smithi098.stdout:2/794: creat d6/dc/d2b/f11a x:0 0 0 2023-01-04T18:16:35.750 INFO:tasks.workunit.client.1.smithi098.stdout:2/795: write d6/dc/d2b/f11a [63844,54912] 0 2023-01-04T18:16:35.754 INFO:tasks.workunit.client.1.smithi098.stdout:9/794: dread d2/d5/d18/d1d/dc0/fcc [0,4194304] 0 2023-01-04T18:16:35.756 INFO:tasks.workunit.client.1.smithi098.stdout:8/796: symlink d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/d8a/lf2 0 2023-01-04T18:16:35.759 INFO:tasks.workunit.client.1.smithi098.stdout:2/796: symlink d6/dc/d2b/d42/d51/d79/da3/db5/l11b 0 2023-01-04T18:16:35.762 INFO:tasks.workunit.client.1.smithi098.stdout:9/795: rename d2/d5/d18/d1d/d23/d5c/fb4 to d2/d5/d18/d1d/d23/dad/d72/d9e/dca/df5/f103 0 2023-01-04T18:16:35.763 INFO:tasks.workunit.client.1.smithi098.stdout:9/796: write d2/d5/d18/d19/f4b [1389512,19491] 0 2023-01-04T18:16:35.763 INFO:tasks.workunit.client.1.smithi098.stdout:9/797: fdatasync d2/d5/d18/d19/f54 0 2023-01-04T18:16:35.765 INFO:tasks.workunit.client.1.smithi098.stdout:8/797: unlink d6/d11/d15/d1b/d2a/d3b/l87 0 2023-01-04T18:16:35.767 INFO:tasks.workunit.client.1.smithi098.stdout:9/798: creat d2/d5/d6f/f104 x:0 0 0 2023-01-04T18:16:35.767 INFO:tasks.workunit.client.1.smithi098.stdout:8/798: dread d6/d11/d15/d1b/d2a/d6b/d7f/d12/f41 [0,4194304] 0 2023-01-04T18:16:35.767 INFO:tasks.workunit.client.1.smithi098.stdout:8/799: truncate d6/d11/d15/d1b/d2a/d6b/d7f/da6/fa9 694853 0 2023-01-04T18:16:35.767 INFO:tasks.workunit.client.1.smithi098.stdout:2/797: mkdir d6/dc/d2b/d42/d47/d11c 0 2023-01-04T18:16:35.768 INFO:tasks.workunit.client.1.smithi098.stdout:8/800: mknod d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/d84/def/cf3 0 2023-01-04T18:16:35.770 INFO:tasks.workunit.client.1.smithi098.stdout:8/801: mknod d6/d11/d15/d1b/d2a/d3b/cf4 0 2023-01-04T18:16:35.770 INFO:tasks.workunit.client.1.smithi098.stdout:8/802: fsync d6/d11/d15/d1b/f76 0 2023-01-04T18:16:35.770 INFO:tasks.workunit.client.1.smithi098.stdout:2/798: write d6/dc/fe [3419280,58292] 0 2023-01-04T18:16:35.770 INFO:tasks.workunit.client.1.smithi098.stdout:0/784: dwrite df/d17/fcd [0,4194304] 0 2023-01-04T18:16:35.771 INFO:tasks.workunit.client.1.smithi098.stdout:3/901: dwrite d6/f15 [4194304,4194304] 0 2023-01-04T18:16:35.771 INFO:tasks.workunit.client.1.smithi098.stdout:8/803: mkdir d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/d8a/ddd/df5 0 2023-01-04T18:16:35.771 INFO:tasks.workunit.client.1.smithi098.stdout:4/773: dwrite d5/d28/d7d/db6/dbd/fd6 [0,4194304] 0 2023-01-04T18:16:35.771 INFO:tasks.workunit.client.1.smithi098.stdout:7/808: dwrite d1/d51/d26/d28/f66 [0,4194304] 0 2023-01-04T18:16:35.775 INFO:tasks.workunit.client.1.smithi098.stdout:2/799: creat d6/dc/d2b/d42/d47/d1f/d39/d6e/d107/f11d x:0 0 0 2023-01-04T18:16:35.775 INFO:tasks.workunit.client.1.smithi098.stdout:2/800: truncate d6/dc/d2b/d46/dd2/fe6 1022146 0 2023-01-04T18:16:35.775 INFO:tasks.workunit.client.1.smithi098.stdout:2/801: stat d6/dc/d2b/d42/d47/d1f/d39/f56 0 2023-01-04T18:16:35.775 INFO:tasks.workunit.client.1.smithi098.stdout:2/802: chown d6/dc/d2b/d42/d51/d79/da3/fdd 9 1 2023-01-04T18:16:35.775 INFO:tasks.workunit.client.1.smithi098.stdout:2/803: fsync d6/dc/d2b/d42/d47/d1f/d39/f8a 0 2023-01-04T18:16:35.783 INFO:tasks.workunit.client.1.smithi098.stdout:3/902: creat d6/d56/d9f/da8/dfd/d120/f13c x:0 0 0 2023-01-04T18:16:35.785 INFO:tasks.workunit.client.1.smithi098.stdout:8/804: stat d6/d11/d15/d1b/lc7 0 2023-01-04T18:16:35.788 INFO:tasks.workunit.client.1.smithi098.stdout:8/805: read d6/d11/d15/d1b/d2a/d6b/d7f/f81 [3444017,99769] 0 2023-01-04T18:16:35.788 INFO:tasks.workunit.client.1.smithi098.stdout:9/799: dread d2/d5/d18/d1d/d23/f8c [0,4194304] 0 2023-01-04T18:16:35.794 INFO:tasks.workunit.client.1.smithi098.stdout:0/785: dwrite df/d17/d1c/d2c/d41/d4a/f65 [0,4194304] 0 2023-01-04T18:16:35.794 INFO:tasks.workunit.client.1.smithi098.stdout:0/786: dread - df/d17/d9b/da4/fe0 zero size 2023-01-04T18:16:35.799 INFO:tasks.workunit.client.1.smithi098.stdout:3/903: dwrite d6/d10/d19/d3f/d5e/d74/fa6 [0,4194304] 0 2023-01-04T18:16:35.800 INFO:tasks.workunit.client.1.smithi098.stdout:4/774: unlink d5/de/d30/d4f/fe1 0 2023-01-04T18:16:35.802 INFO:tasks.workunit.client.1.smithi098.stdout:2/804: rename d6/ded/df9/f59 to d6/dc/d2b/d42/d51/d79/f11e 0 2023-01-04T18:16:35.811 INFO:tasks.workunit.client.1.smithi098.stdout:0/787: dread df/d4f/f7d [0,4194304] 0 2023-01-04T18:16:35.813 INFO:tasks.workunit.client.1.smithi098.stdout:1/750: sync 2023-01-04T18:16:35.813 INFO:tasks.workunit.client.1.smithi098.stdout:6/809: sync 2023-01-04T18:16:35.816 INFO:tasks.workunit.client.1.smithi098.stdout:8/806: dwrite d6/d11/d15/d1b/f76 [0,4194304] 0 2023-01-04T18:16:35.816 INFO:tasks.workunit.client.1.smithi098.stdout:4/775: dread d5/d28/d44/f78 [0,4194304] 0 2023-01-04T18:16:35.817 INFO:tasks.workunit.client.1.smithi098.stdout:2/805: dwrite d6/dc/d2b/d42/f73 [0,4194304] 0 2023-01-04T18:16:35.818 INFO:tasks.workunit.client.1.smithi098.stdout:3/904: rename d6/d10/d19/d3f/d5e/d74/d121/l126 to d6/d10/d19/d3f/d5e/d7d/l13d 0 2023-01-04T18:16:35.819 INFO:tasks.workunit.client.1.smithi098.stdout:9/800: dread d2/d5/d18/d1d/d23/d5c/f87 [0,4194304] 0 2023-01-04T18:16:35.819 INFO:tasks.workunit.client.1.smithi098.stdout:9/801: write d2/d5/d18/d1d/f71 [5821602,35213] 0 2023-01-04T18:16:35.819 INFO:tasks.workunit.client.1.smithi098.stdout:9/802: dread - d2/d5/d18/d1d/d23/dad/fee zero size 2023-01-04T18:16:35.819 INFO:tasks.workunit.client.1.smithi098.stdout:9/803: chown d2/d5/d18/d1d/d23/d5c/lba 1725263627 1 2023-01-04T18:16:35.822 INFO:tasks.workunit.client.1.smithi098.stdout:6/810: mknod d9/dd/d4e/d67/cf8 0 2023-01-04T18:16:35.822 INFO:tasks.workunit.client.1.smithi098.stdout:5/815: sync 2023-01-04T18:16:35.824 INFO:tasks.workunit.client.1.smithi098.stdout:1/751: mknod d1/d8/dac/dfc/d6a/d106/c10e 0 2023-01-04T18:16:35.827 INFO:tasks.workunit.client.1.smithi098.stdout:8/807: mkdir d6/d11/d15/db0/df6 0 2023-01-04T18:16:35.828 INFO:tasks.workunit.client.1.smithi098.stdout:4/776: mknod d5/de/d30/c106 0 2023-01-04T18:16:35.829 INFO:tasks.workunit.client.1.smithi098.stdout:8/808: write d6/d92/fdb [5469461,111834] 0 2023-01-04T18:16:35.829 INFO:tasks.workunit.client.1.smithi098.stdout:2/806: mknod d6/dc/d2b/d42/d47/d1f/d39/c11f 0 2023-01-04T18:16:35.830 INFO:tasks.workunit.client.1.smithi098.stdout:9/804: creat d2/d5/d18/d1d/d23/d66/f105 x:0 0 0 2023-01-04T18:16:35.831 INFO:tasks.workunit.client.1.smithi098.stdout:6/811: creat d9/dd/d24/d64/ff9 x:0 0 0 2023-01-04T18:16:35.832 INFO:tasks.workunit.client.1.smithi098.stdout:4/777: creat d5/d28/d7d/db6/dbd/f107 x:0 0 0 2023-01-04T18:16:35.833 INFO:tasks.workunit.client.1.smithi098.stdout:6/812: creat d9/dda/dde/ffa x:0 0 0 2023-01-04T18:16:35.835 INFO:tasks.workunit.client.1.smithi098.stdout:8/809: write d6/d11/d15/d1b/f62 [3252780,77042] 0 2023-01-04T18:16:35.836 INFO:tasks.workunit.client.1.smithi098.stdout:6/813: rename d9/lba to d9/dd/de/d20/d82/d84/lfb 0 2023-01-04T18:16:35.841 INFO:tasks.workunit.client.1.smithi098.stdout:4/778: dread d5/d9/d13/d65/fd2 [0,4194304] 0 2023-01-04T18:16:35.844 INFO:tasks.workunit.client.1.smithi098.stdout:4/779: creat d5/d28/d7d/db6/dbd/dc5/d104/f108 x:0 0 0 2023-01-04T18:16:35.844 INFO:tasks.workunit.client.1.smithi098.stdout:4/780: stat d5/d28/d40/f4a 0 2023-01-04T18:16:35.846 INFO:tasks.workunit.client.1.smithi098.stdout:2/807: dread d6/ded/ff4 [0,4194304] 0 2023-01-04T18:16:35.848 INFO:tasks.workunit.client.1.smithi098.stdout:4/781: read d5/de/d2c/f9a [2470214,95152] 0 2023-01-04T18:16:35.848 INFO:tasks.workunit.client.1.smithi098.stdout:2/808: read d6/dc/d2b/d42/d51/d79/da3/fcd [5083,4465] 0 2023-01-04T18:16:35.848 INFO:tasks.workunit.client.1.smithi098.stdout:6/814: dread d9/dd/de/d20/d82/fbe [0,4194304] 0 2023-01-04T18:16:35.849 INFO:tasks.workunit.client.1.smithi098.stdout:4/782: getdents d5/d28/d7d 0 2023-01-04T18:16:35.850 INFO:tasks.workunit.client.1.smithi098.stdout:6/815: dread d9/dd/de/d44/df0/d85/fc7 [0,4194304] 0 2023-01-04T18:16:35.850 INFO:tasks.workunit.client.1.smithi098.stdout:2/809: rename d6/dc/d2b/fce to d6/dc/d2b/d42/f120 0 2023-01-04T18:16:35.851 INFO:tasks.workunit.client.1.smithi098.stdout:4/783: truncate d5/de/d21/d9d/fea 582586 0 2023-01-04T18:16:35.851 INFO:tasks.workunit.client.1.smithi098.stdout:4/784: chown f4 683 1 2023-01-04T18:16:35.852 INFO:tasks.workunit.client.1.smithi098.stdout:6/816: mkdir d9/dd/d24/d3e/d86/dfc 0 2023-01-04T18:16:35.853 INFO:tasks.workunit.client.1.smithi098.stdout:2/810: creat d6/dc/d2b/d42/f121 x:0 0 0 2023-01-04T18:16:35.854 INFO:tasks.workunit.client.1.smithi098.stdout:4/785: mknod d5/de/d30/d4f/c109 0 2023-01-04T18:16:35.854 INFO:tasks.workunit.client.1.smithi098.stdout:4/786: chown d5/de/d21/f2d 60481 1 2023-01-04T18:16:35.854 INFO:tasks.workunit.client.1.smithi098.stdout:6/817: mkdir d9/dd/d24/d3e/dfd 0 2023-01-04T18:16:35.855 INFO:tasks.workunit.client.1.smithi098.stdout:4/787: symlink d5/d28/d7d/db6/dbd/l10a 0 2023-01-04T18:16:35.855 INFO:tasks.workunit.client.1.smithi098.stdout:4/788: read - d5/d28/d7d/db6/fde zero size 2023-01-04T18:16:35.856 INFO:tasks.workunit.client.1.smithi098.stdout:6/818: unlink d9/dd/d4e/f92 0 2023-01-04T18:16:35.859 INFO:tasks.workunit.client.1.smithi098.stdout:0/788: dwrite df/d17/d1c/d3b/d98/f5a [0,4194304] 0 2023-01-04T18:16:35.859 INFO:tasks.workunit.client.1.smithi098.stdout:6/819: write d9/fa [1849211,54712] 0 2023-01-04T18:16:35.860 INFO:tasks.workunit.client.1.smithi098.stdout:5/816: dwrite d1/d1e/dab/dd5/d102/d44/d80/dc6/fca [0,4194304] 0 2023-01-04T18:16:35.860 INFO:tasks.workunit.client.1.smithi098.stdout:3/905: dwrite d6/d10/fbf [0,4194304] 0 2023-01-04T18:16:35.862 INFO:tasks.workunit.client.1.smithi098.stdout:9/805: dwrite d2/d5/d18/d19/f54 [4194304,4194304] 0 2023-01-04T18:16:35.864 INFO:tasks.workunit.client.1.smithi098.stdout:2/811: dread d6/dc/d2b/d32/fa2 [0,4194304] 0 2023-01-04T18:16:35.868 INFO:tasks.workunit.client.1.smithi098.stdout:5/817: mkdir d1/db0/ddc/d103 0 2023-01-04T18:16:35.868 INFO:tasks.workunit.client.1.smithi098.stdout:5/818: write d1/f6 [1802211,26304] 0 2023-01-04T18:16:35.869 INFO:tasks.workunit.client.1.smithi098.stdout:3/906: chown d6/d10/d19/l8e 1935 1 2023-01-04T18:16:35.870 INFO:tasks.workunit.client.1.smithi098.stdout:3/907: chown d6/d10/d19/d3f/d5e/d74/fa6 6 1 2023-01-04T18:16:35.871 INFO:tasks.workunit.client.1.smithi098.stdout:9/806: creat d2/d5/d18/d1d/d23/d5c/deb/f106 x:0 0 0 2023-01-04T18:16:35.873 INFO:tasks.workunit.client.1.smithi098.stdout:2/812: getdents d6/dc/d2b/d42/d47/d35 0 2023-01-04T18:16:35.875 INFO:tasks.workunit.client.1.smithi098.stdout:6/820: rmdir d9/dd/d4e/d67 39 2023-01-04T18:16:35.876 INFO:tasks.workunit.client.1.smithi098.stdout:6/821: write d9/dd/de/d26/f62 [915731,128418] 0 2023-01-04T18:16:35.876 INFO:tasks.workunit.client.1.smithi098.stdout:4/789: dwrite d5/d28/d44/f77 [0,4194304] 0 2023-01-04T18:16:35.876 INFO:tasks.workunit.client.1.smithi098.stdout:4/790: fsync d5/d28/d40/d5d/f70 0 2023-01-04T18:16:35.876 INFO:tasks.workunit.client.1.smithi098.stdout:5/819: symlink d1/d1e/dab/dd5/d102/l104 0 2023-01-04T18:16:35.878 INFO:tasks.workunit.client.1.smithi098.stdout:0/789: dwrite df/d17/d1c/d2c/d41/d64/fce [0,4194304] 0 2023-01-04T18:16:35.878 INFO:tasks.workunit.client.1.smithi098.stdout:0/790: readlink df/l20 0 2023-01-04T18:16:35.878 INFO:tasks.workunit.client.1.smithi098.stdout:0/791: chown df/d17/d9b/da4/f76 1 1 2023-01-04T18:16:35.879 INFO:tasks.workunit.client.1.smithi098.stdout:0/792: chown df/d17/d1c/d2c/d41/d105 1088175752 1 2023-01-04T18:16:35.879 INFO:tasks.workunit.client.1.smithi098.stdout:0/793: readlink df/d4f/d6b/l71 0 2023-01-04T18:16:35.879 INFO:tasks.workunit.client.1.smithi098.stdout:3/908: link d6/d10/dc0/fcb d6/d56/d9f/da8/f13e 0 2023-01-04T18:16:35.888 INFO:tasks.workunit.client.1.smithi098.stdout:9/807: symlink d2/d2d/l107 0 2023-01-04T18:16:35.890 INFO:tasks.workunit.client.1.smithi098.stdout:2/813: mknod d6/dc/d2b/d42/d47/d1f/dee/c122 0 2023-01-04T18:16:35.891 INFO:tasks.workunit.client.1.smithi098.stdout:6/822: creat d9/dda/dde/ffe x:0 0 0 2023-01-04T18:16:35.892 INFO:tasks.workunit.client.1.smithi098.stdout:4/791: creat d5/d28/d44/f10b x:0 0 0 2023-01-04T18:16:35.892 INFO:tasks.workunit.client.1.smithi098.stdout:4/792: write d5/f93 [487632,82736] 0 2023-01-04T18:16:35.892 INFO:tasks.workunit.client.1.smithi098.stdout:5/820: getdents d1/d2f/d66 0 2023-01-04T18:16:35.893 INFO:tasks.workunit.client.1.smithi098.stdout:4/793: write d5/d9/f36 [2128759,68268] 0 2023-01-04T18:16:35.899 INFO:tasks.workunit.client.1.smithi098.stdout:0/794: unlink df/d17/d1c/d2c/d41/d4a/le9 0 2023-01-04T18:16:35.900 INFO:tasks.workunit.client.1.smithi098.stdout:3/909: mkdir d6/d56/d9f/d13f 0 2023-01-04T18:16:35.900 INFO:tasks.workunit.client.1.smithi098.stdout:3/910: dread - d6/d10/d19/d3f/d46/ff2 zero size 2023-01-04T18:16:35.900 INFO:tasks.workunit.client.1.smithi098.stdout:3/911: dread - d6/d10/d19/d3f/d5e/d7d/dec/dda/d134/fae zero size 2023-01-04T18:16:35.901 INFO:tasks.workunit.client.1.smithi098.stdout:2/814: link d6/dc/d2b/d42/d47/d1f/d39/d6e/f77 d6/dc/d2b/d42/d51/de1/f123 0 2023-01-04T18:16:35.902 INFO:tasks.workunit.client.1.smithi098.stdout:5/821: truncate d1/d2/fbe 953204 0 2023-01-04T18:16:35.902 INFO:tasks.workunit.client.1.smithi098.stdout:5/822: readlink d1/d38/d3b/l85 0 2023-01-04T18:16:35.903 INFO:tasks.workunit.client.1.smithi098.stdout:5/823: chown d1/d2f 98569 1 2023-01-04T18:16:35.903 INFO:tasks.workunit.client.1.smithi098.stdout:7/809: sync 2023-01-04T18:16:35.904 INFO:tasks.workunit.client.1.smithi098.stdout:4/794: creat d5/d28/d40/d5d/dcf/de9/f10c x:0 0 0 2023-01-04T18:16:35.905 INFO:tasks.workunit.client.1.smithi098.stdout:0/795: symlink df/l10d 0 2023-01-04T18:16:35.905 INFO:tasks.workunit.client.1.smithi098.stdout:0/796: write df/d17/d1c/d2c/d104/f91 [1437967,128841] 0 2023-01-04T18:16:35.906 INFO:tasks.workunit.client.1.smithi098.stdout:3/912: unlink d6/d56/d9f/da8/fe7 0 2023-01-04T18:16:35.907 INFO:tasks.workunit.client.1.smithi098.stdout:7/810: unlink d1/d23/d37/l84 0 2023-01-04T18:16:35.908 INFO:tasks.workunit.client.1.smithi098.stdout:4/795: symlink d5/d28/d7d/l10d 0 2023-01-04T18:16:35.909 INFO:tasks.workunit.client.1.smithi098.stdout:0/797: creat df/d17/d1c/d2c/d41/d4a/d4c/d8e/f10e x:0 0 0 2023-01-04T18:16:35.910 INFO:tasks.workunit.client.1.smithi098.stdout:3/913: rename d6/d10/d19/d3f/c31 to d6/d10/df8/c140 0 2023-01-04T18:16:35.911 INFO:tasks.workunit.client.1.smithi098.stdout:2/815: symlink d6/dc/d2b/d42/d47/l124 0 2023-01-04T18:16:35.911 INFO:tasks.workunit.client.1.smithi098.stdout:7/811: creat d1/d51/d26/d28/f11e x:0 0 0 2023-01-04T18:16:35.912 INFO:tasks.workunit.client.1.smithi098.stdout:4/796: getdents d5/dad/d83 0 2023-01-04T18:16:35.913 INFO:tasks.workunit.client.1.smithi098.stdout:4/797: write d5/d28/d7d/db6/dbd/fd6 [3809333,71806] 0 2023-01-04T18:16:35.913 INFO:tasks.workunit.client.1.smithi098.stdout:0/798: creat df/d4f/d6e/daf/f10f x:0 0 0 2023-01-04T18:16:35.914 INFO:tasks.workunit.client.1.smithi098.stdout:3/914: symlink d6/d10/d19/d3f/d5e/d7d/d90/de6/l141 0 2023-01-04T18:16:35.916 INFO:tasks.workunit.client.1.smithi098.stdout:2/816: rename d6/dc/d2b/d42/d47/d1f/f91 to d6/dc/d2b/d42/d51/d79/f125 0 2023-01-04T18:16:35.918 INFO:tasks.workunit.client.1.smithi098.stdout:7/812: symlink d1/d23/d37/l11f 0 2023-01-04T18:16:35.918 INFO:tasks.workunit.client.1.smithi098.stdout:2/817: dread d6/dc/d2b/d42/d47/d1f/d39/f80 [0,4194304] 0 2023-01-04T18:16:35.919 INFO:tasks.workunit.client.1.smithi098.stdout:4/798: symlink d5/d28/d7d/db6/l10e 0 2023-01-04T18:16:35.919 INFO:tasks.workunit.client.1.smithi098.stdout:2/818: write d6/dc/d2b/d42/d47/d1f/d39/d6e/fb0 [566269,115900] 0 2023-01-04T18:16:35.919 INFO:tasks.workunit.client.1.smithi098.stdout:2/819: write d6/dc/d4b/f63 [839983,535] 0 2023-01-04T18:16:35.919 INFO:tasks.workunit.client.1.smithi098.stdout:7/813: mknod d1/d4/d11/d9d/dd0/c120 0 2023-01-04T18:16:35.920 INFO:tasks.workunit.client.1.smithi098.stdout:7/814: dread - d1/d23/d37/d40/f10a zero size 2023-01-04T18:16:35.920 INFO:tasks.workunit.client.1.smithi098.stdout:0/799: write df/d17/d1c/f22 [383658,49992] 0 2023-01-04T18:16:35.920 INFO:tasks.workunit.client.1.smithi098.stdout:4/799: mknod d5/de/c10f 0 2023-01-04T18:16:35.921 INFO:tasks.workunit.client.1.smithi098.stdout:2/820: mknod d6/dc/d2b/d42/d47/d35/c126 0 2023-01-04T18:16:35.921 INFO:tasks.workunit.client.1.smithi098.stdout:2/821: write d6/dc/d2b/d42/d47/d1f/d39/d6e/fb0 [565324,78172] 0 2023-01-04T18:16:35.922 INFO:tasks.workunit.client.1.smithi098.stdout:7/815: getdents d1/dc1 0 2023-01-04T18:16:35.926 INFO:tasks.workunit.client.1.smithi098.stdout:5/824: dread d1/d46/d6a/f6d [0,4194304] 0 2023-01-04T18:16:35.926 INFO:tasks.workunit.client.1.smithi098.stdout:5/825: truncate d1/d1e/dab/dd5/d102/d44/d45/fb8 706703 0 2023-01-04T18:16:35.926 INFO:tasks.workunit.client.1.smithi098.stdout:5/826: write d1/d2/d14/fad [19625,80183] 0 2023-01-04T18:16:35.927 INFO:tasks.workunit.client.1.smithi098.stdout:0/800: mkdir df/d17/d9b/d86/d110 0 2023-01-04T18:16:35.928 INFO:tasks.workunit.client.1.smithi098.stdout:4/800: unlink d5/f38 0 2023-01-04T18:16:35.932 INFO:tasks.workunit.client.1.smithi098.stdout:2/822: stat d6/dc/l95 0 2023-01-04T18:16:35.932 INFO:tasks.workunit.client.1.smithi098.stdout:2/823: readlink d6/dc/d2b/d42/d47/d1f/lfe 0 2023-01-04T18:16:35.932 INFO:tasks.workunit.client.1.smithi098.stdout:7/816: symlink d1/d23/d21/d7f/de4/l121 0 2023-01-04T18:16:35.934 INFO:tasks.workunit.client.1.smithi098.stdout:5/827: symlink d1/d1e/dab/dd5/d102/d44/d80/dbd/l105 0 2023-01-04T18:16:35.936 INFO:tasks.workunit.client.1.smithi098.stdout:0/801: rename df/d17/d1c/d2c/d41/d4a/d7a/c85 to df/d4f/dc7/c111 0 2023-01-04T18:16:35.938 INFO:tasks.workunit.client.1.smithi098.stdout:4/801: creat d5/d28/d7d/db6/de4/f110 x:0 0 0 2023-01-04T18:16:35.942 INFO:tasks.workunit.client.1.smithi098.stdout:2/824: creat d6/dc/d2b/d42/d51/d79/f127 x:0 0 0 2023-01-04T18:16:35.944 INFO:tasks.workunit.client.1.smithi098.stdout:5/828: rename d1/d2f/d66/d75/da5 to d1/d1e/dab/dd5/d102/d44/d45/d4b/dec/d106 0 2023-01-04T18:16:35.947 INFO:tasks.workunit.client.1.smithi098.stdout:0/802: getdents df/d17/d9b/d86/de7 0 2023-01-04T18:16:35.947 INFO:tasks.workunit.client.1.smithi098.stdout:4/802: creat d5/d9/d13/f111 x:0 0 0 2023-01-04T18:16:35.948 INFO:tasks.workunit.client.1.smithi098.stdout:4/803: fdatasync d5/dad/f99 0 2023-01-04T18:16:35.948 INFO:tasks.workunit.client.1.smithi098.stdout:2/825: truncate d6/dc/d2b/d46/dd2/fe6 286197 0 2023-01-04T18:16:35.951 INFO:tasks.workunit.client.1.smithi098.stdout:4/804: mknod d5/de/d2c/dcb/de6/c112 0 2023-01-04T18:16:35.952 INFO:tasks.workunit.client.1.smithi098.stdout:7/817: dwrite d1/d2e/f4c [0,4194304] 0 2023-01-04T18:16:35.953 INFO:tasks.workunit.client.1.smithi098.stdout:7/818: write d1/d51/f19 [2166448,112912] 0 2023-01-04T18:16:35.953 INFO:tasks.workunit.client.1.smithi098.stdout:7/819: chown d1/d2e/fb8 2983430 1 2023-01-04T18:16:35.953 INFO:tasks.workunit.client.1.smithi098.stdout:7/820: dread - d1/d4/fa8 zero size 2023-01-04T18:16:35.953 INFO:tasks.workunit.client.1.smithi098.stdout:7/821: fsync d1/d51/d26/f8a 0 2023-01-04T18:16:35.955 INFO:tasks.workunit.client.1.smithi098.stdout:0/803: dread df/d4f/d6e/daf/fd0 [0,4194304] 0 2023-01-04T18:16:36.003 INFO:tasks.workunit.client.1.smithi098.stdout:2/826: unlink d6/dc/d2b/d42/d47/c110 0 2023-01-04T18:16:36.003 INFO:tasks.workunit.client.1.smithi098.stdout:2/827: dread - d6/dc/d2b/d42/d51/d79/f127 zero size 2023-01-04T18:16:36.004 INFO:tasks.workunit.client.1.smithi098.stdout:4/805: rename d5/de/d2c/l5b to d5/d28/d7d/db6/dd8/l113 0 2023-01-04T18:16:36.005 INFO:tasks.workunit.client.1.smithi098.stdout:4/806: write d5/fbb [276161,75512] 0 2023-01-04T18:16:36.005 INFO:tasks.workunit.client.1.smithi098.stdout:5/829: dwrite d1/d2f/d73/ffb [0,4194304] 0 2023-01-04T18:16:36.015 INFO:tasks.workunit.client.1.smithi098.stdout:7/822: dwrite d1/d23/d21/f4f [0,4194304] 0 2023-01-04T18:16:36.022 INFO:tasks.workunit.client.1.smithi098.stdout:5/830: dwrite d1/d1e/dab/dd5/d102/d44/d80/dcf/ffc [0,4194304] 0 2023-01-04T18:16:36.043 INFO:tasks.workunit.client.1.smithi098.stdout:0/804: rmdir df/d4f/d6b 39 2023-01-04T18:16:36.043 INFO:tasks.workunit.client.1.smithi098.stdout:0/805: write df/d17/d9b/da4/f103 [450711,105644] 0 2023-01-04T18:16:36.047 INFO:tasks.workunit.client.1.smithi098.stdout:2/828: creat d6/dc/d2b/d42/d47/da5/dda/d111/f128 x:0 0 0 2023-01-04T18:16:36.052 INFO:tasks.workunit.client.1.smithi098.stdout:7/823: mknod d1/d4/d11/d9d/dd0/c122 0 2023-01-04T18:16:36.054 INFO:tasks.workunit.client.1.smithi098.stdout:5/831: creat d1/d2/f107 x:0 0 0 2023-01-04T18:16:36.055 INFO:tasks.workunit.client.1.smithi098.stdout:5/832: write d1/d1e/dab/dd5/d102/d44/d80/fa2 [108711,111780] 0 2023-01-04T18:16:36.055 INFO:tasks.workunit.client.1.smithi098.stdout:5/833: fsync d1/d2/d14/d59/fcd 0 2023-01-04T18:16:36.056 INFO:tasks.workunit.client.1.smithi098.stdout:2/829: getdents d6/dc/d2b/d42/d51/d79/da3/db5 0 2023-01-04T18:16:36.056 INFO:tasks.workunit.client.1.smithi098.stdout:2/830: chown d6/dc/d2b/fad 11809 1 2023-01-04T18:16:36.056 INFO:tasks.workunit.client.1.smithi098.stdout:7/824: mknod d1/d23/d37/d78/c123 0 2023-01-04T18:16:36.058 INFO:tasks.workunit.client.1.smithi098.stdout:5/834: link d1/d2/d14/ld8 d1/d1e/dab/dd5/d102/d44/d80/dcf/l108 0 2023-01-04T18:16:36.059 INFO:tasks.workunit.client.1.smithi098.stdout:6/823: sync 2023-01-04T18:16:36.059 INFO:tasks.workunit.client.1.smithi098.stdout:9/808: sync 2023-01-04T18:16:36.059 INFO:tasks.workunit.client.1.smithi098.stdout:1/752: sync 2023-01-04T18:16:36.059 INFO:tasks.workunit.client.1.smithi098.stdout:8/810: sync 2023-01-04T18:16:36.059 INFO:tasks.workunit.client.1.smithi098.stdout:3/915: sync 2023-01-04T18:16:36.059 INFO:tasks.workunit.client.1.smithi098.stdout:3/916: stat d6/d10/dc0/f10d 0 2023-01-04T18:16:36.060 INFO:tasks.workunit.client.1.smithi098.stdout:8/811: truncate d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/fa2 1524164 0 2023-01-04T18:16:36.060 INFO:tasks.workunit.client.1.smithi098.stdout:2/831: creat d6/dc/d2b/d42/f129 x:0 0 0 2023-01-04T18:16:36.060 INFO:tasks.workunit.client.1.smithi098.stdout:0/806: dwrite df/d17/d1c/d2c/d41/d4a/f65 [0,4194304] 0 2023-01-04T18:16:36.062 INFO:tasks.workunit.client.1.smithi098.stdout:7/825: creat d1/d51/d26/d28/d2d/d75/f124 x:0 0 0 2023-01-04T18:16:36.062 INFO:tasks.workunit.client.1.smithi098.stdout:6/824: dread d9/dd/d4e/f58 [0,4194304] 0 2023-01-04T18:16:36.063 INFO:tasks.workunit.client.1.smithi098.stdout:5/835: mknod d1/db0/ddc/d103/c109 0 2023-01-04T18:16:36.063 INFO:tasks.workunit.client.1.smithi098.stdout:5/836: stat d1/d1e/l2c 0 2023-01-04T18:16:36.064 INFO:tasks.workunit.client.1.smithi098.stdout:1/753: creat d1/da9/de3/dec/df9/f10f x:0 0 0 2023-01-04T18:16:36.064 INFO:tasks.workunit.client.1.smithi098.stdout:1/754: truncate d1/d8/f10 1711249 0 2023-01-04T18:16:36.067 INFO:tasks.workunit.client.1.smithi098.stdout:9/809: mkdir d2/d5/d18/d1d/d23/dad/d72/d9e/d108 0 2023-01-04T18:16:36.067 INFO:tasks.workunit.client.1.smithi098.stdout:8/812: mknod d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/d8a/ddd/cf7 0 2023-01-04T18:16:36.068 INFO:tasks.workunit.client.1.smithi098.stdout:2/832: creat d6/dc/d2b/d32/d10a/f12a x:0 0 0 2023-01-04T18:16:36.070 INFO:tasks.workunit.client.1.smithi098.stdout:0/807: symlink df/d17/d1c/d2c/d41/d4a/d4c/d8e/l112 0 2023-01-04T18:16:36.071 INFO:tasks.workunit.client.1.smithi098.stdout:7/826: link d1/da/c74 d1/d23/d37/d78/d103/c125 0 2023-01-04T18:16:36.072 INFO:tasks.workunit.client.1.smithi098.stdout:5/837: creat d1/d38/dce/f10a x:0 0 0 2023-01-04T18:16:36.074 INFO:tasks.workunit.client.1.smithi098.stdout:9/810: creat d2/d5/d18/dc6/f109 x:0 0 0 2023-01-04T18:16:36.075 INFO:tasks.workunit.client.1.smithi098.stdout:8/813: creat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/d8a/ddd/df5/ff8 x:0 0 0 2023-01-04T18:16:36.075 INFO:tasks.workunit.client.1.smithi098.stdout:8/814: truncate d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/f73 1347513 0 2023-01-04T18:16:36.076 INFO:tasks.workunit.client.1.smithi098.stdout:2/833: mkdir d6/dc/d2b/d42/d51/de1/d12b 0 2023-01-04T18:16:36.079 INFO:tasks.workunit.client.1.smithi098.stdout:6/825: dwrite d9/dd/d24/f30 [0,4194304] 0 2023-01-04T18:16:36.079 INFO:tasks.workunit.client.1.smithi098.stdout:6/826: chown d9/dd/d4e/d67/db6/de9 2 1 2023-01-04T18:16:36.079 INFO:tasks.workunit.client.1.smithi098.stdout:6/827: write d9/dd/de/fa2 [9109104,2686] 0 2023-01-04T18:16:36.080 INFO:tasks.workunit.client.1.smithi098.stdout:0/808: symlink df/d4f/d6b/d75/l113 0 2023-01-04T18:16:36.080 INFO:tasks.workunit.client.1.smithi098.stdout:0/809: fdatasync df/d17/d1c/f1e 0 2023-01-04T18:16:36.080 INFO:tasks.workunit.client.1.smithi098.stdout:9/811: getdents d2/d5/d18 0 2023-01-04T18:16:36.080 INFO:tasks.workunit.client.1.smithi098.stdout:9/812: truncate d2/d5/d18/d1d/d23/dad/dfa/d42/d89/fe7 4368857 0 2023-01-04T18:16:36.081 INFO:tasks.workunit.client.1.smithi098.stdout:1/755: rename d1/d8/dac/dfc/d27/d77/c2c to d1/d8/dac/dfc/d39/d10d/c110 0 2023-01-04T18:16:36.082 INFO:tasks.workunit.client.1.smithi098.stdout:3/917: dwrite d6/d10/d19/d3f/d5e/d74/f52 [0,4194304] 0 2023-01-04T18:16:36.082 INFO:tasks.workunit.client.1.smithi098.stdout:3/918: chown d6/d10/d19/d3f/d5e/f67 5995963 1 2023-01-04T18:16:36.084 INFO:tasks.workunit.client.1.smithi098.stdout:7/827: dread d1/d4/f29 [0,4194304] 0 2023-01-04T18:16:36.086 INFO:tasks.workunit.client.1.smithi098.stdout:2/834: symlink d6/dc/d2b/d42/d47/d1f/l12c 0 2023-01-04T18:16:36.089 INFO:tasks.workunit.client.1.smithi098.stdout:5/838: rename d1/d1e/dab/dd5/d102/d44/d45/d4b/l60 to d1/d1e/dab/dd5/d102/d44/d80/dbd/l10b 0 2023-01-04T18:16:36.090 INFO:tasks.workunit.client.1.smithi098.stdout:6/828: dread d9/dd/de/d26/f97 [4194304,4194304] 0 2023-01-04T18:16:36.090 INFO:tasks.workunit.client.1.smithi098.stdout:3/919: symlink d6/d56/d9f/d13f/l142 0 2023-01-04T18:16:36.090 INFO:tasks.workunit.client.1.smithi098.stdout:3/920: stat d6/d6f/db6/f133 0 2023-01-04T18:16:36.092 INFO:tasks.workunit.client.1.smithi098.stdout:7/828: creat d1/d23/d37/d40/d94/f126 x:0 0 0 2023-01-04T18:16:36.092 INFO:tasks.workunit.client.1.smithi098.stdout:7/829: read d1/d51/d26/d28/d2d/f5f [616929,103851] 0 2023-01-04T18:16:36.093 INFO:tasks.workunit.client.1.smithi098.stdout:2/835: mkdir d6/dc/d2b/d42/d51/de1/d12b/d12d 0 2023-01-04T18:16:36.100 INFO:tasks.workunit.client.1.smithi098.stdout:0/810: rename df/d17/d1c/d3b/d98/c59 to df/d17/d1c/d2c/c114 0 2023-01-04T18:16:36.101 INFO:tasks.workunit.client.1.smithi098.stdout:0/811: stat df/d17/f2a 0 2023-01-04T18:16:36.101 INFO:tasks.workunit.client.1.smithi098.stdout:0/812: chown df/d17/d68 3755544 1 2023-01-04T18:16:36.101 INFO:tasks.workunit.client.1.smithi098.stdout:0/813: chown df/d4f/d6b/d75/ld4 134990373 1 2023-01-04T18:16:36.101 INFO:tasks.workunit.client.1.smithi098.stdout:6/829: creat d9/dd/d24/d3e/d86/d9b/fff x:0 0 0 2023-01-04T18:16:36.101 INFO:tasks.workunit.client.1.smithi098.stdout:3/921: creat d6/d10/d19/d3f/d5e/f143 x:0 0 0 2023-01-04T18:16:36.106 INFO:tasks.workunit.client.1.smithi098.stdout:2/836: creat d6/dc/d2b/d42/d51/d79/da3/f12e x:0 0 0 2023-01-04T18:16:36.107 INFO:tasks.workunit.client.1.smithi098.stdout:2/837: write d6/dc/d2b/d42/d47/da5/dda/fde [587901,42174] 0 2023-01-04T18:16:36.107 INFO:tasks.workunit.client.1.smithi098.stdout:2/838: chown d6/dc/d2b/d42/d47/da5/dda/d111 546976 1 2023-01-04T18:16:36.107 INFO:tasks.workunit.client.1.smithi098.stdout:2/839: write d6/dc/d2b/d42/d51/d79/da3/ff3 [593214,37963] 0 2023-01-04T18:16:36.107 INFO:tasks.workunit.client.1.smithi098.stdout:2/840: chown d6/dc/d2b/d42/d51/fe3 11 1 2023-01-04T18:16:36.107 INFO:tasks.workunit.client.1.smithi098.stdout:2/841: readlink d6/dc/d2b/d42/d47/l124 0 2023-01-04T18:16:36.107 INFO:tasks.workunit.client.1.smithi098.stdout:2/842: stat d6/dc/d2b/d42/f120 0 2023-01-04T18:16:36.107 INFO:tasks.workunit.client.1.smithi098.stdout:2/843: write d6/dc/d2b/f11a [629125,92441] 0 2023-01-04T18:16:36.107 INFO:tasks.workunit.client.1.smithi098.stdout:5/839: rename d1/d2/d14/d59/fcd to d1/d2f/d73/f10c 0 2023-01-04T18:16:36.108 INFO:tasks.workunit.client.1.smithi098.stdout:0/814: mkdir df/d17/d9b/ddf/d115 0 2023-01-04T18:16:36.108 INFO:tasks.workunit.client.1.smithi098.stdout:0/815: write df/d17/d24/f44 [4225730,33024] 0 2023-01-04T18:16:36.110 INFO:tasks.workunit.client.1.smithi098.stdout:3/922: creat d6/d10/d29/d6a/dd1/f144 x:0 0 0 2023-01-04T18:16:36.110 INFO:tasks.workunit.client.1.smithi098.stdout:3/923: chown d6/d10/d19/d3f/d5e/d7d/dec 216 1 2023-01-04T18:16:36.110 INFO:tasks.workunit.client.1.smithi098.stdout:3/924: chown d6/d10/d19/d3f/d5e/d7d/d90/f107 12339382 1 2023-01-04T18:16:36.111 INFO:tasks.workunit.client.1.smithi098.stdout:1/756: dwrite d1/d8/dac/dea/fbc [0,4194304] 0 2023-01-04T18:16:36.112 INFO:tasks.workunit.client.1.smithi098.stdout:2/844: creat d6/dc/d2b/d42/d47/d1f/dee/f12f x:0 0 0 2023-01-04T18:16:36.114 INFO:tasks.workunit.client.1.smithi098.stdout:6/830: rename d9/dd/d4e/d67/db6/de9/lf6 to d9/dd/de/d26/l100 0 2023-01-04T18:16:36.115 INFO:tasks.workunit.client.1.smithi098.stdout:3/925: mkdir d6/d10/d19/d3f/d5e/d145 0 2023-01-04T18:16:36.118 INFO:tasks.workunit.client.1.smithi098.stdout:1/757: creat d1/d8/da/dae/f111 x:0 0 0 2023-01-04T18:16:36.119 INFO:tasks.workunit.client.1.smithi098.stdout:5/840: dread d1/d2f/d73/f10c [0,4194304] 0 2023-01-04T18:16:36.119 INFO:tasks.workunit.client.1.smithi098.stdout:5/841: write d1/fc [4029462,46836] 0 2023-01-04T18:16:36.119 INFO:tasks.workunit.client.1.smithi098.stdout:5/842: chown d1/d1e/dab/dd5/d102/d44/d80/dbd 8090 1 2023-01-04T18:16:36.120 INFO:tasks.workunit.client.1.smithi098.stdout:3/926: symlink d6/d10/d29/dc3/l146 0 2023-01-04T18:16:36.120 INFO:tasks.workunit.client.1.smithi098.stdout:2/845: write d6/dc/d2b/d42/d47/d1f/faf [1589172,119752] 0 2023-01-04T18:16:36.120 INFO:tasks.workunit.client.1.smithi098.stdout:8/815: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/fb7 [0,4194304] 0 2023-01-04T18:16:36.121 INFO:tasks.workunit.client.1.smithi098.stdout:8/816: chown d6/d11/d15/d1b/d2a/d3b 95 1 2023-01-04T18:16:36.122 INFO:tasks.workunit.client.1.smithi098.stdout:5/843: dread d1/d1e/dab/dd5/d102/d44/f70 [0,4194304] 0 2023-01-04T18:16:36.123 INFO:tasks.workunit.client.1.smithi098.stdout:1/758: unlink d1/d8/dac/dfc/d36/c42 0 2023-01-04T18:16:36.123 INFO:tasks.workunit.client.1.smithi098.stdout:9/813: dwrite d2/df6/d26/d41/f6a [0,4194304] 0 2023-01-04T18:16:36.124 INFO:tasks.workunit.client.1.smithi098.stdout:8/817: truncate d6/d11/d15/d1b/f93 3211468 0 2023-01-04T18:16:36.124 INFO:tasks.workunit.client.1.smithi098.stdout:8/818: chown d6/d11/d15/db4/dba 1221369 1 2023-01-04T18:16:36.124 INFO:tasks.workunit.client.1.smithi098.stdout:3/927: symlink d6/d10/db7/de1/l147 0 2023-01-04T18:16:36.124 INFO:tasks.workunit.client.1.smithi098.stdout:3/928: truncate d6/d10/d19/d3f/d5e/d7d/fff 410407 0 2023-01-04T18:16:36.125 INFO:tasks.workunit.client.1.smithi098.stdout:5/844: mkdir d1/d2f/d73/d10d 0 2023-01-04T18:16:36.125 INFO:tasks.workunit.client.1.smithi098.stdout:5/845: write d1/d46/dc4/fd4 [459595,22324] 0 2023-01-04T18:16:36.126 INFO:tasks.workunit.client.1.smithi098.stdout:6/831: dread d9/dd/de/d20/f5d [0,4194304] 0 2023-01-04T18:16:36.128 INFO:tasks.workunit.client.1.smithi098.stdout:1/759: rename d1/d8/da/lda to d1/d8/l112 0 2023-01-04T18:16:36.128 INFO:tasks.workunit.client.1.smithi098.stdout:7/830: dwrite d1/d51/f19 [0,4194304] 0 2023-01-04T18:16:36.128 INFO:tasks.workunit.client.1.smithi098.stdout:9/814: dread d2/d5/d18/d1d/dc0/fcc [0,4194304] 0 2023-01-04T18:16:36.128 INFO:tasks.workunit.client.1.smithi098.stdout:8/819: creat d6/d11/d15/ff9 x:0 0 0 2023-01-04T18:16:36.128 INFO:tasks.workunit.client.1.smithi098.stdout:9/815: chown d2/d5/d18/d19/d82/cc9 13 1 2023-01-04T18:16:36.128 INFO:tasks.workunit.client.1.smithi098.stdout:3/929: link d6/d56/d9f/da8/dfd/f131 d6/d10/d19/d3f/d46/f148 0 2023-01-04T18:16:36.129 INFO:tasks.workunit.client.1.smithi098.stdout:3/930: fdatasync d6/d10/d19/d3f/d5e/d7d/d116/f11f 0 2023-01-04T18:16:36.130 INFO:tasks.workunit.client.1.smithi098.stdout:9/816: dread d2/d53/f65 [0,4194304] 0 2023-01-04T18:16:36.130 INFO:tasks.workunit.client.1.smithi098.stdout:7/831: dread d1/d23/d21/d43/f9e [0,4194304] 0 2023-01-04T18:16:36.130 INFO:tasks.workunit.client.1.smithi098.stdout:9/817: chown d2/d2d/f8d 22 1 2023-01-04T18:16:36.131 INFO:tasks.workunit.client.1.smithi098.stdout:5/846: creat d1/d1e/dab/dd5/d102/d44/d45/d4b/dec/f10e x:0 0 0 2023-01-04T18:16:36.132 INFO:tasks.workunit.client.1.smithi098.stdout:0/816: dwrite df/d17/d24/d80/f8f [0,4194304] 0 2023-01-04T18:16:36.132 INFO:tasks.workunit.client.1.smithi098.stdout:6/832: unlink d9/dd/de/d20/f3f 0 2023-01-04T18:16:36.133 INFO:tasks.workunit.client.1.smithi098.stdout:6/833: readlink d9/dd/d15/l31 0 2023-01-04T18:16:36.133 INFO:tasks.workunit.client.1.smithi098.stdout:6/834: write d9/dd/d24/d3e/f9d [279024,128893] 0 2023-01-04T18:16:36.135 INFO:tasks.workunit.client.1.smithi098.stdout:5/847: read d1/d46/dc4/fd4 [111199,59531] 0 2023-01-04T18:16:36.137 INFO:tasks.workunit.client.1.smithi098.stdout:8/820: dread d6/d11/d15/d1b/f62 [0,4194304] 0 2023-01-04T18:16:36.138 INFO:tasks.workunit.client.1.smithi098.stdout:8/821: dread - d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/fac zero size 2023-01-04T18:16:36.139 INFO:tasks.workunit.client.1.smithi098.stdout:7/832: dread d1/d2e/f35 [0,4194304] 0 2023-01-04T18:16:36.145 INFO:tasks.workunit.client.1.smithi098.stdout:3/931: dread d6/d10/dc0/f10d [0,4194304] 0 2023-01-04T18:16:36.152 INFO:tasks.workunit.client.1.smithi098.stdout:1/760: mkdir d1/d8/dac/dfc/d6a/d106/d113 0 2023-01-04T18:16:36.153 INFO:tasks.workunit.client.1.smithi098.stdout:9/818: link d2/d5/d6f/fd1 d2/d5/d18/d1d/d23/dad/dfa/ded/f10a 0 2023-01-04T18:16:36.156 INFO:tasks.workunit.client.1.smithi098.stdout:0/817: rename df/l20 to df/d17/d1c/d3b/de2/l116 0 2023-01-04T18:16:36.157 INFO:tasks.workunit.client.1.smithi098.stdout:5/848: mknod d1/d1e/dab/dd5/d102/d44/d80/c10f 0 2023-01-04T18:16:36.158 INFO:tasks.workunit.client.1.smithi098.stdout:1/761: dread d1/f44 [4194304,4194304] 0 2023-01-04T18:16:36.159 INFO:tasks.workunit.client.1.smithi098.stdout:8/822: mkdir d6/d11/d15/d1b/d2a/d6b/d7f/d12/dc2/dda/dfa 0 2023-01-04T18:16:36.160 INFO:tasks.workunit.client.1.smithi098.stdout:3/932: symlink d6/d10/d19/d3f/d5e/d7d/d90/l149 0 2023-01-04T18:16:36.161 INFO:tasks.workunit.client.1.smithi098.stdout:6/835: dwrite d9/dd/de/d44/d79/f80 [0,4194304] 0 2023-01-04T18:16:36.162 INFO:tasks.workunit.client.1.smithi098.stdout:6/836: chown d9/dd/c4a 19123 1 2023-01-04T18:16:36.162 INFO:tasks.workunit.client.1.smithi098.stdout:6/837: stat d9/dd/d4e/d67/d8d/d81 0 2023-01-04T18:16:36.163 INFO:tasks.workunit.client.1.smithi098.stdout:9/819: mkdir d2/d5/d18/db6/d10b 0 2023-01-04T18:16:36.164 INFO:tasks.workunit.client.1.smithi098.stdout:0/818: truncate df/d17/d24/f57 1690313 0 2023-01-04T18:16:36.170 INFO:tasks.workunit.client.1.smithi098.stdout:1/762: fsync d1/d8/da/dae/f58 0 2023-01-04T18:16:36.170 INFO:tasks.workunit.client.1.smithi098.stdout:1/763: chown d1/d8/dac/dfc/d36/d89/db3 276644301 1 2023-01-04T18:16:36.171 INFO:tasks.workunit.client.1.smithi098.stdout:4/807: sync 2023-01-04T18:16:36.171 INFO:tasks.workunit.client.1.smithi098.stdout:4/808: write d5/de/d30/f6f [346025,1409] 0 2023-01-04T18:16:36.175 INFO:tasks.workunit.client.1.smithi098.stdout:8/823: truncate d6/d11/d15/d1b/d2a/d6b/d7f/d5a/fc0 391533 0 2023-01-04T18:16:36.176 INFO:tasks.workunit.client.1.smithi098.stdout:7/833: dread d1/d51/d26/f8c [0,4194304] 0 2023-01-04T18:16:36.177 INFO:tasks.workunit.client.1.smithi098.stdout:3/933: creat d6/d10/d19/d3f/d5e/d7d/dec/dda/f14a x:0 0 0 2023-01-04T18:16:36.180 INFO:tasks.workunit.client.1.smithi098.stdout:6/838: creat d9/f101 x:0 0 0 2023-01-04T18:16:36.182 INFO:tasks.workunit.client.1.smithi098.stdout:9/820: mknod d2/d5/d18/d19/c10c 0 2023-01-04T18:16:36.183 INFO:tasks.workunit.client.1.smithi098.stdout:1/764: symlink d1/d8/dac/dfc/d36/d4e/d9f/l114 0 2023-01-04T18:16:36.184 INFO:tasks.workunit.client.1.smithi098.stdout:8/824: truncate d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/f8c 1587265 0 2023-01-04T18:16:36.184 INFO:tasks.workunit.client.1.smithi098.stdout:8/825: fdatasync d6/d11/d15/d1b/d2a/d6b/d7f/d5a/fcc 0 2023-01-04T18:16:36.186 INFO:tasks.workunit.client.1.smithi098.stdout:7/834: symlink d1/d23/d73/d85/dfd/d105/l127 0 2023-01-04T18:16:36.186 INFO:tasks.workunit.client.1.smithi098.stdout:7/835: fdatasync d1/d51/d26/f8a 0 2023-01-04T18:16:36.186 INFO:tasks.workunit.client.1.smithi098.stdout:7/836: fsync d1/da/f68 0 2023-01-04T18:16:36.186 INFO:tasks.workunit.client.1.smithi098.stdout:7/837: chown d1/d51/d26/d28/dc6/lf3 12445 1 2023-01-04T18:16:36.187 INFO:tasks.workunit.client.1.smithi098.stdout:3/934: getdents d6/d10/d29/dc3 0 2023-01-04T18:16:36.188 INFO:tasks.workunit.client.1.smithi098.stdout:6/839: truncate d9/dd/d4e/f8b 4066748 0 2023-01-04T18:16:36.190 INFO:tasks.workunit.client.1.smithi098.stdout:9/821: unlink d2/d5/d18/d1d/d23/dad/dfa/d42/ce2 0 2023-01-04T18:16:36.192 INFO:tasks.workunit.client.1.smithi098.stdout:8/826: creat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/d8a/ddd/df5/ffb x:0 0 0 2023-01-04T18:16:36.194 INFO:tasks.workunit.client.1.smithi098.stdout:6/840: rmdir d9/dd/d24/d3e/dfd 0 2023-01-04T18:16:36.195 INFO:tasks.workunit.client.1.smithi098.stdout:9/822: symlink d2/d53/daf/l10d 0 2023-01-04T18:16:36.195 INFO:tasks.workunit.client.1.smithi098.stdout:9/823: chown f1 14 1 2023-01-04T18:16:36.197 INFO:tasks.workunit.client.1.smithi098.stdout:1/765: creat d1/d8/da/dae/dfa/f115 x:0 0 0 2023-01-04T18:16:36.198 INFO:tasks.workunit.client.1.smithi098.stdout:8/827: truncate d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/fee 734130 0 2023-01-04T18:16:36.200 INFO:tasks.workunit.client.1.smithi098.stdout:6/841: rename d9/dd/de/d26/d71/c78 to d9/dd/de/d44/df0/d85/c102 0 2023-01-04T18:16:36.201 INFO:tasks.workunit.client.1.smithi098.stdout:9/824: mknod d2/d53/c10e 0 2023-01-04T18:16:36.202 INFO:tasks.workunit.client.1.smithi098.stdout:8/828: creat d6/d11/d15/db4/ffc x:0 0 0 2023-01-04T18:16:36.204 INFO:tasks.workunit.client.1.smithi098.stdout:6/842: mkdir d9/d103 0 2023-01-04T18:16:36.204 INFO:tasks.workunit.client.1.smithi098.stdout:6/843: stat d9/dd/de/l5c 0 2023-01-04T18:16:36.237 INFO:tasks.workunit.client.1.smithi098.stdout:0/819: dread df/d17/d68/fb2 [0,4194304] 0 2023-01-04T18:16:36.237 INFO:tasks.workunit.client.1.smithi098.stdout:0/820: fdatasync df/d17/d1c/d2c/d41/d4a/fda 0 2023-01-04T18:16:36.240 INFO:tasks.workunit.client.1.smithi098.stdout:7/838: write d1/d23/d37/f42 [1091366,5159] 0 2023-01-04T18:16:36.242 INFO:tasks.workunit.client.1.smithi098.stdout:0/821: write df/d17/d1c/d3b/d98/f82 [2907720,110563] 0 2023-01-04T18:16:36.242 INFO:tasks.workunit.client.1.smithi098.stdout:0/822: stat df/d17/d1c/d3b/f58 0 2023-01-04T18:16:36.244 INFO:tasks.workunit.client.1.smithi098.stdout:0/823: mknod df/d17/d9b/de5/c117 0 2023-01-04T18:16:36.245 INFO:tasks.workunit.client.1.smithi098.stdout:9/825: dread d2/d5/d18/d1d/d23/dad/dfa/d42/f64 [0,4194304] 0 2023-01-04T18:16:36.246 INFO:tasks.workunit.client.1.smithi098.stdout:9/826: chown d2/d5/d18/d1d 1 1 2023-01-04T18:16:36.246 INFO:tasks.workunit.client.1.smithi098.stdout:9/827: stat d2/df6/d26/d41/f85 0 2023-01-04T18:16:36.247 INFO:tasks.workunit.client.1.smithi098.stdout:9/828: mkdir d2/d5/d18/d19/d82/dce/d10f 0 2023-01-04T18:16:36.247 INFO:tasks.workunit.client.1.smithi098.stdout:9/829: write d2/d5/d18/d1d/d23/dad/dfa/d42/fe0 [137937,115582] 0 2023-01-04T18:16:36.249 INFO:tasks.workunit.client.1.smithi098.stdout:9/830: rmdir d2/d5/d18/d1d/d23 39 2023-01-04T18:16:36.268 INFO:tasks.workunit.client.1.smithi098.stdout:4/809: dwrite d5/dad/d83/fb8 [0,4194304] 0 2023-01-04T18:16:36.274 INFO:tasks.workunit.client.1.smithi098.stdout:4/810: creat d5/de/d30/f114 x:0 0 0 2023-01-04T18:16:36.274 INFO:tasks.workunit.client.1.smithi098.stdout:8/829: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/f2e [0,4194304] 0 2023-01-04T18:16:36.274 INFO:tasks.workunit.client.1.smithi098.stdout:8/830: chown d6/d11/d15/d1b/d2a/d6b/d9c/ca0 379262515 1 2023-01-04T18:16:36.274 INFO:tasks.workunit.client.1.smithi098.stdout:7/839: dwrite d1/d51/dc0/fdd [0,4194304] 0 2023-01-04T18:16:36.276 INFO:tasks.workunit.client.1.smithi098.stdout:4/811: creat d5/de/d21/d96/f115 x:0 0 0 2023-01-04T18:16:36.276 INFO:tasks.workunit.client.1.smithi098.stdout:1/766: dwrite d1/d88/fcf [0,4194304] 0 2023-01-04T18:16:36.276 INFO:tasks.workunit.client.1.smithi098.stdout:3/935: dwrite d6/d10/d19/d3f/d5e/d7d/dec/dda/d134/fb4 [0,4194304] 0 2023-01-04T18:16:36.278 INFO:tasks.workunit.client.1.smithi098.stdout:8/831: rmdir d6/d11/d15/d1b/d2a/d3b/d79 39 2023-01-04T18:16:36.283 INFO:tasks.workunit.client.1.smithi098.stdout:9/831: dwrite d2/d5/d18/d1d/d23/d66/f100 [0,4194304] 0 2023-01-04T18:16:36.284 INFO:tasks.workunit.client.1.smithi098.stdout:7/840: dread d1/d4/d11/f60 [0,4194304] 0 2023-01-04T18:16:36.289 INFO:tasks.workunit.client.1.smithi098.stdout:6/844: rename d9/dd/de/d44/df0 to d9/dd/de/d44/d79/d104 0 2023-01-04T18:16:36.289 INFO:tasks.workunit.client.1.smithi098.stdout:6/845: fdatasync d9/dd/de/d44/d79/f80 0 2023-01-04T18:16:36.290 INFO:tasks.workunit.client.1.smithi098.stdout:4/812: creat d5/d9/d13/f116 x:0 0 0 2023-01-04T18:16:36.292 INFO:tasks.workunit.client.1.smithi098.stdout:3/936: dwrite d6/d10/d29/f34 [4194304,4194304] 0 2023-01-04T18:16:36.294 INFO:tasks.workunit.client.1.smithi098.stdout:3/937: dread d6/d10/dc0/fcb [0,4194304] 0 2023-01-04T18:16:36.295 INFO:tasks.workunit.client.1.smithi098.stdout:3/938: write d6/d6f/f94 [3041523,108576] 0 2023-01-04T18:16:36.295 INFO:tasks.workunit.client.1.smithi098.stdout:3/939: write d6/d56/dc8/fe3 [193210,105429] 0 2023-01-04T18:16:36.298 INFO:tasks.workunit.client.1.smithi098.stdout:3/940: dread d6/d56/f85 [0,4194304] 0 2023-01-04T18:16:36.299 INFO:tasks.workunit.client.1.smithi098.stdout:3/941: dread - d6/d10/d19/d3f/d5e/f143 zero size 2023-01-04T18:16:36.300 INFO:tasks.workunit.client.1.smithi098.stdout:8/832: unlink d6/d11/d15/d1b/d2a/d6b/d7f/d78/d9d/dc4/cc6 0 2023-01-04T18:16:36.307 INFO:tasks.workunit.client.1.smithi098.stdout:7/841: link d1/lc9 d1/d51/d26/d28/d8d/l128 0 2023-01-04T18:16:36.307 INFO:tasks.workunit.client.1.smithi098.stdout:7/842: chown d1/d23/d37/d40/l107 9997003 1 2023-01-04T18:16:36.310 INFO:tasks.workunit.client.1.smithi098.stdout:0/824: rename df/d17/d9b/de5 to df/d17/d1c/d2c/da8/d118 0 2023-01-04T18:16:36.310 INFO:tasks.workunit.client.1.smithi098.stdout:7/843: dread d1/d23/d37/fcb [0,4194304] 0 2023-01-04T18:16:36.310 INFO:tasks.workunit.client.1.smithi098.stdout:7/844: read - d1/d23/d37/d78/d103/f112 zero size 2023-01-04T18:16:36.312 INFO:tasks.workunit.client.1.smithi098.stdout:6/846: symlink d9/dd/d4e/d67/db6/de9/l105 0 2023-01-04T18:16:36.312 INFO:tasks.workunit.client.1.smithi098.stdout:3/942: dwrite d6/f15 [4194304,4194304] 0 2023-01-04T18:16:36.312 INFO:tasks.workunit.client.1.smithi098.stdout:3/943: fdatasync d6/d10/d19/d3f/d5e/d7d/dec/dda/d134/fae 0 2023-01-04T18:16:36.312 INFO:tasks.workunit.client.1.smithi098.stdout:4/813: creat d5/de/d30/d4f/f117 x:0 0 0 2023-01-04T18:16:36.315 INFO:tasks.workunit.client.1.smithi098.stdout:1/767: symlink d1/d8/dac/dfc/d27/d77/l116 0 2023-01-04T18:16:36.315 INFO:tasks.workunit.client.1.smithi098.stdout:1/768: fdatasync d1/d8/dac/dfc/d36/d89/db3/fb5 0 2023-01-04T18:16:36.315 INFO:tasks.workunit.client.1.smithi098.stdout:1/769: fdatasync d1/d8/dac/dfc/d27/fdc 0 2023-01-04T18:16:36.317 INFO:tasks.workunit.client.1.smithi098.stdout:8/833: unlink d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/d84/de0/lec 0 2023-01-04T18:16:36.317 INFO:tasks.workunit.client.1.smithi098.stdout:1/770: write d1/d8/f10 [1014637,8025] 0 2023-01-04T18:16:36.318 INFO:tasks.workunit.client.1.smithi098.stdout:8/834: write d6/d11/d15/d1b/d2a/d3b/f7e [3139884,10588] 0 2023-01-04T18:16:36.318 INFO:tasks.workunit.client.1.smithi098.stdout:9/832: rename d2/d5/d18/d19/d82/cd6 to d2/d5/d18/d1d/d23/d5c/c110 0 2023-01-04T18:16:36.319 INFO:tasks.workunit.client.1.smithi098.stdout:0/825: stat df/d17/d1c/d2c/d104/c101 0 2023-01-04T18:16:36.319 INFO:tasks.workunit.client.1.smithi098.stdout:0/826: stat df/d17/d1c/d2c/d41/da0/fa3 0 2023-01-04T18:16:36.319 INFO:tasks.workunit.client.1.smithi098.stdout:0/827: chown df/d17/d68/df7 1885081 1 2023-01-04T18:16:36.319 INFO:tasks.workunit.client.1.smithi098.stdout:0/828: write df/d17/d9b/d86/ff4 [186032,54293] 0 2023-01-04T18:16:36.320 INFO:tasks.workunit.client.1.smithi098.stdout:6/847: stat d9/dd/de/d44/d79/d104/lcb 0 2023-01-04T18:16:36.320 INFO:tasks.workunit.client.1.smithi098.stdout:6/848: fsync d9/dd/de/f1e 0 2023-01-04T18:16:36.320 INFO:tasks.workunit.client.1.smithi098.stdout:7/845: dread d1/d23/d73/f76 [0,4194304] 0 2023-01-04T18:16:36.323 INFO:tasks.workunit.client.1.smithi098.stdout:2/846: sync 2023-01-04T18:16:36.323 INFO:tasks.workunit.client.1.smithi098.stdout:2/847: truncate d6/dc/d2b/d32/d10a/f12a 833671 0 2023-01-04T18:16:36.323 INFO:tasks.workunit.client.1.smithi098.stdout:2/848: chown d6/dc/d2b/d42/d47/d1f/d39/d6e/d107/f8e 223 1 2023-01-04T18:16:36.323 INFO:tasks.workunit.client.1.smithi098.stdout:2/849: chown d6/dc/d2b/d42/fe4 164960094 1 2023-01-04T18:16:36.326 INFO:tasks.workunit.client.1.smithi098.stdout:4/814: mkdir d5/d28/da6/d118 0 2023-01-04T18:16:36.328 INFO:tasks.workunit.client.1.smithi098.stdout:1/771: rename d1/d8/dac/dfc/d6a/lf6 to d1/d8/dac/dfc/d36/d89/df4/l117 0 2023-01-04T18:16:36.332 INFO:tasks.workunit.client.1.smithi098.stdout:5/849: sync 2023-01-04T18:16:36.335 INFO:tasks.workunit.client.1.smithi098.stdout:9/833: unlink d2/df6/d26/d41/ff3 0 2023-01-04T18:16:36.337 INFO:tasks.workunit.client.1.smithi098.stdout:0/829: symlink df/d17/d1c/d3b/de2/l119 0 2023-01-04T18:16:36.338 INFO:tasks.workunit.client.1.smithi098.stdout:6/849: rmdir d9/dda 39 2023-01-04T18:16:36.340 INFO:tasks.workunit.client.1.smithi098.stdout:4/815: link d5/de/d30/d4f/ceb d5/d28/c119 0 2023-01-04T18:16:36.341 INFO:tasks.workunit.client.1.smithi098.stdout:8/835: rename d6/d11/d15/d1b/d2a/d6b/d7f/d5a/l82 to d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/lfd 0 2023-01-04T18:16:36.342 INFO:tasks.workunit.client.1.smithi098.stdout:5/850: creat d1/d1e/dab/dd5/d102/d44/d80/dc6/f110 x:0 0 0 2023-01-04T18:16:36.343 INFO:tasks.workunit.client.1.smithi098.stdout:0/830: mknod df/d17/d1c/d3b/d98/c11a 0 2023-01-04T18:16:36.344 INFO:tasks.workunit.client.1.smithi098.stdout:6/850: link d9/dd/d24/d3e/d86/d9b/la7 d9/dd/de/l106 0 2023-01-04T18:16:36.344 INFO:tasks.workunit.client.1.smithi098.stdout:6/851: chown d9/dd/d24/d3e/f9d 9 1 2023-01-04T18:16:36.344 INFO:tasks.workunit.client.1.smithi098.stdout:6/852: truncate d9/dd/d4e/d67/db6/de9/ff4 902068 0 2023-01-04T18:16:36.345 INFO:tasks.workunit.client.1.smithi098.stdout:4/816: symlink d5/d28/d7d/ddb/df9/l11a 0 2023-01-04T18:16:36.346 INFO:tasks.workunit.client.1.smithi098.stdout:2/850: dwrite d6/dc/d2b/d42/d47/d1f/d39/d6e/f74 [4194304,4194304] 0 2023-01-04T18:16:36.347 INFO:tasks.workunit.client.1.smithi098.stdout:7/846: rename d1/d51/d26/d28/d2d/d75/f96 to d1/d4/d11/d9d/dd2/d109/f129 0 2023-01-04T18:16:36.347 INFO:tasks.workunit.client.1.smithi098.stdout:7/847: dread - d1/d51/d26/d28/dc6/fd3 zero size 2023-01-04T18:16:36.347 INFO:tasks.workunit.client.1.smithi098.stdout:7/848: write d1/d23/d21/f99 [700447,99883] 0 2023-01-04T18:16:36.348 INFO:tasks.workunit.client.1.smithi098.stdout:8/836: mkdir d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d64/de8/dd9/dfe 0 2023-01-04T18:16:36.348 INFO:tasks.workunit.client.1.smithi098.stdout:0/831: creat df/d17/f11b x:0 0 0 2023-01-04T18:16:36.353 INFO:tasks.workunit.client.1.smithi098.stdout:4/817: creat d5/d9/d13/d65/f11b x:0 0 0 2023-01-04T18:16:36.355 INFO:tasks.workunit.client.1.smithi098.stdout:2/851: mknod d6/dc/d2b/d42/d47/d35/dca/c130 0 2023-01-04T18:16:36.357 INFO:tasks.workunit.client.1.smithi098.stdout:9/834: rename d2/d5/d18/d1d/d23/d66/c73 to d2/df6/d78/dbb/c111 0 2023-01-04T18:16:36.359 INFO:tasks.workunit.client.1.smithi098.stdout:7/849: creat d1/d4/d11/d5d/f12a x:0 0 0 2023-01-04T18:16:36.360 INFO:tasks.workunit.client.1.smithi098.stdout:4/818: creat d5/d28/dff/f11c x:0 0 0 2023-01-04T18:16:36.361 INFO:tasks.workunit.client.1.smithi098.stdout:2/852: mkdir d6/dc/d2b/d42/d51/d81/d8f/de8/d131 0 2023-01-04T18:16:36.364 INFO:tasks.workunit.client.1.smithi098.stdout:5/851: rename d1/d1e/dab/dd5/d102/d44/d45/f7c to d1/d2/d14/d19/f111 0 2023-01-04T18:16:36.365 INFO:tasks.workunit.client.1.smithi098.stdout:7/850: truncate d1/d23/fab 7298002 0 2023-01-04T18:16:36.367 INFO:tasks.workunit.client.1.smithi098.stdout:4/819: mkdir d5/d9/d13/d11d 0 2023-01-04T18:16:36.368 INFO:tasks.workunit.client.1.smithi098.stdout:2/853: rmdir d6/dc/d2b/d32/d10a 39 2023-01-04T18:16:36.369 INFO:tasks.workunit.client.1.smithi098.stdout:5/852: mkdir d1/d1e/dab/dd5/d102/d44/d45/d4b/d61/d112 0 2023-01-04T18:16:36.371 INFO:tasks.workunit.client.1.smithi098.stdout:5/853: creat d1/d1e/dab/dd5/d102/f113 x:0 0 0 2023-01-04T18:16:36.371 INFO:tasks.workunit.client.1.smithi098.stdout:5/854: write d1/fc3 [220393,14645] 0 2023-01-04T18:16:36.372 INFO:tasks.workunit.client.1.smithi098.stdout:4/820: rename d5/d28/d7d/db6/de4/fec to d5/d28/d7d/db6/f11e 0 2023-01-04T18:16:36.373 INFO:tasks.workunit.client.1.smithi098.stdout:4/821: read d5/de/d21/f39 [96427,5136] 0 2023-01-04T18:16:36.375 INFO:tasks.workunit.client.1.smithi098.stdout:4/822: symlink d5/de/d30/d4f/l11f 0 2023-01-04T18:16:36.375 INFO:tasks.workunit.client.1.smithi098.stdout:4/823: read - d5/d9/d13/d65/f11b zero size 2023-01-04T18:16:36.383 INFO:tasks.workunit.client.1.smithi098.stdout:8/837: write d6/f9 [1559027,83751] 0 2023-01-04T18:16:36.383 INFO:tasks.workunit.client.1.smithi098.stdout:8/838: rename d6/d11/d15/fcf to d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d64/fff 0 2023-01-04T18:16:36.384 INFO:tasks.workunit.client.1.smithi098.stdout:8/839: fdatasync d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/f8c 0 2023-01-04T18:16:36.389 INFO:tasks.workunit.client.1.smithi098.stdout:8/840: link d6/d11/d15/d1b/d2a/d3b/cf4 d6/d11/d15/db4/dba/ded/d6e/d8b/c100 0 2023-01-04T18:16:36.397 INFO:tasks.workunit.client.1.smithi098.stdout:4/824: dread d5/d9/f3b [0,4194304] 0 2023-01-04T18:16:36.401 INFO:tasks.workunit.client.1.smithi098.stdout:4/825: mkdir d5/dad/d120 0 2023-01-04T18:16:36.401 INFO:tasks.workunit.client.1.smithi098.stdout:4/826: fsync d5/de/d30/f114 0 2023-01-04T18:16:36.423 INFO:tasks.workunit.client.1.smithi098.stdout:9/835: dwrite d2/d5/d18/d1d/d23/dad/dfa/d42/d89/dcb/ffe [0,4194304] 0 2023-01-04T18:16:36.426 INFO:tasks.workunit.client.1.smithi098.stdout:9/836: creat d2/d5/d18/d1d/d23/dad/d72/f112 x:0 0 0 2023-01-04T18:16:36.441 INFO:tasks.workunit.client.1.smithi098.stdout:9/837: dread d2/df6/d78/fc4 [0,4194304] 0 2023-01-04T18:16:36.442 INFO:tasks.workunit.client.1.smithi098.stdout:9/838: mknod d2/d5/d18/d1d/d23/dad/d72/d9e/dca/df5/c113 0 2023-01-04T18:16:36.446 INFO:tasks.workunit.client.1.smithi098.stdout:0/832: dwrite df/d17/d9b/da1/f10b [0,4194304] 0 2023-01-04T18:16:36.447 INFO:tasks.workunit.client.1.smithi098.stdout:5/855: dwrite d1/d1e/dab/dd5/d102/d44/f9c [0,4194304] 0 2023-01-04T18:16:36.447 INFO:tasks.workunit.client.1.smithi098.stdout:6/853: dwrite d9/dd/d24/d3e/d86/d9b/dce/fd9 [0,4194304] 0 2023-01-04T18:16:36.447 INFO:tasks.workunit.client.1.smithi098.stdout:6/854: readlink d9/dd/d4e/d67/db6/de9/l105 0 2023-01-04T18:16:36.447 INFO:tasks.workunit.client.1.smithi098.stdout:6/855: truncate d9/dd/d24/d3e/d86/fa8 562423 0 2023-01-04T18:16:36.447 INFO:tasks.workunit.client.1.smithi098.stdout:2/854: dwrite d6/f2f [0,4194304] 0 2023-01-04T18:16:36.448 INFO:tasks.workunit.client.1.smithi098.stdout:8/841: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/d78/d9d/fa8 [0,4194304] 0 2023-01-04T18:16:36.448 INFO:tasks.workunit.client.1.smithi098.stdout:4/827: dwrite d5/d9/d13/f17 [0,4194304] 0 2023-01-04T18:16:36.449 INFO:tasks.workunit.client.1.smithi098.stdout:7/851: dwrite d1/d23/d37/d78/d103/fdf [0,4194304] 0 2023-01-04T18:16:36.450 INFO:tasks.workunit.client.1.smithi098.stdout:0/833: creat df/d17/d1c/d2c/d41/d4a/f11c x:0 0 0 2023-01-04T18:16:36.450 INFO:tasks.workunit.client.1.smithi098.stdout:0/834: dread - df/d4f/d6b/d94/feb zero size 2023-01-04T18:16:36.457 INFO:tasks.workunit.client.1.smithi098.stdout:5/856: getdents d1/d1e/dab/dd5/d102/d44/d80/dc6 0 2023-01-04T18:16:36.464 INFO:tasks.workunit.client.1.smithi098.stdout:6/856: creat d9/dda/f107 x:0 0 0 2023-01-04T18:16:36.465 INFO:tasks.workunit.client.1.smithi098.stdout:2/855: symlink d6/dc/d2b/d42/d51/de1/l132 0 2023-01-04T18:16:36.467 INFO:tasks.workunit.client.1.smithi098.stdout:4/828: dwrite d5/de/d2c/dcb/fe8 [0,4194304] 0 2023-01-04T18:16:36.467 INFO:tasks.workunit.client.1.smithi098.stdout:8/842: getdents d6/d11/d15/db4 0 2023-01-04T18:16:36.468 INFO:tasks.workunit.client.1.smithi098.stdout:8/843: fdatasync d6/fd3 0 2023-01-04T18:16:36.468 INFO:tasks.workunit.client.1.smithi098.stdout:8/844: fsync d6/d11/d15/d1b/d2a/d6b/d7f/d78/d9d/fa8 0 2023-01-04T18:16:36.468 INFO:tasks.workunit.client.1.smithi098.stdout:8/845: getdents d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/d84/de0/de7 0 2023-01-04T18:16:36.468 INFO:tasks.workunit.client.1.smithi098.stdout:8/846: read - d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/d8a/fe1 zero size 2023-01-04T18:16:36.472 INFO:tasks.workunit.client.1.smithi098.stdout:0/835: mknod df/d17/d24/dcb/c11d 0 2023-01-04T18:16:36.472 INFO:tasks.workunit.client.1.smithi098.stdout:9/839: dwrite d2/d53/f65 [0,4194304] 0 2023-01-04T18:16:36.472 INFO:tasks.workunit.client.1.smithi098.stdout:7/852: symlink d1/d23/d37/d40/l12b 0 2023-01-04T18:16:36.472 INFO:tasks.workunit.client.1.smithi098.stdout:5/857: mkdir d1/d38/d3b/d8f/d114 0 2023-01-04T18:16:36.472 INFO:tasks.workunit.client.1.smithi098.stdout:5/858: write d1/d1e/dab/dd5/d102/f113 [38098,40897] 0 2023-01-04T18:16:36.473 INFO:tasks.workunit.client.1.smithi098.stdout:6/857: creat d9/dd/de/d20/d82/d84/f108 x:0 0 0 2023-01-04T18:16:36.474 INFO:tasks.workunit.client.1.smithi098.stdout:6/858: write d9/dd/de/d44/d79/fcd [554151,62097] 0 2023-01-04T18:16:36.477 INFO:tasks.workunit.client.1.smithi098.stdout:9/840: stat d2/d5/c15 0 2023-01-04T18:16:36.479 INFO:tasks.workunit.client.1.smithi098.stdout:7/853: creat d1/d23/d37/d40/f12c x:0 0 0 2023-01-04T18:16:36.482 INFO:tasks.workunit.client.1.smithi098.stdout:5/859: rename d1/db0/ddc/d103 to d1/d1e/dab/dd5/d102/d44/d115 0 2023-01-04T18:16:36.483 INFO:tasks.workunit.client.1.smithi098.stdout:2/856: dwrite d6/dc/d2b/d42/d51/d79/da3/ff3 [0,4194304] 0 2023-01-04T18:16:36.483 INFO:tasks.workunit.client.1.smithi098.stdout:2/857: read - d6/dc/d2b/d42/d51/d81/d8f/de8/feb zero size 2023-01-04T18:16:36.484 INFO:tasks.workunit.client.1.smithi098.stdout:2/858: write d6/f4a [82931,59255] 0 2023-01-04T18:16:36.485 INFO:tasks.workunit.client.1.smithi098.stdout:0/836: dread df/d17/d9b/d86/fe8 [0,4194304] 0 2023-01-04T18:16:36.485 INFO:tasks.workunit.client.1.smithi098.stdout:0/837: write df/d4f/d6e/daf/f10f [699759,3640] 0 2023-01-04T18:16:36.486 INFO:tasks.workunit.client.1.smithi098.stdout:2/859: write d6/dc/d2b/d42/d47/d1f/fd6 [1161280,88769] 0 2023-01-04T18:16:36.486 INFO:tasks.workunit.client.1.smithi098.stdout:6/859: creat d9/dd/de/d44/f109 x:0 0 0 2023-01-04T18:16:36.486 INFO:tasks.workunit.client.1.smithi098.stdout:2/860: chown d6/f11 33669489 1 2023-01-04T18:16:36.486 INFO:tasks.workunit.client.1.smithi098.stdout:2/861: chown d6/dc/f8c 207445 1 2023-01-04T18:16:36.489 INFO:tasks.workunit.client.1.smithi098.stdout:9/841: rename d2/c49 to d2/df6/d78/dbb/c114 0 2023-01-04T18:16:36.489 INFO:tasks.workunit.client.1.smithi098.stdout:9/842: chown d2/d5/d18/d1d/d23/dad/d72/d9e/dca 258757 1 2023-01-04T18:16:36.490 INFO:tasks.workunit.client.1.smithi098.stdout:5/860: mkdir d1/d38/dce/d116 0 2023-01-04T18:16:36.495 INFO:tasks.workunit.client.1.smithi098.stdout:0/838: creat df/d17/d9b/da4/ddd/f11e x:0 0 0 2023-01-04T18:16:36.497 INFO:tasks.workunit.client.1.smithi098.stdout:3/944: sync 2023-01-04T18:16:36.497 INFO:tasks.workunit.client.1.smithi098.stdout:3/945: write d6/d10/d19/d3f/d46/fbd [4993878,19421] 0 2023-01-04T18:16:36.497 INFO:tasks.workunit.client.1.smithi098.stdout:9/843: creat d2/d5/d18/d1d/d23/dad/f115 x:0 0 0 2023-01-04T18:16:36.498 INFO:tasks.workunit.client.1.smithi098.stdout:5/861: mknod d1/d1e/dab/dd5/d102/d44/d80/dcf/c117 0 2023-01-04T18:16:36.499 INFO:tasks.workunit.client.1.smithi098.stdout:5/862: write d1/d1e/dab/dd5/d102/f77 [1484305,57818] 0 2023-01-04T18:16:36.500 INFO:tasks.workunit.client.1.smithi098.stdout:0/839: mkdir df/d4f/d6b/d11f 0 2023-01-04T18:16:36.501 INFO:tasks.workunit.client.1.smithi098.stdout:3/946: unlink d6/d10/d19/d3f/d5e/d7d/dec/ce9 0 2023-01-04T18:16:36.508 INFO:tasks.workunit.client.1.smithi098.stdout:9/844: dread d2/df6/d26/d41/f85 [0,4194304] 0 2023-01-04T18:16:36.510 INFO:tasks.workunit.client.1.smithi098.stdout:9/845: rename d2/d5/d18/d1d/d23/c91 to d2/d5/d18/d1d/d23/dad/dfa/ded/c116 0 2023-01-04T18:16:36.510 INFO:tasks.workunit.client.1.smithi098.stdout:9/846: readlink d2/d5/d18/d1d/d23/d66/le3 0 2023-01-04T18:16:36.515 INFO:tasks.workunit.client.1.smithi098.stdout:8/847: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/f8f [0,4194304] 0 2023-01-04T18:16:36.520 INFO:tasks.workunit.client.1.smithi098.stdout:8/848: symlink d6/d11/d15/db0/df6/l101 0 2023-01-04T18:16:36.520 INFO:tasks.workunit.client.1.smithi098.stdout:3/947: dread d6/d10/d19/d3f/d5e/d74/fa6 [0,4194304] 0 2023-01-04T18:16:36.520 INFO:tasks.workunit.client.1.smithi098.stdout:3/948: fdatasync d6/d10/d19/d3f/d5e/d7d/d90/de6/f103 0 2023-01-04T18:16:36.520 INFO:tasks.workunit.client.1.smithi098.stdout:6/860: dread d9/dd/de/d26/f74 [0,4194304] 0 2023-01-04T18:16:36.520 INFO:tasks.workunit.client.1.smithi098.stdout:6/861: fsync d9/dda/f107 0 2023-01-04T18:16:36.522 INFO:tasks.workunit.client.1.smithi098.stdout:8/849: creat d6/d11/d15/d1b/d2a/dae/dd6/f102 x:0 0 0 2023-01-04T18:16:36.522 INFO:tasks.workunit.client.1.smithi098.stdout:8/850: write d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/d8a/ddd/df5/ffb [553198,75117] 0 2023-01-04T18:16:36.523 INFO:tasks.workunit.client.1.smithi098.stdout:0/840: dwrite df/d4f/dc7/df2/f102 [0,4194304] 0 2023-01-04T18:16:36.523 INFO:tasks.workunit.client.1.smithi098.stdout:3/949: symlink d6/d10/d19/d3f/d46/d109/l14b 0 2023-01-04T18:16:36.524 INFO:tasks.workunit.client.1.smithi098.stdout:3/950: chown d6/d10/c3d 2 1 2023-01-04T18:16:36.528 INFO:tasks.workunit.client.1.smithi098.stdout:6/862: rmdir d9/dd/d24 39 2023-01-04T18:16:36.529 INFO:tasks.workunit.client.1.smithi098.stdout:7/854: dwrite d1/d2e/f54 [0,4194304] 0 2023-01-04T18:16:36.529 INFO:tasks.workunit.client.1.smithi098.stdout:8/851: creat d6/d11/d15/d1b/d2a/d3b/d79/f103 x:0 0 0 2023-01-04T18:16:36.530 INFO:tasks.workunit.client.1.smithi098.stdout:8/852: write d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/f6f [3557972,17866] 0 2023-01-04T18:16:36.534 INFO:tasks.workunit.client.1.smithi098.stdout:8/853: write d6/d11/d15/d1b/f93 [373251,43484] 0 2023-01-04T18:16:36.536 INFO:tasks.workunit.client.1.smithi098.stdout:5/863: dwrite d1/d1e/dab/dd5/d102/d44/d45/d4b/dba/fff [0,4194304] 0 2023-01-04T18:16:36.538 INFO:tasks.workunit.client.1.smithi098.stdout:0/841: getdents df/d4f/dc7 0 2023-01-04T18:16:36.538 INFO:tasks.workunit.client.1.smithi098.stdout:9/847: dwrite d2/d5/d18/f39 [4194304,4194304] 0 2023-01-04T18:16:36.540 INFO:tasks.workunit.client.1.smithi098.stdout:9/848: write d2/d5/d18/d1d/d23/dad/dfa/d42/d89/fe7 [867815,77825] 0 2023-01-04T18:16:36.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:35.914234+0000 mgr.smithi098.vhfzum (mgr.24455) 21 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 1.6 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 122 MiB/s rd, 227 MiB/s wr, 758 op/s 2023-01-04T18:16:36.545 INFO:tasks.workunit.client.1.smithi098.stdout:7/855: symlink d1/d51/l12d 0 2023-01-04T18:16:36.545 INFO:tasks.workunit.client.1.smithi098.stdout:7/856: chown d1/d51/d26/d28/f66 7442950 1 2023-01-04T18:16:36.550 INFO:tasks.workunit.client.1.smithi098.stdout:0/842: mknod df/d4f/c120 0 2023-01-04T18:16:36.550 INFO:tasks.workunit.client.1.smithi098.stdout:0/843: chown df/d4f/d6b 641 1 2023-01-04T18:16:36.550 INFO:tasks.workunit.client.1.smithi098.stdout:0/844: chown df/d17/d68/lf0 1 1 2023-01-04T18:16:36.552 INFO:tasks.workunit.client.1.smithi098.stdout:9/849: rename d2/d5/d18/d1d/d23/dad/dfa/d42/d89/dcb/fe9 to d2/d5/d18/d1d/d23/d5c/f117 0 2023-01-04T18:16:36.552 INFO:tasks.workunit.client.1.smithi098.stdout:0/845: getdents df/d17/d9b/ddf 0 2023-01-04T18:16:36.552 INFO:tasks.workunit.client.1.smithi098.stdout:9/850: rmdir d2/d5/d18/db6 39 2023-01-04T18:16:36.553 INFO:tasks.workunit.client.1.smithi098.stdout:0/846: link df/d17/c27 df/d17/d1c/d2c/dba/c121 0 2023-01-04T18:16:36.555 INFO:tasks.workunit.client.1.smithi098.stdout:9/851: creat d2/d5/d18/d1d/f118 x:0 0 0 2023-01-04T18:16:36.556 INFO:tasks.workunit.client.1.smithi098.stdout:0/847: creat df/d4f/dc7/df2/f122 x:0 0 0 2023-01-04T18:16:36.566 INFO:tasks.workunit.client.1.smithi098.stdout:7/857: dread d1/d23/d73/dba/fef [0,4194304] 0 2023-01-04T18:16:36.569 INFO:tasks.workunit.client.1.smithi098.stdout:7/858: rename d1/d4/d11/d9d/dd0/f111 to d1/db2/dc4/f12e 0 2023-01-04T18:16:36.574 INFO:tasks.workunit.client.1.smithi098.stdout:5/864: dwrite d1/d38/d3b/d8f/ff9 [0,4194304] 0 2023-01-04T18:16:36.574 INFO:tasks.workunit.client.1.smithi098.stdout:5/865: chown d1/d1e/de7 255 1 2023-01-04T18:16:36.575 INFO:tasks.workunit.client.1.smithi098.stdout:0/848: dwrite df/d17/d1c/d3b/f107 [0,4194304] 0 2023-01-04T18:16:36.575 INFO:tasks.workunit.client.1.smithi098.stdout:5/866: write d1/f48 [165305,84542] 0 2023-01-04T18:16:36.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:35.914234+0000 mgr.smithi098.vhfzum (mgr.24455) 21 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 1.6 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 122 MiB/s rd, 227 MiB/s wr, 758 op/s 2023-01-04T18:16:36.582 INFO:tasks.workunit.client.1.smithi098.stdout:7/859: dwrite d1/d23/d21/f99 [0,4194304] 0 2023-01-04T18:16:36.582 INFO:tasks.workunit.client.1.smithi098.stdout:7/860: dread - d1/d23/d37/d40/f8e zero size 2023-01-04T18:16:36.586 INFO:tasks.workunit.client.1.smithi098.stdout:0/849: dread df/d4f/f55 [0,4194304] 0 2023-01-04T18:16:36.586 INFO:tasks.workunit.client.1.smithi098.stdout:0/850: write df/d17/d24/f34 [9417716,113275] 0 2023-01-04T18:16:36.586 INFO:tasks.workunit.client.1.smithi098.stdout:0/851: readlink df/d4f/d6b/d89/l10c 0 2023-01-04T18:16:36.587 INFO:tasks.workunit.client.1.smithi098.stdout:5/867: dread d1/f48 [0,4194304] 0 2023-01-04T18:16:36.587 INFO:tasks.workunit.client.1.smithi098.stdout:5/868: write d1/d1e/dab/dd5/d102/d44/d45/d4b/d61/faa [655309,124050] 0 2023-01-04T18:16:36.589 INFO:tasks.workunit.client.1.smithi098.stdout:1/772: sync 2023-01-04T18:16:36.592 INFO:tasks.workunit.client.1.smithi098.stdout:4/829: sync 2023-01-04T18:16:36.592 INFO:tasks.workunit.client.1.smithi098.stdout:4/830: chown d5/d28/d40/f64 38072 1 2023-01-04T18:16:36.592 INFO:tasks.workunit.client.1.smithi098.stdout:4/831: chown d5/d28/d7d/ddb/dfa 2077714 1 2023-01-04T18:16:36.593 INFO:tasks.workunit.client.1.smithi098.stdout:0/852: symlink df/d4f/d6b/d11f/l123 0 2023-01-04T18:16:36.596 INFO:tasks.workunit.client.1.smithi098.stdout:2/862: sync 2023-01-04T18:16:36.596 INFO:tasks.workunit.client.1.smithi098.stdout:3/951: sync 2023-01-04T18:16:36.596 INFO:tasks.workunit.client.1.smithi098.stdout:6/863: sync 2023-01-04T18:16:36.596 INFO:tasks.workunit.client.1.smithi098.stdout:3/952: dread - d6/d6f/db6/ff5 zero size 2023-01-04T18:16:36.596 INFO:tasks.workunit.client.1.smithi098.stdout:2/863: dread - d6/dc/d2b/d42/d51/d79/da3/fdd zero size 2023-01-04T18:16:36.598 INFO:tasks.workunit.client.1.smithi098.stdout:5/869: rmdir d1/d1e/de7 0 2023-01-04T18:16:36.600 INFO:tasks.workunit.client.1.smithi098.stdout:2/864: link d6/dc/d2b/d42/d47/l34 d6/dc/d2b/d42/d51/l133 0 2023-01-04T18:16:36.601 INFO:tasks.workunit.client.1.smithi098.stdout:3/953: creat d6/d10/d19/d3f/d5e/d7d/d116/f14c x:0 0 0 2023-01-04T18:16:36.603 INFO:tasks.workunit.client.1.smithi098.stdout:5/870: link d1/d2f/d66/lb6 d1/d2f/d73/d10d/l118 0 2023-01-04T18:16:36.603 INFO:tasks.workunit.client.1.smithi098.stdout:5/871: fdatasync d1/d2/d14/d59/f71 0 2023-01-04T18:16:36.605 INFO:tasks.workunit.client.1.smithi098.stdout:5/872: dread d1/d1e/dab/dd5/d102/f77 [0,4194304] 0 2023-01-04T18:16:36.606 INFO:tasks.workunit.client.1.smithi098.stdout:5/873: dread - d1/d2f/d66/d75/fa0 zero size 2023-01-04T18:16:36.606 INFO:tasks.workunit.client.1.smithi098.stdout:3/954: read d6/d56/fb8 [2798424,110785] 0 2023-01-04T18:16:36.608 INFO:tasks.workunit.client.1.smithi098.stdout:5/874: dread d1/d1e/dab/dd5/d102/f77 [0,4194304] 0 2023-01-04T18:16:36.609 INFO:tasks.workunit.client.1.smithi098.stdout:2/865: dread d6/dc/d2b/d42/d47/d1f/d39/f64 [0,4194304] 0 2023-01-04T18:16:36.610 INFO:tasks.workunit.client.1.smithi098.stdout:5/875: mknod d1/d46/d6a/c119 0 2023-01-04T18:16:36.611 INFO:tasks.workunit.client.1.smithi098.stdout:2/866: mknod d6/dc/d2b/d42/d47/d35/dca/d103/c134 0 2023-01-04T18:16:36.611 INFO:tasks.workunit.client.1.smithi098.stdout:2/867: dread - d6/dc/d2b/d42/f129 zero size 2023-01-04T18:16:36.612 INFO:tasks.workunit.client.1.smithi098.stdout:5/876: creat d1/d1e/d81/f11a x:0 0 0 2023-01-04T18:16:36.612 INFO:tasks.workunit.client.1.smithi098.stdout:5/877: write d1/d1e/dab/dd5/d102/d44/d80/feb [413248,83759] 0 2023-01-04T18:16:36.613 INFO:tasks.workunit.client.1.smithi098.stdout:7/861: dwrite d1/da/f68 [0,4194304] 0 2023-01-04T18:16:36.616 INFO:tasks.workunit.client.1.smithi098.stdout:4/832: dread d5/d9/d13/f50 [0,4194304] 0 2023-01-04T18:16:36.617 INFO:tasks.workunit.client.1.smithi098.stdout:5/878: dread d1/d1e/dab/fb3 [0,4194304] 0 2023-01-04T18:16:36.617 INFO:tasks.workunit.client.1.smithi098.stdout:5/879: dread - d1/d2f/d66/fe0 zero size 2023-01-04T18:16:36.618 INFO:tasks.workunit.client.1.smithi098.stdout:4/833: creat d5/de/d2c/f121 x:0 0 0 2023-01-04T18:16:36.618 INFO:tasks.workunit.client.1.smithi098.stdout:4/834: chown d5/de/d2c 136299 1 2023-01-04T18:16:36.620 INFO:tasks.workunit.client.1.smithi098.stdout:5/880: rmdir d1/dda 39 2023-01-04T18:16:36.623 INFO:tasks.workunit.client.1.smithi098.stdout:5/881: write d1/d2/f107 [400600,34676] 0 2023-01-04T18:16:36.623 INFO:tasks.workunit.client.1.smithi098.stdout:5/882: stat d1/d1e/dab/dd5/d102 0 2023-01-04T18:16:36.623 INFO:tasks.workunit.client.1.smithi098.stdout:5/883: chown d1/d1e/dab/dd5/d102/d44/d45/d4b/dec/d106/cf0 15572 1 2023-01-04T18:16:36.624 INFO:tasks.workunit.client.1.smithi098.stdout:5/884: mknod d1/d1e/dab/dd5/d102/d44/c11b 0 2023-01-04T18:16:36.624 INFO:tasks.workunit.client.1.smithi098.stdout:5/885: readlink d1/d38/dce/ldd 0 2023-01-04T18:16:36.625 INFO:tasks.workunit.client.1.smithi098.stdout:7/862: dread d1/d4/d11/d9d/dd0/ff4 [0,4194304] 0 2023-01-04T18:16:36.625 INFO:tasks.workunit.client.1.smithi098.stdout:7/863: chown d1/db2/lbb 47943 1 2023-01-04T18:16:36.628 INFO:tasks.workunit.client.1.smithi098.stdout:1/773: dwrite d1/f44 [4194304,4194304] 0 2023-01-04T18:16:36.628 INFO:tasks.workunit.client.1.smithi098.stdout:1/774: readlink d1/d8/dac/dfc/d36/d4e/l68 0 2023-01-04T18:16:36.629 INFO:tasks.workunit.client.1.smithi098.stdout:3/955: dwrite d6/d56/d9f/da8/dfd/f101 [0,4194304] 0 2023-01-04T18:16:36.629 INFO:tasks.workunit.client.1.smithi098.stdout:7/864: dread d1/d23/d21/d43/f9e [0,4194304] 0 2023-01-04T18:16:36.629 INFO:tasks.workunit.client.1.smithi098.stdout:6/864: dwrite d9/dd/de/d20/f5d [4194304,4194304] 0 2023-01-04T18:16:36.633 INFO:tasks.workunit.client.1.smithi098.stdout:1/775: rename d1/d8/d53/fc5 to d1/d8/dac/dfc/d39/dd9/f118 0 2023-01-04T18:16:36.634 INFO:tasks.workunit.client.1.smithi098.stdout:4/835: dwrite d5/d28/d40/f4a [4194304,4194304] 0 2023-01-04T18:16:36.634 INFO:tasks.workunit.client.1.smithi098.stdout:4/836: truncate d5/d9/d90/f9f 526825 0 2023-01-04T18:16:36.636 INFO:tasks.workunit.client.1.smithi098.stdout:3/956: rmdir d6/d6f/db6 39 2023-01-04T18:16:36.636 INFO:tasks.workunit.client.1.smithi098.stdout:3/957: read d6/d10/d19/d3f/d5e/f67 [454822,88474] 0 2023-01-04T18:16:36.638 INFO:tasks.workunit.client.1.smithi098.stdout:7/865: unlink d1/d23/d73/f97 0 2023-01-04T18:16:36.638 INFO:tasks.workunit.client.1.smithi098.stdout:7/866: fdatasync d1/d23/d37/f118 0 2023-01-04T18:16:36.638 INFO:tasks.workunit.client.1.smithi098.stdout:7/867: write d1/d23/fec [455788,120910] 0 2023-01-04T18:16:36.642 INFO:tasks.workunit.client.1.smithi098.stdout:6/865: mknod d9/dd/de/d20/d82/c10a 0 2023-01-04T18:16:36.646 INFO:tasks.workunit.client.1.smithi098.stdout:1/776: symlink d1/d8/dac/dfc/d6a/l119 0 2023-01-04T18:16:36.648 INFO:tasks.workunit.client.1.smithi098.stdout:3/958: symlink d6/d10/d19/d3f/d5e/d7d/dec/dda/d134/l14d 0 2023-01-04T18:16:36.648 INFO:tasks.workunit.client.1.smithi098.stdout:3/959: chown d6/d10/d19/d3f/d5e/fa9 9990 1 2023-01-04T18:16:36.648 INFO:tasks.workunit.client.1.smithi098.stdout:3/960: chown d6/d10/d19/d3f/d46/ff2 63221 1 2023-01-04T18:16:36.649 INFO:tasks.workunit.client.1.smithi098.stdout:9/852: sync 2023-01-04T18:16:36.649 INFO:tasks.workunit.client.1.smithi098.stdout:9/853: dread - d2/d5/d6f/f104 zero size 2023-01-04T18:16:36.649 INFO:tasks.workunit.client.1.smithi098.stdout:9/854: write d2/d2d/f5d [653576,42813] 0 2023-01-04T18:16:36.649 INFO:tasks.workunit.client.1.smithi098.stdout:9/855: truncate d2/d5/d18/d1d/dc0/fcc 5163978 0 2023-01-04T18:16:36.650 INFO:tasks.workunit.client.1.smithi098.stdout:7/868: mkdir d1/d23/d73/d12f 0 2023-01-04T18:16:36.652 INFO:tasks.workunit.client.1.smithi098.stdout:1/777: dread - d1/d8/da/dae/fdd zero size 2023-01-04T18:16:36.652 INFO:tasks.workunit.client.1.smithi098.stdout:8/854: sync 2023-01-04T18:16:36.652 INFO:tasks.workunit.client.1.smithi098.stdout:8/855: write d6/d11/d15/db4/ffc [383003,88243] 0 2023-01-04T18:16:36.653 INFO:tasks.workunit.client.1.smithi098.stdout:8/856: write d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/d8a/ddd/df5/ff8 [955798,105937] 0 2023-01-04T18:16:36.653 INFO:tasks.workunit.client.1.smithi098.stdout:8/857: fsync d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/f57 0 2023-01-04T18:16:36.653 INFO:tasks.workunit.client.1.smithi098.stdout:8/858: chown d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/d84/de0 2 1 2023-01-04T18:16:36.655 INFO:tasks.workunit.client.1.smithi098.stdout:3/961: rename d6/d10/d19/d3f/d5e/d7d/dec/dda/f14a to d6/d10/d29/d6a/dd1/d129/f14e 0 2023-01-04T18:16:36.656 INFO:tasks.workunit.client.1.smithi098.stdout:3/962: write d6/d56/d9f/da8/dfd/d120/f13c [455160,46059] 0 2023-01-04T18:16:36.657 INFO:tasks.workunit.client.1.smithi098.stdout:1/778: symlink d1/d8/d53/l11a 0 2023-01-04T18:16:36.657 INFO:tasks.workunit.client.1.smithi098.stdout:1/779: readlink d1/d8/dac/dfc/d36/d4e/ld6 0 2023-01-04T18:16:36.657 INFO:tasks.workunit.client.1.smithi098.stdout:1/780: truncate d1/d8/dac/dfc/d27/d77/f107 248660 0 2023-01-04T18:16:36.657 INFO:tasks.workunit.client.1.smithi098.stdout:1/781: fdatasync d1/d8/dac/dfc/d27/d77/ffd 0 2023-01-04T18:16:36.658 INFO:tasks.workunit.client.1.smithi098.stdout:8/859: chown d6/d11/d15/d1b/d2a/d6b/c3f 798099149 1 2023-01-04T18:16:36.659 INFO:tasks.workunit.client.1.smithi098.stdout:9/856: mknod d2/d5/d18/d19/d82/dce/c119 0 2023-01-04T18:16:36.659 INFO:tasks.workunit.client.1.smithi098.stdout:9/857: chown d2/d5/d18/d1d/d23/lb9 24 1 2023-01-04T18:16:36.660 INFO:tasks.workunit.client.1.smithi098.stdout:1/782: getdents d1/d8/dac/dfc/d36/d89/df4 0 2023-01-04T18:16:36.660 INFO:tasks.workunit.client.1.smithi098.stdout:1/783: fdatasync d1/d8/fb1 0 2023-01-04T18:16:36.662 INFO:tasks.workunit.client.1.smithi098.stdout:9/858: unlink d2/d5/d18/d1d/d23/dad/dfa/d42/d89/ffd 0 2023-01-04T18:16:36.663 INFO:tasks.workunit.client.1.smithi098.stdout:3/963: dread d6/f54 [0,4194304] 0 2023-01-04T18:16:36.664 INFO:tasks.workunit.client.1.smithi098.stdout:1/784: symlink d1/d8/dac/dfc/d27/d77/da8/l11b 0 2023-01-04T18:16:36.664 INFO:tasks.workunit.client.1.smithi098.stdout:9/859: creat d2/d5/d18/d1d/f11a x:0 0 0 2023-01-04T18:16:36.664 INFO:tasks.workunit.client.1.smithi098.stdout:9/860: write d2/d5/d18/d1d/d23/d66/f100 [4820206,17100] 0 2023-01-04T18:16:36.665 INFO:tasks.workunit.client.1.smithi098.stdout:3/964: creat d6/d10/d19/d3f/d5e/d7d/dec/dda/d134/f14f x:0 0 0 2023-01-04T18:16:36.666 INFO:tasks.workunit.client.1.smithi098.stdout:3/965: fdatasync d6/d6f/db6/ff5 0 2023-01-04T18:16:36.666 INFO:tasks.workunit.client.1.smithi098.stdout:3/966: dread - d6/d10/d19/d3f/d5e/d7d/dec/fbb zero size 2023-01-04T18:16:36.669 INFO:tasks.workunit.client.1.smithi098.stdout:9/861: mknod d2/d5/d18/d1d/d23/c11b 0 2023-01-04T18:16:36.671 INFO:tasks.workunit.client.1.smithi098.stdout:3/967: write d6/d56/f117 [3104854,111711] 0 2023-01-04T18:16:36.671 INFO:tasks.workunit.client.1.smithi098.stdout:3/968: write d6/d6f/d9b/ff6 [795730,71335] 0 2023-01-04T18:16:36.672 INFO:tasks.workunit.client.1.smithi098.stdout:3/969: chown d6/d10/d19/d3f/d5e/d7d/d90/de6/f103 1162 1 2023-01-04T18:16:36.675 INFO:tasks.workunit.client.1.smithi098.stdout:3/970: rename d6/d10/d19/d3f/d5e/d74 to d6/d10/d19/d3f/d5e/d145/d150 0 2023-01-04T18:16:36.676 INFO:tasks.workunit.client.1.smithi098.stdout:3/971: mknod d6/d10/d19/d3f/d5e/d7d/dec/c151 0 2023-01-04T18:16:36.677 INFO:tasks.workunit.client.1.smithi098.stdout:3/972: mkdir d6/d10/d29/d6a/dd1/d152 0 2023-01-04T18:16:36.677 INFO:tasks.workunit.client.1.smithi098.stdout:3/973: readlink d6/l4a 0 2023-01-04T18:16:36.677 INFO:tasks.workunit.client.1.smithi098.stdout:3/974: chown d6/d10/d19/d3f/d46/d8a 41 1 2023-01-04T18:16:36.691 INFO:tasks.workunit.client.1.smithi098.stdout:6/866: dwrite d9/dd/d24/d64/ff9 [0,4194304] 0 2023-01-04T18:16:36.691 INFO:tasks.workunit.client.1.smithi098.stdout:4/837: dwrite d5/de/d21/f2d [0,4194304] 0 2023-01-04T18:16:36.691 INFO:tasks.workunit.client.1.smithi098.stdout:6/867: fdatasync d9/dd/de/d44/d79/f80 0 2023-01-04T18:16:36.691 INFO:tasks.workunit.client.1.smithi098.stdout:4/838: chown d5/dad/la9 24815380 1 2023-01-04T18:16:36.691 INFO:tasks.workunit.client.1.smithi098.stdout:4/839: chown d5/d9/d103 24 1 2023-01-04T18:16:36.691 INFO:tasks.workunit.client.1.smithi098.stdout:4/840: truncate d5/d28/d7d/db6/f11e 666169 0 2023-01-04T18:16:36.691 INFO:tasks.workunit.client.1.smithi098.stdout:4/841: rename d5/d28 to d5/d28/d44/d122 22 2023-01-04T18:16:36.691 INFO:tasks.workunit.client.1.smithi098.stdout:4/842: chown d5/de/d2c/c71 1191200281 1 2023-01-04T18:16:36.691 INFO:tasks.workunit.client.1.smithi098.stdout:7/869: dwrite d1/d4/ff6 [0,4194304] 0 2023-01-04T18:16:36.692 INFO:tasks.workunit.client.1.smithi098.stdout:1/785: dwrite d1/d8/dac/dfc/f102 [0,4194304] 0 2023-01-04T18:16:36.693 INFO:tasks.workunit.client.1.smithi098.stdout:1/786: dread - d1/d8/dac/dfc/d36/d4e/d9f/dd7/fe2 zero size 2023-01-04T18:16:36.693 INFO:tasks.workunit.client.1.smithi098.stdout:1/787: fdatasync d1/f83 0 2023-01-04T18:16:36.693 INFO:tasks.workunit.client.1.smithi098.stdout:9/862: dwrite d2/d5/d18/d1d/d23/d5c/deb/f106 [0,4194304] 0 2023-01-04T18:16:36.693 INFO:tasks.workunit.client.1.smithi098.stdout:1/788: write d1/d8/dac/dfc/d36/d4e/d9f/dd7/fe2 [720356,6265] 0 2023-01-04T18:16:36.693 INFO:tasks.workunit.client.1.smithi098.stdout:1/789: dread - d1/d8/dac/dfc/d36/d89/db3/f109 zero size 2023-01-04T18:16:36.693 INFO:tasks.workunit.client.1.smithi098.stdout:9/863: write d2/d5/f75 [1919496,91317] 0 2023-01-04T18:16:36.693 INFO:tasks.workunit.client.1.smithi098.stdout:9/864: dread - d2/d5/d18/d1d/d23/dad/dfa/d42/ff2 zero size 2023-01-04T18:16:36.693 INFO:tasks.workunit.client.1.smithi098.stdout:6/868: write d9/dd/d24/fcf [1668480,41864] 0 2023-01-04T18:16:36.704 INFO:tasks.workunit.client.1.smithi098.stdout:7/870: rmdir d1/dc1 39 2023-01-04T18:16:36.704 INFO:tasks.workunit.client.1.smithi098.stdout:7/871: chown d1/d23/d21/d43/f9e 502 1 2023-01-04T18:16:36.709 INFO:tasks.workunit.client.1.smithi098.stdout:1/790: symlink d1/d88/l11c 0 2023-01-04T18:16:36.709 INFO:tasks.workunit.client.1.smithi098.stdout:1/791: write d1/d8/dac/dfc/f99 [1237993,55766] 0 2023-01-04T18:16:36.709 INFO:tasks.workunit.client.1.smithi098.stdout:1/792: write d1/d8/dac/dfc/d27/d77/f74 [1249182,104154] 0 2023-01-04T18:16:36.709 INFO:tasks.workunit.client.1.smithi098.stdout:1/793: truncate d1/d8/dac/dfc/d27/f34 4800265 0 2023-01-04T18:16:36.715 INFO:tasks.workunit.client.1.smithi098.stdout:9/865: getdents d2/d5/d6f 0 2023-01-04T18:16:36.717 INFO:tasks.workunit.client.1.smithi098.stdout:4/843: dread d5/d28/d40/f48 [0,4194304] 0 2023-01-04T18:16:36.717 INFO:tasks.workunit.client.1.smithi098.stdout:6/869: creat d9/dd/d24/d3e/d86/f10b x:0 0 0 2023-01-04T18:16:36.718 INFO:tasks.workunit.client.1.smithi098.stdout:1/794: creat d1/d8/da/dae/f11d x:0 0 0 2023-01-04T18:16:36.719 INFO:tasks.workunit.client.1.smithi098.stdout:1/795: read d1/d8/dac/dfc/d27/d77/ffd [367441,127786] 0 2023-01-04T18:16:36.720 INFO:tasks.workunit.client.1.smithi098.stdout:1/796: readlink d1/d8/dac/dfc/d27/d77/da8/dca/lbf 0 2023-01-04T18:16:36.721 INFO:tasks.workunit.client.1.smithi098.stdout:1/797: write d1/f30 [3289601,29245] 0 2023-01-04T18:16:36.721 INFO:tasks.workunit.client.1.smithi098.stdout:1/798: stat d1/d8/dac/dfc/d27/f34 0 2023-01-04T18:16:36.724 INFO:tasks.workunit.client.1.smithi098.stdout:6/870: mkdir d9/dd/de/d26/d10c 0 2023-01-04T18:16:36.724 INFO:tasks.workunit.client.1.smithi098.stdout:6/871: dread - d9/fa0 zero size 2023-01-04T18:16:36.724 INFO:tasks.workunit.client.1.smithi098.stdout:6/872: dread - d9/dda/dde/ffe zero size 2023-01-04T18:16:36.725 INFO:tasks.workunit.client.1.smithi098.stdout:7/872: mkdir d1/d4/d11/d5d/d130 0 2023-01-04T18:16:36.725 INFO:tasks.workunit.client.1.smithi098.stdout:7/873: dread - d1/d23/d73/d85/f11a zero size 2023-01-04T18:16:36.727 INFO:tasks.workunit.client.1.smithi098.stdout:1/799: mknod d1/d8/dac/dfc/d36/d4e/d9f/c11e 0 2023-01-04T18:16:36.729 INFO:tasks.workunit.client.1.smithi098.stdout:6/873: rmdir d9/dd/d4e/d67/d8d/d81/dc5 39 2023-01-04T18:16:36.729 INFO:tasks.workunit.client.1.smithi098.stdout:4/844: write d5/de/f5a [31517,31659] 0 2023-01-04T18:16:36.730 INFO:tasks.workunit.client.1.smithi098.stdout:6/874: dread d9/dd/d4e/f58 [0,4194304] 0 2023-01-04T18:16:36.730 INFO:tasks.workunit.client.1.smithi098.stdout:4/845: read d5/d28/fcd [3245474,8313] 0 2023-01-04T18:16:36.731 INFO:tasks.workunit.client.1.smithi098.stdout:7/874: rename d1/d4/d11/ce8 to d1/d4/d11/d9d/dd2/c131 0 2023-01-04T18:16:36.732 INFO:tasks.workunit.client.1.smithi098.stdout:9/866: dwrite d2/d5/d18/d1d/d23/dad/dfa/d42/d89/fa4 [0,4194304] 0 2023-01-04T18:16:36.732 INFO:tasks.workunit.client.1.smithi098.stdout:1/800: mkdir d1/d8/dac/dfc/d6a/d106/d113/d11f 0 2023-01-04T18:16:36.739 INFO:tasks.workunit.client.1.smithi098.stdout:6/875: getdents d9/dd/d24/d3e/d86 0 2023-01-04T18:16:36.742 INFO:tasks.workunit.client.1.smithi098.stdout:4/846: creat d5/d28/d7d/db6/dbd/dc5/d104/f123 x:0 0 0 2023-01-04T18:16:36.743 INFO:tasks.workunit.client.1.smithi098.stdout:5/886: sync 2023-01-04T18:16:36.743 INFO:tasks.workunit.client.1.smithi098.stdout:0/853: sync 2023-01-04T18:16:36.743 INFO:tasks.workunit.client.1.smithi098.stdout:2/868: sync 2023-01-04T18:16:36.743 INFO:tasks.workunit.client.1.smithi098.stdout:0/854: truncate df/d17/d1c/d3b/f58 1482679 0 2023-01-04T18:16:36.744 INFO:tasks.workunit.client.1.smithi098.stdout:5/887: write d1/d2/d14/f27 [2018094,52507] 0 2023-01-04T18:16:36.745 INFO:tasks.workunit.client.1.smithi098.stdout:7/875: creat d1/d51/d26/d28/d8d/f132 x:0 0 0 2023-01-04T18:16:36.745 INFO:tasks.workunit.client.1.smithi098.stdout:5/888: write d1/d2/d14/d59/f71 [835407,18676] 0 2023-01-04T18:16:36.745 INFO:tasks.workunit.client.1.smithi098.stdout:5/889: read - d1/d2f/d66/d75/f99 zero size 2023-01-04T18:16:36.746 INFO:tasks.workunit.client.1.smithi098.stdout:9/867: dwrite d2/d2d/f5d [0,4194304] 0 2023-01-04T18:16:36.747 INFO:tasks.workunit.client.1.smithi098.stdout:5/890: dread d1/d2/d14/da1/fcc [0,4194304] 0 2023-01-04T18:16:36.749 INFO:tasks.workunit.client.1.smithi098.stdout:4/847: creat d5/d28/da6/f124 x:0 0 0 2023-01-04T18:16:36.749 INFO:tasks.workunit.client.1.smithi098.stdout:4/848: stat d5/d28/d7d/db6/dbd 0 2023-01-04T18:16:36.750 INFO:tasks.workunit.client.1.smithi098.stdout:2/869: unlink d6/dc/l95 0 2023-01-04T18:16:36.752 INFO:tasks.workunit.client.1.smithi098.stdout:0/855: unlink df/d17/d1c/d3b/c67 0 2023-01-04T18:16:36.755 INFO:tasks.workunit.client.1.smithi098.stdout:7/876: rename d1/c6d to d1/d23/d73/d12f/c133 0 2023-01-04T18:16:36.757 INFO:tasks.workunit.client.1.smithi098.stdout:5/891: mkdir d1/d38/d11c 0 2023-01-04T18:16:36.759 INFO:tasks.workunit.client.1.smithi098.stdout:0/856: rename df/d4f/d6b/d89/l10c to df/d17/d1c/d2c/d41/d105/l124 0 2023-01-04T18:16:36.760 INFO:tasks.workunit.client.1.smithi098.stdout:5/892: truncate d1/d2f/d73/ffb 2871281 0 2023-01-04T18:16:36.762 INFO:tasks.workunit.client.1.smithi098.stdout:0/857: rename df/d4f/c120 to df/d17/d9b/da4/db5/c125 0 2023-01-04T18:16:36.769 INFO:tasks.workunit.client.1.smithi098.stdout:9/868: dwrite d2/d5/d18/d1d/f2f [4194304,4194304] 0 2023-01-04T18:16:36.772 INFO:tasks.workunit.client.1.smithi098.stdout:9/869: rmdir d2/d5/d18/d1d/d23/dad/dfa/d42/d89 39 2023-01-04T18:16:36.772 INFO:tasks.workunit.client.1.smithi098.stdout:6/876: dwrite d9/dd/de/d44/d79/d104/d85/fae [0,4194304] 0 2023-01-04T18:16:36.772 INFO:tasks.workunit.client.1.smithi098.stdout:6/877: chown d9/fc3 37111970 1 2023-01-04T18:16:36.772 INFO:tasks.workunit.client.1.smithi098.stdout:6/878: write d9/dd/d24/d3e/f9d [436299,81193] 0 2023-01-04T18:16:36.773 INFO:tasks.workunit.client.1.smithi098.stdout:4/849: fsync d5/d28/da6/f124 0 2023-01-04T18:16:36.774 INFO:tasks.workunit.client.1.smithi098.stdout:2/870: dwrite d6/dc/d2b/d46/fef [0,4194304] 0 2023-01-04T18:16:36.775 INFO:tasks.workunit.client.1.smithi098.stdout:9/870: truncate d2/df6/d26/fae 799840 0 2023-01-04T18:16:36.782 INFO:tasks.workunit.client.1.smithi098.stdout:9/871: link d2/d5/d18/ff7 d2/d5/d18/d19/d82/f11c 0 2023-01-04T18:16:36.783 INFO:tasks.workunit.client.1.smithi098.stdout:2/871: link d6/dc/d2b/d42/d47/c28 d6/dc/d2b/d42/d47/d1f/c135 0 2023-01-04T18:16:36.784 INFO:tasks.workunit.client.1.smithi098.stdout:9/872: creat d2/d5/d18/d1d/d23/dad/dfa/d42/d89/f11d x:0 0 0 2023-01-04T18:16:36.786 INFO:tasks.workunit.client.1.smithi098.stdout:9/873: truncate d2/d5/d18/d19/f58 3060159 0 2023-01-04T18:16:36.786 INFO:tasks.workunit.client.1.smithi098.stdout:9/874: fsync d2/d5/d18/f44 0 2023-01-04T18:16:36.786 INFO:tasks.workunit.client.1.smithi098.stdout:9/875: write d2/d5/d18/d1d/d23/dad/dfa/d42/d89/f11d [1002132,40640] 0 2023-01-04T18:16:36.787 INFO:tasks.workunit.client.1.smithi098.stdout:9/876: rmdir d2/d5/d18/db6 39 2023-01-04T18:16:36.812 INFO:tasks.workunit.client.1.smithi098.stdout:7/877: dwrite d1/d51/d26/d28/d2d/f32 [0,4194304] 0 2023-01-04T18:16:36.813 INFO:tasks.workunit.client.1.smithi098.stdout:7/878: read d1/d51/d26/d28/f88 [1907143,105975] 0 2023-01-04T18:16:36.813 INFO:tasks.workunit.client.1.smithi098.stdout:7/879: fdatasync d1/d23/d37/d78/d103/f115 0 2023-01-04T18:16:36.813 INFO:tasks.workunit.client.1.smithi098.stdout:9/877: fdatasync d2/d5/d18/d1d/d23/dad/dfa/d42/d89/f11d 0 2023-01-04T18:16:36.813 INFO:tasks.workunit.client.1.smithi098.stdout:9/878: write d2/d5/d18/d1d/d23/dad/d72/f112 [353065,50262] 0 2023-01-04T18:16:36.813 INFO:tasks.workunit.client.1.smithi098.stdout:5/893: dwrite d1/d1e/dab/dd5/d102/d44/f9c [0,4194304] 0 2023-01-04T18:16:36.814 INFO:tasks.workunit.client.1.smithi098.stdout:5/894: write d1/d2f/d73/ffb [3383140,119646] 0 2023-01-04T18:16:36.814 INFO:tasks.workunit.client.1.smithi098.stdout:2/872: dwrite d6/dc/d2b/d42/d51/d79/da3/f12e [0,4194304] 0 2023-01-04T18:16:36.814 INFO:tasks.workunit.client.1.smithi098.stdout:7/880: unlink d1/da/l3b 0 2023-01-04T18:16:36.814 INFO:tasks.workunit.client.1.smithi098.stdout:4/850: dwrite d5/d28/d40/d5d/dcf/ffb [0,4194304] 0 2023-01-04T18:16:36.817 INFO:tasks.workunit.client.1.smithi098.stdout:9/879: dread d2/d5/f28 [4194304,4194304] 0 2023-01-04T18:16:36.817 INFO:tasks.workunit.client.1.smithi098.stdout:5/895: write d1/d1e/f3e [4850880,32832] 0 2023-01-04T18:16:36.826 INFO:tasks.workunit.client.1.smithi098.stdout:2/873: creat d6/dc/d2b/d42/d51/d81/d8f/de8/f136 x:0 0 0 2023-01-04T18:16:36.826 INFO:tasks.workunit.client.1.smithi098.stdout:2/874: fsync d6/dc/d2b/d42/d47/d1f/d39/fa6 0 2023-01-04T18:16:36.826 INFO:tasks.workunit.client.1.smithi098.stdout:2/875: getdents d6/dc/d2b/d46 0 2023-01-04T18:16:36.828 INFO:tasks.workunit.client.1.smithi098.stdout:7/881: unlink c0 0 2023-01-04T18:16:36.831 INFO:tasks.workunit.client.1.smithi098.stdout:5/896: dwrite d1/d1e/dab/dd5/d102/d44/d45/fb8 [0,4194304] 0 2023-01-04T18:16:36.832 INFO:tasks.workunit.client.1.smithi098.stdout:7/882: dread d1/d23/d21/f4b [0,4194304] 0 2023-01-04T18:16:36.833 INFO:tasks.workunit.client.1.smithi098.stdout:4/851: unlink d5/f4d 0 2023-01-04T18:16:36.837 INFO:tasks.workunit.client.1.smithi098.stdout:9/880: mkdir d2/d5/d6f/d11e 0 2023-01-04T18:16:36.838 INFO:tasks.workunit.client.1.smithi098.stdout:2/876: rename d6/dc/d2b/d42/d51/d79/ffd to d6/dc/d2b/d42/d51/d79/da3/db5/f137 0 2023-01-04T18:16:36.840 INFO:tasks.workunit.client.1.smithi098.stdout:8/860: sync 2023-01-04T18:16:36.843 INFO:tasks.workunit.client.1.smithi098.stdout:7/883: dread d1/d23/d37/d78/f90 [0,4194304] 0 2023-01-04T18:16:36.845 INFO:tasks.workunit.client.1.smithi098.stdout:4/852: symlink d5/de/d2c/dcb/l125 0 2023-01-04T18:16:36.845 INFO:tasks.workunit.client.1.smithi098.stdout:4/853: chown d5/lf8 1 1 2023-01-04T18:16:36.845 INFO:tasks.workunit.client.1.smithi098.stdout:4/854: write d5/d28/d7d/db6/f11e [1402797,104764] 0 2023-01-04T18:16:36.845 INFO:tasks.workunit.client.1.smithi098.stdout:4/855: stat d5/d28/d44/f77 0 2023-01-04T18:16:36.845 INFO:tasks.workunit.client.1.smithi098.stdout:4/856: dread - d5/d28/d7d/db6/dbd/dc5/d104/f123 zero size 2023-01-04T18:16:36.845 INFO:tasks.workunit.client.1.smithi098.stdout:4/857: chown d5/d28/d40/f52 1 1 2023-01-04T18:16:36.845 INFO:tasks.workunit.client.1.smithi098.stdout:9/881: creat d2/d5/d18/d1d/f11f x:0 0 0 2023-01-04T18:16:36.845 INFO:tasks.workunit.client.1.smithi098.stdout:9/882: dread - d2/d5/d18/d1d/d23/dad/fee zero size 2023-01-04T18:16:36.845 INFO:tasks.workunit.client.1.smithi098.stdout:9/883: dread - d2/d5/d18/dc6/f109 zero size 2023-01-04T18:16:36.845 INFO:tasks.workunit.client.1.smithi098.stdout:9/884: read d2/d5/d18/d1d/d23/dad/dfa/fc8 [164647,43622] 0 2023-01-04T18:16:36.846 INFO:tasks.workunit.client.1.smithi098.stdout:2/877: mknod d6/ded/c138 0 2023-01-04T18:16:36.847 INFO:tasks.workunit.client.1.smithi098.stdout:2/878: write d6/dc/d4b/f10f [546862,113899] 0 2023-01-04T18:16:36.847 INFO:tasks.workunit.client.1.smithi098.stdout:2/879: write d6/dc/d2b/d42/d47/d1f/d39/f56 [475478,105053] 0 2023-01-04T18:16:36.847 INFO:tasks.workunit.client.1.smithi098.stdout:7/884: rename d1/d51/d26/d28/d8d to d1/d23/d73/d85/d134 0 2023-01-04T18:16:36.848 INFO:tasks.workunit.client.1.smithi098.stdout:9/885: mkdir d2/d5/d18/d1d/d23/dad/dfa/ded/d120 0 2023-01-04T18:16:36.851 INFO:tasks.workunit.client.1.smithi098.stdout:2/880: mkdir d6/dc/d4b/d139 0 2023-01-04T18:16:36.851 INFO:tasks.workunit.client.1.smithi098.stdout:5/897: dwrite d1/d1e/dab/dd5/d102/d44/d45/d4b/dec/d106/ff6 [0,4194304] 0 2023-01-04T18:16:36.851 INFO:tasks.workunit.client.1.smithi098.stdout:8/861: dread d6/d11/d15/db4/dba/ded/fce [0,4194304] 0 2023-01-04T18:16:36.851 INFO:tasks.workunit.client.1.smithi098.stdout:8/862: write d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/d8a/ddd/df5/ff8 [1467219,81851] 0 2023-01-04T18:16:36.851 INFO:tasks.workunit.client.1.smithi098.stdout:8/863: truncate d6/d11/d15/d1b/d2a/d6b/d7f/d78/f91 923710 0 2023-01-04T18:16:36.851 INFO:tasks.workunit.client.1.smithi098.stdout:8/864: write d6/d11/d15/d1b/d2a/d3b/d79/f103 [267566,118024] 0 2023-01-04T18:16:36.851 INFO:tasks.workunit.client.1.smithi098.stdout:8/865: write d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d64/de8/fdc [343644,54449] 0 2023-01-04T18:16:36.851 INFO:tasks.workunit.client.1.smithi098.stdout:3/975: sync 2023-01-04T18:16:36.851 INFO:tasks.workunit.client.1.smithi098.stdout:1/801: sync 2023-01-04T18:16:36.851 INFO:tasks.workunit.client.1.smithi098.stdout:3/976: chown d6/d10/d19/d3f/d46/d109 1268 1 2023-01-04T18:16:36.852 INFO:tasks.workunit.client.1.smithi098.stdout:1/802: write d1/da9/fd8 [488862,34111] 0 2023-01-04T18:16:36.852 INFO:tasks.workunit.client.1.smithi098.stdout:3/977: read d6/d56/d9f/da8/f10f [148324,40104] 0 2023-01-04T18:16:36.852 INFO:tasks.workunit.client.1.smithi098.stdout:5/898: write d1/d38/d3b/d8f/ff9 [919708,103334] 0 2023-01-04T18:16:36.852 INFO:tasks.workunit.client.1.smithi098.stdout:7/885: symlink d1/d23/d37/l135 0 2023-01-04T18:16:36.858 INFO:tasks.workunit.client.1.smithi098.stdout:4/858: rename d5/d28/d44/f10b to d5/de/d21/f126 0 2023-01-04T18:16:36.861 INFO:tasks.workunit.client.1.smithi098.stdout:2/881: mkdir d6/dc/d2b/d42/d13a 0 2023-01-04T18:16:36.863 INFO:tasks.workunit.client.1.smithi098.stdout:8/866: symlink d6/d11/d15/d70/dc3/l104 0 2023-01-04T18:16:36.864 INFO:tasks.workunit.client.1.smithi098.stdout:3/978: unlink d6/d10/d19/d3f/d5e/d7d/d90/fcf 0 2023-01-04T18:16:36.864 INFO:tasks.workunit.client.1.smithi098.stdout:3/979: chown d6/l43 6746262 1 2023-01-04T18:16:36.866 INFO:tasks.workunit.client.1.smithi098.stdout:5/899: mknod d1/d2f/d73/c11d 0 2023-01-04T18:16:36.866 INFO:tasks.workunit.client.1.smithi098.stdout:2/882: write f5 [4251768,23332] 0 2023-01-04T18:16:36.866 INFO:tasks.workunit.client.1.smithi098.stdout:2/883: dread - d6/dc/d2b/d42/d51/d81/fd3 zero size 2023-01-04T18:16:36.868 INFO:tasks.workunit.client.1.smithi098.stdout:8/867: unlink d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/d8a/lf2 0 2023-01-04T18:16:36.869 INFO:tasks.workunit.client.1.smithi098.stdout:5/900: truncate d1/d1e/dab/dd5/d102/d44/f9c 2424052 0 2023-01-04T18:16:36.870 INFO:tasks.workunit.client.1.smithi098.stdout:2/884: creat d6/dc/d2b/f13b x:0 0 0 2023-01-04T18:16:36.870 INFO:tasks.workunit.client.1.smithi098.stdout:2/885: fdatasync d6/dc/d2b/d42/d47/d1f/dee/f12f 0 2023-01-04T18:16:36.870 INFO:tasks.workunit.client.1.smithi098.stdout:2/886: stat d6/dc/d2b/d32/f116 0 2023-01-04T18:16:36.871 INFO:tasks.workunit.client.1.smithi098.stdout:8/868: link d6/d11/d15/db4/ld5 d6/d11/d15/d1b/d2a/d3b/l105 0 2023-01-04T18:16:36.872 INFO:tasks.workunit.client.1.smithi098.stdout:5/901: mknod d1/d2f/d73/c11e 0 2023-01-04T18:16:36.874 INFO:tasks.workunit.client.1.smithi098.stdout:2/887: link d6/dc/fdb d6/dc/d2b/d42/d51/de1/d12b/f13c 0 2023-01-04T18:16:36.875 INFO:tasks.workunit.client.1.smithi098.stdout:8/869: symlink d6/d11/d15/d70/dc3/l106 0 2023-01-04T18:16:36.876 INFO:tasks.workunit.client.1.smithi098.stdout:5/902: symlink d1/d1e/l11f 0 2023-01-04T18:16:36.877 INFO:tasks.workunit.client.1.smithi098.stdout:2/888: write d6/dc/d2b/d42/d51/d79/da3/f12e [376309,119987] 0 2023-01-04T18:16:36.878 INFO:tasks.workunit.client.1.smithi098.stdout:2/889: write d6/dc/f14 [3201991,85117] 0 2023-01-04T18:16:36.878 INFO:tasks.workunit.client.1.smithi098.stdout:2/890: chown d6/dc/d2b/d42/fb8 2370543 1 2023-01-04T18:16:36.879 INFO:tasks.workunit.client.1.smithi098.stdout:5/903: rmdir d1/d1e/dab/dd5/d102/d44/d83 39 2023-01-04T18:16:36.880 INFO:tasks.workunit.client.1.smithi098.stdout:2/891: mkdir d6/dc/d2b/d42/d51/d13d 0 2023-01-04T18:16:36.881 INFO:tasks.workunit.client.1.smithi098.stdout:2/892: chown d6/dc/d2b/d42/d47/da5/dda/f119 9492 1 2023-01-04T18:16:36.881 INFO:tasks.workunit.client.1.smithi098.stdout:2/893: fsync d6/dc/d2b/d42/fe4 0 2023-01-04T18:16:36.881 INFO:tasks.workunit.client.1.smithi098.stdout:2/894: dread - d6/dc/d2b/f13b zero size 2023-01-04T18:16:36.882 INFO:tasks.workunit.client.1.smithi098.stdout:2/895: mkdir d6/dc/d2b/d42/d47/da5/d13e 0 2023-01-04T18:16:36.883 INFO:tasks.workunit.client.1.smithi098.stdout:2/896: getdents d6/dc/d2b/d42/d51/d79/da3 0 2023-01-04T18:16:36.887 INFO:tasks.workunit.client.1.smithi098.stdout:1/803: dwrite d1/f4 [4194304,4194304] 0 2023-01-04T18:16:36.887 INFO:tasks.workunit.client.1.smithi098.stdout:1/804: read - d1/da9/de3/dec/df1/f101 zero size 2023-01-04T18:16:36.887 INFO:tasks.workunit.client.1.smithi098.stdout:9/886: dwrite d2/d5/d18/d1d/d23/d5c/f95 [0,4194304] 0 2023-01-04T18:16:36.888 INFO:tasks.workunit.client.1.smithi098.stdout:1/805: read - d1/d8/d53/feb zero size 2023-01-04T18:16:36.889 INFO:tasks.workunit.client.1.smithi098.stdout:0/858: sync 2023-01-04T18:16:36.889 INFO:tasks.workunit.client.1.smithi098.stdout:0/859: chown df/d4f/f5d 2301515 1 2023-01-04T18:16:36.889 INFO:tasks.workunit.client.1.smithi098.stdout:0/860: chown df/d17/d1c/f22 445728 1 2023-01-04T18:16:36.889 INFO:tasks.workunit.client.1.smithi098.stdout:6/879: sync 2023-01-04T18:16:36.889 INFO:tasks.workunit.client.1.smithi098.stdout:6/880: write d9/dd/de/d20/d82/d84/ff2 [994788,55152] 0 2023-01-04T18:16:36.889 INFO:tasks.workunit.client.1.smithi098.stdout:6/881: write d9/dd/de/d44/d79/d104/fc6 [4822915,122298] 0 2023-01-04T18:16:36.890 INFO:tasks.workunit.client.1.smithi098.stdout:3/980: dwrite d6/d10/d19/d3f/d5e/d7d/d116/f11f [0,4194304] 0 2023-01-04T18:16:36.891 INFO:tasks.workunit.client.1.smithi098.stdout:9/887: dread d2/d5/d18/d1d/d23/dad/f59 [0,4194304] 0 2023-01-04T18:16:36.894 INFO:tasks.workunit.client.1.smithi098.stdout:4/859: dwrite d5/d9/d13/f111 [0,4194304] 0 2023-01-04T18:16:36.897 INFO:tasks.workunit.client.1.smithi098.stdout:4/860: dread d5/d9/d13/d65/fd2 [0,4194304] 0 2023-01-04T18:16:36.898 INFO:tasks.workunit.client.1.smithi098.stdout:8/870: rmdir d6/d11/d15/d1b/d2a/d3b 39 2023-01-04T18:16:36.898 INFO:tasks.workunit.client.1.smithi098.stdout:8/871: write d6/d11/d15/f9a [172575,112043] 0 2023-01-04T18:16:36.900 INFO:tasks.workunit.client.1.smithi098.stdout:8/872: write d6/d11/d15/d1b/f76 [3735592,125228] 0 2023-01-04T18:16:36.901 INFO:tasks.workunit.client.1.smithi098.stdout:1/806: getdents d1/d8/dac/dfc/d36/d4e/d9f 0 2023-01-04T18:16:36.905 INFO:tasks.workunit.client.1.smithi098.stdout:8/873: dread d6/d11/d15/d1b/d2a/d6b/f7b [0,4194304] 0 2023-01-04T18:16:36.908 INFO:tasks.workunit.client.1.smithi098.stdout:6/882: creat d9/dd/de/d20/d82/f10d x:0 0 0 2023-01-04T18:16:36.911 INFO:tasks.workunit.client.1.smithi098.stdout:4/861: mkdir d5/d9/d13/dab/d127 0 2023-01-04T18:16:36.911 INFO:tasks.workunit.client.1.smithi098.stdout:4/862: write d5/de/d30/f68 [266387,123350] 0 2023-01-04T18:16:36.911 INFO:tasks.workunit.client.1.smithi098.stdout:4/863: truncate d5/d28/dff/f11c 354482 0 2023-01-04T18:16:36.913 INFO:tasks.workunit.client.1.smithi098.stdout:1/807: unlink d1/d8/dac/dfc/d36/d89/df4/f108 0 2023-01-04T18:16:36.913 INFO:tasks.workunit.client.1.smithi098.stdout:8/874: creat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/d8a/ddd/df5/f107 x:0 0 0 2023-01-04T18:16:36.915 INFO:tasks.workunit.client.1.smithi098.stdout:6/883: mknod d9/dd/de/d26/d10c/c10e 0 2023-01-04T18:16:36.915 INFO:tasks.workunit.client.1.smithi098.stdout:6/884: fsync d9/dd/d4e/d67/d8d/da5/fdb 0 2023-01-04T18:16:36.915 INFO:tasks.workunit.client.1.smithi098.stdout:6/885: chown d9/dd/de/d44/d79/d104/lcb 0 1 2023-01-04T18:16:36.915 INFO:tasks.workunit.client.1.smithi098.stdout:6/886: dread - d9/dd/de/d20/d82/f10d zero size 2023-01-04T18:16:36.915 INFO:tasks.workunit.client.1.smithi098.stdout:3/981: dwrite d6/d10/d19/d3f/d5e/d7d/d90/f107 [0,4194304] 0 2023-01-04T18:16:36.916 INFO:tasks.workunit.client.1.smithi098.stdout:3/982: read - d6/d6f/db6/ff5 zero size 2023-01-04T18:16:36.916 INFO:tasks.workunit.client.1.smithi098.stdout:9/888: rename d2/df6/d26/d41/laa to d2/d5/d18/d19/d82/dce/d10f/l121 0 2023-01-04T18:16:36.916 INFO:tasks.workunit.client.1.smithi098.stdout:6/887: truncate d9/dd/d15/f36 1912067 0 2023-01-04T18:16:36.918 INFO:tasks.workunit.client.1.smithi098.stdout:1/808: write d1/d8/da/f17 [2368476,112208] 0 2023-01-04T18:16:36.918 INFO:tasks.workunit.client.1.smithi098.stdout:0/861: dwrite df/d4f/dc7/df2/f102 [0,4194304] 0 2023-01-04T18:16:36.918 INFO:tasks.workunit.client.1.smithi098.stdout:2/897: dwrite d6/dc/d4b/f63 [0,4194304] 0 2023-01-04T18:16:36.919 INFO:tasks.workunit.client.1.smithi098.stdout:3/983: symlink d6/d6f/db6/l153 0 2023-01-04T18:16:36.919 INFO:tasks.workunit.client.1.smithi098.stdout:3/984: chown d6/d10/d19/d3f/d5e/d7d/d90/f107 199 1 2023-01-04T18:16:36.919 INFO:tasks.workunit.client.1.smithi098.stdout:5/904: dwrite d1/d2f/d73/f10c [0,4194304] 0 2023-01-04T18:16:36.920 INFO:tasks.workunit.client.1.smithi098.stdout:4/864: rename d5/d28/da6/f124 to d5/d28/d7d/db6/dd8/f128 0 2023-01-04T18:16:36.920 INFO:tasks.workunit.client.1.smithi098.stdout:4/865: fsync d5/dad/fb2 0 2023-01-04T18:16:36.920 INFO:tasks.workunit.client.1.smithi098.stdout:4/866: chown d5/d28/d40/d5d/ff4 316737349 1 2023-01-04T18:16:36.920 INFO:tasks.workunit.client.1.smithi098.stdout:9/889: creat d2/d5/f122 x:0 0 0 2023-01-04T18:16:36.922 INFO:tasks.workunit.client.1.smithi098.stdout:2/898: write d6/dc/d4b/f10f [3262739,120095] 0 2023-01-04T18:16:36.922 INFO:tasks.workunit.client.1.smithi098.stdout:2/899: stat d6/dc/d2b/d42/d47/d1f/d39/d6e/f77 0 2023-01-04T18:16:36.923 INFO:tasks.workunit.client.1.smithi098.stdout:6/888: rmdir d9/dd/de/d20/d82/d84 39 2023-01-04T18:16:36.923 INFO:tasks.workunit.client.1.smithi098.stdout:6/889: truncate d9/dd/de/d20/d82/d84/f108 439433 0 2023-01-04T18:16:36.927 INFO:tasks.workunit.client.1.smithi098.stdout:9/890: write d2/d5/d18/d19/d82/f84 [1363715,23096] 0 2023-01-04T18:16:36.935 INFO:tasks.workunit.client.1.smithi098.stdout:1/809: write d1/d8/da/dae/f6c [1291034,73792] 0 2023-01-04T18:16:36.939 INFO:tasks.workunit.client.1.smithi098.stdout:3/985: dwrite d6/d10/d19/d3f/d5e/d145/d150/f3c [0,4194304] 0 2023-01-04T18:16:36.940 INFO:tasks.workunit.client.1.smithi098.stdout:5/905: mkdir d1/d2f/d66/d75/d120 0 2023-01-04T18:16:36.942 INFO:tasks.workunit.client.1.smithi098.stdout:8/875: rename d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/d8a/fde to d6/d11/d15/db4/f108 0 2023-01-04T18:16:36.944 INFO:tasks.workunit.client.1.smithi098.stdout:7/886: sync 2023-01-04T18:16:36.945 INFO:tasks.workunit.client.1.smithi098.stdout:7/887: dread - d1/d23/d37/d78/d103/f115 zero size 2023-01-04T18:16:36.945 INFO:tasks.workunit.client.1.smithi098.stdout:4/867: creat d5/dad/f129 x:0 0 0 2023-01-04T18:16:36.945 INFO:tasks.workunit.client.1.smithi098.stdout:4/868: write d5/f16 [711031,32381] 0 2023-01-04T18:16:36.945 INFO:tasks.workunit.client.1.smithi098.stdout:4/869: read - d5/d9/f7c zero size 2023-01-04T18:16:36.947 INFO:tasks.workunit.client.1.smithi098.stdout:2/900: mkdir d6/dc/d2b/d42/d47/d1f/d39/d13f 0 2023-01-04T18:16:36.947 INFO:tasks.workunit.client.1.smithi098.stdout:2/901: chown d6/dc/d2b/d42/d47/d1f/l12c 36686209 1 2023-01-04T18:16:36.947 INFO:tasks.workunit.client.1.smithi098.stdout:2/902: stat d6/dc/d2b/d42/d47/d1f/d39/fa6 0 2023-01-04T18:16:36.948 INFO:tasks.workunit.client.1.smithi098.stdout:9/891: mkdir d2/d5/d18/d1d/d23/dad/d72/d123 0 2023-01-04T18:16:36.949 INFO:tasks.workunit.client.1.smithi098.stdout:9/892: write d2/d5/d18/d1d/d23/dad/d72/d9e/dca/df5/f103 [598246,30033] 0 2023-01-04T18:16:36.952 INFO:tasks.workunit.client.1.smithi098.stdout:1/810: symlink d1/da9/l120 0 2023-01-04T18:16:36.952 INFO:tasks.workunit.client.1.smithi098.stdout:5/906: dread d1/d1e/dab/dd5/d102/d44/d80/dbd/ff8 [4194304,4194304] 0 2023-01-04T18:16:36.953 INFO:tasks.workunit.client.1.smithi098.stdout:3/986: mknod d6/d10/d19/d3f/d46/d10b/c154 0 2023-01-04T18:16:36.955 INFO:tasks.workunit.client.1.smithi098.stdout:0/862: rename df/d17/d1c/d3b/c95 to df/d17/d1c/d2c/d41/d4a/d4c/c126 0 2023-01-04T18:16:36.956 INFO:tasks.workunit.client.1.smithi098.stdout:0/863: read df/d17/f2d [882312,131000] 0 2023-01-04T18:16:36.957 INFO:tasks.workunit.client.1.smithi098.stdout:7/888: rmdir d1/d51/d26/d28/d2d/d75 39 2023-01-04T18:16:36.960 INFO:tasks.workunit.client.1.smithi098.stdout:4/870: mkdir d5/de/d2c/d12a 0 2023-01-04T18:16:36.960 INFO:tasks.workunit.client.1.smithi098.stdout:4/871: chown d5/de/d2c/cce 2998571 1 2023-01-04T18:16:36.965 INFO:tasks.workunit.client.1.smithi098.stdout:5/907: creat d1/d2f/f121 x:0 0 0 2023-01-04T18:16:36.966 INFO:tasks.workunit.client.1.smithi098.stdout:0/864: link df/d17/d1c/d2c/dba/lc6 df/d17/d9b/ddf/l127 0 2023-01-04T18:16:36.966 INFO:tasks.workunit.client.1.smithi098.stdout:0/865: dread - df/d17/d1c/d2c/d41/d4a/fda zero size 2023-01-04T18:16:36.977 INFO:tasks.workunit.client.1.smithi098.stdout:5/908: mknod d1/d38/d3b/c122 0 2023-01-04T18:16:36.977 INFO:tasks.workunit.client.1.smithi098.stdout:0/866: symlink df/d17/d9b/d86/de7/l128 0 2023-01-04T18:16:36.978 INFO:tasks.workunit.client.1.smithi098.stdout:5/909: mkdir d1/d1e/dab/dd5/d102/d44/d80/dc6/d123 0 2023-01-04T18:16:36.978 INFO:tasks.workunit.client.1.smithi098.stdout:5/910: truncate d1/d2/d14/fd1 308059 0 2023-01-04T18:16:36.978 INFO:tasks.workunit.client.1.smithi098.stdout:5/911: write d1/d46/d6a/f6d [4891426,18877] 0 2023-01-04T18:16:36.979 INFO:tasks.workunit.client.1.smithi098.stdout:5/912: creat d1/d1e/dab/dd5/d102/d44/d80/dc6/f124 x:0 0 0 2023-01-04T18:16:36.980 INFO:tasks.workunit.client.1.smithi098.stdout:5/913: mknod d1/d1e/dab/dd5/d102/d44/d80/dbb/c125 0 2023-01-04T18:16:37.002 INFO:tasks.workunit.client.1.smithi098.stdout:8/876: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/d8a/ddd/df5/f107 [0,4194304] 0 2023-01-04T18:16:37.007 INFO:tasks.workunit.client.1.smithi098.stdout:8/877: write d6/d11/d15/d1b/d2a/d3b/f5d [62085,115851] 0 2023-01-04T18:16:37.008 INFO:tasks.workunit.client.1.smithi098.stdout:8/878: read d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/f40 [1266318,63242] 0 2023-01-04T18:16:37.009 INFO:tasks.workunit.client.1.smithi098.stdout:8/879: mkdir d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d64/d109 0 2023-01-04T18:16:37.010 INFO:tasks.workunit.client.1.smithi098.stdout:8/880: symlink d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/l10a 0 2023-01-04T18:16:37.011 INFO:tasks.workunit.client.1.smithi098.stdout:8/881: rename d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d64/fe9 to d6/d11/f10b 0 2023-01-04T18:16:37.013 INFO:tasks.workunit.client.1.smithi098.stdout:8/882: write d6/d11/d15/d1b/d2a/d6b/d7f/f81 [3137162,129936] 0 2023-01-04T18:16:37.013 INFO:tasks.workunit.client.1.smithi098.stdout:8/883: dread - d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/fb6 zero size 2023-01-04T18:16:37.020 INFO:tasks.workunit.client.1.smithi098.stdout:9/893: dwrite d2/d5/d6f/ff4 [0,4194304] 0 2023-01-04T18:16:37.020 INFO:tasks.workunit.client.1.smithi098.stdout:3/987: dwrite d6/d10/d19/f13a [0,4194304] 0 2023-01-04T18:16:37.021 INFO:tasks.workunit.client.1.smithi098.stdout:1/811: dwrite d1/d8/dac/dfc/d27/d77/ffd [0,4194304] 0 2023-01-04T18:16:37.021 INFO:tasks.workunit.client.1.smithi098.stdout:7/889: dwrite d1/d2e/f54 [0,4194304] 0 2023-01-04T18:16:37.022 INFO:tasks.workunit.client.1.smithi098.stdout:0/867: dwrite df/d17/d9b/da1/fd8 [0,4194304] 0 2023-01-04T18:16:37.031 INFO:tasks.workunit.client.1.smithi098.stdout:8/884: dread d6/d11/d15/d1b/d2a/d6b/d7f/f81 [0,4194304] 0 2023-01-04T18:16:37.032 INFO:tasks.workunit.client.1.smithi098.stdout:3/988: rename d6/d10/db7/de1/l147 to d6/d56/dc8/l155 0 2023-01-04T18:16:37.033 INFO:tasks.workunit.client.1.smithi098.stdout:4/872: rmdir d5 39 2023-01-04T18:16:37.035 INFO:tasks.workunit.client.1.smithi098.stdout:1/812: getdents d1/d8/dac/dfc/d6a 0 2023-01-04T18:16:37.035 INFO:tasks.workunit.client.1.smithi098.stdout:1/813: chown d1/d8/dac/dfc/d27/d77/da8/fe6 4 1 2023-01-04T18:16:37.035 INFO:tasks.workunit.client.1.smithi098.stdout:1/814: stat d1/d8 0 2023-01-04T18:16:37.039 INFO:tasks.workunit.client.1.smithi098.stdout:7/890: mknod d1/d51/d26/d28/c136 0 2023-01-04T18:16:37.039 INFO:tasks.workunit.client.1.smithi098.stdout:7/891: chown d1/d23/d73/d85/d134/caf 35532 1 2023-01-04T18:16:37.040 INFO:tasks.workunit.client.1.smithi098.stdout:7/892: dread - d1/d23/d37/fee zero size 2023-01-04T18:16:37.041 INFO:tasks.workunit.client.1.smithi098.stdout:0/868: dwrite df/d17/d1c/d2c/d41/d4a/d4c/d90/fee [0,4194304] 0 2023-01-04T18:16:37.047 INFO:tasks.workunit.client.1.smithi098.stdout:8/885: dread d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/f6f [0,4194304] 0 2023-01-04T18:16:37.048 INFO:tasks.workunit.client.1.smithi098.stdout:3/989: creat d6/d10/d29/d6a/dd1/f156 x:0 0 0 2023-01-04T18:16:37.050 INFO:tasks.workunit.client.1.smithi098.stdout:4/873: creat d5/d28/d7d/db6/de4/f12b x:0 0 0 2023-01-04T18:16:37.050 INFO:tasks.workunit.client.1.smithi098.stdout:4/874: chown d5/d28/d40/d5d/f6d 4013 1 2023-01-04T18:16:37.051 INFO:tasks.workunit.client.1.smithi098.stdout:4/875: write d5/de/d21/f39 [1411636,73548] 0 2023-01-04T18:16:37.051 INFO:tasks.workunit.client.1.smithi098.stdout:1/815: mknod d1/da9/de3/c121 0 2023-01-04T18:16:37.051 INFO:tasks.workunit.client.1.smithi098.stdout:0/869: dread df/d17/d9b/da4/f76 [0,4194304] 0 2023-01-04T18:16:37.056 INFO:tasks.workunit.client.1.smithi098.stdout:8/886: rename d6/d11/d15/d1b/d2a/d6b/d7f/d78/d9d to d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/d10c 0 2023-01-04T18:16:37.058 INFO:tasks.workunit.client.1.smithi098.stdout:4/876: symlink d5/d28/d7d/ddb/df9/l12c 0 2023-01-04T18:16:37.060 INFO:tasks.workunit.client.1.smithi098.stdout:1/816: rmdir d1/d8/dac/dfc/d36/d89/df4 39 2023-01-04T18:16:37.061 INFO:tasks.workunit.client.1.smithi098.stdout:0/870: creat df/d17/d1c/d2c/da8/d118/f129 x:0 0 0 2023-01-04T18:16:37.062 INFO:tasks.workunit.client.1.smithi098.stdout:8/887: creat d6/d11/d15/db0/df6/f10d x:0 0 0 2023-01-04T18:16:37.062 INFO:tasks.workunit.client.1.smithi098.stdout:3/990: mknod d6/d10/d19/c157 0 2023-01-04T18:16:37.064 INFO:tasks.workunit.client.1.smithi098.stdout:4/877: unlink d5/d28/d7d/db6/dbd/fd6 0 2023-01-04T18:16:37.064 INFO:tasks.workunit.client.1.smithi098.stdout:4/878: write d5/f42 [1222147,113276] 0 2023-01-04T18:16:37.064 INFO:tasks.workunit.client.1.smithi098.stdout:1/817: creat d1/da9/f122 x:0 0 0 2023-01-04T18:16:37.067 INFO:tasks.workunit.client.1.smithi098.stdout:0/871: link df/d4f/d6e/l7b df/d17/d1c/d2c/da8/d118/l12a 0 2023-01-04T18:16:37.067 INFO:tasks.workunit.client.1.smithi098.stdout:6/890: sync 2023-01-04T18:16:37.067 INFO:tasks.workunit.client.1.smithi098.stdout:1/818: mkdir d1/da9/de3/dec/df1/d123 0 2023-01-04T18:16:37.067 INFO:tasks.workunit.client.1.smithi098.stdout:0/872: chown df/d17/d1c/d2c/d41/da0 11617309 1 2023-01-04T18:16:37.072 INFO:tasks.workunit.client.1.smithi098.stdout:0/873: rename df/d17/f54 to df/d4f/d6b/d94/f12b 0 2023-01-04T18:16:37.072 INFO:tasks.workunit.client.1.smithi098.stdout:6/891: getdents d9/dd/de/d20/d82/d84 0 2023-01-04T18:16:37.072 INFO:tasks.workunit.client.1.smithi098.stdout:6/892: readlink d9/dd/de/d20/d82/d84/lfb 0 2023-01-04T18:16:37.073 INFO:tasks.workunit.client.1.smithi098.stdout:0/874: fsync df/d17/d1c/d2c/d41/fae 0 2023-01-04T18:16:37.074 INFO:tasks.workunit.client.1.smithi098.stdout:6/893: mknod d9/dd/de/d20/d82/c10f 0 2023-01-04T18:16:37.074 INFO:tasks.workunit.client.1.smithi098.stdout:0/875: creat df/d17/d1c/d2c/d41/d64/f12c x:0 0 0 2023-01-04T18:16:37.076 INFO:tasks.workunit.client.1.smithi098.stdout:0/876: mknod df/d17/d1c/d3b/d98/c12d 0 2023-01-04T18:16:37.076 INFO:tasks.workunit.client.1.smithi098.stdout:0/877: write df/d17/d9b/d86/fc5 [763386,33891] 0 2023-01-04T18:16:37.078 INFO:tasks.workunit.client.1.smithi098.stdout:6/894: write d9/dd/de/d20/d82/d84/ff2 [128450,20260] 0 2023-01-04T18:16:37.079 INFO:tasks.workunit.client.1.smithi098.stdout:6/895: write d9/dd/fd2 [164543,1066] 0 2023-01-04T18:16:37.083 INFO:tasks.workunit.client.1.smithi098.stdout:6/896: creat d9/dd/d4e/d67/d8d/d81/dc5/f110 x:0 0 0 2023-01-04T18:16:37.085 INFO:tasks.workunit.client.1.smithi098.stdout:6/897: symlink d9/dd/d24/d3e/d86/dfc/l111 0 2023-01-04T18:16:37.085 INFO:tasks.workunit.client.1.smithi098.stdout:6/898: fsync d9/dd/de/d7e/f93 0 2023-01-04T18:16:37.086 INFO:tasks.workunit.client.1.smithi098.stdout:6/899: write d9/dd/de/d44/d79/d104/d85/fc7 [339659,29557] 0 2023-01-04T18:16:37.091 INFO:tasks.workunit.client.1.smithi098.stdout:0/878: dread df/d17/d1c/d2c/d104/f96 [0,4194304] 0 2023-01-04T18:16:37.098 INFO:tasks.workunit.client.1.smithi098.stdout:0/879: write df/d17/f4b [1363899,112222] 0 2023-01-04T18:16:37.098 INFO:tasks.workunit.client.1.smithi098.stdout:0/880: readlink df/d17/d68/l9d 0 2023-01-04T18:16:37.100 INFO:tasks.workunit.client.1.smithi098.stdout:0/881: link df/d17/d24/l7c df/d17/d9b/da4/db5/l12e 0 2023-01-04T18:16:37.101 INFO:tasks.workunit.client.1.smithi098.stdout:0/882: unlink df/d4f/d6b/d89/le4 0 2023-01-04T18:16:37.102 INFO:tasks.workunit.client.1.smithi098.stdout:0/883: symlink df/d17/d9b/da1/l12f 0 2023-01-04T18:16:37.104 INFO:tasks.workunit.client.1.smithi098.stdout:8/888: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/fea [0,4194304] 0 2023-01-04T18:16:37.106 INFO:tasks.workunit.client.1.smithi098.stdout:4/879: dwrite d5/de/d30/d4f/f117 [0,4194304] 0 2023-01-04T18:16:37.107 INFO:tasks.workunit.client.1.smithi098.stdout:6/900: dwrite d9/dd/d24/d3e/fe8 [0,4194304] 0 2023-01-04T18:16:37.107 INFO:tasks.workunit.client.1.smithi098.stdout:1/819: dwrite d1/f1f [0,4194304] 0 2023-01-04T18:16:37.107 INFO:tasks.workunit.client.1.smithi098.stdout:1/820: chown d1/d8/dac/dfc/d6a/fb0 10379 1 2023-01-04T18:16:37.107 INFO:tasks.workunit.client.1.smithi098.stdout:6/901: truncate d9/dd/d24/d3e/f9d 1542273 0 2023-01-04T18:16:37.107 INFO:tasks.workunit.client.1.smithi098.stdout:6/902: write d9/dd/de/d20/d82/d84/f108 [1396371,69768] 0 2023-01-04T18:16:37.108 INFO:tasks.workunit.client.1.smithi098.stdout:6/903: write d9/dd/de/d44/d79/fcd [876947,93821] 0 2023-01-04T18:16:37.108 INFO:tasks.workunit.client.1.smithi098.stdout:6/904: write d9/dd/de/d20/d82/f10d [1022302,31910] 0 2023-01-04T18:16:37.108 INFO:tasks.workunit.client.1.smithi098.stdout:3/991: dwrite d6/d10/d19/d3f/d5e/d145/d150/f52 [4194304,4194304] 0 2023-01-04T18:16:37.109 INFO:tasks.workunit.client.1.smithi098.stdout:8/889: creat d6/d11/d15/db4/dba/ded/d6e/f10e x:0 0 0 2023-01-04T18:16:37.109 INFO:tasks.workunit.client.1.smithi098.stdout:8/890: chown d6/d11/d15/d1b/d2a/d6b/d7f/da6/fbd 2087465 1 2023-01-04T18:16:37.113 INFO:tasks.workunit.client.1.smithi098.stdout:0/884: dread df/d17/d1c/d3b/d98/f81 [0,4194304] 0 2023-01-04T18:16:37.114 INFO:tasks.workunit.client.1.smithi098.stdout:0/885: chown df/d17/d1c/d2c/d104/f96 417 1 2023-01-04T18:16:37.115 INFO:tasks.workunit.client.1.smithi098.stdout:4/880: rename d5/d28/d7d/db6/dbd/ld3 to d5/d9/l12d 0 2023-01-04T18:16:37.120 INFO:tasks.workunit.client.1.smithi098.stdout:1/821: link d1/d8/dac/dfc/d6a/fb0 d1/d8/dac/dfc/d39/d10d/f124 0 2023-01-04T18:16:37.120 INFO:tasks.workunit.client.1.smithi098.stdout:1/822: read - d1/d8/dac/fad zero size 2023-01-04T18:16:37.123 INFO:tasks.workunit.client.1.smithi098.stdout:6/905: dwrite d9/dd/d15/f5f [0,4194304] 0 2023-01-04T18:16:37.128 INFO:tasks.workunit.client.1.smithi098.stdout:8/891: stat d6/d11/d15/d70/dc3/c63 0 2023-01-04T18:16:37.131 INFO:tasks.workunit.client.1.smithi098.stdout:8/892: truncate d6/d11/d15/f9a 1205493 0 2023-01-04T18:16:37.133 INFO:tasks.workunit.client.1.smithi098.stdout:0/886: link df/c16 df/d17/d1c/c130 0 2023-01-04T18:16:37.133 INFO:tasks.workunit.client.1.smithi098.stdout:3/992: rename d6/d10/d29/d6a/cea to d6/c158 0 2023-01-04T18:16:37.133 INFO:tasks.workunit.client.1.smithi098.stdout:4/881: creat d5/d28/d7d/db6/f12e x:0 0 0 2023-01-04T18:16:37.133 INFO:tasks.workunit.client.1.smithi098.stdout:4/882: chown d5/d9/f7c 168336752 1 2023-01-04T18:16:37.133 INFO:tasks.workunit.client.1.smithi098.stdout:6/906: mkdir d9/dd/d4e/d112 0 2023-01-04T18:16:37.134 INFO:tasks.workunit.client.1.smithi098.stdout:6/907: write d9/dd/d24/d3e/d86/fdd [2587285,17891] 0 2023-01-04T18:16:37.134 INFO:tasks.workunit.client.1.smithi098.stdout:6/908: chown d9/dd/d24/d3e/d86/la9 11501965 1 2023-01-04T18:16:37.135 INFO:tasks.workunit.client.1.smithi098.stdout:8/893: getdents d6/d11/d15/db4/dba/ded 0 2023-01-04T18:16:37.137 INFO:tasks.workunit.client.1.smithi098.stdout:2/903: sync 2023-01-04T18:16:37.137 INFO:tasks.workunit.client.1.smithi098.stdout:5/914: sync 2023-01-04T18:16:37.137 INFO:tasks.workunit.client.1.smithi098.stdout:5/915: fsync d1/d1e/dab/dd0/fd9 0 2023-01-04T18:16:37.137 INFO:tasks.workunit.client.1.smithi098.stdout:5/916: chown d1/d1e/dab/dd5/d102/d44/d80/dbd/l10b 2467 1 2023-01-04T18:16:37.137 INFO:tasks.workunit.client.1.smithi098.stdout:0/887: symlink df/d17/d1c/d3b/d98/l131 0 2023-01-04T18:16:37.137 INFO:tasks.workunit.client.1.smithi098.stdout:1/823: dwrite d1/d8/dac/dfc/d36/d4e/d6e/f9a [4194304,4194304] 0 2023-01-04T18:16:37.137 INFO:tasks.workunit.client.1.smithi098.stdout:1/824: write d1/d88/f97 [4268196,34422] 0 2023-01-04T18:16:37.138 INFO:tasks.workunit.client.1.smithi098.stdout:0/888: write df/d4f/f7d [1837098,29365] 0 2023-01-04T18:16:37.138 INFO:tasks.workunit.client.1.smithi098.stdout:3/993: rename d6/d10/dc0/l100 to d6/d10/d19/d3f/d46/d10b/l159 0 2023-01-04T18:16:37.138 INFO:tasks.workunit.client.1.smithi098.stdout:0/889: write df/d4f/f7d [2401450,109840] 0 2023-01-04T18:16:37.138 INFO:tasks.workunit.client.1.smithi098.stdout:3/994: read d6/d10/d19/d3f/d46/f124 [2508721,56813] 0 2023-01-04T18:16:37.142 INFO:tasks.workunit.client.1.smithi098.stdout:4/883: creat d5/d28/d7d/ddb/df9/f12f x:0 0 0 2023-01-04T18:16:37.142 INFO:tasks.workunit.client.1.smithi098.stdout:6/909: creat d9/dd/d24/d3e/d86/dfc/f113 x:0 0 0 2023-01-04T18:16:37.142 INFO:tasks.workunit.client.1.smithi098.stdout:8/894: mknod d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/d8a/ddd/df5/c10f 0 2023-01-04T18:16:37.142 INFO:tasks.workunit.client.1.smithi098.stdout:6/910: stat d9/dd/d24/f30 0 2023-01-04T18:16:37.143 INFO:tasks.workunit.client.1.smithi098.stdout:2/904: mkdir d6/dc/d2b/d42/d47/d1f/d39/d13f/d140 0 2023-01-04T18:16:37.143 INFO:tasks.workunit.client.1.smithi098.stdout:5/917: truncate d1/d1e/dab/dd5/d102/d44/d80/dc6/fca 2078632 0 2023-01-04T18:16:37.143 INFO:tasks.workunit.client.1.smithi098.stdout:5/918: fsync d1/d1e/f3e 0 2023-01-04T18:16:37.143 INFO:tasks.workunit.client.1.smithi098.stdout:5/919: truncate d1/d38/fc1 370299 0 2023-01-04T18:16:37.145 INFO:tasks.workunit.client.1.smithi098.stdout:0/890: mkdir df/d17/d68/d132 0 2023-01-04T18:16:37.146 INFO:tasks.workunit.client.1.smithi098.stdout:3/995: truncate d6/d56/fb8 520637 0 2023-01-04T18:16:37.150 INFO:tasks.workunit.client.1.smithi098.stdout:8/895: rename d6/d11/d15/d1b/d2a/d3b/c97 to d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/c110 0 2023-01-04T18:16:37.150 INFO:tasks.workunit.client.1.smithi098.stdout:0/891: creat df/d17/d9b/ddf/f133 x:0 0 0 2023-01-04T18:16:37.150 INFO:tasks.workunit.client.1.smithi098.stdout:0/892: chown df/d17/d68/df7 2034284 1 2023-01-04T18:16:37.150 INFO:tasks.workunit.client.1.smithi098.stdout:8/896: getdents d6/d11/d15/d1b/d2a/d3b/d8e 0 2023-01-04T18:16:37.151 INFO:tasks.workunit.client.1.smithi098.stdout:8/897: mknod d6/d11/d15/db4/dba/df1/c111 0 2023-01-04T18:16:37.152 INFO:tasks.workunit.client.1.smithi098.stdout:2/905: dread f3 [4194304,4194304] 0 2023-01-04T18:16:37.152 INFO:tasks.workunit.client.1.smithi098.stdout:2/906: truncate d6/dc/d2b/d42/d51/d79/da3/fdd 477146 0 2023-01-04T18:16:37.152 INFO:tasks.workunit.client.1.smithi098.stdout:2/907: chown d6/dc/d4b/d139 0 1 2023-01-04T18:16:37.154 INFO:tasks.workunit.client.1.smithi098.stdout:8/898: creat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d64/de8/f112 x:0 0 0 2023-01-04T18:16:37.156 INFO:tasks.workunit.client.1.smithi098.stdout:5/920: dread d1/d1e/dab/dd5/d102/f26 [4194304,4194304] 0 2023-01-04T18:16:37.162 INFO:tasks.workunit.client.1.smithi098.stdout:1/825: dwrite d1/d8/dac/dfc/fd1 [0,4194304] 0 2023-01-04T18:16:37.162 INFO:tasks.workunit.client.1.smithi098.stdout:3/996: dread d6/d6f/fdd [0,4194304] 0 2023-01-04T18:16:37.162 INFO:tasks.workunit.client.1.smithi098.stdout:5/921: link d1/d1e/dab/dd5/d102/d44/ff2 d1/d1e/dab/dd5/d102/d44/d45/d4b/d61/d112/f126 0 2023-01-04T18:16:37.163 INFO:tasks.workunit.client.1.smithi098.stdout:3/997: getdents d6/d6f/d9b/d12d 0 2023-01-04T18:16:37.167 INFO:tasks.workunit.client.1.smithi098.stdout:0/893: dread df/d17/d1c/d2c/d41/d4a/d7a/f88 [0,4194304] 0 2023-01-04T18:16:37.168 INFO:tasks.workunit.client.1.smithi098.stdout:3/998: mknod d6/d10/d19/d3f/d5e/d7d/dec/dda/c15a 0 2023-01-04T18:16:37.168 INFO:tasks.workunit.client.1.smithi098.stdout:3/999: readlink d6/d10/d19/d3f/d5e/d7d/d90/l149 0 2023-01-04T18:16:37.168 INFO:tasks.workunit.client.1.smithi098.stdout:8/899: dread d6/d11/d15/d1b/d2a/d6b/d7f/fb9 [0,4194304] 0 2023-01-04T18:16:37.169 INFO:tasks.workunit.client.1.smithi098.stdout:8/900: write d6/d11/d15/f9a [877199,108606] 0 2023-01-04T18:16:37.172 INFO:tasks.workunit.client.1.smithi098.stdout:0/894: rename df/d4f/d6b/d94/f12b to df/d17/d1c/d3b/d98/ddc/f134 0 2023-01-04T18:16:37.172 INFO:tasks.workunit.client.1.smithi098.stdout:0/895: readlink df/d17/d1c/d2c/le3 0 2023-01-04T18:16:37.175 INFO:tasks.workunit.client.1.smithi098.stdout:6/911: dwrite d9/dd/d24/d64/ff3 [0,4194304] 0 2023-01-04T18:16:37.175 INFO:tasks.workunit.client.1.smithi098.stdout:6/912: write d9/dd/de/d7e/f93 [526508,47258] 0 2023-01-04T18:16:37.181 INFO:tasks.workunit.client.1.smithi098.stdout:9/894: sync 2023-01-04T18:16:37.181 INFO:tasks.workunit.client.1.smithi098.stdout:7/893: sync 2023-01-04T18:16:37.181 INFO:tasks.workunit.client.1.smithi098.stdout:6/913: truncate d9/dd/de/f1e 64395 0 2023-01-04T18:16:37.182 INFO:tasks.workunit.client.1.smithi098.stdout:4/884: dwrite d5/de/d2c/f3a [4194304,4194304] 0 2023-01-04T18:16:37.182 INFO:tasks.workunit.client.1.smithi098.stdout:4/885: write d5/d28/d40/d5d/fb7 [650786,116350] 0 2023-01-04T18:16:37.182 INFO:tasks.workunit.client.1.smithi098.stdout:7/894: creat d1/da/f137 x:0 0 0 2023-01-04T18:16:37.184 INFO:tasks.workunit.client.1.smithi098.stdout:6/914: rmdir d9/dd/d4e/d112 0 2023-01-04T18:16:37.184 INFO:tasks.workunit.client.1.smithi098.stdout:7/895: link d1/d23/l1c d1/d2e/l138 0 2023-01-04T18:16:37.185 INFO:tasks.workunit.client.1.smithi098.stdout:9/895: write d2/d5/d18/d1d/d23/d66/f100 [3330553,84319] 0 2023-01-04T18:16:37.188 INFO:tasks.workunit.client.1.smithi098.stdout:6/915: rename d9/dd/d24/d3e/cd5 to d9/dd/d4e/d67/db6/de9/c114 0 2023-01-04T18:16:37.191 INFO:tasks.workunit.client.1.smithi098.stdout:9/896: creat d2/df6/d26/d41/dc1/f124 x:0 0 0 2023-01-04T18:16:37.191 INFO:tasks.workunit.client.1.smithi098.stdout:9/897: stat d2/d5/d18/d1d/d23/dad/dfa/d42/d89/fa1 0 2023-01-04T18:16:37.195 INFO:tasks.workunit.client.1.smithi098.stdout:9/898: truncate d2/d5/d18/d19/f4b 2455987 0 2023-01-04T18:16:37.195 INFO:tasks.workunit.client.1.smithi098.stdout:9/899: truncate d2/df6/d26/fd9 565482 0 2023-01-04T18:16:37.195 INFO:tasks.workunit.client.1.smithi098.stdout:5/922: dwrite d1/d1e/dab/dd5/d102/d44/d45/d4b/d61/d112/f126 [0,4194304] 0 2023-01-04T18:16:37.196 INFO:tasks.workunit.client.1.smithi098.stdout:9/900: mknod d2/d5/d18/d19/d82/dce/d10f/c125 0 2023-01-04T18:16:37.200 INFO:tasks.workunit.client.1.smithi098.stdout:5/923: mkdir d1/d1e/dab/dd5/d102/d44/d80/d127 0 2023-01-04T18:16:37.200 INFO:tasks.workunit.client.1.smithi098.stdout:5/924: fdatasync d1/d1e/dab/dd5/d102/f1c 0 2023-01-04T18:16:37.200 INFO:tasks.workunit.client.1.smithi098.stdout:9/901: dread d2/d5/d18/d1d/d23/dad/dfa/d42/f64 [0,4194304] 0 2023-01-04T18:16:37.200 INFO:tasks.workunit.client.1.smithi098.stdout:9/902: dread - d2/df6/d26/d41/dc1/f124 zero size 2023-01-04T18:16:37.201 INFO:tasks.workunit.client.1.smithi098.stdout:4/886: dread d5/de/d21/d9d/fca [4194304,4194304] 0 2023-01-04T18:16:37.202 INFO:tasks.workunit.client.1.smithi098.stdout:5/925: unlink d1/d38/l89 0 2023-01-04T18:16:37.204 INFO:tasks.workunit.client.1.smithi098.stdout:4/887: mkdir d5/d28/d40/d5d/d130 0 2023-01-04T18:16:37.204 INFO:tasks.workunit.client.1.smithi098.stdout:1/826: dwrite d1/d88/f97 [0,4194304] 0 2023-01-04T18:16:37.205 INFO:tasks.workunit.client.1.smithi098.stdout:5/926: link d1/d46/dc4/fd4 d1/db0/ddc/f128 0 2023-01-04T18:16:37.206 INFO:tasks.workunit.client.1.smithi098.stdout:4/888: link d5/d28/d44/fb4 d5/d28/d44/f131 0 2023-01-04T18:16:37.209 INFO:tasks.workunit.client.1.smithi098.stdout:8/901: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/f50 [0,4194304] 0 2023-01-04T18:16:37.209 INFO:tasks.workunit.client.1.smithi098.stdout:6/916: dwrite d9/dd/de/d44/fa6 [4194304,4194304] 0 2023-01-04T18:16:37.210 INFO:tasks.workunit.client.1.smithi098.stdout:1/827: mkdir d1/d8/da/dae/dfa/d125 0 2023-01-04T18:16:37.211 INFO:tasks.workunit.client.1.smithi098.stdout:1/828: chown d1/d8/dac/dfc/d39/dd9/f118 24246 1 2023-01-04T18:16:37.221 INFO:tasks.workunit.client.1.smithi098.stdout:6/917: dread d9/dd/d24/d64/ff3 [0,4194304] 0 2023-01-04T18:16:37.221 INFO:tasks.workunit.client.1.smithi098.stdout:6/918: readlink d9/dd/de/d44/led 0 2023-01-04T18:16:37.222 INFO:tasks.workunit.client.1.smithi098.stdout:7/896: dwrite d1/d51/d26/d28/f88 [4194304,4194304] 0 2023-01-04T18:16:37.226 INFO:tasks.workunit.client.1.smithi098.stdout:5/927: symlink d1/d2f/d73/de9/l129 0 2023-01-04T18:16:37.226 INFO:tasks.workunit.client.1.smithi098.stdout:9/903: dwrite d2/d53/fe5 [0,4194304] 0 2023-01-04T18:16:37.226 INFO:tasks.workunit.client.1.smithi098.stdout:9/904: chown d2 590472705 1 2023-01-04T18:16:37.226 INFO:tasks.workunit.client.1.smithi098.stdout:9/905: chown d2/d5/d18/d1d/d23/dad/d72/d9e/dca 252727 1 2023-01-04T18:16:37.227 INFO:tasks.workunit.client.1.smithi098.stdout:4/889: creat d5/d9/d13/d11d/f132 x:0 0 0 2023-01-04T18:16:37.230 INFO:tasks.workunit.client.1.smithi098.stdout:6/919: dread d9/dd/d24/d3e/d86/fdd [0,4194304] 0 2023-01-04T18:16:37.231 INFO:tasks.workunit.client.1.smithi098.stdout:8/902: rename d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/ldf to d6/d11/l113 0 2023-01-04T18:16:37.234 INFO:tasks.workunit.client.1.smithi098.stdout:1/829: link d1/d8/da/fc1 d1/d8/dac/f126 0 2023-01-04T18:16:37.241 INFO:tasks.workunit.client.1.smithi098.stdout:5/928: unlink d1/d2/d14/d19/fa6 0 2023-01-04T18:16:37.242 INFO:tasks.workunit.client.1.smithi098.stdout:9/906: symlink d2/d53/daf/dff/l126 0 2023-01-04T18:16:37.243 INFO:tasks.workunit.client.1.smithi098.stdout:6/920: creat d9/dd/d24/d64/f115 x:0 0 0 2023-01-04T18:16:37.244 INFO:tasks.workunit.client.1.smithi098.stdout:1/830: symlink d1/d8/dac/dfc/d6a/d106/d113/d11f/l127 0 2023-01-04T18:16:37.244 INFO:tasks.workunit.client.1.smithi098.stdout:5/929: creat d1/d1e/dab/dd0/f12a x:0 0 0 2023-01-04T18:16:37.244 INFO:tasks.workunit.client.1.smithi098.stdout:5/930: write d1/d1e/fc0 [734955,40917] 0 2023-01-04T18:16:37.245 INFO:tasks.workunit.client.1.smithi098.stdout:9/907: mkdir d2/d5/d18/d1d/d23/d127 0 2023-01-04T18:16:37.246 INFO:tasks.workunit.client.1.smithi098.stdout:6/921: creat d9/dd/d24/d3e/d86/d9b/f116 x:0 0 0 2023-01-04T18:16:37.246 INFO:tasks.workunit.client.1.smithi098.stdout:6/922: fsync d9/dd/de/d20/d82/f59 0 2023-01-04T18:16:37.247 INFO:tasks.workunit.client.1.smithi098.stdout:9/908: creat d2/d5/d18/d19/d82/f128 x:0 0 0 2023-01-04T18:16:37.249 INFO:tasks.workunit.client.1.smithi098.stdout:9/909: write d2/d2d/f5d [1441380,76233] 0 2023-01-04T18:16:37.251 INFO:tasks.workunit.client.1.smithi098.stdout:9/910: unlink d2/d5/d18/f39 0 2023-01-04T18:16:37.252 INFO:tasks.workunit.client.1.smithi098.stdout:1/831: dread d1/d8/dac/dfc/d27/f6f [0,4194304] 0 2023-01-04T18:16:37.252 INFO:tasks.workunit.client.1.smithi098.stdout:1/832: dread - d1/d8/dac/dfc/d39/dd9/fe5 zero size 2023-01-04T18:16:37.252 INFO:tasks.workunit.client.1.smithi098.stdout:1/833: fsync d1/d8/da/dae/f5f 0 2023-01-04T18:16:37.252 INFO:tasks.workunit.client.1.smithi098.stdout:1/834: dread - d1/d8/da/dae/f111 zero size 2023-01-04T18:16:37.252 INFO:tasks.workunit.client.1.smithi098.stdout:9/911: creat d2/d5/d18/d1d/d23/dad/dfa/d42/d89/dcb/f129 x:0 0 0 2023-01-04T18:16:37.253 INFO:tasks.workunit.client.1.smithi098.stdout:1/835: rename d1/d8/dac/dfc/d27/d77/da8 to d1/d8/dac/dfc/d6a/d106/d128 0 2023-01-04T18:16:37.255 INFO:tasks.workunit.client.1.smithi098.stdout:1/836: rmdir d1/d8/dac/dfc/d36 39 2023-01-04T18:16:37.256 INFO:tasks.workunit.client.1.smithi098.stdout:1/837: mknod d1/d8/da/c129 0 2023-01-04T18:16:37.258 INFO:tasks.workunit.client.1.smithi098.stdout:1/838: link d1/d8/da/dae/f37 d1/d8/dac/dea/f12a 0 2023-01-04T18:16:37.260 INFO:tasks.workunit.client.1.smithi098.stdout:1/839: link d1/d8/dac/dfc/d36/d4e/ld6 d1/d8/da/dae/l12b 0 2023-01-04T18:16:37.276 INFO:tasks.workunit.client.1.smithi098.stdout:1/840: dwrite d1/fc [0,4194304] 0 2023-01-04T18:16:37.278 INFO:tasks.workunit.client.1.smithi098.stdout:1/841: mkdir d1/d8/d12c 0 2023-01-04T18:16:37.278 INFO:tasks.workunit.client.1.smithi098.stdout:1/842: write d1/f30 [3379867,6288] 0 2023-01-04T18:16:37.280 INFO:tasks.workunit.client.1.smithi098.stdout:1/843: creat d1/da9/f12d x:0 0 0 2023-01-04T18:16:37.280 INFO:tasks.workunit.client.1.smithi098.stdout:1/844: chown d1/d8/l26 48 1 2023-01-04T18:16:37.284 INFO:tasks.workunit.client.1.smithi098.stdout:7/897: dread d1/d23/d37/f42 [0,4194304] 0 2023-01-04T18:16:37.293 INFO:tasks.workunit.client.1.smithi098.stdout:9/912: write d2/d2d/f93 [1891548,128035] 0 2023-01-04T18:16:37.295 INFO:tasks.workunit.client.1.smithi098.stdout:9/913: mknod d2/d5/d6f/c12a 0 2023-01-04T18:16:37.301 INFO:tasks.workunit.client.1.smithi098.stdout:5/931: dwrite d1/d2/fd7 [0,4194304] 0 2023-01-04T18:16:37.302 INFO:tasks.workunit.client.1.smithi098.stdout:9/914: dread d2/f8b [0,4194304] 0 2023-01-04T18:16:37.303 INFO:tasks.workunit.client.1.smithi098.stdout:6/923: dwrite d9/dd/d24/d3e/fa4 [0,4194304] 0 2023-01-04T18:16:37.305 INFO:tasks.workunit.client.1.smithi098.stdout:9/915: mkdir d2/d5/d18/d1d/d23/dad/d72/d9e/d108/d12b 0 2023-01-04T18:16:37.306 INFO:tasks.workunit.client.1.smithi098.stdout:9/916: write d2/df6/d26/fbe [1911437,88852] 0 2023-01-04T18:16:37.306 INFO:tasks.workunit.client.1.smithi098.stdout:6/924: link d9/dd/d4e/f58 d9/dd/de/d20/d82/f117 0 2023-01-04T18:16:37.307 INFO:tasks.workunit.client.1.smithi098.stdout:6/925: mkdir d9/dd/de/d20/d118 0 2023-01-04T18:16:37.307 INFO:tasks.workunit.client.1.smithi098.stdout:6/926: chown d9/dd/de/d20/le6 10445 1 2023-01-04T18:16:37.307 INFO:tasks.workunit.client.1.smithi098.stdout:1/845: dwrite d1/da9/f12d [0,4194304] 0 2023-01-04T18:16:37.308 INFO:tasks.workunit.client.1.smithi098.stdout:9/917: fdatasync d2/d2d/f5d 0 2023-01-04T18:16:37.309 INFO:tasks.workunit.client.1.smithi098.stdout:6/927: mknod d9/dd/de/d20/c119 0 2023-01-04T18:16:37.314 INFO:tasks.workunit.client.1.smithi098.stdout:6/928: dread d9/dd/d24/d3e/d86/fa8 [0,4194304] 0 2023-01-04T18:16:37.320 INFO:tasks.workunit.client.1.smithi098.stdout:9/918: mkdir d2/d5/d18/db6/d12c 0 2023-01-04T18:16:37.320 INFO:tasks.workunit.client.1.smithi098.stdout:9/919: chown d2/d5/d6f/f104 717 1 2023-01-04T18:16:37.323 INFO:tasks.workunit.client.1.smithi098.stdout:9/920: dread d2/d5/d18/d1d/d23/f8c [0,4194304] 0 2023-01-04T18:16:37.324 INFO:tasks.workunit.client.1.smithi098.stdout:9/921: read d2/d5/d18/d1d/d23/dad/dfa/fc8 [23970,100124] 0 2023-01-04T18:16:37.326 INFO:tasks.workunit.client.1.smithi098.stdout:6/929: dread d9/dd/f11 [4194304,4194304] 0 2023-01-04T18:16:37.327 INFO:tasks.workunit.client.1.smithi098.stdout:7/898: dwrite d1/da/fcf [0,4194304] 0 2023-01-04T18:16:37.328 INFO:tasks.workunit.client.1.smithi098.stdout:1/846: dwrite d1/d8/dac/dfc/d27/fdc [0,4194304] 0 2023-01-04T18:16:37.330 INFO:tasks.workunit.client.1.smithi098.stdout:5/932: dwrite d1/d1e/dab/fb3 [0,4194304] 0 2023-01-04T18:16:37.330 INFO:tasks.workunit.client.1.smithi098.stdout:9/922: rmdir d2/d5/d18/d1d/d23/dad/dfa/d42/d89 39 2023-01-04T18:16:37.337 INFO:tasks.workunit.client.1.smithi098.stdout:6/930: mkdir d9/dd/de/d20/d11a 0 2023-01-04T18:16:37.344 INFO:tasks.workunit.client.1.smithi098.stdout:7/899: creat d1/d2e/f139 x:0 0 0 2023-01-04T18:16:37.345 INFO:tasks.workunit.client.1.smithi098.stdout:7/900: write d1/d23/d21/f4b [530342,119799] 0 2023-01-04T18:16:37.349 INFO:tasks.workunit.client.1.smithi098.stdout:5/933: creat d1/d2/d14/da1/f12b x:0 0 0 2023-01-04T18:16:37.351 INFO:tasks.workunit.client.1.smithi098.stdout:0/896: sync 2023-01-04T18:16:37.351 INFO:tasks.workunit.client.1.smithi098.stdout:9/923: mkdir d2/d5/d6f/d12d 0 2023-01-04T18:16:37.352 INFO:tasks.workunit.client.1.smithi098.stdout:2/908: sync 2023-01-04T18:16:37.352 INFO:tasks.workunit.client.1.smithi098.stdout:2/909: fdatasync d6/f94 0 2023-01-04T18:16:37.352 INFO:tasks.workunit.client.1.smithi098.stdout:6/931: creat d9/dd/de/d20/d82/d84/f11b x:0 0 0 2023-01-04T18:16:37.352 INFO:tasks.workunit.client.1.smithi098.stdout:6/932: fdatasync d9/dd/d15/f2d 0 2023-01-04T18:16:37.354 INFO:tasks.workunit.client.1.smithi098.stdout:7/901: rename d1/d23/d37/d78 to d1/d51/d13a 0 2023-01-04T18:16:37.357 INFO:tasks.workunit.client.1.smithi098.stdout:4/890: sync 2023-01-04T18:16:37.357 INFO:tasks.workunit.client.1.smithi098.stdout:8/903: sync 2023-01-04T18:16:37.358 INFO:tasks.workunit.client.1.smithi098.stdout:5/934: rmdir d1/d38/dce/d116 0 2023-01-04T18:16:37.358 INFO:tasks.workunit.client.1.smithi098.stdout:5/935: chown d1/d2f/d73/c11e 14030 1 2023-01-04T18:16:37.358 INFO:tasks.workunit.client.1.smithi098.stdout:5/936: stat d1/d38/d3b/l85 0 2023-01-04T18:16:37.359 INFO:tasks.workunit.client.1.smithi098.stdout:0/897: mkdir df/d4f/d6b/d89/d135 0 2023-01-04T18:16:37.360 INFO:tasks.workunit.client.1.smithi098.stdout:9/924: creat d2/d5/d18/d19/d82/dce/d10f/f12e x:0 0 0 2023-01-04T18:16:37.360 INFO:tasks.workunit.client.1.smithi098.stdout:2/910: creat d6/dc/d2b/f141 x:0 0 0 2023-01-04T18:16:37.365 INFO:tasks.workunit.client.1.smithi098.stdout:6/933: creat d9/f11c x:0 0 0 2023-01-04T18:16:37.365 INFO:tasks.workunit.client.1.smithi098.stdout:7/902: symlink d1/db2/l13b 0 2023-01-04T18:16:37.365 INFO:tasks.workunit.client.1.smithi098.stdout:4/891: rmdir d5/d9/d90 39 2023-01-04T18:16:37.365 INFO:tasks.workunit.client.1.smithi098.stdout:7/903: dread - d1/d51/d26/d28/dc6/fd3 zero size 2023-01-04T18:16:37.366 INFO:tasks.workunit.client.1.smithi098.stdout:8/904: link d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/fac d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/d84/de0/f114 0 2023-01-04T18:16:37.366 INFO:tasks.workunit.client.1.smithi098.stdout:8/905: fsync d6/d11/d15/d1b/d2a/d6b/d7f/d5a/fc0 0 2023-01-04T18:16:37.366 INFO:tasks.workunit.client.1.smithi098.stdout:8/906: readlink d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/l9b 0 2023-01-04T18:16:37.366 INFO:tasks.workunit.client.1.smithi098.stdout:1/847: dread d1/d8/da/dae/f84 [0,4194304] 0 2023-01-04T18:16:37.367 INFO:tasks.workunit.client.1.smithi098.stdout:5/937: symlink d1/d46/d6a/l12c 0 2023-01-04T18:16:37.367 INFO:tasks.workunit.client.1.smithi098.stdout:4/892: mknod d5/d28/d7d/c133 0 2023-01-04T18:16:37.368 INFO:tasks.workunit.client.1.smithi098.stdout:4/893: dread - d5/d28/d7d/db6/de4/f110 zero size 2023-01-04T18:16:37.368 INFO:tasks.workunit.client.1.smithi098.stdout:6/934: symlink d9/dd/de/d26/d71/l11d 0 2023-01-04T18:16:37.369 INFO:tasks.workunit.client.1.smithi098.stdout:7/904: creat d1/d4/d11/d9d/dd2/f13c x:0 0 0 2023-01-04T18:16:37.369 INFO:tasks.workunit.client.1.smithi098.stdout:2/911: dread d6/dc/d4b/f10f [0,4194304] 0 2023-01-04T18:16:37.369 INFO:tasks.workunit.client.1.smithi098.stdout:2/912: write d6/dc/d2b/d42/d47/d1f/d39/d6e/d107/fcb [2113849,97454] 0 2023-01-04T18:16:37.370 INFO:tasks.workunit.client.1.smithi098.stdout:8/907: stat d6/d11/d15/d1b/d2a/d6b/d7f/d12/c94 0 2023-01-04T18:16:37.371 INFO:tasks.workunit.client.1.smithi098.stdout:5/938: mkdir d1/d2/d14/d59/d12d 0 2023-01-04T18:16:37.372 INFO:tasks.workunit.client.1.smithi098.stdout:5/939: write d1/d38/f69 [1543947,31419] 0 2023-01-04T18:16:37.372 INFO:tasks.workunit.client.1.smithi098.stdout:5/940: truncate d1/d1e/f74 4710719 0 2023-01-04T18:16:37.373 INFO:tasks.workunit.client.1.smithi098.stdout:4/894: link d5/d28/d44/f131 d5/dad/d120/f134 0 2023-01-04T18:16:37.373 INFO:tasks.workunit.client.1.smithi098.stdout:0/898: dwrite df/d17/d1c/d2c/d41/d4a/d4c/d5f/fed [0,4194304] 0 2023-01-04T18:16:37.374 INFO:tasks.workunit.client.1.smithi098.stdout:6/935: truncate d9/dd/d4e/d67/d8d/f6f 3426829 0 2023-01-04T18:16:37.374 INFO:tasks.workunit.client.1.smithi098.stdout:6/936: fdatasync d9/dd/de/d20/d82/d84/ff2 0 2023-01-04T18:16:37.376 INFO:tasks.workunit.client.1.smithi098.stdout:2/913: mknod d6/ded/df9/d90/c142 0 2023-01-04T18:16:37.377 INFO:tasks.workunit.client.1.smithi098.stdout:2/914: read - d6/dc/d2b/f13b zero size 2023-01-04T18:16:37.378 INFO:tasks.workunit.client.1.smithi098.stdout:8/908: mkdir d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d64/d115 0 2023-01-04T18:16:37.378 INFO:tasks.workunit.client.1.smithi098.stdout:8/909: fsync d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d64/de8/fdc 0 2023-01-04T18:16:37.378 INFO:tasks.workunit.client.1.smithi098.stdout:0/899: write df/d17/d1c/d2c/d41/d4a/d4c/d5f/fed [3528961,91172] 0 2023-01-04T18:16:37.378 INFO:tasks.workunit.client.1.smithi098.stdout:8/910: truncate d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d64/de8/f112 477362 0 2023-01-04T18:16:37.378 INFO:tasks.workunit.client.1.smithi098.stdout:6/937: dread d9/dd/de/d7e/fd3 [0,4194304] 0 2023-01-04T18:16:37.379 INFO:tasks.workunit.client.1.smithi098.stdout:5/941: rmdir d1/dda 39 2023-01-04T18:16:37.380 INFO:tasks.workunit.client.1.smithi098.stdout:7/905: dread d1/d4/d11/f9a [0,4194304] 0 2023-01-04T18:16:37.380 INFO:tasks.workunit.client.1.smithi098.stdout:7/906: truncate d1/d23/d21/d7f/fd1 369676 0 2023-01-04T18:16:37.383 INFO:tasks.workunit.client.1.smithi098.stdout:4/895: rename d5/d28/d7d/db6/dbd/dc5/d104/f123 to d5/d28/d40/d5d/dcf/de9/f135 0 2023-01-04T18:16:37.383 INFO:tasks.workunit.client.1.smithi098.stdout:4/896: readlink d5/d28/d7d/db6/dd8/l113 0 2023-01-04T18:16:37.384 INFO:tasks.workunit.client.1.smithi098.stdout:2/915: symlink d6/dc/d2b/d42/d47/d1f/d39/l143 0 2023-01-04T18:16:37.386 INFO:tasks.workunit.client.1.smithi098.stdout:1/848: dwrite d1/d8/dac/dea/f12a [4194304,4194304] 0 2023-01-04T18:16:37.387 INFO:tasks.workunit.client.1.smithi098.stdout:8/911: rmdir d6/d11/d15/d1b/d2a/d6b/d7f/d5a 39 2023-01-04T18:16:37.390 INFO:tasks.workunit.client.1.smithi098.stdout:6/938: truncate d9/dd/de/f9c 256498 0 2023-01-04T18:16:37.392 INFO:tasks.workunit.client.1.smithi098.stdout:6/939: write d9/fca [2080692,54444] 0 2023-01-04T18:16:37.392 INFO:tasks.workunit.client.1.smithi098.stdout:6/940: dread - d9/dd/d4e/d67/d8d/d81/dc5/f110 zero size 2023-01-04T18:16:37.392 INFO:tasks.workunit.client.1.smithi098.stdout:5/942: truncate d1/f48 523713 0 2023-01-04T18:16:37.393 INFO:tasks.workunit.client.1.smithi098.stdout:7/907: truncate d1/f7a 7907 0 2023-01-04T18:16:37.395 INFO:tasks.workunit.client.1.smithi098.stdout:0/900: dwrite df/d17/d1c/d3b/d98/f6a [0,4194304] 0 2023-01-04T18:16:37.395 INFO:tasks.workunit.client.1.smithi098.stdout:0/901: fsync df/d17/d68/fb2 0 2023-01-04T18:16:37.396 INFO:tasks.workunit.client.1.smithi098.stdout:4/897: mkdir d5/d28/d40/de5/d136 0 2023-01-04T18:16:37.398 INFO:tasks.workunit.client.1.smithi098.stdout:7/908: dread d1/da/f1b [0,4194304] 0 2023-01-04T18:16:37.398 INFO:tasks.workunit.client.1.smithi098.stdout:1/849: dread d1/d8/dac/dfc/f98 [0,4194304] 0 2023-01-04T18:16:37.398 INFO:tasks.workunit.client.1.smithi098.stdout:1/850: chown d1/d8/dac/dfc/d6a/d106/d128/fe6 495313007 1 2023-01-04T18:16:37.400 INFO:tasks.workunit.client.1.smithi098.stdout:8/912: mkdir d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d64/d109/d116 0 2023-01-04T18:16:37.403 INFO:tasks.workunit.client.1.smithi098.stdout:2/916: dwrite d6/dc/f12 [0,4194304] 0 2023-01-04T18:16:37.412 INFO:tasks.workunit.client.1.smithi098.stdout:5/943: rename c0 to d1/d2f/d66/d75/c12e 0 2023-01-04T18:16:37.413 INFO:tasks.workunit.client.1.smithi098.stdout:0/902: mkdir df/d17/d1c/d2c/d104/d136 0 2023-01-04T18:16:37.420 INFO:tasks.workunit.client.1.smithi098.stdout:4/898: mknod d5/de/d30/c137 0 2023-01-04T18:16:37.421 INFO:tasks.workunit.client.1.smithi098.stdout:1/851: creat d1/d8/dac/dfc/d39/d10d/f12e x:0 0 0 2023-01-04T18:16:37.421 INFO:tasks.workunit.client.1.smithi098.stdout:8/913: mknod d6/d11/d15/db0/c117 0 2023-01-04T18:16:37.421 INFO:tasks.workunit.client.1.smithi098.stdout:8/914: stat d6/d11/d15/d1b/d2a/d6b/d7f/d12/dc2/dda/dfa 0 2023-01-04T18:16:37.422 INFO:tasks.workunit.client.1.smithi098.stdout:7/909: rename d1/d4/l44 to d1/d51/l13d 0 2023-01-04T18:16:37.422 INFO:tasks.workunit.client.1.smithi098.stdout:0/903: creat df/d17/d9b/da4/ddd/f137 x:0 0 0 2023-01-04T18:16:37.423 INFO:tasks.workunit.client.1.smithi098.stdout:4/899: creat d5/d28/d7d/db6/dbd/f138 x:0 0 0 2023-01-04T18:16:37.423 INFO:tasks.workunit.client.1.smithi098.stdout:4/900: truncate d5/d28/d7d/db6/dbd/ff2 557690 0 2023-01-04T18:16:37.424 INFO:tasks.workunit.client.1.smithi098.stdout:4/901: fdatasync d5/d28/d40/f8a 0 2023-01-04T18:16:37.424 INFO:tasks.workunit.client.1.smithi098.stdout:4/902: truncate d5/d28/d40/d5d/f94 1023619 0 2023-01-04T18:16:37.424 INFO:tasks.workunit.client.1.smithi098.stdout:1/852: symlink d1/d88/l12f 0 2023-01-04T18:16:37.425 INFO:tasks.workunit.client.1.smithi098.stdout:8/915: symlink d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/l118 0 2023-01-04T18:16:37.426 INFO:tasks.workunit.client.1.smithi098.stdout:0/904: rename df/d17/d68/lc4 to df/d17/d1c/l138 0 2023-01-04T18:16:37.426 INFO:tasks.workunit.client.1.smithi098.stdout:0/905: write df/d17/d1c/d3b/fec [448823,42910] 0 2023-01-04T18:16:37.427 INFO:tasks.workunit.client.1.smithi098.stdout:4/903: link d5/d28/d40/f4a d5/d28/d7d/db6/dbd/f139 0 2023-01-04T18:16:37.428 INFO:tasks.workunit.client.1.smithi098.stdout:1/853: mkdir d1/d8/dac/dfc/d6a/d106/d113/d130 0 2023-01-04T18:16:37.429 INFO:tasks.workunit.client.1.smithi098.stdout:8/916: rmdir d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/d84/def 39 2023-01-04T18:16:37.430 INFO:tasks.workunit.client.1.smithi098.stdout:0/906: mkdir df/d17/d1c/d2c/da8/d139 0 2023-01-04T18:16:37.430 INFO:tasks.workunit.client.1.smithi098.stdout:0/907: dread - df/d17/d1c/d2c/da8/d118/f129 zero size 2023-01-04T18:16:37.431 INFO:tasks.workunit.client.1.smithi098.stdout:4/904: symlink d5/d9/d90/l13a 0 2023-01-04T18:16:37.433 INFO:tasks.workunit.client.1.smithi098.stdout:8/917: creat d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/f119 x:0 0 0 2023-01-04T18:16:37.435 INFO:tasks.workunit.client.1.smithi098.stdout:0/908: link df/d17/d24/d80/ldb df/dfa/l13a 0 2023-01-04T18:16:37.435 INFO:tasks.workunit.client.1.smithi098.stdout:0/909: fsync df/d17/d1c/d3b/f107 0 2023-01-04T18:16:37.435 INFO:tasks.workunit.client.1.smithi098.stdout:0/910: read - df/d17/d1c/d2c/d41/fd2 zero size 2023-01-04T18:16:37.435 INFO:tasks.workunit.client.1.smithi098.stdout:0/911: stat df/d4f/d6b/fd6 0 2023-01-04T18:16:37.435 INFO:tasks.workunit.client.1.smithi098.stdout:2/917: dwrite d6/dc/d2b/d42/d47/d1f/f7a [0,4194304] 0 2023-01-04T18:16:37.436 INFO:tasks.workunit.client.1.smithi098.stdout:4/905: creat d5/de/d21/d9d/f13b x:0 0 0 2023-01-04T18:16:37.436 INFO:tasks.workunit.client.1.smithi098.stdout:5/944: dwrite d1/d2/d14/d59/f71 [0,4194304] 0 2023-01-04T18:16:37.436 INFO:tasks.workunit.client.1.smithi098.stdout:5/945: chown d1/d1e/dab/dd5/d102/d44/d45/d4b/d61/d112/f126 2142574706 1 2023-01-04T18:16:37.438 INFO:tasks.workunit.client.1.smithi098.stdout:6/941: dwrite d9/dd/de/d44/fa6 [0,4194304] 0 2023-01-04T18:16:37.439 INFO:tasks.workunit.client.1.smithi098.stdout:2/918: mknod d6/dc/d2b/d42/d47/d35/dca/c144 0 2023-01-04T18:16:37.439 INFO:tasks.workunit.client.1.smithi098.stdout:2/919: write d6/dc/d2b/d42/d47/f41 [1844980,24622] 0 2023-01-04T18:16:37.439 INFO:tasks.workunit.client.1.smithi098.stdout:2/920: readlink d6/dc/d2b/d32/l3d 0 2023-01-04T18:16:37.446 INFO:tasks.workunit.client.1.smithi098.stdout:5/946: rename d1/d1e/dab/dd5/d102/d44/d45/d4b/lf5 to d1/d2/d14/d59/d12d/l12f 0 2023-01-04T18:16:37.450 INFO:tasks.workunit.client.1.smithi098.stdout:8/918: dread d6/d11/d15/db4/dba/ded/fe3 [0,4194304] 0 2023-01-04T18:16:37.450 INFO:tasks.workunit.client.1.smithi098.stdout:0/912: dread df/d17/d1c/d2c/d41/d4a/f65 [0,4194304] 0 2023-01-04T18:16:37.450 INFO:tasks.workunit.client.1.smithi098.stdout:0/913: fsync df/d4f/d6e/daf/fd0 0 2023-01-04T18:16:37.450 INFO:tasks.workunit.client.1.smithi098.stdout:7/910: dwrite d1/d51/d26/d28/dc6/fd3 [0,4194304] 0 2023-01-04T18:16:37.451 INFO:tasks.workunit.client.1.smithi098.stdout:8/919: write d6/d11/d15/d1b/d2a/d3b/d79/f103 [239584,122663] 0 2023-01-04T18:16:37.451 INFO:tasks.workunit.client.1.smithi098.stdout:8/920: dread - d6/d11/d15/d1b/d2a/d3b/d79/fe2 zero size 2023-01-04T18:16:37.452 INFO:tasks.workunit.client.1.smithi098.stdout:6/942: truncate d9/dd/d15/f2d 94190 0 2023-01-04T18:16:37.453 INFO:tasks.workunit.client.1.smithi098.stdout:2/921: getdents d6/dc/d2b/d32 0 2023-01-04T18:16:37.454 INFO:tasks.workunit.client.1.smithi098.stdout:2/922: dread - d6/dc/d2b/d42/d51/d79/fba zero size 2023-01-04T18:16:37.454 INFO:tasks.workunit.client.1.smithi098.stdout:5/947: mknod d1/d1e/dab/dd5/d102/d44/d80/dbd/c130 0 2023-01-04T18:16:37.457 INFO:tasks.workunit.client.1.smithi098.stdout:0/914: rename df/d17/d1c/d3b/d98/ddc/lf9 to df/d17/d9b/d86/l13b 0 2023-01-04T18:16:37.458 INFO:tasks.workunit.client.1.smithi098.stdout:8/921: link d6/d11/d15/d1b/d2a/d6b/d7f/l34 d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/l11a 0 2023-01-04T18:16:37.459 INFO:tasks.workunit.client.1.smithi098.stdout:8/922: write d6/d11/d15/f9a [384602,4692] 0 2023-01-04T18:16:37.460 INFO:tasks.workunit.client.1.smithi098.stdout:6/943: creat d9/dd/de/d26/d10c/f11e x:0 0 0 2023-01-04T18:16:37.462 INFO:tasks.workunit.client.1.smithi098.stdout:5/948: creat d1/d1e/dab/dd5/d102/d44/d80/d127/f131 x:0 0 0 2023-01-04T18:16:37.463 INFO:tasks.workunit.client.1.smithi098.stdout:1/854: dwrite d1/d8/dac/dfc/d36/d4e/d6e/fc0 [0,4194304] 0 2023-01-04T18:16:37.464 INFO:tasks.workunit.client.1.smithi098.stdout:1/855: chown d1/d8/dac/dfc/d6a/d106/d128 3064 1 2023-01-04T18:16:37.464 INFO:tasks.workunit.client.1.smithi098.stdout:1/856: chown d1/d8/dac/dfc/d36/d89/df4 4471 1 2023-01-04T18:16:37.464 INFO:tasks.workunit.client.1.smithi098.stdout:1/857: fsync d1/d8/dac/dfc/d36/d4e/d6e/f7f 0 2023-01-04T18:16:37.464 INFO:tasks.workunit.client.1.smithi098.stdout:6/944: creat d9/dd/de/d20/d11a/f11f x:0 0 0 2023-01-04T18:16:37.466 INFO:tasks.workunit.client.1.smithi098.stdout:4/906: dwrite d5/de/d21/f41 [0,4194304] 0 2023-01-04T18:16:37.468 INFO:tasks.workunit.client.1.smithi098.stdout:7/911: dwrite d1/d51/d13a/f90 [0,4194304] 0 2023-01-04T18:16:37.468 INFO:tasks.workunit.client.1.smithi098.stdout:7/912: chown d1/d2e/l138 21172 1 2023-01-04T18:16:37.468 INFO:tasks.workunit.client.1.smithi098.stdout:7/913: chown d1/d51/c31 38754 1 2023-01-04T18:16:37.476 INFO:tasks.workunit.client.1.smithi098.stdout:5/949: read d1/d1e/f74 [810566,49872] 0 2023-01-04T18:16:37.476 INFO:tasks.workunit.client.1.smithi098.stdout:4/907: read d5/de/d21/d9d/f87 [2696160,114862] 0 2023-01-04T18:16:37.478 INFO:tasks.workunit.client.1.smithi098.stdout:1/858: mknod d1/d8/df0/c131 0 2023-01-04T18:16:37.480 INFO:tasks.workunit.client.1.smithi098.stdout:6/945: unlink d9/dd/c40 0 2023-01-04T18:16:37.482 INFO:tasks.workunit.client.1.smithi098.stdout:2/923: dwrite d6/dc/d2b/d42/d47/d35/f67 [0,4194304] 0 2023-01-04T18:16:37.482 INFO:tasks.workunit.client.1.smithi098.stdout:2/924: chown d6/dc/d2b/d32 5909964 1 2023-01-04T18:16:37.482 INFO:tasks.workunit.client.1.smithi098.stdout:2/925: read - d6/dc/d2b/d42/fe4 zero size 2023-01-04T18:16:37.483 INFO:tasks.workunit.client.1.smithi098.stdout:2/926: write d6/dc/d2b/d42/d47/d1f/d39/d6e/d107/fa4 [114587,110439] 0 2023-01-04T18:16:37.487 INFO:tasks.workunit.client.1.smithi098.stdout:9/925: sync 2023-01-04T18:16:37.487 INFO:tasks.workunit.client.1.smithi098.stdout:4/908: creat d5/d28/d7d/f13c x:0 0 0 2023-01-04T18:16:37.488 INFO:tasks.workunit.client.1.smithi098.stdout:4/909: dread d5/d28/d40/f48 [0,4194304] 0 2023-01-04T18:16:37.489 INFO:tasks.workunit.client.1.smithi098.stdout:4/910: dread - d5/d28/d44/fc4 zero size 2023-01-04T18:16:37.489 INFO:tasks.workunit.client.1.smithi098.stdout:4/911: stat f4 0 2023-01-04T18:16:37.489 INFO:tasks.workunit.client.1.smithi098.stdout:4/912: truncate d5/d9/d13/d65/d98/fe0 410804 0 2023-01-04T18:16:37.489 INFO:tasks.workunit.client.1.smithi098.stdout:4/913: write d5/d28/d7d/db6/dd8/f128 [279288,66468] 0 2023-01-04T18:16:37.489 INFO:tasks.workunit.client.1.smithi098.stdout:4/914: read - d5/d9/d13/f116 zero size 2023-01-04T18:16:37.489 INFO:tasks.workunit.client.1.smithi098.stdout:4/915: dread - d5/de/d30/d4f/fb0 zero size 2023-01-04T18:16:37.490 INFO:tasks.workunit.client.1.smithi098.stdout:4/916: stat d5/d9/d13/d65/laa 0 2023-01-04T18:16:37.490 INFO:tasks.workunit.client.1.smithi098.stdout:0/915: dwrite df/d17/d9b/da4/f76 [0,4194304] 0 2023-01-04T18:16:37.491 INFO:tasks.workunit.client.1.smithi098.stdout:8/923: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/f3a [0,4194304] 0 2023-01-04T18:16:37.493 INFO:tasks.workunit.client.1.smithi098.stdout:1/859: creat d1/d8/dac/dfc/d6a/d106/d113/f132 x:0 0 0 2023-01-04T18:16:37.494 INFO:tasks.workunit.client.1.smithi098.stdout:6/946: readlink d9/dd/d15/l38 0 2023-01-04T18:16:37.496 INFO:tasks.workunit.client.1.smithi098.stdout:7/914: dwrite d1/db2/dc4/f12e [0,4194304] 0 2023-01-04T18:16:37.497 INFO:tasks.workunit.client.1.smithi098.stdout:2/927: mknod d6/dc/d2b/d42/d47/d1f/d39/d6e/c145 0 2023-01-04T18:16:37.497 INFO:tasks.workunit.client.1.smithi098.stdout:2/928: chown d6/dc/d2b/d42/d47/d1f/d39/f64 780 1 2023-01-04T18:16:37.501 INFO:tasks.workunit.client.1.smithi098.stdout:9/926: rmdir d2/d5/d18/d1d/d23 39 2023-01-04T18:16:37.501 INFO:tasks.workunit.client.1.smithi098.stdout:5/950: dread d1/d38/fc1 [0,4194304] 0 2023-01-04T18:16:37.501 INFO:tasks.workunit.client.1.smithi098.stdout:4/917: creat d5/d28/d7d/db6/dbd/f13d x:0 0 0 2023-01-04T18:16:37.504 INFO:tasks.workunit.client.1.smithi098.stdout:5/951: write d1/d1e/dab/dd5/d102/d44/d45/d4b/dec/d106/ff6 [2794909,15398] 0 2023-01-04T18:16:37.504 INFO:tasks.workunit.client.1.smithi098.stdout:5/952: chown d1/d1e/dab/dd5/d102/d44/d45/d4b/d61/faa 11410 1 2023-01-04T18:16:37.505 INFO:tasks.workunit.client.1.smithi098.stdout:6/947: creat d9/dd/d4e/d67/d8d/d81/dc5/f120 x:0 0 0 2023-01-04T18:16:37.508 INFO:tasks.workunit.client.1.smithi098.stdout:7/915: creat d1/d4/d11/d9d/dd2/d109/f13e x:0 0 0 2023-01-04T18:16:37.514 INFO:tasks.workunit.client.1.smithi098.stdout:9/927: rename d2/d5/d18/d1d to d2/d2d/d12f 0 2023-01-04T18:16:37.515 INFO:tasks.workunit.client.1.smithi098.stdout:9/928: chown d2/d53/daf/dff 919537 1 2023-01-04T18:16:37.515 INFO:tasks.workunit.client.1.smithi098.stdout:9/929: chown d2/df6/d78/fbc 351393 1 2023-01-04T18:16:37.515 INFO:tasks.workunit.client.1.smithi098.stdout:9/930: chown d2/df6/d78 192360646 1 2023-01-04T18:16:37.515 INFO:tasks.workunit.client.1.smithi098.stdout:5/953: dread d1/d38/d3b/d8f/ff9 [0,4194304] 0 2023-01-04T18:16:37.515 INFO:tasks.workunit.client.1.smithi098.stdout:4/918: mknod d5/d28/da6/c13e 0 2023-01-04T18:16:37.517 INFO:tasks.workunit.client.1.smithi098.stdout:2/929: dwrite d6/dc/d2b/d42/d47/d1f/d39/f80 [0,4194304] 0 2023-01-04T18:16:37.521 INFO:tasks.workunit.client.1.smithi098.stdout:1/860: dwrite d1/d8/dac/dfc/d27/d77/ffd [4194304,4194304] 0 2023-01-04T18:16:37.523 INFO:tasks.workunit.client.1.smithi098.stdout:8/924: dread d6/d11/d15/d1b/d2a/d6b/d7f/d5a/fc0 [0,4194304] 0 2023-01-04T18:16:37.523 INFO:tasks.workunit.client.1.smithi098.stdout:8/925: readlink d6/d11/d15/d1b/l27 0 2023-01-04T18:16:37.523 INFO:tasks.workunit.client.1.smithi098.stdout:7/916: dwrite d1/d4/d11/d9d/dd0/f108 [0,4194304] 0 2023-01-04T18:16:37.523 INFO:tasks.workunit.client.1.smithi098.stdout:7/917: chown d1/d51/d26/d28/d2d/d6b/cc8 0 1 2023-01-04T18:16:37.523 INFO:tasks.workunit.client.1.smithi098.stdout:7/918: write d1/d51/f59 [4944196,20570] 0 2023-01-04T18:16:37.525 INFO:tasks.workunit.client.1.smithi098.stdout:6/948: mkdir d9/dd/d24/d3e/d86/d9b/dce/d121 0 2023-01-04T18:16:37.526 INFO:tasks.workunit.client.1.smithi098.stdout:9/931: mkdir d2/df6/d78/d130 0 2023-01-04T18:16:37.527 INFO:tasks.workunit.client.1.smithi098.stdout:5/954: unlink d1/d2/d14/da1/f12b 0 2023-01-04T18:16:37.528 INFO:tasks.workunit.client.1.smithi098.stdout:6/949: dread d9/dda/fe2 [0,4194304] 0 2023-01-04T18:16:37.528 INFO:tasks.workunit.client.1.smithi098.stdout:4/919: creat d5/d9/d13/f13f x:0 0 0 2023-01-04T18:16:37.535 INFO:tasks.workunit.client.1.smithi098.stdout:2/930: creat d6/dc/d2b/d42/d47/d35/f146 x:0 0 0 2023-01-04T18:16:37.536 INFO:tasks.workunit.client.1.smithi098.stdout:6/950: dread d9/dd/d24/d3e/fe8 [0,4194304] 0 2023-01-04T18:16:37.539 INFO:tasks.workunit.client.1.smithi098.stdout:8/926: symlink d6/d11/d15/d1b/d2a/d6b/d7f/d12/dc2/l11b 0 2023-01-04T18:16:37.540 INFO:tasks.workunit.client.1.smithi098.stdout:1/861: dwrite d1/d8/dac/dfc/d27/d77/f8f [0,4194304] 0 2023-01-04T18:16:37.544 INFO:tasks.workunit.client.1.smithi098.stdout:7/919: link d1/d4/f29 d1/d23/d73/d85/dfd/f13f 0 2023-01-04T18:16:37.545 INFO:tasks.workunit.client.1.smithi098.stdout:5/955: rmdir d1/d1e/dab/dd5/d102/d44/d80/dd2 39 2023-01-04T18:16:37.545 INFO:tasks.workunit.client.1.smithi098.stdout:5/956: write d1/d1e/dab/dd5/d102/d44/d45/d4b/dec/d106/ff6 [5058006,32745] 0 2023-01-04T18:16:37.545 INFO:tasks.workunit.client.1.smithi098.stdout:5/957: chown d1/d1e/dab/dd5/d102/d44/d45/d4b/dba 695 1 2023-01-04T18:16:37.546 INFO:tasks.workunit.client.1.smithi098.stdout:4/920: unlink d5/d9/d13/l35 0 2023-01-04T18:16:37.546 INFO:tasks.workunit.client.1.smithi098.stdout:4/921: fdatasync d5/f1b 0 2023-01-04T18:16:37.547 INFO:tasks.workunit.client.1.smithi098.stdout:2/931: rename d6/dc/d2b/d32/f116 to d6/dc/d2b/d42/d51/d79/da3/db5/f147 0 2023-01-04T18:16:37.548 INFO:tasks.workunit.client.1.smithi098.stdout:2/932: truncate d6/dc/d2b/d46/f84 681142 0 2023-01-04T18:16:37.548 INFO:tasks.workunit.client.1.smithi098.stdout:6/951: creat d9/dd/d24/d3e/d86/dfc/f122 x:0 0 0 2023-01-04T18:16:37.548 INFO:tasks.workunit.client.1.smithi098.stdout:8/927: rmdir d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/d84/def 39 2023-01-04T18:16:37.550 INFO:tasks.workunit.client.1.smithi098.stdout:1/862: mknod d1/d8/dac/dfc/d6a/d106/c133 0 2023-01-04T18:16:37.551 INFO:tasks.workunit.client.1.smithi098.stdout:5/958: creat d1/d1e/dab/f132 x:0 0 0 2023-01-04T18:16:37.551 INFO:tasks.workunit.client.1.smithi098.stdout:5/959: chown d1/d1e/d81/ld6 3 1 2023-01-04T18:16:37.552 INFO:tasks.workunit.client.1.smithi098.stdout:4/922: mknod d5/c140 0 2023-01-04T18:16:37.552 INFO:tasks.workunit.client.1.smithi098.stdout:5/960: dread d1/d1e/f74 [4194304,4194304] 0 2023-01-04T18:16:37.552 INFO:tasks.workunit.client.1.smithi098.stdout:5/961: fdatasync d1/d1e/dab/dd5/d102/fa4 0 2023-01-04T18:16:37.553 INFO:tasks.workunit.client.1.smithi098.stdout:9/932: dwrite d2/df6/f79 [0,4194304] 0 2023-01-04T18:16:37.553 INFO:tasks.workunit.client.1.smithi098.stdout:7/920: rename d1/d2e/f4c to d1/d23/d73/dba/f140 0 2023-01-04T18:16:37.553 INFO:tasks.workunit.client.1.smithi098.stdout:9/933: dread d2/d2d/d12f/d23/dad/f59 [0,4194304] 0 2023-01-04T18:16:37.555 INFO:tasks.workunit.client.1.smithi098.stdout:1/863: creat d1/d8/df0/f134 x:0 0 0 2023-01-04T18:16:37.558 INFO:tasks.workunit.client.1.smithi098.stdout:7/921: link d1/d4/d11/f9a d1/d23/d73/d85/dfd/d105/f141 0 2023-01-04T18:16:37.560 INFO:tasks.workunit.client.1.smithi098.stdout:9/934: mknod d2/d2d/c131 0 2023-01-04T18:16:37.561 INFO:tasks.workunit.client.1.smithi098.stdout:1/864: symlink d1/d8/dac/dfc/d36/d100/l135 0 2023-01-04T18:16:37.562 INFO:tasks.workunit.client.1.smithi098.stdout:7/922: mknod d1/d23/d21/c142 0 2023-01-04T18:16:37.562 INFO:tasks.workunit.client.1.smithi098.stdout:7/923: chown d1/d51/d26/d28/f66 2962805 1 2023-01-04T18:16:37.563 INFO:tasks.workunit.client.1.smithi098.stdout:7/924: write d1/d23/d73/f76 [1891531,74407] 0 2023-01-04T18:16:37.564 INFO:tasks.workunit.client.1.smithi098.stdout:1/865: mkdir d1/d8/dac/dfc/d6a/df3/d136 0 2023-01-04T18:16:37.565 INFO:tasks.workunit.client.1.smithi098.stdout:1/866: chown d1/c18 1 1 2023-01-04T18:16:37.565 INFO:tasks.workunit.client.1.smithi098.stdout:5/962: dread d1/d1e/dab/dd5/d102/f33 [0,4194304] 0 2023-01-04T18:16:37.565 INFO:tasks.workunit.client.1.smithi098.stdout:9/935: write f1 [16704915,8139] 0 2023-01-04T18:16:37.565 INFO:tasks.workunit.client.1.smithi098.stdout:7/925: write d1/d2e/fbe [1432837,64845] 0 2023-01-04T18:16:37.567 INFO:tasks.workunit.client.1.smithi098.stdout:2/933: rename d6/dc/d2b/d42/d51/d79/da3/db5/f147 to d6/dc/d2b/d32/f148 0 2023-01-04T18:16:37.569 INFO:tasks.workunit.client.1.smithi098.stdout:1/867: mknod d1/d8/dac/dfc/d27/c137 0 2023-01-04T18:16:37.569 INFO:tasks.workunit.client.1.smithi098.stdout:1/868: write d1/d8/dac/dfc/d36/d4e/d9f/fb8 [193085,88805] 0 2023-01-04T18:16:37.572 INFO:tasks.workunit.client.1.smithi098.stdout:7/926: unlink d1/d4/d11/d9d/dd0/c122 0 2023-01-04T18:16:37.573 INFO:tasks.workunit.client.1.smithi098.stdout:8/928: dwrite d6/d11/d15/d1b/d2a/dae/dd6/f102 [0,4194304] 0 2023-01-04T18:16:37.573 INFO:tasks.workunit.client.1.smithi098.stdout:8/929: write d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/fb6 [413587,16457] 0 2023-01-04T18:16:37.577 INFO:tasks.workunit.client.1.smithi098.stdout:9/936: creat d2/d5/d6f/f132 x:0 0 0 2023-01-04T18:16:37.577 INFO:tasks.workunit.client.1.smithi098.stdout:9/937: fdatasync d2/d53/daf/ff0 0 2023-01-04T18:16:37.577 INFO:tasks.workunit.client.1.smithi098.stdout:6/952: rename d9/dd/ld7 to d9/dd/d24/d3e/d86/d9b/l123 0 2023-01-04T18:16:37.580 INFO:tasks.workunit.client.1.smithi098.stdout:9/938: write d2/d2d/f5d [1362453,50614] 0 2023-01-04T18:16:37.581 INFO:tasks.workunit.client.1.smithi098.stdout:1/869: mknod d1/da9/de3/dec/df1/d123/c138 0 2023-01-04T18:16:37.581 INFO:tasks.workunit.client.1.smithi098.stdout:1/870: fsync d1/d8/dac/dfc/d36/d4e/d9f/dd7/fe2 0 2023-01-04T18:16:37.581 INFO:tasks.workunit.client.1.smithi098.stdout:9/939: write d2/d53/f65 [1305133,47561] 0 2023-01-04T18:16:37.581 INFO:tasks.workunit.client.1.smithi098.stdout:9/940: readlink d2/d2d/d12f/d23/d66/le3 0 2023-01-04T18:16:37.582 INFO:tasks.workunit.client.1.smithi098.stdout:9/941: stat d2/d2d/d12f/dc0/ld3 0 2023-01-04T18:16:37.583 INFO:tasks.workunit.client.1.smithi098.stdout:4/923: rename d5/d9/f7c to d5/d28/f141 0 2023-01-04T18:16:37.584 INFO:tasks.workunit.client.1.smithi098.stdout:6/953: mkdir d9/dd/de/d44/d79/d104/d85/d124 0 2023-01-04T18:16:37.590 INFO:tasks.workunit.client.1.smithi098.stdout:1/871: creat d1/d8/dac/f139 x:0 0 0 2023-01-04T18:16:37.591 INFO:tasks.workunit.client.1.smithi098.stdout:2/934: rename d6/dc/d2b/d42/d51/d81/d8f/fea to d6/dc/d2b/d42/d51/f149 0 2023-01-04T18:16:37.593 INFO:tasks.workunit.client.1.smithi098.stdout:6/954: mkdir d9/dd/d4e/d125 0 2023-01-04T18:16:37.594 INFO:tasks.workunit.client.1.smithi098.stdout:1/872: stat d1/d8/da/dae/f4a 0 2023-01-04T18:16:37.594 INFO:tasks.workunit.client.1.smithi098.stdout:1/873: stat d1/d8/da/f48 0 2023-01-04T18:16:37.594 INFO:tasks.workunit.client.1.smithi098.stdout:1/874: dread - d1/fff zero size 2023-01-04T18:16:37.596 INFO:tasks.workunit.client.1.smithi098.stdout:4/924: unlink d5/de/d21/d9d/c91 0 2023-01-04T18:16:37.598 INFO:tasks.workunit.client.1.smithi098.stdout:4/925: truncate d5/dad/fb9 2055038 0 2023-01-04T18:16:37.601 INFO:tasks.workunit.client.1.smithi098.stdout:4/926: rename d5/d28/d40/f64 to d5/d28/d7d/db6/dbd/dc5/d104/f142 0 2023-01-04T18:16:37.601 INFO:tasks.workunit.client.1.smithi098.stdout:4/927: write d5/de/d2c/f121 [423890,85303] 0 2023-01-04T18:16:37.601 INFO:tasks.workunit.client.1.smithi098.stdout:4/928: truncate d5/d28/d40/d5d/f70 506800 0 2023-01-04T18:16:37.606 INFO:tasks.workunit.client.1.smithi098.stdout:8/930: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/fb9 [4194304,4194304] 0 2023-01-04T18:16:37.607 INFO:tasks.workunit.client.1.smithi098.stdout:9/942: dwrite d2/d2d/d12f/d23/d66/f105 [0,4194304] 0 2023-01-04T18:16:37.607 INFO:tasks.workunit.client.1.smithi098.stdout:7/927: dwrite d1/d2e/f54 [4194304,4194304] 0 2023-01-04T18:16:37.607 INFO:tasks.workunit.client.1.smithi098.stdout:7/928: stat d1/da/f1b 0 2023-01-04T18:16:37.607 INFO:tasks.workunit.client.1.smithi098.stdout:7/929: chown d1/d4/d11/d9d/dd0/l10f 1303 1 2023-01-04T18:16:37.608 INFO:tasks.workunit.client.1.smithi098.stdout:5/963: dwrite d1/d2/d14/f2d [0,4194304] 0 2023-01-04T18:16:37.613 INFO:tasks.workunit.client.1.smithi098.stdout:9/943: mknod d2/c133 0 2023-01-04T18:16:37.613 INFO:tasks.workunit.client.1.smithi098.stdout:9/944: dread - d2/d5/d18/d19/d82/f128 zero size 2023-01-04T18:16:37.616 INFO:tasks.workunit.client.1.smithi098.stdout:7/930: symlink d1/d51/dc0/l143 0 2023-01-04T18:16:37.616 INFO:tasks.workunit.client.1.smithi098.stdout:7/931: readlink d1/d23/d37/l7b 0 2023-01-04T18:16:37.618 INFO:tasks.workunit.client.1.smithi098.stdout:1/875: dread d1/d8/dac/dfc/d36/d4e/d6e/f9a [0,4194304] 0 2023-01-04T18:16:37.621 INFO:tasks.workunit.client.1.smithi098.stdout:7/932: write d1/d23/d73/dba/fef [2276081,23698] 0 2023-01-04T18:16:37.642 INFO:tasks.workunit.client.1.smithi098.stdout:8/931: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/fac [0,4194304] 0 2023-01-04T18:16:37.643 INFO:tasks.workunit.client.1.smithi098.stdout:2/935: dwrite d6/dc/d2b/fad [0,4194304] 0 2023-01-04T18:16:37.643 INFO:tasks.workunit.client.1.smithi098.stdout:4/929: dwrite d5/d9/d13/f111 [0,4194304] 0 2023-01-04T18:16:37.643 INFO:tasks.workunit.client.1.smithi098.stdout:4/930: chown d5/d28/d7d/db6/dbd/dc5/d104/f108 555801 1 2023-01-04T18:16:37.643 INFO:tasks.workunit.client.1.smithi098.stdout:6/955: dwrite d9/dd/d15/f41 [4194304,4194304] 0 2023-01-04T18:16:37.644 INFO:tasks.workunit.client.1.smithi098.stdout:5/964: dwrite d1/d2f/d66/d75/f99 [0,4194304] 0 2023-01-04T18:16:37.653 INFO:tasks.workunit.client.1.smithi098.stdout:9/945: truncate d2/d2d/d12f/f71 1354539 0 2023-01-04T18:16:37.653 INFO:tasks.workunit.client.1.smithi098.stdout:9/946: chown d2/d2d/d12f/d23/d66/cdb 5943030 1 2023-01-04T18:16:37.653 INFO:tasks.workunit.client.1.smithi098.stdout:9/947: readlink d2/d5/d6f/l90 0 2023-01-04T18:16:37.654 INFO:tasks.workunit.client.1.smithi098.stdout:1/876: mkdir d1/da9/de3/d13a 0 2023-01-04T18:16:37.661 INFO:tasks.workunit.client.1.smithi098.stdout:7/933: rename d1/d23/d37/fcb to d1/d4/d11/d9d/f144 0 2023-01-04T18:16:37.661 INFO:tasks.workunit.client.1.smithi098.stdout:7/934: read d1/d4/d11/d9d/dd2/fd8 [430224,68947] 0 2023-01-04T18:16:37.669 INFO:tasks.workunit.client.1.smithi098.stdout:8/932: mkdir d6/d11/d15/d1b/d2a/d6b/d9c/d11c 0 2023-01-04T18:16:37.673 INFO:tasks.workunit.client.1.smithi098.stdout:0/916: sync 2023-01-04T18:16:37.674 INFO:tasks.workunit.client.1.smithi098.stdout:2/936: symlink d6/dc/d2b/d42/d47/d106/l14a 0 2023-01-04T18:16:37.674 INFO:tasks.workunit.client.1.smithi098.stdout:8/933: dread d6/d11/d15/db4/dba/ded/d6e/fd8 [0,4194304] 0 2023-01-04T18:16:37.676 INFO:tasks.workunit.client.1.smithi098.stdout:4/931: creat d5/d28/d40/d5d/dcf/f143 x:0 0 0 2023-01-04T18:16:37.680 INFO:tasks.workunit.client.1.smithi098.stdout:5/965: symlink d1/d2/d14/d19/l133 0 2023-01-04T18:16:37.680 INFO:tasks.workunit.client.1.smithi098.stdout:5/966: readlink d1/d1e/dab/dd5/d102/d44/d83/lbc 0 2023-01-04T18:16:37.685 INFO:tasks.workunit.client.1.smithi098.stdout:1/877: mkdir d1/d8/dac/dfc/d36/d89/db3/d13b 0 2023-01-04T18:16:37.686 INFO:tasks.workunit.client.1.smithi098.stdout:1/878: write d1/d8/dac/dfc/d27/fdc [1904952,1304] 0 2023-01-04T18:16:37.689 INFO:tasks.workunit.client.1.smithi098.stdout:5/967: dread d1/d38/f41 [0,4194304] 0 2023-01-04T18:16:37.690 INFO:tasks.workunit.client.1.smithi098.stdout:2/937: dwrite d6/dc/d2b/d42/d51/d81/d8f/de8/feb [0,4194304] 0 2023-01-04T18:16:37.692 INFO:tasks.workunit.client.1.smithi098.stdout:6/956: rename d9/dd/de/d44/fa6 to d9/dd/de/d20/d82/d84/d8a/f126 0 2023-01-04T18:16:37.697 INFO:tasks.workunit.client.1.smithi098.stdout:0/917: symlink df/d17/d1c/d2c/d41/d105/l13c 0 2023-01-04T18:16:37.697 INFO:tasks.workunit.client.1.smithi098.stdout:8/934: mknod d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/d10c/dc4/c11d 0 2023-01-04T18:16:37.698 INFO:tasks.workunit.client.1.smithi098.stdout:7/935: write d1/d23/d37/d40/f5c [3482448,74631] 0 2023-01-04T18:16:37.702 INFO:tasks.workunit.client.1.smithi098.stdout:4/932: unlink d5/d28/d7d/db6/dd8/l113 0 2023-01-04T18:16:37.702 INFO:tasks.workunit.client.1.smithi098.stdout:1/879: creat d1/d8/dac/dfc/d27/dfe/f13c x:0 0 0 2023-01-04T18:16:37.702 INFO:tasks.workunit.client.1.smithi098.stdout:1/880: dread - d1/d8/da/dae/dfa/f115 zero size 2023-01-04T18:16:37.703 INFO:tasks.workunit.client.1.smithi098.stdout:2/938: creat d6/dc/d2b/d42/d47/da5/d13e/f14b x:0 0 0 2023-01-04T18:16:37.703 INFO:tasks.workunit.client.1.smithi098.stdout:2/939: readlink d6/dc/d2b/d42/d51/de1/l104 0 2023-01-04T18:16:37.704 INFO:tasks.workunit.client.1.smithi098.stdout:9/948: rename d2/c9b to d2/d2d/d12f/d23/d127/c134 0 2023-01-04T18:16:37.705 INFO:tasks.workunit.client.1.smithi098.stdout:4/933: dread d5/d28/d40/d5d/fb7 [0,4194304] 0 2023-01-04T18:16:37.705 INFO:tasks.workunit.client.1.smithi098.stdout:8/935: truncate d6/d11/d15/d1b/d2a/d3b/f7e 367864 0 2023-01-04T18:16:37.707 INFO:tasks.workunit.client.1.smithi098.stdout:4/934: write d5/d28/d44/f78 [1298209,59592] 0 2023-01-04T18:16:37.707 INFO:tasks.workunit.client.1.smithi098.stdout:7/936: link d1/da/ce0 d1/d51/d26/d28/d2d/d6b/c145 0 2023-01-04T18:16:37.709 INFO:tasks.workunit.client.1.smithi098.stdout:0/918: rename df/d17/d1c/d3b/d98/f82 to df/d17/d9b/f13d 0 2023-01-04T18:16:37.710 INFO:tasks.workunit.client.1.smithi098.stdout:4/935: getdents d5/d28/d7d/db6/dbd 0 2023-01-04T18:16:37.712 INFO:tasks.workunit.client.1.smithi098.stdout:2/940: dread d6/dc/f14 [0,4194304] 0 2023-01-04T18:16:37.712 INFO:tasks.workunit.client.1.smithi098.stdout:2/941: readlink d6/dc/d2b/d42/d47/d1f/l76 0 2023-01-04T18:16:37.712 INFO:tasks.workunit.client.1.smithi098.stdout:2/942: write d6/dc/d2b/d32/f148 [954158,57471] 0 2023-01-04T18:16:37.712 INFO:tasks.workunit.client.1.smithi098.stdout:2/943: readlink d6/dc/d2b/d42/d47/d1f/d39/lc0 0 2023-01-04T18:16:37.712 INFO:tasks.workunit.client.1.smithi098.stdout:7/937: mknod d1/d51/d26/d28/d2d/d6b/c146 0 2023-01-04T18:16:37.713 INFO:tasks.workunit.client.1.smithi098.stdout:5/968: dwrite d1/d1e/dab/dd5/fee [0,4194304] 0 2023-01-04T18:16:37.713 INFO:tasks.workunit.client.1.smithi098.stdout:0/919: link df/d17/d1c/d3b/d98/f69 df/d17/d9b/d86/d110/f13e 0 2023-01-04T18:16:37.716 INFO:tasks.workunit.client.1.smithi098.stdout:7/938: write d1/d2e/f54 [1536833,95847] 0 2023-01-04T18:16:37.716 INFO:tasks.workunit.client.1.smithi098.stdout:7/939: read - d1/db2/dc4/fcc zero size 2023-01-04T18:16:37.716 INFO:tasks.workunit.client.1.smithi098.stdout:5/969: dread d1/d1e/dab/dd5/d102/d44/d45/d4b/d61/f86 [0,4194304] 0 2023-01-04T18:16:37.719 INFO:tasks.workunit.client.1.smithi098.stdout:8/936: dread d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/f47 [4194304,4194304] 0 2023-01-04T18:16:37.720 INFO:tasks.workunit.client.1.smithi098.stdout:2/944: write d6/f2f [4150053,96631] 0 2023-01-04T18:16:37.720 INFO:tasks.workunit.client.1.smithi098.stdout:2/945: write d6/dc/d2b/d42/fe4 [593130,92119] 0 2023-01-04T18:16:37.720 INFO:tasks.workunit.client.1.smithi098.stdout:2/946: getdents d6/dc/d4b/d139 0 2023-01-04T18:16:37.721 INFO:tasks.workunit.client.1.smithi098.stdout:0/920: write df/d17/f2d [4000113,125198] 0 2023-01-04T18:16:37.721 INFO:tasks.workunit.client.1.smithi098.stdout:1/881: dread d1/d8/dac/dfc/d36/d4e/d9f/fb8 [0,4194304] 0 2023-01-04T18:16:37.722 INFO:tasks.workunit.client.1.smithi098.stdout:7/940: write d1/d2e/fbe [811620,118994] 0 2023-01-04T18:16:37.725 INFO:tasks.workunit.client.1.smithi098.stdout:1/882: dread d1/d8/dac/dfc/d36/f40 [4194304,4194304] 0 2023-01-04T18:16:37.725 INFO:tasks.workunit.client.1.smithi098.stdout:5/970: mkdir d1/d2f/d66/d75/d120/d134 0 2023-01-04T18:16:37.729 INFO:tasks.workunit.client.1.smithi098.stdout:8/937: creat d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/d84/f11e x:0 0 0 2023-01-04T18:16:37.731 INFO:tasks.workunit.client.1.smithi098.stdout:4/936: dwrite d5/de/d2c/f9a [4194304,4194304] 0 2023-01-04T18:16:37.732 INFO:tasks.workunit.client.1.smithi098.stdout:4/937: stat d5/d9/d13/l19 0 2023-01-04T18:16:37.734 INFO:tasks.workunit.client.1.smithi098.stdout:7/941: dread d1/f47 [0,4194304] 0 2023-01-04T18:16:37.735 INFO:tasks.workunit.client.1.smithi098.stdout:9/949: rename d2/d2d/d12f/d23/d127/c134 to d2/d53/c135 0 2023-01-04T18:16:37.744 INFO:tasks.workunit.client.1.smithi098.stdout:2/947: unlink d6/dc/d2b/d42/d47/d1f/d39/d6e/f88 0 2023-01-04T18:16:37.745 INFO:tasks.workunit.client.1.smithi098.stdout:0/921: truncate df/d17/d1c/d3b/d98/f5a 3684247 0 2023-01-04T18:16:37.745 INFO:tasks.workunit.client.1.smithi098.stdout:0/922: dread - df/d17/d9b/da4/ddd/f11e zero size 2023-01-04T18:16:37.749 INFO:tasks.workunit.client.1.smithi098.stdout:1/883: unlink d1/d8/dac/dfc/d6a/d106/c10e 0 2023-01-04T18:16:37.749 INFO:tasks.workunit.client.1.smithi098.stdout:5/971: mkdir d1/dda/d135 0 2023-01-04T18:16:37.750 INFO:tasks.workunit.client.1.smithi098.stdout:8/938: stat d6/d11/l113 0 2023-01-04T18:16:37.751 INFO:tasks.workunit.client.1.smithi098.stdout:4/938: chown d5/de/d21/c6e 2535339 1 2023-01-04T18:16:37.752 INFO:tasks.workunit.client.1.smithi098.stdout:7/942: symlink d1/d23/d21/d7f/de4/d119/l147 0 2023-01-04T18:16:37.752 INFO:tasks.workunit.client.1.smithi098.stdout:7/943: chown d1/d51/d26/d28/dc6/lf3 3 1 2023-01-04T18:16:37.753 INFO:tasks.workunit.client.1.smithi098.stdout:5/972: read d1/d1e/dab/dd5/d102/d44/d45/d4b/f9d [1117828,45990] 0 2023-01-04T18:16:37.754 INFO:tasks.workunit.client.1.smithi098.stdout:9/950: creat d2/d2d/d12f/dc0/f136 x:0 0 0 2023-01-04T18:16:37.757 INFO:tasks.workunit.client.1.smithi098.stdout:0/923: mknod df/d17/d9b/d86/c13f 0 2023-01-04T18:16:37.757 INFO:tasks.workunit.client.1.smithi098.stdout:0/924: chown df/d17/d9b/d86/c13f 56844879 1 2023-01-04T18:16:37.757 INFO:tasks.workunit.client.1.smithi098.stdout:4/939: creat d5/d9/d103/f144 x:0 0 0 2023-01-04T18:16:37.757 INFO:tasks.workunit.client.1.smithi098.stdout:5/973: write d1/d2/d14/d19/f111 [1787020,72694] 0 2023-01-04T18:16:37.757 INFO:tasks.workunit.client.1.smithi098.stdout:7/944: mknod d1/d4/c148 0 2023-01-04T18:16:37.759 INFO:tasks.workunit.client.1.smithi098.stdout:9/951: link d2/d5/d18/d19/f58 d2/d2d/d12f/d23/dad/d72/d9e/d108/d12b/f137 0 2023-01-04T18:16:37.761 INFO:tasks.workunit.client.1.smithi098.stdout:1/884: link d1/d8/dac/dfc/d36/d89/db3/fb5 d1/d8/da/dae/f13d 0 2023-01-04T18:16:37.765 INFO:tasks.workunit.client.1.smithi098.stdout:4/940: creat d5/d28/d40/d5d/d130/f145 x:0 0 0 2023-01-04T18:16:37.765 INFO:tasks.workunit.client.1.smithi098.stdout:5/974: creat d1/d38/d3b/d8f/f136 x:0 0 0 2023-01-04T18:16:37.766 INFO:tasks.workunit.client.1.smithi098.stdout:7/945: symlink d1/d4/d11/d5d/d130/l149 0 2023-01-04T18:16:37.766 INFO:tasks.workunit.client.1.smithi098.stdout:7/946: chown d1/d4/l8b 0 1 2023-01-04T18:16:37.766 INFO:tasks.workunit.client.1.smithi098.stdout:7/947: readlink d1/d2e/la0 0 2023-01-04T18:16:37.766 INFO:tasks.workunit.client.1.smithi098.stdout:5/975: write d1/d1e/dab/dd5/d102/d44/d45/d4b/d61/f86 [1185446,59807] 0 2023-01-04T18:16:37.766 INFO:tasks.workunit.client.1.smithi098.stdout:9/952: creat d2/d5/d18/d19/d82/dce/d10f/f138 x:0 0 0 2023-01-04T18:16:37.774 INFO:tasks.workunit.client.1.smithi098.stdout:4/941: symlink d5/dad/d83/l146 0 2023-01-04T18:16:37.774 INFO:tasks.workunit.client.1.smithi098.stdout:1/885: creat d1/d8/dac/dfc/d36/d89/db3/d13b/f13e x:0 0 0 2023-01-04T18:16:37.776 INFO:tasks.workunit.client.1.smithi098.stdout:5/976: unlink d1/d2/d14/l8e 0 2023-01-04T18:16:37.776 INFO:tasks.workunit.client.1.smithi098.stdout:1/886: chown d1/d8/da/dae/l79 581784 1 2023-01-04T18:16:37.779 INFO:tasks.workunit.client.1.smithi098.stdout:9/953: link d2/d5/lde d2/df6/d26/d41/l139 0 2023-01-04T18:16:37.780 INFO:tasks.workunit.client.1.smithi098.stdout:5/977: rename d1/d2/c2a to d1/d2f/d66/c137 0 2023-01-04T18:16:37.780 INFO:tasks.workunit.client.1.smithi098.stdout:5/978: write d1/d2f/d73/ffb [4308070,78908] 0 2023-01-04T18:16:37.782 INFO:tasks.workunit.client.1.smithi098.stdout:1/887: truncate d1/d8/dac/dfc/d27/fbd 1099853 0 2023-01-04T18:16:37.782 INFO:tasks.workunit.client.1.smithi098.stdout:1/888: chown d1/d8/da/c129 219 1 2023-01-04T18:16:37.784 INFO:tasks.workunit.client.1.smithi098.stdout:1/889: unlink d1/d8/dac/dfc/d6a/d106/d128/c7a 0 2023-01-04T18:16:37.785 INFO:tasks.workunit.client.1.smithi098.stdout:5/979: mknod d1/d38/d3b/c138 0 2023-01-04T18:16:37.788 INFO:tasks.workunit.client.1.smithi098.stdout:1/890: rename d1/d8/dac/dfc/fee to d1/d8/da/dae/f13f 0 2023-01-04T18:16:37.790 INFO:tasks.workunit.client.1.smithi098.stdout:1/891: symlink d1/l140 0 2023-01-04T18:16:37.791 INFO:tasks.workunit.client.1.smithi098.stdout:1/892: mknod d1/d8/dac/dfc/d36/d4e/d9f/c141 0 2023-01-04T18:16:37.791 INFO:tasks.workunit.client.1.smithi098.stdout:1/893: write d1/d8/d53/feb [380736,66057] 0 2023-01-04T18:16:37.792 INFO:tasks.workunit.client.1.smithi098.stdout:1/894: creat d1/d8/dac/f142 x:0 0 0 2023-01-04T18:16:37.792 INFO:tasks.workunit.client.1.smithi098.stdout:1/895: chown d1/d8/d53/la4 250665 1 2023-01-04T18:16:37.794 INFO:tasks.workunit.client.1.smithi098.stdout:1/896: mkdir d1/da9/de3/d13a/d143 0 2023-01-04T18:16:37.809 INFO:tasks.workunit.client.1.smithi098.stdout:8/939: dwrite d6/d11/d15/d1b/d2a/d3b/f3c [0,4194304] 0 2023-01-04T18:16:37.809 INFO:tasks.workunit.client.1.smithi098.stdout:8/940: write d6/d11/d15/db4/dba/ded/d6e/f89 [4394785,126363] 0 2023-01-04T18:16:37.810 INFO:tasks.workunit.client.1.smithi098.stdout:0/925: dwrite df/d17/d9b/d86/d110/f13e [0,4194304] 0 2023-01-04T18:16:37.811 INFO:tasks.workunit.client.1.smithi098.stdout:0/926: write df/d17/d1c/d2c/d41/ff8 [424216,3535] 0 2023-01-04T18:16:37.811 INFO:tasks.workunit.client.1.smithi098.stdout:0/927: readlink df/d17/d1c/d2c/d41/d105/l13c 0 2023-01-04T18:16:37.811 INFO:tasks.workunit.client.1.smithi098.stdout:0/928: chown df/d17/d24/cb4 2833605 1 2023-01-04T18:16:37.811 INFO:tasks.workunit.client.1.smithi098.stdout:7/948: dwrite d1/d23/d21/f4b [0,4194304] 0 2023-01-04T18:16:37.811 INFO:tasks.workunit.client.1.smithi098.stdout:7/949: chown d1/d23/d73/d85/f9b 210708092 1 2023-01-04T18:16:37.811 INFO:tasks.workunit.client.1.smithi098.stdout:8/941: dread d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/fb6 [0,4194304] 0 2023-01-04T18:16:37.811 INFO:tasks.workunit.client.1.smithi098.stdout:2/948: dwrite d6/dc/d2b/d42/d51/d79/f11e [0,4194304] 0 2023-01-04T18:16:37.811 INFO:tasks.workunit.client.1.smithi098.stdout:2/949: write d6/dc/d2b/d42/d51/d79/fc7 [141436,40832] 0 2023-01-04T18:16:37.813 INFO:tasks.workunit.client.1.smithi098.stdout:5/980: dwrite d1/d2/d14/d19/f35 [4194304,4194304] 0 2023-01-04T18:16:37.813 INFO:tasks.workunit.client.1.smithi098.stdout:4/942: dwrite d5/d28/d40/f56 [0,4194304] 0 2023-01-04T18:16:37.813 INFO:tasks.workunit.client.1.smithi098.stdout:9/954: dwrite d2/f1e [8388608,4194304] 0 2023-01-04T18:16:37.813 INFO:tasks.workunit.client.1.smithi098.stdout:0/929: dread df/d4f/d6e/daf/fd0 [0,4194304] 0 2023-01-04T18:16:37.814 INFO:tasks.workunit.client.1.smithi098.stdout:7/950: chown d1/d23/d37/d40/f10a 187512327 1 2023-01-04T18:16:37.816 INFO:tasks.workunit.client.1.smithi098.stdout:1/897: dread d1/d8/d53/feb [0,4194304] 0 2023-01-04T18:16:37.816 INFO:tasks.workunit.client.1.smithi098.stdout:1/898: chown d1/d88/fcf 35 1 2023-01-04T18:16:37.816 INFO:tasks.workunit.client.1.smithi098.stdout:1/899: truncate d1/d8/d53/f73 4650968 0 2023-01-04T18:16:37.819 INFO:tasks.workunit.client.1.smithi098.stdout:5/981: truncate d1/d1e/f3e 1651422 0 2023-01-04T18:16:37.822 INFO:tasks.workunit.client.1.smithi098.stdout:9/955: mkdir d2/d2d/d12f/d23/d66/d13a 0 2023-01-04T18:16:37.823 INFO:tasks.workunit.client.1.smithi098.stdout:4/943: mkdir d5/d28/d7d/db6/d147 0 2023-01-04T18:16:37.827 INFO:tasks.workunit.client.1.smithi098.stdout:0/930: write df/d17/d1c/d2c/d41/d4a/d4c/f66 [3399652,41520] 0 2023-01-04T18:16:37.827 INFO:tasks.workunit.client.1.smithi098.stdout:0/931: chown l7 156973 1 2023-01-04T18:16:37.827 INFO:tasks.workunit.client.1.smithi098.stdout:0/932: chown df/d17/d1c/d2c/dba/ff6 3665 1 2023-01-04T18:16:37.827 INFO:tasks.workunit.client.1.smithi098.stdout:0/933: write df/d17/d1c/d2c/d41/da0/fa3 [563926,69448] 0 2023-01-04T18:16:37.828 INFO:tasks.workunit.client.1.smithi098.stdout:5/982: read d1/d1e/dab/dd5/d102/d44/d80/dcf/ffc [2213001,118860] 0 2023-01-04T18:16:37.829 INFO:tasks.workunit.client.1.smithi098.stdout:5/983: write d1/f1d [3607375,103317] 0 2023-01-04T18:16:37.841 INFO:tasks.workunit.client.1.smithi098.stdout:4/944: mknod d5/d9/d13/d65/d98/c148 0 2023-01-04T18:16:37.841 INFO:tasks.workunit.client.1.smithi098.stdout:4/945: fdatasync d5/d9/d13/d11d/f132 0 2023-01-04T18:16:37.841 INFO:tasks.workunit.client.1.smithi098.stdout:8/942: dwrite d6/d11/d15/db4/f108 [0,4194304] 0 2023-01-04T18:16:37.842 INFO:tasks.workunit.client.1.smithi098.stdout:8/943: truncate d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/f6f 4417305 0 2023-01-04T18:16:37.843 INFO:tasks.workunit.client.1.smithi098.stdout:0/934: mknod df/d17/d1c/d2c/d104/c140 0 2023-01-04T18:16:37.846 INFO:tasks.workunit.client.1.smithi098.stdout:5/984: mkdir d1/d1e/dab/dd5/d102/d44/d80/dbb/d139 0 2023-01-04T18:16:37.847 INFO:tasks.workunit.client.1.smithi098.stdout:7/951: dwrite d1/d2e/f54 [4194304,4194304] 0 2023-01-04T18:16:37.847 INFO:tasks.workunit.client.1.smithi098.stdout:5/985: write d1/d1e/dab/dd5/d102/f26 [6657220,120249] 0 2023-01-04T18:16:37.847 INFO:tasks.workunit.client.1.smithi098.stdout:5/986: write d1/d1e/dab/dd5/d102/d44/d80/dcf/ffc [4707429,100321] 0 2023-01-04T18:16:37.848 INFO:tasks.workunit.client.1.smithi098.stdout:9/956: symlink d2/df6/d26/d41/l13b 0 2023-01-04T18:16:37.848 INFO:tasks.workunit.client.1.smithi098.stdout:9/957: fsync d2/df6/d78/fc2 0 2023-01-04T18:16:37.848 INFO:tasks.workunit.client.1.smithi098.stdout:2/950: dwrite d6/ded/df9/f6b [0,4194304] 0 2023-01-04T18:16:37.849 INFO:tasks.workunit.client.1.smithi098.stdout:4/946: mknod d5/d9/d13/d65/c149 0 2023-01-04T18:16:37.850 INFO:tasks.workunit.client.1.smithi098.stdout:1/900: dwrite d1/d8/dac/dfc/d36/d4e/d6e/f9a [0,4194304] 0 2023-01-04T18:16:37.853 INFO:tasks.workunit.client.1.smithi098.stdout:8/944: creat d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/f11f x:0 0 0 2023-01-04T18:16:37.855 INFO:tasks.workunit.client.1.smithi098.stdout:0/935: mknod df/d17/d68/c141 0 2023-01-04T18:16:37.855 INFO:tasks.workunit.client.1.smithi098.stdout:8/945: read d6/d11/d15/d1b/d2a/d3b/f38 [4210374,122315] 0 2023-01-04T18:16:37.860 INFO:tasks.workunit.client.1.smithi098.stdout:6/957: sync 2023-01-04T18:16:37.860 INFO:tasks.workunit.client.1.smithi098.stdout:6/958: chown d9/dd/d24/d3e/fe8 80235492 1 2023-01-04T18:16:37.860 INFO:tasks.workunit.client.1.smithi098.stdout:6/959: write d9/dd/de/d44/f5e [962681,68] 0 2023-01-04T18:16:37.861 INFO:tasks.workunit.client.1.smithi098.stdout:5/987: creat d1/f13a x:0 0 0 2023-01-04T18:16:37.863 INFO:tasks.workunit.client.1.smithi098.stdout:9/958: creat d2/d2d/d12f/d23/dad/dfa/f13c x:0 0 0 2023-01-04T18:16:37.865 INFO:tasks.workunit.client.1.smithi098.stdout:9/959: dread d2/d2d/d12f/d23/dad/f59 [0,4194304] 0 2023-01-04T18:16:37.865 INFO:tasks.workunit.client.1.smithi098.stdout:9/960: stat d2/d2d/d12f/d23/dad/d72 0 2023-01-04T18:16:37.865 INFO:tasks.workunit.client.1.smithi098.stdout:9/961: dread - d2/d2d/d12f/d23/dad/dfa/d42/ff2 zero size 2023-01-04T18:16:37.865 INFO:tasks.workunit.client.1.smithi098.stdout:9/962: chown d2/d2d/d12f/d23/d66/le3 5841634 1 2023-01-04T18:16:37.865 INFO:tasks.workunit.client.1.smithi098.stdout:9/963: getdents d2/d5/d6f/d12d 0 2023-01-04T18:16:37.866 INFO:tasks.workunit.client.1.smithi098.stdout:4/947: getdents d5/dad/d83 0 2023-01-04T18:16:37.866 INFO:tasks.workunit.client.1.smithi098.stdout:4/948: write d5/dad/d83/fae [693966,121534] 0 2023-01-04T18:16:37.866 INFO:tasks.workunit.client.1.smithi098.stdout:4/949: stat d5/de/d2c/dcb/de6/c112 0 2023-01-04T18:16:37.866 INFO:tasks.workunit.client.1.smithi098.stdout:4/950: fsync d5/f16 0 2023-01-04T18:16:37.867 INFO:tasks.workunit.client.1.smithi098.stdout:1/901: rmdir d1/d8/da/dae/dfa/d125 0 2023-01-04T18:16:37.868 INFO:tasks.workunit.client.1.smithi098.stdout:0/936: symlink df/d4f/d6b/d89/db6/l142 0 2023-01-04T18:16:37.870 INFO:tasks.workunit.client.1.smithi098.stdout:8/946: mknod d6/d11/d15/d1b/d2a/d6b/d7f/d12/c120 0 2023-01-04T18:16:37.870 INFO:tasks.workunit.client.1.smithi098.stdout:8/947: fsync d6/d11/d15/db4/dba/ded/fe6 0 2023-01-04T18:16:37.870 INFO:tasks.workunit.client.1.smithi098.stdout:8/948: fsync d6/d11/d15/ff9 0 2023-01-04T18:16:37.872 INFO:tasks.workunit.client.1.smithi098.stdout:7/952: rename d1/f45 to d1/d4/d11/d5d/f14a 0 2023-01-04T18:16:37.874 INFO:tasks.workunit.client.1.smithi098.stdout:6/960: symlink d9/dd/d24/d3e/d86/d9b/dce/d121/l127 0 2023-01-04T18:16:37.874 INFO:tasks.workunit.client.1.smithi098.stdout:5/988: creat d1/d38/f13b x:0 0 0 2023-01-04T18:16:37.874 INFO:tasks.workunit.client.1.smithi098.stdout:6/961: read d9/dd/de/fa2 [1385081,20430] 0 2023-01-04T18:16:37.874 INFO:tasks.workunit.client.1.smithi098.stdout:6/962: chown d9/dd/de/d26/d10c/f11e 3 1 2023-01-04T18:16:37.875 INFO:tasks.workunit.client.1.smithi098.stdout:2/951: mknod d6/dc/d2b/d42/d47/c14c 0 2023-01-04T18:16:37.876 INFO:tasks.workunit.client.1.smithi098.stdout:1/902: dread d1/d8/dac/dfc/d36/d89/db3/fb5 [0,4194304] 0 2023-01-04T18:16:37.876 INFO:tasks.workunit.client.1.smithi098.stdout:2/952: write d6/dc/d2b/d42/d47/fe2 [771249,81670] 0 2023-01-04T18:16:37.877 INFO:tasks.workunit.client.1.smithi098.stdout:8/949: creat d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/d84/de0/de7/f121 x:0 0 0 2023-01-04T18:16:37.877 INFO:tasks.workunit.client.1.smithi098.stdout:8/950: dread - d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/fc9 zero size 2023-01-04T18:16:37.878 INFO:tasks.workunit.client.1.smithi098.stdout:8/951: fdatasync d6/d11/d15/d1b/d2a/d6b/d7f/d12/f41 0 2023-01-04T18:16:37.882 INFO:tasks.workunit.client.1.smithi098.stdout:5/989: mkdir d1/d1e/dab/dd5/d102/d44/d45/d4b/dba/dfa/d13c 0 2023-01-04T18:16:37.882 INFO:tasks.workunit.client.1.smithi098.stdout:6/963: mkdir d9/dd/d4e/d67/db6/de9/d128 0 2023-01-04T18:16:37.883 INFO:tasks.workunit.client.1.smithi098.stdout:7/953: dread d1/d51/dc0/fce [0,4194304] 0 2023-01-04T18:16:37.883 INFO:tasks.workunit.client.1.smithi098.stdout:8/952: truncate d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/f3a 240353 0 2023-01-04T18:16:37.883 INFO:tasks.workunit.client.1.smithi098.stdout:8/953: stat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/lc5 0 2023-01-04T18:16:37.883 INFO:tasks.workunit.client.1.smithi098.stdout:8/954: chown d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67 19920988 1 2023-01-04T18:16:37.885 INFO:tasks.workunit.client.1.smithi098.stdout:6/964: link d9/dd/d24/d3e/d86/dfc/l111 d9/l129 0 2023-01-04T18:16:37.888 INFO:tasks.workunit.client.1.smithi098.stdout:8/955: unlink d6/d11/d15/d70/dc3/l106 0 2023-01-04T18:16:37.892 INFO:tasks.workunit.client.1.smithi098.stdout:4/951: write d5/d28/f2b [462926,44514] 0 2023-01-04T18:16:37.892 INFO:tasks.workunit.client.1.smithi098.stdout:4/952: chown d5/dad/ce7 1554209 1 2023-01-04T18:16:37.893 INFO:tasks.workunit.client.1.smithi098.stdout:4/953: fsync d5/fbb 0 2023-01-04T18:16:37.893 INFO:tasks.workunit.client.1.smithi098.stdout:6/965: creat d9/dd/de/d20/d82/d84/d8a/f12a x:0 0 0 2023-01-04T18:16:37.893 INFO:tasks.workunit.client.1.smithi098.stdout:8/956: creat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e/d37/d4b/d67/d8a/ddd/f122 x:0 0 0 2023-01-04T18:16:37.893 INFO:tasks.workunit.client.1.smithi098.stdout:8/957: chown d6/d11/d15/d1b/d2a/d6b/d7f/da6/la4 801086 1 2023-01-04T18:16:37.902 INFO:tasks.workunit.client.1.smithi098.stdout:6/966: write d9/dd/d4e/d67/d8d/f6f [483993,14727] 0 2023-01-04T18:16:37.910 INFO:tasks.workunit.client.1.smithi098.stdout:0/937: dwrite df/d17/f4b [0,4194304] 0 2023-01-04T18:16:37.913 INFO:tasks.workunit.client.1.smithi098.stdout:0/938: rename df/d4f/d6e/daf to df/d4f/d6e/d143 0 2023-01-04T18:16:37.913 INFO:tasks.workunit.client.1.smithi098.stdout:0/939: truncate df/d4f/d6b/d94/feb 945628 0 2023-01-04T18:16:37.929 INFO:tasks.workunit.client.1.smithi098.stdout:4/954: dread d5/de/d2c/dcb/fe8 [0,4194304] 0 2023-01-04T18:16:37.933 INFO:tasks.workunit.client.1.smithi098.stdout:9/964: dwrite d2/d5/d18/d19/ffb [0,4194304] 0 2023-01-04T18:16:37.933 INFO:tasks.workunit.client.1.smithi098.stdout:9/965: chown d2/d2d/d12f/d23/dad/dfa/fd8 6982840 1 2023-01-04T18:16:37.936 INFO:tasks.workunit.client.1.smithi098.stdout:9/966: mkdir d2/d53/daf/dff/d13d 0 2023-01-04T18:16:37.948 INFO:tasks.workunit.client.1.smithi098.stdout:7/954: dwrite d1/d23/d37/f42 [0,4194304] 0 2023-01-04T18:16:37.948 INFO:tasks.workunit.client.1.smithi098.stdout:0/940: dwrite df/d17/d1c/d2c/d104/f91 [0,4194304] 0 2023-01-04T18:16:37.949 INFO:tasks.workunit.client.1.smithi098.stdout:7/955: creat d1/d23/d37/f14b x:0 0 0 2023-01-04T18:16:37.949 INFO:tasks.workunit.client.1.smithi098.stdout:7/956: read d1/d51/d26/d28/d2d/d75/fb6 [1798168,70382] 0 2023-01-04T18:16:37.950 INFO:tasks.workunit.client.1.smithi098.stdout:1/903: dwrite d1/d8/da/dae/f111 [0,4194304] 0 2023-01-04T18:16:37.950 INFO:tasks.workunit.client.1.smithi098.stdout:1/904: chown d1/d8/dac/dfc/d27/d77 16152658 1 2023-01-04T18:16:37.950 INFO:tasks.workunit.client.1.smithi098.stdout:4/955: dwrite d5/d28/d40/f52 [0,4194304] 0 2023-01-04T18:16:37.955 INFO:tasks.workunit.client.1.smithi098.stdout:0/941: mknod df/d4f/d6b/d94/c144 0 2023-01-04T18:16:37.955 INFO:tasks.workunit.client.1.smithi098.stdout:5/990: dwrite d1/d1e/dab/dd5/d102/f26 [0,4194304] 0 2023-01-04T18:16:37.956 INFO:tasks.workunit.client.1.smithi098.stdout:2/953: dwrite d6/f94 [0,4194304] 0 2023-01-04T18:16:37.958 INFO:tasks.workunit.client.1.smithi098.stdout:7/957: creat d1/d51/f14c x:0 0 0 2023-01-04T18:16:37.959 INFO:tasks.workunit.client.1.smithi098.stdout:9/967: dwrite d2/d2d/d12f/d23/dad/dfa/d42/fe0 [0,4194304] 0 2023-01-04T18:16:37.967 INFO:tasks.workunit.client.1.smithi098.stdout:8/958: rename d6/d11/d15/d1b/d2a/d6b/d7f/d12/d1e to d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/d123 0 2023-01-04T18:16:37.971 INFO:tasks.workunit.client.1.smithi098.stdout:4/956: link d5/de/d30/ffd d5/d9/d103/f14a 0 2023-01-04T18:16:37.972 INFO:tasks.workunit.client.1.smithi098.stdout:0/942: truncate df/d17/d1c/f47 63725 0 2023-01-04T18:16:37.980 INFO:tasks.workunit.client.1.smithi098.stdout:2/954: symlink d6/dc/d2b/d42/d51/de1/d12b/d12d/l14d 0 2023-01-04T18:16:37.982 INFO:tasks.workunit.client.1.smithi098.stdout:1/905: dwrite d1/d8/da/dae/fdd [0,4194304] 0 2023-01-04T18:16:37.982 INFO:tasks.workunit.client.1.smithi098.stdout:5/991: dwrite d1/d2f/f5f [0,4194304] 0 2023-01-04T18:16:37.983 INFO:tasks.workunit.client.1.smithi098.stdout:5/992: fsync d1/d2f/d73/ffb 0 2023-01-04T18:16:37.983 INFO:tasks.workunit.client.1.smithi098.stdout:5/993: write d1/fc3 [1218207,72649] 0 2023-01-04T18:16:37.989 INFO:tasks.workunit.client.1.smithi098.stdout:9/968: creat d2/df6/d78/dbb/f13e x:0 0 0 2023-01-04T18:16:37.991 INFO:tasks.workunit.client.1.smithi098.stdout:8/959: symlink d6/d11/d15/d1b/d2a/dae/l124 0 2023-01-04T18:16:37.992 INFO:tasks.workunit.client.1.smithi098.stdout:4/957: creat d5/d9/d13/f14b x:0 0 0 2023-01-04T18:16:37.992 INFO:tasks.workunit.client.1.smithi098.stdout:4/958: write d5/d9/f43 [3924703,96898] 0 2023-01-04T18:16:37.995 INFO:tasks.workunit.client.1.smithi098.stdout:1/906: link d1/d8/dac/f139 d1/d8/dac/dfc/d36/d89/f144 0 2023-01-04T18:16:37.996 INFO:tasks.workunit.client.1.smithi098.stdout:7/958: dwrite d1/d51/d13a/d103/f112 [0,4194304] 0 2023-01-04T18:16:37.996 INFO:tasks.workunit.client.1.smithi098.stdout:0/943: dwrite df/d17/d1c/d2c/d41/d4a/d4c/d8e/f10e [0,4194304] 0 2023-01-04T18:16:37.997 INFO:tasks.workunit.client.1.smithi098.stdout:5/994: link d1/d1e/dab/dd5/d102/d44/c11b d1/d2/d14/da1/c13d 0 2023-01-04T18:16:38.001 INFO:tasks.workunit.client.1.smithi098.stdout:9/969: unlink d2/df6/d26/f7e 0 2023-01-04T18:16:38.003 INFO:tasks.workunit.client.1.smithi098.stdout:8/960: creat d6/d11/d15/d1b/d2a/d6b/d7f/d12/dc2/dda/f125 x:0 0 0 2023-01-04T18:16:38.006 INFO:tasks.workunit.client.1.smithi098.stdout:4/959: link d5/d9/d13/l74 d5/d28/d40/d5d/l14c 0 2023-01-04T18:16:38.008 INFO:tasks.workunit.client.1.smithi098.stdout:1/907: creat d1/d8/da/dae/f145 x:0 0 0 2023-01-04T18:16:38.014 INFO:tasks.workunit.client.1.smithi098.stdout:7/959: rmdir d1/d23/d73/d85 39 2023-01-04T18:16:38.014 INFO:tasks.workunit.client.1.smithi098.stdout:7/960: chown d1/d2e/f54 130284174 1 2023-01-04T18:16:38.018 INFO:tasks.workunit.client.1.smithi098.stdout:0/944: stat df/d4f/d6b/l71 0 2023-01-04T18:16:38.018 INFO:tasks.workunit.client.1.smithi098.stdout:5/995: creat d1/d1e/dab/dd5/f13e x:0 0 0 2023-01-04T18:16:38.018 INFO:tasks.workunit.client.1.smithi098.stdout:5/996: fsync d1/d1e/dab/dd5/d102/f26 0 2023-01-04T18:16:38.019 INFO:tasks.workunit.client.1.smithi098.stdout:9/970: chown d2/d5/d18/d19/f54 1831395985 1 2023-01-04T18:16:38.019 INFO:tasks.workunit.client.1.smithi098.stdout:9/971: readlink d2/d2d/d12f/d23/dad/dfa/d42/l60 0 2023-01-04T18:16:38.019 INFO:tasks.workunit.client.1.smithi098.stdout:5/997: write d1/d1e/dab/dd5/d102/f77 [636603,111038] 0 2023-01-04T18:16:38.020 INFO:tasks.workunit.client.1.smithi098.stdout:4/960: rename d5/de/d30/d4f/f117 to d5/d28/d40/de5/f14d 0 2023-01-04T18:16:38.022 INFO:tasks.workunit.client.1.smithi098.stdout:1/908: unlink d1/d8/dac/dfc/d36/c4c 0 2023-01-04T18:16:38.023 INFO:tasks.workunit.client.1.smithi098.stdout:7/961: creat d1/d51/d26/d28/d2d/f14d x:0 0 0 2023-01-04T18:16:38.023 INFO:tasks.workunit.client.1.smithi098.stdout:0/945: truncate df/d17/d1c/d2c/d41/d64/fce 2689220 0 2023-01-04T18:16:38.024 INFO:tasks.workunit.client.1.smithi098.stdout:5/998: mkdir d1/d2/d14/d19/d13f 0 2023-01-04T18:16:38.026 INFO:tasks.workunit.client.1.smithi098.stdout:9/972: rename d2/d53/ce6 to d2/d5/d6f/c13f 0 2023-01-04T18:16:38.027 INFO:tasks.workunit.client.1.smithi098.stdout:1/909: getdents d1/d8/d53 0 2023-01-04T18:16:38.028 INFO:tasks.workunit.client.1.smithi098.stdout:7/962: symlink d1/d23/l14e 0 2023-01-04T18:16:38.028 INFO:tasks.workunit.client.1.smithi098.stdout:7/963: write d1/da/f137 [47817,113364] 0 2023-01-04T18:16:38.028 INFO:tasks.workunit.client.1.smithi098.stdout:7/964: chown d1/da/ld4 302 1 2023-01-04T18:16:38.029 INFO:tasks.workunit.client.1.smithi098.stdout:5/999: symlink d1/d1e/d81/l140 0 2023-01-04T18:16:38.029 INFO:tasks.workunit.client.1.smithi098.stdout:9/973: truncate d2/df6/d78/fbc 1724615 0 2023-01-04T18:16:38.030 INFO:tasks.workunit.client.1.smithi098.stdout:1/910: mknod d1/d8/da/dae/dfa/c146 0 2023-01-04T18:16:38.031 INFO:tasks.workunit.client.1.smithi098.stdout:1/911: dread - d1/d8/dac/dfc/d36/d89/db3/f109 zero size 2023-01-04T18:16:38.031 INFO:tasks.workunit.client.1.smithi098.stdout:1/912: truncate d1/d8/da/fc1 102428 0 2023-01-04T18:16:38.031 INFO:tasks.workunit.client.1.smithi098.stdout:1/913: write d1/d8/dac/dfc/d36/d4e/f10c [1038564,73951] 0 2023-01-04T18:16:38.031 INFO:tasks.workunit.client.1.smithi098.stdout:1/914: truncate d1/d8/da/dae/dfa/f115 446565 0 2023-01-04T18:16:38.031 INFO:tasks.workunit.client.1.smithi098.stdout:4/961: dread d5/de/d21/d9d/fca [0,4194304] 0 2023-01-04T18:16:38.031 INFO:tasks.workunit.client.1.smithi098.stdout:4/962: write d5/de/f9e [4607665,27742] 0 2023-01-04T18:16:38.032 INFO:tasks.workunit.client.1.smithi098.stdout:7/965: rename d1/d4/d11/d5d/f14a to d1/d23/d21/d7f/de4/f14f 0 2023-01-04T18:16:38.034 INFO:tasks.workunit.client.1.smithi098.stdout:4/963: creat d5/dad/d120/f14e x:0 0 0 2023-01-04T18:16:38.036 INFO:tasks.workunit.client.1.smithi098.stdout:7/966: rename d1/dc1/lfc to d1/d23/d73/d12f/l150 0 2023-01-04T18:16:38.036 INFO:tasks.workunit.client.1.smithi098.stdout:7/967: stat d1/d23/d21/d7f/fd1 0 2023-01-04T18:16:38.036 INFO:tasks.workunit.client.1.smithi098.stdout:7/968: write d1/d23/d73/fff [803395,97514] 0 2023-01-04T18:16:38.038 INFO:tasks.workunit.client.1.smithi098.stdout:4/964: rename d5/d9/d13/d65/f61 to d5/d28/d7d/f14f 0 2023-01-04T18:16:38.038 INFO:tasks.workunit.client.1.smithi098.stdout:9/974: write d2/d2d/d12f/fb1 [674245,108491] 0 2023-01-04T18:16:38.038 INFO:tasks.workunit.client.1.smithi098.stdout:9/975: fdatasync d2/d2d/d12f/d23/d5c/f117 0 2023-01-04T18:16:38.040 INFO:tasks.workunit.client.1.smithi098.stdout:4/965: creat d5/d28/da6/d118/f150 x:0 0 0 2023-01-04T18:16:38.041 INFO:tasks.workunit.client.1.smithi098.stdout:7/969: creat d1/d51/f151 x:0 0 0 2023-01-04T18:16:38.041 INFO:tasks.workunit.client.1.smithi098.stdout:7/970: chown d1/d23/d37/d40/f5c 228 1 2023-01-04T18:16:38.043 INFO:tasks.workunit.client.1.smithi098.stdout:4/966: creat d5/d28/d44/f151 x:0 0 0 2023-01-04T18:16:38.043 INFO:tasks.workunit.client.1.smithi098.stdout:9/976: write d2/d2d/d12f/d23/dad/dfa/fd8 [582228,30928] 0 2023-01-04T18:16:38.048 INFO:tasks.workunit.client.1.smithi098.stdout:8/961: dread d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/d84/de0/f114 [0,4194304] 0 2023-01-04T18:16:38.048 INFO:tasks.workunit.client.1.smithi098.stdout:8/962: chown d6/d11/d15/db4/dba/ded/cbf 4677542 1 2023-01-04T18:16:38.048 INFO:tasks.workunit.client.1.smithi098.stdout:4/967: rename d5/de/d21/d96/f115 to d5/dad/d120/f152 0 2023-01-04T18:16:38.048 INFO:tasks.workunit.client.1.smithi098.stdout:4/968: fdatasync d5/d28/da6/ff3 0 2023-01-04T18:16:38.048 INFO:tasks.workunit.client.1.smithi098.stdout:4/969: fsync d5/d28/d44/f78 0 2023-01-04T18:16:38.049 INFO:tasks.workunit.client.1.smithi098.stdout:1/915: dread d1/d8/dac/dea/f12a [0,4194304] 0 2023-01-04T18:16:38.050 INFO:tasks.workunit.client.1.smithi098.stdout:7/971: dread d1/d2e/f39 [0,4194304] 0 2023-01-04T18:16:38.054 INFO:tasks.workunit.client.1.smithi098.stdout:0/946: dwrite df/d17/d1c/f1e [0,4194304] 0 2023-01-04T18:16:38.068 INFO:tasks.workunit.client.1.smithi098.stdout:7/972: creat d1/d23/f152 x:0 0 0 2023-01-04T18:16:38.069 INFO:tasks.workunit.client.1.smithi098.stdout:0/947: creat df/d4f/d6b/d89/f145 x:0 0 0 2023-01-04T18:16:38.070 INFO:tasks.workunit.client.1.smithi098.stdout:4/970: dread d5/d28/d40/d5d/f70 [0,4194304] 0 2023-01-04T18:16:38.070 INFO:tasks.workunit.client.1.smithi098.stdout:0/948: write df/d17/d1c/d2c/d41/ff8 [69767,45610] 0 2023-01-04T18:16:38.070 INFO:tasks.workunit.client.1.smithi098.stdout:1/916: dread d1/d8/dac/f126 [0,4194304] 0 2023-01-04T18:16:38.071 INFO:tasks.workunit.client.1.smithi098.stdout:4/971: mkdir d5/d28/d44/d153 0 2023-01-04T18:16:38.072 INFO:tasks.workunit.client.1.smithi098.stdout:8/963: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/f88 [0,4194304] 0 2023-01-04T18:16:38.073 INFO:tasks.workunit.client.1.smithi098.stdout:9/977: dwrite d2/d2d/d12f/dc0/fcc [4194304,4194304] 0 2023-01-04T18:16:38.073 INFO:tasks.workunit.client.1.smithi098.stdout:9/978: fsync d2/d2d/d12f/d23/dad/d72/d9e/dca/df5/f103 0 2023-01-04T18:16:38.073 INFO:tasks.workunit.client.1.smithi098.stdout:1/917: creat d1/d8/dac/dfc/d39/f147 x:0 0 0 2023-01-04T18:16:38.074 INFO:tasks.workunit.client.1.smithi098.stdout:8/964: write d6/d11/d15/d1b/d2a/d3b/f35 [4052698,80853] 0 2023-01-04T18:16:38.074 INFO:tasks.workunit.client.1.smithi098.stdout:7/973: mknod d1/d23/d37/d40/c153 0 2023-01-04T18:16:38.079 INFO:tasks.workunit.client.1.smithi098.stdout:4/972: rename d5/d28/f141 to d5/d28/f154 0 2023-01-04T18:16:38.080 INFO:tasks.workunit.client.1.smithi098.stdout:9/979: unlink d2/d5/d18/c52 0 2023-01-04T18:16:38.080 INFO:tasks.workunit.client.1.smithi098.stdout:9/980: truncate d2/df6/d26/d41/f43 4715488 0 2023-01-04T18:16:38.080 INFO:tasks.workunit.client.1.smithi098.stdout:9/981: readlink d2/d2d/d12f/d23/dad/d72/l101 0 2023-01-04T18:16:38.080 INFO:tasks.workunit.client.1.smithi098.stdout:9/982: chown d2/d2d/d12f/d23/d66/cdb 1027 1 2023-01-04T18:16:38.080 INFO:tasks.workunit.client.1.smithi098.stdout:9/983: write d2/d2d/d12f/d23/d5c/f117 [1182892,42509] 0 2023-01-04T18:16:38.080 INFO:tasks.workunit.client.1.smithi098.stdout:9/984: dread - d2/d2d/d12f/f11f zero size 2023-01-04T18:16:38.081 INFO:tasks.workunit.client.1.smithi098.stdout:8/965: creat d6/d11/d15/db4/dba/ded/f126 x:0 0 0 2023-01-04T18:16:38.083 INFO:tasks.workunit.client.1.smithi098.stdout:4/973: rename d5/de/c25 to d5/d9/d103/c155 0 2023-01-04T18:16:38.084 INFO:tasks.workunit.client.1.smithi098.stdout:9/985: getdents d2/d2d/d12f/d23/dad/d72/d9e/dca/df5 0 2023-01-04T18:16:38.084 INFO:tasks.workunit.client.1.smithi098.stdout:0/949: dread df/f52 [0,4194304] 0 2023-01-04T18:16:38.087 INFO:tasks.workunit.client.1.smithi098.stdout:8/966: creat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/d123/d37/d4b/d67/f127 x:0 0 0 2023-01-04T18:16:38.089 INFO:tasks.workunit.client.1.smithi098.stdout:4/974: unlink d5/d9/d13/d65/d98/fa8 0 2023-01-04T18:16:38.089 INFO:tasks.workunit.client.1.smithi098.stdout:4/975: readlink d5/d9/d90/l13a 0 2023-01-04T18:16:38.091 INFO:tasks.workunit.client.1.smithi098.stdout:4/976: write d5/d28/d7d/db6/dbd/f139 [8305010,45215] 0 2023-01-04T18:16:38.091 INFO:tasks.workunit.client.1.smithi098.stdout:1/918: dwrite d1/da9/f12d [0,4194304] 0 2023-01-04T18:16:38.093 INFO:tasks.workunit.client.1.smithi098.stdout:9/986: getdents d2/df6/d26/d41 0 2023-01-04T18:16:38.095 INFO:tasks.workunit.client.1.smithi098.stdout:0/950: mknod df/d17/d1c/d2c/d41/d105/c146 0 2023-01-04T18:16:38.100 INFO:tasks.workunit.client.1.smithi098.stdout:8/967: link d6/d11/d15/db4/dba/ded/d6e/fd8 d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/d84/f128 0 2023-01-04T18:16:38.100 INFO:tasks.workunit.client.1.smithi098.stdout:7/974: dwrite d1/d4/d11/d9d/dd2/f13c [0,4194304] 0 2023-01-04T18:16:38.100 INFO:tasks.workunit.client.1.smithi098.stdout:1/919: dread d1/d8/dac/dfc/d27/d77/fa3 [0,4194304] 0 2023-01-04T18:16:38.101 INFO:tasks.workunit.client.1.smithi098.stdout:1/920: dread - d1/d8/dac/dfc/d36/d89/db3/f109 zero size 2023-01-04T18:16:38.103 INFO:tasks.workunit.client.1.smithi098.stdout:8/968: dread d6/d11/d15/db4/dba/ded/d6e/fd8 [0,4194304] 0 2023-01-04T18:16:38.106 INFO:tasks.workunit.client.1.smithi098.stdout:0/951: mknod df/d17/d68/d132/c147 0 2023-01-04T18:16:38.106 INFO:tasks.workunit.client.1.smithi098.stdout:9/987: mkdir d2/d2d/d12f/d23/dad/d72/d9e/d108/d140 0 2023-01-04T18:16:38.106 INFO:tasks.workunit.client.1.smithi098.stdout:9/988: fdatasync d2/d2d/d12f/d23/dad/dfa/d42/f99 0 2023-01-04T18:16:38.121 INFO:tasks.workunit.client.1.smithi098.stdout:7/975: creat d1/d4/f154 x:0 0 0 2023-01-04T18:16:38.121 INFO:tasks.workunit.client.1.smithi098.stdout:8/969: mknod d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/d123/d37/d4b/c129 0 2023-01-04T18:16:38.121 INFO:tasks.workunit.client.1.smithi098.stdout:8/970: fdatasync d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/d123/d64/de8/fdc 0 2023-01-04T18:16:38.122 INFO:tasks.workunit.client.1.smithi098.stdout:4/977: rename d5/d28/d40/f8a to d5/de/d21/f156 0 2023-01-04T18:16:38.124 INFO:tasks.workunit.client.1.smithi098.stdout:0/952: creat df/d17/d1c/d3b/d98/ddc/f148 x:0 0 0 2023-01-04T18:16:38.124 INFO:tasks.workunit.client.1.smithi098.stdout:9/989: mknod d2/d53/c141 0 2023-01-04T18:16:38.127 INFO:tasks.workunit.client.1.smithi098.stdout:0/953: creat df/d17/d68/f149 x:0 0 0 2023-01-04T18:16:38.129 INFO:tasks.workunit.client.1.smithi098.stdout:0/954: dread df/d17/d1c/d3b/fec [0,4194304] 0 2023-01-04T18:16:38.129 INFO:tasks.workunit.client.1.smithi098.stdout:4/978: link d5/d28/d44/f131 d5/d9/d13/dab/f157 0 2023-01-04T18:16:38.143 INFO:tasks.workunit.client.1.smithi098.stdout:0/955: dread df/d17/f2d [0,4194304] 0 2023-01-04T18:16:38.143 INFO:tasks.workunit.client.1.smithi098.stdout:0/956: rmdir df/d17/d68/d132 39 2023-01-04T18:16:38.144 INFO:tasks.workunit.client.1.smithi098.stdout:0/957: stat df/d17/d1c/d3b/f107 0 2023-01-04T18:16:38.144 INFO:tasks.workunit.client.1.smithi098.stdout:0/958: symlink df/d17/d68/l14a 0 2023-01-04T18:16:38.160 INFO:tasks.workunit.client.1.smithi098.stdout:6/967: sync 2023-01-04T18:16:38.160 INFO:tasks.workunit.client.1.smithi098.stdout:2/955: sync 2023-01-04T18:16:38.160 INFO:tasks.workunit.client.1.smithi098.stdout:2/956: chown d6/dc/d2b/d42/d51/d79/f125 644 1 2023-01-04T18:16:38.161 INFO:tasks.workunit.client.1.smithi098.stdout:4/979: dwrite d5/d9/d90/ff7 [0,4194304] 0 2023-01-04T18:16:38.161 INFO:tasks.workunit.client.1.smithi098.stdout:0/959: read df/d17/d1c/d2c/d41/d4a/d4c/d90/fef [2683843,127581] 0 2023-01-04T18:16:38.161 INFO:tasks.workunit.client.1.smithi098.stdout:6/968: creat d9/dd/d4e/d67/d8d/d81/dc5/f12b x:0 0 0 2023-01-04T18:16:38.163 INFO:tasks.workunit.client.1.smithi098.stdout:0/960: rmdir df/d17/d1c/d2c/d41/d4a/d7a 39 2023-01-04T18:16:38.163 INFO:tasks.workunit.client.1.smithi098.stdout:0/961: truncate df/d17/d1c/d3b/fec 1030372 0 2023-01-04T18:16:38.163 INFO:tasks.workunit.client.1.smithi098.stdout:0/962: stat df/d17/d9b 0 2023-01-04T18:16:38.164 INFO:tasks.workunit.client.1.smithi098.stdout:6/969: rename d9/dd/d4e/d67/d8d/d81/dc5/f110 to d9/dd/de/d7e/f12c 0 2023-01-04T18:16:38.165 INFO:tasks.workunit.client.1.smithi098.stdout:4/980: mknod d5/d28/d40/d5d/dcf/de9/c158 0 2023-01-04T18:16:38.166 INFO:tasks.workunit.client.1.smithi098.stdout:0/963: symlink df/d4f/d6b/d75/l14b 0 2023-01-04T18:16:38.167 INFO:tasks.workunit.client.1.smithi098.stdout:6/970: creat d9/dd/de/d20/f12d x:0 0 0 2023-01-04T18:16:38.167 INFO:tasks.workunit.client.1.smithi098.stdout:6/971: write d9/dd/de/d7e/f12c [449168,75767] 0 2023-01-04T18:16:38.167 INFO:tasks.workunit.client.1.smithi098.stdout:4/981: chown d5/de/d21/f126 1589974 1 2023-01-04T18:16:38.168 INFO:tasks.workunit.client.1.smithi098.stdout:7/976: dwrite d1/d23/f100 [0,4194304] 0 2023-01-04T18:16:38.168 INFO:tasks.workunit.client.1.smithi098.stdout:0/964: creat df/d17/d1c/d3b/de2/f14c x:0 0 0 2023-01-04T18:16:38.168 INFO:tasks.workunit.client.1.smithi098.stdout:0/965: readlink df/d17/d1c/d3b/de2/l119 0 2023-01-04T18:16:38.169 INFO:tasks.workunit.client.1.smithi098.stdout:0/966: chown df/d17/d1c/d3b/d98/c73 4434868 1 2023-01-04T18:16:38.169 INFO:tasks.workunit.client.1.smithi098.stdout:8/971: dwrite d6/d11/d15/db4/dba/ded/d6e/fd8 [0,4194304] 0 2023-01-04T18:16:38.169 INFO:tasks.workunit.client.1.smithi098.stdout:8/972: fsync d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/fea 0 2023-01-04T18:16:38.169 INFO:tasks.workunit.client.1.smithi098.stdout:8/973: write d6/d11/d15/d70/fbc [1985773,32348] 0 2023-01-04T18:16:38.169 INFO:tasks.workunit.client.1.smithi098.stdout:4/982: rename d5/d9/d90/fba to d5/de/d2c/d12a/f159 0 2023-01-04T18:16:38.173 INFO:tasks.workunit.client.1.smithi098.stdout:7/977: symlink d1/d23/d73/d85/dfd/d105/l155 0 2023-01-04T18:16:38.176 INFO:tasks.workunit.client.1.smithi098.stdout:8/974: rename d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/d123/c4e to d6/d11/d15/d1b/d2a/d6b/d7f/d12/d39/c12a 0 2023-01-04T18:16:38.177 INFO:tasks.workunit.client.1.smithi098.stdout:8/975: stat d6/d11/d15/d1b/d2a/d6b/d7f/f81 0 2023-01-04T18:16:38.177 INFO:tasks.workunit.client.1.smithi098.stdout:8/976: chown d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/f61 243634887 1 2023-01-04T18:16:38.177 INFO:tasks.workunit.client.1.smithi098.stdout:8/977: readlink d6/d11/d15/d1b/d2a/d6b/d7f/l55 0 2023-01-04T18:16:38.177 INFO:tasks.workunit.client.1.smithi098.stdout:4/983: truncate d5/de/d21/d9d/fca 7995273 0 2023-01-04T18:16:38.178 INFO:tasks.workunit.client.1.smithi098.stdout:4/984: chown d5/de/d2c/l34 14737330 1 2023-01-04T18:16:38.181 INFO:tasks.workunit.client.1.smithi098.stdout:4/985: dread d5/de/d21/f39 [0,4194304] 0 2023-01-04T18:16:38.246 INFO:tasks.workunit.client.1.smithi098.stdout:6/972: dwrite d9/dd/d4e/d67/d8d/d81/dc5/f120 [0,4194304] 0 2023-01-04T18:16:38.247 INFO:tasks.workunit.client.1.smithi098.stdout:0/967: dwrite df/d17/d1c/f3a [0,4194304] 0 2023-01-04T18:16:38.248 INFO:tasks.workunit.client.1.smithi098.stdout:8/978: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/d123/d64/de8/f112 [0,4194304] 0 2023-01-04T18:16:38.249 INFO:tasks.workunit.client.1.smithi098.stdout:7/978: dwrite d1/d4/d11/d9d/f144 [0,4194304] 0 2023-01-04T18:16:38.250 INFO:tasks.workunit.client.1.smithi098.stdout:4/986: dwrite d5/d9/d13/f13f [0,4194304] 0 2023-01-04T18:16:38.250 INFO:tasks.workunit.client.1.smithi098.stdout:6/973: rename d9/dd/de/d44/d79/d104/lcc to d9/dd/de/d44/d79/l12e 0 2023-01-04T18:16:38.253 INFO:tasks.workunit.client.1.smithi098.stdout:6/974: read d9/dd/de/f9c [3397700,31238] 0 2023-01-04T18:16:38.254 INFO:tasks.workunit.client.1.smithi098.stdout:6/975: fsync d9/fa0 0 2023-01-04T18:16:38.254 INFO:tasks.workunit.client.1.smithi098.stdout:4/987: write d5/dad/d120/f134 [1042113,104770] 0 2023-01-04T18:16:38.257 INFO:tasks.workunit.client.1.smithi098.stdout:0/968: mknod df/d17/d1c/d2c/da8/d139/c14d 0 2023-01-04T18:16:38.261 INFO:tasks.workunit.client.1.smithi098.stdout:8/979: link d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/fb6 d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/d123/d37/d4b/d67/d8a/ddd/f12b 0 2023-01-04T18:16:38.265 INFO:tasks.workunit.client.1.smithi098.stdout:0/969: dread df/d17/fcd [0,4194304] 0 2023-01-04T18:16:38.266 INFO:tasks.workunit.client.1.smithi098.stdout:0/970: dread - df/d17/d1c/d2c/d41/d4a/fda zero size 2023-01-04T18:16:38.266 INFO:tasks.workunit.client.1.smithi098.stdout:0/971: fsync df/d4f/d6b/d94/feb 0 2023-01-04T18:16:38.266 INFO:tasks.workunit.client.1.smithi098.stdout:7/979: dwrite d1/d23/d37/fee [0,4194304] 0 2023-01-04T18:16:38.270 INFO:tasks.workunit.client.1.smithi098.stdout:4/988: fsync d5/de/d21/f6b 0 2023-01-04T18:16:38.270 INFO:tasks.workunit.client.1.smithi098.stdout:4/989: chown d5/d28/d44/f78 966839588 1 2023-01-04T18:16:38.271 INFO:tasks.workunit.client.1.smithi098.stdout:8/980: mkdir d6/d11/d15/d1b/d2a/d6b/d9c/d12c 0 2023-01-04T18:16:38.273 INFO:tasks.workunit.client.1.smithi098.stdout:7/980: creat d1/d4/d11/d9d/f156 x:0 0 0 2023-01-04T18:16:38.274 INFO:tasks.workunit.client.1.smithi098.stdout:6/976: dwrite d9/dd/d24/fcf [4194304,4194304] 0 2023-01-04T18:16:38.274 INFO:tasks.workunit.client.1.smithi098.stdout:6/977: chown d9/dd/d24/d64 3418 1 2023-01-04T18:16:38.275 INFO:tasks.workunit.client.1.smithi098.stdout:4/990: rename d5/dad/d120/f14e to d5/d9/d13/f15a 0 2023-01-04T18:16:38.276 INFO:tasks.workunit.client.1.smithi098.stdout:8/981: link d6/f9 d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/d123/d64/d115/f12d 0 2023-01-04T18:16:38.276 INFO:tasks.workunit.client.1.smithi098.stdout:0/972: dread df/d17/d1c/d2c/d41/d64/f9f [0,4194304] 0 2023-01-04T18:16:38.277 INFO:tasks.workunit.client.1.smithi098.stdout:8/982: read d6/d11/d15/f9a [1205060,105510] 0 2023-01-04T18:16:38.278 INFO:tasks.workunit.client.1.smithi098.stdout:1/921: sync 2023-01-04T18:16:38.279 INFO:tasks.workunit.client.1.smithi098.stdout:7/981: creat d1/d23/d37/f157 x:0 0 0 2023-01-04T18:16:38.281 INFO:tasks.workunit.client.1.smithi098.stdout:7/982: dread d1/d23/d21/d43/f9e [0,4194304] 0 2023-01-04T18:16:38.281 INFO:tasks.workunit.client.1.smithi098.stdout:7/983: chown d1/d4/l18 489852 1 2023-01-04T18:16:38.281 INFO:tasks.workunit.client.1.smithi098.stdout:7/984: readlink d1/d23/d21/leb 0 2023-01-04T18:16:38.282 INFO:tasks.workunit.client.1.smithi098.stdout:7/985: write d1/d51/d26/d28/d2d/f32 [2877645,33518] 0 2023-01-04T18:16:38.283 INFO:tasks.workunit.client.1.smithi098.stdout:6/978: getdents d9/dd/de/d26/d10c 0 2023-01-04T18:16:38.286 INFO:tasks.workunit.client.1.smithi098.stdout:0/973: mknod df/d17/d1c/c14e 0 2023-01-04T18:16:38.286 INFO:tasks.workunit.client.1.smithi098.stdout:0/974: chown df/d17/f2d 352830271 1 2023-01-04T18:16:38.287 INFO:tasks.workunit.client.1.smithi098.stdout:8/983: creat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/d123/d64/d109/f12e x:0 0 0 2023-01-04T18:16:38.290 INFO:tasks.workunit.client.1.smithi098.stdout:1/922: link d1/d8/dac/dfc/d36/c5e d1/d8/dac/dfc/d6a/d106/d113/c148 0 2023-01-04T18:16:38.291 INFO:tasks.workunit.client.1.smithi098.stdout:6/979: symlink d9/dd/de/d44/d79/d104/d85/l12f 0 2023-01-04T18:16:38.291 INFO:tasks.workunit.client.1.smithi098.stdout:6/980: write d9/dd/d24/d3e/f87 [690912,69828] 0 2023-01-04T18:16:38.292 INFO:tasks.workunit.client.1.smithi098.stdout:4/991: creat d5/d28/d7d/db6/dbd/dc5/f15b x:0 0 0 2023-01-04T18:16:38.293 INFO:tasks.workunit.client.1.smithi098.stdout:0/975: rename df/d4f/d6b/d89/d135 to df/d4f/d6b/d75/d14f 0 2023-01-04T18:16:38.295 INFO:tasks.workunit.client.1.smithi098.stdout:6/981: creat d9/dd/de/d7e/f130 x:0 0 0 2023-01-04T18:16:38.296 INFO:tasks.workunit.client.1.smithi098.stdout:7/986: dwrite d1/d51/dc0/ff5 [0,4194304] 0 2023-01-04T18:16:38.297 INFO:tasks.workunit.client.1.smithi098.stdout:8/984: rename d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/d123/d64/fff to d6/d11/d15/d1b/d2a/d6b/d7f/da6/d54/d6a/d84/def/f12f 0 2023-01-04T18:16:38.298 INFO:tasks.workunit.client.1.smithi098.stdout:6/982: stat d9/dd/de/l47 0 2023-01-04T18:16:38.298 INFO:tasks.workunit.client.1.smithi098.stdout:6/983: chown d9/dd/d24/d3e/d86/d9b/f116 2 1 2023-01-04T18:16:38.298 INFO:tasks.workunit.client.1.smithi098.stdout:6/984: truncate d9/dd/de/d7e/f130 749780 0 2023-01-04T18:16:38.300 INFO:tasks.workunit.client.1.smithi098.stdout:7/987: symlink d1/d4/d11/d9d/dd2/l158 0 2023-01-04T18:16:38.302 INFO:tasks.workunit.client.1.smithi098.stdout:0/976: rename df/d17/d9b/d86/de7/ff3 to df/d17/d1c/f150 0 2023-01-04T18:16:38.306 INFO:tasks.workunit.client.1.smithi098.stdout:8/985: creat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/d123/d37/d4b/d67/d8a/ddd/f130 x:0 0 0 2023-01-04T18:16:38.306 INFO:tasks.workunit.client.1.smithi098.stdout:7/988: mknod d1/dc1/c159 0 2023-01-04T18:16:38.306 INFO:tasks.workunit.client.1.smithi098.stdout:7/989: fsync d1/d51/d26/f8a 0 2023-01-04T18:16:38.308 INFO:tasks.workunit.client.1.smithi098.stdout:6/985: rename d9/dd/d24/d3e/d86/d9b/dce/d121/l127 to d9/dd/de/d44/d79/l131 0 2023-01-04T18:16:38.309 INFO:tasks.workunit.client.1.smithi098.stdout:0/977: creat df/d4f/d6b/f151 x:0 0 0 2023-01-04T18:16:38.311 INFO:tasks.workunit.client.1.smithi098.stdout:1/923: dwrite d1/d8/dac/dfc/d27/d77/f3b [4194304,4194304] 0 2023-01-04T18:16:38.312 INFO:tasks.workunit.client.1.smithi098.stdout:4/992: dwrite d5/d28/d44/f131 [4194304,4194304] 0 2023-01-04T18:16:38.313 INFO:tasks.workunit.client.1.smithi098.stdout:8/986: creat d6/d92/f131 x:0 0 0 2023-01-04T18:16:38.313 INFO:tasks.workunit.client.1.smithi098.stdout:7/990: mkdir d1/d51/dc0/d15a 0 2023-01-04T18:16:38.314 INFO:tasks.workunit.client.1.smithi098.stdout:0/978: mkdir df/d152 0 2023-01-04T18:16:38.315 INFO:tasks.workunit.client.1.smithi098.stdout:1/924: write d1/d8/d53/fc8 [3449390,64528] 0 2023-01-04T18:16:38.322 INFO:tasks.workunit.client.1.smithi098.stdout:6/986: dwrite d9/fa0 [0,4194304] 0 2023-01-04T18:16:38.322 INFO:tasks.workunit.client.1.smithi098.stdout:6/987: chown d9/dd/de/d7e/fd3 216 1 2023-01-04T18:16:38.323 INFO:tasks.workunit.client.1.smithi098.stdout:4/993: rename d5/d28 to d5/d9/d13/d11d/d15c 0 2023-01-04T18:16:38.323 INFO:tasks.workunit.client.1.smithi098.stdout:4/994: dread - d5/d9/d13/f15a zero size 2023-01-04T18:16:38.323 INFO:tasks.workunit.client.1.smithi098.stdout:4/995: write d5/dad/d120/f134 [6895508,9383] 0 2023-01-04T18:16:38.339 INFO:tasks.workunit.client.1.smithi098.stdout:0/979: dwrite df/d17/d1c/d2c/d41/d4a/fda [0,4194304] 0 2023-01-04T18:16:38.347 INFO:tasks.workunit.client.1.smithi098.stdout:0/980: dread df/d17/d1c/d2c/d41/d4a/d4c/f66 [0,4194304] 0 2023-01-04T18:16:38.357 INFO:tasks.workunit.client.1.smithi098.stdout:8/987: truncate d6/d11/d15/d1b/d2a/dae/dd6/f102 915945 0 2023-01-04T18:16:38.534 INFO:tasks.workunit.client.1.smithi098.stdout:7/991: creat d1/d4/d11/d5d/f15b x:0 0 0 2023-01-04T18:16:38.536 INFO:tasks.workunit.client.1.smithi098.stdout:1/925: symlink d1/da9/de3/dec/df1/d123/l149 0 2023-01-04T18:16:38.537 INFO:tasks.workunit.client.1.smithi098.stdout:1/926: chown d1/ldf 0 1 2023-01-04T18:16:38.546 INFO:tasks.workunit.client.1.smithi098.stdout:9/990: sync 2023-01-04T18:16:38.568 INFO:tasks.workunit.client.1.smithi098.stdout:0/981: creat df/d17/d9b/ddf/f153 x:0 0 0 2023-01-04T18:16:38.571 INFO:tasks.workunit.client.1.smithi098.stdout:8/988: creat d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/d123/d64/d109/d116/f132 x:0 0 0 2023-01-04T18:16:38.572 INFO:tasks.workunit.client.1.smithi098.stdout:8/989: write d6/d11/d15/d1b/d2a/d6b/d7f/f8f [3309888,74278] 0 2023-01-04T18:16:38.572 INFO:tasks.workunit.client.1.smithi098.stdout:8/990: stat d6/d11/d15/d1b/d2a/dae/l124 0 2023-01-04T18:16:38.590 INFO:tasks.workunit.client.1.smithi098.stdout:7/992: mkdir d1/d4/d11/d9d/d15c 0 2023-01-04T18:16:38.592 INFO:tasks.workunit.client.1.smithi098.stdout:1/927: truncate d1/d8/dac/dfc/d6a/f90 3691228 0 2023-01-04T18:16:38.593 INFO:tasks.workunit.client.1.smithi098.stdout:9/991: mknod d2/df6/d26/c142 0 2023-01-04T18:16:38.593 INFO:tasks.workunit.client.1.smithi098.stdout:9/992: write d2/d5/d18/d19/d82/f128 [840520,108568] 0 2023-01-04T18:16:38.597 INFO:tasks.workunit.client.1.smithi098.stdout:0/982: mknod df/d17/d68/c154 0 2023-01-04T18:16:38.597 INFO:tasks.workunit.client.1.smithi098.stdout:0/983: fdatasync df/d17/d1c/f1e 0 2023-01-04T18:16:38.602 INFO:tasks.workunit.client.1.smithi098.stdout:8/991: getdents d6/d11/d15/db4 0 2023-01-04T18:16:38.604 INFO:tasks.workunit.client.1.smithi098.stdout:7/993: creat d1/d51/d26/d28/d2d/d6b/f15d x:0 0 0 2023-01-04T18:16:38.613 INFO:tasks.workunit.client.1.smithi098.stdout:1/928: creat d1/d8/dac/f14a x:0 0 0 2023-01-04T18:16:38.613 INFO:tasks.workunit.client.1.smithi098.stdout:1/929: chown d1/fff 93885476 1 2023-01-04T18:16:38.616 INFO:tasks.workunit.client.1.smithi098.stdout:8/992: dwrite d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/d123/d64/d109/f12e [0,4194304] 0 2023-01-04T18:16:38.617 INFO:tasks.workunit.client.1.smithi098.stdout:9/993: truncate d2/d2d/d12f/d23/dad/dfa/d42/f99 1213710 0 2023-01-04T18:16:38.617 INFO:tasks.workunit.client.1.smithi098.stdout:9/994: readlink d2/d2d/d12f/d23/l40 0 2023-01-04T18:16:38.619 INFO:tasks.workunit.client.1.smithi098.stdout:0/984: unlink df/d17/d1c/l138 0 2023-01-04T18:16:38.621 INFO:tasks.workunit.client.1.smithi098.stdout:8/993: dread d6/d11/d15/db4/dba/ded/fe3 [0,4194304] 0 2023-01-04T18:16:38.622 INFO:tasks.workunit.client.1.smithi098.stdout:6/988: rename d9/dd/de/d20/f5d to d9/dd/d4e/d67/d8d/f132 0 2023-01-04T18:16:38.624 INFO:tasks.workunit.client.1.smithi098.stdout:7/994: mknod d1/d4/d11/d5d/d130/c15e 0 2023-01-04T18:16:38.624 INFO:tasks.workunit.client.1.smithi098.stdout:1/930: symlink d1/da9/de3/dec/df9/l14b 0 2023-01-04T18:16:38.630 INFO:tasks.workunit.client.1.smithi098.stdout:9/995: unlink d2/d2d/d12f/d23/dad/f115 0 2023-01-04T18:16:38.632 INFO:tasks.workunit.client.1.smithi098.stdout:0/985: link df/d17/d9b/d86/ff4 df/d17/d1c/d3b/de2/f155 0 2023-01-04T18:16:38.634 INFO:tasks.workunit.client.1.smithi098.stdout:8/994: creat d6/d11/d15/d1b/f133 x:0 0 0 2023-01-04T18:16:38.636 INFO:tasks.workunit.client.1.smithi098.stdout:4/996: rename d5/dad/laf to d5/de/d2c/dcb/de6/l15d 0 2023-01-04T18:16:38.637 INFO:tasks.workunit.client.1.smithi098.stdout:6/989: mknod d9/dd/de/d20/d82/d84/d8a/c133 0 2023-01-04T18:16:38.640 INFO:tasks.workunit.client.1.smithi098.stdout:9/996: creat d2/d2d/d12f/d23/dad/d72/f143 x:0 0 0 2023-01-04T18:16:38.641 INFO:tasks.workunit.client.1.smithi098.stdout:0/986: creat df/d17/d9b/d86/de7/f156 x:0 0 0 2023-01-04T18:16:38.641 INFO:tasks.workunit.client.1.smithi098.stdout:0/987: chown f5 0 1 2023-01-04T18:16:38.641 INFO:tasks.workunit.client.1.smithi098.stdout:0/988: fdatasync df/d4f/f5d 0 2023-01-04T18:16:38.642 INFO:tasks.workunit.client.1.smithi098.stdout:8/995: unlink d6/d11/d15/d1b/f93 0 2023-01-04T18:16:38.643 INFO:tasks.workunit.client.1.smithi098.stdout:8/996: dread - d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/d123/d37/d4b/d67/f127 zero size 2023-01-04T18:16:38.644 INFO:tasks.workunit.client.1.smithi098.stdout:4/997: rename d5/de/d21 to d5/d9/d13/dab/d127/d15e 0 2023-01-04T18:16:38.645 INFO:tasks.workunit.client.1.smithi098.stdout:6/990: mkdir d9/dda/d134 0 2023-01-04T18:16:38.645 INFO:tasks.workunit.client.1.smithi098.stdout:6/991: write d9/f11c [783471,101202] 0 2023-01-04T18:16:38.646 INFO:tasks.workunit.client.1.smithi098.stdout:0/989: creat df/d4f/d6b/d75/f157 x:0 0 0 2023-01-04T18:16:38.647 INFO:tasks.workunit.client.1.smithi098.stdout:8/997: mkdir d6/d11/d15/d1b/d2a/d6b/d7f/d12/dc2/d134 0 2023-01-04T18:16:38.648 INFO:tasks.workunit.client.1.smithi098.stdout:9/997: rename d2/d2d/d12f/d23/l25 to d2/d53/l144 0 2023-01-04T18:16:38.649 INFO:tasks.workunit.client.1.smithi098.stdout:0/990: creat df/d17/d1c/d2c/d41/d4a/f158 x:0 0 0 2023-01-04T18:16:38.649 INFO:tasks.workunit.client.1.smithi098.stdout:4/998: rename d5/de/d30/d4f/c109 to d5/c15f 0 2023-01-04T18:16:38.650 INFO:tasks.workunit.client.1.smithi098.stdout:9/998: creat d2/df6/d78/f145 x:0 0 0 2023-01-04T18:16:38.651 INFO:tasks.workunit.client.1.smithi098.stdout:0/991: creat df/d17/d68/f159 x:0 0 0 2023-01-04T18:16:38.653 INFO:tasks.workunit.client.1.smithi098.stdout:0/992: truncate df/d17/d1c/d2c/d41/d4a/fda 3527192 0 2023-01-04T18:16:38.655 INFO:tasks.workunit.client.1.smithi098.stdout:0/993: getdents df/d4f 0 2023-01-04T18:16:38.655 INFO:tasks.workunit.client.1.smithi098.stdout:0/994: readlink df/d4f/d6b/d75/ld4 0 2023-01-04T18:16:38.655 INFO:tasks.workunit.client.1.smithi098.stdout:0/995: fdatasync df/d17/d1c/d2c/d41/d4a/d4c/d8e/f10e 0 2023-01-04T18:16:38.674 INFO:tasks.workunit.client.1.smithi098.stdout:9/999: dwrite d2/d5/d18/d19/d82/dce/d10f/f12e [0,4194304] 0 2023-01-04T18:16:38.674 INFO:tasks.workunit.client.1.smithi098.stdout:6/992: dwrite d9/dd/de/d20/d11a/f11f [0,4194304] 0 2023-01-04T18:16:38.675 INFO:tasks.workunit.client.1.smithi098.stdout:6/993: dread d9/fb1 [0,4194304] 0 2023-01-04T18:16:38.675 INFO:tasks.workunit.client.1.smithi098.stdout:6/994: symlink d9/dd/d4e/d67/d8d/da5/l135 0 2023-01-04T18:16:38.675 INFO:tasks.workunit.client.1.smithi098.stdout:6/995: creat d9/dda/f136 x:0 0 0 2023-01-04T18:16:38.692 INFO:tasks.workunit.client.1.smithi098.stdout:0/996: dwrite df/d17/d24/f57 [0,4194304] 0 2023-01-04T18:16:38.692 INFO:tasks.workunit.client.1.smithi098.stdout:1/931: dwrite d1/d8/da/f1a [4194304,4194304] 0 2023-01-04T18:16:38.692 INFO:tasks.workunit.client.1.smithi098.stdout:4/999: dwrite d5/d9/d13/d11d/d15c/d7d/db6/dbd/f13d [0,4194304] 0 2023-01-04T18:16:38.692 INFO:tasks.workunit.client.1.smithi098.stdout:1/932: write d1/d8/dac/dfc/d6a/d106/d128/dca/fe0 [814029,26079] 0 2023-01-04T18:16:38.710 INFO:tasks.workunit.client.1.smithi098.stdout:6/996: creat d9/dda/f137 x:0 0 0 2023-01-04T18:16:38.710 INFO:tasks.workunit.client.1.smithi098.stdout:0/997: dwrite df/d17/d9b/da1/f10b [0,4194304] 0 2023-01-04T18:16:38.712 INFO:tasks.workunit.client.1.smithi098.stdout:2/957: sync 2023-01-04T18:16:38.712 INFO:tasks.workunit.client.1.smithi098.stdout:2/958: readlink d6/dc/d2b/d46/l98 0 2023-01-04T18:16:38.712 INFO:tasks.workunit.client.1.smithi098.stdout:2/959: fsync d6/dc/d2b/d42/d47/da5/dda/d111/f113 0 2023-01-04T18:16:38.713 INFO:tasks.workunit.client.1.smithi098.stdout:2/960: fsync d6/dc/d2b/d42/d47/d1f/f29 0 2023-01-04T18:16:38.713 INFO:tasks.workunit.client.1.smithi098.stdout:2/961: chown d6/ded 1205696 1 2023-01-04T18:16:38.715 INFO:tasks.workunit.client.1.smithi098.stdout:1/933: mknod d1/da9/de3/d13a/d143/c14c 0 2023-01-04T18:16:38.717 INFO:tasks.workunit.client.1.smithi098.stdout:6/997: mkdir d9/dd/de/d138 0 2023-01-04T18:16:38.718 INFO:tasks.workunit.client.1.smithi098.stdout:6/998: readlink d9/dd/d15/l90 0 2023-01-04T18:16:38.718 INFO:tasks.workunit.client.1.smithi098.stdout:1/934: read d1/d8/da/dae/f111 [2901156,82468] 0 2023-01-04T18:16:38.727 INFO:tasks.workunit.client.1.smithi098.stdout:0/998: mknod df/d17/d1c/d2c/d41/d4a/d7a/c15a 0 2023-01-04T18:16:38.734 INFO:tasks.workunit.client.1.smithi098.stdout:2/962: dwrite d6/dc/d2b/fcc [4194304,4194304] 0 2023-01-04T18:16:38.734 INFO:tasks.workunit.client.1.smithi098.stdout:6/999: creat d9/dd/d4e/d67/d8d/d81/f139 x:0 0 0 2023-01-04T18:16:38.754 INFO:tasks.workunit.client.1.smithi098.stdout:1/935: dwrite d1/d8/d53/feb [0,4194304] 0 2023-01-04T18:16:38.758 INFO:tasks.workunit.client.1.smithi098.stdout:1/936: link d1/d8/da/dae/ccd d1/d8/dac/dfc/d27/dfe/c14d 0 2023-01-04T18:16:38.759 INFO:tasks.workunit.client.1.smithi098.stdout:1/937: mknod d1/d8/dac/dfc/d6a/d106/d113/c14e 0 2023-01-04T18:16:38.760 INFO:tasks.workunit.client.1.smithi098.stdout:1/938: getdents d1/d8/df0 0 2023-01-04T18:16:38.761 INFO:tasks.workunit.client.1.smithi098.stdout:1/939: chown d1/da9/de3/dec/df9/l14b 0 1 2023-01-04T18:16:38.761 INFO:tasks.workunit.client.1.smithi098.stdout:1/940: write d1/da9/de3/dec/df9/f10f [969069,35238] 0 2023-01-04T18:16:38.777 INFO:tasks.workunit.client.1.smithi098.stdout:1/941: dwrite d1/d8/da/dae/f6c [0,4194304] 0 2023-01-04T18:16:38.778 INFO:tasks.workunit.client.1.smithi098.stdout:1/942: read d1/d8/da/dae/f13d [2759988,98297] 0 2023-01-04T18:16:38.779 INFO:tasks.workunit.client.1.smithi098.stdout:1/943: creat d1/d8/dac/dfc/d36/d100/f14f x:0 0 0 2023-01-04T18:16:38.781 INFO:tasks.workunit.client.1.smithi098.stdout:1/944: rename d1/d8/da/dae/l79 to d1/d8/d53/l150 0 2023-01-04T18:16:38.781 INFO:tasks.workunit.client.1.smithi098.stdout:1/945: truncate d1/d8/dac/dfc/d36/d4e/d9f/fc7 485875 0 2023-01-04T18:16:38.782 INFO:tasks.workunit.client.1.smithi098.stdout:1/946: unlink d1/d8/dac/dfc/d36/d4e/d6e/c7e 0 2023-01-04T18:16:38.783 INFO:tasks.workunit.client.1.smithi098.stdout:1/947: creat d1/d8/dac/dfc/d27/f151 x:0 0 0 2023-01-04T18:16:38.784 INFO:tasks.workunit.client.1.smithi098.stdout:1/948: symlink d1/l152 0 2023-01-04T18:16:38.784 INFO:tasks.workunit.client.1.smithi098.stdout:1/949: stat d1/d8/fb1 0 2023-01-04T18:16:38.797 INFO:tasks.workunit.client.1.smithi098.stdout:1/950: dwrite d1/fff [0,4194304] 0 2023-01-04T18:16:38.800 INFO:tasks.workunit.client.1.smithi098.stdout:1/951: symlink d1/d8/dac/dfc/d36/d4e/d9f/dd7/l153 0 2023-01-04T18:16:38.824 INFO:tasks.workunit.client.1.smithi098.stdout:1/952: dwrite d1/d8/d53/f73 [0,4194304] 0 2023-01-04T18:16:38.837 INFO:tasks.workunit.client.1.smithi098.stdout:8/998: sync 2023-01-04T18:16:38.837 INFO:tasks.workunit.client.1.smithi098.stdout:7/995: sync 2023-01-04T18:16:38.838 INFO:tasks.workunit.client.1.smithi098.stdout:1/953: dwrite d1/fff [0,4194304] 0 2023-01-04T18:16:38.838 INFO:tasks.workunit.client.1.smithi098.stdout:8/999: unlink d6/d11/d15/d1b/d2a/d6b/d7f/d12/d20/c65 0 2023-01-04T18:16:38.839 INFO:tasks.workunit.client.1.smithi098.stdout:7/996: creat d1/d23/d73/d12f/f15f x:0 0 0 2023-01-04T18:16:38.844 INFO:tasks.workunit.client.1.smithi098.stdout:2/963: sync 2023-01-04T18:16:38.845 INFO:tasks.workunit.client.1.smithi098.stdout:0/999: sync 2023-01-04T18:16:38.845 INFO:tasks.workunit.client.1.smithi098.stdout:2/964: symlink d6/dc/l14e 0 2023-01-04T18:16:38.847 INFO:tasks.workunit.client.1.smithi098.stdout:2/965: mkdir d6/dc/d2b/d42/d47/d1f/d39/d6e/d14f 0 2023-01-04T18:16:38.848 INFO:tasks.workunit.client.1.smithi098.stdout:1/954: dread d1/d8/dac/dea/fbc [0,4194304] 0 2023-01-04T18:16:38.848 INFO:tasks.workunit.client.1.smithi098.stdout:1/955: chown d1/d8/dac/dfc/d36/d4e/d6e/f7f 1415325869 1 2023-01-04T18:16:38.849 INFO:tasks.workunit.client.1.smithi098.stdout:2/966: mkdir d6/dc/d4b/d150 0 2023-01-04T18:16:38.850 INFO:tasks.workunit.client.1.smithi098.stdout:1/956: link d1/d8/da/fc1 d1/d8/dac/dfc/d27/d5c/f154 0 2023-01-04T18:16:38.851 INFO:tasks.workunit.client.1.smithi098.stdout:2/967: symlink d6/dc/d2b/d46/l151 0 2023-01-04T18:16:38.852 INFO:tasks.workunit.client.1.smithi098.stdout:7/997: dwrite d1/d23/d37/f118 [0,4194304] 0 2023-01-04T18:16:38.853 INFO:tasks.workunit.client.1.smithi098.stdout:2/968: mknod d6/c152 0 2023-01-04T18:16:38.853 INFO:tasks.workunit.client.1.smithi098.stdout:2/969: readlink d6/dc/d2b/d42/d51/d79/da3/db5/lbd 0 2023-01-04T18:16:38.946 INFO:tasks.workunit.client.1.smithi098.stdout:7/998: dwrite d1/d23/d73/fff [0,4194304] 0 2023-01-04T18:16:38.950 INFO:tasks.workunit.client.1.smithi098.stdout:1/957: dwrite d1/d8/dac/dfc/d36/d100/f14f [0,4194304] 0 2023-01-04T18:16:38.950 INFO:tasks.workunit.client.1.smithi098.stdout:1/958: write d1/d8/da/dae/dfa/f115 [987805,46418] 0 2023-01-04T18:16:38.950 INFO:tasks.workunit.client.1.smithi098.stdout:1/959: dread - d1/d8/da/dae/faf zero size 2023-01-04T18:16:38.950 INFO:tasks.workunit.client.1.smithi098.stdout:7/999: link d1/d51/d26/d28/d2d/d75/ff8 d1/d51/d26/f160 0 2023-01-04T18:16:38.971 INFO:tasks.workunit.client.1.smithi098.stdout:1/960: dwrite d1/d8/dac/dfc/d39/dd9/fe5 [0,4194304] 0 2023-01-04T18:16:38.971 INFO:tasks.workunit.client.1.smithi098.stdout:1/961: readlink d1/d8/d53/l150 0 2023-01-04T18:16:38.972 INFO:tasks.workunit.client.1.smithi098.stdout:1/962: write d1/d8/da/f48 [690690,122366] 0 2023-01-04T18:16:38.974 INFO:tasks.workunit.client.1.smithi098.stdout:1/963: symlink d1/d8/dac/dfc/d36/d4e/d9f/dd7/l155 0 2023-01-04T18:16:38.978 INFO:tasks.workunit.client.1.smithi098.stdout:2/970: sync 2023-01-04T18:16:38.980 INFO:tasks.workunit.client.1.smithi098.stdout:2/971: rename d6/dc/d2b/d42/d47/d1f/f3a to d6/dc/d2b/d42/d47/d1f/d39/d13f/f153 0 2023-01-04T18:16:38.980 INFO:tasks.workunit.client.1.smithi098.stdout:2/972: write d6/dc/d2b/d42/d51/d81/d8f/de8/f136 [225458,54234] 0 2023-01-04T18:16:38.994 INFO:tasks.workunit.client.1.smithi098.stdout:1/964: dwrite d1/da9/f122 [0,4194304] 0 2023-01-04T18:16:38.996 INFO:tasks.workunit.client.1.smithi098.stdout:1/965: creat d1/d8/da/dae/f156 x:0 0 0 2023-01-04T18:16:38.996 INFO:tasks.workunit.client.1.smithi098.stdout:2/973: dwrite f5 [4194304,4194304] 0 2023-01-04T18:16:39.006 INFO:tasks.workunit.client.1.smithi098.stdout:1/966: dread d1/f83 [0,4194304] 0 2023-01-04T18:16:39.006 INFO:tasks.workunit.client.1.smithi098.stdout:2/974: dread d6/f33 [0,4194304] 0 2023-01-04T18:16:39.008 INFO:tasks.workunit.client.1.smithi098.stdout:1/967: rename d1/d8/dac/dfc/d27/d77/f3b to d1/d8/dac/dfc/d36/d4e/d6e/f157 0 2023-01-04T18:16:39.009 INFO:tasks.workunit.client.1.smithi098.stdout:2/975: creat d6/dc/d4b/f154 x:0 0 0 2023-01-04T18:16:39.010 INFO:tasks.workunit.client.1.smithi098.stdout:1/968: mkdir d1/d8/dac/dfc/d36/d4e/d9f/dd7/d158 0 2023-01-04T18:16:39.010 INFO:tasks.workunit.client.1.smithi098.stdout:1/969: write d1/d8/dac/dea/fce [743249,127131] 0 2023-01-04T18:16:39.010 INFO:tasks.workunit.client.1.smithi098.stdout:1/970: fsync f0 0 2023-01-04T18:16:39.010 INFO:tasks.workunit.client.1.smithi098.stdout:2/976: creat d6/dc/d2b/d42/d47/f155 x:0 0 0 2023-01-04T18:16:39.010 INFO:tasks.workunit.client.1.smithi098.stdout:2/977: fdatasync d6/dc/d2b/d42/d47/f155 0 2023-01-04T18:16:39.011 INFO:tasks.workunit.client.1.smithi098.stdout:1/971: symlink d1/d8/dac/dfc/d39/dd9/l159 0 2023-01-04T18:16:39.011 INFO:tasks.workunit.client.1.smithi098.stdout:2/978: write d6/f11 [1777267,104024] 0 2023-01-04T18:16:39.011 INFO:tasks.workunit.client.1.smithi098.stdout:2/979: read d6/dc/f12 [2727418,9405] 0 2023-01-04T18:16:39.012 INFO:tasks.workunit.client.1.smithi098.stdout:1/972: unlink d1/d8/dac/dfc/d36/d4e/ld6 0 2023-01-04T18:16:39.012 INFO:tasks.workunit.client.1.smithi098.stdout:1/973: readlink d1/d8/l71 0 2023-01-04T18:16:39.013 INFO:tasks.workunit.client.1.smithi098.stdout:2/980: mknod d6/dc/d2b/d42/d47/d1f/d39/d13f/d140/c156 0 2023-01-04T18:16:39.020 INFO:tasks.workunit.client.1.smithi098.stdout:1/974: dread d1/d8/dac/dfc/d27/d77/f8f [0,4194304] 0 2023-01-04T18:16:39.021 INFO:tasks.workunit.client.1.smithi098.stdout:1/975: write d1/d8/dac/dfc/d39/d10d/f124 [899441,111316] 0 2023-01-04T18:16:39.021 INFO:tasks.workunit.client.1.smithi098.stdout:1/976: fsync d1/d8/d53/feb 0 2023-01-04T18:16:39.037 INFO:tasks.workunit.client.1.smithi098.stdout:2/981: dwrite d6/dc/d2b/d42/d47/d1f/d39/d6e/d107/fb6 [0,4194304] 0 2023-01-04T18:16:39.037 INFO:tasks.workunit.client.1.smithi098.stdout:2/982: chown d6/dc/d2b/d42/d47/d106/c10b 1317167792 1 2023-01-04T18:16:39.037 INFO:tasks.workunit.client.1.smithi098.stdout:2/983: readlink d6/dc/d2b/d42/d51/l133 0 2023-01-04T18:16:39.037 INFO:tasks.workunit.client.1.smithi098.stdout:2/984: truncate d6/dc/d2b/d42/d47/d1f/f8b 875197 0 2023-01-04T18:16:39.037 INFO:tasks.workunit.client.1.smithi098.stdout:1/977: dwrite d1/d8/da/dae/f37 [8388608,4194304] 0 2023-01-04T18:16:39.045 INFO:tasks.workunit.client.1.smithi098.stdout:1/978: dread d1/f4 [4194304,4194304] 0 2023-01-04T18:16:39.055 INFO:tasks.workunit.client.1.smithi098.stdout:2/985: dwrite d6/dc/d2b/d32/d10a/f12a [0,4194304] 0 2023-01-04T18:16:39.055 INFO:tasks.workunit.client.1.smithi098.stdout:1/979: dread d1/d8/dac/dfc/d27/d5c/fb6 [0,4194304] 0 2023-01-04T18:16:39.057 INFO:tasks.workunit.client.1.smithi098.stdout:2/986: symlink d6/dc/d2b/d42/d47/d1f/d39/d13f/d140/l157 0 2023-01-04T18:16:39.060 INFO:tasks.workunit.client.1.smithi098.stdout:2/987: rename d6/dc/d2b/d42/d51/d81/d8f/de8 to d6/dc/d2b/d42/d51/d79/da3/db5/d158 0 2023-01-04T18:16:39.068 INFO:tasks.workunit.client.1.smithi098.stdout:2/988: dread d6/dc/f8c [0,4194304] 0 2023-01-04T18:16:39.069 INFO:tasks.workunit.client.1.smithi098.stdout:2/989: write d6/dc/d2b/d42/d51/d79/da3/db5/d158/feb [880024,98053] 0 2023-01-04T18:16:39.070 INFO:tasks.workunit.client.1.smithi098.stdout:2/990: write d6/dc/d2b/d42/d47/f41 [361818,1408] 0 2023-01-04T18:16:39.070 INFO:tasks.workunit.client.1.smithi098.stdout:2/991: readlink d6/dc/d2b/d42/d47/d35/dca/lf2 0 2023-01-04T18:16:39.070 INFO:tasks.workunit.client.1.smithi098.stdout:2/992: chown d6/dc/d2b/d42/d51/d79/da3/db5/f137 99 1 2023-01-04T18:16:39.071 INFO:tasks.workunit.client.1.smithi098.stdout:2/993: rmdir d6/dc/d2b/d42/d47/d1f/d39/d6e/d14f 0 2023-01-04T18:16:39.073 INFO:tasks.workunit.client.1.smithi098.stdout:2/994: rename d6/ded/df9/d90/fae to d6/dc/d2b/d42/d47/d1f/d39/d6e/d107/f159 0 2023-01-04T18:16:39.074 INFO:tasks.workunit.client.1.smithi098.stdout:2/995: mkdir d6/dc/d2b/d42/d47/d1f/d39/d6e/d107/d15a 0 2023-01-04T18:16:39.079 INFO:tasks.workunit.client.1.smithi098.stdout:2/996: dread d6/dc/d2b/d42/d47/d1f/d39/d6e/d107/fa4 [0,4194304] 0 2023-01-04T18:16:39.079 INFO:tasks.workunit.client.1.smithi098.stdout:2/997: stat d6/dc/d2b/c60 0 2023-01-04T18:16:39.080 INFO:tasks.workunit.client.1.smithi098.stdout:1/980: dwrite d1/d8/da/dae/f5f [4194304,4194304] 0 2023-01-04T18:16:39.081 INFO:tasks.workunit.client.1.smithi098.stdout:2/998: truncate d6/ded/df9/f6b 3448938 0 2023-01-04T18:16:39.081 INFO:tasks.workunit.client.1.smithi098.stdout:2/999: truncate d6/dc/d2b/d42/d51/d79/da3/db5/d158/f136 1221616 0 2023-01-04T18:16:39.081 INFO:tasks.workunit.client.1.smithi098.stdout:1/981: mknod d1/d8/dac/dfc/d36/d89/db3/c15a 0 2023-01-04T18:16:39.081 INFO:tasks.workunit.client.1.smithi098.stdout:1/982: write d1/d8/dac/dfc/d6a/d106/d128/fe6 [405806,112603] 0 2023-01-04T18:16:39.089 INFO:tasks.workunit.client.1.smithi098.stdout:1/983: rmdir d1/d8/dac 39 2023-01-04T18:16:39.089 INFO:tasks.workunit.client.1.smithi098.stdout:1/984: stat d1/d8/dac/dfc/d39/f147 0 2023-01-04T18:16:39.091 INFO:tasks.workunit.client.1.smithi098.stdout:1/985: rename d1/la6 to d1/d8/dac/dfc/d36/d4e/d9f/l15b 0 2023-01-04T18:16:39.100 INFO:tasks.workunit.client.1.smithi098.stdout:1/986: dread d1/d8/dac/dfc/d27/d77/f2b [4194304,4194304] 0 2023-01-04T18:16:39.241 INFO:tasks.workunit.client.1.smithi098.stdout:1/987: dwrite d1/d8/dac/dfc/d39/dd9/fe5 [0,4194304] 0 2023-01-04T18:16:39.242 INFO:tasks.workunit.client.1.smithi098.stdout:1/988: truncate d1/d8/dac/dfc/f102 2130024 0 2023-01-04T18:16:39.243 INFO:tasks.workunit.client.1.smithi098.stdout:1/989: stat d1/d8/dac/dfc/d36/d4e/d9f/dd7/l153 0 2023-01-04T18:16:39.243 INFO:tasks.workunit.client.1.smithi098.stdout:1/990: stat d1/d8/dac/dfc/f3c 0 2023-01-04T18:16:39.243 INFO:tasks.workunit.client.1.smithi098.stdout:1/991: write d1/d8/df0/f134 [1017548,115877] 0 2023-01-04T18:16:39.243 INFO:tasks.workunit.client.1.smithi098.stdout:1/992: chown d1/da9/de3 108710 1 2023-01-04T18:16:39.243 INFO:tasks.workunit.client.1.smithi098.stdout:1/993: stat d1/d8/da/dae/f37 0 2023-01-04T18:16:39.243 INFO:tasks.workunit.client.1.smithi098.stdout:1/994: write d1/d8/dac/dfc/d39/d10d/f12e [236117,98307] 0 2023-01-04T18:16:39.243 INFO:tasks.workunit.client.1.smithi098.stdout:1/995: getdents d1/d8/dac/dfc/d6a/d106/d113 0 2023-01-04T18:16:39.245 INFO:tasks.workunit.client.1.smithi098.stdout:1/996: unlink d1/d8/da/dae/f58 0 2023-01-04T18:16:39.246 INFO:tasks.workunit.client.1.smithi098.stdout:1/997: write d1/d8/f28 [3302862,41917] 0 2023-01-04T18:16:39.246 INFO:tasks.workunit.client.1.smithi098.stdout:1/998: stat d1/d8/dac/dfc/d39/dd9/f118 0 2023-01-04T18:16:39.247 INFO:tasks.workunit.client.1.smithi098.stdout:1/999: chown d1/d8/df0 15 1 2023-01-04T18:16:39.251 INFO:tasks.workunit.client.1.smithi098.stderr:+ rm -rf -- ./tmp.iPu29PosZV 2023-01-04T18:16:39.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:37.914777+0000 mgr.smithi098.vhfzum (mgr.24455) 22 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 1.6 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 121 MiB/s rd, 223 MiB/s wr, 384 op/s 2023-01-04T18:16:39.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:37.914777+0000 mgr.smithi098.vhfzum (mgr.24455) 22 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 1.6 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 121 MiB/s rd, 223 MiB/s wr, 384 op/s 2023-01-04T18:16:41.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:39.915215+0000 mgr.smithi098.vhfzum (mgr.24455) 23 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 2.3 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 176 MiB/s rd, 334 MiB/s wr, 562 op/s 2023-01-04T18:16:41.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:39.915215+0000 mgr.smithi098.vhfzum (mgr.24455) 23 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 2.3 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 176 MiB/s rd, 334 MiB/s wr, 562 op/s 2023-01-04T18:16:43.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:41.915586+0000 mgr.smithi098.vhfzum (mgr.24455) 24 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 2.3 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 121 MiB/s rd, 237 MiB/s wr, 381 op/s 2023-01-04T18:16:43.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:41.915586+0000 mgr.smithi098.vhfzum (mgr.24455) 24 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 2.3 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 121 MiB/s rd, 237 MiB/s wr, 381 op/s 2023-01-04T18:16:45.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:43.916264+0000 mgr.smithi098.vhfzum (mgr.24455) 25 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 2.3 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 121 MiB/s rd, 237 MiB/s wr, 381 op/s 2023-01-04T18:16:45.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:43.916264+0000 mgr.smithi098.vhfzum (mgr.24455) 25 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 2.3 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 121 MiB/s rd, 237 MiB/s wr, 381 op/s 2023-01-04T18:16:46.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:45.916849+0000 mgr.smithi098.vhfzum (mgr.24455) 26 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 1.6 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 124 MiB/s rd, 241 MiB/s wr, 449 op/s 2023-01-04T18:16:46.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:45.916849+0000 mgr.smithi098.vhfzum (mgr.24455) 26 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 1.6 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 124 MiB/s rd, 241 MiB/s wr, 449 op/s 2023-01-04T18:16:47.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.374+0000 7f0ff67ae700 1 -- 172.21.15.50:0/4013453640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ff00602d0 msgr2=0x7f0ff00f92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:47.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.374+0000 7f0ff67ae700 1 --2- 172.21.15.50:0/4013453640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ff00602d0 0x7f0ff00f92e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f0fe0004660 tx=0x7f0fe0009b30).stop 2023-01-04T18:16:47.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.374+0000 7f0ff67ae700 1 -- 172.21.15.50:0/4013453640 shutdown_connections 2023-01-04T18:16:47.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.374+0000 7f0ff67ae700 1 --2- 172.21.15.50:0/4013453640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ff00f9860 0x7f0ff00fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:47.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.374+0000 7f0ff67ae700 1 --2- 172.21.15.50:0/4013453640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ff00602d0 0x7f0ff00f92e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:47.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.374+0000 7f0ff67ae700 1 -- 172.21.15.50:0/4013453640 >> 172.21.15.50:0/4013453640 conn(0x7f0ff00f0d40 msgr2=0x7f0ff00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:47.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.374+0000 7f0ff67ae700 1 -- 172.21.15.50:0/4013453640 shutdown_connections 2023-01-04T18:16:47.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.374+0000 7f0ff67ae700 1 -- 172.21.15.50:0/4013453640 wait complete. 2023-01-04T18:16:47.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.375+0000 7f0ff67ae700 1 Processor -- start 2023-01-04T18:16:47.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.375+0000 7f0ff67ae700 1 -- start start 2023-01-04T18:16:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.375+0000 7f0ff67ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ff00602d0 0x7f0ff0106f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.375+0000 7f0ff67ae700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ff00f9860 0x7f0ff01073f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.375+0000 7f0ff67ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff01079a0 con 0x7f0ff00602d0 2023-01-04T18:16:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.375+0000 7f0ff67ae700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff0107ae0 con 0x7f0ff00f9860 2023-01-04T18:16:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.375+0000 7f0feffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ff00602d0 0x7f0ff0106f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.375+0000 7f0fef7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ff00f9860 0x7f0ff01073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.375+0000 7f0feffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ff00602d0 0x7f0ff0106f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49532/0 (socket says 172.21.15.50:49532) 2023-01-04T18:16:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.375+0000 7f0feffff700 1 -- 172.21.15.50:0/3221682742 learned_addr learned my addr 172.21.15.50:0/3221682742 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:16:47.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.376+0000 7f0fef7fe700 1 -- 172.21.15.50:0/3221682742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ff00602d0 msgr2=0x7f0ff0106f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:47.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.376+0000 7f0fef7fe700 1 --2- 172.21.15.50:0/3221682742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ff00602d0 0x7f0ff0106f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:47.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.376+0000 7f0fef7fe700 1 -- 172.21.15.50:0/3221682742 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe0005040 con 0x7f0ff00f9860 2023-01-04T18:16:47.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.376+0000 7f0feffff700 1 --2- 172.21.15.50:0/3221682742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ff00602d0 0x7f0ff0106f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-01-04T18:16:47.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.376+0000 7f0fef7fe700 1 --2- 172.21.15.50:0/3221682742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ff00f9860 0x7f0ff01073f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f0ff00600a0 tx=0x7f0fe400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:47.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.376+0000 7f0fecff9700 1 -- 172.21.15.50:0/3221682742 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fe4015070 con 0x7f0ff00f9860 2023-01-04T18:16:47.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.376+0000 7f0ff67ae700 1 -- 172.21.15.50:0/3221682742 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff0108480 con 0x7f0ff00f9860 2023-01-04T18:16:47.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.376+0000 7f0fecff9700 1 -- 172.21.15.50:0/3221682742 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0fe4007c70 con 0x7f0ff00f9860 2023-01-04T18:16:47.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.376+0000 7f0fecff9700 1 -- 172.21.15.50:0/3221682742 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fe400bbd0 con 0x7f0ff00f9860 2023-01-04T18:16:47.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.376+0000 7f0ff67ae700 1 -- 172.21.15.50:0/3221682742 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff01089c0 con 0x7f0ff00f9860 2023-01-04T18:16:47.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.377+0000 7f0ff67ae700 1 -- 172.21.15.50:0/3221682742 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff0045ad0 con 0x7f0ff00f9860 2023-01-04T18:16:47.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.378+0000 7f0fecff9700 1 -- 172.21.15.50:0/3221682742 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) v1 ==== 74625+0+0 (secure 0 0 0) 0x7f0fe400bd30 con 0x7f0ff00f9860 2023-01-04T18:16:47.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.378+0000 7f0fecff9700 1 --2- 172.21.15.50:0/3221682742 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f0fd805e7c0 0x7f0fd8060c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:47.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.378+0000 7f0fecff9700 1 -- 172.21.15.50:0/3221682742 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f0fe407d1d0 con 0x7f0ff00f9860 2023-01-04T18:16:47.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.378+0000 7f0feffff700 1 --2- 172.21.15.50:0/3221682742 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f0fd805e7c0 0x7f0fd8060c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:47.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.379+0000 7f0feffff700 1 --2- 172.21.15.50:0/3221682742 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f0fd805e7c0 0x7f0fd8060c80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0fe0005010 tx=0x7f0fe0016040).ready entity=mgr.24455 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:47.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.383+0000 7f0fecff9700 1 -- 172.21.15.50:0/3221682742 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161783 (secure 0 0 0) 0x7f0fe40512f0 con 0x7f0ff00f9860 2023-01-04T18:16:47.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.573+0000 7f0ff67ae700 1 -- 172.21.15.50:0/3221682742 --> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ff0108c40 con 0x7f0fd805e7c0 2023-01-04T18:16:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.574+0000 7f0fecff9700 1 -- 172.21.15.50:0/3221682742 <== mgr.24455 v2:172.21.15.98:6828/3052541756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f0ff0108c40 con 0x7f0fd805e7c0 2023-01-04T18:16:47.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.576+0000 7f0ff67ae700 1 -- 172.21.15.50:0/3221682742 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f0fd805e7c0 msgr2=0x7f0fd8060c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.576+0000 7f0ff67ae700 1 --2- 172.21.15.50:0/3221682742 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f0fd805e7c0 0x7f0fd8060c80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0fe0005010 tx=0x7f0fe0016040).stop 2023-01-04T18:16:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.576+0000 7f0ff67ae700 1 -- 172.21.15.50:0/3221682742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ff00f9860 msgr2=0x7f0ff01073f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.576+0000 7f0ff67ae700 1 --2- 172.21.15.50:0/3221682742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ff00f9860 0x7f0ff01073f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f0ff00600a0 tx=0x7f0fe400b040).stop 2023-01-04T18:16:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.576+0000 7f0ff67ae700 1 -- 172.21.15.50:0/3221682742 shutdown_connections 2023-01-04T18:16:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.576+0000 7f0ff67ae700 1 --2- 172.21.15.50:0/3221682742 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f0fd805e7c0 0x7f0fd8060c80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.576+0000 7f0ff67ae700 1 --2- 172.21.15.50:0/3221682742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ff00602d0 0x7f0ff0106f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.576+0000 7f0ff67ae700 1 --2- 172.21.15.50:0/3221682742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ff00f9860 0x7f0ff01073f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.576+0000 7f0ff67ae700 1 -- 172.21.15.50:0/3221682742 >> 172.21.15.50:0/3221682742 conn(0x7f0ff00f0d40 msgr2=0x7f0ff00f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.577+0000 7f0ff67ae700 1 -- 172.21.15.50:0/3221682742 shutdown_connections 2023-01-04T18:16:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.577+0000 7f0ff67ae700 1 -- 172.21.15.50:0/3221682742 wait complete. 2023-01-04T18:16:47.589 INFO:teuthology.orchestra.run.smithi050.stdout:true 2023-01-04T18:16:47.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.682+0000 7f4c89f68700 1 -- 172.21.15.50:0/3619567012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c840fbbd0 msgr2=0x7f4c840fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:47.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.682+0000 7f4c89f68700 1 --2- 172.21.15.50:0/3619567012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c840fbbd0 0x7f4c840fdfc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f4c78004660 tx=0x7f4c78009b30).stop 2023-01-04T18:16:47.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.682+0000 7f4c89f68700 1 -- 172.21.15.50:0/3619567012 shutdown_connections 2023-01-04T18:16:47.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.682+0000 7f4c89f68700 1 --2- 172.21.15.50:0/3619567012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c840fbbd0 0x7f4c840fdfc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:47.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.682+0000 7f4c89f68700 1 --2- 172.21.15.50:0/3619567012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c840602d0 0x7f4c840fb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:47.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.682+0000 7f4c89f68700 1 -- 172.21.15.50:0/3619567012 >> 172.21.15.50:0/3619567012 conn(0x7f4c840f0d40 msgr2=0x7f4c840f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:47.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.682+0000 7f4c89f68700 1 -- 172.21.15.50:0/3619567012 shutdown_connections 2023-01-04T18:16:47.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.683+0000 7f4c89f68700 1 -- 172.21.15.50:0/3619567012 wait complete. 2023-01-04T18:16:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.683+0000 7f4c89f68700 1 Processor -- start 2023-01-04T18:16:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.683+0000 7f4c89f68700 1 -- start start 2023-01-04T18:16:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.683+0000 7f4c89f68700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c840602d0 0x7f4c841090e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.683+0000 7f4c89f68700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c840fbbd0 0x7f4c841095d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.683+0000 7f4c89f68700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c84109b80 con 0x7f4c840602d0 2023-01-04T18:16:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.683+0000 7f4c89f68700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c84109cc0 con 0x7f4c840fbbd0 2023-01-04T18:16:47.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.684+0000 7f4c837fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c840602d0 0x7f4c841090e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:47.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.684+0000 7f4c837fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c840602d0 0x7f4c841090e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49550/0 (socket says 172.21.15.50:49550) 2023-01-04T18:16:47.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.684+0000 7f4c837fe700 1 -- 172.21.15.50:0/90103559 learned_addr learned my addr 172.21.15.50:0/90103559 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:16:47.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.684+0000 7f4c82ffd700 1 --2- 172.21.15.50:0/90103559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c840fbbd0 0x7f4c841095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:47.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.684+0000 7f4c837fe700 1 -- 172.21.15.50:0/90103559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c840fbbd0 msgr2=0x7f4c841095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:47.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.684+0000 7f4c837fe700 1 --2- 172.21.15.50:0/90103559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c840fbbd0 0x7f4c841095d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:47.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.684+0000 7f4c837fe700 1 -- 172.21.15.50:0/90103559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c78005040 con 0x7f4c840602d0 2023-01-04T18:16:47.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.684+0000 7f4c82ffd700 1 --2- 172.21.15.50:0/90103559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c840fbbd0 0x7f4c841095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-01-04T18:16:47.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.684+0000 7f4c837fe700 1 --2- 172.21.15.50:0/90103559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c840602d0 0x7f4c841090e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f4c7400e7f0 tx=0x7f4c7400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:47.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.684+0000 7f4c6bfff700 1 -- 172.21.15.50:0/90103559 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c740092e0 con 0x7f4c840602d0 2023-01-04T18:16:47.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.684+0000 7f4c89f68700 1 -- 172.21.15.50:0/90103559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8410a660 con 0x7f4c840602d0 2023-01-04T18:16:47.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.684+0000 7f4c89f68700 1 -- 172.21.15.50:0/90103559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8410aba0 con 0x7f4c840602d0 2023-01-04T18:16:47.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.684+0000 7f4c6bfff700 1 -- 172.21.15.50:0/90103559 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4c7400f040 con 0x7f4c840602d0 2023-01-04T18:16:47.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.684+0000 7f4c6bfff700 1 -- 172.21.15.50:0/90103559 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c740147e0 con 0x7f4c840602d0 2023-01-04T18:16:47.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.686+0000 7f4c89f68700 1 -- 172.21.15.50:0/90103559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c64004fa0 con 0x7f4c840602d0 2023-01-04T18:16:47.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.686+0000 7f4c6bfff700 1 -- 172.21.15.50:0/90103559 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 23) v1 ==== 74625+0+0 (secure 0 0 0) 0x7f4c7401b030 con 0x7f4c840602d0 2023-01-04T18:16:47.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.686+0000 7f4c6bfff700 1 --2- 172.21.15.50:0/90103559 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f4c6c05e7c0 0x7f4c6c060c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:47.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.686+0000 7f4c6bfff700 1 -- 172.21.15.50:0/90103559 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f4c74078b10 con 0x7f4c840602d0 2023-01-04T18:16:47.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.687+0000 7f4c82ffd700 1 --2- 172.21.15.50:0/90103559 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f4c6c05e7c0 0x7f4c6c060c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:47.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.687+0000 7f4c82ffd700 1 --2- 172.21.15.50:0/90103559 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f4c6c05e7c0 0x7f4c6c060c80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f4c78009720 tx=0x7f4c78016040).ready entity=mgr.24455 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:47.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.691+0000 7f4c6bfff700 1 -- 172.21.15.50:0/90103559 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161783 (secure 0 0 0) 0x7f4c7404cce0 con 0x7f4c840602d0 2023-01-04T18:16:47.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.909+0000 7f4c89f68700 1 -- 172.21.15.50:0/90103559 --> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c64000bc0 con 0x7f4c6c05e7c0 2023-01-04T18:16:47.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.911+0000 7f4c6bfff700 1 -- 172.21.15.50:0/90103559 <== mgr.24455 v2:172.21.15.98:6828/3052541756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f4c64000bc0 con 0x7f4c6c05e7c0 2023-01-04T18:16:47.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.912+0000 7f4c89f68700 1 -- 172.21.15.50:0/90103559 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f4c6c05e7c0 msgr2=0x7f4c6c060c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:47.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.912+0000 7f4c89f68700 1 --2- 172.21.15.50:0/90103559 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f4c6c05e7c0 0x7f4c6c060c80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f4c78009720 tx=0x7f4c78016040).stop 2023-01-04T18:16:47.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.912+0000 7f4c89f68700 1 -- 172.21.15.50:0/90103559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c840602d0 msgr2=0x7f4c841090e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:47.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.912+0000 7f4c89f68700 1 --2- 172.21.15.50:0/90103559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c840602d0 0x7f4c841090e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f4c7400e7f0 tx=0x7f4c7400b040).stop 2023-01-04T18:16:47.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.913+0000 7f4c89f68700 1 -- 172.21.15.50:0/90103559 shutdown_connections 2023-01-04T18:16:47.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.913+0000 7f4c89f68700 1 --2- 172.21.15.50:0/90103559 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f4c6c05e7c0 0x7f4c6c060c80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:47.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.913+0000 7f4c89f68700 1 --2- 172.21.15.50:0/90103559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c840602d0 0x7f4c841090e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:47.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.913+0000 7f4c89f68700 1 --2- 172.21.15.50:0/90103559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c840fbbd0 0x7f4c841095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:47.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.913+0000 7f4c89f68700 1 -- 172.21.15.50:0/90103559 >> 172.21.15.50:0/90103559 conn(0x7f4c840f0d40 msgr2=0x7f4c840f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:47.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.913+0000 7f4c89f68700 1 -- 172.21.15.50:0/90103559 shutdown_connections 2023-01-04T18:16:47.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:47.913+0000 7f4c89f68700 1 -- 172.21.15.50:0/90103559 wait complete. 2023-01-04T18:16:48.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.065+0000 7fbceb7b8700 1 -- 172.21.15.50:0/4003376491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbce406cbb0 msgr2=0x7fbce406d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:48.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.065+0000 7fbceb7b8700 1 --2- 172.21.15.50:0/4003376491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbce406cbb0 0x7fbce406d630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fbce00045a0 tx=0x7fbce0009b30).stop 2023-01-04T18:16:48.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.065+0000 7fbceb7b8700 1 -- 172.21.15.50:0/4003376491 shutdown_connections 2023-01-04T18:16:48.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.065+0000 7fbceb7b8700 1 --2- 172.21.15.50:0/4003376491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbce406cbb0 0x7fbce406d630 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:48.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.065+0000 7fbceb7b8700 1 --2- 172.21.15.50:0/4003376491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce406c2a0 0x7fbce406c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:48.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.065+0000 7fbceb7b8700 1 -- 172.21.15.50:0/4003376491 >> 172.21.15.50:0/4003376491 conn(0x7fbce40f40e0 msgr2=0x7fbce40f6500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:48.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.066+0000 7fbceb7b8700 1 -- 172.21.15.50:0/4003376491 shutdown_connections 2023-01-04T18:16:48.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.067+0000 7fbceb7b8700 1 -- 172.21.15.50:0/4003376491 wait complete. 2023-01-04T18:16:48.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.068+0000 7fbceb7b8700 1 Processor -- start 2023-01-04T18:16:48.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.069+0000 7fbceb7b8700 1 -- start start 2023-01-04T18:16:48.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.069+0000 7fbceb7b8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce406c2a0 0x7fbce410d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:48.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.069+0000 7fbceb7b8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbce406cbb0 0x7fbce410da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:48.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.069+0000 7fbceb7b8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce410dfd0 con 0x7fbce406c2a0 2023-01-04T18:16:48.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.069+0000 7fbceb7b8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce410e110 con 0x7fbce406cbb0 2023-01-04T18:16:48.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.070+0000 7fbce9554700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce406c2a0 0x7fbce410d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:48.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.070+0000 7fbce9554700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce406c2a0 0x7fbce410d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49570/0 (socket says 172.21.15.50:49570) 2023-01-04T18:16:48.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.070+0000 7fbce9554700 1 -- 172.21.15.50:0/2851117941 learned_addr learned my addr 172.21.15.50:0/2851117941 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:16:48.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.070+0000 7fbce8d53700 1 --2- 172.21.15.50:0/2851117941 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbce406cbb0 0x7fbce410da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:48.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.070+0000 7fbce9554700 1 -- 172.21.15.50:0/2851117941 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbce406cbb0 msgr2=0x7fbce410da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:48.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.070+0000 7fbce9554700 1 --2- 172.21.15.50:0/2851117941 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbce406cbb0 0x7fbce410da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:48.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.070+0000 7fbce9554700 1 -- 172.21.15.50:0/2851117941 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce0005040 con 0x7fbce406c2a0 2023-01-04T18:16:48.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.071+0000 7fbce9554700 1 --2- 172.21.15.50:0/2851117941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce406c2a0 0x7fbce410d530 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fbcdc00e930 tx=0x7fbcdc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:48.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.071+0000 7fbcd9ffb700 1 -- 172.21.15.50:0/2851117941 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcdc0092e0 con 0x7fbce406c2a0 2023-01-04T18:16:48.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.071+0000 7fbcd9ffb700 1 -- 172.21.15.50:0/2851117941 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbcdc00f040 con 0x7fbce406c2a0 2023-01-04T18:16:48.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.071+0000 7fbcd9ffb700 1 -- 172.21.15.50:0/2851117941 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcdc014880 con 0x7fbce406c2a0 2023-01-04T18:16:48.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.074+0000 7fbceb7b8700 1 -- 172.21.15.50:0/2851117941 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce410eab0 con 0x7fbce406c2a0 2023-01-04T18:16:48.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.075+0000 7fbceb7b8700 1 -- 172.21.15.50:0/2851117941 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce410f040 con 0x7fbce406c2a0 2023-01-04T18:16:48.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.076+0000 7fbceb7b8700 1 -- 172.21.15.50:0/2851117941 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce4045ad0 con 0x7fbce406c2a0 2023-01-04T18:16:48.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.082+0000 7fbcd9ffb700 1 -- 172.21.15.50:0/2851117941 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 23) v1 ==== 74625+0+0 (secure 0 0 0) 0x7fbcdc007620 con 0x7fbce406c2a0 2023-01-04T18:16:48.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.083+0000 7fbcd9ffb700 1 --2- 172.21.15.50:0/2851117941 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fbcd005e870 0x7fbcd0060d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:48.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.083+0000 7fbcd9ffb700 1 -- 172.21.15.50:0/2851117941 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fbcdc079300 con 0x7fbce406c2a0 2023-01-04T18:16:48.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.086+0000 7fbcd9ffb700 1 -- 172.21.15.50:0/2851117941 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161783 (secure 0 0 0) 0x7fbcdc04d550 con 0x7fbce406c2a0 2023-01-04T18:16:48.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.087+0000 7fbce8d53700 1 --2- 172.21.15.50:0/2851117941 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fbcd005e870 0x7fbcd0060d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:48.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.087+0000 7fbce8d53700 1 --2- 172.21.15.50:0/2851117941 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fbcd005e870 0x7fbcd0060d30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fbce0004570 tx=0x7fbce0016040).ready entity=mgr.24455 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:48.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.296+0000 7fbceb7b8700 1 -- 172.21.15.50:0/2851117941 --> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbce410f320 con 0x7fbcd005e870 2023-01-04T18:16:48.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.304+0000 7fbcd9ffb700 1 -- 172.21.15.50:0/2851117941 <== mgr.24455 v2:172.21.15.98:6828/3052541756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fbce410f320 con 0x7fbcd005e870 2023-01-04T18:16:48.307 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-01-04T18:16:48.308 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager.smithi050 smithi050 *:9093,9094 running (5m) 30s ago 6m 18.1M - 0.20.0 0881eb8f169f b5d3e2678a23 2023-01-04T18:16:48.308 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi050 smithi050 running (6m) 30s ago 6m 7037k - 16.2.4 8d91d370c2b8 cfe6f2d72ef5 2023-01-04T18:16:48.308 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi098 smithi098 running (5m) 20s ago 5m 7151k - 16.2.4 8d91d370c2b8 2928008d526c 2023-01-04T18:16:48.308 INFO:teuthology.orchestra.run.smithi050.stdout:grafana.smithi050 smithi050 *:3000 running (5m) 30s ago 6m 36.6M - 6.7.4 557c83e11646 7e5dccbafe78 2023-01-04T18:16:48.308 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.ezoiwl smithi050 running (2m) 30s ago 2m 1861M - 16.2.4 8d91d370c2b8 6c5c5f2be8b9 2023-01-04T18:16:48.309 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.kefmuy smithi050 running (2m) 30s ago 2m 16.5M - 16.2.4 8d91d370c2b8 58cace913b55 2023-01-04T18:16:48.309 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.laynsk smithi098 running (2m) 20s ago 2m 14.2M - 16.2.4 8d91d370c2b8 8ff8af70b989 2023-01-04T18:16:48.309 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.memais smithi098 running (2m) 20s ago 2m 291M - 16.2.4 8d91d370c2b8 d59d9b4dbf7d 2023-01-04T18:16:48.309 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi050.emnywo smithi050 *:9283 running (7m) 30s ago 7m 109M - 16.2.4 8d91d370c2b8 51f88deda58e 2023-01-04T18:16:48.309 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi098.vhfzum smithi098 *:8443,9283 running (47s) 20s ago 5m 426M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 5ec7d7719033 2023-01-04T18:16:48.309 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi050 smithi050 running (7m) 30s ago 7m 107M 2048M 16.2.4 8d91d370c2b8 7ef171ad1e93 2023-01-04T18:16:48.309 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi098 smithi098 running (5m) 20s ago 5m 109M 2048M 16.2.4 8d91d370c2b8 e6b6833279a4 2023-01-04T18:16:48.310 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi050 smithi050 *:9100 running (6m) 30s ago 6m 18.3M - 0.18.1 e5a616e4b9cf 88892b2e5e5a 2023-01-04T18:16:48.310 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi098 smithi098 *:9100 running (5m) 20s ago 5m 18.3M - 0.18.1 e5a616e4b9cf 49bcde8331b6 2023-01-04T18:16:48.310 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (5m) 30s ago 4m 258M 4096M 16.2.4 8d91d370c2b8 b46676195180 2023-01-04T18:16:48.310 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi050 running (4m) 30s ago 4m 283M 4096M 16.2.4 8d91d370c2b8 e4928bcfd146 2023-01-04T18:16:48.310 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi050 running (4m) 30s ago 4m 222M 4096M 16.2.4 8d91d370c2b8 babab394b338 2023-01-04T18:16:48.310 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi098 running (4m) 20s ago 4m 304M 4096M 16.2.4 8d91d370c2b8 b02df8e3cb23 2023-01-04T18:16:48.310 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi098 running (3m) 20s ago 3m 241M 4096M 16.2.4 8d91d370c2b8 92273135ca82 2023-01-04T18:16:48.310 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi098 running (3m) 20s ago 3m 274M 4096M 16.2.4 8d91d370c2b8 366d0bfff809 2023-01-04T18:16:48.310 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus.smithi050 smithi050 *:9095 running (4m) 30s ago 5m 33.2M - 2.18.1 de242295e225 6ff859f5958f 2023-01-04T18:16:48.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.306+0000 7fbceb7b8700 1 -- 172.21.15.50:0/2851117941 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fbcd005e870 msgr2=0x7fbcd0060d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:48.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.306+0000 7fbceb7b8700 1 --2- 172.21.15.50:0/2851117941 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fbcd005e870 0x7fbcd0060d30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fbce0004570 tx=0x7fbce0016040).stop 2023-01-04T18:16:48.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.306+0000 7fbceb7b8700 1 -- 172.21.15.50:0/2851117941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce406c2a0 msgr2=0x7fbce410d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:48.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.306+0000 7fbceb7b8700 1 --2- 172.21.15.50:0/2851117941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce406c2a0 0x7fbce410d530 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fbcdc00e930 tx=0x7fbcdc00b040).stop 2023-01-04T18:16:48.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.306+0000 7fbceb7b8700 1 -- 172.21.15.50:0/2851117941 shutdown_connections 2023-01-04T18:16:48.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.306+0000 7fbceb7b8700 1 --2- 172.21.15.50:0/2851117941 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fbcd005e870 0x7fbcd0060d30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:48.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.306+0000 7fbceb7b8700 1 --2- 172.21.15.50:0/2851117941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce406c2a0 0x7fbce410d530 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:48.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.306+0000 7fbceb7b8700 1 --2- 172.21.15.50:0/2851117941 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbce406cbb0 0x7fbce410da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:48.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.306+0000 7fbceb7b8700 1 -- 172.21.15.50:0/2851117941 >> 172.21.15.50:0/2851117941 conn(0x7fbce40f40e0 msgr2=0x7fbce4103520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:48.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.307+0000 7fbceb7b8700 1 -- 172.21.15.50:0/2851117941 shutdown_connections 2023-01-04T18:16:48.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.307+0000 7fbceb7b8700 1 -- 172.21.15.50:0/2851117941 wait complete. 2023-01-04T18:16:48.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.450+0000 7fe0eab83700 1 -- 172.21.15.50:0/310360085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0e40f66e0 msgr2=0x7fe0e40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:48.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.450+0000 7fe0eab83700 1 --2- 172.21.15.50:0/310360085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0e40f66e0 0x7fe0e40f6b00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fe0d8004660 tx=0x7fe0d8009b30).stop 2023-01-04T18:16:48.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.450+0000 7fe0eab83700 1 -- 172.21.15.50:0/310360085 shutdown_connections 2023-01-04T18:16:48.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.450+0000 7fe0eab83700 1 --2- 172.21.15.50:0/310360085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0e40f7980 0x7fe0e40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:48.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.450+0000 7fe0eab83700 1 --2- 172.21.15.50:0/310360085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0e40f66e0 0x7fe0e40f6b00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:48.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.450+0000 7fe0eab83700 1 -- 172.21.15.50:0/310360085 >> 172.21.15.50:0/310360085 conn(0x7fe0e40f1e40 msgr2=0x7fe0e40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:48.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.450+0000 7fe0eab83700 1 -- 172.21.15.50:0/310360085 shutdown_connections 2023-01-04T18:16:48.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.450+0000 7fe0eab83700 1 -- 172.21.15.50:0/310360085 wait complete. 2023-01-04T18:16:48.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.451+0000 7fe0eab83700 1 Processor -- start 2023-01-04T18:16:48.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.451+0000 7fe0eab83700 1 -- start start 2023-01-04T18:16:48.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.451+0000 7fe0eab83700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0e40f66e0 0x7fe0e4106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:48.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.452+0000 7fe0eab83700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0e40f7980 0x7fe0e41074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:48.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.452+0000 7fe0eab83700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4107a70 con 0x7fe0e40f66e0 2023-01-04T18:16:48.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.452+0000 7fe0eab83700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4107bb0 con 0x7fe0e40f7980 2023-01-04T18:16:48.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.452+0000 7fe0e891f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0e40f66e0 0x7fe0e4106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:48.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.452+0000 7fe0e891f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0e40f66e0 0x7fe0e4106fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49584/0 (socket says 172.21.15.50:49584) 2023-01-04T18:16:48.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.452+0000 7fe0e891f700 1 -- 172.21.15.50:0/2625202132 learned_addr learned my addr 172.21.15.50:0/2625202132 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:16:48.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.452+0000 7fe0e3fff700 1 --2- 172.21.15.50:0/2625202132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0e40f7980 0x7fe0e41074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:48.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.452+0000 7fe0e891f700 1 -- 172.21.15.50:0/2625202132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0e40f7980 msgr2=0x7fe0e41074c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:48.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.452+0000 7fe0e891f700 1 --2- 172.21.15.50:0/2625202132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0e40f7980 0x7fe0e41074c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:48.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.452+0000 7fe0e891f700 1 -- 172.21.15.50:0/2625202132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d8005040 con 0x7fe0e40f66e0 2023-01-04T18:16:48.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.452+0000 7fe0e891f700 1 --2- 172.21.15.50:0/2625202132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0e40f66e0 0x7fe0e4106fd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fe0d8004e30 tx=0x7fe0d8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:48.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.452+0000 7fe0e17fa700 1 -- 172.21.15.50:0/2625202132 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0d8018070 con 0x7fe0e40f66e0 2023-01-04T18:16:48.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.453+0000 7fe0eab83700 1 -- 172.21.15.50:0/2625202132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e41084f0 con 0x7fe0e40f66e0 2023-01-04T18:16:48.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.453+0000 7fe0eab83700 1 -- 172.21.15.50:0/2625202132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e41089d0 con 0x7fe0e40f66e0 2023-01-04T18:16:48.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.453+0000 7fe0e17fa700 1 -- 172.21.15.50:0/2625202132 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe0d8009630 con 0x7fe0e40f66e0 2023-01-04T18:16:48.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.453+0000 7fe0e17fa700 1 -- 172.21.15.50:0/2625202132 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0d801c3c0 con 0x7fe0e40f66e0 2023-01-04T18:16:48.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.454+0000 7fe0eab83700 1 -- 172.21.15.50:0/2625202132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c4004fa0 con 0x7fe0e40f66e0 2023-01-04T18:16:48.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.455+0000 7fe0e17fa700 1 -- 172.21.15.50:0/2625202132 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 23) v1 ==== 74625+0+0 (secure 0 0 0) 0x7fe0d801d420 con 0x7fe0e40f66e0 2023-01-04T18:16:48.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.455+0000 7fe0e17fa700 1 --2- 172.21.15.50:0/2625202132 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fe0d405e7c0 0x7fe0d4060c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:48.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.455+0000 7fe0e17fa700 1 -- 172.21.15.50:0/2625202132 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fe0d807a930 con 0x7fe0e40f66e0 2023-01-04T18:16:48.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.455+0000 7fe0e3fff700 1 --2- 172.21.15.50:0/2625202132 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fe0d405e7c0 0x7fe0d4060c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:48.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.456+0000 7fe0e3fff700 1 --2- 172.21.15.50:0/2625202132 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fe0d405e7c0 0x7fe0d4060c80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe0d0004c40 tx=0x7fe0d000b040).ready entity=mgr.24455 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.459+0000 7fe0e17fa700 1 -- 172.21.15.50:0/2625202132 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161783 (secure 0 0 0) 0x7fe0d804ead0 con 0x7fe0e40f66e0 2023-01-04T18:16:48.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.764+0000 7fe0eab83700 1 -- 172.21.15.50:0/2625202132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe0c4005e80 con 0x7fe0e40f66e0 2023-01-04T18:16:48.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.764+0000 7fe0e17fa700 1 -- 172.21.15.50:0/2625202132 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+793 (secure 0 0 0) 0x7fe0d804e6c0 con 0x7fe0e40f66e0 2023-01-04T18:16:48.768 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:16:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": { 2023-01-04T18:16:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-01-04T18:16:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:16:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": { 2023-01-04T18:16:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 1, 2023-01-04T18:16:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 1 2023-01-04T18:16:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:16:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": { 2023-01-04T18:16:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2023-01-04T18:16:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:16:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2023-01-04T18:16:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-01-04T18:16:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:16:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "overall": { 2023-01-04T18:16:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 1, 2023-01-04T18:16:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 13 2023-01-04T18:16:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-01-04T18:16:48.769 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:16:48.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.767+0000 7fe0eab83700 1 -- 172.21.15.50:0/2625202132 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fe0d405e7c0 msgr2=0x7fe0d4060c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:48.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.767+0000 7fe0eab83700 1 --2- 172.21.15.50:0/2625202132 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fe0d405e7c0 0x7fe0d4060c80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe0d0004c40 tx=0x7fe0d000b040).stop 2023-01-04T18:16:48.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.767+0000 7fe0eab83700 1 -- 172.21.15.50:0/2625202132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0e40f66e0 msgr2=0x7fe0e4106fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:48.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.767+0000 7fe0eab83700 1 --2- 172.21.15.50:0/2625202132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0e40f66e0 0x7fe0e4106fd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fe0d8004e30 tx=0x7fe0d8009b30).stop 2023-01-04T18:16:48.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.767+0000 7fe0eab83700 1 -- 172.21.15.50:0/2625202132 shutdown_connections 2023-01-04T18:16:48.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.767+0000 7fe0eab83700 1 --2- 172.21.15.50:0/2625202132 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fe0d405e7c0 0x7fe0d4060c80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:48.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.767+0000 7fe0eab83700 1 --2- 172.21.15.50:0/2625202132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0e40f66e0 0x7fe0e4106fd0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:48.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.767+0000 7fe0eab83700 1 --2- 172.21.15.50:0/2625202132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0e40f7980 0x7fe0e41074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:48.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.767+0000 7fe0eab83700 1 -- 172.21.15.50:0/2625202132 >> 172.21.15.50:0/2625202132 conn(0x7fe0e40f1e40 msgr2=0x7fe0e40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:48.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.768+0000 7fe0eab83700 1 -- 172.21.15.50:0/2625202132 shutdown_connections 2023-01-04T18:16:48.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.768+0000 7fe0eab83700 1 -- 172.21.15.50:0/2625202132 wait complete. 2023-01-04T18:16:48.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.885+0000 7f445f59e700 1 -- 172.21.15.50:0/4021462971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44600602d0 msgr2=0x7f44600f9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.885+0000 7f445f59e700 1 --2- 172.21.15.50:0/4021462971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44600602d0 0x7f44600f9160 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f4450004660 tx=0x7f4450009b30).stop 2023-01-04T18:16:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.885+0000 7f445f59e700 1 -- 172.21.15.50:0/4021462971 shutdown_connections 2023-01-04T18:16:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.885+0000 7f445f59e700 1 --2- 172.21.15.50:0/4021462971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44600f96e0 0x7f44600fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.885+0000 7f445f59e700 1 --2- 172.21.15.50:0/4021462971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44600602d0 0x7f44600f9160 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.885+0000 7f445f59e700 1 -- 172.21.15.50:0/4021462971 >> 172.21.15.50:0/4021462971 conn(0x7f44600f0ba0 msgr2=0x7f44600f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.885+0000 7f445f59e700 1 -- 172.21.15.50:0/4021462971 shutdown_connections 2023-01-04T18:16:48.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.885+0000 7f445f59e700 1 -- 172.21.15.50:0/4021462971 wait complete. 2023-01-04T18:16:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.886+0000 7f445f59e700 1 Processor -- start 2023-01-04T18:16:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.886+0000 7f445f59e700 1 -- start start 2023-01-04T18:16:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.886+0000 7f445f59e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44600602d0 0x7f44600f6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.886+0000 7f445f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44600f96e0 0x7f44600f5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.886+0000 7f445f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44600f55c0 con 0x7f44600f96e0 2023-01-04T18:16:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.886+0000 7f445f59e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44600f5700 con 0x7f44600602d0 2023-01-04T18:16:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.886+0000 7f445dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44600f96e0 0x7f44600f5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:48.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.886+0000 7f445dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44600f96e0 0x7f44600f5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49598/0 (socket says 172.21.15.50:49598) 2023-01-04T18:16:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.886+0000 7f445dd9b700 1 -- 172.21.15.50:0/3406321436 learned_addr learned my addr 172.21.15.50:0/3406321436 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:16:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.886+0000 7f445e59c700 1 --2- 172.21.15.50:0/3406321436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44600602d0 0x7f44600f6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.886+0000 7f445dd9b700 1 -- 172.21.15.50:0/3406321436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44600602d0 msgr2=0x7f44600f6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.886+0000 7f445dd9b700 1 --2- 172.21.15.50:0/3406321436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44600602d0 0x7f44600f6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.886+0000 7f445dd9b700 1 -- 172.21.15.50:0/3406321436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4450005040 con 0x7f44600f96e0 2023-01-04T18:16:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.887+0000 7f445dd9b700 1 --2- 172.21.15.50:0/3406321436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44600f96e0 0x7f44600f5060 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f445400e7c0 tx=0x7f445400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.887+0000 7f444effd700 1 -- 172.21.15.50:0/3406321436 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44540092e0 con 0x7f44600f96e0 2023-01-04T18:16:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.887+0000 7f444effd700 1 -- 172.21.15.50:0/3406321436 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f445400f040 con 0x7f44600f96e0 2023-01-04T18:16:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.887+0000 7f445f59e700 1 -- 172.21.15.50:0/3406321436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44600f59e0 con 0x7f44600f96e0 2023-01-04T18:16:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.887+0000 7f444effd700 1 -- 172.21.15.50:0/3406321436 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44540147e0 con 0x7f44600f96e0 2023-01-04T18:16:48.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.887+0000 7f445f59e700 1 -- 172.21.15.50:0/3406321436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446010ed40 con 0x7f44600f96e0 2023-01-04T18:16:48.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.888+0000 7f445f59e700 1 -- 172.21.15.50:0/3406321436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4460059100 con 0x7f44600f96e0 2023-01-04T18:16:48.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.888+0000 7f444effd700 1 -- 172.21.15.50:0/3406321436 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 23) v1 ==== 74625+0+0 (secure 0 0 0) 0x7f4454014a10 con 0x7f44600f96e0 2023-01-04T18:16:48.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.889+0000 7f444effd700 1 --2- 172.21.15.50:0/3406321436 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f444805e810 0x7f4448060cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:48.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.889+0000 7f444effd700 1 -- 172.21.15.50:0/3406321436 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f4454079030 con 0x7f44600f96e0 2023-01-04T18:16:48.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.889+0000 7f445e59c700 1 --2- 172.21.15.50:0/3406321436 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f444805e810 0x7f4448060cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:48.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.890+0000 7f445e59c700 1 --2- 172.21.15.50:0/3406321436 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f444805e810 0x7f4448060cd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4450009720 tx=0x7f4450016040).ready entity=mgr.24455 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:48.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:48.893+0000 7f444effd700 1 -- 172.21.15.50:0/3406321436 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161783 (secure 0 0 0) 0x7f4454049720 con 0x7f44600f96e0 2023-01-04T18:16:49.241 INFO:teuthology.orchestra.run.smithi050.stdout:e13 2023-01-04T18:16:49.241 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:16:49.241 INFO:teuthology.orchestra.run.smithi050.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:16:49.241 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-01-04T18:16:49.241 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:16:49.241 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-01-04T18:16:49.242 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-01-04T18:16:49.242 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 10 2023-01-04T18:16:49.242 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 2023-01-04T18:16:49.242 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:16:49.242 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-01-04T18:14:43.958806+0000 2023-01-04T18:16:49.242 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-01-04T18:16:49.242 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-01-04T18:16:49.242 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 60 2023-01-04T18:16:49.242 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-01-04T18:16:49.242 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-01-04T18:16:49.242 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-01-04T18:16:49.242 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-01-04T18:16:49.243 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 0 2023-01-04T18:16:49.243 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:16:49.243 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 1 2023-01-04T18:16:49.243 INFO:teuthology.orchestra.run.smithi050.stdout:in 0 2023-01-04T18:16:49.243 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=14430} 2023-01-04T18:16:49.243 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-01-04T18:16:49.243 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-01-04T18:16:49.243 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-01-04T18:16:49.243 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-01-04T18:16:49.243 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-01-04T18:16:49.243 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data enabled 2023-01-04T18:16:49.244 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-01-04T18:16:49.244 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 1 2023-01-04T18:16:49.244 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.ezoiwl{0:14430} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541]] 2023-01-04T18:16:49.244 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.memais{0:24291} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.98:6824/1196398070,v1:172.21.15.98:6825/1196398070]] 2023-01-04T18:16:49.244 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:16:49.244 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:16:49.244 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2023-01-04T18:16:49.244 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:16:49.244 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.kefmuy{-1:14440} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592]] 2023-01-04T18:16:49.244 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.laynsk{-1:24297} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263]] 2023-01-04T18:16:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.199+0000 7f445f59e700 1 -- 172.21.15.50:0/3406321436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f44600fecf0 con 0x7f44600f96e0 2023-01-04T18:16:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.200+0000 7f444effd700 1 -- 172.21.15.50:0/3406321436 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1669 (secure 0 0 0) 0x7f445404cd40 con 0x7f44600f96e0 2023-01-04T18:16:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.201+0000 7f445f59e700 1 -- 172.21.15.50:0/3406321436 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f444805e810 msgr2=0x7f4448060cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.202+0000 7f445f59e700 1 --2- 172.21.15.50:0/3406321436 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f444805e810 0x7f4448060cd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4450009720 tx=0x7f4450016040).stop 2023-01-04T18:16:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.202+0000 7f445f59e700 1 -- 172.21.15.50:0/3406321436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44600f96e0 msgr2=0x7f44600f5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.202+0000 7f445f59e700 1 --2- 172.21.15.50:0/3406321436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44600f96e0 0x7f44600f5060 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f445400e7c0 tx=0x7f445400b040).stop 2023-01-04T18:16:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.202+0000 7f445f59e700 1 -- 172.21.15.50:0/3406321436 shutdown_connections 2023-01-04T18:16:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.202+0000 7f445f59e700 1 --2- 172.21.15.50:0/3406321436 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f444805e810 0x7f4448060cd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.202+0000 7f445f59e700 1 --2- 172.21.15.50:0/3406321436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44600602d0 0x7f44600f6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.202+0000 7f445f59e700 1 --2- 172.21.15.50:0/3406321436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44600f96e0 0x7f44600f5060 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:49.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.202+0000 7f445f59e700 1 -- 172.21.15.50:0/3406321436 >> 172.21.15.50:0/3406321436 conn(0x7f44600f0ba0 msgr2=0x7f44600f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:49.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.202+0000 7f445f59e700 1 -- 172.21.15.50:0/3406321436 shutdown_connections 2023-01-04T18:16:49.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.202+0000 7f445f59e700 1 -- 172.21.15.50:0/3406321436 wait complete. 2023-01-04T18:16:49.246 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2023-01-04T18:16:49.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:47.574621+0000 mgr.smithi098.vhfzum (mgr.24455) 27 : audit [DBG] from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:16:49.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:47.910830+0000 mgr.smithi098.vhfzum (mgr.24455) 28 : audit [DBG] from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:16:49.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:47.917134+0000 mgr.smithi098.vhfzum (mgr.24455) 29 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 1.6 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 58 MiB/s rd, 114 MiB/s wr, 246 op/s 2023-01-04T18:16:49.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:48.765932+0000 mon.smithi050 (mon.0) 593 : audit [DBG] from='client.? 172.21.15.50:0/2625202132' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:16:49.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:47.574621+0000 mgr.smithi098.vhfzum (mgr.24455) 27 : audit [DBG] from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:16:49.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:47.910830+0000 mgr.smithi098.vhfzum (mgr.24455) 28 : audit [DBG] from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:16:49.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:47.917134+0000 mgr.smithi098.vhfzum (mgr.24455) 29 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 1.6 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 58 MiB/s rd, 114 MiB/s wr, 246 op/s 2023-01-04T18:16:49.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:48.765932+0000 mon.smithi050 (mon.0) 593 : audit [DBG] from='client.? 172.21.15.50:0/2625202132' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:16:49.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.350+0000 7f09e8d78700 1 -- 172.21.15.50:0/2579856665 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09e40f6870 msgr2=0x7f09e40f6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:49.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.350+0000 7f09e8d78700 1 --2- 172.21.15.50:0/2579856665 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09e40f6870 0x7f09e40f6cd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f09d40045a0 tx=0x7f09d4009b30).stop 2023-01-04T18:16:49.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.350+0000 7f09e8d78700 1 -- 172.21.15.50:0/2579856665 shutdown_connections 2023-01-04T18:16:49.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.350+0000 7f09e8d78700 1 --2- 172.21.15.50:0/2579856665 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09e40f6870 0x7f09e40f6cd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:49.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.350+0000 7f09e8d78700 1 --2- 172.21.15.50:0/2579856665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09e40f55d0 0x7f09e40f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:49.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.350+0000 7f09e8d78700 1 -- 172.21.15.50:0/2579856665 >> 172.21.15.50:0/2579856665 conn(0x7f09e40f0d70 msgr2=0x7f09e40f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:49.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.350+0000 7f09e8d78700 1 -- 172.21.15.50:0/2579856665 shutdown_connections 2023-01-04T18:16:49.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.350+0000 7f09e8d78700 1 -- 172.21.15.50:0/2579856665 wait complete. 2023-01-04T18:16:49.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.351+0000 7f09e8d78700 1 Processor -- start 2023-01-04T18:16:49.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.351+0000 7f09e8d78700 1 -- start start 2023-01-04T18:16:49.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.351+0000 7f09e8d78700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09e40f55d0 0x7f09e4109ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:49.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.351+0000 7f09e8d78700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09e40f6870 0x7f09e410c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:49.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.351+0000 7f09e8d78700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e4060500 con 0x7f09e40f55d0 2023-01-04T18:16:49.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.351+0000 7f09e8d78700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e4060640 con 0x7f09e40f6870 2023-01-04T18:16:49.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.351+0000 7f09e259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09e40f55d0 0x7f09e4109ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:49.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.351+0000 7f09e259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09e40f55d0 0x7f09e4109ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49608/0 (socket says 172.21.15.50:49608) 2023-01-04T18:16:49.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.351+0000 7f09e259c700 1 -- 172.21.15.50:0/2577738801 learned_addr learned my addr 172.21.15.50:0/2577738801 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:16:49.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.351+0000 7f09e1d9b700 1 --2- 172.21.15.50:0/2577738801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09e40f6870 0x7f09e410c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:49.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.351+0000 7f09e259c700 1 -- 172.21.15.50:0/2577738801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09e40f6870 msgr2=0x7f09e410c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:49.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.351+0000 7f09e259c700 1 --2- 172.21.15.50:0/2577738801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09e40f6870 0x7f09e410c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:49.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.351+0000 7f09e259c700 1 -- 172.21.15.50:0/2577738801 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc009640 con 0x7f09e40f55d0 2023-01-04T18:16:49.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.352+0000 7f09e259c700 1 --2- 172.21.15.50:0/2577738801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09e40f55d0 0x7f09e4109ba0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f09dc001c80 tx=0x7f09dc004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:49.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.352+0000 7f09d2ffd700 1 -- 172.21.15.50:0/2577738801 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09dc0092b0 con 0x7f09e40f55d0 2023-01-04T18:16:49.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.352+0000 7f09e8d78700 1 -- 172.21.15.50:0/2577738801 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d4005040 con 0x7f09e40f55d0 2023-01-04T18:16:49.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.352+0000 7f09d2ffd700 1 -- 172.21.15.50:0/2577738801 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f09dc00fe90 con 0x7f09e40f55d0 2023-01-04T18:16:49.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.352+0000 7f09d2ffd700 1 -- 172.21.15.50:0/2577738801 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09dc015420 con 0x7f09e40f55d0 2023-01-04T18:16:49.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.352+0000 7f09e8d78700 1 -- 172.21.15.50:0/2577738801 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e410ca30 con 0x7f09e40f55d0 2023-01-04T18:16:49.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.353+0000 7f09e8d78700 1 -- 172.21.15.50:0/2577738801 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e40f49c0 con 0x7f09e40f55d0 2023-01-04T18:16:49.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.354+0000 7f09d2ffd700 1 -- 172.21.15.50:0/2577738801 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 23) v1 ==== 74625+0+0 (secure 0 0 0) 0x7f09dc00f9d0 con 0x7f09e40f55d0 2023-01-04T18:16:49.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.354+0000 7f09d2ffd700 1 --2- 172.21.15.50:0/2577738801 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f09cc05e7c0 0x7f09cc060c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:16:49.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.355+0000 7f09d2ffd700 1 -- 172.21.15.50:0/2577738801 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f09dc079d70 con 0x7f09e40f55d0 2023-01-04T18:16:49.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.355+0000 7f09e1d9b700 1 --2- 172.21.15.50:0/2577738801 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f09cc05e7c0 0x7f09cc060c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:16:49.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.355+0000 7f09e1d9b700 1 --2- 172.21.15.50:0/2577738801 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f09cc05e7c0 0x7f09cc060c80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f09d4004570 tx=0x7f09d4016040).ready entity=mgr.24455 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:16:49.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.359+0000 7f09d2ffd700 1 -- 172.21.15.50:0/2577738801 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161783 (secure 0 0 0) 0x7f09dc04a460 con 0x7f09e40f55d0 2023-01-04T18:16:49.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.613+0000 7f09e8d78700 1 -- 172.21.15.50:0/2577738801 --> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f09e40fde40 con 0x7f09cc05e7c0 2023-01-04T18:16:49.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.614+0000 7f09d2ffd700 1 -- 172.21.15.50:0/2577738801 <== mgr.24455 v2:172.21.15.98:6828/3052541756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f09e40fde40 con 0x7f09cc05e7c0 2023-01-04T18:16:49.617 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:16:49.617 INFO:teuthology.orchestra.run.smithi050.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308", 2023-01-04T18:16:49.617 INFO:teuthology.orchestra.run.smithi050.stdout: "in_progress": true, 2023-01-04T18:16:49.617 INFO:teuthology.orchestra.run.smithi050.stdout: "which": "Upgrading all daemon types on all hosts", 2023-01-04T18:16:49.617 INFO:teuthology.orchestra.run.smithi050.stdout: "services_complete": [], 2023-01-04T18:16:49.618 INFO:teuthology.orchestra.run.smithi050.stdout: "progress": "1/21 daemons upgraded", 2023-01-04T18:16:49.618 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "", 2023-01-04T18:16:49.618 INFO:teuthology.orchestra.run.smithi050.stdout: "is_paused": false 2023-01-04T18:16:49.618 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:16:49.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.616+0000 7f09e8d78700 1 -- 172.21.15.50:0/2577738801 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f09cc05e7c0 msgr2=0x7f09cc060c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:49.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.616+0000 7f09e8d78700 1 --2- 172.21.15.50:0/2577738801 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f09cc05e7c0 0x7f09cc060c80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f09d4004570 tx=0x7f09d4016040).stop 2023-01-04T18:16:49.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.616+0000 7f09e8d78700 1 -- 172.21.15.50:0/2577738801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09e40f55d0 msgr2=0x7f09e4109ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:16:49.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.616+0000 7f09e8d78700 1 --2- 172.21.15.50:0/2577738801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09e40f55d0 0x7f09e4109ba0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f09dc001c80 tx=0x7f09dc004d10).stop 2023-01-04T18:16:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.616+0000 7f09e8d78700 1 -- 172.21.15.50:0/2577738801 shutdown_connections 2023-01-04T18:16:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.616+0000 7f09e8d78700 1 --2- 172.21.15.50:0/2577738801 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f09cc05e7c0 0x7f09cc060c80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.616+0000 7f09e8d78700 1 --2- 172.21.15.50:0/2577738801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09e40f55d0 0x7f09e4109ba0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.616+0000 7f09e8d78700 1 --2- 172.21.15.50:0/2577738801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09e40f6870 0x7f09e410c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:16:49.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.616+0000 7f09e8d78700 1 -- 172.21.15.50:0/2577738801 >> 172.21.15.50:0/2577738801 conn(0x7f09e40f0d70 msgr2=0x7f09e40fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:16:49.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.616+0000 7f09e8d78700 1 -- 172.21.15.50:0/2577738801 shutdown_connections 2023-01-04T18:16:49.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:16:49.616+0000 7f09e8d78700 1 -- 172.21.15.50:0/2577738801 wait complete. 2023-01-04T18:16:50.062 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-01-04T18:16:50.063 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2023-01-04T18:16:50.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:49 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:48.297082+0000 mgr.smithi098.vhfzum (mgr.24455) 30 : audit [DBG] from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:16:50.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:49 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:49.201496+0000 mon.smithi050 (mon.0) 594 : audit [DBG] from='client.? 172.21.15.50:0/3406321436' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:16:50.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:49 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:48.297082+0000 mgr.smithi098.vhfzum (mgr.24455) 30 : audit [DBG] from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:16:50.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:49 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:49.201496+0000 mon.smithi050 (mon.0) 594 : audit [DBG] from='client.? 172.21.15.50:0/3406321436' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:16:51.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:16:49.615063+0000 mgr.smithi098.vhfzum (mgr.24455) 31 : audit [DBG] from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:16:51.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:49.917549+0000 mgr.smithi098.vhfzum (mgr.24455) 32 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 734 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 58 MiB/s rd, 115 MiB/s wr, 302 op/s 2023-01-04T18:16:51.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:16:49.615063+0000 mgr.smithi098.vhfzum (mgr.24455) 31 : audit [DBG] from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:16:51.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:49.917549+0000 mgr.smithi098.vhfzum (mgr.24455) 32 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 734 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 58 MiB/s rd, 115 MiB/s wr, 302 op/s 2023-01-04T18:16:52.365 INFO:tasks.workunit.client.0.smithi050.stdout:4/3: sync 2023-01-04T18:16:52.366 INFO:tasks.workunit.client.0.smithi050.stdout:8/46: sync 2023-01-04T18:16:52.366 INFO:tasks.workunit.client.0.smithi050.stdout:1/17: sync 2023-01-04T18:16:52.366 INFO:tasks.workunit.client.0.smithi050.stdout:5/138: sync 2023-01-04T18:16:52.366 INFO:tasks.workunit.client.0.smithi050.stdout:1/18: chown c4 7683 1 2023-01-04T18:16:52.366 INFO:tasks.workunit.client.0.smithi050.stdout:3/0: sync 2023-01-04T18:16:52.367 INFO:tasks.workunit.client.0.smithi050.stdout:3/1: rename - no filename 2023-01-04T18:16:52.367 INFO:tasks.workunit.client.0.smithi050.stdout:3/2: dread - no filename 2023-01-04T18:16:52.367 INFO:tasks.workunit.client.0.smithi050.stdout:8/47: write d3/d5/fb [879773,29195] 0 2023-01-04T18:16:52.367 INFO:tasks.workunit.client.0.smithi050.stdout:7/26: sync 2023-01-04T18:16:52.367 INFO:tasks.workunit.client.0.smithi050.stdout:5/139: write d13/d15/d17/d27/f2b [318492,117425] 0 2023-01-04T18:16:52.367 INFO:tasks.workunit.client.0.smithi050.stdout:0/11: sync 2023-01-04T18:16:52.367 INFO:tasks.workunit.client.0.smithi050.stdout:0/12: write - no filename 2023-01-04T18:16:52.367 INFO:tasks.workunit.client.0.smithi050.stdout:9/61: sync 2023-01-04T18:16:52.367 INFO:tasks.workunit.client.0.smithi050.stdout:2/29: sync 2023-01-04T18:16:52.367 INFO:tasks.workunit.client.0.smithi050.stdout:6/57: sync 2023-01-04T18:16:52.367 INFO:tasks.workunit.client.0.smithi050.stdout:6/58: dread - d0/d9/df/f11 zero size 2023-01-04T18:16:52.368 INFO:tasks.workunit.client.0.smithi050.stdout:1/19: truncate f3 2811158 0 2023-01-04T18:16:52.368 INFO:tasks.workunit.client.0.smithi050.stdout:3/3: mkdir d0 0 2023-01-04T18:16:52.368 INFO:tasks.workunit.client.0.smithi050.stdout:3/4: unlink - no file 2023-01-04T18:16:52.370 INFO:tasks.workunit.client.0.smithi050.stdout:8/48: symlink d3/l10 0 2023-01-04T18:16:52.370 INFO:tasks.workunit.client.0.smithi050.stdout:8/49: chown d3/d5/fb 1838222 1 2023-01-04T18:16:52.371 INFO:tasks.workunit.client.0.smithi050.stdout:7/27: getdents . 0 2023-01-04T18:16:52.373 INFO:tasks.workunit.client.0.smithi050.stdout:5/140: creat d13/d15/d17/d27/f2d x:0 0 0 2023-01-04T18:16:52.374 INFO:tasks.workunit.client.0.smithi050.stdout:0/13: getdents d0 0 2023-01-04T18:16:52.374 INFO:tasks.workunit.client.0.smithi050.stdout:0/14: chown d0/l2 43160 1 2023-01-04T18:16:52.374 INFO:tasks.workunit.client.0.smithi050.stdout:0/15: getdents d0 0 2023-01-04T18:16:52.375 INFO:tasks.workunit.client.0.smithi050.stdout:2/30: getdents d1 0 2023-01-04T18:16:52.376 INFO:tasks.workunit.client.0.smithi050.stdout:9/62: mknod d1/ce 0 2023-01-04T18:16:52.376 INFO:tasks.workunit.client.0.smithi050.stdout:9/63: readlink d1/d3/lb 0 2023-01-04T18:16:52.377 INFO:tasks.workunit.client.0.smithi050.stdout:6/59: link d0/d9/fa d0/d9/f12 0 2023-01-04T18:16:52.380 INFO:tasks.workunit.client.0.smithi050.stdout:1/20: creat d8/fa x:0 0 0 2023-01-04T18:16:52.383 INFO:tasks.workunit.client.0.smithi050.stdout:4/4: dwrite f0 [0,4194304] 0 2023-01-04T18:16:52.383 INFO:tasks.workunit.client.0.smithi050.stdout:5/141: dread d13/d15/d17/f1e [0,4194304] 0 2023-01-04T18:16:52.385 INFO:tasks.workunit.client.0.smithi050.stdout:3/5: mknod d0/c1 0 2023-01-04T18:16:52.387 INFO:tasks.workunit.client.0.smithi050.stdout:7/28: unlink c0 0 2023-01-04T18:16:52.388 INFO:tasks.workunit.client.0.smithi050.stdout:0/16: unlink d0/l2 0 2023-01-04T18:16:52.389 INFO:tasks.workunit.client.0.smithi050.stdout:4/5: dread f0 [0,4194304] 0 2023-01-04T18:16:52.390 INFO:tasks.workunit.client.0.smithi050.stdout:2/31: creat d1/f5 x:0 0 0 2023-01-04T18:16:52.391 INFO:tasks.workunit.client.0.smithi050.stdout:9/64: symlink d1/d3/lf 0 2023-01-04T18:16:52.394 INFO:tasks.workunit.client.0.smithi050.stdout:6/60: link d0/d9/f12 d0/d8/f13 0 2023-01-04T18:16:52.394 INFO:tasks.workunit.client.0.smithi050.stdout:1/21: mknod d8/cb 0 2023-01-04T18:16:52.402 INFO:tasks.workunit.client.0.smithi050.stdout:5/142: rename d13/f22 to d13/d15/d17/d1f/d29/f2e 0 2023-01-04T18:16:52.402 INFO:tasks.workunit.client.0.smithi050.stdout:5/143: write d13/d15/d17/d27/f2c [606210,13687] 0 2023-01-04T18:16:52.402 INFO:tasks.workunit.client.0.smithi050.stdout:5/144: truncate d13/d15/d17/d1f/d29/f2e 885984 0 2023-01-04T18:16:52.410 INFO:tasks.workunit.client.0.smithi050.stdout:3/6: mknod d0/c2 0 2023-01-04T18:16:52.411 INFO:tasks.workunit.client.0.smithi050.stdout:6/61: dwrite d0/d9/df/f11 [0,4194304] 0 2023-01-04T18:16:52.411 INFO:tasks.workunit.client.0.smithi050.stdout:8/50: mkdir d3/d5/d11 0 2023-01-04T18:16:52.413 INFO:tasks.workunit.client.0.smithi050.stdout:7/29: symlink l5 0 2023-01-04T18:16:52.417 INFO:tasks.workunit.client.0.smithi050.stdout:4/6: symlink l1 0 2023-01-04T18:16:52.418 INFO:tasks.workunit.client.0.smithi050.stdout:2/32: chown d1/f3 25 1 2023-01-04T18:16:52.422 INFO:tasks.workunit.client.0.smithi050.stdout:9/65: symlink d1/l10 0 2023-01-04T18:16:52.422 INFO:tasks.workunit.client.0.smithi050.stdout:9/66: write d1/fd [859183,31359] 0 2023-01-04T18:16:52.422 INFO:tasks.workunit.client.0.smithi050.stdout:1/22: mknod d8/cc 0 2023-01-04T18:16:52.423 INFO:tasks.workunit.client.0.smithi050.stdout:1/23: readlink - no filename 2023-01-04T18:16:52.427 INFO:tasks.workunit.client.0.smithi050.stdout:5/145: symlink d13/d28/l2f 0 2023-01-04T18:16:52.427 INFO:tasks.workunit.client.0.smithi050.stdout:5/146: read d13/f18 [132384,34345] 0 2023-01-04T18:16:52.427 INFO:tasks.workunit.client.0.smithi050.stdout:5/147: fsync d13/f19 0 2023-01-04T18:16:52.427 INFO:tasks.workunit.client.0.smithi050.stdout:5/148: chown d13/d15/d17 102 1 2023-01-04T18:16:52.428 INFO:tasks.workunit.client.0.smithi050.stdout:3/7: creat d0/f3 x:0 0 0 2023-01-04T18:16:52.435 INFO:tasks.workunit.client.0.smithi050.stdout:6/62: creat d0/f14 x:0 0 0 2023-01-04T18:16:52.435 INFO:tasks.workunit.client.0.smithi050.stdout:6/63: write d0/d8/f13 [333957,78847] 0 2023-01-04T18:16:52.436 INFO:tasks.workunit.client.0.smithi050.stdout:8/51: mkdir d3/dc/d12 0 2023-01-04T18:16:52.439 INFO:tasks.workunit.client.0.smithi050.stdout:0/17: mknod d0/c3 0 2023-01-04T18:16:52.440 INFO:tasks.workunit.client.0.smithi050.stdout:4/7: creat f2 x:0 0 0 2023-01-04T18:16:52.440 INFO:tasks.workunit.client.0.smithi050.stdout:4/8: chown f0 22437 1 2023-01-04T18:16:52.441 INFO:tasks.workunit.client.0.smithi050.stdout:4/9: read - f2 zero size 2023-01-04T18:16:52.441 INFO:tasks.workunit.client.0.smithi050.stdout:4/10: chown f0 150588503 1 2023-01-04T18:16:52.441 INFO:tasks.workunit.client.0.smithi050.stdout:4/11: readlink l1 0 2023-01-04T18:16:52.442 INFO:tasks.workunit.client.0.smithi050.stdout:2/33: getdents d1 0 2023-01-04T18:16:52.442 INFO:tasks.workunit.client.0.smithi050.stdout:2/34: fdatasync d1/f5 0 2023-01-04T18:16:52.442 INFO:tasks.workunit.client.0.smithi050.stdout:2/35: write d1/f5 [883516,52442] 0 2023-01-04T18:16:52.442 INFO:tasks.workunit.client.0.smithi050.stdout:2/36: fsync d1/f3 0 2023-01-04T18:16:52.445 INFO:tasks.workunit.client.0.smithi050.stdout:9/67: mkdir d1/d3/d11 0 2023-01-04T18:16:52.448 INFO:tasks.workunit.client.0.smithi050.stdout:2/37: write d1/f2 [840508,88879] 0 2023-01-04T18:16:52.448 INFO:tasks.workunit.client.0.smithi050.stdout:3/8: dwrite d0/f3 [0,4194304] 0 2023-01-04T18:16:52.449 INFO:tasks.workunit.client.0.smithi050.stdout:3/9: readlink - no filename 2023-01-04T18:16:52.451 INFO:tasks.workunit.client.0.smithi050.stdout:3/10: read d0/f3 [2098486,50775] 0 2023-01-04T18:16:52.451 INFO:tasks.workunit.client.0.smithi050.stdout:1/24: unlink d8/cc 0 2023-01-04T18:16:52.455 INFO:tasks.workunit.client.0.smithi050.stdout:8/52: dwrite d3/d5/fb [0,4194304] 0 2023-01-04T18:16:52.455 INFO:tasks.workunit.client.0.smithi050.stdout:8/53: stat d3/l10 0 2023-01-04T18:16:52.456 INFO:tasks.workunit.client.0.smithi050.stdout:5/149: rename d13/d15/d17/d27/f2d to d13/d15/d17/d1f/f30 0 2023-01-04T18:16:52.457 INFO:tasks.workunit.client.0.smithi050.stdout:3/11: fsync d0/f3 0 2023-01-04T18:16:52.457 INFO:tasks.workunit.client.0.smithi050.stdout:3/12: fsync d0/f3 0 2023-01-04T18:16:52.458 INFO:tasks.workunit.client.0.smithi050.stdout:6/64: unlink d0/c6 0 2023-01-04T18:16:52.461 INFO:tasks.workunit.client.0.smithi050.stdout:0/18: creat d0/f4 x:0 0 0 2023-01-04T18:16:52.461 INFO:tasks.workunit.client.0.smithi050.stdout:0/19: truncate d0/f4 440726 0 2023-01-04T18:16:52.467 INFO:tasks.workunit.client.0.smithi050.stdout:2/38: creat d1/f6 x:0 0 0 2023-01-04T18:16:52.469 INFO:tasks.workunit.client.0.smithi050.stdout:1/25: creat d8/fd x:0 0 0 2023-01-04T18:16:52.472 INFO:tasks.workunit.client.0.smithi050.stdout:3/13: dread d0/f3 [0,4194304] 0 2023-01-04T18:16:52.472 INFO:tasks.workunit.client.0.smithi050.stdout:3/14: chown d0/c2 59165 1 2023-01-04T18:16:52.476 INFO:tasks.workunit.client.0.smithi050.stdout:3/15: dread d0/f3 [0,4194304] 0 2023-01-04T18:16:52.485 INFO:tasks.workunit.client.0.smithi050.stdout:5/150: truncate d13/d15/f26 1096126 0 2023-01-04T18:16:52.485 INFO:tasks.workunit.client.0.smithi050.stdout:2/39: dwrite d1/f5 [0,4194304] 0 2023-01-04T18:16:52.486 INFO:tasks.workunit.client.0.smithi050.stdout:7/30: dwrite f2 [0,4194304] 0 2023-01-04T18:16:52.487 INFO:tasks.workunit.client.0.smithi050.stdout:0/20: creat d0/f5 x:0 0 0 2023-01-04T18:16:52.487 INFO:tasks.workunit.client.0.smithi050.stdout:0/21: write d0/f5 [709898,4536] 0 2023-01-04T18:16:52.490 INFO:tasks.workunit.client.0.smithi050.stdout:4/12: rename f2 to f3 0 2023-01-04T18:16:52.491 INFO:tasks.workunit.client.0.smithi050.stdout:4/13: write f0 [1942740,18369] 0 2023-01-04T18:16:52.491 INFO:tasks.workunit.client.0.smithi050.stdout:8/54: write d3/d5/fb [4742031,65657] 0 2023-01-04T18:16:52.491 INFO:tasks.workunit.client.0.smithi050.stdout:0/22: dread d0/f5 [0,4194304] 0 2023-01-04T18:16:52.492 INFO:tasks.workunit.client.0.smithi050.stdout:0/23: readlink - no filename 2023-01-04T18:16:52.495 INFO:tasks.workunit.client.0.smithi050.stdout:6/65: dread d0/f7 [0,4194304] 0 2023-01-04T18:16:52.497 INFO:tasks.workunit.client.0.smithi050.stdout:1/26: rename f0 to d8/fe 0 2023-01-04T18:16:52.497 INFO:tasks.workunit.client.0.smithi050.stdout:3/16: creat d0/f4 x:0 0 0 2023-01-04T18:16:52.498 INFO:tasks.workunit.client.0.smithi050.stdout:5/151: mkdir d13/d15/d17/d1f/d31 0 2023-01-04T18:16:52.498 INFO:tasks.workunit.client.0.smithi050.stdout:5/152: write d13/d15/d17/d1f/d29/f2e [1299817,71783] 0 2023-01-04T18:16:52.498 INFO:tasks.workunit.client.0.smithi050.stdout:5/153: readlink d13/d15/d17/l24 0 2023-01-04T18:16:52.499 INFO:tasks.workunit.client.0.smithi050.stdout:4/14: dread f0 [0,4194304] 0 2023-01-04T18:16:52.500 INFO:tasks.workunit.client.0.smithi050.stdout:2/40: getdents d1 0 2023-01-04T18:16:52.500 INFO:tasks.workunit.client.0.smithi050.stdout:1/27: dread d8/fe [0,4194304] 0 2023-01-04T18:16:52.500 INFO:tasks.workunit.client.0.smithi050.stdout:1/28: stat c2 0 2023-01-04T18:16:52.503 INFO:tasks.workunit.client.0.smithi050.stdout:5/154: dread d13/f19 [0,4194304] 0 2023-01-04T18:16:52.506 INFO:tasks.workunit.client.0.smithi050.stdout:8/55: chown d3/d5/ca 13 1 2023-01-04T18:16:52.506 INFO:tasks.workunit.client.0.smithi050.stdout:0/24: dwrite d0/f4 [0,4194304] 0 2023-01-04T18:16:52.509 INFO:tasks.workunit.client.0.smithi050.stdout:4/15: creat f4 x:0 0 0 2023-01-04T18:16:52.511 INFO:tasks.workunit.client.0.smithi050.stdout:2/41: creat d1/f7 x:0 0 0 2023-01-04T18:16:52.512 INFO:tasks.workunit.client.0.smithi050.stdout:1/29: mknod d8/cf 0 2023-01-04T18:16:52.520 INFO:tasks.workunit.client.0.smithi050.stdout:2/42: creat d1/f8 x:0 0 0 2023-01-04T18:16:52.520 INFO:tasks.workunit.client.0.smithi050.stdout:2/43: fdatasync d1/f8 0 2023-01-04T18:16:52.523 INFO:tasks.workunit.client.0.smithi050.stdout:1/30: creat d8/f10 x:0 0 0 2023-01-04T18:16:52.524 INFO:tasks.workunit.client.0.smithi050.stdout:1/31: dread - d8/f9 zero size 2023-01-04T18:16:52.524 INFO:tasks.workunit.client.0.smithi050.stdout:1/32: dread - f7 zero size 2023-01-04T18:16:52.524 INFO:tasks.workunit.client.0.smithi050.stdout:0/25: mkdir d0/d6 0 2023-01-04T18:16:52.526 INFO:tasks.workunit.client.0.smithi050.stdout:0/26: dread d0/f5 [0,4194304] 0 2023-01-04T18:16:52.526 INFO:tasks.workunit.client.0.smithi050.stdout:0/27: read d0/f5 [193013,50806] 0 2023-01-04T18:16:52.527 INFO:tasks.workunit.client.0.smithi050.stdout:1/33: creat d8/f11 x:0 0 0 2023-01-04T18:16:52.529 INFO:tasks.workunit.client.0.smithi050.stdout:7/31: truncate f2 2517594 0 2023-01-04T18:16:52.531 INFO:tasks.workunit.client.0.smithi050.stdout:2/44: mkdir d1/d9 0 2023-01-04T18:16:52.532 INFO:tasks.workunit.client.0.smithi050.stdout:0/28: creat d0/f7 x:0 0 0 2023-01-04T18:16:52.532 INFO:tasks.workunit.client.0.smithi050.stdout:0/29: write d0/f5 [978901,8561] 0 2023-01-04T18:16:52.535 INFO:tasks.workunit.client.0.smithi050.stdout:7/32: mkdir d6 0 2023-01-04T18:16:52.536 INFO:tasks.workunit.client.0.smithi050.stdout:2/45: write d1/f6 [553923,7709] 0 2023-01-04T18:16:52.537 INFO:tasks.workunit.client.0.smithi050.stdout:3/17: dwrite d0/f3 [0,4194304] 0 2023-01-04T18:16:52.539 INFO:tasks.workunit.client.0.smithi050.stdout:7/33: creat d6/f7 x:0 0 0 2023-01-04T18:16:52.540 INFO:tasks.workunit.client.0.smithi050.stdout:7/34: dread - d6/f7 zero size 2023-01-04T18:16:52.541 INFO:tasks.workunit.client.0.smithi050.stdout:3/18: symlink d0/l5 0 2023-01-04T18:16:52.544 INFO:tasks.workunit.client.0.smithi050.stdout:7/35: creat d6/f8 x:0 0 0 2023-01-04T18:16:52.544 INFO:tasks.workunit.client.0.smithi050.stdout:7/36: write d6/f8 [659938,80695] 0 2023-01-04T18:16:52.544 INFO:tasks.workunit.client.0.smithi050.stdout:5/155: dwrite d13/f19 [0,4194304] 0 2023-01-04T18:16:52.549 INFO:tasks.workunit.client.0.smithi050.stdout:5/156: symlink d13/d15/d17/d27/l32 0 2023-01-04T18:16:52.559 INFO:tasks.workunit.client.0.smithi050.stdout:5/157: dread d13/d15/d17/f1e [0,4194304] 0 2023-01-04T18:16:52.559 INFO:tasks.workunit.client.0.smithi050.stdout:5/158: chown c12 88 1 2023-01-04T18:16:52.559 INFO:tasks.workunit.client.0.smithi050.stdout:5/159: readlink d13/d15/d17/l24 0 2023-01-04T18:16:52.560 INFO:tasks.workunit.client.0.smithi050.stdout:5/160: mknod d13/d15/d17/d1f/d29/c33 0 2023-01-04T18:16:52.561 INFO:tasks.workunit.client.0.smithi050.stdout:4/16: dwrite f4 [0,4194304] 0 2023-01-04T18:16:52.561 INFO:tasks.workunit.client.0.smithi050.stdout:4/17: stat f0 0 2023-01-04T18:16:52.561 INFO:tasks.workunit.client.0.smithi050.stdout:4/18: fdatasync f0 0 2023-01-04T18:16:52.561 INFO:tasks.workunit.client.0.smithi050.stdout:4/19: write f3 [71684,99899] 0 2023-01-04T18:16:52.570 INFO:tasks.workunit.client.0.smithi050.stdout:1/34: rmdir d8 39 2023-01-04T18:16:52.571 INFO:tasks.workunit.client.0.smithi050.stdout:8/56: dwrite d3/d5/fb [4194304,4194304] 0 2023-01-04T18:16:52.571 INFO:tasks.workunit.client.0.smithi050.stdout:8/57: write d3/fd [223915,23350] 0 2023-01-04T18:16:52.571 INFO:tasks.workunit.client.0.smithi050.stdout:8/58: dread - d3/d5/fe zero size 2023-01-04T18:16:52.572 INFO:tasks.workunit.client.0.smithi050.stdout:0/30: dwrite d0/f4 [0,4194304] 0 2023-01-04T18:16:52.572 INFO:tasks.workunit.client.0.smithi050.stdout:3/19: dwrite d0/f4 [0,4194304] 0 2023-01-04T18:16:52.573 INFO:tasks.workunit.client.0.smithi050.stdout:6/66: dwrite d0/f7 [0,4194304] 0 2023-01-04T18:16:52.573 INFO:tasks.workunit.client.0.smithi050.stdout:4/20: dread f4 [0,4194304] 0 2023-01-04T18:16:52.573 INFO:tasks.workunit.client.0.smithi050.stdout:4/21: truncate f3 478194 0 2023-01-04T18:16:52.573 INFO:tasks.workunit.client.0.smithi050.stdout:4/22: write f0 [3732603,87794] 0 2023-01-04T18:16:52.575 INFO:tasks.workunit.client.0.smithi050.stdout:7/37: dread d6/f8 [0,4194304] 0 2023-01-04T18:16:52.579 INFO:tasks.workunit.client.0.smithi050.stdout:0/31: mkdir d0/d6/d8 0 2023-01-04T18:16:52.579 INFO:tasks.workunit.client.0.smithi050.stdout:0/32: write d0/f4 [4547716,78434] 0 2023-01-04T18:16:52.579 INFO:tasks.workunit.client.0.smithi050.stdout:5/161: dwrite d13/d15/d17/f1b [0,4194304] 0 2023-01-04T18:16:52.580 INFO:tasks.workunit.client.0.smithi050.stdout:5/162: write d13/f18 [389791,99595] 0 2023-01-04T18:16:52.583 INFO:tasks.workunit.client.0.smithi050.stdout:3/20: symlink d0/l6 0 2023-01-04T18:16:52.585 INFO:tasks.workunit.client.0.smithi050.stdout:6/67: creat d0/d8/f15 x:0 0 0 2023-01-04T18:16:52.586 INFO:tasks.workunit.client.0.smithi050.stdout:7/38: dread f2 [0,4194304] 0 2023-01-04T18:16:52.586 INFO:tasks.workunit.client.0.smithi050.stdout:7/39: chown d6 6710017 1 2023-01-04T18:16:52.588 INFO:tasks.workunit.client.0.smithi050.stdout:4/23: creat f5 x:0 0 0 2023-01-04T18:16:52.591 INFO:tasks.workunit.client.0.smithi050.stdout:1/35: dwrite d8/fe [0,4194304] 0 2023-01-04T18:16:52.595 INFO:tasks.workunit.client.0.smithi050.stdout:5/163: creat d13/d15/f34 x:0 0 0 2023-01-04T18:16:52.595 INFO:tasks.workunit.client.0.smithi050.stdout:5/164: chown d13/d15/d17/d27/f2c 191 1 2023-01-04T18:16:52.596 INFO:tasks.workunit.client.0.smithi050.stdout:3/21: mknod d0/c7 0 2023-01-04T18:16:52.596 INFO:tasks.workunit.client.0.smithi050.stdout:3/22: stat d0/c7 0 2023-01-04T18:16:52.597 INFO:tasks.workunit.client.0.smithi050.stdout:4/24: mknod c6 0 2023-01-04T18:16:52.597 INFO:tasks.workunit.client.0.smithi050.stdout:3/23: write d0/f3 [2729217,107857] 0 2023-01-04T18:16:52.601 INFO:tasks.workunit.client.0.smithi050.stdout:1/36: creat d8/f12 x:0 0 0 2023-01-04T18:16:52.604 INFO:tasks.workunit.client.0.smithi050.stdout:5/165: mkdir d13/d15/d17/d1f/d35 0 2023-01-04T18:16:52.604 INFO:tasks.workunit.client.0.smithi050.stdout:5/166: fdatasync d13/d15/d17/f1b 0 2023-01-04T18:16:52.604 INFO:tasks.workunit.client.0.smithi050.stdout:4/25: creat f7 x:0 0 0 2023-01-04T18:16:52.608 INFO:tasks.workunit.client.0.smithi050.stdout:3/24: rename d0/c2 to d0/c8 0 2023-01-04T18:16:52.608 INFO:tasks.workunit.client.0.smithi050.stdout:1/37: creat d8/f13 x:0 0 0 2023-01-04T18:16:52.609 INFO:tasks.workunit.client.0.smithi050.stdout:3/25: mkdir d0/d9 0 2023-01-04T18:16:52.610 INFO:tasks.workunit.client.0.smithi050.stdout:3/26: stat d0/l5 0 2023-01-04T18:16:52.610 INFO:tasks.workunit.client.0.smithi050.stdout:1/38: mkdir d8/d14 0 2023-01-04T18:16:52.612 INFO:tasks.workunit.client.0.smithi050.stdout:1/39: creat d8/f15 x:0 0 0 2023-01-04T18:16:52.612 INFO:tasks.workunit.client.0.smithi050.stdout:1/40: dread - d8/fa zero size 2023-01-04T18:16:52.612 INFO:tasks.workunit.client.0.smithi050.stdout:1/41: truncate d8/f15 1020780 0 2023-01-04T18:16:52.612 INFO:tasks.workunit.client.0.smithi050.stdout:1/42: write f1 [369713,13172] 0 2023-01-04T18:16:52.612 INFO:tasks.workunit.client.0.smithi050.stdout:1/43: chown d8/fa 14630201 1 2023-01-04T18:16:52.613 INFO:tasks.workunit.client.0.smithi050.stdout:1/44: chown c4 11128 1 2023-01-04T18:16:52.627 INFO:tasks.workunit.client.0.smithi050.stdout:5/167: dwrite d13/f18 [0,4194304] 0 2023-01-04T18:16:52.629 INFO:tasks.workunit.client.0.smithi050.stdout:5/168: creat d13/d28/f36 x:0 0 0 2023-01-04T18:16:52.629 INFO:tasks.workunit.client.0.smithi050.stdout:5/169: read d13/f18 [1031115,84542] 0 2023-01-04T18:16:52.630 INFO:tasks.workunit.client.0.smithi050.stdout:5/170: creat d13/d15/d17/d1f/d29/f37 x:0 0 0 2023-01-04T18:16:52.644 INFO:tasks.workunit.client.0.smithi050.stdout:1/45: dwrite d8/fe [0,4194304] 0 2023-01-04T18:16:52.727 INFO:tasks.workunit.client.0.smithi050.stdout:5/171: write d13/d15/d17/d27/f2c [342856,29672] 0 2023-01-04T18:16:52.728 INFO:tasks.workunit.client.0.smithi050.stdout:5/172: mknod d13/d15/d17/c38 0 2023-01-04T18:16:52.729 INFO:tasks.workunit.client.0.smithi050.stdout:5/173: truncate d13/f14 2889380 0 2023-01-04T18:16:52.732 INFO:tasks.workunit.client.0.smithi050.stdout:4/26: write f0 [1947203,118018] 0 2023-01-04T18:16:52.735 INFO:tasks.workunit.client.0.smithi050.stdout:0/33: dread d0/f4 [0,4194304] 0 2023-01-04T18:16:52.735 INFO:tasks.workunit.client.0.smithi050.stdout:3/27: dwrite d0/f4 [0,4194304] 0 2023-01-04T18:16:52.740 INFO:tasks.workunit.client.0.smithi050.stdout:0/34: dread d0/f4 [0,4194304] 0 2023-01-04T18:16:52.743 INFO:tasks.workunit.client.0.smithi050.stdout:6/68: dwrite d0/d8/f15 [0,4194304] 0 2023-01-04T18:16:52.756 INFO:tasks.workunit.client.0.smithi050.stdout:3/28: dwrite d0/f3 [0,4194304] 0 2023-01-04T18:16:52.767 INFO:tasks.workunit.client.0.smithi050.stdout:6/69: dwrite d0/d8/fd [4194304,4194304] 0 2023-01-04T18:16:52.776 INFO:tasks.workunit.client.0.smithi050.stdout:8/59: truncate d3/d5/fb 3221250 0 2023-01-04T18:16:52.849 INFO:tasks.workunit.client.0.smithi050.stdout:4/27: mknod c8 0 2023-01-04T18:16:52.869 INFO:tasks.workunit.client.0.smithi050.stdout:5/174: dwrite d13/d15/f26 [0,4194304] 0 2023-01-04T18:16:52.869 INFO:tasks.workunit.client.0.smithi050.stdout:5/175: chown d13/d15/d17/d27/l32 6 1 2023-01-04T18:16:52.870 INFO:tasks.workunit.client.0.smithi050.stdout:3/29: symlink d0/la 0 2023-01-04T18:16:52.875 INFO:tasks.workunit.client.0.smithi050.stdout:6/70: mkdir d0/d8/d16 0 2023-01-04T18:16:52.876 INFO:tasks.workunit.client.0.smithi050.stdout:6/71: write d0/f7 [1231662,116099] 0 2023-01-04T18:16:52.878 INFO:tasks.workunit.client.0.smithi050.stdout:4/28: creat f9 x:0 0 0 2023-01-04T18:16:52.878 INFO:tasks.workunit.client.0.smithi050.stdout:4/29: stat f0 0 2023-01-04T18:16:52.880 INFO:tasks.workunit.client.0.smithi050.stdout:0/35: mknod d0/c9 0 2023-01-04T18:16:52.880 INFO:tasks.workunit.client.0.smithi050.stdout:0/36: write d0/f5 [1957751,122532] 0 2023-01-04T18:16:52.881 INFO:tasks.workunit.client.0.smithi050.stdout:0/37: chown d0/f5 190724756 1 2023-01-04T18:16:52.884 INFO:tasks.workunit.client.0.smithi050.stdout:5/176: symlink d13/l39 0 2023-01-04T18:16:52.885 INFO:tasks.workunit.client.0.smithi050.stdout:3/30: creat d0/fb x:0 0 0 2023-01-04T18:16:52.889 INFO:tasks.workunit.client.0.smithi050.stdout:6/72: creat d0/d9/f17 x:0 0 0 2023-01-04T18:16:52.889 INFO:tasks.workunit.client.0.smithi050.stdout:6/73: fsync d0/d8/f15 0 2023-01-04T18:16:52.890 INFO:tasks.workunit.client.0.smithi050.stdout:6/74: read d0/f7 [4151136,99185] 0 2023-01-04T18:16:52.890 INFO:tasks.workunit.client.0.smithi050.stdout:6/75: stat d0/d8/f13 0 2023-01-04T18:16:52.891 INFO:tasks.workunit.client.0.smithi050.stdout:4/30: symlink la 0 2023-01-04T18:16:52.892 INFO:tasks.workunit.client.0.smithi050.stdout:5/177: creat d13/d15/d17/d1f/d35/f3a x:0 0 0 2023-01-04T18:16:52.892 INFO:tasks.workunit.client.0.smithi050.stdout:5/178: readlink d13/d15/l1a 0 2023-01-04T18:16:52.892 INFO:tasks.workunit.client.0.smithi050.stdout:5/179: chown d13/d15/l1a 1164 1 2023-01-04T18:16:52.894 INFO:tasks.workunit.client.0.smithi050.stdout:3/31: rename d0/l5 to d0/lc 0 2023-01-04T18:16:52.894 INFO:tasks.workunit.client.0.smithi050.stdout:6/76: mknod d0/d9/df/c18 0 2023-01-04T18:16:52.903 INFO:tasks.workunit.client.0.smithi050.stdout:0/38: dwrite d0/f7 [0,4194304] 0 2023-01-04T18:16:52.909 INFO:tasks.workunit.client.0.smithi050.stdout:0/39: dread d0/f7 [0,4194304] 0 2023-01-04T18:16:52.909 INFO:tasks.workunit.client.0.smithi050.stdout:0/40: chown d0/f7 26846 1 2023-01-04T18:16:52.919 INFO:tasks.workunit.client.0.smithi050.stdout:5/180: rmdir d13/d15/d17/d1f/d31 0 2023-01-04T18:16:52.920 INFO:tasks.workunit.client.0.smithi050.stdout:3/32: mkdir d0/dd 0 2023-01-04T18:16:52.921 INFO:tasks.workunit.client.0.smithi050.stdout:6/77: mknod d0/d9/df/c19 0 2023-01-04T18:16:52.921 INFO:tasks.workunit.client.0.smithi050.stdout:6/78: truncate d0/d9/f17 509520 0 2023-01-04T18:16:52.926 INFO:tasks.workunit.client.0.smithi050.stdout:5/181: creat d13/f3b x:0 0 0 2023-01-04T18:16:52.927 INFO:tasks.workunit.client.0.smithi050.stdout:3/33: truncate d0/f4 2818788 0 2023-01-04T18:16:52.929 INFO:tasks.workunit.client.0.smithi050.stdout:6/79: rename d0/c5 to d0/c1a 0 2023-01-04T18:16:52.931 INFO:tasks.workunit.client.0.smithi050.stdout:6/80: dread d0/d9/fa [0,4194304] 0 2023-01-04T18:16:52.933 INFO:tasks.workunit.client.0.smithi050.stdout:6/81: mknod d0/c1b 0 2023-01-04T18:16:52.933 INFO:tasks.workunit.client.0.smithi050.stdout:5/182: getdents d13/d15/d17/d1f/d35 0 2023-01-04T18:16:52.934 INFO:tasks.workunit.client.0.smithi050.stdout:5/183: fdatasync d13/d15/d17/d27/f2b 0 2023-01-04T18:16:52.935 INFO:tasks.workunit.client.0.smithi050.stdout:6/82: mkdir d0/d8/d1c 0 2023-01-04T18:16:52.936 INFO:tasks.workunit.client.0.smithi050.stdout:6/83: chown d0/d9/cb 584491799 1 2023-01-04T18:16:52.936 INFO:tasks.workunit.client.0.smithi050.stdout:6/84: write d0/d9/f17 [1222451,48800] 0 2023-01-04T18:16:52.937 INFO:tasks.workunit.client.0.smithi050.stdout:5/184: creat d13/d15/d17/d1f/d29/f3c x:0 0 0 2023-01-04T18:16:52.937 INFO:tasks.workunit.client.0.smithi050.stdout:5/185: readlink l9 0 2023-01-04T18:16:52.937 INFO:tasks.workunit.client.0.smithi050.stdout:5/186: readlink d13/d15/l21 0 2023-01-04T18:16:52.938 INFO:tasks.workunit.client.0.smithi050.stdout:5/187: write d13/d15/d17/d27/f2c [564733,48703] 0 2023-01-04T18:16:52.938 INFO:tasks.workunit.client.0.smithi050.stdout:5/188: readlink d13/d28/l2f 0 2023-01-04T18:16:52.938 INFO:tasks.workunit.client.0.smithi050.stdout:6/85: symlink d0/d8/d16/l1d 0 2023-01-04T18:16:52.939 INFO:tasks.workunit.client.0.smithi050.stdout:6/86: fdatasync d0/d8/fd 0 2023-01-04T18:16:52.940 INFO:tasks.workunit.client.0.smithi050.stdout:0/41: truncate d0/f7 3948240 0 2023-01-04T18:16:52.947 INFO:tasks.workunit.client.0.smithi050.stdout:5/189: link d13/d15/d17/d27/l32 d13/d28/l3d 0 2023-01-04T18:16:52.956 INFO:tasks.workunit.client.0.smithi050.stdout:0/42: rename d0/f7 to d0/d6/fa 0 2023-01-04T18:16:52.960 INFO:tasks.workunit.client.0.smithi050.stdout:0/43: dread d0/d6/fa [0,4194304] 0 2023-01-04T18:16:52.964 INFO:tasks.workunit.client.0.smithi050.stdout:5/190: dread d13/f14 [0,4194304] 0 2023-01-04T18:16:52.964 INFO:tasks.workunit.client.0.smithi050.stdout:6/87: dwrite d0/d9/fa [0,4194304] 0 2023-01-04T18:16:52.965 INFO:tasks.workunit.client.0.smithi050.stdout:3/34: dwrite d0/f4 [0,4194304] 0 2023-01-04T18:16:52.966 INFO:tasks.workunit.client.0.smithi050.stdout:5/191: getdents d13/d15/d17/d1f/d29 0 2023-01-04T18:16:52.966 INFO:tasks.workunit.client.0.smithi050.stdout:5/192: read d13/d15/d17/d27/f2c [36766,64699] 0 2023-01-04T18:16:52.967 INFO:tasks.workunit.client.0.smithi050.stdout:5/193: write d13/d15/f26 [4488021,39061] 0 2023-01-04T18:16:52.967 INFO:tasks.workunit.client.0.smithi050.stdout:5/194: write d13/d15/f34 [229592,112662] 0 2023-01-04T18:16:52.967 INFO:tasks.workunit.client.0.smithi050.stdout:5/195: write d13/d15/d17/d27/f2c [407695,33692] 0 2023-01-04T18:16:52.968 INFO:tasks.workunit.client.0.smithi050.stdout:5/196: dread - d13/d28/f36 zero size 2023-01-04T18:16:52.968 INFO:tasks.workunit.client.0.smithi050.stdout:5/197: read - d13/d15/d17/d1f/d29/f37 zero size 2023-01-04T18:16:52.969 INFO:tasks.workunit.client.0.smithi050.stdout:0/44: getdents d0/d6 0 2023-01-04T18:16:52.974 INFO:tasks.workunit.client.0.smithi050.stdout:6/88: truncate d0/f7 1741767 0 2023-01-04T18:16:52.976 INFO:tasks.workunit.client.0.smithi050.stdout:3/35: creat d0/fe x:0 0 0 2023-01-04T18:16:52.976 INFO:tasks.workunit.client.0.smithi050.stdout:3/36: chown d0/lc 968940 1 2023-01-04T18:16:52.976 INFO:tasks.workunit.client.0.smithi050.stdout:3/37: write d0/fb [680063,91511] 0 2023-01-04T18:16:52.979 INFO:tasks.workunit.client.0.smithi050.stdout:5/198: rename d13/d15/d17/f1e to d13/d28/f3e 0 2023-01-04T18:16:52.979 INFO:tasks.workunit.client.0.smithi050.stdout:5/199: write d13/d15/d17/d1f/d29/f37 [403812,123795] 0 2023-01-04T18:16:52.989 INFO:tasks.workunit.client.0.smithi050.stdout:0/45: link d0/f4 d0/d6/fb 0 2023-01-04T18:16:52.991 INFO:tasks.workunit.client.0.smithi050.stdout:6/89: rename d0/d9/df/c18 to d0/d8/c1e 0 2023-01-04T18:16:52.992 INFO:tasks.workunit.client.0.smithi050.stdout:5/200: creat d13/d15/d17/d1f/d35/f3f x:0 0 0 2023-01-04T18:16:52.992 INFO:tasks.workunit.client.0.smithi050.stdout:5/201: write d13/d15/d17/d27/f2c [1582577,70213] 0 2023-01-04T18:16:52.996 INFO:tasks.workunit.client.0.smithi050.stdout:3/38: dwrite d0/fb [0,4194304] 0 2023-01-04T18:16:52.996 INFO:tasks.workunit.client.0.smithi050.stdout:3/39: readlink d0/la 0 2023-01-04T18:16:52.998 INFO:tasks.workunit.client.0.smithi050.stdout:5/202: rename d13/d15/d17/d27/f2c to d13/d15/d17/f40 0 2023-01-04T18:16:52.998 INFO:tasks.workunit.client.0.smithi050.stdout:5/203: readlink l10 0 2023-01-04T18:16:52.998 INFO:tasks.workunit.client.0.smithi050.stdout:5/204: write d13/d28/f36 [503538,101683] 0 2023-01-04T18:16:52.999 INFO:tasks.workunit.client.0.smithi050.stdout:3/40: write d0/f4 [1398886,125634] 0 2023-01-04T18:16:52.999 INFO:tasks.workunit.client.0.smithi050.stdout:3/41: chown d0/d9 26144166 1 2023-01-04T18:16:53.000 INFO:tasks.workunit.client.0.smithi050.stdout:0/46: symlink d0/d6/lc 0 2023-01-04T18:16:53.001 INFO:tasks.workunit.client.0.smithi050.stdout:3/42: creat d0/d9/ff x:0 0 0 2023-01-04T18:16:53.005 INFO:tasks.workunit.client.0.smithi050.stdout:3/43: write d0/f3 [1995177,108454] 0 2023-01-04T18:16:53.006 INFO:tasks.workunit.client.0.smithi050.stdout:6/90: dwrite d0/f14 [0,4194304] 0 2023-01-04T18:16:53.007 INFO:tasks.workunit.client.0.smithi050.stdout:6/91: read d0/d8/fd [7897548,12480] 0 2023-01-04T18:16:53.012 INFO:tasks.workunit.client.0.smithi050.stdout:0/47: dwrite d0/f5 [0,4194304] 0 2023-01-04T18:16:53.015 INFO:tasks.workunit.client.0.smithi050.stdout:8/60: sync 2023-01-04T18:16:53.016 INFO:tasks.workunit.client.0.smithi050.stdout:7/40: sync 2023-01-04T18:16:53.016 INFO:tasks.workunit.client.0.smithi050.stdout:2/46: sync 2023-01-04T18:16:53.016 INFO:tasks.workunit.client.0.smithi050.stdout:9/68: sync 2023-01-04T18:16:53.016 INFO:tasks.workunit.client.0.smithi050.stdout:9/69: readlink d1/d3/l9 0 2023-01-04T18:16:53.016 INFO:tasks.workunit.client.0.smithi050.stdout:3/44: mkdir d0/d10 0 2023-01-04T18:16:53.016 INFO:tasks.workunit.client.0.smithi050.stdout:1/46: sync 2023-01-04T18:16:53.017 INFO:tasks.workunit.client.0.smithi050.stdout:1/47: readlink - no filename 2023-01-04T18:16:53.025 INFO:tasks.workunit.client.0.smithi050.stdout:5/205: truncate d13/d28/f36 227714 0 2023-01-04T18:16:53.026 INFO:tasks.workunit.client.0.smithi050.stdout:0/48: dwrite d0/f4 [0,4194304] 0 2023-01-04T18:16:53.032 INFO:tasks.workunit.client.0.smithi050.stdout:6/92: symlink d0/d8/d1c/l1f 0 2023-01-04T18:16:53.039 INFO:tasks.workunit.client.0.smithi050.stdout:4/31: sync 2023-01-04T18:16:53.039 INFO:tasks.workunit.client.0.smithi050.stdout:4/32: write f7 [919826,83910] 0 2023-01-04T18:16:53.045 INFO:tasks.workunit.client.0.smithi050.stdout:8/61: rename d3/d5/ca to d3/d5/d11/c13 0 2023-01-04T18:16:53.045 INFO:tasks.workunit.client.0.smithi050.stdout:5/206: rename d13/d15 to d13/d15/d17/d1f/d29/d41 22 2023-01-04T18:16:53.047 INFO:tasks.workunit.client.0.smithi050.stdout:7/41: symlink d6/l9 0 2023-01-04T18:16:53.048 INFO:tasks.workunit.client.0.smithi050.stdout:8/62: dread d3/fd [0,4194304] 0 2023-01-04T18:16:53.048 INFO:tasks.workunit.client.0.smithi050.stdout:8/63: dread - d3/d5/fe zero size 2023-01-04T18:16:53.050 INFO:tasks.workunit.client.0.smithi050.stdout:6/93: dwrite d0/f7 [0,4194304] 0 2023-01-04T18:16:53.052 INFO:tasks.workunit.client.0.smithi050.stdout:9/70: unlink d1/fd 0 2023-01-04T18:16:53.052 INFO:tasks.workunit.client.0.smithi050.stdout:9/71: chown d1 302751464 1 2023-01-04T18:16:53.053 INFO:tasks.workunit.client.0.smithi050.stdout:3/45: getdents d0/d9 0 2023-01-04T18:16:53.054 INFO:tasks.workunit.client.0.smithi050.stdout:1/48: creat d8/f16 x:0 0 0 2023-01-04T18:16:53.055 INFO:tasks.workunit.client.0.smithi050.stdout:9/72: dread d1/d3/f4 [0,4194304] 0 2023-01-04T18:16:53.056 INFO:tasks.workunit.client.0.smithi050.stdout:4/33: getdents . 0 2023-01-04T18:16:53.058 INFO:tasks.workunit.client.0.smithi050.stdout:0/49: write d0/d6/fa [927263,45303] 0 2023-01-04T18:16:53.079 INFO:tasks.workunit.client.0.smithi050.stdout:2/47: symlink d1/la 0 2023-01-04T18:16:53.080 INFO:tasks.workunit.client.0.smithi050.stdout:6/94: mknod d0/d9/c20 0 2023-01-04T18:16:53.080 INFO:tasks.workunit.client.0.smithi050.stdout:6/95: chown d0/d8/d16 394 1 2023-01-04T18:16:53.080 INFO:tasks.workunit.client.0.smithi050.stdout:6/96: chown d0/d8/c1e 3512842 1 2023-01-04T18:16:53.086 INFO:tasks.workunit.client.0.smithi050.stdout:3/46: dwrite d0/f4 [0,4194304] 0 2023-01-04T18:16:53.096 INFO:tasks.workunit.client.0.smithi050.stdout:7/42: rmdir d6 39 2023-01-04T18:16:53.103 INFO:tasks.workunit.client.0.smithi050.stdout:6/97: dwrite d0/d8/f13 [0,4194304] 0 2023-01-04T18:16:53.105 INFO:tasks.workunit.client.0.smithi050.stdout:9/73: mkdir d1/d12 0 2023-01-04T18:16:53.105 INFO:tasks.workunit.client.0.smithi050.stdout:9/74: fdatasync d1/d3/f4 0 2023-01-04T18:16:53.105 INFO:tasks.workunit.client.0.smithi050.stdout:1/49: link d8/cf d8/c17 0 2023-01-04T18:16:53.105 INFO:tasks.workunit.client.0.smithi050.stdout:1/50: chown d8/f15 26 1 2023-01-04T18:16:53.106 INFO:tasks.workunit.client.0.smithi050.stdout:6/98: write d0/d9/fa [3632648,31137] 0 2023-01-04T18:16:53.108 INFO:tasks.workunit.client.0.smithi050.stdout:5/207: write d13/f14 [686723,117495] 0 2023-01-04T18:16:53.116 INFO:tasks.workunit.client.0.smithi050.stdout:4/34: mknod cb 0 2023-01-04T18:16:53.118 INFO:tasks.workunit.client.0.smithi050.stdout:8/64: rename d3/c7 to d3/d5/c14 0 2023-01-04T18:16:53.120 INFO:tasks.workunit.client.0.smithi050.stdout:2/48: creat d1/fb x:0 0 0 2023-01-04T18:16:53.122 INFO:tasks.workunit.client.0.smithi050.stdout:3/47: creat d0/dd/f11 x:0 0 0 2023-01-04T18:16:53.122 INFO:tasks.workunit.client.0.smithi050.stdout:3/48: dread - d0/fe zero size 2023-01-04T18:16:53.123 INFO:tasks.workunit.client.0.smithi050.stdout:7/43: mknod d6/ca 0 2023-01-04T18:16:53.124 INFO:tasks.workunit.client.0.smithi050.stdout:9/75: mkdir d1/d3/d13 0 2023-01-04T18:16:53.126 INFO:tasks.workunit.client.0.smithi050.stdout:6/99: unlink d0/f7 0 2023-01-04T18:16:53.128 INFO:tasks.workunit.client.0.smithi050.stdout:0/50: link d0/c3 d0/d6/d8/cd 0 2023-01-04T18:16:53.129 INFO:tasks.workunit.client.0.smithi050.stdout:4/35: creat fc x:0 0 0 2023-01-04T18:16:53.131 INFO:tasks.workunit.client.0.smithi050.stdout:8/65: rename d3/lf to d3/dc/l15 0 2023-01-04T18:16:53.132 INFO:tasks.workunit.client.0.smithi050.stdout:2/49: symlink d1/d9/lc 0 2023-01-04T18:16:53.132 INFO:tasks.workunit.client.0.smithi050.stdout:3/49: symlink d0/d9/l12 0 2023-01-04T18:16:53.133 INFO:tasks.workunit.client.0.smithi050.stdout:5/208: dwrite d13/d15/d17/d1f/d35/f3f [0,4194304] 0 2023-01-04T18:16:53.134 INFO:tasks.workunit.client.0.smithi050.stdout:1/51: dwrite d8/fe [4194304,4194304] 0 2023-01-04T18:16:53.134 INFO:tasks.workunit.client.0.smithi050.stdout:1/52: dread - d8/f9 zero size 2023-01-04T18:16:53.135 INFO:tasks.workunit.client.0.smithi050.stdout:4/36: creat fd x:0 0 0 2023-01-04T18:16:53.136 INFO:tasks.workunit.client.0.smithi050.stdout:9/76: mkdir d1/d12/d14 0 2023-01-04T18:16:53.138 INFO:tasks.workunit.client.0.smithi050.stdout:4/37: fdatasync f3 0 2023-01-04T18:16:53.139 INFO:tasks.workunit.client.0.smithi050.stdout:9/77: creat d1/d3/d13/f15 x:0 0 0 2023-01-04T18:16:53.140 INFO:tasks.workunit.client.0.smithi050.stdout:9/78: read - d1/d3/d13/f15 zero size 2023-01-04T18:16:53.140 INFO:tasks.workunit.client.0.smithi050.stdout:9/79: write d1/d3/d13/f15 [664527,70061] 0 2023-01-04T18:16:53.140 INFO:tasks.workunit.client.0.smithi050.stdout:2/50: mkdir d1/dd 0 2023-01-04T18:16:53.142 INFO:tasks.workunit.client.0.smithi050.stdout:9/80: creat d1/d3/d11/f16 x:0 0 0 2023-01-04T18:16:53.142 INFO:tasks.workunit.client.0.smithi050.stdout:9/81: fdatasync d1/d3/d11/f16 0 2023-01-04T18:16:53.148 INFO:tasks.workunit.client.0.smithi050.stdout:4/38: dread f3 [0,4194304] 0 2023-01-04T18:16:53.150 INFO:tasks.workunit.client.0.smithi050.stdout:4/39: creat fe x:0 0 0 2023-01-04T18:16:53.150 INFO:tasks.workunit.client.0.smithi050.stdout:9/82: mkdir d1/d3/d17 0 2023-01-04T18:16:53.151 INFO:tasks.workunit.client.0.smithi050.stdout:4/40: chown f0 1 1 2023-01-04T18:16:53.152 INFO:tasks.workunit.client.0.smithi050.stdout:9/83: truncate d1/d3/f4 1154172 0 2023-01-04T18:16:53.155 INFO:tasks.workunit.client.0.smithi050.stdout:9/84: unlink d1/l10 0 2023-01-04T18:16:53.155 INFO:tasks.workunit.client.0.smithi050.stdout:7/44: dwrite d6/f7 [0,4194304] 0 2023-01-04T18:16:53.156 INFO:tasks.workunit.client.0.smithi050.stdout:7/45: write f2 [443972,109602] 0 2023-01-04T18:16:53.157 INFO:tasks.workunit.client.0.smithi050.stdout:9/85: unlink d1/cc 0 2023-01-04T18:16:53.159 INFO:tasks.workunit.client.0.smithi050.stdout:3/50: dwrite d0/dd/f11 [0,4194304] 0 2023-01-04T18:16:53.162 INFO:tasks.workunit.client.0.smithi050.stdout:5/209: dwrite d13/d15/d17/d1f/d29/f2e [0,4194304] 0 2023-01-04T18:16:53.163 INFO:tasks.workunit.client.0.smithi050.stdout:7/46: rmdir d6 39 2023-01-04T18:16:53.166 INFO:tasks.workunit.client.0.smithi050.stdout:9/86: creat d1/d3/f18 x:0 0 0 2023-01-04T18:16:53.168 INFO:tasks.workunit.client.0.smithi050.stdout:8/66: rename d3/d5/c14 to d3/dc/c16 0 2023-01-04T18:16:53.175 INFO:tasks.workunit.client.0.smithi050.stdout:0/51: getdents d0/d6/d8 0 2023-01-04T18:16:53.175 INFO:tasks.workunit.client.0.smithi050.stdout:3/51: dwrite d0/fb [4194304,4194304] 0 2023-01-04T18:16:53.177 INFO:tasks.workunit.client.0.smithi050.stdout:3/52: write d0/dd/f11 [1595007,115373] 0 2023-01-04T18:16:53.177 INFO:tasks.workunit.client.0.smithi050.stdout:3/53: write d0/d9/ff [356488,6569] 0 2023-01-04T18:16:53.177 INFO:tasks.workunit.client.0.smithi050.stdout:3/54: chown d0/fb 188352434 1 2023-01-04T18:16:53.177 INFO:tasks.workunit.client.0.smithi050.stdout:3/55: readlink d0/la 0 2023-01-04T18:16:53.177 INFO:tasks.workunit.client.0.smithi050.stdout:3/56: dread - d0/fe zero size 2023-01-04T18:16:53.178 INFO:tasks.workunit.client.0.smithi050.stdout:3/57: readlink d0/lc 0 2023-01-04T18:16:53.178 INFO:tasks.workunit.client.0.smithi050.stdout:3/58: truncate d0/d9/ff 473919 0 2023-01-04T18:16:53.190 INFO:tasks.workunit.client.0.smithi050.stdout:4/41: getdents . 0 2023-01-04T18:16:53.193 INFO:tasks.workunit.client.0.smithi050.stdout:5/210: mkdir d13/d15/d17/d1f/d35/d42 0 2023-01-04T18:16:53.196 INFO:tasks.workunit.client.0.smithi050.stdout:7/47: mkdir d6/db 0 2023-01-04T18:16:53.197 INFO:tasks.workunit.client.0.smithi050.stdout:9/87: creat d1/d3/f19 x:0 0 0 2023-01-04T18:16:53.198 INFO:tasks.workunit.client.0.smithi050.stdout:9/88: dread - d1/d3/f18 zero size 2023-01-04T18:16:53.198 INFO:tasks.workunit.client.0.smithi050.stdout:9/89: chown d1/d3/f18 89953762 1 2023-01-04T18:16:53.204 INFO:tasks.workunit.client.0.smithi050.stdout:4/42: dwrite f3 [0,4194304] 0 2023-01-04T18:16:53.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:51.917968+0000 mgr.smithi098.vhfzum (mgr.24455) 33 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 734 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s rd, 4.3 MiB/s wr, 124 op/s 2023-01-04T18:16:53.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:51.917968+0000 mgr.smithi098.vhfzum (mgr.24455) 33 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 734 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s rd, 4.3 MiB/s wr, 124 op/s 2023-01-04T18:16:53.376 INFO:tasks.workunit.client.0.smithi050.stdout:1/53: rename f3 to d8/f18 0 2023-01-04T18:16:53.428 INFO:tasks.workunit.client.0.smithi050.stdout:3/59: creat d0/f13 x:0 0 0 2023-01-04T18:16:53.432 INFO:tasks.workunit.client.0.smithi050.stdout:5/211: mknod d13/d15/d17/c43 0 2023-01-04T18:16:53.435 INFO:tasks.workunit.client.0.smithi050.stdout:7/48: rmdir d6 39 2023-01-04T18:16:53.437 INFO:tasks.workunit.client.0.smithi050.stdout:9/90: link d1/d3/f18 d1/d3/f1a 0 2023-01-04T18:16:53.437 INFO:tasks.workunit.client.0.smithi050.stdout:9/91: readlink d1/d3/lf 0 2023-01-04T18:16:53.438 INFO:tasks.workunit.client.0.smithi050.stdout:9/92: truncate d1/d3/d13/f15 1407632 0 2023-01-04T18:16:53.438 INFO:tasks.workunit.client.0.smithi050.stdout:9/93: write d1/d3/f4 [790448,98664] 0 2023-01-04T18:16:53.443 INFO:tasks.workunit.client.0.smithi050.stdout:4/43: creat ff x:0 0 0 2023-01-04T18:16:53.443 INFO:tasks.workunit.client.0.smithi050.stdout:4/44: stat f5 0 2023-01-04T18:16:53.443 INFO:tasks.workunit.client.0.smithi050.stdout:4/45: truncate fe 881672 0 2023-01-04T18:16:53.453 INFO:tasks.workunit.client.0.smithi050.stdout:1/54: rename d8/f16 to d8/f19 0 2023-01-04T18:16:53.453 INFO:tasks.workunit.client.0.smithi050.stdout:1/55: write d8/f10 [984647,71479] 0 2023-01-04T18:16:53.453 INFO:tasks.workunit.client.0.smithi050.stdout:1/56: read d8/f10 [997841,108633] 0 2023-01-04T18:16:53.453 INFO:tasks.workunit.client.0.smithi050.stdout:1/57: chown d8/f10 21121995 1 2023-01-04T18:16:53.454 INFO:tasks.workunit.client.0.smithi050.stdout:8/67: mkdir d3/d5/d17 0 2023-01-04T18:16:53.455 INFO:tasks.workunit.client.0.smithi050.stdout:0/52: mknod d0/d6/ce 0 2023-01-04T18:16:53.456 INFO:tasks.workunit.client.0.smithi050.stdout:0/53: write d0/f4 [1423130,113020] 0 2023-01-04T18:16:53.457 INFO:tasks.workunit.client.0.smithi050.stdout:3/60: creat d0/dd/f14 x:0 0 0 2023-01-04T18:16:53.457 INFO:tasks.workunit.client.0.smithi050.stdout:3/61: chown d0 43155 1 2023-01-04T18:16:53.457 INFO:tasks.workunit.client.0.smithi050.stdout:3/62: read d0/d9/ff [24691,110588] 0 2023-01-04T18:16:53.460 INFO:tasks.workunit.client.0.smithi050.stdout:5/212: mkdir d13/d15/d17/d27/d44 0 2023-01-04T18:16:53.463 INFO:tasks.workunit.client.0.smithi050.stdout:7/49: unlink l4 0 2023-01-04T18:16:53.464 INFO:tasks.workunit.client.0.smithi050.stdout:7/50: write d6/f7 [1042702,1812] 0 2023-01-04T18:16:53.464 INFO:tasks.workunit.client.0.smithi050.stdout:9/94: creat d1/d3/f1b x:0 0 0 2023-01-04T18:16:53.464 INFO:tasks.workunit.client.0.smithi050.stdout:9/95: chown d1/d3/f19 930 1 2023-01-04T18:16:53.464 INFO:tasks.workunit.client.0.smithi050.stdout:4/46: mknod c10 0 2023-01-04T18:16:53.466 INFO:tasks.workunit.client.0.smithi050.stdout:1/58: truncate f1 17748 0 2023-01-04T18:16:53.466 INFO:tasks.workunit.client.0.smithi050.stdout:1/59: truncate f6 868542 0 2023-01-04T18:16:53.466 INFO:tasks.workunit.client.0.smithi050.stdout:1/60: stat c4 0 2023-01-04T18:16:53.466 INFO:tasks.workunit.client.0.smithi050.stdout:8/68: getdents d3/dc 0 2023-01-04T18:16:53.477 INFO:tasks.workunit.client.0.smithi050.stdout:3/63: rename d0/lc to d0/l15 0 2023-01-04T18:16:53.478 INFO:tasks.workunit.client.0.smithi050.stdout:3/64: write d0/dd/f11 [818206,18290] 0 2023-01-04T18:16:53.478 INFO:tasks.workunit.client.0.smithi050.stdout:3/65: fdatasync d0/fe 0 2023-01-04T18:16:53.478 INFO:tasks.workunit.client.0.smithi050.stdout:5/213: creat d13/d15/d17/d27/d44/f45 x:0 0 0 2023-01-04T18:16:53.478 INFO:tasks.workunit.client.0.smithi050.stdout:5/214: chown d13/d15/d17/f40 18488 1 2023-01-04T18:16:53.479 INFO:tasks.workunit.client.0.smithi050.stdout:5/215: chown d13/d15/d17/f1b 243724 1 2023-01-04T18:16:53.479 INFO:tasks.workunit.client.0.smithi050.stdout:5/216: write d13/d28/f3e [390329,48782] 0 2023-01-04T18:16:53.479 INFO:tasks.workunit.client.0.smithi050.stdout:5/217: stat d13/c23 0 2023-01-04T18:16:53.479 INFO:tasks.workunit.client.0.smithi050.stdout:5/218: chown d13/d15/d17/d1f/d35 769542439 1 2023-01-04T18:16:53.482 INFO:tasks.workunit.client.0.smithi050.stdout:7/51: getdents d6 0 2023-01-04T18:16:53.483 INFO:tasks.workunit.client.0.smithi050.stdout:9/96: creat d1/d3/d17/f1c x:0 0 0 2023-01-04T18:16:53.485 INFO:tasks.workunit.client.0.smithi050.stdout:4/47: creat f11 x:0 0 0 2023-01-04T18:16:53.485 INFO:tasks.workunit.client.0.smithi050.stdout:1/61: dread d8/f15 [0,4194304] 0 2023-01-04T18:16:53.489 INFO:tasks.workunit.client.0.smithi050.stdout:8/69: unlink d3/d5/d11/c13 0 2023-01-04T18:16:53.489 INFO:tasks.workunit.client.0.smithi050.stdout:8/70: fdatasync d3/d5/fe 0 2023-01-04T18:16:53.489 INFO:tasks.workunit.client.0.smithi050.stdout:8/71: chown d3/d5/d11 316636483 1 2023-01-04T18:16:53.490 INFO:tasks.workunit.client.0.smithi050.stdout:8/72: write d3/d5/fb [3002350,44655] 0 2023-01-04T18:16:53.490 INFO:tasks.workunit.client.0.smithi050.stdout:0/54: symlink d0/lf 0 2023-01-04T18:16:53.490 INFO:tasks.workunit.client.0.smithi050.stdout:8/73: chown d3/dc/d12 24180 1 2023-01-04T18:16:53.490 INFO:tasks.workunit.client.0.smithi050.stdout:8/74: chown d3/d5/fe 60 1 2023-01-04T18:16:53.494 INFO:tasks.workunit.client.0.smithi050.stdout:3/66: unlink d0/d9/l12 0 2023-01-04T18:16:53.497 INFO:tasks.workunit.client.0.smithi050.stdout:5/219: mkdir d13/d15/d17/d27/d46 0 2023-01-04T18:16:53.497 INFO:tasks.workunit.client.0.smithi050.stdout:7/52: mkdir d6/db/dc 0 2023-01-04T18:16:53.499 INFO:tasks.workunit.client.0.smithi050.stdout:4/48: creat f12 x:0 0 0 2023-01-04T18:16:53.500 INFO:tasks.workunit.client.0.smithi050.stdout:4/49: write f3 [101082,56977] 0 2023-01-04T18:16:53.502 INFO:tasks.workunit.client.0.smithi050.stdout:1/62: rmdir d8 39 2023-01-04T18:16:53.502 INFO:tasks.workunit.client.0.smithi050.stdout:1/63: fsync d8/f18 0 2023-01-04T18:16:53.502 INFO:tasks.workunit.client.0.smithi050.stdout:1/64: stat d8/f11 0 2023-01-04T18:16:53.503 INFO:tasks.workunit.client.0.smithi050.stdout:3/67: creat d0/d10/f16 x:0 0 0 2023-01-04T18:16:53.505 INFO:tasks.workunit.client.0.smithi050.stdout:5/220: mkdir d13/d15/d17/d27/d44/d47 0 2023-01-04T18:16:53.505 INFO:tasks.workunit.client.0.smithi050.stdout:5/221: dread - d13/d15/d17/d27/d44/f45 zero size 2023-01-04T18:16:53.505 INFO:tasks.workunit.client.0.smithi050.stdout:5/222: write d13/d15/d17/d27/d44/f45 [514339,109499] 0 2023-01-04T18:16:53.511 INFO:tasks.workunit.client.0.smithi050.stdout:3/68: unlink d0/dd/f14 0 2023-01-04T18:16:53.512 INFO:tasks.workunit.client.0.smithi050.stdout:5/223: truncate d13/d15/f26 2740918 0 2023-01-04T18:16:53.513 INFO:tasks.workunit.client.0.smithi050.stdout:5/224: symlink d13/d15/d17/l48 0 2023-01-04T18:16:53.513 INFO:tasks.workunit.client.0.smithi050.stdout:5/225: write d13/d15/d17/d1f/d29/f3c [987365,25854] 0 2023-01-04T18:16:53.526 INFO:tasks.workunit.client.0.smithi050.stdout:1/65: dwrite d8/f13 [0,4194304] 0 2023-01-04T18:16:53.527 INFO:tasks.workunit.client.0.smithi050.stdout:1/66: write d8/fe [2287589,74381] 0 2023-01-04T18:16:53.528 INFO:tasks.workunit.client.0.smithi050.stdout:1/67: symlink d8/l1a 0 2023-01-04T18:16:53.529 INFO:tasks.workunit.client.0.smithi050.stdout:1/68: creat d8/f1b x:0 0 0 2023-01-04T18:16:53.530 INFO:tasks.workunit.client.0.smithi050.stdout:1/69: mkdir d8/d14/d1c 0 2023-01-04T18:16:53.573 INFO:tasks.workunit.client.0.smithi050.stdout:2/51: sync 2023-01-04T18:16:53.573 INFO:tasks.workunit.client.0.smithi050.stdout:2/52: dread - d1/f8 zero size 2023-01-04T18:16:53.573 INFO:tasks.workunit.client.0.smithi050.stdout:6/100: sync 2023-01-04T18:16:53.574 INFO:tasks.workunit.client.0.smithi050.stdout:0/55: write d0/f4 [486399,123099] 0 2023-01-04T18:16:53.574 INFO:tasks.workunit.client.0.smithi050.stdout:6/101: read d0/d9/fa [1117383,95673] 0 2023-01-04T18:16:53.576 INFO:tasks.workunit.client.0.smithi050.stdout:2/53: rename d1/d9/lc to d1/d9/le 0 2023-01-04T18:16:53.576 INFO:tasks.workunit.client.0.smithi050.stdout:2/54: write d1/f7 [781513,129197] 0 2023-01-04T18:16:53.578 INFO:tasks.workunit.client.0.smithi050.stdout:2/55: symlink d1/d9/lf 0 2023-01-04T18:16:53.581 INFO:tasks.workunit.client.0.smithi050.stdout:2/56: mkdir d1/d10 0 2023-01-04T18:16:53.581 INFO:tasks.workunit.client.0.smithi050.stdout:7/53: dread d6/f7 [0,4194304] 0 2023-01-04T18:16:53.581 INFO:tasks.workunit.client.0.smithi050.stdout:7/54: getdents d6/db/dc 0 2023-01-04T18:16:53.583 INFO:tasks.workunit.client.0.smithi050.stdout:9/97: dwrite d1/d3/d13/f15 [0,4194304] 0 2023-01-04T18:16:53.585 INFO:tasks.workunit.client.0.smithi050.stdout:7/55: dread f2 [0,4194304] 0 2023-01-04T18:16:53.586 INFO:tasks.workunit.client.0.smithi050.stdout:4/50: dwrite fe [0,4194304] 0 2023-01-04T18:16:53.589 INFO:tasks.workunit.client.0.smithi050.stdout:0/56: dread d0/d6/fb [0,4194304] 0 2023-01-04T18:16:53.590 INFO:tasks.workunit.client.0.smithi050.stdout:0/57: write d0/f5 [2341863,126465] 0 2023-01-04T18:16:53.637 INFO:tasks.workunit.client.0.smithi050.stdout:6/102: dread d0/d8/f15 [0,4194304] 0 2023-01-04T18:16:53.637 INFO:tasks.workunit.client.0.smithi050.stdout:6/103: chown d0/d8 57 1 2023-01-04T18:16:53.641 INFO:tasks.workunit.client.0.smithi050.stdout:4/51: dread f7 [0,4194304] 0 2023-01-04T18:16:53.647 INFO:tasks.workunit.client.0.smithi050.stdout:6/104: dread d0/d8/f13 [0,4194304] 0 2023-01-04T18:16:53.647 INFO:tasks.workunit.client.0.smithi050.stdout:9/98: dwrite d1/d3/f1b [0,4194304] 0 2023-01-04T18:16:53.648 INFO:tasks.workunit.client.0.smithi050.stdout:9/99: dread - d1/d3/f1a zero size 2023-01-04T18:16:53.674 INFO:tasks.workunit.client.0.smithi050.stdout:2/57: unlink d1/f7 0 2023-01-04T18:16:53.674 INFO:tasks.workunit.client.0.smithi050.stdout:2/58: fsync d1/f6 0 2023-01-04T18:16:53.682 INFO:tasks.workunit.client.0.smithi050.stdout:7/56: creat d6/fd x:0 0 0 2023-01-04T18:16:53.682 INFO:tasks.workunit.client.0.smithi050.stdout:7/57: truncate d6/fd 575161 0 2023-01-04T18:16:53.685 INFO:tasks.workunit.client.0.smithi050.stdout:7/58: dread d6/f7 [0,4194304] 0 2023-01-04T18:16:53.688 INFO:tasks.workunit.client.0.smithi050.stdout:3/69: truncate d0/dd/f11 1534251 0 2023-01-04T18:16:53.689 INFO:tasks.workunit.client.0.smithi050.stdout:3/70: dread d0/d9/ff [0,4194304] 0 2023-01-04T18:16:53.691 INFO:tasks.workunit.client.0.smithi050.stdout:0/58: symlink d0/d6/d8/l10 0 2023-01-04T18:16:53.693 INFO:tasks.workunit.client.0.smithi050.stdout:1/70: rmdir d8 39 2023-01-04T18:16:53.708 INFO:tasks.workunit.client.0.smithi050.stdout:6/105: unlink d0/d8/c1e 0 2023-01-04T18:16:53.712 INFO:tasks.workunit.client.0.smithi050.stdout:9/100: mkdir d1/d3/d11/d1d 0 2023-01-04T18:16:53.712 INFO:tasks.workunit.client.0.smithi050.stdout:9/101: write d1/d3/f18 [50215,61697] 0 2023-01-04T18:16:53.715 INFO:tasks.workunit.client.0.smithi050.stdout:2/59: rename d1/d9 to d1/dd/d11 0 2023-01-04T18:16:53.719 INFO:tasks.workunit.client.0.smithi050.stdout:7/59: creat d6/db/dc/fe x:0 0 0 2023-01-04T18:16:53.721 INFO:tasks.workunit.client.0.smithi050.stdout:3/71: rename d0/la to d0/l17 0 2023-01-04T18:16:53.722 INFO:tasks.workunit.client.0.smithi050.stdout:0/59: rmdir d0/d6/d8 39 2023-01-04T18:16:53.724 INFO:tasks.workunit.client.0.smithi050.stdout:1/71: mkdir d8/d14/d1d 0 2023-01-04T18:16:53.724 INFO:tasks.workunit.client.0.smithi050.stdout:1/72: chown d8/f19 7 1 2023-01-04T18:16:53.724 INFO:tasks.workunit.client.0.smithi050.stdout:1/73: dread - d8/f9 zero size 2023-01-04T18:16:53.725 INFO:tasks.workunit.client.0.smithi050.stdout:5/226: truncate d13/d15/f26 41443 0 2023-01-04T18:16:53.727 INFO:tasks.workunit.client.0.smithi050.stdout:6/106: mknod d0/d8/c21 0 2023-01-04T18:16:53.727 INFO:tasks.workunit.client.0.smithi050.stdout:6/107: chown d0/d9/df 1 1 2023-01-04T18:16:53.727 INFO:tasks.workunit.client.0.smithi050.stdout:6/108: fsync d0/d8/f15 0 2023-01-04T18:16:53.731 INFO:tasks.workunit.client.0.smithi050.stdout:9/102: creat d1/d3/d13/f1e x:0 0 0 2023-01-04T18:16:53.731 INFO:tasks.workunit.client.0.smithi050.stdout:2/60: mkdir d1/dd/d11/d12 0 2023-01-04T18:16:53.734 INFO:tasks.workunit.client.0.smithi050.stdout:7/60: rmdir d6/db 39 2023-01-04T18:16:53.734 INFO:tasks.workunit.client.0.smithi050.stdout:7/61: read - d6/db/dc/fe zero size 2023-01-04T18:16:53.734 INFO:tasks.workunit.client.0.smithi050.stdout:7/62: write d6/f7 [4972132,65328] 0 2023-01-04T18:16:53.735 INFO:tasks.workunit.client.0.smithi050.stdout:3/72: creat d0/f18 x:0 0 0 2023-01-04T18:16:53.738 INFO:tasks.workunit.client.0.smithi050.stdout:1/74: unlink d8/cf 0 2023-01-04T18:16:53.741 INFO:tasks.workunit.client.0.smithi050.stdout:5/227: mkdir d13/d15/d17/d1f/d35/d49 0 2023-01-04T18:16:53.742 INFO:tasks.workunit.client.0.smithi050.stdout:6/109: unlink d0/d8/d16/l1d 0 2023-01-04T18:16:53.743 INFO:tasks.workunit.client.0.smithi050.stdout:9/103: unlink d1/c2 0 2023-01-04T18:16:53.746 INFO:tasks.workunit.client.0.smithi050.stdout:7/63: link d6/l9 d6/db/dc/lf 0 2023-01-04T18:16:53.746 INFO:tasks.workunit.client.0.smithi050.stdout:7/64: readlink d6/l9 0 2023-01-04T18:16:53.748 INFO:tasks.workunit.client.0.smithi050.stdout:3/73: symlink d0/dd/l19 0 2023-01-04T18:16:53.748 INFO:tasks.workunit.client.0.smithi050.stdout:0/60: rename d0/c9 to d0/d6/c11 0 2023-01-04T18:16:53.749 INFO:tasks.workunit.client.0.smithi050.stdout:0/61: read d0/d6/fb [2133993,8099] 0 2023-01-04T18:16:53.749 INFO:tasks.workunit.client.0.smithi050.stdout:0/62: readlink d0/lf 0 2023-01-04T18:16:53.750 INFO:tasks.workunit.client.0.smithi050.stdout:3/74: dread d0/d9/ff [0,4194304] 0 2023-01-04T18:16:53.754 INFO:tasks.workunit.client.0.smithi050.stdout:5/228: mkdir d13/d15/d17/d1f/d35/d42/d4a 0 2023-01-04T18:16:53.754 INFO:tasks.workunit.client.0.smithi050.stdout:5/229: dread - d13/d15/d17/d1f/d35/f3a zero size 2023-01-04T18:16:53.754 INFO:tasks.workunit.client.0.smithi050.stdout:5/230: chown d13/d15/d17/d1f 0 1 2023-01-04T18:16:53.755 INFO:tasks.workunit.client.0.smithi050.stdout:5/231: write d13/d15/d17/d27/d44/f45 [199690,84544] 0 2023-01-04T18:16:53.755 INFO:tasks.workunit.client.0.smithi050.stdout:5/232: fsync d13/d15/f26 0 2023-01-04T18:16:53.757 INFO:tasks.workunit.client.0.smithi050.stdout:6/110: getdents d0/d9/df 0 2023-01-04T18:16:53.758 INFO:tasks.workunit.client.0.smithi050.stdout:0/63: dread d0/f5 [0,4194304] 0 2023-01-04T18:16:53.758 INFO:tasks.workunit.client.0.smithi050.stdout:0/64: fdatasync d0/f5 0 2023-01-04T18:16:53.759 INFO:tasks.workunit.client.0.smithi050.stdout:2/61: mknod d1/c13 0 2023-01-04T18:16:53.761 INFO:tasks.workunit.client.0.smithi050.stdout:1/75: rename d8/f10 to d8/d14/d1d/f1e 0 2023-01-04T18:16:53.763 INFO:tasks.workunit.client.0.smithi050.stdout:3/75: rename d0/d9 to d0/d1a 0 2023-01-04T18:16:53.763 INFO:tasks.workunit.client.0.smithi050.stdout:3/76: dread - d0/f18 zero size 2023-01-04T18:16:53.765 INFO:tasks.workunit.client.0.smithi050.stdout:5/233: symlink d13/d15/d17/d1f/d35/d49/l4b 0 2023-01-04T18:16:53.765 INFO:tasks.workunit.client.0.smithi050.stdout:5/234: write d13/d15/d17/d27/d44/f45 [476099,40808] 0 2023-01-04T18:16:53.766 INFO:tasks.workunit.client.0.smithi050.stdout:0/65: getdents d0/d6/d8 0 2023-01-04T18:16:53.767 INFO:tasks.workunit.client.0.smithi050.stdout:2/62: mkdir d1/dd/d11/d14 0 2023-01-04T18:16:53.768 INFO:tasks.workunit.client.0.smithi050.stdout:5/235: write d13/d15/d17/d1f/d35/f3f [1494251,73909] 0 2023-01-04T18:16:53.769 INFO:tasks.workunit.client.0.smithi050.stdout:1/76: rename d8/f18 to d8/d14/d1d/f1f 0 2023-01-04T18:16:53.769 INFO:tasks.workunit.client.0.smithi050.stdout:1/77: chown d8/f13 180648 1 2023-01-04T18:16:53.769 INFO:tasks.workunit.client.0.smithi050.stdout:1/78: stat d8/f1b 0 2023-01-04T18:16:53.769 INFO:tasks.workunit.client.0.smithi050.stdout:1/79: stat f6 0 2023-01-04T18:16:53.770 INFO:tasks.workunit.client.0.smithi050.stdout:3/77: mkdir d0/d1b 0 2023-01-04T18:16:53.770 INFO:tasks.workunit.client.0.smithi050.stdout:3/78: chown d0/d1a 233591 1 2023-01-04T18:16:53.771 INFO:tasks.workunit.client.0.smithi050.stdout:3/79: readlink d0/l17 0 2023-01-04T18:16:53.771 INFO:tasks.workunit.client.0.smithi050.stdout:3/80: stat d0/d1a/ff 0 2023-01-04T18:16:53.771 INFO:tasks.workunit.client.0.smithi050.stdout:3/81: fdatasync d0/dd/f11 0 2023-01-04T18:16:53.772 INFO:tasks.workunit.client.0.smithi050.stdout:7/65: dwrite f2 [0,4194304] 0 2023-01-04T18:16:53.774 INFO:tasks.workunit.client.0.smithi050.stdout:2/63: creat d1/f15 x:0 0 0 2023-01-04T18:16:53.774 INFO:tasks.workunit.client.0.smithi050.stdout:6/111: dread d0/d9/df/f11 [0,4194304] 0 2023-01-04T18:16:53.774 INFO:tasks.workunit.client.0.smithi050.stdout:9/104: dwrite d1/d3/d11/f16 [0,4194304] 0 2023-01-04T18:16:53.774 INFO:tasks.workunit.client.0.smithi050.stdout:6/112: chown d0/d9/df 769 1 2023-01-04T18:16:53.775 INFO:tasks.workunit.client.0.smithi050.stdout:9/105: write d1/d3/f4 [951567,6415] 0 2023-01-04T18:16:53.775 INFO:tasks.workunit.client.0.smithi050.stdout:9/106: fsync d1/d3/f19 0 2023-01-04T18:16:53.776 INFO:tasks.workunit.client.0.smithi050.stdout:5/236: rename d13/d15/d17/d1f/d29/f2e to d13/d15/d17/f4c 0 2023-01-04T18:16:53.781 INFO:tasks.workunit.client.0.smithi050.stdout:8/75: sync 2023-01-04T18:16:53.782 INFO:tasks.workunit.client.0.smithi050.stdout:4/52: sync 2023-01-04T18:16:53.784 INFO:tasks.workunit.client.0.smithi050.stdout:3/82: creat d0/d1b/f1c x:0 0 0 2023-01-04T18:16:53.784 INFO:tasks.workunit.client.0.smithi050.stdout:7/66: mknod d6/c10 0 2023-01-04T18:16:53.785 INFO:tasks.workunit.client.0.smithi050.stdout:7/67: fsync d6/db/dc/fe 0 2023-01-04T18:16:53.786 INFO:tasks.workunit.client.0.smithi050.stdout:2/64: write d1/f2 [1046537,68449] 0 2023-01-04T18:16:53.789 INFO:tasks.workunit.client.0.smithi050.stdout:0/66: dwrite d0/d6/fa [0,4194304] 0 2023-01-04T18:16:53.817 INFO:tasks.workunit.client.0.smithi050.stdout:6/113: unlink d0/d9/df/f11 0 2023-01-04T18:16:53.818 INFO:tasks.workunit.client.0.smithi050.stdout:9/107: mkdir d1/d3/d11/d1f 0 2023-01-04T18:16:53.820 INFO:tasks.workunit.client.0.smithi050.stdout:1/80: rename c4 to d8/d14/d1d/c20 0 2023-01-04T18:16:53.821 INFO:tasks.workunit.client.0.smithi050.stdout:5/237: truncate d13/f18 368706 0 2023-01-04T18:16:53.821 INFO:tasks.workunit.client.0.smithi050.stdout:5/238: write d13/d15/f34 [981976,120380] 0 2023-01-04T18:16:53.824 INFO:tasks.workunit.client.0.smithi050.stdout:8/76: getdents d3 0 2023-01-04T18:16:53.829 INFO:tasks.workunit.client.0.smithi050.stdout:3/83: link d0/l15 d0/d1a/l1d 0 2023-01-04T18:16:53.830 INFO:tasks.workunit.client.0.smithi050.stdout:7/68: creat d6/f11 x:0 0 0 2023-01-04T18:16:53.834 INFO:tasks.workunit.client.0.smithi050.stdout:0/67: link d0/d6/d8/cd d0/d6/d8/c12 0 2023-01-04T18:16:53.834 INFO:tasks.workunit.client.0.smithi050.stdout:0/68: fdatasync d0/f5 0 2023-01-04T18:16:53.841 INFO:tasks.workunit.client.0.smithi050.stdout:6/114: creat d0/d9/df/f22 x:0 0 0 2023-01-04T18:16:53.842 INFO:tasks.workunit.client.0.smithi050.stdout:9/108: truncate d1/d3/f1b 2371742 0 2023-01-04T18:16:53.848 INFO:tasks.workunit.client.0.smithi050.stdout:5/239: unlink d13/d15/d17/c43 0 2023-01-04T18:16:53.850 INFO:tasks.workunit.client.0.smithi050.stdout:8/77: creat d3/d5/d11/f18 x:0 0 0 2023-01-04T18:16:53.851 INFO:tasks.workunit.client.0.smithi050.stdout:5/240: fsync d13/d15/f34 0 2023-01-04T18:16:53.853 INFO:tasks.workunit.client.0.smithi050.stdout:3/84: creat d0/dd/f1e x:0 0 0 2023-01-04T18:16:53.854 INFO:tasks.workunit.client.0.smithi050.stdout:3/85: dread - d0/f13 zero size 2023-01-04T18:16:53.854 INFO:tasks.workunit.client.0.smithi050.stdout:3/86: write d0/d10/f16 [495172,41656] 0 2023-01-04T18:16:53.859 INFO:tasks.workunit.client.0.smithi050.stdout:7/69: dread d6/fd [0,4194304] 0 2023-01-04T18:16:53.861 INFO:tasks.workunit.client.0.smithi050.stdout:0/69: creat d0/d6/d8/f13 x:0 0 0 2023-01-04T18:16:53.862 INFO:tasks.workunit.client.0.smithi050.stdout:6/115: creat d0/d8/f23 x:0 0 0 2023-01-04T18:16:53.865 INFO:tasks.workunit.client.0.smithi050.stdout:9/109: link d1/ce d1/c20 0 2023-01-04T18:16:53.868 INFO:tasks.workunit.client.0.smithi050.stdout:1/81: unlink d8/f15 0 2023-01-04T18:16:53.871 INFO:tasks.workunit.client.0.smithi050.stdout:8/78: rmdir d3/dc/d12 0 2023-01-04T18:16:53.873 INFO:tasks.workunit.client.0.smithi050.stdout:5/241: mkdir d13/d15/d17/d1f/d29/d4d 0 2023-01-04T18:16:53.875 INFO:tasks.workunit.client.0.smithi050.stdout:3/87: link d0/l17 d0/d10/l1f 0 2023-01-04T18:16:53.876 INFO:tasks.workunit.client.0.smithi050.stdout:7/70: rename d6/ca to d6/db/c12 0 2023-01-04T18:16:53.878 INFO:tasks.workunit.client.0.smithi050.stdout:9/110: creat d1/d3/d11/d1f/f21 x:0 0 0 2023-01-04T18:16:53.878 INFO:tasks.workunit.client.0.smithi050.stdout:9/111: fsync d1/d3/f18 0 2023-01-04T18:16:53.879 INFO:tasks.workunit.client.0.smithi050.stdout:9/112: chown d1/d3/d17/f1c 26829428 1 2023-01-04T18:16:53.879 INFO:tasks.workunit.client.0.smithi050.stdout:9/113: chown d1/d3/d13/f15 0 1 2023-01-04T18:16:53.879 INFO:tasks.workunit.client.0.smithi050.stdout:9/114: fdatasync d1/d3/f19 0 2023-01-04T18:16:53.880 INFO:tasks.workunit.client.0.smithi050.stdout:1/82: write d8/f11 [791037,85860] 0 2023-01-04T18:16:53.880 INFO:tasks.workunit.client.0.smithi050.stdout:3/88: symlink d0/d1b/l20 0 2023-01-04T18:16:53.880 INFO:tasks.workunit.client.0.smithi050.stdout:3/89: fdatasync d0/f4 0 2023-01-04T18:16:53.882 INFO:tasks.workunit.client.0.smithi050.stdout:7/71: dread d6/f7 [0,4194304] 0 2023-01-04T18:16:53.882 INFO:tasks.workunit.client.0.smithi050.stdout:7/72: readlink l3 0 2023-01-04T18:16:53.882 INFO:tasks.workunit.client.0.smithi050.stdout:7/73: write d6/db/dc/fe [548130,73904] 0 2023-01-04T18:16:53.883 INFO:tasks.workunit.client.0.smithi050.stdout:1/83: readlink d8/l1a 0 2023-01-04T18:16:53.884 INFO:tasks.workunit.client.0.smithi050.stdout:3/90: mkdir d0/d21 0 2023-01-04T18:16:53.884 INFO:tasks.workunit.client.0.smithi050.stdout:3/91: chown d0/dd/l19 41083 1 2023-01-04T18:16:53.885 INFO:tasks.workunit.client.0.smithi050.stdout:3/92: dread - d0/f18 zero size 2023-01-04T18:16:53.886 INFO:tasks.workunit.client.0.smithi050.stdout:7/74: creat d6/f13 x:0 0 0 2023-01-04T18:16:53.886 INFO:tasks.workunit.client.0.smithi050.stdout:7/75: chown f2 4 1 2023-01-04T18:16:53.886 INFO:tasks.workunit.client.0.smithi050.stdout:0/70: dwrite d0/d6/fb [4194304,4194304] 0 2023-01-04T18:16:53.887 INFO:tasks.workunit.client.0.smithi050.stdout:3/93: symlink d0/d1a/l22 0 2023-01-04T18:16:53.888 INFO:tasks.workunit.client.0.smithi050.stdout:3/94: write d0/fe [881300,64852] 0 2023-01-04T18:16:53.888 INFO:tasks.workunit.client.0.smithi050.stdout:3/95: chown d0/dd/l19 3783 1 2023-01-04T18:16:53.888 INFO:tasks.workunit.client.0.smithi050.stdout:3/96: write d0/d10/f16 [1001992,89258] 0 2023-01-04T18:16:53.888 INFO:tasks.workunit.client.0.smithi050.stdout:3/97: truncate d0/dd/f1e 198254 0 2023-01-04T18:16:53.888 INFO:tasks.workunit.client.0.smithi050.stdout:8/79: dwrite d3/d5/fb [0,4194304] 0 2023-01-04T18:16:53.889 INFO:tasks.workunit.client.0.smithi050.stdout:6/116: dwrite d0/d9/fa [0,4194304] 0 2023-01-04T18:16:53.889 INFO:tasks.workunit.client.0.smithi050.stdout:8/80: chown d3/d5/d11/f18 14800 1 2023-01-04T18:16:53.889 INFO:tasks.workunit.client.0.smithi050.stdout:6/117: write d0/d9/fa [4781263,105248] 0 2023-01-04T18:16:53.889 INFO:tasks.workunit.client.0.smithi050.stdout:6/118: read d0/d8/f15 [146257,117358] 0 2023-01-04T18:16:53.889 INFO:tasks.workunit.client.0.smithi050.stdout:1/84: write d8/d14/d1d/f1f [1143908,116803] 0 2023-01-04T18:16:53.894 INFO:tasks.workunit.client.0.smithi050.stdout:6/119: creat d0/d9/f24 x:0 0 0 2023-01-04T18:16:53.895 INFO:tasks.workunit.client.0.smithi050.stdout:1/85: creat d8/d14/d1d/f21 x:0 0 0 2023-01-04T18:16:53.895 INFO:tasks.workunit.client.0.smithi050.stdout:1/86: readlink d8/l1a 0 2023-01-04T18:16:53.895 INFO:tasks.workunit.client.0.smithi050.stdout:0/71: dread d0/f4 [4194304,4194304] 0 2023-01-04T18:16:53.896 INFO:tasks.workunit.client.0.smithi050.stdout:1/87: write f7 [542764,39661] 0 2023-01-04T18:16:53.897 INFO:tasks.workunit.client.0.smithi050.stdout:8/81: link d3/dc/c16 d3/d5/c19 0 2023-01-04T18:16:53.897 INFO:tasks.workunit.client.0.smithi050.stdout:8/82: chown d3/d5/c19 521910 1 2023-01-04T18:16:53.900 INFO:tasks.workunit.client.0.smithi050.stdout:6/120: mkdir d0/d9/d25 0 2023-01-04T18:16:53.900 INFO:tasks.workunit.client.0.smithi050.stdout:3/98: dread d0/f4 [0,4194304] 0 2023-01-04T18:16:53.901 INFO:tasks.workunit.client.0.smithi050.stdout:5/242: rename d13/d15/d17/d1f/d29 to d13/d15/d17/d27/d46/d4e 0 2023-01-04T18:16:53.904 INFO:tasks.workunit.client.0.smithi050.stdout:9/115: dwrite d1/d3/d13/f1e [0,4194304] 0 2023-01-04T18:16:53.905 INFO:tasks.workunit.client.0.smithi050.stdout:7/76: dwrite f2 [0,4194304] 0 2023-01-04T18:16:53.907 INFO:tasks.workunit.client.0.smithi050.stdout:1/88: mkdir d8/d14/d22 0 2023-01-04T18:16:53.908 INFO:tasks.workunit.client.0.smithi050.stdout:6/121: link d0/fe d0/d8/d1c/f26 0 2023-01-04T18:16:53.910 INFO:tasks.workunit.client.0.smithi050.stdout:3/99: rmdir d0/d1b 39 2023-01-04T18:16:53.910 INFO:tasks.workunit.client.0.smithi050.stdout:3/100: dread - d0/f18 zero size 2023-01-04T18:16:53.910 INFO:tasks.workunit.client.0.smithi050.stdout:3/101: chown d0/d1a/l1d 260123059 1 2023-01-04T18:16:53.912 INFO:tasks.workunit.client.0.smithi050.stdout:8/83: rename d3/dc/l15 to d3/d5/d11/l1a 0 2023-01-04T18:16:53.914 INFO:tasks.workunit.client.0.smithi050.stdout:3/102: read d0/fb [6900977,64121] 0 2023-01-04T18:16:53.917 INFO:tasks.workunit.client.0.smithi050.stdout:0/72: rename d0/d6/fb to d0/d6/f14 0 2023-01-04T18:16:53.917 INFO:tasks.workunit.client.0.smithi050.stdout:0/73: fdatasync d0/f4 0 2023-01-04T18:16:53.918 INFO:tasks.workunit.client.0.smithi050.stdout:7/77: symlink d6/l14 0 2023-01-04T18:16:53.922 INFO:tasks.workunit.client.0.smithi050.stdout:1/89: mkdir d8/d14/d22/d23 0 2023-01-04T18:16:53.935 INFO:tasks.workunit.client.0.smithi050.stdout:7/78: dwrite f2 [0,4194304] 0 2023-01-04T18:16:53.955 INFO:tasks.workunit.client.0.smithi050.stdout:7/79: dwrite d6/f7 [4194304,4194304] 0 2023-01-04T18:16:53.956 INFO:tasks.workunit.client.0.smithi050.stdout:7/80: write f2 [244722,40794] 0 2023-01-04T18:16:54.008 INFO:tasks.workunit.client.0.smithi050.stdout:6/122: creat d0/d9/d25/f27 x:0 0 0 2023-01-04T18:16:54.008 INFO:tasks.workunit.client.0.smithi050.stdout:6/123: fdatasync d0/d8/d1c/f26 0 2023-01-04T18:16:54.010 INFO:tasks.workunit.client.0.smithi050.stdout:5/243: rename d13/d28/l2f to d13/d15/d17/d1f/l4f 0 2023-01-04T18:16:54.010 INFO:tasks.workunit.client.0.smithi050.stdout:5/244: chown d13/d28/f36 49957 1 2023-01-04T18:16:54.012 INFO:tasks.workunit.client.0.smithi050.stdout:8/84: rmdir d3/d5/d17 0 2023-01-04T18:16:54.013 INFO:tasks.workunit.client.0.smithi050.stdout:3/103: creat d0/d1b/f23 x:0 0 0 2023-01-04T18:16:54.039 INFO:tasks.workunit.client.0.smithi050.stdout:7/81: rename d6/db/dc to d6/db/d15 0 2023-01-04T18:16:54.047 INFO:tasks.workunit.client.0.smithi050.stdout:6/124: symlink d0/d9/d25/l28 0 2023-01-04T18:16:54.047 INFO:tasks.workunit.client.0.smithi050.stdout:6/125: readlink d0/d9/d25/l28 0 2023-01-04T18:16:54.049 INFO:tasks.workunit.client.0.smithi050.stdout:5/245: mknod d13/d15/c50 0 2023-01-04T18:16:54.138 INFO:tasks.workunit.client.0.smithi050.stdout:8/85: mkdir d3/dc/d1b 0 2023-01-04T18:16:54.139 INFO:tasks.workunit.client.0.smithi050.stdout:8/86: fdatasync d3/fd 0 2023-01-04T18:16:54.139 INFO:tasks.workunit.client.0.smithi050.stdout:3/104: creat d0/d1a/f24 x:0 0 0 2023-01-04T18:16:54.141 INFO:tasks.workunit.client.0.smithi050.stdout:0/74: rename d0/c3 to d0/c15 0 2023-01-04T18:16:54.141 INFO:tasks.workunit.client.0.smithi050.stdout:7/82: stat d6/db/d15/lf 0 2023-01-04T18:16:54.144 INFO:tasks.workunit.client.0.smithi050.stdout:9/116: rename d1/d3/d13/f1e to d1/d12/f22 0 2023-01-04T18:16:54.145 INFO:tasks.workunit.client.0.smithi050.stdout:5/246: link d13/d28/f36 d13/d15/d17/d27/d46/d4e/d4d/f51 0 2023-01-04T18:16:54.146 INFO:tasks.workunit.client.0.smithi050.stdout:3/105: creat d0/d21/f25 x:0 0 0 2023-01-04T18:16:54.149 INFO:tasks.workunit.client.0.smithi050.stdout:7/83: link d6/f8 d6/db/d15/f16 0 2023-01-04T18:16:54.150 INFO:tasks.workunit.client.0.smithi050.stdout:9/117: dread d1/d3/f18 [0,4194304] 0 2023-01-04T18:16:54.150 INFO:tasks.workunit.client.0.smithi050.stdout:8/87: mknod d3/d5/c1c 0 2023-01-04T18:16:54.150 INFO:tasks.workunit.client.0.smithi050.stdout:8/88: readlink d3/d5/d11/l1a 0 2023-01-04T18:16:54.156 INFO:tasks.workunit.client.0.smithi050.stdout:0/75: symlink d0/l16 0 2023-01-04T18:16:54.159 INFO:tasks.workunit.client.0.smithi050.stdout:7/84: link d6/db/d15/f16 d6/f17 0 2023-01-04T18:16:54.159 INFO:tasks.workunit.client.0.smithi050.stdout:7/85: readlink l3 0 2023-01-04T18:16:54.159 INFO:tasks.workunit.client.0.smithi050.stdout:7/86: readlink l5 0 2023-01-04T18:16:54.161 INFO:tasks.workunit.client.0.smithi050.stdout:9/118: rename d1/d3/d17 to d1/d12/d14/d23 0 2023-01-04T18:16:54.165 INFO:tasks.workunit.client.0.smithi050.stdout:9/119: write d1/d3/d11/f16 [1213647,111401] 0 2023-01-04T18:16:54.167 INFO:tasks.workunit.client.0.smithi050.stdout:7/87: symlink d6/db/l18 0 2023-01-04T18:16:54.167 INFO:tasks.workunit.client.0.smithi050.stdout:3/106: getdents d0/d1a 0 2023-01-04T18:16:54.171 INFO:tasks.workunit.client.0.smithi050.stdout:0/76: link d0/d6/d8/l10 d0/l17 0 2023-01-04T18:16:54.173 INFO:tasks.workunit.client.0.smithi050.stdout:5/247: dwrite d13/d28/f36 [0,4194304] 0 2023-01-04T18:16:54.177 INFO:tasks.workunit.client.0.smithi050.stdout:9/120: mkdir d1/d3/d24 0 2023-01-04T18:16:54.180 INFO:tasks.workunit.client.0.smithi050.stdout:7/88: creat d6/db/f19 x:0 0 0 2023-01-04T18:16:54.181 INFO:tasks.workunit.client.0.smithi050.stdout:8/89: dwrite d3/d5/fe [0,4194304] 0 2023-01-04T18:16:54.182 INFO:tasks.workunit.client.0.smithi050.stdout:8/90: write d3/fd [315952,128254] 0 2023-01-04T18:16:54.182 INFO:tasks.workunit.client.0.smithi050.stdout:3/107: rename d0/dd/l19 to d0/d1b/l26 0 2023-01-04T18:16:54.182 INFO:tasks.workunit.client.0.smithi050.stdout:3/108: chown d0/f18 46449344 1 2023-01-04T18:16:54.216 INFO:tasks.workunit.client.0.smithi050.stdout:8/91: dwrite d3/d5/fe [0,4194304] 0 2023-01-04T18:16:54.220 INFO:tasks.workunit.client.0.smithi050.stdout:8/92: dread d3/fd [0,4194304] 0 2023-01-04T18:16:54.240 INFO:tasks.workunit.client.0.smithi050.stdout:7/89: mkdir d6/d1a 0 2023-01-04T18:16:54.248 INFO:tasks.workunit.client.0.smithi050.stdout:0/77: rename d0/d6/f14 to d0/d6/d8/f18 0 2023-01-04T18:16:54.248 INFO:tasks.workunit.client.0.smithi050.stdout:0/78: chown d0/f5 574 1 2023-01-04T18:16:54.251 INFO:tasks.workunit.client.0.smithi050.stdout:3/109: truncate d0/f3 22806 0 2023-01-04T18:16:54.254 INFO:tasks.workunit.client.0.smithi050.stdout:8/93: creat d3/d5/f1d x:0 0 0 2023-01-04T18:16:54.261 INFO:tasks.workunit.client.0.smithi050.stdout:7/90: mkdir d6/db/d15/d1b 0 2023-01-04T18:16:54.261 INFO:tasks.workunit.client.0.smithi050.stdout:7/91: fsync d6/f11 0 2023-01-04T18:16:54.262 INFO:tasks.workunit.client.0.smithi050.stdout:5/248: rename d13/d15/l21 to d13/d15/d17/d27/d46/d4e/d4d/l52 0 2023-01-04T18:16:54.263 INFO:tasks.workunit.client.0.smithi050.stdout:7/92: dread d6/f8 [0,4194304] 0 2023-01-04T18:16:54.263 INFO:tasks.workunit.client.0.smithi050.stdout:7/93: chown d6 0 1 2023-01-04T18:16:54.263 INFO:tasks.workunit.client.0.smithi050.stdout:7/94: getdents d6/d1a 0 2023-01-04T18:16:54.264 INFO:tasks.workunit.client.0.smithi050.stdout:5/249: dread d13/f18 [0,4194304] 0 2023-01-04T18:16:54.264 INFO:tasks.workunit.client.0.smithi050.stdout:0/79: truncate d0/f4 3460673 0 2023-01-04T18:16:54.264 INFO:tasks.workunit.client.0.smithi050.stdout:0/80: stat d0 0 2023-01-04T18:16:54.265 INFO:tasks.workunit.client.0.smithi050.stdout:5/250: write d13/d15/d17/f1b [2615645,30527] 0 2023-01-04T18:16:54.265 INFO:tasks.workunit.client.0.smithi050.stdout:5/251: dread - d13/f3b zero size 2023-01-04T18:16:54.268 INFO:tasks.workunit.client.0.smithi050.stdout:3/110: creat d0/d21/f27 x:0 0 0 2023-01-04T18:16:54.268 INFO:tasks.workunit.client.0.smithi050.stdout:8/94: symlink d3/dc/l1e 0 2023-01-04T18:16:54.268 INFO:tasks.workunit.client.0.smithi050.stdout:7/95: creat d6/f1c x:0 0 0 2023-01-04T18:16:54.268 INFO:tasks.workunit.client.0.smithi050.stdout:3/111: write d0/d1b/f1c [867291,10107] 0 2023-01-04T18:16:54.268 INFO:tasks.workunit.client.0.smithi050.stdout:0/81: dread d0/f5 [0,4194304] 0 2023-01-04T18:16:54.268 INFO:tasks.workunit.client.0.smithi050.stdout:0/82: chown d0/d6/lc 11 1 2023-01-04T18:16:54.269 INFO:tasks.workunit.client.0.smithi050.stdout:3/112: dread d0/fe [0,4194304] 0 2023-01-04T18:16:54.274 INFO:tasks.workunit.client.0.smithi050.stdout:5/252: creat d13/d15/d17/d1f/f53 x:0 0 0 2023-01-04T18:16:54.276 INFO:tasks.workunit.client.0.smithi050.stdout:8/95: unlink d3/d5/fe 0 2023-01-04T18:16:54.277 INFO:tasks.workunit.client.0.smithi050.stdout:7/96: dread d6/f7 [4194304,4194304] 0 2023-01-04T18:16:54.278 INFO:tasks.workunit.client.0.smithi050.stdout:7/97: write d6/f11 [616465,124558] 0 2023-01-04T18:16:54.278 INFO:tasks.workunit.client.0.smithi050.stdout:0/83: rmdir d0/d6 39 2023-01-04T18:16:54.278 INFO:tasks.workunit.client.0.smithi050.stdout:3/113: mkdir d0/d21/d28 0 2023-01-04T18:16:54.281 INFO:tasks.workunit.client.0.smithi050.stdout:5/253: symlink d13/d15/d17/d1f/d35/d42/d4a/l54 0 2023-01-04T18:16:54.283 INFO:tasks.workunit.client.0.smithi050.stdout:8/96: rename d3/d5/fb to d3/f1f 0 2023-01-04T18:16:54.283 INFO:tasks.workunit.client.0.smithi050.stdout:8/97: chown d3/d5/d11/f18 19 1 2023-01-04T18:16:54.283 INFO:tasks.workunit.client.0.smithi050.stdout:8/98: write d3/d5/f1d [664044,83399] 0 2023-01-04T18:16:54.283 INFO:tasks.workunit.client.0.smithi050.stdout:8/99: chown d3/f1f 166 1 2023-01-04T18:16:54.286 INFO:tasks.workunit.client.0.smithi050.stdout:8/100: dread d3/d5/f1d [0,4194304] 0 2023-01-04T18:16:54.293 INFO:tasks.workunit.client.0.smithi050.stdout:2/65: sync 2023-01-04T18:16:54.293 INFO:tasks.workunit.client.0.smithi050.stdout:4/53: sync 2023-01-04T18:16:54.294 INFO:tasks.workunit.client.0.smithi050.stdout:4/54: write f12 [859837,5546] 0 2023-01-04T18:16:54.294 INFO:tasks.workunit.client.0.smithi050.stdout:4/55: truncate f9 184740 0 2023-01-04T18:16:54.297 INFO:tasks.workunit.client.0.smithi050.stdout:7/98: mkdir d6/d1d 0 2023-01-04T18:16:54.298 INFO:tasks.workunit.client.0.smithi050.stdout:3/114: creat d0/d1a/f29 x:0 0 0 2023-01-04T18:16:54.298 INFO:tasks.workunit.client.0.smithi050.stdout:3/115: read d0/fe [810639,58873] 0 2023-01-04T18:16:54.299 INFO:tasks.workunit.client.0.smithi050.stdout:3/116: write d0/d10/f16 [1092577,7481] 0 2023-01-04T18:16:54.300 INFO:tasks.workunit.client.0.smithi050.stdout:5/254: getdents d13/d28 0 2023-01-04T18:16:54.300 INFO:tasks.workunit.client.0.smithi050.stdout:5/255: fdatasync d13/d28/f36 0 2023-01-04T18:16:54.301 INFO:tasks.workunit.client.0.smithi050.stdout:8/101: creat d3/f20 x:0 0 0 2023-01-04T18:16:54.305 INFO:tasks.workunit.client.0.smithi050.stdout:2/66: symlink d1/d10/l16 0 2023-01-04T18:16:54.306 INFO:tasks.workunit.client.0.smithi050.stdout:4/56: creat f13 x:0 0 0 2023-01-04T18:16:54.306 INFO:tasks.workunit.client.0.smithi050.stdout:4/57: rmdir - no directory 2023-01-04T18:16:54.308 INFO:tasks.workunit.client.0.smithi050.stdout:7/99: creat d6/d1d/f1e x:0 0 0 2023-01-04T18:16:54.308 INFO:tasks.workunit.client.0.smithi050.stdout:7/100: stat d6/d1a 0 2023-01-04T18:16:54.308 INFO:tasks.workunit.client.0.smithi050.stdout:7/101: chown d6/f17 10770 1 2023-01-04T18:16:54.309 INFO:tasks.workunit.client.0.smithi050.stdout:3/117: symlink d0/d21/d28/l2a 0 2023-01-04T18:16:54.309 INFO:tasks.workunit.client.0.smithi050.stdout:5/256: mknod d13/d15/d17/d1f/d35/d42/d4a/c55 0 2023-01-04T18:16:54.312 INFO:tasks.workunit.client.0.smithi050.stdout:8/102: mknod d3/d5/d11/c21 0 2023-01-04T18:16:54.312 INFO:tasks.workunit.client.0.smithi050.stdout:8/103: fdatasync d3/d5/d11/f18 0 2023-01-04T18:16:54.313 INFO:tasks.workunit.client.0.smithi050.stdout:5/257: dread d13/f14 [0,4194304] 0 2023-01-04T18:16:54.320 INFO:tasks.workunit.client.0.smithi050.stdout:2/67: dread d1/f3 [0,4194304] 0 2023-01-04T18:16:54.320 INFO:tasks.workunit.client.0.smithi050.stdout:4/58: mkdir d14 0 2023-01-04T18:16:54.321 INFO:tasks.workunit.client.0.smithi050.stdout:4/59: read f3 [4009915,127633] 0 2023-01-04T18:16:54.321 INFO:tasks.workunit.client.0.smithi050.stdout:4/60: getdents d14 0 2023-01-04T18:16:54.322 INFO:tasks.workunit.client.0.smithi050.stdout:7/102: rename d6/d1a to d6/d1d/d1f 0 2023-01-04T18:16:54.322 INFO:tasks.workunit.client.0.smithi050.stdout:7/103: fsync d6/fd 0 2023-01-04T18:16:54.328 INFO:tasks.workunit.client.0.smithi050.stdout:3/118: mknod d0/d1a/c2b 0 2023-01-04T18:16:54.332 INFO:tasks.workunit.client.0.smithi050.stdout:5/258: rmdir d13/d15/d17 39 2023-01-04T18:16:54.333 INFO:tasks.workunit.client.0.smithi050.stdout:8/104: dwrite d3/f20 [0,4194304] 0 2023-01-04T18:16:54.333 INFO:tasks.workunit.client.0.smithi050.stdout:2/68: symlink d1/dd/d11/l17 0 2023-01-04T18:16:54.333 INFO:tasks.workunit.client.0.smithi050.stdout:2/69: write d1/f6 [1363756,127217] 0 2023-01-04T18:16:54.337 INFO:tasks.workunit.client.0.smithi050.stdout:4/61: creat d14/f15 x:0 0 0 2023-01-04T18:16:54.339 INFO:tasks.workunit.client.0.smithi050.stdout:3/119: creat d0/f2c x:0 0 0 2023-01-04T18:16:54.344 INFO:tasks.workunit.client.0.smithi050.stdout:7/104: dwrite d6/f17 [0,4194304] 0 2023-01-04T18:16:54.344 INFO:tasks.workunit.client.0.smithi050.stdout:4/62: symlink d14/l16 0 2023-01-04T18:16:54.348 INFO:tasks.workunit.client.0.smithi050.stdout:3/120: symlink d0/d1a/l2d 0 2023-01-04T18:16:54.348 INFO:tasks.workunit.client.0.smithi050.stdout:3/121: chown d0/l6 7049204 1 2023-01-04T18:16:54.353 INFO:tasks.workunit.client.0.smithi050.stdout:7/105: getdents d6/db 0 2023-01-04T18:16:54.354 INFO:tasks.workunit.client.0.smithi050.stdout:4/63: mknod d14/c17 0 2023-01-04T18:16:54.355 INFO:tasks.workunit.client.0.smithi050.stdout:3/122: symlink d0/d21/l2e 0 2023-01-04T18:16:54.355 INFO:tasks.workunit.client.0.smithi050.stdout:3/123: write d0/f18 [333283,62523] 0 2023-01-04T18:16:54.355 INFO:tasks.workunit.client.0.smithi050.stdout:3/124: dread - d0/d1a/f29 zero size 2023-01-04T18:16:54.356 INFO:tasks.workunit.client.0.smithi050.stdout:7/106: mkdir d6/db/d20 0 2023-01-04T18:16:54.358 INFO:tasks.workunit.client.0.smithi050.stdout:3/125: mkdir d0/d1b/d2f 0 2023-01-04T18:16:54.359 INFO:tasks.workunit.client.0.smithi050.stdout:4/64: dread f9 [0,4194304] 0 2023-01-04T18:16:54.360 INFO:tasks.workunit.client.0.smithi050.stdout:3/126: mkdir d0/d10/d30 0 2023-01-04T18:16:54.365 INFO:tasks.workunit.client.0.smithi050.stdout:8/105: dwrite d3/d5/d11/f18 [0,4194304] 0 2023-01-04T18:16:54.367 INFO:tasks.workunit.client.0.smithi050.stdout:2/70: dwrite d1/f8 [0,4194304] 0 2023-01-04T18:16:54.369 INFO:tasks.workunit.client.0.smithi050.stdout:8/106: creat d3/f22 x:0 0 0 2023-01-04T18:16:54.371 INFO:tasks.workunit.client.0.smithi050.stdout:5/259: dwrite d13/f19 [0,4194304] 0 2023-01-04T18:16:54.375 INFO:tasks.workunit.client.0.smithi050.stdout:5/260: creat d13/d15/d17/d1f/f56 x:0 0 0 2023-01-04T18:16:54.384 INFO:tasks.workunit.client.0.smithi050.stdout:8/107: dread d3/f20 [0,4194304] 0 2023-01-04T18:16:54.388 INFO:tasks.workunit.client.0.smithi050.stdout:3/127: dwrite d0/f2c [0,4194304] 0 2023-01-04T18:16:54.388 INFO:tasks.workunit.client.0.smithi050.stdout:3/128: write d0/d1b/f1c [997896,107820] 0 2023-01-04T18:16:54.389 INFO:tasks.workunit.client.0.smithi050.stdout:3/129: chown d0/d1a 191114 1 2023-01-04T18:16:54.389 INFO:tasks.workunit.client.0.smithi050.stdout:4/65: dwrite f11 [0,4194304] 0 2023-01-04T18:16:54.389 INFO:tasks.workunit.client.0.smithi050.stdout:4/66: dread - d14/f15 zero size 2023-01-04T18:16:54.404 INFO:tasks.workunit.client.0.smithi050.stdout:4/67: dwrite fc [0,4194304] 0 2023-01-04T18:16:54.406 INFO:tasks.workunit.client.0.smithi050.stdout:7/107: truncate d6/f17 319897 0 2023-01-04T18:16:54.412 INFO:tasks.workunit.client.0.smithi050.stdout:5/261: truncate d13/d15/d17/f4c 1773531 0 2023-01-04T18:16:54.413 INFO:tasks.workunit.client.0.smithi050.stdout:8/108: mkdir d3/dc/d23 0 2023-01-04T18:16:54.416 INFO:tasks.workunit.client.0.smithi050.stdout:3/130: mkdir d0/d1b/d2f/d31 0 2023-01-04T18:16:54.417 INFO:tasks.workunit.client.0.smithi050.stdout:4/68: dwrite f9 [0,4194304] 0 2023-01-04T18:16:54.417 INFO:tasks.workunit.client.0.smithi050.stdout:4/69: write fd [883308,45912] 0 2023-01-04T18:16:54.417 INFO:tasks.workunit.client.0.smithi050.stdout:4/70: fsync f13 0 2023-01-04T18:16:54.471 INFO:tasks.workunit.client.0.smithi050.stdout:1/90: sync 2023-01-04T18:16:54.472 INFO:tasks.workunit.client.0.smithi050.stdout:6/126: sync 2023-01-04T18:16:54.482 INFO:tasks.workunit.client.0.smithi050.stdout:0/84: sync 2023-01-04T18:16:54.482 INFO:tasks.workunit.client.0.smithi050.stdout:9/121: sync 2023-01-04T18:16:54.487 INFO:tasks.workunit.client.0.smithi050.stdout:7/108: truncate d6/fd 232968 0 2023-01-04T18:16:54.490 INFO:tasks.workunit.client.0.smithi050.stdout:5/262: symlink d13/d15/d17/d27/d46/d4e/l57 0 2023-01-04T18:16:54.490 INFO:tasks.workunit.client.0.smithi050.stdout:5/263: write d13/d15/d17/d1f/f56 [657266,10673] 0 2023-01-04T18:16:54.491 INFO:tasks.workunit.client.0.smithi050.stdout:8/109: creat d3/d5/d11/f24 x:0 0 0 2023-01-04T18:16:54.493 INFO:tasks.workunit.client.0.smithi050.stdout:5/264: dread d13/d15/d17/d27/d46/d4e/f3c [0,4194304] 0 2023-01-04T18:16:54.493 INFO:tasks.workunit.client.0.smithi050.stdout:5/265: chown d13/d15/d17/d27/d46/d4e/l57 2050921548 1 2023-01-04T18:16:54.494 INFO:tasks.workunit.client.0.smithi050.stdout:9/122: dwrite d1/d3/f4 [0,4194304] 0 2023-01-04T18:16:54.494 INFO:tasks.workunit.client.0.smithi050.stdout:3/131: rename d0/d21/d28 to d0/d10/d30/d32 0 2023-01-04T18:16:54.500 INFO:tasks.workunit.client.0.smithi050.stdout:4/71: link fe d14/f18 0 2023-01-04T18:16:54.501 INFO:tasks.workunit.client.0.smithi050.stdout:5/266: dread d13/d15/d17/f1b [0,4194304] 0 2023-01-04T18:16:54.502 INFO:tasks.workunit.client.0.smithi050.stdout:6/127: rename d0/d9/f12 to d0/d9/f29 0 2023-01-04T18:16:54.502 INFO:tasks.workunit.client.0.smithi050.stdout:6/128: readlink d0/d9/d25/l28 0 2023-01-04T18:16:54.505 INFO:tasks.workunit.client.0.smithi050.stdout:6/129: read d0/d9/fa [1899683,36134] 0 2023-01-04T18:16:54.506 INFO:tasks.workunit.client.0.smithi050.stdout:6/130: write d0/d9/f29 [4188559,8583] 0 2023-01-04T18:16:54.506 INFO:tasks.workunit.client.0.smithi050.stdout:5/267: fdatasync d13/d15/d17/d1f/f56 0 2023-01-04T18:16:54.506 INFO:tasks.workunit.client.0.smithi050.stdout:5/268: chown d13/d15/d17/d27/d46/d4e 47384 1 2023-01-04T18:16:54.506 INFO:tasks.workunit.client.0.smithi050.stdout:5/269: chown d13/d15/c1d 11 1 2023-01-04T18:16:54.506 INFO:tasks.workunit.client.0.smithi050.stdout:5/270: stat d13/d15/d17/d27/d46/d4e/f3c 0 2023-01-04T18:16:54.507 INFO:tasks.workunit.client.0.smithi050.stdout:1/91: symlink d8/d14/d1d/l24 0 2023-01-04T18:16:54.507 INFO:tasks.workunit.client.0.smithi050.stdout:1/92: fdatasync d8/d14/d1d/f1f 0 2023-01-04T18:16:54.511 INFO:tasks.workunit.client.0.smithi050.stdout:7/109: creat d6/db/d15/d1b/f21 x:0 0 0 2023-01-04T18:16:54.511 INFO:tasks.workunit.client.0.smithi050.stdout:7/110: readlink d6/db/l18 0 2023-01-04T18:16:54.514 INFO:tasks.workunit.client.0.smithi050.stdout:7/111: dread d6/f7 [0,4194304] 0 2023-01-04T18:16:54.514 INFO:tasks.workunit.client.0.smithi050.stdout:7/112: chown d6/db/d15/d1b/f21 6261 1 2023-01-04T18:16:54.516 INFO:tasks.workunit.client.0.smithi050.stdout:4/72: dwrite f0 [0,4194304] 0 2023-01-04T18:16:54.516 INFO:tasks.workunit.client.0.smithi050.stdout:4/73: stat c10 0 2023-01-04T18:16:54.518 INFO:tasks.workunit.client.0.smithi050.stdout:4/74: dread f12 [0,4194304] 0 2023-01-04T18:16:54.518 INFO:tasks.workunit.client.0.smithi050.stdout:4/75: write ff [361601,85954] 0 2023-01-04T18:16:54.518 INFO:tasks.workunit.client.0.smithi050.stdout:4/76: write f7 [1105088,37753] 0 2023-01-04T18:16:54.519 INFO:tasks.workunit.client.0.smithi050.stdout:7/113: write d6/db/d15/f16 [4633,102731] 0 2023-01-04T18:16:54.532 INFO:tasks.workunit.client.0.smithi050.stdout:8/110: creat d3/f25 x:0 0 0 2023-01-04T18:16:54.533 INFO:tasks.workunit.client.0.smithi050.stdout:9/123: getdents d1/d12 0 2023-01-04T18:16:54.534 INFO:tasks.workunit.client.0.smithi050.stdout:3/132: mknod d0/d1b/c33 0 2023-01-04T18:16:54.536 INFO:tasks.workunit.client.0.smithi050.stdout:5/271: getdents d13/d15/d17/d27/d46/d4e/d4d 0 2023-01-04T18:16:54.539 INFO:tasks.workunit.client.0.smithi050.stdout:0/85: mkdir d0/d19 0 2023-01-04T18:16:54.539 INFO:tasks.workunit.client.0.smithi050.stdout:0/86: readlink d0/lf 0 2023-01-04T18:16:54.542 INFO:tasks.workunit.client.0.smithi050.stdout:4/77: link cb d14/c19 0 2023-01-04T18:16:54.544 INFO:tasks.workunit.client.0.smithi050.stdout:7/114: mkdir d6/db/d15/d1b/d22 0 2023-01-04T18:16:54.545 INFO:tasks.workunit.client.0.smithi050.stdout:8/111: rename d3/f22 to d3/d5/d11/f26 0 2023-01-04T18:16:54.553 INFO:tasks.workunit.client.0.smithi050.stdout:1/93: dwrite d8/f9 [0,4194304] 0 2023-01-04T18:16:54.553 INFO:tasks.workunit.client.0.smithi050.stdout:9/124: symlink d1/d3/l25 0 2023-01-04T18:16:54.553 INFO:tasks.workunit.client.0.smithi050.stdout:9/125: stat d1/d12/f22 0 2023-01-04T18:16:54.554 INFO:tasks.workunit.client.0.smithi050.stdout:3/133: symlink d0/d10/d30/l34 0 2023-01-04T18:16:54.557 INFO:tasks.workunit.client.0.smithi050.stdout:5/272: symlink d13/d15/d17/d27/d44/l58 0 2023-01-04T18:16:54.557 INFO:tasks.workunit.client.0.smithi050.stdout:5/273: stat d13/c23 0 2023-01-04T18:16:54.559 INFO:tasks.workunit.client.0.smithi050.stdout:0/87: stat d0/c1 0 2023-01-04T18:16:54.603 INFO:tasks.workunit.client.0.smithi050.stdout:4/78: creat d14/f1a x:0 0 0 2023-01-04T18:16:54.603 INFO:tasks.workunit.client.0.smithi050.stdout:4/79: readlink la 0 2023-01-04T18:16:54.604 INFO:tasks.workunit.client.0.smithi050.stdout:4/80: write d14/f1a [120174,117627] 0 2023-01-04T18:16:54.605 INFO:tasks.workunit.client.0.smithi050.stdout:7/115: rename d6/fd to d6/f23 0 2023-01-04T18:16:54.606 INFO:tasks.workunit.client.0.smithi050.stdout:7/116: dread - d6/f13 zero size 2023-01-04T18:16:54.606 INFO:tasks.workunit.client.0.smithi050.stdout:8/112: stat d3/d5/d11/l1a 0 2023-01-04T18:16:54.612 INFO:tasks.workunit.client.0.smithi050.stdout:1/94: symlink d8/d14/d1c/l25 0 2023-01-04T18:16:54.613 INFO:tasks.workunit.client.0.smithi050.stdout:9/126: getdents d1 0 2023-01-04T18:16:54.615 INFO:tasks.workunit.client.0.smithi050.stdout:5/274: mkdir d13/d15/d17/d1f/d35/d59 0 2023-01-04T18:16:54.620 INFO:tasks.workunit.client.0.smithi050.stdout:0/88: unlink d0/c1 0 2023-01-04T18:16:54.624 INFO:tasks.workunit.client.0.smithi050.stdout:7/117: mkdir d6/db/d15/d1b/d22/d24 0 2023-01-04T18:16:54.626 INFO:tasks.workunit.client.0.smithi050.stdout:4/81: dwrite d14/f15 [0,4194304] 0 2023-01-04T18:16:54.628 INFO:tasks.workunit.client.0.smithi050.stdout:8/113: dwrite d3/f20 [0,4194304] 0 2023-01-04T18:16:54.629 INFO:tasks.workunit.client.0.smithi050.stdout:8/114: chown d3/fd 936232 1 2023-01-04T18:16:54.629 INFO:tasks.workunit.client.0.smithi050.stdout:4/82: read d14/f18 [1870231,100602] 0 2023-01-04T18:16:54.629 INFO:tasks.workunit.client.0.smithi050.stdout:4/83: fdatasync f0 0 2023-01-04T18:16:54.629 INFO:tasks.workunit.client.0.smithi050.stdout:4/84: chown la 5 1 2023-01-04T18:16:54.629 INFO:tasks.workunit.client.0.smithi050.stdout:9/127: unlink d1/d3/lb 0 2023-01-04T18:16:54.631 INFO:tasks.workunit.client.0.smithi050.stdout:5/275: rename d13/f18 to d13/d15/d17/d1f/d35/d42/d4a/f5a 0 2023-01-04T18:16:54.631 INFO:tasks.workunit.client.0.smithi050.stdout:5/276: fdatasync d13/d15/d17/d1f/d35/f3a 0 2023-01-04T18:16:54.631 INFO:tasks.workunit.client.0.smithi050.stdout:0/89: stat d0/d6/d8/c12 0 2023-01-04T18:16:54.634 INFO:tasks.workunit.client.0.smithi050.stdout:1/95: link d8/fd d8/d14/d22/d23/f26 0 2023-01-04T18:16:54.636 INFO:tasks.workunit.client.0.smithi050.stdout:8/115: mkdir d3/d5/d11/d27 0 2023-01-04T18:16:54.636 INFO:tasks.workunit.client.0.smithi050.stdout:8/116: readlink d3/l10 0 2023-01-04T18:16:54.636 INFO:tasks.workunit.client.0.smithi050.stdout:8/117: stat d3/d5/d11/c21 0 2023-01-04T18:16:54.637 INFO:tasks.workunit.client.0.smithi050.stdout:8/118: stat d3/d5/d11/c21 0 2023-01-04T18:16:54.637 INFO:tasks.workunit.client.0.smithi050.stdout:8/119: write d3/fd [350621,70716] 0 2023-01-04T18:16:54.637 INFO:tasks.workunit.client.0.smithi050.stdout:8/120: read d3/d5/d11/f18 [253858,70164] 0 2023-01-04T18:16:54.638 INFO:tasks.workunit.client.0.smithi050.stdout:4/85: mkdir d14/d1b 0 2023-01-04T18:16:54.640 INFO:tasks.workunit.client.0.smithi050.stdout:7/118: rename d6/f17 to d6/db/d15/d1b/d22/f25 0 2023-01-04T18:16:54.641 INFO:tasks.workunit.client.0.smithi050.stdout:5/277: mknod d13/d15/d17/c5b 0 2023-01-04T18:16:54.645 INFO:tasks.workunit.client.0.smithi050.stdout:8/121: unlink d3/d5/d11/f26 0 2023-01-04T18:16:54.645 INFO:tasks.workunit.client.0.smithi050.stdout:8/122: stat d3/d5/d11/f24 0 2023-01-04T18:16:54.645 INFO:tasks.workunit.client.0.smithi050.stdout:4/86: creat d14/f1c x:0 0 0 2023-01-04T18:16:54.647 INFO:tasks.workunit.client.0.smithi050.stdout:9/128: rename d1/d3/f1a to d1/d3/d13/f26 0 2023-01-04T18:16:54.647 INFO:tasks.workunit.client.0.smithi050.stdout:5/278: rename d13 to d13/d5c 22 2023-01-04T18:16:54.647 INFO:tasks.workunit.client.0.smithi050.stdout:9/129: chown d1/d12/f22 1 1 2023-01-04T18:16:54.647 INFO:tasks.workunit.client.0.smithi050.stdout:0/90: dwrite d0/f5 [0,4194304] 0 2023-01-04T18:16:54.648 INFO:tasks.workunit.client.0.smithi050.stdout:2/71: sync 2023-01-04T18:16:54.648 INFO:tasks.workunit.client.0.smithi050.stdout:2/72: fdatasync d1/f3 0 2023-01-04T18:16:54.648 INFO:tasks.workunit.client.0.smithi050.stdout:0/91: write d0/f5 [1772795,49381] 0 2023-01-04T18:16:54.649 INFO:tasks.workunit.client.0.smithi050.stdout:0/92: write d0/d6/fa [2573730,70181] 0 2023-01-04T18:16:54.649 INFO:tasks.workunit.client.0.smithi050.stdout:7/119: rmdir d6/db/d15/d1b/d22/d24 0 2023-01-04T18:16:54.651 INFO:tasks.workunit.client.0.smithi050.stdout:8/123: mkdir d3/dc/d1b/d28 0 2023-01-04T18:16:54.655 INFO:tasks.workunit.client.0.smithi050.stdout:4/87: rename ff to d14/f1d 0 2023-01-04T18:16:54.656 INFO:tasks.workunit.client.0.smithi050.stdout:9/130: getdents d1/d3/d11 0 2023-01-04T18:16:54.656 INFO:tasks.workunit.client.0.smithi050.stdout:9/131: fsync d1/d3/d13/f15 0 2023-01-04T18:16:54.656 INFO:tasks.workunit.client.0.smithi050.stdout:9/132: write d1/d3/d13/f26 [316671,116280] 0 2023-01-04T18:16:54.657 INFO:tasks.workunit.client.0.smithi050.stdout:5/279: symlink d13/d15/d17/d27/l5d 0 2023-01-04T18:16:54.657 INFO:tasks.workunit.client.0.smithi050.stdout:5/280: write d13/d15/d17/d27/d44/f45 [1668640,56486] 0 2023-01-04T18:16:54.669 INFO:tasks.workunit.client.0.smithi050.stdout:1/96: dwrite d8/f13 [0,4194304] 0 2023-01-04T18:16:54.683 INFO:tasks.workunit.client.0.smithi050.stdout:5/281: dwrite d13/f14 [0,4194304] 0 2023-01-04T18:16:54.691 INFO:tasks.workunit.client.0.smithi050.stdout:0/93: dwrite d0/d6/fa [4194304,4194304] 0 2023-01-04T18:16:54.692 INFO:tasks.workunit.client.0.smithi050.stdout:1/97: dwrite d8/d14/d1d/f1f [0,4194304] 0 2023-01-04T18:16:54.698 INFO:tasks.workunit.client.0.smithi050.stdout:0/94: dread d0/f5 [0,4194304] 0 2023-01-04T18:16:54.698 INFO:tasks.workunit.client.0.smithi050.stdout:0/95: fsync d0/d6/d8/f13 0 2023-01-04T18:16:54.699 INFO:tasks.workunit.client.0.smithi050.stdout:5/282: dread d13/f14 [0,4194304] 0 2023-01-04T18:16:54.701 INFO:tasks.workunit.client.0.smithi050.stdout:2/73: symlink d1/d10/l18 0 2023-01-04T18:16:54.701 INFO:tasks.workunit.client.0.smithi050.stdout:2/74: fdatasync d1/f6 0 2023-01-04T18:16:54.704 INFO:tasks.workunit.client.0.smithi050.stdout:1/98: dread d8/f9 [0,4194304] 0 2023-01-04T18:16:54.705 INFO:tasks.workunit.client.0.smithi050.stdout:7/120: getdents d6/db/d15 0 2023-01-04T18:16:54.705 INFO:tasks.workunit.client.0.smithi050.stdout:7/121: read d6/f7 [2555701,67382] 0 2023-01-04T18:16:54.705 INFO:tasks.workunit.client.0.smithi050.stdout:7/122: truncate d6/d1d/f1e 409434 0 2023-01-04T18:16:54.707 INFO:tasks.workunit.client.0.smithi050.stdout:9/133: link d1/d12/d14/d23/f1c d1/d12/d14/f27 0 2023-01-04T18:16:54.708 INFO:tasks.workunit.client.0.smithi050.stdout:9/134: write d1/d3/d11/f16 [2281128,61489] 0 2023-01-04T18:16:54.708 INFO:tasks.workunit.client.0.smithi050.stdout:9/135: truncate d1/d12/d14/d23/f1c 950427 0 2023-01-04T18:16:54.716 INFO:tasks.workunit.client.0.smithi050.stdout:0/96: mkdir d0/d19/d1a 0 2023-01-04T18:16:54.716 INFO:tasks.workunit.client.0.smithi050.stdout:0/97: chown d0/d6/d8 921038968 1 2023-01-04T18:16:54.717 INFO:tasks.workunit.client.0.smithi050.stdout:5/283: mknod d13/d15/d17/d27/d46/c5e 0 2023-01-04T18:16:54.720 INFO:tasks.workunit.client.0.smithi050.stdout:7/123: creat d6/db/d15/f26 x:0 0 0 2023-01-04T18:16:54.720 INFO:tasks.workunit.client.0.smithi050.stdout:7/124: truncate d6/db/d15/f16 934878 0 2023-01-04T18:16:54.721 INFO:tasks.workunit.client.0.smithi050.stdout:9/136: mknod d1/d3/d11/c28 0 2023-01-04T18:16:54.721 INFO:tasks.workunit.client.0.smithi050.stdout:9/137: chown d1/d12/d14/f27 29 1 2023-01-04T18:16:54.722 INFO:tasks.workunit.client.0.smithi050.stdout:9/138: write d1/d3/d13/f26 [1099904,105335] 0 2023-01-04T18:16:54.722 INFO:tasks.workunit.client.0.smithi050.stdout:9/139: write d1/d12/d14/f27 [1301350,109924] 0 2023-01-04T18:16:54.737 INFO:tasks.workunit.client.0.smithi050.stdout:2/75: mkdir d1/d19 0 2023-01-04T18:16:54.740 INFO:tasks.workunit.client.0.smithi050.stdout:7/125: creat d6/f27 x:0 0 0 2023-01-04T18:16:54.741 INFO:tasks.workunit.client.0.smithi050.stdout:5/284: dwrite d13/d28/f3e [0,4194304] 0 2023-01-04T18:16:54.743 INFO:tasks.workunit.client.0.smithi050.stdout:2/76: dread d1/f6 [0,4194304] 0 2023-01-04T18:16:54.743 INFO:tasks.workunit.client.0.smithi050.stdout:2/77: getdents d1/dd/d11/d12 0 2023-01-04T18:16:54.747 INFO:tasks.workunit.client.0.smithi050.stdout:0/98: link d0/d6/c11 d0/c1b 0 2023-01-04T18:16:54.747 INFO:tasks.workunit.client.0.smithi050.stdout:0/99: fdatasync d0/d6/d8/f13 0 2023-01-04T18:16:54.747 INFO:tasks.workunit.client.0.smithi050.stdout:0/100: dread - d0/d6/d8/f13 zero size 2023-01-04T18:16:54.747 INFO:tasks.workunit.client.0.smithi050.stdout:0/101: write d0/f4 [3897527,9277] 0 2023-01-04T18:16:54.749 INFO:tasks.workunit.client.0.smithi050.stdout:1/99: dwrite d8/f19 [0,4194304] 0 2023-01-04T18:16:54.749 INFO:tasks.workunit.client.0.smithi050.stdout:9/140: dwrite d1/d3/d11/f16 [0,4194304] 0 2023-01-04T18:16:54.750 INFO:tasks.workunit.client.0.smithi050.stdout:7/126: mkdir d6/d28 0 2023-01-04T18:16:54.750 INFO:tasks.workunit.client.0.smithi050.stdout:7/127: fdatasync d6/db/d15/d1b/d22/f25 0 2023-01-04T18:16:54.750 INFO:tasks.workunit.client.0.smithi050.stdout:7/128: readlink l5 0 2023-01-04T18:16:54.750 INFO:tasks.workunit.client.0.smithi050.stdout:7/129: chown d6/db/d20 175 1 2023-01-04T18:16:54.750 INFO:tasks.workunit.client.0.smithi050.stdout:7/130: fsync d6/db/d15/fe 0 2023-01-04T18:16:54.751 INFO:tasks.workunit.client.0.smithi050.stdout:5/285: symlink d13/d15/d17/d1f/d35/d49/l5f 0 2023-01-04T18:16:54.751 INFO:tasks.workunit.client.0.smithi050.stdout:0/102: creat d0/d6/d8/f1c x:0 0 0 2023-01-04T18:16:54.758 INFO:tasks.workunit.client.0.smithi050.stdout:9/141: symlink d1/d3/d11/d1f/l29 0 2023-01-04T18:16:54.759 INFO:tasks.workunit.client.0.smithi050.stdout:9/142: write d1/d3/d13/f15 [4552906,65977] 0 2023-01-04T18:16:54.759 INFO:tasks.workunit.client.0.smithi050.stdout:9/143: chown d1/d3/d11/d1f 857762 1 2023-01-04T18:16:54.761 INFO:tasks.workunit.client.0.smithi050.stdout:2/78: dwrite d1/f6 [0,4194304] 0 2023-01-04T18:16:54.763 INFO:tasks.workunit.client.0.smithi050.stdout:7/131: symlink d6/d28/l29 0 2023-01-04T18:16:54.766 INFO:tasks.workunit.client.0.smithi050.stdout:5/286: creat d13/d15/d17/d1f/d35/d49/f60 x:0 0 0 2023-01-04T18:16:54.768 INFO:tasks.workunit.client.0.smithi050.stdout:1/100: mknod d8/c27 0 2023-01-04T18:16:54.768 INFO:tasks.workunit.client.0.smithi050.stdout:1/101: chown c2 575 1 2023-01-04T18:16:54.768 INFO:tasks.workunit.client.0.smithi050.stdout:1/102: chown d8/d14/d22 29780002 1 2023-01-04T18:16:54.768 INFO:tasks.workunit.client.0.smithi050.stdout:1/103: fdatasync d8/d14/d1d/f21 0 2023-01-04T18:16:54.771 INFO:tasks.workunit.client.0.smithi050.stdout:9/144: symlink d1/d3/d11/l2a 0 2023-01-04T18:16:54.777 INFO:tasks.workunit.client.0.smithi050.stdout:2/79: creat d1/f1a x:0 0 0 2023-01-04T18:16:54.778 INFO:tasks.workunit.client.0.smithi050.stdout:9/145: dread d1/d12/d14/f27 [0,4194304] 0 2023-01-04T18:16:54.779 INFO:tasks.workunit.client.0.smithi050.stdout:7/132: link d6/f7 d6/db/f2a 0 2023-01-04T18:16:54.779 INFO:tasks.workunit.client.0.smithi050.stdout:2/80: dread d1/f2 [0,4194304] 0 2023-01-04T18:16:54.780 INFO:tasks.workunit.client.0.smithi050.stdout:5/287: symlink d13/d15/d17/d27/d44/d47/l61 0 2023-01-04T18:16:54.780 INFO:tasks.workunit.client.0.smithi050.stdout:5/288: chown d13/d15/d17/d27/d46/d4e/c33 23457165 1 2023-01-04T18:16:54.781 INFO:tasks.workunit.client.0.smithi050.stdout:0/103: mknod d0/d6/c1d 0 2023-01-04T18:16:54.781 INFO:tasks.workunit.client.0.smithi050.stdout:1/104: mkdir d8/d14/d1c/d28 0 2023-01-04T18:16:54.784 INFO:tasks.workunit.client.0.smithi050.stdout:9/146: symlink d1/d3/d13/l2b 0 2023-01-04T18:16:54.785 INFO:tasks.workunit.client.0.smithi050.stdout:7/133: mkdir d6/d1d/d2b 0 2023-01-04T18:16:54.789 INFO:tasks.workunit.client.0.smithi050.stdout:7/134: dread d6/f8 [0,4194304] 0 2023-01-04T18:16:54.789 INFO:tasks.workunit.client.0.smithi050.stdout:7/135: dread - d6/f1c zero size 2023-01-04T18:16:54.789 INFO:tasks.workunit.client.0.smithi050.stdout:7/136: write d6/db/d15/d1b/d22/f25 [1262670,127274] 0 2023-01-04T18:16:54.789 INFO:tasks.workunit.client.0.smithi050.stdout:7/137: truncate d6/f1c 167478 0 2023-01-04T18:16:54.792 INFO:tasks.workunit.client.0.smithi050.stdout:5/289: mkdir d13/d15/d17/d1f/d62 0 2023-01-04T18:16:54.793 INFO:tasks.workunit.client.0.smithi050.stdout:5/290: write d13/f14 [506137,70887] 0 2023-01-04T18:16:54.794 INFO:tasks.workunit.client.0.smithi050.stdout:0/104: creat d0/f1e x:0 0 0 2023-01-04T18:16:54.795 INFO:tasks.workunit.client.0.smithi050.stdout:9/147: dread d1/d3/f4 [0,4194304] 0 2023-01-04T18:16:54.796 INFO:tasks.workunit.client.0.smithi050.stdout:9/148: stat d1/d3/d11/d1f 0 2023-01-04T18:16:54.796 INFO:tasks.workunit.client.0.smithi050.stdout:9/149: write d1/d12/d14/f27 [2328655,66627] 0 2023-01-04T18:16:54.796 INFO:tasks.workunit.client.0.smithi050.stdout:9/150: write d1/d3/d11/d1f/f21 [607606,71291] 0 2023-01-04T18:16:54.796 INFO:tasks.workunit.client.0.smithi050.stdout:9/151: readlink d1/d3/d11/l2a 0 2023-01-04T18:16:54.797 INFO:tasks.workunit.client.0.smithi050.stdout:7/138: creat d6/d28/f2c x:0 0 0 2023-01-04T18:16:54.797 INFO:tasks.workunit.client.0.smithi050.stdout:7/139: dread - d6/f13 zero size 2023-01-04T18:16:54.798 INFO:tasks.workunit.client.0.smithi050.stdout:5/291: dread d13/d15/d17/f1b [0,4194304] 0 2023-01-04T18:16:54.798 INFO:tasks.workunit.client.0.smithi050.stdout:5/292: stat d13/d15/d17/d27/d46/d4e/f37 0 2023-01-04T18:16:54.799 INFO:tasks.workunit.client.0.smithi050.stdout:0/105: unlink d0/f1e 0 2023-01-04T18:16:54.799 INFO:tasks.workunit.client.0.smithi050.stdout:7/140: dread d6/f11 [0,4194304] 0 2023-01-04T18:16:54.800 INFO:tasks.workunit.client.0.smithi050.stdout:1/105: dwrite d8/f19 [4194304,4194304] 0 2023-01-04T18:16:54.800 INFO:tasks.workunit.client.0.smithi050.stdout:2/81: dread d1/f5 [0,4194304] 0 2023-01-04T18:16:54.800 INFO:tasks.workunit.client.0.smithi050.stdout:7/141: read d6/db/f2a [5258606,93607] 0 2023-01-04T18:16:54.801 INFO:tasks.workunit.client.0.smithi050.stdout:7/142: stat d6/db 0 2023-01-04T18:16:54.802 INFO:tasks.workunit.client.0.smithi050.stdout:5/293: mkdir d13/d15/d63 0 2023-01-04T18:16:54.803 INFO:tasks.workunit.client.0.smithi050.stdout:9/152: dread d1/d12/f22 [0,4194304] 0 2023-01-04T18:16:54.803 INFO:tasks.workunit.client.0.smithi050.stdout:9/153: write d1/d3/f19 [303219,7174] 0 2023-01-04T18:16:54.804 INFO:tasks.workunit.client.0.smithi050.stdout:9/154: write d1/d12/f22 [3347081,56762] 0 2023-01-04T18:16:54.807 INFO:tasks.workunit.client.0.smithi050.stdout:6/131: sync 2023-01-04T18:16:54.808 INFO:tasks.workunit.client.0.smithi050.stdout:1/106: mknod d8/d14/d22/c29 0 2023-01-04T18:16:54.811 INFO:tasks.workunit.client.0.smithi050.stdout:5/294: creat d13/d15/d17/d1f/d35/d42/d4a/f64 x:0 0 0 2023-01-04T18:16:54.813 INFO:tasks.workunit.client.0.smithi050.stdout:0/106: symlink d0/l1f 0 2023-01-04T18:16:54.814 INFO:tasks.workunit.client.0.smithi050.stdout:6/132: symlink d0/d8/d1c/l2a 0 2023-01-04T18:16:54.815 INFO:tasks.workunit.client.0.smithi050.stdout:6/133: read d0/d8/f13 [4314054,39404] 0 2023-01-04T18:16:54.815 INFO:tasks.workunit.client.0.smithi050.stdout:2/82: dwrite d1/f3 [0,4194304] 0 2023-01-04T18:16:54.817 INFO:tasks.workunit.client.0.smithi050.stdout:8/124: sync 2023-01-04T18:16:54.817 INFO:tasks.workunit.client.0.smithi050.stdout:4/88: sync 2023-01-04T18:16:54.818 INFO:tasks.workunit.client.0.smithi050.stdout:3/134: sync 2023-01-04T18:16:54.818 INFO:tasks.workunit.client.0.smithi050.stdout:8/125: read d3/fd [416583,119539] 0 2023-01-04T18:16:54.823 INFO:tasks.workunit.client.0.smithi050.stdout:5/295: rename d13/d15/d17/d1f/d35/d49/f60 to d13/d15/d17/d1f/d35/f65 0 2023-01-04T18:16:54.823 INFO:tasks.workunit.client.0.smithi050.stdout:1/107: dread d8/f13 [0,4194304] 0 2023-01-04T18:16:54.824 INFO:tasks.workunit.client.0.smithi050.stdout:1/108: chown d8/d14/d1d 7558444 1 2023-01-04T18:16:54.824 INFO:tasks.workunit.client.0.smithi050.stdout:7/143: getdents d6/d28 0 2023-01-04T18:16:54.827 INFO:tasks.workunit.client.0.smithi050.stdout:0/107: creat d0/d19/d1a/f20 x:0 0 0 2023-01-04T18:16:54.828 INFO:tasks.workunit.client.0.smithi050.stdout:6/134: creat d0/d9/f2b x:0 0 0 2023-01-04T18:16:54.919 INFO:tasks.workunit.client.0.smithi050.stdout:6/135: dwrite d0/fe [0,4194304] 0 2023-01-04T18:16:54.919 INFO:tasks.workunit.client.0.smithi050.stdout:9/155: dwrite d1/d3/d13/f15 [0,4194304] 0 2023-01-04T18:16:54.919 INFO:tasks.workunit.client.0.smithi050.stdout:9/156: write d1/d3/f4 [3020337,66076] 0 2023-01-04T18:16:54.928 INFO:tasks.workunit.client.0.smithi050.stdout:0/108: dwrite d0/d6/d8/f18 [0,4194304] 0 2023-01-04T18:16:54.928 INFO:tasks.workunit.client.0.smithi050.stdout:0/109: read d0/f4 [3472472,29396] 0 2023-01-04T18:16:54.928 INFO:tasks.workunit.client.0.smithi050.stdout:0/110: readlink d0/d6/lc 0 2023-01-04T18:16:54.940 INFO:tasks.workunit.client.0.smithi050.stdout:0/111: dwrite d0/f4 [0,4194304] 0 2023-01-04T18:16:54.940 INFO:tasks.workunit.client.0.smithi050.stdout:0/112: readlink d0/lf 0 2023-01-04T18:16:54.940 INFO:tasks.workunit.client.0.smithi050.stdout:0/113: read d0/f5 [3160896,8325] 0 2023-01-04T18:16:54.953 INFO:tasks.workunit.client.0.smithi050.stdout:0/114: dwrite d0/f4 [4194304,4194304] 0 2023-01-04T18:16:54.954 INFO:tasks.workunit.client.0.smithi050.stdout:0/115: read d0/f4 [6645603,101185] 0 2023-01-04T18:16:54.961 INFO:tasks.workunit.client.0.smithi050.stdout:4/89: creat d14/d1b/f1e x:0 0 0 2023-01-04T18:16:54.962 INFO:tasks.workunit.client.0.smithi050.stdout:4/90: readlink la 0 2023-01-04T18:16:54.966 INFO:tasks.workunit.client.0.smithi050.stdout:3/135: symlink d0/d1b/d2f/l35 0 2023-01-04T18:16:54.967 INFO:tasks.workunit.client.0.smithi050.stdout:8/126: truncate d3/f20 1583518 0 2023-01-04T18:16:55.025 INFO:tasks.workunit.client.0.smithi050.stdout:3/136: dwrite d0/fb [4194304,4194304] 0 2023-01-04T18:16:55.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:53.918479+0000 mgr.smithi098.vhfzum (mgr.24455) 34 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 734 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s rd, 4.3 MiB/s wr, 124 op/s 2023-01-04T18:16:55.055 INFO:tasks.workunit.client.0.smithi050.stdout:2/83: rename d1/d10/l18 to d1/dd/d11/d14/l1b 0 2023-01-04T18:16:55.055 INFO:tasks.workunit.client.0.smithi050.stdout:5/296: mkdir d13/d15/d66 0 2023-01-04T18:16:55.060 INFO:tasks.workunit.client.0.smithi050.stdout:7/144: creat d6/d1d/d1f/f2d x:0 0 0 2023-01-04T18:16:55.060 INFO:tasks.workunit.client.0.smithi050.stdout:7/145: fdatasync d6/d1d/d1f/f2d 0 2023-01-04T18:16:55.076 INFO:tasks.workunit.client.0.smithi050.stdout:6/136: mknod d0/c2c 0 2023-01-04T18:16:55.079 INFO:tasks.workunit.client.0.smithi050.stdout:6/137: read d0/d8/f15 [1237919,96399] 0 2023-01-04T18:16:55.080 INFO:tasks.workunit.client.0.smithi050.stdout:9/157: symlink d1/d3/l2c 0 2023-01-04T18:16:55.081 INFO:tasks.workunit.client.0.smithi050.stdout:5/297: dwrite d13/d15/d17/d27/f2b [0,4194304] 0 2023-01-04T18:16:55.084 INFO:tasks.workunit.client.0.smithi050.stdout:0/116: truncate d0/f5 1146643 0 2023-01-04T18:16:55.084 INFO:tasks.workunit.client.0.smithi050.stdout:2/84: dwrite d1/f15 [0,4194304] 0 2023-01-04T18:16:55.086 INFO:tasks.workunit.client.0.smithi050.stdout:4/91: mkdir d14/d1b/d1f 0 2023-01-04T18:16:55.100 INFO:tasks.workunit.client.0.smithi050.stdout:2/85: dwrite d1/f2 [4194304,4194304] 0 2023-01-04T18:16:55.105 INFO:tasks.workunit.client.0.smithi050.stdout:7/146: mkdir d6/db/d15/d2e 0 2023-01-04T18:16:55.107 INFO:tasks.workunit.client.0.smithi050.stdout:6/138: rmdir d0/d8/d1c 39 2023-01-04T18:16:55.108 INFO:tasks.workunit.client.0.smithi050.stdout:9/158: mkdir d1/d12/d2d 0 2023-01-04T18:16:55.113 INFO:tasks.workunit.client.0.smithi050.stdout:5/298: truncate d13/d28/f36 3652480 0 2023-01-04T18:16:55.115 INFO:tasks.workunit.client.0.smithi050.stdout:0/117: creat d0/d6/f21 x:0 0 0 2023-01-04T18:16:55.118 INFO:tasks.workunit.client.0.smithi050.stdout:4/92: symlink d14/l20 0 2023-01-04T18:16:55.119 INFO:tasks.workunit.client.0.smithi050.stdout:4/93: write fd [769330,104730] 0 2023-01-04T18:16:55.119 INFO:tasks.workunit.client.0.smithi050.stdout:4/94: chown d14/l16 52 1 2023-01-04T18:16:55.144 INFO:tasks.workunit.client.0.smithi050.stdout:2/86: rename d1/f6 to d1/dd/d11/d12/f1c 0 2023-01-04T18:16:55.145 INFO:tasks.workunit.client.0.smithi050.stdout:2/87: read d1/f3 [3811491,19538] 0 2023-01-04T18:16:55.148 INFO:tasks.workunit.client.0.smithi050.stdout:7/147: unlink d6/db/c12 0 2023-01-04T18:16:55.149 INFO:tasks.workunit.client.0.smithi050.stdout:6/139: mkdir d0/d9/d25/d2d 0 2023-01-04T18:16:55.150 INFO:tasks.workunit.client.0.smithi050.stdout:6/140: dread - d0/d8/f23 zero size 2023-01-04T18:16:55.150 INFO:tasks.workunit.client.0.smithi050.stdout:6/141: chown d0/d9/d25/d2d 693 1 2023-01-04T18:16:55.159 INFO:tasks.workunit.client.0.smithi050.stdout:2/88: dwrite d1/f8 [4194304,4194304] 0 2023-01-04T18:16:55.167 INFO:tasks.workunit.client.0.smithi050.stdout:2/89: dread d1/f2 [4194304,4194304] 0 2023-01-04T18:16:55.223 INFO:tasks.workunit.client.0.smithi050.stdout:1/109: sync 2023-01-04T18:16:55.226 INFO:tasks.workunit.client.0.smithi050.stdout:9/159: symlink d1/d12/d14/d23/l2e 0 2023-01-04T18:16:55.226 INFO:tasks.workunit.client.0.smithi050.stdout:9/160: write d1/d3/d13/f26 [1168288,96650] 0 2023-01-04T18:16:55.226 INFO:tasks.workunit.client.0.smithi050.stdout:9/161: stat d1/la 0 2023-01-04T18:16:55.226 INFO:tasks.workunit.client.0.smithi050.stdout:9/162: write d1/d3/f19 [834274,78411] 0 2023-01-04T18:16:55.231 INFO:tasks.workunit.client.0.smithi050.stdout:0/118: stat d0/l17 0 2023-01-04T18:16:55.231 INFO:tasks.workunit.client.0.smithi050.stdout:0/119: write d0/d19/d1a/f20 [536875,4835] 0 2023-01-04T18:16:55.231 INFO:tasks.workunit.client.0.smithi050.stdout:0/120: chown d0/c1b 15 1 2023-01-04T18:16:55.234 INFO:tasks.workunit.client.0.smithi050.stdout:4/95: getdents d14/d1b 0 2023-01-04T18:16:55.234 INFO:tasks.workunit.client.0.smithi050.stdout:4/96: fsync f3 0 2023-01-04T18:16:55.237 INFO:tasks.workunit.client.0.smithi050.stdout:3/137: sync 2023-01-04T18:16:55.237 INFO:tasks.workunit.client.0.smithi050.stdout:8/127: sync 2023-01-04T18:16:55.240 INFO:tasks.workunit.client.0.smithi050.stdout:7/148: rename d6/db/d15/fe to d6/db/d15/d2e/f2f 0 2023-01-04T18:16:55.242 INFO:tasks.workunit.client.0.smithi050.stdout:6/142: truncate d0/d8/d1c/f26 16011 0 2023-01-04T18:16:55.245 INFO:tasks.workunit.client.0.smithi050.stdout:2/90: unlink d1/la 0 2023-01-04T18:16:55.247 INFO:tasks.workunit.client.0.smithi050.stdout:2/91: write d1/f15 [1317300,20766] 0 2023-01-04T18:16:55.247 INFO:tasks.workunit.client.0.smithi050.stdout:2/92: fsync d1/f1a 0 2023-01-04T18:16:55.247 INFO:tasks.workunit.client.0.smithi050.stdout:1/110: symlink d8/d14/d22/d23/l2a 0 2023-01-04T18:16:55.250 INFO:tasks.workunit.client.0.smithi050.stdout:9/163: getdents d1/d3/d11 0 2023-01-04T18:16:55.254 INFO:tasks.workunit.client.0.smithi050.stdout:4/97: creat d14/f21 x:0 0 0 2023-01-04T18:16:55.255 INFO:tasks.workunit.client.0.smithi050.stdout:8/128: symlink d3/d5/d11/d27/l29 0 2023-01-04T18:16:55.260 INFO:tasks.workunit.client.0.smithi050.stdout:3/138: symlink d0/d10/l36 0 2023-01-04T18:16:55.260 INFO:tasks.workunit.client.0.smithi050.stdout:3/139: write d0/dd/f1e [544467,84363] 0 2023-01-04T18:16:55.260 INFO:tasks.workunit.client.0.smithi050.stdout:3/140: chown d0/d1a/f24 1 1 2023-01-04T18:16:55.260 INFO:tasks.workunit.client.0.smithi050.stdout:3/141: chown d0/d1b/d2f 0 1 2023-01-04T18:16:55.261 INFO:tasks.workunit.client.0.smithi050.stdout:7/149: symlink d6/db/d15/l30 0 2023-01-04T18:16:55.263 INFO:tasks.workunit.client.0.smithi050.stdout:6/143: creat d0/f2e x:0 0 0 2023-01-04T18:16:55.266 INFO:tasks.workunit.client.0.smithi050.stdout:2/93: mknod d1/dd/d11/c1d 0 2023-01-04T18:16:55.269 INFO:tasks.workunit.client.0.smithi050.stdout:9/164: rmdir d1/d3/d11/d1d 0 2023-01-04T18:16:55.269 INFO:tasks.workunit.client.0.smithi050.stdout:9/165: chown d1/d3/d13/f15 478055484 1 2023-01-04T18:16:55.271 INFO:tasks.workunit.client.0.smithi050.stdout:0/121: mkdir d0/d22 0 2023-01-04T18:16:55.272 INFO:tasks.workunit.client.0.smithi050.stdout:4/98: mkdir d14/d1b/d1f/d22 0 2023-01-04T18:16:55.274 INFO:tasks.workunit.client.0.smithi050.stdout:3/142: mknod d0/d10/d30/c37 0 2023-01-04T18:16:55.276 INFO:tasks.workunit.client.0.smithi050.stdout:8/129: dwrite d3/d5/d11/f24 [0,4194304] 0 2023-01-04T18:16:55.276 INFO:tasks.workunit.client.0.smithi050.stdout:6/144: rename d0/d9/f24 to d0/f2f 0 2023-01-04T18:16:55.276 INFO:tasks.workunit.client.0.smithi050.stdout:4/99: rename d14 to d14/d1b/d1f/d22/d23 22 2023-01-04T18:16:55.278 INFO:tasks.workunit.client.0.smithi050.stdout:7/150: dwrite d6/f1c [0,4194304] 0 2023-01-04T18:16:55.278 INFO:tasks.workunit.client.0.smithi050.stdout:2/94: unlink d1/f5 0 2023-01-04T18:16:55.278 INFO:tasks.workunit.client.0.smithi050.stdout:2/95: chown d1/f15 13029639 1 2023-01-04T18:16:55.282 INFO:tasks.workunit.client.0.smithi050.stdout:1/111: write f6 [338436,78694] 0 2023-01-04T18:16:55.283 INFO:tasks.workunit.client.0.smithi050.stdout:9/166: stat d1/d3/d11/d1f 0 2023-01-04T18:16:55.284 INFO:tasks.workunit.client.0.smithi050.stdout:0/122: creat d0/d19/d1a/f23 x:0 0 0 2023-01-04T18:16:55.289 INFO:tasks.workunit.client.0.smithi050.stdout:3/143: rename d0/d1b/l20 to d0/dd/l38 0 2023-01-04T18:16:55.290 INFO:tasks.workunit.client.0.smithi050.stdout:4/100: link f13 d14/f24 0 2023-01-04T18:16:55.301 INFO:tasks.workunit.client.0.smithi050.stdout:7/151: link d6/f27 d6/f31 0 2023-01-04T18:16:55.302 INFO:tasks.workunit.client.0.smithi050.stdout:2/96: mkdir d1/dd/d11/d1e 0 2023-01-04T18:16:55.304 INFO:tasks.workunit.client.0.smithi050.stdout:9/167: rmdir d1/d3/d13 39 2023-01-04T18:16:55.306 INFO:tasks.workunit.client.0.smithi050.stdout:2/97: write d1/f15 [1935057,73142] 0 2023-01-04T18:16:55.315 INFO:tasks.workunit.client.0.smithi050.stdout:0/123: rmdir d0/d6/d8 39 2023-01-04T18:16:55.316 INFO:tasks.workunit.client.0.smithi050.stdout:0/124: read d0/d6/fa [2376082,1075] 0 2023-01-04T18:16:55.317 INFO:tasks.workunit.client.0.smithi050.stdout:8/130: rename d3/d5/d11 to d3/d2a 0 2023-01-04T18:16:55.318 INFO:tasks.workunit.client.0.smithi050.stdout:5/299: sync 2023-01-04T18:16:55.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:53.918479+0000 mgr.smithi098.vhfzum (mgr.24455) 34 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 734 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s rd, 4.3 MiB/s wr, 124 op/s 2023-01-04T18:16:55.374 INFO:tasks.workunit.client.0.smithi050.stdout:3/144: getdents d0/d21 0 2023-01-04T18:16:55.375 INFO:tasks.workunit.client.0.smithi050.stdout:3/145: stat d0 0 2023-01-04T18:16:55.375 INFO:tasks.workunit.client.0.smithi050.stdout:3/146: write d0/f2c [2161992,115706] 0 2023-01-04T18:16:55.377 INFO:tasks.workunit.client.0.smithi050.stdout:2/98: unlink d1/dd/d11/c1d 0 2023-01-04T18:16:55.377 INFO:tasks.workunit.client.0.smithi050.stdout:2/99: chown d1/d19 0 1 2023-01-04T18:16:55.377 INFO:tasks.workunit.client.0.smithi050.stdout:2/100: stat d1/dd/d11/d12/f1c 0 2023-01-04T18:16:55.379 INFO:tasks.workunit.client.0.smithi050.stdout:0/125: unlink d0/f5 0 2023-01-04T18:16:55.384 INFO:tasks.workunit.client.0.smithi050.stdout:6/145: rename d0/d8/f13 to d0/d9/df/f30 0 2023-01-04T18:16:55.384 INFO:tasks.workunit.client.0.smithi050.stdout:6/146: fsync d0/f2f 0 2023-01-04T18:16:55.386 INFO:tasks.workunit.client.0.smithi050.stdout:6/147: dread d0/d8/d1c/f26 [0,4194304] 0 2023-01-04T18:16:55.391 INFO:tasks.workunit.client.0.smithi050.stdout:2/101: symlink d1/d19/l1f 0 2023-01-04T18:16:55.392 INFO:tasks.workunit.client.0.smithi050.stdout:3/147: dwrite d0/dd/f11 [0,4194304] 0 2023-01-04T18:16:55.392 INFO:tasks.workunit.client.0.smithi050.stdout:3/148: dread - d0/d1a/f29 zero size 2023-01-04T18:16:55.392 INFO:tasks.workunit.client.0.smithi050.stdout:3/149: dread - d0/d1a/f29 zero size 2023-01-04T18:16:55.393 INFO:tasks.workunit.client.0.smithi050.stdout:1/112: rename d8/f9 to d8/d14/d1c/d28/f2b 0 2023-01-04T18:16:55.397 INFO:tasks.workunit.client.0.smithi050.stdout:2/102: write d1/f8 [1931,80903] 0 2023-01-04T18:16:55.398 INFO:tasks.workunit.client.0.smithi050.stdout:2/103: chown d1/dd/d11/lf 1176 1 2023-01-04T18:16:55.398 INFO:tasks.workunit.client.0.smithi050.stdout:6/148: getdents d0/d9/d25 0 2023-01-04T18:16:55.399 INFO:tasks.workunit.client.0.smithi050.stdout:0/126: dwrite d0/d6/d8/f1c [0,4194304] 0 2023-01-04T18:16:55.402 INFO:tasks.workunit.client.0.smithi050.stdout:4/101: rename c10 to d14/c25 0 2023-01-04T18:16:55.402 INFO:tasks.workunit.client.0.smithi050.stdout:9/168: rename d1 to d1/d12/d14/d23/d2f 22 2023-01-04T18:16:55.403 INFO:tasks.workunit.client.0.smithi050.stdout:1/113: write d8/fa [333322,42841] 0 2023-01-04T18:16:55.405 INFO:tasks.workunit.client.0.smithi050.stdout:3/150: dwrite d0/dd/f1e [0,4194304] 0 2023-01-04T18:16:55.407 INFO:tasks.workunit.client.0.smithi050.stdout:2/104: getdents d1/dd/d11 0 2023-01-04T18:16:55.408 INFO:tasks.workunit.client.0.smithi050.stdout:6/149: symlink d0/d8/l31 0 2023-01-04T18:16:55.414 INFO:tasks.workunit.client.0.smithi050.stdout:0/127: creat d0/d19/d1a/f24 x:0 0 0 2023-01-04T18:16:55.418 INFO:tasks.workunit.client.0.smithi050.stdout:8/131: rename d3/f1f to d3/dc/f2b 0 2023-01-04T18:16:55.418 INFO:tasks.workunit.client.0.smithi050.stdout:8/132: fsync d3/d2a/f18 0 2023-01-04T18:16:55.419 INFO:tasks.workunit.client.0.smithi050.stdout:4/102: creat d14/d1b/d1f/f26 x:0 0 0 2023-01-04T18:16:55.420 INFO:tasks.workunit.client.0.smithi050.stdout:8/133: read d3/fd [260338,55980] 0 2023-01-04T18:16:55.420 INFO:tasks.workunit.client.0.smithi050.stdout:8/134: chown d3/d2a/l1a 575 1 2023-01-04T18:16:55.420 INFO:tasks.workunit.client.0.smithi050.stdout:1/114: symlink d8/d14/d1c/d28/l2c 0 2023-01-04T18:16:55.423 INFO:tasks.workunit.client.0.smithi050.stdout:3/151: creat d0/d21/f39 x:0 0 0 2023-01-04T18:16:55.424 INFO:tasks.workunit.client.0.smithi050.stdout:3/152: read d0/f4 [4190186,111482] 0 2023-01-04T18:16:55.424 INFO:tasks.workunit.client.0.smithi050.stdout:3/153: chown d0/d10/d30/c37 127 1 2023-01-04T18:16:55.424 INFO:tasks.workunit.client.0.smithi050.stdout:3/154: write d0/d21/f25 [232399,7994] 0 2023-01-04T18:16:55.424 INFO:tasks.workunit.client.0.smithi050.stdout:6/150: symlink d0/l32 0 2023-01-04T18:16:55.425 INFO:tasks.workunit.client.0.smithi050.stdout:4/103: creat d14/d1b/d1f/f27 x:0 0 0 2023-01-04T18:16:55.426 INFO:tasks.workunit.client.0.smithi050.stdout:3/155: mknod d0/d21/c3a 0 2023-01-04T18:16:55.427 INFO:tasks.workunit.client.0.smithi050.stdout:4/104: write f12 [639390,83728] 0 2023-01-04T18:16:55.428 INFO:tasks.workunit.client.0.smithi050.stdout:6/151: mkdir d0/d8/d33 0 2023-01-04T18:16:55.428 INFO:tasks.workunit.client.0.smithi050.stdout:6/152: write d0/d9/d25/f27 [52825,93725] 0 2023-01-04T18:16:55.428 INFO:tasks.workunit.client.0.smithi050.stdout:6/153: readlink d0/d8/d1c/l1f 0 2023-01-04T18:16:55.429 INFO:tasks.workunit.client.0.smithi050.stdout:9/169: rename d1/d3/l9 to d1/d3/d11/l30 0 2023-01-04T18:16:55.432 INFO:tasks.workunit.client.0.smithi050.stdout:3/156: symlink d0/d1b/l3b 0 2023-01-04T18:16:55.434 INFO:tasks.workunit.client.0.smithi050.stdout:4/105: symlink d14/l28 0 2023-01-04T18:16:55.434 INFO:tasks.workunit.client.0.smithi050.stdout:4/106: write d14/d1b/d1f/f26 [213763,116471] 0 2023-01-04T18:16:55.434 INFO:tasks.workunit.client.0.smithi050.stdout:4/107: dread - d14/f1c zero size 2023-01-04T18:16:55.434 INFO:tasks.workunit.client.0.smithi050.stdout:4/108: write f5 [552296,117721] 0 2023-01-04T18:16:55.435 INFO:tasks.workunit.client.0.smithi050.stdout:2/105: rename d1/f2 to d1/dd/d11/d1e/f20 0 2023-01-04T18:16:55.435 INFO:tasks.workunit.client.0.smithi050.stdout:1/115: rename d8/d14 to d8/d14/d1c/d2d 22 2023-01-04T18:16:55.436 INFO:tasks.workunit.client.0.smithi050.stdout:0/128: dwrite d0/f4 [0,4194304] 0 2023-01-04T18:16:55.437 INFO:tasks.workunit.client.0.smithi050.stdout:9/170: symlink d1/d12/d14/d23/l31 0 2023-01-04T18:16:55.438 INFO:tasks.workunit.client.0.smithi050.stdout:9/171: write d1/d3/f1b [1607369,86579] 0 2023-01-04T18:16:55.439 INFO:tasks.workunit.client.0.smithi050.stdout:3/157: unlink d0/d21/c3a 0 2023-01-04T18:16:55.441 INFO:tasks.workunit.client.0.smithi050.stdout:2/106: creat d1/d19/f21 x:0 0 0 2023-01-04T18:16:55.442 INFO:tasks.workunit.client.0.smithi050.stdout:0/129: rmdir d0/d19/d1a 39 2023-01-04T18:16:55.443 INFO:tasks.workunit.client.0.smithi050.stdout:0/130: stat d0/l17 0 2023-01-04T18:16:55.443 INFO:tasks.workunit.client.0.smithi050.stdout:0/131: write d0/d19/d1a/f23 [75926,26646] 0 2023-01-04T18:16:55.446 INFO:tasks.workunit.client.0.smithi050.stdout:9/172: mknod d1/c32 0 2023-01-04T18:16:55.447 INFO:tasks.workunit.client.0.smithi050.stdout:8/135: dwrite d3/f20 [0,4194304] 0 2023-01-04T18:16:55.447 INFO:tasks.workunit.client.0.smithi050.stdout:3/158: symlink d0/d10/l3c 0 2023-01-04T18:16:55.447 INFO:tasks.workunit.client.0.smithi050.stdout:3/159: chown d0/d1a 83158371 1 2023-01-04T18:16:55.448 INFO:tasks.workunit.client.0.smithi050.stdout:2/107: rename d1/dd/d11/d12/f1c to d1/dd/d11/d1e/f22 0 2023-01-04T18:16:55.449 INFO:tasks.workunit.client.0.smithi050.stdout:0/132: getdents d0/d6 0 2023-01-04T18:16:55.452 INFO:tasks.workunit.client.0.smithi050.stdout:9/173: dread d1/d3/d13/f26 [0,4194304] 0 2023-01-04T18:16:55.452 INFO:tasks.workunit.client.0.smithi050.stdout:4/109: dread fc [0,4194304] 0 2023-01-04T18:16:55.453 INFO:tasks.workunit.client.0.smithi050.stdout:8/136: mkdir d3/dc/d1b/d28/d2c 0 2023-01-04T18:16:55.453 INFO:tasks.workunit.client.0.smithi050.stdout:8/137: readlink d3/d2a/d27/l29 0 2023-01-04T18:16:55.454 INFO:tasks.workunit.client.0.smithi050.stdout:3/160: creat d0/d1b/d2f/d31/f3d x:0 0 0 2023-01-04T18:16:55.455 INFO:tasks.workunit.client.0.smithi050.stdout:6/154: dwrite d0/d9/df/f22 [0,4194304] 0 2023-01-04T18:16:55.455 INFO:tasks.workunit.client.0.smithi050.stdout:6/155: fsync d0/fe 0 2023-01-04T18:16:55.460 INFO:tasks.workunit.client.0.smithi050.stdout:1/116: dwrite d8/f13 [4194304,4194304] 0 2023-01-04T18:16:55.460 INFO:tasks.workunit.client.0.smithi050.stdout:1/117: readlink d8/l1a 0 2023-01-04T18:16:55.460 INFO:tasks.workunit.client.0.smithi050.stdout:4/110: dread f4 [0,4194304] 0 2023-01-04T18:16:55.463 INFO:tasks.workunit.client.0.smithi050.stdout:0/133: mkdir d0/d6/d8/d25 0 2023-01-04T18:16:55.464 INFO:tasks.workunit.client.0.smithi050.stdout:0/134: chown d0/l1f 663578 1 2023-01-04T18:16:55.464 INFO:tasks.workunit.client.0.smithi050.stdout:0/135: read d0/d19/d1a/f23 [101463,79363] 0 2023-01-04T18:16:55.469 INFO:tasks.workunit.client.0.smithi050.stdout:9/174: dread d1/d3/d13/f15 [0,4194304] 0 2023-01-04T18:16:55.469 INFO:tasks.workunit.client.0.smithi050.stdout:9/175: write d1/d12/d14/f27 [1310169,89907] 0 2023-01-04T18:16:55.470 INFO:tasks.workunit.client.0.smithi050.stdout:9/176: chown d1/d3/d11/l30 0 1 2023-01-04T18:16:55.470 INFO:tasks.workunit.client.0.smithi050.stdout:9/177: stat d1/d12/d14/d23/f1c 0 2023-01-04T18:16:55.470 INFO:tasks.workunit.client.0.smithi050.stdout:9/178: fdatasync d1/d3/f1b 0 2023-01-04T18:16:55.470 INFO:tasks.workunit.client.0.smithi050.stdout:8/138: dwrite d3/dc/f2b [0,4194304] 0 2023-01-04T18:16:55.470 INFO:tasks.workunit.client.0.smithi050.stdout:8/139: stat d3 0 2023-01-04T18:16:55.497 INFO:tasks.workunit.client.0.smithi050.stdout:2/108: getdents d1/dd/d11/d1e 0 2023-01-04T18:16:55.499 INFO:tasks.workunit.client.0.smithi050.stdout:3/161: rename d0/d1a/ff to d0/d10/f3e 0 2023-01-04T18:16:55.506 INFO:tasks.workunit.client.0.smithi050.stdout:2/109: dread d1/dd/d11/d1e/f22 [0,4194304] 0 2023-01-04T18:16:55.571 INFO:tasks.workunit.client.0.smithi050.stdout:1/118: unlink f7 0 2023-01-04T18:16:55.571 INFO:tasks.workunit.client.0.smithi050.stdout:1/119: write f6 [1445409,18720] 0 2023-01-04T18:16:55.574 INFO:tasks.workunit.client.0.smithi050.stdout:4/111: mknod d14/d1b/c29 0 2023-01-04T18:16:55.635 INFO:tasks.workunit.client.0.smithi050.stdout:0/136: creat d0/d6/f26 x:0 0 0 2023-01-04T18:16:55.635 INFO:tasks.workunit.client.0.smithi050.stdout:0/137: dread - d0/d19/d1a/f24 zero size 2023-01-04T18:16:55.649 INFO:tasks.workunit.client.0.smithi050.stdout:8/140: getdents d3 0 2023-01-04T18:16:55.650 INFO:tasks.workunit.client.0.smithi050.stdout:3/162: mkdir d0/d10/d30/d3f 0 2023-01-04T18:16:55.650 INFO:tasks.workunit.client.0.smithi050.stdout:3/163: stat d0/c1 0 2023-01-04T18:16:55.650 INFO:tasks.workunit.client.0.smithi050.stdout:8/141: dread d3/d5/f1d [0,4194304] 0 2023-01-04T18:16:55.651 INFO:tasks.workunit.client.0.smithi050.stdout:8/142: dread d3/fd [0,4194304] 0 2023-01-04T18:16:55.655 INFO:tasks.workunit.client.0.smithi050.stdout:2/110: creat d1/dd/d11/d14/f23 x:0 0 0 2023-01-04T18:16:55.655 INFO:tasks.workunit.client.0.smithi050.stdout:2/111: readlink d1/dd/d11/l17 0 2023-01-04T18:16:55.656 INFO:tasks.workunit.client.0.smithi050.stdout:2/112: dread - d1/d19/f21 zero size 2023-01-04T18:16:55.656 INFO:tasks.workunit.client.0.smithi050.stdout:2/113: truncate d1/fb 714765 0 2023-01-04T18:16:55.656 INFO:tasks.workunit.client.0.smithi050.stdout:2/114: stat d1/f15 0 2023-01-04T18:16:55.656 INFO:tasks.workunit.client.0.smithi050.stdout:2/115: fsync d1/f8 0 2023-01-04T18:16:55.658 INFO:tasks.workunit.client.0.smithi050.stdout:4/112: mknod d14/c2a 0 2023-01-04T18:16:55.658 INFO:tasks.workunit.client.0.smithi050.stdout:4/113: getdents d14/d1b/d1f/d22 0 2023-01-04T18:16:55.658 INFO:tasks.workunit.client.0.smithi050.stdout:4/114: chown d14/c25 18525 1 2023-01-04T18:16:55.659 INFO:tasks.workunit.client.0.smithi050.stdout:0/138: truncate d0/d6/fa 85258 0 2023-01-04T18:16:55.662 INFO:tasks.workunit.client.0.smithi050.stdout:3/164: unlink d0/c7 0 2023-01-04T18:16:55.663 INFO:tasks.workunit.client.0.smithi050.stdout:3/165: write d0/dd/f11 [1319040,81484] 0 2023-01-04T18:16:55.664 INFO:tasks.workunit.client.0.smithi050.stdout:8/143: mkdir d3/d2a/d2d 0 2023-01-04T18:16:55.669 INFO:tasks.workunit.client.0.smithi050.stdout:2/116: mkdir d1/d10/d24 0 2023-01-04T18:16:55.669 INFO:tasks.workunit.client.0.smithi050.stdout:4/115: creat d14/d1b/d1f/f2b x:0 0 0 2023-01-04T18:16:55.669 INFO:tasks.workunit.client.0.smithi050.stdout:2/117: fdatasync d1/f1a 0 2023-01-04T18:16:55.670 INFO:tasks.workunit.client.0.smithi050.stdout:0/139: mknod d0/d6/d8/c27 0 2023-01-04T18:16:55.671 INFO:tasks.workunit.client.0.smithi050.stdout:7/152: sync 2023-01-04T18:16:55.671 INFO:tasks.workunit.client.0.smithi050.stdout:5/300: sync 2023-01-04T18:16:55.672 INFO:tasks.workunit.client.0.smithi050.stdout:2/118: creat d1/dd/d11/d1e/f25 x:0 0 0 2023-01-04T18:16:55.672 INFO:tasks.workunit.client.0.smithi050.stdout:7/153: unlink d6/d28/l29 0 2023-01-04T18:16:55.672 INFO:tasks.workunit.client.0.smithi050.stdout:7/154: readlink d6/l9 0 2023-01-04T18:16:55.673 INFO:tasks.workunit.client.0.smithi050.stdout:5/301: creat d13/d15/d17/d27/d44/f67 x:0 0 0 2023-01-04T18:16:55.674 INFO:tasks.workunit.client.0.smithi050.stdout:2/119: stat d1/dd/d11/d14/l1b 0 2023-01-04T18:16:55.674 INFO:tasks.workunit.client.0.smithi050.stdout:7/155: mkdir d6/d28/d32 0 2023-01-04T18:16:55.675 INFO:tasks.workunit.client.0.smithi050.stdout:5/302: write d13/d15/d17/f4c [1001091,107473] 0 2023-01-04T18:16:55.676 INFO:tasks.workunit.client.0.smithi050.stdout:5/303: truncate d13/d15/d17/d1f/d35/f65 261094 0 2023-01-04T18:16:55.676 INFO:tasks.workunit.client.0.smithi050.stdout:8/144: dread d3/d2a/f24 [0,4194304] 0 2023-01-04T18:16:55.677 INFO:tasks.workunit.client.0.smithi050.stdout:4/116: dread f4 [0,4194304] 0 2023-01-04T18:16:55.677 INFO:tasks.workunit.client.0.smithi050.stdout:4/117: write f13 [278613,21851] 0 2023-01-04T18:16:55.677 INFO:tasks.workunit.client.0.smithi050.stdout:4/118: dread - d14/f21 zero size 2023-01-04T18:16:55.677 INFO:tasks.workunit.client.0.smithi050.stdout:0/140: write d0/d6/fa [1088842,111689] 0 2023-01-04T18:16:55.678 INFO:tasks.workunit.client.0.smithi050.stdout:3/166: dwrite d0/d21/f27 [0,4194304] 0 2023-01-04T18:16:55.678 INFO:tasks.workunit.client.0.smithi050.stdout:0/141: write d0/f4 [5621919,21026] 0 2023-01-04T18:16:55.679 INFO:tasks.workunit.client.0.smithi050.stdout:2/120: link d1/d19/f21 d1/dd/d11/f26 0 2023-01-04T18:16:55.679 INFO:tasks.workunit.client.0.smithi050.stdout:2/121: readlink d1/dd/d11/lf 0 2023-01-04T18:16:55.679 INFO:tasks.workunit.client.0.smithi050.stdout:2/122: fdatasync d1/f1a 0 2023-01-04T18:16:55.679 INFO:tasks.workunit.client.0.smithi050.stdout:2/123: dread - d1/dd/d11/d14/f23 zero size 2023-01-04T18:16:55.681 INFO:tasks.workunit.client.0.smithi050.stdout:2/124: write d1/dd/d11/d1e/f20 [139068,38394] 0 2023-01-04T18:16:55.683 INFO:tasks.workunit.client.0.smithi050.stdout:3/167: dread d0/f18 [0,4194304] 0 2023-01-04T18:16:55.683 INFO:tasks.workunit.client.0.smithi050.stdout:3/168: dread - d0/d1a/f24 zero size 2023-01-04T18:16:55.683 INFO:tasks.workunit.client.0.smithi050.stdout:3/169: fdatasync d0/d1b/d2f/d31/f3d 0 2023-01-04T18:16:55.683 INFO:tasks.workunit.client.0.smithi050.stdout:3/170: dread - d0/d1b/f23 zero size 2023-01-04T18:16:55.683 INFO:tasks.workunit.client.0.smithi050.stdout:3/171: chown d0/dd/f11 2616 1 2023-01-04T18:16:55.684 INFO:tasks.workunit.client.0.smithi050.stdout:3/172: fsync d0/d1b/d2f/d31/f3d 0 2023-01-04T18:16:55.684 INFO:tasks.workunit.client.0.smithi050.stdout:7/156: link d6/c10 d6/d1d/c33 0 2023-01-04T18:16:55.685 INFO:tasks.workunit.client.0.smithi050.stdout:8/145: mknod d3/dc/d23/c2e 0 2023-01-04T18:16:55.685 INFO:tasks.workunit.client.0.smithi050.stdout:4/119: dread f0 [0,4194304] 0 2023-01-04T18:16:55.685 INFO:tasks.workunit.client.0.smithi050.stdout:4/120: read - d14/f1c zero size 2023-01-04T18:16:55.685 INFO:tasks.workunit.client.0.smithi050.stdout:4/121: chown d14 62657 1 2023-01-04T18:16:55.689 INFO:tasks.workunit.client.0.smithi050.stdout:0/142: rename d0/d19 to d0/d6/d28 0 2023-01-04T18:16:55.692 INFO:tasks.workunit.client.0.smithi050.stdout:5/304: dwrite d13/d15/d17/d27/f2b [0,4194304] 0 2023-01-04T18:16:55.694 INFO:tasks.workunit.client.0.smithi050.stdout:2/125: unlink d1/dd/d11/lf 0 2023-01-04T18:16:55.695 INFO:tasks.workunit.client.0.smithi050.stdout:7/157: mknod d6/d28/d32/c34 0 2023-01-04T18:16:55.700 INFO:tasks.workunit.client.0.smithi050.stdout:0/143: fdatasync d0/f4 0 2023-01-04T18:16:55.700 INFO:tasks.workunit.client.0.smithi050.stdout:0/144: readlink d0/d6/d8/l10 0 2023-01-04T18:16:55.701 INFO:tasks.workunit.client.0.smithi050.stdout:0/145: write d0/d6/f21 [575060,99312] 0 2023-01-04T18:16:55.701 INFO:tasks.workunit.client.0.smithi050.stdout:3/173: dwrite d0/d1a/f29 [0,4194304] 0 2023-01-04T18:16:55.701 INFO:tasks.workunit.client.0.smithi050.stdout:0/146: dread d0/d6/d28/d1a/f23 [0,4194304] 0 2023-01-04T18:16:55.707 INFO:tasks.workunit.client.0.smithi050.stdout:8/146: creat d3/dc/f2f x:0 0 0 2023-01-04T18:16:55.707 INFO:tasks.workunit.client.0.smithi050.stdout:8/147: write d3/fd [590972,37514] 0 2023-01-04T18:16:55.707 INFO:tasks.workunit.client.0.smithi050.stdout:4/122: symlink d14/l2c 0 2023-01-04T18:16:55.709 INFO:tasks.workunit.client.0.smithi050.stdout:5/305: creat d13/d15/d17/d1f/d35/d42/d4a/f68 x:0 0 0 2023-01-04T18:16:55.711 INFO:tasks.workunit.client.0.smithi050.stdout:2/126: creat d1/dd/d11/f27 x:0 0 0 2023-01-04T18:16:55.714 INFO:tasks.workunit.client.0.smithi050.stdout:7/158: rename d6/d1d/d1f/f2d to d6/d1d/f35 0 2023-01-04T18:16:55.714 INFO:tasks.workunit.client.0.smithi050.stdout:7/159: chown d6/f31 0 1 2023-01-04T18:16:55.715 INFO:tasks.workunit.client.0.smithi050.stdout:7/160: write d6/db/d15/d1b/f21 [465399,105865] 0 2023-01-04T18:16:55.719 INFO:tasks.workunit.client.0.smithi050.stdout:3/174: truncate d0/f18 286727 0 2023-01-04T18:16:55.722 INFO:tasks.workunit.client.0.smithi050.stdout:7/161: dread d6/f1c [0,4194304] 0 2023-01-04T18:16:55.722 INFO:tasks.workunit.client.0.smithi050.stdout:7/162: fsync d6/f7 0 2023-01-04T18:16:55.722 INFO:tasks.workunit.client.0.smithi050.stdout:0/147: symlink d0/d6/d28/l29 0 2023-01-04T18:16:55.725 INFO:tasks.workunit.client.0.smithi050.stdout:8/148: mkdir d3/d2a/d30 0 2023-01-04T18:16:55.727 INFO:tasks.workunit.client.0.smithi050.stdout:4/123: rmdir d14/d1b 39 2023-01-04T18:16:55.727 INFO:tasks.workunit.client.0.smithi050.stdout:4/124: write d14/d1b/d1f/f2b [64691,80774] 0 2023-01-04T18:16:55.727 INFO:tasks.workunit.client.0.smithi050.stdout:4/125: write d14/f1d [1303285,8482] 0 2023-01-04T18:16:55.727 INFO:tasks.workunit.client.0.smithi050.stdout:8/149: write d3/d2a/f18 [1420001,22014] 0 2023-01-04T18:16:55.727 INFO:tasks.workunit.client.0.smithi050.stdout:8/150: chown d3 187081091 1 2023-01-04T18:16:55.727 INFO:tasks.workunit.client.0.smithi050.stdout:8/151: stat d3/d2a/d27/l29 0 2023-01-04T18:16:55.727 INFO:tasks.workunit.client.0.smithi050.stdout:8/152: fsync d3/dc/f2f 0 2023-01-04T18:16:55.728 INFO:tasks.workunit.client.0.smithi050.stdout:5/306: truncate d13/d15/d17/d1f/d35/f3f 2557225 0 2023-01-04T18:16:55.730 INFO:tasks.workunit.client.0.smithi050.stdout:4/126: fsync d14/f24 0 2023-01-04T18:16:55.730 INFO:tasks.workunit.client.0.smithi050.stdout:2/127: mkdir d1/dd/d28 0 2023-01-04T18:16:55.730 INFO:tasks.workunit.client.0.smithi050.stdout:2/128: chown d1/dd/d11/d14 1021003 1 2023-01-04T18:16:55.732 INFO:tasks.workunit.client.0.smithi050.stdout:3/175: creat d0/f40 x:0 0 0 2023-01-04T18:16:55.732 INFO:tasks.workunit.client.0.smithi050.stdout:3/176: chown d0/d21/f25 6448508 1 2023-01-04T18:16:55.733 INFO:tasks.workunit.client.0.smithi050.stdout:7/163: creat d6/db/d15/f36 x:0 0 0 2023-01-04T18:16:55.733 INFO:tasks.workunit.client.0.smithi050.stdout:7/164: read - d6/db/f19 zero size 2023-01-04T18:16:55.734 INFO:tasks.workunit.client.0.smithi050.stdout:7/165: readlink d6/db/l18 0 2023-01-04T18:16:55.735 INFO:tasks.workunit.client.0.smithi050.stdout:0/148: creat d0/d6/d8/f2a x:0 0 0 2023-01-04T18:16:55.736 INFO:tasks.workunit.client.0.smithi050.stdout:0/149: fsync d0/d6/d28/d1a/f24 0 2023-01-04T18:16:55.736 INFO:tasks.workunit.client.0.smithi050.stdout:3/177: write d0/f18 [138967,11918] 0 2023-01-04T18:16:55.736 INFO:tasks.workunit.client.0.smithi050.stdout:3/178: truncate d0/f40 239922 0 2023-01-04T18:16:55.736 INFO:tasks.workunit.client.0.smithi050.stdout:3/179: chown d0/d10/d30/d3f 6578 1 2023-01-04T18:16:55.737 INFO:tasks.workunit.client.0.smithi050.stdout:7/166: dread d6/f1c [0,4194304] 0 2023-01-04T18:16:55.737 INFO:tasks.workunit.client.0.smithi050.stdout:3/180: write d0/f4 [460919,58991] 0 2023-01-04T18:16:55.737 INFO:tasks.workunit.client.0.smithi050.stdout:3/181: dread - d0/d1b/d2f/d31/f3d zero size 2023-01-04T18:16:55.739 INFO:tasks.workunit.client.0.smithi050.stdout:8/153: getdents d3/d5 0 2023-01-04T18:16:55.745 INFO:tasks.workunit.client.0.smithi050.stdout:5/307: creat d13/d15/d17/d1f/d35/d42/d4a/f69 x:0 0 0 2023-01-04T18:16:55.750 INFO:tasks.workunit.client.0.smithi050.stdout:4/127: link d14/l2c d14/d1b/d1f/l2d 0 2023-01-04T18:16:55.753 INFO:tasks.workunit.client.0.smithi050.stdout:2/129: dwrite d1/dd/d11/f27 [0,4194304] 0 2023-01-04T18:16:55.754 INFO:tasks.workunit.client.0.smithi050.stdout:7/167: rename d6/d1d/f1e to d6/db/d15/d1b/d22/f37 0 2023-01-04T18:16:55.755 INFO:tasks.workunit.client.0.smithi050.stdout:8/154: unlink d3/d2a/c21 0 2023-01-04T18:16:55.762 INFO:tasks.workunit.client.0.smithi050.stdout:4/128: rmdir d14/d1b/d1f 39 2023-01-04T18:16:55.766 INFO:tasks.workunit.client.0.smithi050.stdout:2/130: rename d1/d10/d24 to d1/dd/d11/d12/d29 0 2023-01-04T18:16:55.767 INFO:tasks.workunit.client.0.smithi050.stdout:3/182: dwrite d0/d1b/d2f/d31/f3d [0,4194304] 0 2023-01-04T18:16:55.767 INFO:tasks.workunit.client.0.smithi050.stdout:3/183: truncate d0/fe 1531294 0 2023-01-04T18:16:55.767 INFO:tasks.workunit.client.0.smithi050.stdout:0/150: dwrite d0/d6/d8/f1c [0,4194304] 0 2023-01-04T18:16:55.768 INFO:tasks.workunit.client.0.smithi050.stdout:7/168: link l5 d6/d1d/d1f/l38 0 2023-01-04T18:16:55.771 INFO:tasks.workunit.client.0.smithi050.stdout:5/308: dwrite d13/d15/d17/d27/d44/f45 [0,4194304] 0 2023-01-04T18:16:55.771 INFO:tasks.workunit.client.0.smithi050.stdout:2/131: mknod d1/dd/d11/d12/c2a 0 2023-01-04T18:16:55.778 INFO:tasks.workunit.client.0.smithi050.stdout:3/184: creat d0/d1b/d2f/d31/f41 x:0 0 0 2023-01-04T18:16:55.778 INFO:tasks.workunit.client.0.smithi050.stdout:8/155: dwrite d3/dc/f2f [0,4194304] 0 2023-01-04T18:16:55.778 INFO:tasks.workunit.client.0.smithi050.stdout:8/156: write d3/f25 [581319,43242] 0 2023-01-04T18:16:55.778 INFO:tasks.workunit.client.0.smithi050.stdout:8/157: write d3/fd [81458,130758] 0 2023-01-04T18:16:55.784 INFO:tasks.workunit.client.0.smithi050.stdout:4/129: dwrite d14/d1b/d1f/f26 [0,4194304] 0 2023-01-04T18:16:55.784 INFO:tasks.workunit.client.0.smithi050.stdout:4/130: chown d14/f15 47 1 2023-01-04T18:16:55.785 INFO:tasks.workunit.client.0.smithi050.stdout:4/131: chown d14/f15 6000246 1 2023-01-04T18:16:55.785 INFO:tasks.workunit.client.0.smithi050.stdout:4/132: write d14/d1b/d1f/f2b [181026,118026] 0 2023-01-04T18:16:55.785 INFO:tasks.workunit.client.0.smithi050.stdout:4/133: write d14/f1a [969448,83384] 0 2023-01-04T18:16:55.785 INFO:tasks.workunit.client.0.smithi050.stdout:4/134: write f5 [939980,33589] 0 2023-01-04T18:16:55.785 INFO:tasks.workunit.client.0.smithi050.stdout:4/135: dread - d14/f1c zero size 2023-01-04T18:16:55.799 INFO:tasks.workunit.client.0.smithi050.stdout:7/169: rename d6/db/d15/f26 to d6/db/d15/d1b/d22/f39 0 2023-01-04T18:16:55.801 INFO:tasks.workunit.client.0.smithi050.stdout:7/170: dread d6/db/d15/d2e/f2f [0,4194304] 0 2023-01-04T18:16:55.801 INFO:tasks.workunit.client.0.smithi050.stdout:8/158: dwrite d3/f20 [0,4194304] 0 2023-01-04T18:16:55.802 INFO:tasks.workunit.client.0.smithi050.stdout:8/159: stat d3/d2a/d27/l29 0 2023-01-04T18:16:55.803 INFO:tasks.workunit.client.0.smithi050.stdout:4/136: dread d14/d1b/d1f/f26 [0,4194304] 0 2023-01-04T18:16:55.806 INFO:tasks.workunit.client.0.smithi050.stdout:2/132: symlink d1/d19/l2b 0 2023-01-04T18:16:55.809 INFO:tasks.workunit.client.0.smithi050.stdout:0/151: dwrite d0/d6/f21 [0,4194304] 0 2023-01-04T18:16:55.810 INFO:tasks.workunit.client.0.smithi050.stdout:3/185: link d0/d1a/f29 d0/d10/f42 0 2023-01-04T18:16:55.811 INFO:tasks.workunit.client.0.smithi050.stdout:3/186: read d0/f4 [570164,123059] 0 2023-01-04T18:16:55.823 INFO:tasks.workunit.client.0.smithi050.stdout:6/156: sync 2023-01-04T18:16:55.823 INFO:tasks.workunit.client.0.smithi050.stdout:9/179: sync 2023-01-04T18:16:55.824 INFO:tasks.workunit.client.0.smithi050.stdout:5/309: rename d13/d15/d17/d27/d44/f67 to d13/d15/d17/d1f/d35/d59/f6a 0 2023-01-04T18:16:55.825 INFO:tasks.workunit.client.0.smithi050.stdout:7/171: dwrite d6/db/f2a [4194304,4194304] 0 2023-01-04T18:16:55.830 INFO:tasks.workunit.client.0.smithi050.stdout:8/160: mkdir d3/dc/d23/d31 0 2023-01-04T18:16:55.831 INFO:tasks.workunit.client.0.smithi050.stdout:8/161: getdents d3/d2a/d30 0 2023-01-04T18:16:55.834 INFO:tasks.workunit.client.0.smithi050.stdout:4/137: mknod d14/d1b/d1f/c2e 0 2023-01-04T18:16:55.834 INFO:tasks.workunit.client.0.smithi050.stdout:4/138: chown d14/d1b/d1f/d22 14 1 2023-01-04T18:16:55.835 INFO:tasks.workunit.client.0.smithi050.stdout:2/133: mkdir d1/dd/d28/d2c 0 2023-01-04T18:16:55.836 INFO:tasks.workunit.client.0.smithi050.stdout:2/134: write d1/dd/d11/d1e/f25 [815790,53094] 0 2023-01-04T18:16:55.836 INFO:tasks.workunit.client.0.smithi050.stdout:2/135: fdatasync d1/dd/d11/d14/f23 0 2023-01-04T18:16:55.836 INFO:tasks.workunit.client.0.smithi050.stdout:2/136: write d1/dd/d11/d1e/f25 [621136,15173] 0 2023-01-04T18:16:55.837 INFO:tasks.workunit.client.0.smithi050.stdout:4/139: dread f0 [0,4194304] 0 2023-01-04T18:16:55.838 INFO:tasks.workunit.client.0.smithi050.stdout:1/120: sync 2023-01-04T18:16:55.838 INFO:tasks.workunit.client.0.smithi050.stdout:1/121: write d8/d14/d22/d23/f26 [359863,25615] 0 2023-01-04T18:16:55.838 INFO:tasks.workunit.client.0.smithi050.stdout:1/122: chown d8/d14/d22/d23/f26 0 1 2023-01-04T18:16:55.838 INFO:tasks.workunit.client.0.smithi050.stdout:4/140: write d14/d1b/d1f/f26 [4473725,40911] 0 2023-01-04T18:16:55.839 INFO:tasks.workunit.client.0.smithi050.stdout:4/141: chown d14/d1b/d1f/d22 389 1 2023-01-04T18:16:55.839 INFO:tasks.workunit.client.0.smithi050.stdout:7/172: dwrite d6/f27 [0,4194304] 0 2023-01-04T18:16:55.839 INFO:tasks.workunit.client.0.smithi050.stdout:7/173: truncate d6/f13 690221 0 2023-01-04T18:16:55.840 INFO:tasks.workunit.client.0.smithi050.stdout:7/174: write d6/db/d15/d1b/d22/f37 [602969,94031] 0 2023-01-04T18:16:55.842 INFO:tasks.workunit.client.0.smithi050.stdout:0/152: rmdir d0/d6 39 2023-01-04T18:16:55.842 INFO:tasks.workunit.client.0.smithi050.stdout:0/153: chown d0/d6/d8/cd 0 1 2023-01-04T18:16:55.844 INFO:tasks.workunit.client.0.smithi050.stdout:3/187: symlink d0/d10/d30/d3f/l43 0 2023-01-04T18:16:55.846 INFO:tasks.workunit.client.0.smithi050.stdout:9/180: mkdir d1/d3/d11/d1f/d33 0 2023-01-04T18:16:55.846 INFO:tasks.workunit.client.0.smithi050.stdout:9/181: fsync d1/d3/f19 0 2023-01-04T18:16:55.848 INFO:tasks.workunit.client.0.smithi050.stdout:6/157: symlink d0/d9/d25/d2d/l34 0 2023-01-04T18:16:55.850 INFO:tasks.workunit.client.0.smithi050.stdout:1/123: dwrite d8/f11 [0,4194304] 0 2023-01-04T18:16:55.855 INFO:tasks.workunit.client.0.smithi050.stdout:5/310: truncate d13/d15/d17/f1b 1606786 0 2023-01-04T18:16:55.855 INFO:tasks.workunit.client.0.smithi050.stdout:8/162: symlink d3/dc/l32 0 2023-01-04T18:16:55.856 INFO:tasks.workunit.client.0.smithi050.stdout:8/163: readlink d3/l10 0 2023-01-04T18:16:55.857 INFO:tasks.workunit.client.0.smithi050.stdout:5/311: dread d13/d15/d17/d1f/d35/d42/d4a/f5a [0,4194304] 0 2023-01-04T18:16:55.857 INFO:tasks.workunit.client.0.smithi050.stdout:5/312: write d13/d15/d17/d27/d46/d4e/f3c [1087163,65226] 0 2023-01-04T18:16:55.859 INFO:tasks.workunit.client.0.smithi050.stdout:2/137: creat d1/dd/d28/d2c/f2d x:0 0 0 2023-01-04T18:16:55.860 INFO:tasks.workunit.client.0.smithi050.stdout:4/142: creat d14/d1b/f2f x:0 0 0 2023-01-04T18:16:55.860 INFO:tasks.workunit.client.0.smithi050.stdout:4/143: stat la 0 2023-01-04T18:16:55.861 INFO:tasks.workunit.client.0.smithi050.stdout:6/158: dread d0/d9/fa [0,4194304] 0 2023-01-04T18:16:55.864 INFO:tasks.workunit.client.0.smithi050.stdout:6/159: dread d0/d8/f15 [0,4194304] 0 2023-01-04T18:16:55.865 INFO:tasks.workunit.client.0.smithi050.stdout:7/175: mkdir d6/db/d3a 0 2023-01-04T18:16:55.865 INFO:tasks.workunit.client.0.smithi050.stdout:0/154: creat d0/d22/f2b x:0 0 0 2023-01-04T18:16:55.866 INFO:tasks.workunit.client.0.smithi050.stdout:0/155: stat d0/d6/d28/d1a/f20 0 2023-01-04T18:16:55.868 INFO:tasks.workunit.client.0.smithi050.stdout:6/160: write d0/d8/fd [8325886,13555] 0 2023-01-04T18:16:55.869 INFO:tasks.workunit.client.0.smithi050.stdout:1/124: dwrite f1 [0,4194304] 0 2023-01-04T18:16:55.869 INFO:tasks.workunit.client.0.smithi050.stdout:3/188: getdents d0/d10/d30 0 2023-01-04T18:16:55.879 INFO:tasks.workunit.client.0.smithi050.stdout:2/138: dread d1/f15 [0,4194304] 0 2023-01-04T18:16:55.879 INFO:tasks.workunit.client.0.smithi050.stdout:2/139: dread - d1/dd/d11/f26 zero size 2023-01-04T18:16:55.879 INFO:tasks.workunit.client.0.smithi050.stdout:2/140: write d1/dd/d11/f26 [297479,39812] 0 2023-01-04T18:16:55.881 INFO:tasks.workunit.client.0.smithi050.stdout:0/156: dread d0/d6/d8/f1c [0,4194304] 0 2023-01-04T18:16:55.881 INFO:tasks.workunit.client.0.smithi050.stdout:0/157: chown d0/l1f 22 1 2023-01-04T18:16:55.885 INFO:tasks.workunit.client.0.smithi050.stdout:4/144: dwrite f4 [4194304,4194304] 0 2023-01-04T18:16:55.904 INFO:tasks.workunit.client.0.smithi050.stdout:9/182: dwrite d1/d3/d11/f16 [0,4194304] 0 2023-01-04T18:16:55.905 INFO:tasks.workunit.client.0.smithi050.stdout:0/158: dwrite d0/d6/d28/d1a/f20 [0,4194304] 0 2023-01-04T18:16:55.905 INFO:tasks.workunit.client.0.smithi050.stdout:0/159: stat d0/f4 0 2023-01-04T18:16:55.919 INFO:tasks.workunit.client.0.smithi050.stdout:9/183: dwrite d1/d3/f4 [0,4194304] 0 2023-01-04T18:16:55.919 INFO:tasks.workunit.client.0.smithi050.stdout:9/184: fdatasync d1/d12/d14/d23/f1c 0 2023-01-04T18:16:55.936 INFO:tasks.workunit.client.0.smithi050.stdout:8/164: creat d3/d2a/d27/f33 x:0 0 0 2023-01-04T18:16:55.937 INFO:tasks.workunit.client.0.smithi050.stdout:8/165: read d3/dc/f2b [2252734,82569] 0 2023-01-04T18:16:55.938 INFO:tasks.workunit.client.0.smithi050.stdout:8/166: write d3/dc/f2f [1414958,45016] 0 2023-01-04T18:16:55.941 INFO:tasks.workunit.client.0.smithi050.stdout:5/313: rename ca to d13/d15/d66/c6b 0 2023-01-04T18:16:55.946 INFO:tasks.workunit.client.0.smithi050.stdout:7/176: unlink d6/f11 0 2023-01-04T18:16:55.947 INFO:tasks.workunit.client.0.smithi050.stdout:5/314: dread d13/d28/f36 [0,4194304] 0 2023-01-04T18:16:55.949 INFO:tasks.workunit.client.0.smithi050.stdout:7/177: dread d6/f1c [0,4194304] 0 2023-01-04T18:16:55.950 INFO:tasks.workunit.client.0.smithi050.stdout:8/167: dread d3/d2a/f18 [0,4194304] 0 2023-01-04T18:16:55.951 INFO:tasks.workunit.client.0.smithi050.stdout:8/168: write d3/f20 [1054638,40471] 0 2023-01-04T18:16:55.954 INFO:tasks.workunit.client.0.smithi050.stdout:1/125: write d8/fe [5546120,2142] 0 2023-01-04T18:16:55.960 INFO:tasks.workunit.client.0.smithi050.stdout:3/189: getdents d0/d10/d30/d32 0 2023-01-04T18:16:55.960 INFO:tasks.workunit.client.0.smithi050.stdout:3/190: chown d0/d10/d30/l34 15812 1 2023-01-04T18:16:55.961 INFO:tasks.workunit.client.0.smithi050.stdout:2/141: mkdir d1/dd/d28/d2c/d2e 0 2023-01-04T18:16:55.962 INFO:tasks.workunit.client.0.smithi050.stdout:2/142: write d1/d19/f21 [1206256,65049] 0 2023-01-04T18:16:55.963 INFO:tasks.workunit.client.0.smithi050.stdout:3/191: dread d0/d1b/f1c [0,4194304] 0 2023-01-04T18:16:55.975 INFO:tasks.workunit.client.0.smithi050.stdout:4/145: mknod d14/d1b/d1f/d22/c30 0 2023-01-04T18:16:55.990 INFO:tasks.workunit.client.0.smithi050.stdout:0/160: link d0/d6/d8/cd d0/d6/d28/d1a/c2c 0 2023-01-04T18:16:55.991 INFO:tasks.workunit.client.0.smithi050.stdout:0/161: write d0/d6/f21 [1036179,26462] 0 2023-01-04T18:16:55.992 INFO:tasks.workunit.client.0.smithi050.stdout:9/185: mkdir d1/d12/d34 0 2023-01-04T18:16:55.992 INFO:tasks.workunit.client.0.smithi050.stdout:0/162: write d0/d6/d28/d1a/f20 [376511,107789] 0 2023-01-04T18:16:55.992 INFO:tasks.workunit.client.0.smithi050.stdout:0/163: chown d0/d6/d8 31805778 1 2023-01-04T18:16:56.002 INFO:tasks.workunit.client.0.smithi050.stdout:5/315: creat d13/d15/d17/d27/f6c x:0 0 0 2023-01-04T18:16:56.009 INFO:tasks.workunit.client.0.smithi050.stdout:7/178: mkdir d6/db/d3b 0 2023-01-04T18:16:56.010 INFO:tasks.workunit.client.0.smithi050.stdout:7/179: write d6/db/d15/f16 [290239,125099] 0 2023-01-04T18:16:56.011 INFO:tasks.workunit.client.0.smithi050.stdout:8/169: rename d3/dc/d23/c2e to d3/d2a/d27/c34 0 2023-01-04T18:16:56.014 INFO:tasks.workunit.client.0.smithi050.stdout:1/126: symlink d8/d14/d1c/l2e 0 2023-01-04T18:16:56.015 INFO:tasks.workunit.client.0.smithi050.stdout:2/143: symlink d1/dd/d28/l2f 0 2023-01-04T18:16:56.018 INFO:tasks.workunit.client.0.smithi050.stdout:3/192: creat d0/d1b/d2f/f44 x:0 0 0 2023-01-04T18:16:56.021 INFO:tasks.workunit.client.0.smithi050.stdout:4/146: creat d14/f31 x:0 0 0 2023-01-04T18:16:56.022 INFO:tasks.workunit.client.0.smithi050.stdout:9/186: rmdir d1/d3/d11/d1f/d33 0 2023-01-04T18:16:56.025 INFO:tasks.workunit.client.0.smithi050.stdout:0/164: creat d0/f2d x:0 0 0 2023-01-04T18:16:56.026 INFO:tasks.workunit.client.0.smithi050.stdout:5/316: creat d13/d15/d17/d1f/f6d x:0 0 0 2023-01-04T18:16:56.026 INFO:tasks.workunit.client.0.smithi050.stdout:5/317: chown d13/d15/d17/d1f/d35/d42/d4a/f69 117 1 2023-01-04T18:16:56.026 INFO:tasks.workunit.client.0.smithi050.stdout:5/318: truncate d13/d15/d17/d1f/d35/f65 1123109 0 2023-01-04T18:16:56.026 INFO:tasks.workunit.client.0.smithi050.stdout:5/319: stat d13/d15/d17/d27/l5d 0 2023-01-04T18:16:56.027 INFO:tasks.workunit.client.0.smithi050.stdout:7/180: rmdir d6/d28/d32 39 2023-01-04T18:16:56.028 INFO:tasks.workunit.client.0.smithi050.stdout:9/187: write d1/d3/d11/d1f/f21 [193576,12300] 0 2023-01-04T18:16:56.028 INFO:tasks.workunit.client.0.smithi050.stdout:7/181: write d6/f31 [2541728,78812] 0 2023-01-04T18:16:56.028 INFO:tasks.workunit.client.0.smithi050.stdout:0/165: write d0/d6/f21 [490568,121774] 0 2023-01-04T18:16:56.029 INFO:tasks.workunit.client.0.smithi050.stdout:8/170: dwrite d3/f20 [4194304,4194304] 0 2023-01-04T18:16:56.029 INFO:tasks.workunit.client.0.smithi050.stdout:8/171: fsync d3/d2a/f24 0 2023-01-04T18:16:56.030 INFO:tasks.workunit.client.0.smithi050.stdout:2/144: creat d1/dd/d11/d14/f30 x:0 0 0 2023-01-04T18:16:56.030 INFO:tasks.workunit.client.0.smithi050.stdout:4/147: mkdir d14/d1b/d32 0 2023-01-04T18:16:56.030 INFO:tasks.workunit.client.0.smithi050.stdout:4/148: chown d14/f1c 787135 1 2023-01-04T18:16:56.032 INFO:tasks.workunit.client.0.smithi050.stdout:5/320: symlink d13/d15/d17/d1f/d35/d59/l6e 0 2023-01-04T18:16:56.032 INFO:tasks.workunit.client.0.smithi050.stdout:5/321: truncate d13/d15/d17/d27/d46/d4e/f37 919180 0 2023-01-04T18:16:56.032 INFO:tasks.workunit.client.0.smithi050.stdout:5/322: write d13/d15/d17/d1f/f56 [1382863,66521] 0 2023-01-04T18:16:56.033 INFO:tasks.workunit.client.0.smithi050.stdout:1/127: rename f1 to d8/f2f 0 2023-01-04T18:16:56.034 INFO:tasks.workunit.client.0.smithi050.stdout:9/188: link d1/d3/l2c d1/d3/l35 0 2023-01-04T18:16:56.038 INFO:tasks.workunit.client.0.smithi050.stdout:7/182: mkdir d6/d28/d3c 0 2023-01-04T18:16:56.043 INFO:tasks.workunit.client.0.smithi050.stdout:8/172: link d3/d2a/d27/l29 d3/d2a/d30/l35 0 2023-01-04T18:16:56.043 INFO:tasks.workunit.client.0.smithi050.stdout:8/173: fsync d3/d2a/f24 0 2023-01-04T18:16:56.043 INFO:tasks.workunit.client.0.smithi050.stdout:3/193: dwrite d0/f40 [0,4194304] 0 2023-01-04T18:16:56.046 INFO:tasks.workunit.client.0.smithi050.stdout:2/145: mknod d1/d10/c31 0 2023-01-04T18:16:56.047 INFO:tasks.workunit.client.0.smithi050.stdout:4/149: mknod d14/d1b/c33 0 2023-01-04T18:16:56.048 INFO:tasks.workunit.client.0.smithi050.stdout:1/128: dread d8/f13 [4194304,4194304] 0 2023-01-04T18:16:56.048 INFO:tasks.workunit.client.0.smithi050.stdout:1/129: fsync d8/f11 0 2023-01-04T18:16:56.051 INFO:tasks.workunit.client.0.smithi050.stdout:9/189: truncate d1/d3/f1b 206134 0 2023-01-04T18:16:56.052 INFO:tasks.workunit.client.0.smithi050.stdout:9/190: read d1/d3/f19 [713884,4937] 0 2023-01-04T18:16:56.056 INFO:tasks.workunit.client.0.smithi050.stdout:7/183: link d6/f1c d6/d28/f3d 0 2023-01-04T18:16:56.057 INFO:tasks.workunit.client.0.smithi050.stdout:0/166: dwrite d0/d6/d8/f13 [0,4194304] 0 2023-01-04T18:16:56.058 INFO:tasks.workunit.client.0.smithi050.stdout:5/323: dwrite d13/d15/d17/d1f/d35/d42/d4a/f5a [0,4194304] 0 2023-01-04T18:16:56.058 INFO:tasks.workunit.client.0.smithi050.stdout:8/174: creat d3/dc/d23/f36 x:0 0 0 2023-01-04T18:16:56.059 INFO:tasks.workunit.client.0.smithi050.stdout:8/175: write d3/d5/f1d [848029,35215] 0 2023-01-04T18:16:56.070 INFO:tasks.workunit.client.0.smithi050.stdout:3/194: getdents d0/d10/d30/d3f 0 2023-01-04T18:16:56.074 INFO:tasks.workunit.client.0.smithi050.stdout:2/146: rmdir d1/dd/d11/d12/d29 0 2023-01-04T18:16:56.079 INFO:tasks.workunit.client.0.smithi050.stdout:4/150: creat d14/d1b/d1f/d22/f34 x:0 0 0 2023-01-04T18:16:56.080 INFO:tasks.workunit.client.0.smithi050.stdout:4/151: fdatasync d14/d1b/f1e 0 2023-01-04T18:16:56.080 INFO:tasks.workunit.client.0.smithi050.stdout:4/152: write d14/d1b/d1f/f27 [822247,86877] 0 2023-01-04T18:16:56.080 INFO:tasks.workunit.client.0.smithi050.stdout:1/130: truncate d8/f13 3001525 0 2023-01-04T18:16:56.083 INFO:tasks.workunit.client.0.smithi050.stdout:9/191: creat d1/d3/d13/f36 x:0 0 0 2023-01-04T18:16:56.083 INFO:tasks.workunit.client.0.smithi050.stdout:2/147: dread d1/dd/d11/f27 [0,4194304] 0 2023-01-04T18:16:56.084 INFO:tasks.workunit.client.0.smithi050.stdout:7/184: symlink d6/db/d15/d1b/l3e 0 2023-01-04T18:16:56.085 INFO:tasks.workunit.client.0.smithi050.stdout:7/185: chown d6/db/l18 3192286 1 2023-01-04T18:16:56.085 INFO:tasks.workunit.client.0.smithi050.stdout:7/186: readlink d6/db/d15/lf 0 2023-01-04T18:16:56.088 INFO:tasks.workunit.client.0.smithi050.stdout:1/131: dread d8/f11 [0,4194304] 0 2023-01-04T18:16:56.091 INFO:tasks.workunit.client.0.smithi050.stdout:9/192: dread d1/d12/d14/f27 [0,4194304] 0 2023-01-04T18:16:56.092 INFO:tasks.workunit.client.0.smithi050.stdout:3/195: dwrite d0/fe [0,4194304] 0 2023-01-04T18:16:56.092 INFO:tasks.workunit.client.0.smithi050.stdout:3/196: stat d0/d1a/c2b 0 2023-01-04T18:16:56.092 INFO:tasks.workunit.client.0.smithi050.stdout:3/197: write d0/d1b/f23 [203459,94041] 0 2023-01-04T18:16:56.093 INFO:tasks.workunit.client.0.smithi050.stdout:0/167: creat d0/d22/f2e x:0 0 0 2023-01-04T18:16:56.109 INFO:tasks.workunit.client.0.smithi050.stdout:8/176: mknod d3/c37 0 2023-01-04T18:16:56.110 INFO:tasks.workunit.client.0.smithi050.stdout:4/153: creat d14/d1b/d32/f35 x:0 0 0 2023-01-04T18:16:56.162 INFO:tasks.workunit.client.0.smithi050.stdout:2/148: mknod d1/dd/d28/d2c/d2e/c32 0 2023-01-04T18:16:56.163 INFO:tasks.workunit.client.0.smithi050.stdout:7/187: symlink d6/db/d3b/l3f 0 2023-01-04T18:16:56.163 INFO:tasks.workunit.client.0.smithi050.stdout:7/188: write d6/db/d15/d1b/d22/f37 [885354,62677] 0 2023-01-04T18:16:56.163 INFO:tasks.workunit.client.0.smithi050.stdout:7/189: stat d6/db/d15/d1b 0 2023-01-04T18:16:56.164 INFO:tasks.workunit.client.0.smithi050.stdout:1/132: creat d8/d14/f30 x:0 0 0 2023-01-04T18:16:56.164 INFO:tasks.workunit.client.0.smithi050.stdout:1/133: read d8/fd [375000,114729] 0 2023-01-04T18:16:56.165 INFO:tasks.workunit.client.0.smithi050.stdout:9/193: truncate d1/d12/f22 2172085 0 2023-01-04T18:16:56.167 INFO:tasks.workunit.client.0.smithi050.stdout:9/194: dread d1/d3/d11/d1f/f21 [0,4194304] 0 2023-01-04T18:16:56.170 INFO:tasks.workunit.client.0.smithi050.stdout:3/198: mkdir d0/dd/d45 0 2023-01-04T18:16:56.172 INFO:tasks.workunit.client.0.smithi050.stdout:0/168: symlink d0/d22/l2f 0 2023-01-04T18:16:56.172 INFO:tasks.workunit.client.0.smithi050.stdout:0/169: fdatasync d0/d6/f26 0 2023-01-04T18:16:56.180 INFO:tasks.workunit.client.0.smithi050.stdout:5/324: truncate d13/d15/d17/d27/d46/d4e/f37 272076 0 2023-01-04T18:16:56.182 INFO:tasks.workunit.client.0.smithi050.stdout:8/177: symlink d3/l38 0 2023-01-04T18:16:56.186 INFO:tasks.workunit.client.0.smithi050.stdout:6/161: sync 2023-01-04T18:16:56.309 INFO:tasks.workunit.client.0.smithi050.stdout:8/178: dwrite d3/d2a/d27/f33 [0,4194304] 0 2023-01-04T18:16:56.309 INFO:tasks.workunit.client.0.smithi050.stdout:8/179: truncate d3/d5/f1d 984272 0 2023-01-04T18:16:56.311 INFO:tasks.workunit.client.0.smithi050.stdout:2/149: creat d1/dd/d11/d14/f33 x:0 0 0 2023-01-04T18:16:56.312 INFO:tasks.workunit.client.0.smithi050.stdout:2/150: chown d1/dd/d11/d1e/f25 1761 1 2023-01-04T18:16:56.318 INFO:tasks.workunit.client.0.smithi050.stdout:7/190: getdents d6/d28 0 2023-01-04T18:16:56.319 INFO:tasks.workunit.client.0.smithi050.stdout:1/134: mkdir d8/d14/d22/d31 0 2023-01-04T18:16:56.319 INFO:tasks.workunit.client.0.smithi050.stdout:1/135: write f6 [2335672,69177] 0 2023-01-04T18:16:56.320 INFO:tasks.workunit.client.0.smithi050.stdout:1/136: stat d8/d14/d1d 0 2023-01-04T18:16:56.320 INFO:tasks.workunit.client.0.smithi050.stdout:1/137: write d8/d14/d1c/d28/f2b [1463297,65242] 0 2023-01-04T18:16:56.321 INFO:tasks.workunit.client.0.smithi050.stdout:9/195: getdents d1/d12/d14 0 2023-01-04T18:16:56.322 INFO:tasks.workunit.client.0.smithi050.stdout:3/199: truncate d0/f2c 1443903 0 2023-01-04T18:16:56.326 INFO:tasks.workunit.client.0.smithi050.stdout:2/151: dwrite d1/fb [0,4194304] 0 2023-01-04T18:16:56.326 INFO:tasks.workunit.client.0.smithi050.stdout:2/152: fsync d1/f8 0 2023-01-04T18:16:56.327 INFO:tasks.workunit.client.0.smithi050.stdout:0/170: creat d0/d6/d28/d1a/f30 x:0 0 0 2023-01-04T18:16:56.327 INFO:tasks.workunit.client.0.smithi050.stdout:0/171: dread - d0/d6/d28/d1a/f24 zero size 2023-01-04T18:16:56.328 INFO:tasks.workunit.client.0.smithi050.stdout:2/153: dread d1/dd/d11/d1e/f25 [0,4194304] 0 2023-01-04T18:16:56.330 INFO:tasks.workunit.client.0.smithi050.stdout:5/325: creat d13/d15/d17/d1f/d35/d42/f6f x:0 0 0 2023-01-04T18:16:56.330 INFO:tasks.workunit.client.0.smithi050.stdout:5/326: chown cd 1698 1 2023-01-04T18:16:56.330 INFO:tasks.workunit.client.0.smithi050.stdout:5/327: chown d13/d15/d17/l48 26647 1 2023-01-04T18:16:56.332 INFO:tasks.workunit.client.0.smithi050.stdout:6/162: symlink d0/d9/df/l35 0 2023-01-04T18:16:56.336 INFO:tasks.workunit.client.0.smithi050.stdout:8/180: rename d3/fd to d3/dc/d1b/d28/f39 0 2023-01-04T18:16:56.344 INFO:tasks.workunit.client.0.smithi050.stdout:7/191: creat d6/db/f40 x:0 0 0 2023-01-04T18:16:56.349 INFO:tasks.workunit.client.0.smithi050.stdout:9/196: mknod d1/c37 0 2023-01-04T18:16:56.349 INFO:tasks.workunit.client.0.smithi050.stdout:9/197: truncate d1/d3/f19 1954979 0 2023-01-04T18:16:56.350 INFO:tasks.workunit.client.0.smithi050.stdout:3/200: mkdir d0/d21/d46 0 2023-01-04T18:16:56.350 INFO:tasks.workunit.client.0.smithi050.stdout:3/201: chown d0/l15 231 1 2023-01-04T18:16:56.350 INFO:tasks.workunit.client.0.smithi050.stdout:3/202: readlink d0/d1b/d2f/l35 0 2023-01-04T18:16:56.354 INFO:tasks.workunit.client.0.smithi050.stdout:5/328: symlink d13/d15/d63/l70 0 2023-01-04T18:16:56.355 INFO:tasks.workunit.client.0.smithi050.stdout:6/163: symlink d0/d9/l36 0 2023-01-04T18:16:56.357 INFO:tasks.workunit.client.0.smithi050.stdout:8/181: symlink d3/l3a 0 2023-01-04T18:16:56.358 INFO:tasks.workunit.client.0.smithi050.stdout:7/192: unlink d6/d1d/f35 0 2023-01-04T18:16:56.358 INFO:tasks.workunit.client.0.smithi050.stdout:7/193: write d6/db/d15/d1b/f21 [550407,104590] 0 2023-01-04T18:16:56.359 INFO:tasks.workunit.client.0.smithi050.stdout:7/194: chown d6/f13 9041 1 2023-01-04T18:16:56.359 INFO:tasks.workunit.client.0.smithi050.stdout:7/195: truncate d6/f8 2006391 0 2023-01-04T18:16:56.360 INFO:tasks.workunit.client.0.smithi050.stdout:1/138: unlink d8/f1b 0 2023-01-04T18:16:56.360 INFO:tasks.workunit.client.0.smithi050.stdout:1/139: chown d8/d14/f30 13348013 1 2023-01-04T18:16:56.362 INFO:tasks.workunit.client.0.smithi050.stdout:9/198: rename d1/d12/d14/d23/l31 to d1/d3/l38 0 2023-01-04T18:16:56.362 INFO:tasks.workunit.client.0.smithi050.stdout:9/199: chown d1/d3/d11/f16 0 1 2023-01-04T18:16:56.363 INFO:tasks.workunit.client.0.smithi050.stdout:3/203: creat d0/d21/f47 x:0 0 0 2023-01-04T18:16:56.367 INFO:tasks.workunit.client.0.smithi050.stdout:5/329: mknod d13/d15/d17/d27/d44/d47/c71 0 2023-01-04T18:16:56.367 INFO:tasks.workunit.client.0.smithi050.stdout:6/164: creat d0/d8/d16/f37 x:0 0 0 2023-01-04T18:16:56.368 INFO:tasks.workunit.client.0.smithi050.stdout:8/182: mkdir d3/d2a/d30/d3b 0 2023-01-04T18:16:56.368 INFO:tasks.workunit.client.0.smithi050.stdout:8/183: readlink d3/l38 0 2023-01-04T18:16:56.368 INFO:tasks.workunit.client.0.smithi050.stdout:8/184: chown d3/c37 387 1 2023-01-04T18:16:56.368 INFO:tasks.workunit.client.0.smithi050.stdout:7/196: mknod d6/db/d15/c41 0 2023-01-04T18:16:56.419 INFO:tasks.workunit.client.0.smithi050.stdout:2/154: dwrite d1/dd/d11/d14/f30 [0,4194304] 0 2023-01-04T18:16:56.419 INFO:tasks.workunit.client.0.smithi050.stdout:2/155: read d1/dd/d11/f26 [953212,392] 0 2023-01-04T18:16:56.508 INFO:tasks.workunit.client.0.smithi050.stdout:1/140: mknod d8/d14/d22/d23/c32 0 2023-01-04T18:16:56.511 INFO:tasks.workunit.client.0.smithi050.stdout:9/200: mkdir d1/d12/d2d/d39 0 2023-01-04T18:16:56.511 INFO:tasks.workunit.client.0.smithi050.stdout:9/201: fsync d1/d3/f1b 0 2023-01-04T18:16:56.514 INFO:tasks.workunit.client.0.smithi050.stdout:3/204: creat d0/d10/d30/d32/f48 x:0 0 0 2023-01-04T18:16:56.520 INFO:tasks.workunit.client.0.smithi050.stdout:6/165: rmdir d0/d9/d25 39 2023-01-04T18:16:56.520 INFO:tasks.workunit.client.0.smithi050.stdout:6/166: fdatasync d0/d8/d1c/f26 0 2023-01-04T18:16:56.520 INFO:tasks.workunit.client.0.smithi050.stdout:6/167: chown d0/d9/c20 15249 1 2023-01-04T18:16:56.521 INFO:tasks.workunit.client.0.smithi050.stdout:6/168: dread - d0/f2f zero size 2023-01-04T18:16:56.530 INFO:tasks.workunit.client.0.smithi050.stdout:3/205: dwrite d0/f18 [0,4194304] 0 2023-01-04T18:16:56.530 INFO:tasks.workunit.client.0.smithi050.stdout:5/330: rmdir d13/d15/d17/d27/d44 39 2023-01-04T18:16:56.537 INFO:tasks.workunit.client.0.smithi050.stdout:8/185: rename d3/c37 to d3/d2a/d30/d3b/c3c 0 2023-01-04T18:16:56.537 INFO:tasks.workunit.client.0.smithi050.stdout:7/197: mkdir d6/d28/d3c/d42 0 2023-01-04T18:16:56.537 INFO:tasks.workunit.client.0.smithi050.stdout:8/186: write d3/dc/f2f [2307052,52524] 0 2023-01-04T18:16:56.538 INFO:tasks.workunit.client.0.smithi050.stdout:2/156: symlink d1/dd/d28/l34 0 2023-01-04T18:16:56.539 INFO:tasks.workunit.client.0.smithi050.stdout:1/141: creat d8/d14/d1d/f33 x:0 0 0 2023-01-04T18:16:56.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:55.918918+0000 mgr.smithi098.vhfzum (mgr.24455) 35 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 450 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 23 MiB/s wr, 198 op/s 2023-01-04T18:16:56.540 INFO:tasks.workunit.client.0.smithi050.stdout:2/157: write d1/f3 [4343955,36264] 0 2023-01-04T18:16:56.550 INFO:tasks.workunit.client.0.smithi050.stdout:6/169: unlink d0/fe 0 2023-01-04T18:16:56.556 INFO:tasks.workunit.client.0.smithi050.stdout:3/206: creat d0/d10/d30/d32/f49 x:0 0 0 2023-01-04T18:16:56.560 INFO:tasks.workunit.client.0.smithi050.stdout:5/331: symlink d13/d28/l72 0 2023-01-04T18:16:56.560 INFO:tasks.workunit.client.0.smithi050.stdout:5/332: chown d13/d15/d63 9 1 2023-01-04T18:16:56.560 INFO:tasks.workunit.client.0.smithi050.stdout:5/333: dread - d13/d15/d17/d1f/d35/d42/d4a/f68 zero size 2023-01-04T18:16:56.564 INFO:tasks.workunit.client.0.smithi050.stdout:7/198: creat d6/db/f43 x:0 0 0 2023-01-04T18:16:56.564 INFO:tasks.workunit.client.0.smithi050.stdout:7/199: truncate d6/f13 1007452 0 2023-01-04T18:16:56.565 INFO:tasks.workunit.client.0.smithi050.stdout:7/200: write d6/d28/f3d [1886676,95405] 0 2023-01-04T18:16:56.565 INFO:tasks.workunit.client.0.smithi050.stdout:8/187: mkdir d3/dc/d1b/d28/d3d 0 2023-01-04T18:16:56.568 INFO:tasks.workunit.client.0.smithi050.stdout:1/142: mknod d8/d14/d22/d23/c34 0 2023-01-04T18:16:56.568 INFO:tasks.workunit.client.0.smithi050.stdout:1/143: readlink d8/l1a 0 2023-01-04T18:16:56.568 INFO:tasks.workunit.client.0.smithi050.stdout:3/207: dwrite d0/f2c [0,4194304] 0 2023-01-04T18:16:56.571 INFO:tasks.workunit.client.0.smithi050.stdout:3/208: read d0/d1a/f29 [1466629,127049] 0 2023-01-04T18:16:56.571 INFO:tasks.workunit.client.0.smithi050.stdout:3/209: dread - d0/d10/d30/d32/f48 zero size 2023-01-04T18:16:56.571 INFO:tasks.workunit.client.0.smithi050.stdout:9/202: symlink d1/d3/d11/l3a 0 2023-01-04T18:16:56.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:55.918918+0000 mgr.smithi098.vhfzum (mgr.24455) 35 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 450 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 23 MiB/s wr, 198 op/s 2023-01-04T18:16:56.582 INFO:tasks.workunit.client.0.smithi050.stdout:5/334: creat d13/d15/f73 x:0 0 0 2023-01-04T18:16:56.582 INFO:tasks.workunit.client.0.smithi050.stdout:5/335: truncate d13/d15/d17/d1f/d35/d42/d4a/f68 503204 0 2023-01-04T18:16:56.585 INFO:tasks.workunit.client.0.smithi050.stdout:6/170: rename d0/d8 to d0/d9/d38 0 2023-01-04T18:16:56.587 INFO:tasks.workunit.client.0.smithi050.stdout:7/201: creat d6/db/d15/f44 x:0 0 0 2023-01-04T18:16:56.587 INFO:tasks.workunit.client.0.smithi050.stdout:7/202: chown d6/db/d15 382 1 2023-01-04T18:16:56.588 INFO:tasks.workunit.client.0.smithi050.stdout:9/203: dwrite d1/d12/d14/d23/f1c [0,4194304] 0 2023-01-04T18:16:56.589 INFO:tasks.workunit.client.0.smithi050.stdout:8/188: mknod d3/dc/d23/d31/c3e 0 2023-01-04T18:16:56.589 INFO:tasks.workunit.client.0.smithi050.stdout:8/189: chown d3 0 1 2023-01-04T18:16:56.590 INFO:tasks.workunit.client.0.smithi050.stdout:8/190: dread d3/d5/f1d [0,4194304] 0 2023-01-04T18:16:56.591 INFO:tasks.workunit.client.0.smithi050.stdout:1/144: dread - d8/f12 zero size 2023-01-04T18:16:56.592 INFO:tasks.workunit.client.0.smithi050.stdout:1/145: dread - d8/f12 zero size 2023-01-04T18:16:56.593 INFO:tasks.workunit.client.0.smithi050.stdout:1/146: write d8/f13 [674269,130232] 0 2023-01-04T18:16:56.594 INFO:tasks.workunit.client.0.smithi050.stdout:3/210: symlink d0/d10/d30/d3f/l4a 0 2023-01-04T18:16:56.594 INFO:tasks.workunit.client.0.smithi050.stdout:3/211: chown d0/d1b/d2f/d31/f41 178 1 2023-01-04T18:16:56.596 INFO:tasks.workunit.client.0.smithi050.stdout:5/336: unlink d13/d15/d17/d1f/d35/d42/d4a/f69 0 2023-01-04T18:16:56.597 INFO:tasks.workunit.client.0.smithi050.stdout:6/171: creat d0/d9/d25/f39 x:0 0 0 2023-01-04T18:16:56.597 INFO:tasks.workunit.client.0.smithi050.stdout:6/172: chown d0/d9/d25/f27 1817 1 2023-01-04T18:16:56.598 INFO:tasks.workunit.client.0.smithi050.stdout:7/203: truncate d6/f7 5590311 0 2023-01-04T18:16:56.601 INFO:tasks.workunit.client.0.smithi050.stdout:5/337: mknod d13/d15/d17/d27/d44/d47/c74 0 2023-01-04T18:16:56.603 INFO:tasks.workunit.client.0.smithi050.stdout:6/173: creat d0/d9/d25/f3a x:0 0 0 2023-01-04T18:16:56.609 INFO:tasks.workunit.client.0.smithi050.stdout:7/204: symlink d6/d28/d3c/l45 0 2023-01-04T18:16:56.610 INFO:tasks.workunit.client.0.smithi050.stdout:9/204: dwrite d1/d3/d11/f16 [0,4194304] 0 2023-01-04T18:16:56.612 INFO:tasks.workunit.client.0.smithi050.stdout:9/205: write d1/d3/f18 [1006590,30136] 0 2023-01-04T18:16:56.615 INFO:tasks.workunit.client.0.smithi050.stdout:5/338: link d13/d15/d17/d1f/d35/d42/d4a/c55 d13/d15/d17/d1f/d35/c75 0 2023-01-04T18:16:56.616 INFO:tasks.workunit.client.0.smithi050.stdout:7/205: rmdir d6/db/d3b 39 2023-01-04T18:16:56.621 INFO:tasks.workunit.client.0.smithi050.stdout:9/206: rename d1/d12/d14 to d1/d3/d3b 0 2023-01-04T18:16:56.621 INFO:tasks.workunit.client.0.smithi050.stdout:9/207: dread - d1/d3/d13/f36 zero size 2023-01-04T18:16:56.621 INFO:tasks.workunit.client.0.smithi050.stdout:9/208: write d1/d3/f1b [397305,89363] 0 2023-01-04T18:16:56.622 INFO:tasks.workunit.client.0.smithi050.stdout:5/339: creat d13/d15/d17/d27/f76 x:0 0 0 2023-01-04T18:16:56.623 INFO:tasks.workunit.client.0.smithi050.stdout:5/340: creat d13/d15/d17/d27/d46/d4e/d4d/f77 x:0 0 0 2023-01-04T18:16:56.625 INFO:tasks.workunit.client.0.smithi050.stdout:5/341: write d13/d15/d17/d27/d44/f45 [1295689,80410] 0 2023-01-04T18:16:56.625 INFO:tasks.workunit.client.0.smithi050.stdout:8/191: dwrite d3/f20 [4194304,4194304] 0 2023-01-04T18:16:56.625 INFO:tasks.workunit.client.0.smithi050.stdout:8/192: chown d3 1 1 2023-01-04T18:16:56.626 INFO:tasks.workunit.client.0.smithi050.stdout:6/174: dwrite d0/f2f [0,4194304] 0 2023-01-04T18:16:56.626 INFO:tasks.workunit.client.0.smithi050.stdout:6/175: dread - d0/d9/f2b zero size 2023-01-04T18:16:56.626 INFO:tasks.workunit.client.0.smithi050.stdout:1/147: dwrite d8/d14/d1c/d28/f2b [0,4194304] 0 2023-01-04T18:16:56.626 INFO:tasks.workunit.client.0.smithi050.stdout:1/148: fdatasync d8/d14/f30 0 2023-01-04T18:16:56.626 INFO:tasks.workunit.client.0.smithi050.stdout:1/149: dread - d8/d14/d1d/f21 zero size 2023-01-04T18:16:56.627 INFO:tasks.workunit.client.0.smithi050.stdout:1/150: getdents d8/d14/d22/d31 0 2023-01-04T18:16:56.631 INFO:tasks.workunit.client.0.smithi050.stdout:6/176: dread d0/d9/f17 [0,4194304] 0 2023-01-04T18:16:56.631 INFO:tasks.workunit.client.0.smithi050.stdout:7/206: dwrite d6/db/f40 [0,4194304] 0 2023-01-04T18:16:56.632 INFO:tasks.workunit.client.0.smithi050.stdout:9/209: dread d1/d3/d13/f26 [0,4194304] 0 2023-01-04T18:16:56.632 INFO:tasks.workunit.client.0.smithi050.stdout:9/210: stat d1/d3/d11/l3a 0 2023-01-04T18:16:56.637 INFO:tasks.workunit.client.0.smithi050.stdout:9/211: dread d1/d3/d11/d1f/f21 [0,4194304] 0 2023-01-04T18:16:56.650 INFO:tasks.workunit.client.0.smithi050.stdout:6/177: dwrite d0/d9/df/f22 [0,4194304] 0 2023-01-04T18:16:56.703 INFO:tasks.workunit.client.0.smithi050.stdout:8/193: rename d3/dc/f2f to d3/d2a/d30/f3f 0 2023-01-04T18:16:56.703 INFO:tasks.workunit.client.0.smithi050.stdout:8/194: chown d3/d2a/f18 527 1 2023-01-04T18:16:56.707 INFO:tasks.workunit.client.0.smithi050.stdout:6/178: dwrite d0/d9/fa [0,4194304] 0 2023-01-04T18:16:56.709 INFO:tasks.workunit.client.0.smithi050.stdout:1/151: unlink d8/fa 0 2023-01-04T18:16:56.715 INFO:tasks.workunit.client.0.smithi050.stdout:1/152: dread d8/f2f [0,4194304] 0 2023-01-04T18:16:56.732 INFO:tasks.workunit.client.0.smithi050.stdout:7/207: link d6/d28/f2c d6/db/d15/d1b/f46 0 2023-01-04T18:16:56.733 INFO:tasks.workunit.client.0.smithi050.stdout:7/208: chown d6/d28 18316706 1 2023-01-04T18:16:56.733 INFO:tasks.workunit.client.0.smithi050.stdout:7/209: stat d6/db 0 2023-01-04T18:16:56.735 INFO:tasks.workunit.client.0.smithi050.stdout:9/212: rename d1/d3/l25 to d1/d12/d2d/d39/l3c 0 2023-01-04T18:16:56.738 INFO:tasks.workunit.client.0.smithi050.stdout:8/195: truncate d3/d2a/d27/f33 2069750 0 2023-01-04T18:16:56.738 INFO:tasks.workunit.client.0.smithi050.stdout:8/196: stat d3/f20 0 2023-01-04T18:16:56.740 INFO:tasks.workunit.client.0.smithi050.stdout:6/179: creat d0/d9/f3b x:0 0 0 2023-01-04T18:16:56.740 INFO:tasks.workunit.client.0.smithi050.stdout:6/180: dread - d0/d9/d38/d16/f37 zero size 2023-01-04T18:16:56.740 INFO:tasks.workunit.client.0.smithi050.stdout:6/181: write d0/d9/d38/f23 [180659,14036] 0 2023-01-04T18:16:56.741 INFO:tasks.workunit.client.0.smithi050.stdout:1/153: creat d8/d14/f35 x:0 0 0 2023-01-04T18:16:56.742 INFO:tasks.workunit.client.0.smithi050.stdout:9/213: dread d1/d3/d13/f15 [0,4194304] 0 2023-01-04T18:16:56.743 INFO:tasks.workunit.client.0.smithi050.stdout:7/210: mknod d6/d1d/d1f/c47 0 2023-01-04T18:16:56.743 INFO:tasks.workunit.client.0.smithi050.stdout:7/211: write d6/db/f40 [4850434,55167] 0 2023-01-04T18:16:56.743 INFO:tasks.workunit.client.0.smithi050.stdout:7/212: fsync d6/db/d15/d1b/d22/f25 0 2023-01-04T18:16:56.743 INFO:tasks.workunit.client.0.smithi050.stdout:7/213: fsync d6/f13 0 2023-01-04T18:16:56.745 INFO:tasks.workunit.client.0.smithi050.stdout:8/197: rename d3/dc/d23/f36 to d3/dc/d1b/d28/f40 0 2023-01-04T18:16:56.746 INFO:tasks.workunit.client.0.smithi050.stdout:8/198: chown d3/c6 887 1 2023-01-04T18:16:56.746 INFO:tasks.workunit.client.0.smithi050.stdout:8/199: chown d3/d2a/l1a 182 1 2023-01-04T18:16:56.777 INFO:tasks.workunit.client.0.smithi050.stdout:4/154: sync 2023-01-04T18:16:56.777 INFO:tasks.workunit.client.0.smithi050.stdout:4/155: fdatasync d14/d1b/d1f/d22/f34 0 2023-01-04T18:16:56.785 INFO:tasks.workunit.client.0.smithi050.stdout:6/182: symlink d0/d9/l3c 0 2023-01-04T18:16:56.786 INFO:tasks.workunit.client.0.smithi050.stdout:9/214: truncate d1/d3/f19 1880298 0 2023-01-04T18:16:56.790 INFO:tasks.workunit.client.0.smithi050.stdout:7/214: unlink d6/c10 0 2023-01-04T18:16:56.799 INFO:tasks.workunit.client.0.smithi050.stdout:8/200: mknod d3/dc/d1b/d28/d3d/c41 0 2023-01-04T18:16:56.800 INFO:tasks.workunit.client.0.smithi050.stdout:8/201: write d3/d2a/f18 [3709572,49944] 0 2023-01-04T18:16:56.802 INFO:tasks.workunit.client.0.smithi050.stdout:4/156: symlink d14/d1b/d1f/l36 0 2023-01-04T18:16:56.802 INFO:tasks.workunit.client.0.smithi050.stdout:4/157: chown f5 51436814 1 2023-01-04T18:16:56.802 INFO:tasks.workunit.client.0.smithi050.stdout:4/158: chown d14/l16 109984 1 2023-01-04T18:16:56.805 INFO:tasks.workunit.client.0.smithi050.stdout:6/183: mknod d0/d9/df/c3d 0 2023-01-04T18:16:56.805 INFO:tasks.workunit.client.0.smithi050.stdout:6/184: chown d0/f2e 297373 1 2023-01-04T18:16:56.806 INFO:tasks.workunit.client.0.smithi050.stdout:9/215: rmdir d1/d12/d34 0 2023-01-04T18:16:56.806 INFO:tasks.workunit.client.0.smithi050.stdout:9/216: readlink d1/d3/l2c 0 2023-01-04T18:16:56.813 INFO:tasks.workunit.client.0.smithi050.stdout:7/215: mkdir d6/db/d15/d48 0 2023-01-04T18:16:56.819 INFO:tasks.workunit.client.0.smithi050.stdout:8/202: symlink d3/d5/l42 0 2023-01-04T18:16:56.820 INFO:tasks.workunit.client.0.smithi050.stdout:4/159: rmdir d14/d1b/d1f/d22 39 2023-01-04T18:16:56.822 INFO:tasks.workunit.client.0.smithi050.stdout:9/217: dwrite d1/d12/f22 [0,4194304] 0 2023-01-04T18:16:56.822 INFO:tasks.workunit.client.0.smithi050.stdout:9/218: write d1/d3/f19 [2655843,119020] 0 2023-01-04T18:16:56.823 INFO:tasks.workunit.client.0.smithi050.stdout:6/185: symlink d0/d9/d25/l3e 0 2023-01-04T18:16:56.829 INFO:tasks.workunit.client.0.smithi050.stdout:8/203: mkdir d3/dc/d43 0 2023-01-04T18:16:56.829 INFO:tasks.workunit.client.0.smithi050.stdout:9/219: stat d1/d3/l38 0 2023-01-04T18:16:56.832 INFO:tasks.workunit.client.0.smithi050.stdout:6/186: creat d0/d9/d38/d16/f3f x:0 0 0 2023-01-04T18:16:56.836 INFO:tasks.workunit.client.0.smithi050.stdout:8/204: truncate d3/d5/f1d 659753 0 2023-01-04T18:16:56.836 INFO:tasks.workunit.client.0.smithi050.stdout:8/205: fsync d3/d2a/d27/f33 0 2023-01-04T18:16:56.836 INFO:tasks.workunit.client.0.smithi050.stdout:8/206: fdatasync d3/d5/f1d 0 2023-01-04T18:16:56.837 INFO:tasks.workunit.client.0.smithi050.stdout:9/220: creat d1/d3/d3b/d23/f3d x:0 0 0 2023-01-04T18:16:56.838 INFO:tasks.workunit.client.0.smithi050.stdout:6/187: write d0/f2f [777337,23285] 0 2023-01-04T18:16:56.839 INFO:tasks.workunit.client.0.smithi050.stdout:7/216: dwrite d6/db/d15/d1b/d22/f37 [0,4194304] 0 2023-01-04T18:16:56.839 INFO:tasks.workunit.client.0.smithi050.stdout:8/207: link d3/d5/c1c d3/dc/d23/c44 0 2023-01-04T18:16:56.842 INFO:tasks.workunit.client.0.smithi050.stdout:4/160: dwrite f12 [0,4194304] 0 2023-01-04T18:16:56.844 INFO:tasks.workunit.client.0.smithi050.stdout:9/221: symlink d1/d12/d2d/l3e 0 2023-01-04T18:16:56.844 INFO:tasks.workunit.client.0.smithi050.stdout:9/222: write d1/d3/f4 [4312546,65981] 0 2023-01-04T18:16:56.845 INFO:tasks.workunit.client.0.smithi050.stdout:7/217: dread d6/db/d15/d1b/d22/f25 [0,4194304] 0 2023-01-04T18:16:56.845 INFO:tasks.workunit.client.0.smithi050.stdout:7/218: write d6/f13 [417045,12688] 0 2023-01-04T18:16:56.847 INFO:tasks.workunit.client.0.smithi050.stdout:4/161: dread d14/f15 [0,4194304] 0 2023-01-04T18:16:56.848 INFO:tasks.workunit.client.0.smithi050.stdout:4/162: chown d14/d1b 0 1 2023-01-04T18:16:56.856 INFO:tasks.workunit.client.0.smithi050.stdout:0/172: sync 2023-01-04T18:16:56.856 INFO:tasks.workunit.client.0.smithi050.stdout:0/173: write d0/d6/d8/f2a [689774,104653] 0 2023-01-04T18:16:56.859 INFO:tasks.workunit.client.0.smithi050.stdout:8/208: mknod d3/dc/d1b/d28/d2c/c45 0 2023-01-04T18:16:56.860 INFO:tasks.workunit.client.0.smithi050.stdout:0/174: dread d0/d6/d8/f1c [0,4194304] 0 2023-01-04T18:16:56.870 INFO:tasks.workunit.client.0.smithi050.stdout:9/223: mkdir d1/d12/d3f 0 2023-01-04T18:16:56.870 INFO:tasks.workunit.client.0.smithi050.stdout:9/224: chown d1/d3 27650335 1 2023-01-04T18:16:56.872 INFO:tasks.workunit.client.0.smithi050.stdout:7/219: creat d6/f49 x:0 0 0 2023-01-04T18:16:56.875 INFO:tasks.workunit.client.0.smithi050.stdout:4/163: link f11 d14/d1b/d32/f37 0 2023-01-04T18:16:56.878 INFO:tasks.workunit.client.0.smithi050.stdout:8/209: unlink d3/dc/d1b/d28/d2c/c45 0 2023-01-04T18:16:56.880 INFO:tasks.workunit.client.0.smithi050.stdout:7/220: symlink d6/d28/l4a 0 2023-01-04T18:16:56.880 INFO:tasks.workunit.client.0.smithi050.stdout:7/221: write d6/f13 [1614504,75131] 0 2023-01-04T18:16:56.880 INFO:tasks.workunit.client.0.smithi050.stdout:7/222: dread - d6/db/f43 zero size 2023-01-04T18:16:56.882 INFO:tasks.workunit.client.0.smithi050.stdout:0/175: dwrite d0/d6/f26 [0,4194304] 0 2023-01-04T18:16:56.883 INFO:tasks.workunit.client.0.smithi050.stdout:4/164: mknod d14/d1b/c38 0 2023-01-04T18:16:56.883 INFO:tasks.workunit.client.0.smithi050.stdout:4/165: dread - d14/f21 zero size 2023-01-04T18:16:56.884 INFO:tasks.workunit.client.0.smithi050.stdout:8/210: mkdir d3/d5/d46 0 2023-01-04T18:16:56.884 INFO:tasks.workunit.client.0.smithi050.stdout:8/211: readlink d3/d2a/d30/l35 0 2023-01-04T18:16:56.885 INFO:tasks.workunit.client.0.smithi050.stdout:7/223: mkdir d6/db/d15/d2e/d4b 0 2023-01-04T18:16:56.885 INFO:tasks.workunit.client.0.smithi050.stdout:7/224: chown f2 259873455 1 2023-01-04T18:16:56.889 INFO:tasks.workunit.client.0.smithi050.stdout:0/176: mknod d0/d6/d28/d1a/c31 0 2023-01-04T18:16:56.893 INFO:tasks.workunit.client.0.smithi050.stdout:8/212: link d3/l38 d3/d5/l47 0 2023-01-04T18:16:56.903 INFO:tasks.workunit.client.0.smithi050.stdout:7/225: creat d6/db/d3b/f4c x:0 0 0 2023-01-04T18:16:56.903 INFO:tasks.workunit.client.0.smithi050.stdout:7/226: write d6/db/d15/d1b/f46 [771010,128115] 0 2023-01-04T18:16:56.905 INFO:tasks.workunit.client.0.smithi050.stdout:8/213: mkdir d3/d2a/d30/d48 0 2023-01-04T18:16:56.905 INFO:tasks.workunit.client.0.smithi050.stdout:8/214: rename d3/d2a/d30/d3b to d3/d2a/d30/d3b/d49 22 2023-01-04T18:16:56.905 INFO:tasks.workunit.client.0.smithi050.stdout:8/215: truncate d3/dc/d1b/d28/f40 421422 0 2023-01-04T18:16:56.906 INFO:tasks.workunit.client.0.smithi050.stdout:7/227: mknod d6/d28/d32/c4d 0 2023-01-04T18:16:56.906 INFO:tasks.workunit.client.0.smithi050.stdout:7/228: write d6/db/d15/d1b/f21 [1154888,87800] 0 2023-01-04T18:16:56.911 INFO:tasks.workunit.client.0.smithi050.stdout:4/166: dwrite d14/f21 [0,4194304] 0 2023-01-04T18:16:56.912 INFO:tasks.workunit.client.0.smithi050.stdout:7/229: read d6/d28/f3d [305481,51665] 0 2023-01-04T18:16:56.912 INFO:tasks.workunit.client.0.smithi050.stdout:7/230: chown d6/d28/d3c/d42 33213804 1 2023-01-04T18:16:56.913 INFO:tasks.workunit.client.0.smithi050.stdout:8/216: dread d3/dc/f2b [0,4194304] 0 2023-01-04T18:16:56.915 INFO:tasks.workunit.client.0.smithi050.stdout:0/177: dwrite d0/d6/d8/f1c [0,4194304] 0 2023-01-04T18:16:56.915 INFO:tasks.workunit.client.0.smithi050.stdout:0/178: chown d0/l17 367 1 2023-01-04T18:16:56.916 INFO:tasks.workunit.client.0.smithi050.stdout:4/167: mknod d14/d1b/d1f/d22/c39 0 2023-01-04T18:16:56.917 INFO:tasks.workunit.client.0.smithi050.stdout:4/168: read d14/f18 [2719429,26509] 0 2023-01-04T18:16:56.919 INFO:tasks.workunit.client.0.smithi050.stdout:8/217: creat d3/d5/d46/f4a x:0 0 0 2023-01-04T18:16:56.919 INFO:tasks.workunit.client.0.smithi050.stdout:7/231: dread d6/f13 [0,4194304] 0 2023-01-04T18:16:56.921 INFO:tasks.workunit.client.0.smithi050.stdout:0/179: mknod d0/d22/c32 0 2023-01-04T18:16:56.921 INFO:tasks.workunit.client.0.smithi050.stdout:0/180: chown d0/d6/d8/cd 6 1 2023-01-04T18:16:56.924 INFO:tasks.workunit.client.0.smithi050.stdout:4/169: mknod d14/d1b/d1f/d22/c3a 0 2023-01-04T18:16:56.932 INFO:tasks.workunit.client.0.smithi050.stdout:8/218: dwrite d3/d2a/d30/f3f [4194304,4194304] 0 2023-01-04T18:16:56.932 INFO:tasks.workunit.client.0.smithi050.stdout:7/232: creat d6/d28/d32/f4e x:0 0 0 2023-01-04T18:16:56.975 INFO:tasks.workunit.client.0.smithi050.stdout:0/181: symlink d0/d6/d8/d25/l33 0 2023-01-04T18:16:56.978 INFO:tasks.workunit.client.0.smithi050.stdout:4/170: unlink d14/d1b/c29 0 2023-01-04T18:16:56.978 INFO:tasks.workunit.client.0.smithi050.stdout:4/171: read - d14/f1c zero size 2023-01-04T18:16:56.989 INFO:tasks.workunit.client.0.smithi050.stdout:8/219: rmdir d3/dc/d43 0 2023-01-04T18:16:56.993 INFO:tasks.workunit.client.0.smithi050.stdout:7/233: mkdir d6/db/d20/d4f 0 2023-01-04T18:16:56.995 INFO:tasks.workunit.client.0.smithi050.stdout:0/182: creat d0/d22/f34 x:0 0 0 2023-01-04T18:16:56.995 INFO:tasks.workunit.client.0.smithi050.stdout:0/183: truncate d0/d6/fa 1550992 0 2023-01-04T18:16:56.998 INFO:tasks.workunit.client.0.smithi050.stdout:4/172: symlink d14/d1b/d32/l3b 0 2023-01-04T18:16:57.003 INFO:tasks.workunit.client.0.smithi050.stdout:8/220: getdents d3/d5 0 2023-01-04T18:16:57.004 INFO:tasks.workunit.client.0.smithi050.stdout:7/234: mknod d6/db/d15/d1b/d22/c50 0 2023-01-04T18:16:57.007 INFO:tasks.workunit.client.0.smithi050.stdout:0/184: rename d0/d22 to d0/d6/d8/d35 0 2023-01-04T18:16:57.007 INFO:tasks.workunit.client.0.smithi050.stdout:0/185: chown d0/d6 289862 1 2023-01-04T18:16:57.007 INFO:tasks.workunit.client.0.smithi050.stdout:0/186: write d0/d6/fa [1927094,50276] 0 2023-01-04T18:16:57.007 INFO:tasks.workunit.client.0.smithi050.stdout:0/187: read d0/f4 [2638572,60755] 0 2023-01-04T18:16:57.010 INFO:tasks.workunit.client.0.smithi050.stdout:4/173: getdents d14/d1b 0 2023-01-04T18:16:57.013 INFO:tasks.workunit.client.0.smithi050.stdout:8/221: rename d3/d5/l42 to d3/d5/l4b 0 2023-01-04T18:16:57.013 INFO:tasks.workunit.client.0.smithi050.stdout:8/222: truncate d3/dc/d1b/d28/f40 791928 0 2023-01-04T18:16:57.017 INFO:tasks.workunit.client.0.smithi050.stdout:7/235: mknod d6/db/d3a/c51 0 2023-01-04T18:16:57.019 INFO:tasks.workunit.client.0.smithi050.stdout:8/223: dread d3/d2a/f24 [0,4194304] 0 2023-01-04T18:16:57.020 INFO:tasks.workunit.client.0.smithi050.stdout:0/188: creat d0/d6/f36 x:0 0 0 2023-01-04T18:16:57.021 INFO:tasks.workunit.client.0.smithi050.stdout:7/236: creat d6/d28/d32/f52 x:0 0 0 2023-01-04T18:16:57.022 INFO:tasks.workunit.client.0.smithi050.stdout:7/237: truncate d6/f8 2810503 0 2023-01-04T18:16:57.025 INFO:tasks.workunit.client.0.smithi050.stdout:4/174: dwrite f7 [0,4194304] 0 2023-01-04T18:16:57.025 INFO:tasks.workunit.client.0.smithi050.stdout:4/175: chown f0 249486 1 2023-01-04T18:16:57.025 INFO:tasks.workunit.client.0.smithi050.stdout:4/176: truncate d14/d1b/d32/f35 394302 0 2023-01-04T18:16:57.027 INFO:tasks.workunit.client.0.smithi050.stdout:0/189: creat d0/d6/d8/d35/f37 x:0 0 0 2023-01-04T18:16:57.031 INFO:tasks.workunit.client.0.smithi050.stdout:4/177: rmdir d14/d1b 39 2023-01-04T18:16:57.032 INFO:tasks.workunit.client.0.smithi050.stdout:4/178: chown c6 2 1 2023-01-04T18:16:57.032 INFO:tasks.workunit.client.0.smithi050.stdout:4/179: readlink d14/l28 0 2023-01-04T18:16:57.033 INFO:tasks.workunit.client.0.smithi050.stdout:0/190: mknod d0/d6/c38 0 2023-01-04T18:16:57.035 INFO:tasks.workunit.client.0.smithi050.stdout:7/238: dwrite d6/db/f19 [0,4194304] 0 2023-01-04T18:16:57.036 INFO:tasks.workunit.client.0.smithi050.stdout:8/224: getdents d3/d5 0 2023-01-04T18:16:57.037 INFO:tasks.workunit.client.0.smithi050.stdout:0/191: symlink d0/d6/d28/d1a/l39 0 2023-01-04T18:16:57.042 INFO:tasks.workunit.client.0.smithi050.stdout:3/212: sync 2023-01-04T18:16:57.043 INFO:tasks.workunit.client.0.smithi050.stdout:2/158: sync 2023-01-04T18:16:57.043 INFO:tasks.workunit.client.0.smithi050.stdout:5/342: sync 2023-01-04T18:16:57.043 INFO:tasks.workunit.client.0.smithi050.stdout:2/159: stat d1/f3 0 2023-01-04T18:16:57.043 INFO:tasks.workunit.client.0.smithi050.stdout:2/160: stat d1/d19/f21 0 2023-01-04T18:16:57.043 INFO:tasks.workunit.client.0.smithi050.stdout:5/343: write d13/d15/d17/d1f/d35/f3a [38708,14030] 0 2023-01-04T18:16:57.044 INFO:tasks.workunit.client.0.smithi050.stdout:5/344: dread d13/d15/d17/d27/d46/d4e/f37 [0,4194304] 0 2023-01-04T18:16:57.044 INFO:tasks.workunit.client.0.smithi050.stdout:7/239: mkdir d6/db/d15/d2e/d4b/d53 0 2023-01-04T18:16:57.047 INFO:tasks.workunit.client.0.smithi050.stdout:4/180: dwrite d14/d1b/f2f [0,4194304] 0 2023-01-04T18:16:57.050 INFO:tasks.workunit.client.0.smithi050.stdout:8/225: rename d3/dc/d1b/d28/d3d/c41 to d3/dc/d1b/d28/c4c 0 2023-01-04T18:16:57.051 INFO:tasks.workunit.client.0.smithi050.stdout:7/240: dread d6/db/f2a [0,4194304] 0 2023-01-04T18:16:57.052 INFO:tasks.workunit.client.0.smithi050.stdout:3/213: link d0/d10/f42 d0/d1b/d2f/d31/f4b 0 2023-01-04T18:16:57.054 INFO:tasks.workunit.client.0.smithi050.stdout:2/161: unlink d1/fb 0 2023-01-04T18:16:57.056 INFO:tasks.workunit.client.0.smithi050.stdout:2/162: read d1/dd/d11/d1e/f22 [392295,128305] 0 2023-01-04T18:16:57.056 INFO:tasks.workunit.client.0.smithi050.stdout:2/163: truncate d1/dd/d11/d14/f23 318507 0 2023-01-04T18:16:57.057 INFO:tasks.workunit.client.0.smithi050.stdout:5/345: mkdir d13/d15/d17/d27/d78 0 2023-01-04T18:16:57.057 INFO:tasks.workunit.client.0.smithi050.stdout:5/346: dread - d13/d15/d17/d1f/d35/d42/f6f zero size 2023-01-04T18:16:57.057 INFO:tasks.workunit.client.0.smithi050.stdout:5/347: write d13/d15/d17/d1f/d35/f65 [2110503,26729] 0 2023-01-04T18:16:57.066 INFO:tasks.workunit.client.0.smithi050.stdout:0/192: dwrite d0/d6/d8/d35/f37 [0,4194304] 0 2023-01-04T18:16:57.066 INFO:tasks.workunit.client.0.smithi050.stdout:0/193: dread - d0/f2d zero size 2023-01-04T18:16:57.068 INFO:tasks.workunit.client.0.smithi050.stdout:4/181: dwrite d14/d1b/d1f/f26 [0,4194304] 0 2023-01-04T18:16:57.074 INFO:tasks.workunit.client.0.smithi050.stdout:7/241: link d6/db/d15/f16 d6/db/d15/d1b/d22/f54 0 2023-01-04T18:16:57.076 INFO:tasks.workunit.client.0.smithi050.stdout:8/226: rename d3/dc to d3/d2a/d30/d3b/d4d 0 2023-01-04T18:16:57.079 INFO:tasks.workunit.client.0.smithi050.stdout:0/194: dwrite d0/d6/d8/d35/f2e [0,4194304] 0 2023-01-04T18:16:57.080 INFO:tasks.workunit.client.0.smithi050.stdout:3/214: symlink d0/d10/d30/l4c 0 2023-01-04T18:16:57.080 INFO:tasks.workunit.client.0.smithi050.stdout:3/215: write d0/d1b/d2f/d31/f41 [720453,6684] 0 2023-01-04T18:16:57.087 INFO:tasks.workunit.client.0.smithi050.stdout:2/164: rmdir d1 39 2023-01-04T18:16:57.088 INFO:tasks.workunit.client.0.smithi050.stdout:2/165: dread - d1/dd/d28/d2c/f2d zero size 2023-01-04T18:16:57.088 INFO:tasks.workunit.client.0.smithi050.stdout:2/166: write d1/dd/d11/d14/f23 [1203878,33460] 0 2023-01-04T18:16:57.094 INFO:tasks.workunit.client.0.smithi050.stdout:5/348: creat d13/d15/d17/d1f/d35/d42/f79 x:0 0 0 2023-01-04T18:16:57.098 INFO:tasks.workunit.client.0.smithi050.stdout:0/195: dwrite d0/d6/d8/d35/f34 [0,4194304] 0 2023-01-04T18:16:57.102 INFO:tasks.workunit.client.0.smithi050.stdout:5/349: read d13/f19 [180383,119977] 0 2023-01-04T18:16:57.120 INFO:tasks.workunit.client.0.smithi050.stdout:3/216: dwrite d0/fe [0,4194304] 0 2023-01-04T18:16:57.120 INFO:tasks.workunit.client.0.smithi050.stdout:3/217: chown d0/d21/f47 41 1 2023-01-04T18:16:57.121 INFO:tasks.workunit.client.0.smithi050.stdout:3/218: readlink d0/l6 0 2023-01-04T18:16:57.121 INFO:tasks.workunit.client.0.smithi050.stdout:0/196: dwrite d0/d6/f36 [0,4194304] 0 2023-01-04T18:16:57.121 INFO:tasks.workunit.client.0.smithi050.stdout:0/197: read - d0/d6/d28/d1a/f30 zero size 2023-01-04T18:16:57.121 INFO:tasks.workunit.client.0.smithi050.stdout:0/198: truncate d0/f2d 378249 0 2023-01-04T18:16:57.121 INFO:tasks.workunit.client.0.smithi050.stdout:2/167: dwrite d1/dd/d11/d1e/f25 [0,4194304] 0 2023-01-04T18:16:57.123 INFO:tasks.workunit.client.0.smithi050.stdout:8/227: symlink d3/d2a/l4e 0 2023-01-04T18:16:57.125 INFO:tasks.workunit.client.0.smithi050.stdout:4/182: creat d14/d1b/d32/f3c x:0 0 0 2023-01-04T18:16:57.125 INFO:tasks.workunit.client.0.smithi050.stdout:7/242: mkdir d6/db/d20/d55 0 2023-01-04T18:16:57.125 INFO:tasks.workunit.client.0.smithi050.stdout:7/243: dread - d6/f49 zero size 2023-01-04T18:16:57.130 INFO:tasks.workunit.client.0.smithi050.stdout:5/350: creat d13/d15/d17/d1f/d35/d42/f7a x:0 0 0 2023-01-04T18:16:57.132 INFO:tasks.workunit.client.0.smithi050.stdout:3/219: symlink d0/d10/d30/d3f/l4d 0 2023-01-04T18:16:57.138 INFO:tasks.workunit.client.0.smithi050.stdout:2/168: dread d1/dd/d11/d14/f23 [0,4194304] 0 2023-01-04T18:16:57.138 INFO:tasks.workunit.client.0.smithi050.stdout:2/169: fsync d1/dd/d11/d14/f23 0 2023-01-04T18:16:57.188 INFO:tasks.workunit.client.0.smithi050.stdout:0/199: mkdir d0/d6/d3a 0 2023-01-04T18:16:57.190 INFO:tasks.workunit.client.0.smithi050.stdout:8/228: symlink d3/d2a/d30/d3b/l4f 0 2023-01-04T18:16:57.192 INFO:tasks.workunit.client.0.smithi050.stdout:4/183: symlink d14/d1b/d1f/d22/l3d 0 2023-01-04T18:16:57.196 INFO:tasks.workunit.client.0.smithi050.stdout:0/200: write d0/d6/f26 [3512548,117510] 0 2023-01-04T18:16:57.217 INFO:tasks.workunit.client.0.smithi050.stdout:8/229: dwrite d3/d2a/f18 [0,4194304] 0 2023-01-04T18:16:57.220 INFO:tasks.workunit.client.0.smithi050.stdout:7/244: creat d6/d28/d3c/d42/f56 x:0 0 0 2023-01-04T18:16:57.220 INFO:tasks.workunit.client.0.smithi050.stdout:5/351: creat d13/d15/d17/d27/d44/f7b x:0 0 0 2023-01-04T18:16:57.221 INFO:tasks.workunit.client.0.smithi050.stdout:3/220: truncate d0/d1b/f1c 560577 0 2023-01-04T18:16:57.226 INFO:tasks.workunit.client.0.smithi050.stdout:4/184: mkdir d14/d1b/d1f/d22/d3e 0 2023-01-04T18:16:57.226 INFO:tasks.workunit.client.0.smithi050.stdout:4/185: readlink d14/l2c 0 2023-01-04T18:16:57.226 INFO:tasks.workunit.client.0.smithi050.stdout:4/186: write d14/f1d [2231364,78020] 0 2023-01-04T18:16:57.226 INFO:tasks.workunit.client.0.smithi050.stdout:4/187: fsync d14/f24 0 2023-01-04T18:16:57.226 INFO:tasks.workunit.client.0.smithi050.stdout:4/188: truncate d14/f1c 248401 0 2023-01-04T18:16:57.226 INFO:tasks.workunit.client.0.smithi050.stdout:3/221: write d0/d10/f42 [3214143,19393] 0 2023-01-04T18:16:57.227 INFO:tasks.workunit.client.0.smithi050.stdout:0/201: getdents d0/d6/d28 0 2023-01-04T18:16:57.227 INFO:tasks.workunit.client.0.smithi050.stdout:5/352: truncate d13/d15/d17/d1f/d35/d42/d4a/f5a 1100572 0 2023-01-04T18:16:57.228 INFO:tasks.workunit.client.0.smithi050.stdout:4/189: creat d14/d1b/d32/f3f x:0 0 0 2023-01-04T18:16:57.229 INFO:tasks.workunit.client.0.smithi050.stdout:3/222: getdents d0/d1b 0 2023-01-04T18:16:57.231 INFO:tasks.workunit.client.0.smithi050.stdout:3/223: creat d0/d1a/f4e x:0 0 0 2023-01-04T18:16:57.232 INFO:tasks.workunit.client.0.smithi050.stdout:0/202: link d0/d6/d28/d1a/f24 d0/f3b 0 2023-01-04T18:16:57.232 INFO:tasks.workunit.client.0.smithi050.stdout:0/203: write d0/d6/d8/f2a [1703698,8458] 0 2023-01-04T18:16:57.233 INFO:tasks.workunit.client.0.smithi050.stdout:3/224: mknod d0/dd/c4f 0 2023-01-04T18:16:57.234 INFO:tasks.workunit.client.0.smithi050.stdout:3/225: rmdir d0/d10/d30/d3f 39 2023-01-04T18:16:57.235 INFO:tasks.workunit.client.0.smithi050.stdout:7/245: dread d6/f27 [0,4194304] 0 2023-01-04T18:16:57.244 INFO:tasks.workunit.client.0.smithi050.stdout:3/226: creat d0/d1b/d2f/d31/f50 x:0 0 0 2023-01-04T18:16:57.244 INFO:tasks.workunit.client.0.smithi050.stdout:7/246: creat d6/db/d15/d48/f57 x:0 0 0 2023-01-04T18:16:57.244 INFO:tasks.workunit.client.0.smithi050.stdout:3/227: readlink d0/d21/l2e 0 2023-01-04T18:16:57.244 INFO:tasks.workunit.client.0.smithi050.stdout:8/230: dwrite d3/d2a/d30/f3f [4194304,4194304] 0 2023-01-04T18:16:57.244 INFO:tasks.workunit.client.0.smithi050.stdout:0/204: dread d0/d6/d8/d35/f37 [0,4194304] 0 2023-01-04T18:16:57.247 INFO:tasks.workunit.client.0.smithi050.stdout:7/247: unlink d6/db/d3b/l3f 0 2023-01-04T18:16:57.247 INFO:tasks.workunit.client.0.smithi050.stdout:0/205: link d0/d6/d8/d35/f34 d0/d6/f3c 0 2023-01-04T18:16:57.251 INFO:tasks.workunit.client.0.smithi050.stdout:1/154: sync 2023-01-04T18:16:57.251 INFO:tasks.workunit.client.0.smithi050.stdout:9/225: sync 2023-01-04T18:16:57.251 INFO:tasks.workunit.client.0.smithi050.stdout:3/228: write d0/d1a/f29 [3750811,16944] 0 2023-01-04T18:16:57.251 INFO:tasks.workunit.client.0.smithi050.stdout:6/188: sync 2023-01-04T18:16:57.254 INFO:tasks.workunit.client.0.smithi050.stdout:7/248: creat d6/db/d15/d48/f58 x:0 0 0 2023-01-04T18:16:57.257 INFO:tasks.workunit.client.0.smithi050.stdout:6/189: rmdir d0/d9 39 2023-01-04T18:16:57.257 INFO:tasks.workunit.client.0.smithi050.stdout:9/226: rmdir d1/d12/d2d/d39 39 2023-01-04T18:16:57.257 INFO:tasks.workunit.client.0.smithi050.stdout:8/231: write d3/d2a/d30/f3f [3010930,54762] 0 2023-01-04T18:16:57.257 INFO:tasks.workunit.client.0.smithi050.stdout:4/190: dwrite f5 [0,4194304] 0 2023-01-04T18:16:57.258 INFO:tasks.workunit.client.0.smithi050.stdout:6/190: mkdir d0/d9/d25/d40 0 2023-01-04T18:16:57.258 INFO:tasks.workunit.client.0.smithi050.stdout:6/191: dread - d0/f2e zero size 2023-01-04T18:16:57.268 INFO:tasks.workunit.client.0.smithi050.stdout:8/232: rmdir d3/d2a/d30/d48 0 2023-01-04T18:16:57.268 INFO:tasks.workunit.client.0.smithi050.stdout:8/233: getdents d3/d2a/d2d 0 2023-01-04T18:16:57.274 INFO:tasks.workunit.client.0.smithi050.stdout:1/155: dwrite f6 [0,4194304] 0 2023-01-04T18:16:57.274 INFO:tasks.workunit.client.0.smithi050.stdout:4/191: mknod d14/d1b/d1f/d22/d3e/c40 0 2023-01-04T18:16:57.274 INFO:tasks.workunit.client.0.smithi050.stdout:6/192: mknod d0/d9/d25/d2d/c41 0 2023-01-04T18:16:57.281 INFO:tasks.workunit.client.0.smithi050.stdout:6/193: write d0/f2f [2878309,46839] 0 2023-01-04T18:16:57.282 INFO:tasks.workunit.client.0.smithi050.stdout:7/249: dwrite d6/db/f2a [0,4194304] 0 2023-01-04T18:16:57.283 INFO:tasks.workunit.client.0.smithi050.stdout:9/227: dwrite d1/d12/f22 [4194304,4194304] 0 2023-01-04T18:16:57.283 INFO:tasks.workunit.client.0.smithi050.stdout:9/228: write d1/d3/d13/f26 [1881601,50134] 0 2023-01-04T18:16:57.302 INFO:tasks.workunit.client.0.smithi050.stdout:5/353: dwrite d13/d15/d17/d1f/d35/d42/d4a/f5a [0,4194304] 0 2023-01-04T18:16:57.303 INFO:tasks.workunit.client.0.smithi050.stdout:9/229: dwrite d1/d3/f19 [0,4194304] 0 2023-01-04T18:16:57.304 INFO:tasks.workunit.client.0.smithi050.stdout:5/354: write d13/d28/f3e [3198178,65396] 0 2023-01-04T18:16:57.305 INFO:tasks.workunit.client.0.smithi050.stdout:1/156: creat d8/d14/d22/f36 x:0 0 0 2023-01-04T18:16:57.306 INFO:tasks.workunit.client.0.smithi050.stdout:4/192: creat d14/d1b/f41 x:0 0 0 2023-01-04T18:16:57.310 INFO:tasks.workunit.client.0.smithi050.stdout:6/194: rename d0/d9/d25/l3e to d0/d9/d38/l42 0 2023-01-04T18:16:57.313 INFO:tasks.workunit.client.0.smithi050.stdout:7/250: mknod d6/d28/d3c/d42/c59 0 2023-01-04T18:16:57.319 INFO:tasks.workunit.client.0.smithi050.stdout:5/355: dwrite d13/d15/d17/f40 [0,4194304] 0 2023-01-04T18:16:57.320 INFO:tasks.workunit.client.0.smithi050.stdout:5/356: write d13/d15/d17/d1f/d35/d42/f7a [655994,101687] 0 2023-01-04T18:16:57.327 INFO:tasks.workunit.client.0.smithi050.stdout:2/170: sync 2023-01-04T18:16:57.328 INFO:tasks.workunit.client.0.smithi050.stdout:2/171: readlink d1/dd/d28/l34 0 2023-01-04T18:16:57.328 INFO:tasks.workunit.client.0.smithi050.stdout:2/172: fdatasync d1/dd/d11/d1e/f25 0 2023-01-04T18:16:57.328 INFO:tasks.workunit.client.0.smithi050.stdout:2/173: dread - d1/f1a zero size 2023-01-04T18:16:57.332 INFO:tasks.workunit.client.0.smithi050.stdout:9/230: link d1/d3/d13/l2b d1/d3/d3b/d23/l40 0 2023-01-04T18:16:57.336 INFO:tasks.workunit.client.0.smithi050.stdout:1/157: mknod d8/d14/d22/d23/c37 0 2023-01-04T18:16:57.337 INFO:tasks.workunit.client.0.smithi050.stdout:1/158: read d8/fe [4154856,53649] 0 2023-01-04T18:16:57.337 INFO:tasks.workunit.client.0.smithi050.stdout:1/159: chown d8 35585 1 2023-01-04T18:16:57.343 INFO:tasks.workunit.client.0.smithi050.stdout:6/195: truncate d0/f14 2214759 0 2023-01-04T18:16:57.344 INFO:tasks.workunit.client.0.smithi050.stdout:7/251: symlink d6/d28/d32/l5a 0 2023-01-04T18:16:57.344 INFO:tasks.workunit.client.0.smithi050.stdout:7/252: chown d6/d28/d3c/d42/c59 21792 1 2023-01-04T18:16:57.347 INFO:tasks.workunit.client.0.smithi050.stdout:7/253: dread d6/db/d15/d1b/d22/f54 [0,4194304] 0 2023-01-04T18:16:57.349 INFO:tasks.workunit.client.0.smithi050.stdout:5/357: mkdir d13/d28/d7c 0 2023-01-04T18:16:57.352 INFO:tasks.workunit.client.0.smithi050.stdout:2/174: mknod d1/dd/d11/d12/c35 0 2023-01-04T18:16:57.353 INFO:tasks.workunit.client.0.smithi050.stdout:2/175: fsync d1/d19/f21 0 2023-01-04T18:16:57.355 INFO:tasks.workunit.client.0.smithi050.stdout:9/231: mkdir d1/d12/d41 0 2023-01-04T18:16:57.356 INFO:tasks.workunit.client.0.smithi050.stdout:1/160: stat d8/cb 0 2023-01-04T18:16:57.357 INFO:tasks.workunit.client.0.smithi050.stdout:4/193: unlink d14/f1d 0 2023-01-04T18:16:57.358 INFO:tasks.workunit.client.0.smithi050.stdout:4/194: chown f9 66178 1 2023-01-04T18:16:57.358 INFO:tasks.workunit.client.0.smithi050.stdout:4/195: readlink d14/l28 0 2023-01-04T18:16:57.359 INFO:tasks.workunit.client.0.smithi050.stdout:5/358: truncate d13/d15/d17/d1f/d35/d42/d4a/f5a 3436703 0 2023-01-04T18:16:57.359 INFO:tasks.workunit.client.0.smithi050.stdout:5/359: write d13/d15/f26 [874595,105533] 0 2023-01-04T18:16:57.361 INFO:tasks.workunit.client.0.smithi050.stdout:4/196: truncate d14/f18 3685338 0 2023-01-04T18:16:57.362 INFO:tasks.workunit.client.0.smithi050.stdout:5/360: symlink d13/d15/d17/d27/d78/l7d 0 2023-01-04T18:16:57.363 INFO:tasks.workunit.client.0.smithi050.stdout:1/161: rename d8/d14/d22/d23/c34 to d8/c38 0 2023-01-04T18:16:57.367 INFO:tasks.workunit.client.0.smithi050.stdout:6/196: dwrite d0/d9/d38/d16/f37 [0,4194304] 0 2023-01-04T18:16:57.367 INFO:tasks.workunit.client.0.smithi050.stdout:6/197: dread - d0/d9/f3b zero size 2023-01-04T18:16:57.370 INFO:tasks.workunit.client.0.smithi050.stdout:7/254: dwrite d6/db/f40 [0,4194304] 0 2023-01-04T18:16:57.370 INFO:tasks.workunit.client.0.smithi050.stdout:7/255: write d6/db/d15/d1b/d22/f37 [4591449,118730] 0 2023-01-04T18:16:57.371 INFO:tasks.workunit.client.0.smithi050.stdout:7/256: dread - d6/d28/d32/f4e zero size 2023-01-04T18:16:57.371 INFO:tasks.workunit.client.0.smithi050.stdout:7/257: stat d6/db/d15/d2e 0 2023-01-04T18:16:57.371 INFO:tasks.workunit.client.0.smithi050.stdout:9/232: mkdir d1/d3/d11/d42 0 2023-01-04T18:16:57.371 INFO:tasks.workunit.client.0.smithi050.stdout:2/176: dwrite d1/d19/f21 [0,4194304] 0 2023-01-04T18:16:57.373 INFO:tasks.workunit.client.0.smithi050.stdout:5/361: mknod d13/d15/d17/d1f/d35/d42/c7e 0 2023-01-04T18:16:57.373 INFO:tasks.workunit.client.0.smithi050.stdout:5/362: fsync d13/d15/d17/d27/f6c 0 2023-01-04T18:16:57.373 INFO:tasks.workunit.client.0.smithi050.stdout:5/363: read - d13/d15/d17/d27/f76 zero size 2023-01-04T18:16:57.373 INFO:tasks.workunit.client.0.smithi050.stdout:9/233: write d1/d3/d13/f26 [1522573,43501] 0 2023-01-04T18:16:57.374 INFO:tasks.workunit.client.0.smithi050.stdout:7/258: dread d6/f8 [0,4194304] 0 2023-01-04T18:16:57.374 INFO:tasks.workunit.client.0.smithi050.stdout:7/259: write d6/db/d15/d1b/f46 [1763624,85613] 0 2023-01-04T18:16:57.393 INFO:tasks.workunit.client.0.smithi050.stdout:2/177: dwrite d1/dd/d11/d1e/f22 [0,4194304] 0 2023-01-04T18:16:57.399 INFO:tasks.workunit.client.0.smithi050.stdout:2/178: read d1/dd/d11/d14/f30 [1990768,1076] 0 2023-01-04T18:16:57.407 INFO:tasks.workunit.client.0.smithi050.stdout:4/197: rename d14/d1b/d1f/f2b to d14/d1b/d1f/d22/f42 0 2023-01-04T18:16:57.409 INFO:tasks.workunit.client.0.smithi050.stdout:7/260: dwrite d6/db/d15/d1b/f46 [0,4194304] 0 2023-01-04T18:16:57.410 INFO:tasks.workunit.client.0.smithi050.stdout:7/261: write d6/db/f19 [2470501,127014] 0 2023-01-04T18:16:57.471 INFO:tasks.workunit.client.0.smithi050.stdout:1/162: truncate f6 3801365 0 2023-01-04T18:16:57.471 INFO:tasks.workunit.client.0.smithi050.stdout:1/163: chown d8/d14/d1c/d28/l2c 14366174 1 2023-01-04T18:16:57.472 INFO:tasks.workunit.client.0.smithi050.stdout:1/164: write d8/d14/d1d/f1f [209112,20208] 0 2023-01-04T18:16:57.487 INFO:tasks.workunit.client.0.smithi050.stdout:5/364: link d13/d15/d17/d1f/d35/d59/l6e d13/l7f 0 2023-01-04T18:16:57.493 INFO:tasks.workunit.client.0.smithi050.stdout:9/234: creat d1/d3/d11/f43 x:0 0 0 2023-01-04T18:16:57.493 INFO:tasks.workunit.client.0.smithi050.stdout:9/235: fdatasync d1/d3/f4 0 2023-01-04T18:16:57.498 INFO:tasks.workunit.client.0.smithi050.stdout:2/179: mkdir d1/dd/d28/d2c/d2e/d36 0 2023-01-04T18:16:57.501 INFO:tasks.workunit.client.0.smithi050.stdout:4/198: link d14/d1b/d1f/d22/c3a d14/d1b/d1f/c43 0 2023-01-04T18:16:57.509 INFO:tasks.workunit.client.0.smithi050.stdout:9/236: dwrite d1/d3/d11/d1f/f21 [0,4194304] 0 2023-01-04T18:16:57.511 INFO:tasks.workunit.client.0.smithi050.stdout:5/365: link d13/d15/d17/d1f/d35/f3a d13/d15/d17/d1f/f80 0 2023-01-04T18:16:57.511 INFO:tasks.workunit.client.0.smithi050.stdout:2/180: mknod d1/dd/c37 0 2023-01-04T18:16:57.517 INFO:tasks.workunit.client.0.smithi050.stdout:1/165: truncate f6 2380701 0 2023-01-04T18:16:57.517 INFO:tasks.workunit.client.0.smithi050.stdout:1/166: readlink d8/d14/d1c/l25 0 2023-01-04T18:16:57.523 INFO:tasks.workunit.client.0.smithi050.stdout:9/237: rename d1/d3/d13/f26 to d1/d12/f44 0 2023-01-04T18:16:57.525 INFO:tasks.workunit.client.0.smithi050.stdout:5/366: getdents d13/d15/d17/d1f/d35/d49 0 2023-01-04T18:16:57.525 INFO:tasks.workunit.client.0.smithi050.stdout:5/367: fsync d13/f3b 0 2023-01-04T18:16:57.527 INFO:tasks.workunit.client.0.smithi050.stdout:0/206: sync 2023-01-04T18:16:57.527 INFO:tasks.workunit.client.0.smithi050.stdout:3/229: sync 2023-01-04T18:16:57.528 INFO:tasks.workunit.client.0.smithi050.stdout:8/234: sync 2023-01-04T18:16:57.528 INFO:tasks.workunit.client.0.smithi050.stdout:3/230: fsync d0/d10/f42 0 2023-01-04T18:16:57.528 INFO:tasks.workunit.client.0.smithi050.stdout:3/231: stat d0/d1b/d2f/d31/f4b 0 2023-01-04T18:16:57.530 INFO:tasks.workunit.client.0.smithi050.stdout:2/181: rmdir d1/dd 39 2023-01-04T18:16:57.533 INFO:tasks.workunit.client.0.smithi050.stdout:4/199: dread d14/d1b/d32/f35 [0,4194304] 0 2023-01-04T18:16:57.533 INFO:tasks.workunit.client.0.smithi050.stdout:4/200: write d14/f15 [4769150,85923] 0 2023-01-04T18:16:57.535 INFO:tasks.workunit.client.0.smithi050.stdout:4/201: write f5 [2428702,13034] 0 2023-01-04T18:16:57.536 INFO:tasks.workunit.client.0.smithi050.stdout:1/167: unlink d8/f19 0 2023-01-04T18:16:57.536 INFO:tasks.workunit.client.0.smithi050.stdout:1/168: truncate d8/d14/f30 981915 0 2023-01-04T18:16:57.537 INFO:tasks.workunit.client.0.smithi050.stdout:9/238: rename d1/d3/d11/l30 to d1/d3/d11/d1f/l45 0 2023-01-04T18:16:57.540 INFO:tasks.workunit.client.0.smithi050.stdout:5/368: symlink d13/d15/d17/d1f/d62/l81 0 2023-01-04T18:16:57.540 INFO:tasks.workunit.client.0.smithi050.stdout:5/369: readlink d13/d15/d17/d27/d46/d4e/l57 0 2023-01-04T18:16:57.540 INFO:tasks.workunit.client.0.smithi050.stdout:5/370: chown d13/d15/d17/d1f/d35 56680 1 2023-01-04T18:16:57.540 INFO:tasks.workunit.client.0.smithi050.stdout:5/371: stat d13/d15/d17/d27/d46/d4e/d4d/f77 0 2023-01-04T18:16:57.543 INFO:tasks.workunit.client.0.smithi050.stdout:0/207: link d0/d6/d8/d35/c32 d0/d6/d28/c3d 0 2023-01-04T18:16:57.544 INFO:tasks.workunit.client.0.smithi050.stdout:0/208: write d0/d6/d8/f13 [3144608,40796] 0 2023-01-04T18:16:57.544 INFO:tasks.workunit.client.0.smithi050.stdout:8/235: creat d3/d2a/d2d/f50 x:0 0 0 2023-01-04T18:16:57.544 INFO:tasks.workunit.client.0.smithi050.stdout:8/236: stat d3/d2a/f18 0 2023-01-04T18:16:57.544 INFO:tasks.workunit.client.0.smithi050.stdout:8/237: write d3/d2a/d30/d3b/d4d/d1b/d28/f40 [764839,68290] 0 2023-01-04T18:16:57.544 INFO:tasks.workunit.client.0.smithi050.stdout:8/238: rename d3/d2a/d30/d3b/d4d/d1b/d28 to d3/d2a/d30/d3b/d4d/d1b/d28/d51 22 2023-01-04T18:16:57.545 INFO:tasks.workunit.client.0.smithi050.stdout:0/209: write d0/f4 [193622,83995] 0 2023-01-04T18:16:57.551 INFO:tasks.workunit.client.0.smithi050.stdout:3/232: symlink d0/d1b/d2f/l51 0 2023-01-04T18:16:57.552 INFO:tasks.workunit.client.0.smithi050.stdout:2/182: truncate d1/f3 6688248 0 2023-01-04T18:16:57.552 INFO:tasks.workunit.client.0.smithi050.stdout:2/183: dread - d1/dd/d28/d2c/f2d zero size 2023-01-04T18:16:57.552 INFO:tasks.workunit.client.0.smithi050.stdout:2/184: fsync d1/dd/d28/d2c/f2d 0 2023-01-04T18:16:57.556 INFO:tasks.workunit.client.0.smithi050.stdout:0/210: dread d0/d6/d8/f13 [0,4194304] 0 2023-01-04T18:16:57.557 INFO:tasks.workunit.client.0.smithi050.stdout:0/211: write d0/d6/d8/d35/f37 [4384985,50365] 0 2023-01-04T18:16:57.557 INFO:tasks.workunit.client.0.smithi050.stdout:4/202: mkdir d14/d1b/d1f/d22/d3e/d44 0 2023-01-04T18:16:57.559 INFO:tasks.workunit.client.0.smithi050.stdout:1/169: getdents d8/d14/d1c/d28 0 2023-01-04T18:16:57.560 INFO:tasks.workunit.client.0.smithi050.stdout:9/239: symlink d1/d3/d11/d1f/l46 0 2023-01-04T18:16:57.562 INFO:tasks.workunit.client.0.smithi050.stdout:1/170: write d8/d14/d1d/f1e [844135,77669] 0 2023-01-04T18:16:57.563 INFO:tasks.workunit.client.0.smithi050.stdout:1/171: fsync d8/f11 0 2023-01-04T18:16:57.563 INFO:tasks.workunit.client.0.smithi050.stdout:8/239: dwrite d3/f25 [0,4194304] 0 2023-01-04T18:16:57.563 INFO:tasks.workunit.client.0.smithi050.stdout:1/172: write d8/f2f [419415,69112] 0 2023-01-04T18:16:57.563 INFO:tasks.workunit.client.0.smithi050.stdout:1/173: fdatasync d8/d14/f30 0 2023-01-04T18:16:57.564 INFO:tasks.workunit.client.0.smithi050.stdout:5/372: creat d13/d15/d17/d27/d44/f82 x:0 0 0 2023-01-04T18:16:57.564 INFO:tasks.workunit.client.0.smithi050.stdout:8/240: write d3/f25 [2535106,109499] 0 2023-01-04T18:16:57.564 INFO:tasks.workunit.client.0.smithi050.stdout:8/241: chown d3/l3a 1494516132 1 2023-01-04T18:16:57.573 INFO:tasks.workunit.client.0.smithi050.stdout:3/233: rename d0/d10/d30/d3f/l4d to d0/d1b/l52 0 2023-01-04T18:16:57.574 INFO:tasks.workunit.client.0.smithi050.stdout:3/234: write d0/f4 [257698,86657] 0 2023-01-04T18:16:57.575 INFO:tasks.workunit.client.0.smithi050.stdout:2/185: mkdir d1/dd/d38 0 2023-01-04T18:16:57.575 INFO:tasks.workunit.client.0.smithi050.stdout:2/186: chown d1/dd 8177 1 2023-01-04T18:16:57.575 INFO:tasks.workunit.client.0.smithi050.stdout:2/187: chown d1/dd/d38 204 1 2023-01-04T18:16:57.577 INFO:tasks.workunit.client.0.smithi050.stdout:4/203: link fc d14/d1b/d32/f45 0 2023-01-04T18:16:57.578 INFO:tasks.workunit.client.0.smithi050.stdout:0/212: dwrite d0/d6/fa [0,4194304] 0 2023-01-04T18:16:57.578 INFO:tasks.workunit.client.0.smithi050.stdout:8/242: fdatasync d3/d2a/d30/d3b/d4d/d1b/d28/f40 0 2023-01-04T18:16:57.578 INFO:tasks.workunit.client.0.smithi050.stdout:6/198: sync 2023-01-04T18:16:57.579 INFO:tasks.workunit.client.0.smithi050.stdout:9/240: creat d1/f47 x:0 0 0 2023-01-04T18:16:57.586 INFO:tasks.workunit.client.0.smithi050.stdout:1/174: mknod d8/d14/d22/d31/c39 0 2023-01-04T18:16:57.590 INFO:tasks.workunit.client.0.smithi050.stdout:5/373: mkdir d13/d28/d7c/d83 0 2023-01-04T18:16:57.592 INFO:tasks.workunit.client.0.smithi050.stdout:3/235: rename d0/d21/f47 to d0/d10/d30/f53 0 2023-01-04T18:16:57.595 INFO:tasks.workunit.client.0.smithi050.stdout:3/236: fdatasync d0/f4 0 2023-01-04T18:16:57.611 INFO:tasks.workunit.client.0.smithi050.stdout:3/237: dwrite d0/d1a/f29 [0,4194304] 0 2023-01-04T18:16:57.611 INFO:tasks.workunit.client.0.smithi050.stdout:3/238: chown d0/d10/f42 48143 1 2023-01-04T18:16:57.664 INFO:tasks.workunit.client.0.smithi050.stdout:2/188: mkdir d1/dd/d11/d14/d39 0 2023-01-04T18:16:57.666 INFO:tasks.workunit.client.0.smithi050.stdout:0/213: mkdir d0/d6/d8/d25/d3e 0 2023-01-04T18:16:57.718 INFO:tasks.workunit.client.0.smithi050.stdout:6/199: unlink d0/d9/d38/l42 0 2023-01-04T18:16:57.719 INFO:tasks.workunit.client.0.smithi050.stdout:9/241: symlink d1/d3/l48 0 2023-01-04T18:16:57.722 INFO:tasks.workunit.client.0.smithi050.stdout:4/204: rename f12 to d14/d1b/d1f/f46 0 2023-01-04T18:16:57.723 INFO:tasks.workunit.client.0.smithi050.stdout:4/205: read d14/f21 [768076,31642] 0 2023-01-04T18:16:57.726 INFO:tasks.workunit.client.0.smithi050.stdout:3/239: link d0/d1b/d2f/l51 d0/d21/l54 0 2023-01-04T18:16:57.728 INFO:tasks.workunit.client.0.smithi050.stdout:9/242: dread d1/d3/d3b/d23/f1c [0,4194304] 0 2023-01-04T18:16:57.728 INFO:tasks.workunit.client.0.smithi050.stdout:9/243: stat d1/d12/f44 0 2023-01-04T18:16:57.728 INFO:tasks.workunit.client.0.smithi050.stdout:9/244: dread - d1/d3/d13/f36 zero size 2023-01-04T18:16:57.729 INFO:tasks.workunit.client.0.smithi050.stdout:2/189: creat d1/dd/f3a x:0 0 0 2023-01-04T18:16:57.732 INFO:tasks.workunit.client.0.smithi050.stdout:6/200: unlink d0/d9/d38/l31 0 2023-01-04T18:16:57.732 INFO:tasks.workunit.client.0.smithi050.stdout:6/201: chown d0/d9/d25/d2d/l34 0 1 2023-01-04T18:16:57.733 INFO:tasks.workunit.client.0.smithi050.stdout:8/243: rename d3/l38 to d3/d2a/d30/d3b/d4d/d1b/d28/d3d/l52 0 2023-01-04T18:16:57.734 INFO:tasks.workunit.client.0.smithi050.stdout:2/190: dread d1/dd/d11/f27 [0,4194304] 0 2023-01-04T18:16:57.735 INFO:tasks.workunit.client.0.smithi050.stdout:4/206: truncate f0 1712120 0 2023-01-04T18:16:57.735 INFO:tasks.workunit.client.0.smithi050.stdout:4/207: read d14/f24 [184621,58171] 0 2023-01-04T18:16:57.738 INFO:tasks.workunit.client.0.smithi050.stdout:9/245: creat d1/d12/d2d/f49 x:0 0 0 2023-01-04T18:16:57.739 INFO:tasks.workunit.client.0.smithi050.stdout:6/202: symlink d0/d9/d25/d40/l43 0 2023-01-04T18:16:57.743 INFO:tasks.workunit.client.0.smithi050.stdout:1/175: rename d8/d14/d22 to d8/d14/d1d/d3a 0 2023-01-04T18:16:57.743 INFO:tasks.workunit.client.0.smithi050.stdout:0/214: rename d0 to d0/d6/d28/d3f 22 2023-01-04T18:16:57.743 INFO:tasks.workunit.client.0.smithi050.stdout:1/176: stat d8/d14/d1c/l25 0 2023-01-04T18:16:57.745 INFO:tasks.workunit.client.0.smithi050.stdout:8/244: mkdir d3/d2a/d30/d3b/d53 0 2023-01-04T18:16:57.748 INFO:tasks.workunit.client.0.smithi050.stdout:2/191: symlink d1/dd/d11/d14/d39/l3b 0 2023-01-04T18:16:57.752 INFO:tasks.workunit.client.0.smithi050.stdout:9/246: creat d1/d12/d41/f4a x:0 0 0 2023-01-04T18:16:57.756 INFO:tasks.workunit.client.0.smithi050.stdout:3/240: truncate d0/d1b/d2f/d31/f4b 3179822 0 2023-01-04T18:16:57.756 INFO:tasks.workunit.client.0.smithi050.stdout:7/262: sync 2023-01-04T18:16:57.762 INFO:tasks.workunit.client.0.smithi050.stdout:7/263: dread d6/d28/f3d [0,4194304] 0 2023-01-04T18:16:57.762 INFO:tasks.workunit.client.0.smithi050.stdout:7/264: chown d6/db/d15/d1b 14249 1 2023-01-04T18:16:57.763 INFO:tasks.workunit.client.0.smithi050.stdout:6/203: creat d0/d9/d25/d2d/f44 x:0 0 0 2023-01-04T18:16:57.766 INFO:tasks.workunit.client.0.smithi050.stdout:1/177: dwrite d8/d14/d1c/d28/f2b [0,4194304] 0 2023-01-04T18:16:57.767 INFO:tasks.workunit.client.0.smithi050.stdout:0/215: dwrite d0/f3b [0,4194304] 0 2023-01-04T18:16:57.769 INFO:tasks.workunit.client.0.smithi050.stdout:4/208: rename d14/d1b/d1f/d22/c30 to d14/d1b/d1f/c47 0 2023-01-04T18:16:57.769 INFO:tasks.workunit.client.0.smithi050.stdout:4/209: truncate d14/d1b/f41 1038690 0 2023-01-04T18:16:57.771 INFO:tasks.workunit.client.0.smithi050.stdout:8/245: creat d3/d2a/d30/d3b/d53/f54 x:0 0 0 2023-01-04T18:16:57.771 INFO:tasks.workunit.client.0.smithi050.stdout:8/246: chown d3/d2a/d30/d3b/d4d/d23 503 1 2023-01-04T18:16:57.776 INFO:tasks.workunit.client.0.smithi050.stdout:2/192: symlink d1/d10/l3c 0 2023-01-04T18:16:57.776 INFO:tasks.workunit.client.0.smithi050.stdout:9/247: mknod d1/d3/d11/d42/c4b 0 2023-01-04T18:16:57.776 INFO:tasks.workunit.client.0.smithi050.stdout:7/265: mkdir d6/db/d15/d1b/d5b 0 2023-01-04T18:16:57.777 INFO:tasks.workunit.client.0.smithi050.stdout:3/241: dwrite d0/d1a/f24 [0,4194304] 0 2023-01-04T18:16:57.777 INFO:tasks.workunit.client.0.smithi050.stdout:3/242: stat d0/d10/f42 0 2023-01-04T18:16:57.777 INFO:tasks.workunit.client.0.smithi050.stdout:0/216: dread d0/d6/d8/d35/f34 [0,4194304] 0 2023-01-04T18:16:57.777 INFO:tasks.workunit.client.0.smithi050.stdout:4/210: dread fc [0,4194304] 0 2023-01-04T18:16:57.779 INFO:tasks.workunit.client.0.smithi050.stdout:1/178: unlink d8/d14/d1c/d28/l2c 0 2023-01-04T18:16:57.779 INFO:tasks.workunit.client.0.smithi050.stdout:1/179: readlink d8/d14/d1c/l2e 0 2023-01-04T18:16:57.779 INFO:tasks.workunit.client.0.smithi050.stdout:1/180: write d8/f2f [5201118,23756] 0 2023-01-04T18:16:57.780 INFO:tasks.workunit.client.0.smithi050.stdout:1/181: chown d8/d14/d1c/d28/f2b 448820 1 2023-01-04T18:16:57.781 INFO:tasks.workunit.client.0.smithi050.stdout:1/182: dread d8/d14/d1d/f1e [0,4194304] 0 2023-01-04T18:16:57.781 INFO:tasks.workunit.client.0.smithi050.stdout:1/183: fdatasync d8/d14/d1d/d3a/d23/f26 0 2023-01-04T18:16:57.782 INFO:tasks.workunit.client.0.smithi050.stdout:2/193: creat d1/dd/d28/d2c/d2e/d36/f3d x:0 0 0 2023-01-04T18:16:57.782 INFO:tasks.workunit.client.0.smithi050.stdout:2/194: dread - d1/dd/d11/d14/f33 zero size 2023-01-04T18:16:57.788 INFO:tasks.workunit.client.0.smithi050.stdout:9/248: getdents d1/d12/d41 0 2023-01-04T18:16:57.789 INFO:tasks.workunit.client.0.smithi050.stdout:3/243: dread d0/f40 [0,4194304] 0 2023-01-04T18:16:57.791 INFO:tasks.workunit.client.0.smithi050.stdout:3/244: write d0/dd/f11 [1915717,96938] 0 2023-01-04T18:16:57.792 INFO:tasks.workunit.client.0.smithi050.stdout:7/266: mkdir d6/db/d3b/d5c 0 2023-01-04T18:16:57.793 INFO:tasks.workunit.client.0.smithi050.stdout:7/267: stat d6/d28/d3c/l45 0 2023-01-04T18:16:57.793 INFO:tasks.workunit.client.0.smithi050.stdout:7/268: stat d6/db/d15/d1b/f46 0 2023-01-04T18:16:57.793 INFO:tasks.workunit.client.0.smithi050.stdout:7/269: dread - d6/db/d15/f44 zero size 2023-01-04T18:16:57.796 INFO:tasks.workunit.client.0.smithi050.stdout:8/247: dwrite d3/d2a/d30/f3f [8388608,4194304] 0 2023-01-04T18:16:57.797 INFO:tasks.workunit.client.0.smithi050.stdout:8/248: stat d3/d2a/d30 0 2023-01-04T18:16:57.797 INFO:tasks.workunit.client.0.smithi050.stdout:8/249: chown d3/d2a/d30/f3f 2 1 2023-01-04T18:16:57.797 INFO:tasks.workunit.client.0.smithi050.stdout:8/250: fsync d3/d5/d46/f4a 0 2023-01-04T18:16:57.797 INFO:tasks.workunit.client.0.smithi050.stdout:8/251: stat d3/d2a/d30/d3b/d4d/d1b/d28 0 2023-01-04T18:16:57.797 INFO:tasks.workunit.client.0.smithi050.stdout:6/204: unlink d0/d9/d38/d1c/l2a 0 2023-01-04T18:16:57.797 INFO:tasks.workunit.client.0.smithi050.stdout:6/205: write d0/d9/d38/fd [599147,45830] 0 2023-01-04T18:16:57.798 INFO:tasks.workunit.client.0.smithi050.stdout:8/252: dread d3/d2a/d30/d3b/d4d/d1b/d28/f40 [0,4194304] 0 2023-01-04T18:16:57.798 INFO:tasks.workunit.client.0.smithi050.stdout:8/253: dread - d3/d5/d46/f4a zero size 2023-01-04T18:16:57.802 INFO:tasks.workunit.client.0.smithi050.stdout:0/217: creat d0/d6/d28/d1a/f40 x:0 0 0 2023-01-04T18:16:57.802 INFO:tasks.workunit.client.0.smithi050.stdout:0/218: chown d0/d6/d28/l29 10452 1 2023-01-04T18:16:57.804 INFO:tasks.workunit.client.0.smithi050.stdout:4/211: mknod d14/d1b/d1f/c48 0 2023-01-04T18:16:57.808 INFO:tasks.workunit.client.0.smithi050.stdout:0/219: write d0/d6/d8/f1c [3234566,84891] 0 2023-01-04T18:16:57.808 INFO:tasks.workunit.client.0.smithi050.stdout:0/220: stat d0/d6 0 2023-01-04T18:16:57.810 INFO:tasks.workunit.client.0.smithi050.stdout:1/184: chown d8/c17 131046841 1 2023-01-04T18:16:57.812 INFO:tasks.workunit.client.0.smithi050.stdout:2/195: unlink d1/f1a 0 2023-01-04T18:16:57.813 INFO:tasks.workunit.client.0.smithi050.stdout:9/249: creat d1/d12/d2d/f4c x:0 0 0 2023-01-04T18:16:57.814 INFO:tasks.workunit.client.0.smithi050.stdout:7/270: dwrite d6/db/d15/d48/f58 [0,4194304] 0 2023-01-04T18:16:57.814 INFO:tasks.workunit.client.0.smithi050.stdout:7/271: write d6/db/d15/f36 [387538,90897] 0 2023-01-04T18:16:57.818 INFO:tasks.workunit.client.0.smithi050.stdout:9/250: dread d1/d3/d13/f15 [0,4194304] 0 2023-01-04T18:16:57.823 INFO:tasks.workunit.client.0.smithi050.stdout:9/251: dread d1/d3/d3b/f27 [0,4194304] 0 2023-01-04T18:16:57.824 INFO:tasks.workunit.client.0.smithi050.stdout:4/212: dwrite f4 [0,4194304] 0 2023-01-04T18:16:57.836 INFO:tasks.workunit.client.0.smithi050.stdout:4/213: dwrite f9 [4194304,4194304] 0 2023-01-04T18:16:57.853 INFO:tasks.workunit.client.0.smithi050.stdout:3/245: rmdir d0/d1b 39 2023-01-04T18:16:57.854 INFO:tasks.workunit.client.0.smithi050.stdout:6/206: symlink d0/d9/d38/l45 0 2023-01-04T18:16:57.856 INFO:tasks.workunit.client.0.smithi050.stdout:8/254: rename d3/d2a/d30/d3b/d4d/d1b/d28/d3d to d3/d2a/d30/d3b/d4d/d23/d55 0 2023-01-04T18:16:57.859 INFO:tasks.workunit.client.0.smithi050.stdout:1/185: mkdir d8/d14/d1d/d3b 0 2023-01-04T18:16:57.859 INFO:tasks.workunit.client.0.smithi050.stdout:1/186: write d8/f12 [107740,40105] 0 2023-01-04T18:16:57.860 INFO:tasks.workunit.client.0.smithi050.stdout:2/196: symlink d1/dd/d28/d2c/d2e/d36/l3e 0 2023-01-04T18:16:57.860 INFO:tasks.workunit.client.0.smithi050.stdout:2/197: chown d1/dd/d11/d14/l1b 63954 1 2023-01-04T18:16:57.865 INFO:tasks.workunit.client.0.smithi050.stdout:7/272: creat d6/db/d15/d2e/f5d x:0 0 0 2023-01-04T18:16:57.865 INFO:tasks.workunit.client.0.smithi050.stdout:2/198: dread d1/dd/d11/d1e/f20 [4194304,4194304] 0 2023-01-04T18:16:57.866 INFO:tasks.workunit.client.0.smithi050.stdout:2/199: readlink d1/d10/l16 0 2023-01-04T18:16:57.868 INFO:tasks.workunit.client.0.smithi050.stdout:9/252: unlink d1/d3/d13/l2b 0 2023-01-04T18:16:57.881 INFO:tasks.workunit.client.0.smithi050.stdout:4/214: creat d14/d1b/d1f/d22/f49 x:0 0 0 2023-01-04T18:16:57.882 INFO:tasks.workunit.client.0.smithi050.stdout:3/246: mknod d0/dd/c55 0 2023-01-04T18:16:57.882 INFO:tasks.workunit.client.0.smithi050.stdout:3/247: truncate d0/d21/f25 1153280 0 2023-01-04T18:16:57.887 INFO:tasks.workunit.client.0.smithi050.stdout:5/374: sync 2023-01-04T18:16:57.891 INFO:tasks.workunit.client.0.smithi050.stdout:8/255: mknod d3/d2a/d30/d3b/d4d/d23/c56 0 2023-01-04T18:16:57.895 INFO:tasks.workunit.client.0.smithi050.stdout:7/273: creat d6/db/d20/d55/f5e x:0 0 0 2023-01-04T18:16:57.897 INFO:tasks.workunit.client.0.smithi050.stdout:7/274: dread d6/db/d15/d2e/f2f [0,4194304] 0 2023-01-04T18:16:57.897 INFO:tasks.workunit.client.0.smithi050.stdout:7/275: write d6/db/d15/d1b/d22/f39 [499420,64912] 0 2023-01-04T18:16:57.897 INFO:tasks.workunit.client.0.smithi050.stdout:2/200: mkdir d1/dd/d28/d2c/d2e/d3f 0 2023-01-04T18:16:57.898 INFO:tasks.workunit.client.0.smithi050.stdout:9/253: creat d1/d12/d2d/d39/f4d x:0 0 0 2023-01-04T18:16:57.899 INFO:tasks.workunit.client.0.smithi050.stdout:4/215: creat d14/d1b/d1f/f4a x:0 0 0 2023-01-04T18:16:57.899 INFO:tasks.workunit.client.0.smithi050.stdout:4/216: fsync f11 0 2023-01-04T18:16:57.902 INFO:tasks.workunit.client.0.smithi050.stdout:3/248: rename d0/d10/d30 to d0/d1b/d2f/d56 0 2023-01-04T18:16:57.903 INFO:tasks.workunit.client.0.smithi050.stdout:2/201: dread d1/dd/d11/f26 [0,4194304] 0 2023-01-04T18:16:57.904 INFO:tasks.workunit.client.0.smithi050.stdout:6/207: mknod d0/d9/d38/d1c/c46 0 2023-01-04T18:16:57.907 INFO:tasks.workunit.client.0.smithi050.stdout:5/375: creat d13/d15/d17/d27/d44/d47/f84 x:0 0 0 2023-01-04T18:16:57.908 INFO:tasks.workunit.client.0.smithi050.stdout:5/376: chown d13/d15/d17/d1f/d35/d49/l4b 0 1 2023-01-04T18:16:57.914 INFO:tasks.workunit.client.0.smithi050.stdout:8/256: creat d3/d2a/d30/d3b/d4d/d23/d55/f57 x:0 0 0 2023-01-04T18:16:57.914 INFO:tasks.workunit.client.0.smithi050.stdout:6/208: dread d0/d9/f29 [0,4194304] 0 2023-01-04T18:16:57.915 INFO:tasks.workunit.client.0.smithi050.stdout:1/187: symlink d8/l3c 0 2023-01-04T18:16:57.918 INFO:tasks.workunit.client.0.smithi050.stdout:7/276: mkdir d6/d28/d3c/d42/d5f 0 2023-01-04T18:16:57.919 INFO:tasks.workunit.client.0.smithi050.stdout:9/254: creat d1/d3/d11/d1f/f4e x:0 0 0 2023-01-04T18:16:57.925 INFO:tasks.workunit.client.0.smithi050.stdout:4/217: getdents d14/d1b/d1f/d22/d3e 0 2023-01-04T18:16:57.925 INFO:tasks.workunit.client.0.smithi050.stdout:3/249: creat d0/d1a/f57 x:0 0 0 2023-01-04T18:16:57.927 INFO:tasks.workunit.client.0.smithi050.stdout:2/202: rename d1/dd/d28/d2c/d2e/d36/f3d to d1/dd/d28/d2c/d2e/f40 0 2023-01-04T18:16:57.928 INFO:tasks.workunit.client.0.smithi050.stdout:2/203: write d1/f15 [3181770,85779] 0 2023-01-04T18:16:57.930 INFO:tasks.workunit.client.0.smithi050.stdout:5/377: rmdir d13/d15/d17/d1f/d35/d42 39 2023-01-04T18:16:57.930 INFO:tasks.workunit.client.0.smithi050.stdout:5/378: chown d13/d15/d17/c25 3645 1 2023-01-04T18:16:57.930 INFO:tasks.workunit.client.0.smithi050.stdout:5/379: chown d13/d15/d17/d1f/d35/d42/d4a/f68 3552 1 2023-01-04T18:16:57.932 INFO:tasks.workunit.client.0.smithi050.stdout:8/257: symlink d3/d2a/d30/d3b/d4d/d1b/d28/l58 0 2023-01-04T18:16:57.932 INFO:tasks.workunit.client.0.smithi050.stdout:6/209: creat d0/d9/df/f47 x:0 0 0 2023-01-04T18:16:57.932 INFO:tasks.workunit.client.0.smithi050.stdout:2/204: dread d1/d19/f21 [0,4194304] 0 2023-01-04T18:16:57.934 INFO:tasks.workunit.client.0.smithi050.stdout:3/250: write d0/fe [2719740,6479] 0 2023-01-04T18:16:57.934 INFO:tasks.workunit.client.0.smithi050.stdout:1/188: symlink d8/d14/d1d/d3a/d23/l3d 0 2023-01-04T18:16:57.935 INFO:tasks.workunit.client.0.smithi050.stdout:1/189: write d8/fd [904033,78070] 0 2023-01-04T18:16:57.936 INFO:tasks.workunit.client.0.smithi050.stdout:4/218: rename d14/c19 to d14/d1b/d1f/d22/d3e/c4b 0 2023-01-04T18:16:57.936 INFO:tasks.workunit.client.0.smithi050.stdout:4/219: chown d14/f15 15080 1 2023-01-04T18:16:57.941 INFO:tasks.workunit.client.0.smithi050.stdout:3/251: write d0/f18 [2428027,107008] 0 2023-01-04T18:16:57.941 INFO:tasks.workunit.client.0.smithi050.stdout:3/252: chown d0/fb 62 1 2023-01-04T18:16:57.941 INFO:tasks.workunit.client.0.smithi050.stdout:3/253: write d0/d10/f3e [527352,109015] 0 2023-01-04T18:16:57.942 INFO:tasks.workunit.client.0.smithi050.stdout:5/380: symlink d13/d15/d17/l85 0 2023-01-04T18:16:57.942 INFO:tasks.workunit.client.0.smithi050.stdout:7/277: dwrite d6/db/f2a [0,4194304] 0 2023-01-04T18:16:57.944 INFO:tasks.workunit.client.0.smithi050.stdout:8/258: link d3/c9 d3/d2a/d30/d3b/d53/c59 0 2023-01-04T18:16:57.947 INFO:tasks.workunit.client.0.smithi050.stdout:4/220: write f4 [2057068,95672] 0 2023-01-04T18:16:57.947 INFO:tasks.workunit.client.0.smithi050.stdout:2/205: rmdir d1/d19 39 2023-01-04T18:16:57.947 INFO:tasks.workunit.client.0.smithi050.stdout:8/259: dread d3/d2a/d30/d3b/d4d/f2b [0,4194304] 0 2023-01-04T18:16:57.948 INFO:tasks.workunit.client.0.smithi050.stdout:9/255: dwrite d1/d12/d2d/d39/f4d [0,4194304] 0 2023-01-04T18:16:57.950 INFO:tasks.workunit.client.0.smithi050.stdout:6/210: dwrite d0/f2f [0,4194304] 0 2023-01-04T18:16:57.951 INFO:tasks.workunit.client.0.smithi050.stdout:1/190: rename d8/f2f to d8/d14/d1d/d3a/d23/f3e 0 2023-01-04T18:16:57.955 INFO:tasks.workunit.client.0.smithi050.stdout:3/254: unlink d0/d1a/f29 0 2023-01-04T18:16:57.955 INFO:tasks.workunit.client.0.smithi050.stdout:3/255: readlink d0/d10/l1f 0 2023-01-04T18:16:57.955 INFO:tasks.workunit.client.0.smithi050.stdout:3/256: dread - d0/d1b/d2f/d56/f53 zero size 2023-01-04T18:16:57.955 INFO:tasks.workunit.client.0.smithi050.stdout:5/381: symlink d13/d15/d17/d1f/d35/d59/l86 0 2023-01-04T18:16:57.958 INFO:tasks.workunit.client.0.smithi050.stdout:7/278: creat d6/db/f60 x:0 0 0 2023-01-04T18:16:57.959 INFO:tasks.workunit.client.0.smithi050.stdout:4/221: mknod d14/d1b/d32/c4c 0 2023-01-04T18:16:57.959 INFO:tasks.workunit.client.0.smithi050.stdout:6/211: write d0/d9/df/f22 [575654,65398] 0 2023-01-04T18:16:57.962 INFO:tasks.workunit.client.0.smithi050.stdout:8/260: stat d3/d5/c19 0 2023-01-04T18:16:57.967 INFO:tasks.workunit.client.0.smithi050.stdout:9/256: link d1/d3/l2c d1/d3/d24/l4f 0 2023-01-04T18:16:57.970 INFO:tasks.workunit.client.0.smithi050.stdout:5/382: dwrite d13/d15/d17/d1f/d35/d42/f79 [0,4194304] 0 2023-01-04T18:16:57.970 INFO:tasks.workunit.client.0.smithi050.stdout:5/383: write d13/d15/d17/d27/f76 [505663,116758] 0 2023-01-04T18:16:57.970 INFO:tasks.workunit.client.0.smithi050.stdout:1/191: creat d8/d14/d1c/d28/f3f x:0 0 0 2023-01-04T18:16:57.971 INFO:tasks.workunit.client.0.smithi050.stdout:3/257: rmdir d0/d1b/d2f/d56/d3f 39 2023-01-04T18:16:57.971 INFO:tasks.workunit.client.0.smithi050.stdout:5/384: write d13/d15/d17/d1f/f56 [1020716,121508] 0 2023-01-04T18:16:57.972 INFO:tasks.workunit.client.0.smithi050.stdout:7/279: creat d6/db/d3b/f61 x:0 0 0 2023-01-04T18:16:57.975 INFO:tasks.workunit.client.0.smithi050.stdout:4/222: creat d14/d1b/d1f/d22/f4d x:0 0 0 2023-01-04T18:16:57.980 INFO:tasks.workunit.client.0.smithi050.stdout:6/212: symlink d0/d9/d25/d40/l48 0 2023-01-04T18:16:57.980 INFO:tasks.workunit.client.0.smithi050.stdout:6/213: chown d0/d9/f17 196 1 2023-01-04T18:16:57.983 INFO:tasks.workunit.client.0.smithi050.stdout:2/206: mkdir d1/d41 0 2023-01-04T18:16:57.985 INFO:tasks.workunit.client.0.smithi050.stdout:8/261: creat d3/d2a/d30/d3b/d4d/d23/d55/f5a x:0 0 0 2023-01-04T18:16:57.986 INFO:tasks.workunit.client.0.smithi050.stdout:8/262: write d3/d5/d46/f4a [594465,9582] 0 2023-01-04T18:16:57.987 INFO:tasks.workunit.client.0.smithi050.stdout:8/263: dread d3/d2a/d30/d3b/d4d/d1b/d28/f39 [0,4194304] 0 2023-01-04T18:16:57.987 INFO:tasks.workunit.client.0.smithi050.stdout:8/264: write d3/d2a/d30/d3b/d4d/d23/d55/f5a [870535,108890] 0 2023-01-04T18:16:57.987 INFO:tasks.workunit.client.0.smithi050.stdout:8/265: chown d3/d2a/d30/d3b/d4d/d23 205 1 2023-01-04T18:16:57.988 INFO:tasks.workunit.client.0.smithi050.stdout:8/266: readlink d3/d2a/d30/d3b/l4f 0 2023-01-04T18:16:57.988 INFO:tasks.workunit.client.0.smithi050.stdout:9/257: mknod d1/d12/d2d/d39/c50 0 2023-01-04T18:16:57.991 INFO:tasks.workunit.client.0.smithi050.stdout:2/207: write d1/dd/d11/d14/f30 [3387255,34276] 0 2023-01-04T18:16:57.994 INFO:tasks.workunit.client.0.smithi050.stdout:1/192: creat d8/d14/d1c/f40 x:0 0 0 2023-01-04T18:16:57.994 INFO:tasks.workunit.client.0.smithi050.stdout:1/193: dread - d8/d14/f35 zero size 2023-01-04T18:16:57.994 INFO:tasks.workunit.client.0.smithi050.stdout:1/194: write d8/d14/f30 [95646,26177] 0 2023-01-04T18:16:57.995 INFO:tasks.workunit.client.0.smithi050.stdout:1/195: fsync d8/f11 0 2023-01-04T18:16:57.995 INFO:tasks.workunit.client.0.smithi050.stdout:5/385: mkdir d13/d15/d17/d1f/d35/d59/d87 0 2023-01-04T18:16:57.999 INFO:tasks.workunit.client.0.smithi050.stdout:4/223: dwrite d14/f1a [0,4194304] 0 2023-01-04T18:16:57.999 INFO:tasks.workunit.client.0.smithi050.stdout:3/258: dwrite d0/d1a/f4e [0,4194304] 0 2023-01-04T18:16:58.000 INFO:tasks.workunit.client.0.smithi050.stdout:7/280: mkdir d6/d28/d3c/d62 0 2023-01-04T18:16:58.001 INFO:tasks.workunit.client.0.smithi050.stdout:1/196: dread d8/d14/f30 [0,4194304] 0 2023-01-04T18:16:58.002 INFO:tasks.workunit.client.0.smithi050.stdout:6/214: rmdir d0/d9/d38/d33 0 2023-01-04T18:16:58.005 INFO:tasks.workunit.client.0.smithi050.stdout:2/208: dwrite d1/dd/f3a [0,4194304] 0 2023-01-04T18:16:58.007 INFO:tasks.workunit.client.0.smithi050.stdout:8/267: mknod d3/d2a/d30/d3b/d4d/c5b 0 2023-01-04T18:16:58.007 INFO:tasks.workunit.client.0.smithi050.stdout:8/268: chown d3/d2a/d2d/f50 123423161 1 2023-01-04T18:16:58.008 INFO:tasks.workunit.client.0.smithi050.stdout:9/258: write d1/d3/d3b/d23/f3d [1031826,130550] 0 2023-01-04T18:16:58.008 INFO:tasks.workunit.client.0.smithi050.stdout:9/259: chown d1/d12/f44 17913 1 2023-01-04T18:16:58.008 INFO:tasks.workunit.client.0.smithi050.stdout:9/260: rename d1/d3/d3b to d1/d3/d3b/d51 22 2023-01-04T18:16:58.013 INFO:tasks.workunit.client.0.smithi050.stdout:7/281: dwrite d6/db/d15/f36 [0,4194304] 0 2023-01-04T18:16:58.014 INFO:tasks.workunit.client.0.smithi050.stdout:5/386: mknod d13/d15/d17/d27/c88 0 2023-01-04T18:16:58.024 INFO:tasks.workunit.client.0.smithi050.stdout:4/224: truncate fe 666379 0 2023-01-04T18:16:58.168 INFO:tasks.workunit.client.0.smithi050.stdout:1/197: creat d8/d14/d1c/d28/f41 x:0 0 0 2023-01-04T18:16:58.168 INFO:tasks.workunit.client.0.smithi050.stdout:3/259: truncate d0/dd/f1e 549818 0 2023-01-04T18:16:58.171 INFO:tasks.workunit.client.0.smithi050.stdout:6/215: rmdir d0/d9/d25 39 2023-01-04T18:16:58.174 INFO:tasks.workunit.client.0.smithi050.stdout:2/209: creat d1/dd/d28/d2c/d2e/d36/f42 x:0 0 0 2023-01-04T18:16:58.174 INFO:tasks.workunit.client.0.smithi050.stdout:8/269: symlink d3/d2a/d30/d3b/d4d/d1b/d28/d2c/l5c 0 2023-01-04T18:16:58.177 INFO:tasks.workunit.client.0.smithi050.stdout:9/261: symlink d1/d12/d2d/d39/l52 0 2023-01-04T18:16:58.181 INFO:tasks.workunit.client.0.smithi050.stdout:7/282: creat d6/db/d15/d1b/d5b/f63 x:0 0 0 2023-01-04T18:16:58.183 INFO:tasks.workunit.client.0.smithi050.stdout:5/387: creat d13/d15/d17/d1f/d35/d59/d87/f89 x:0 0 0 2023-01-04T18:16:58.183 INFO:tasks.workunit.client.0.smithi050.stdout:5/388: dread - d13/d15/d17/d27/d46/d4e/d4d/f77 zero size 2023-01-04T18:16:58.183 INFO:tasks.workunit.client.0.smithi050.stdout:5/389: chown d13/d15/d17/d1f/d35/d42/f79 3814 1 2023-01-04T18:16:58.188 INFO:tasks.workunit.client.0.smithi050.stdout:3/260: creat d0/d1a/f58 x:0 0 0 2023-01-04T18:16:58.189 INFO:tasks.workunit.client.0.smithi050.stdout:2/210: link d1/dd/d28/d2c/d2e/f40 d1/dd/d28/f43 0 2023-01-04T18:16:58.190 INFO:tasks.workunit.client.0.smithi050.stdout:8/270: getdents d3/d2a 0 2023-01-04T18:16:58.190 INFO:tasks.workunit.client.0.smithi050.stdout:8/271: truncate d3/d5/f1d 1138288 0 2023-01-04T18:16:58.190 INFO:tasks.workunit.client.0.smithi050.stdout:6/216: mkdir d0/d9/d38/d49 0 2023-01-04T18:16:58.195 INFO:tasks.workunit.client.0.smithi050.stdout:2/211: dread d1/f3 [4194304,4194304] 0 2023-01-04T18:16:58.195 INFO:tasks.workunit.client.0.smithi050.stdout:2/212: dread - d1/dd/d28/d2c/f2d zero size 2023-01-04T18:16:58.205 INFO:tasks.workunit.client.0.smithi050.stdout:9/262: dwrite d1/d3/d13/f36 [0,4194304] 0 2023-01-04T18:16:58.209 INFO:tasks.workunit.client.0.smithi050.stdout:5/390: dwrite d13/d15/f73 [0,4194304] 0 2023-01-04T18:16:58.210 INFO:tasks.workunit.client.0.smithi050.stdout:5/391: read - d13/f3b zero size 2023-01-04T18:16:58.213 INFO:tasks.workunit.client.0.smithi050.stdout:0/221: sync 2023-01-04T18:16:58.214 INFO:tasks.workunit.client.0.smithi050.stdout:0/222: fdatasync d0/d6/f21 0 2023-01-04T18:16:58.221 INFO:tasks.workunit.client.0.smithi050.stdout:4/225: sync 2023-01-04T18:16:58.221 INFO:tasks.workunit.client.0.smithi050.stdout:4/226: readlink d14/l20 0 2023-01-04T18:16:58.221 INFO:tasks.workunit.client.0.smithi050.stdout:4/227: stat d14/d1b/d1f/f46 0 2023-01-04T18:16:58.221 INFO:tasks.workunit.client.0.smithi050.stdout:8/272: dwrite d3/d2a/d30/d3b/d4d/d1b/d28/f40 [0,4194304] 0 2023-01-04T18:16:58.222 INFO:tasks.workunit.client.0.smithi050.stdout:7/283: creat d6/db/d3b/d5c/f64 x:0 0 0 2023-01-04T18:16:58.223 INFO:tasks.workunit.client.0.smithi050.stdout:1/198: mknod d8/c42 0 2023-01-04T18:16:58.224 INFO:tasks.workunit.client.0.smithi050.stdout:8/273: write d3/d2a/d30/f3f [388406,114509] 0 2023-01-04T18:16:58.224 INFO:tasks.workunit.client.0.smithi050.stdout:8/274: rename d3 to d3/d2a/d2d/d5d 22 2023-01-04T18:16:58.225 INFO:tasks.workunit.client.0.smithi050.stdout:1/199: write d8/f11 [2554365,105503] 0 2023-01-04T18:16:58.225 INFO:tasks.workunit.client.0.smithi050.stdout:3/261: write d0/d1b/d2f/d31/f41 [255979,18700] 0 2023-01-04T18:16:58.225 INFO:tasks.workunit.client.0.smithi050.stdout:3/262: write d0/d1b/d2f/d56/d32/f48 [781155,94286] 0 2023-01-04T18:16:58.226 INFO:tasks.workunit.client.0.smithi050.stdout:2/213: mkdir d1/dd/d11/d14/d44 0 2023-01-04T18:16:58.232 INFO:tasks.workunit.client.0.smithi050.stdout:9/263: truncate d1/d3/d13/f15 541019 0 2023-01-04T18:16:58.235 INFO:tasks.workunit.client.0.smithi050.stdout:0/223: dwrite d0/d6/d8/f2a [0,4194304] 0 2023-01-04T18:16:58.235 INFO:tasks.workunit.client.0.smithi050.stdout:0/224: fsync d0/d6/d28/d1a/f40 0 2023-01-04T18:16:58.242 INFO:tasks.workunit.client.0.smithi050.stdout:5/392: mknod d13/d15/d17/d1f/d35/d59/d87/c8a 0 2023-01-04T18:16:58.242 INFO:tasks.workunit.client.0.smithi050.stdout:4/228: creat d14/d1b/d1f/d22/f4e x:0 0 0 2023-01-04T18:16:58.247 INFO:tasks.workunit.client.0.smithi050.stdout:7/284: dread d6/f23 [0,4194304] 0 2023-01-04T18:16:58.248 INFO:tasks.workunit.client.0.smithi050.stdout:8/275: creat d3/d2a/d30/d3b/d4d/d1b/d28/d2c/f5e x:0 0 0 2023-01-04T18:16:58.252 INFO:tasks.workunit.client.0.smithi050.stdout:1/200: creat d8/f43 x:0 0 0 2023-01-04T18:16:58.258 INFO:tasks.workunit.client.0.smithi050.stdout:2/214: creat d1/dd/d28/d2c/f45 x:0 0 0 2023-01-04T18:16:58.258 INFO:tasks.workunit.client.0.smithi050.stdout:2/215: stat d1/dd/d11/d1e 0 2023-01-04T18:16:58.263 INFO:tasks.workunit.client.0.smithi050.stdout:0/225: mknod d0/d6/d8/c41 0 2023-01-04T18:16:58.266 INFO:tasks.workunit.client.0.smithi050.stdout:5/393: mknod d13/d15/d17/d27/d46/c8b 0 2023-01-04T18:16:58.272 INFO:tasks.workunit.client.0.smithi050.stdout:4/229: symlink d14/d1b/d1f/d22/d3e/l4f 0 2023-01-04T18:16:58.272 INFO:tasks.workunit.client.0.smithi050.stdout:3/263: dwrite d0/d1b/d2f/d31/f50 [0,4194304] 0 2023-01-04T18:16:58.273 INFO:tasks.workunit.client.0.smithi050.stdout:7/285: rename d6/d28/l4a to d6/d28/d3c/d62/l65 0 2023-01-04T18:16:58.277 INFO:tasks.workunit.client.0.smithi050.stdout:8/276: mkdir d3/d2a/d30/d3b/d4d/d23/d55/d5f 0 2023-01-04T18:16:58.278 INFO:tasks.workunit.client.0.smithi050.stdout:1/201: creat d8/f44 x:0 0 0 2023-01-04T18:16:58.279 INFO:tasks.workunit.client.0.smithi050.stdout:4/230: write f11 [3771192,22059] 0 2023-01-04T18:16:58.280 INFO:tasks.workunit.client.0.smithi050.stdout:2/216: symlink d1/dd/d11/d14/l46 0 2023-01-04T18:16:58.280 INFO:tasks.workunit.client.0.smithi050.stdout:5/394: dwrite d13/d15/d17/d27/d44/f7b [0,4194304] 0 2023-01-04T18:16:58.281 INFO:tasks.workunit.client.0.smithi050.stdout:9/264: mknod d1/d3/d3b/d23/c53 0 2023-01-04T18:16:58.284 INFO:tasks.workunit.client.0.smithi050.stdout:3/264: unlink d0/d21/l54 0 2023-01-04T18:16:58.285 INFO:tasks.workunit.client.0.smithi050.stdout:0/226: rename d0/f2d to d0/d6/d8/d35/f42 0 2023-01-04T18:16:58.349 INFO:tasks.workunit.client.0.smithi050.stdout:7/286: mkdir d6/db/d15/d2e/d66 0 2023-01-04T18:16:58.350 INFO:tasks.workunit.client.0.smithi050.stdout:7/287: write d6/db/f40 [993185,104527] 0 2023-01-04T18:16:58.350 INFO:tasks.workunit.client.0.smithi050.stdout:1/202: mknod d8/d14/d1d/d3a/d23/c45 0 2023-01-04T18:16:58.351 INFO:tasks.workunit.client.0.smithi050.stdout:1/203: chown d8/d14/f35 51 1 2023-01-04T18:16:58.351 INFO:tasks.workunit.client.0.smithi050.stdout:1/204: fsync d8/fe 0 2023-01-04T18:16:58.351 INFO:tasks.workunit.client.0.smithi050.stdout:1/205: read f6 [1327551,114959] 0 2023-01-04T18:16:58.352 INFO:tasks.workunit.client.0.smithi050.stdout:7/288: dread d6/db/d15/d1b/d22/f54 [0,4194304] 0 2023-01-04T18:16:58.352 INFO:tasks.workunit.client.0.smithi050.stdout:7/289: chown f2 15900 1 2023-01-04T18:16:58.356 INFO:tasks.workunit.client.0.smithi050.stdout:4/231: rmdir d14 39 2023-01-04T18:16:58.362 INFO:tasks.workunit.client.0.smithi050.stdout:9/265: rename d1/d3/l38 to d1/d3/l54 0 2023-01-04T18:16:58.362 INFO:tasks.workunit.client.0.smithi050.stdout:9/266: write d1/d12/d41/f4a [1021023,63509] 0 2023-01-04T18:16:58.362 INFO:tasks.workunit.client.0.smithi050.stdout:9/267: stat d1/d12/d2d/l3e 0 2023-01-04T18:16:58.363 INFO:tasks.workunit.client.0.smithi050.stdout:3/265: rename d0/d1a/l2d to d0/d1a/l59 0 2023-01-04T18:16:58.419 INFO:tasks.workunit.client.0.smithi050.stdout:8/277: rename d3/d2a/d30/d3b/d4d/d1b/d28 to d3/d2a/d60 0 2023-01-04T18:16:58.420 INFO:tasks.workunit.client.0.smithi050.stdout:8/278: truncate d3/d2a/d30/d3b/d4d/d23/d55/f57 761335 0 2023-01-04T18:16:58.420 INFO:tasks.workunit.client.0.smithi050.stdout:0/227: mknod d0/d6/d8/d35/c43 0 2023-01-04T18:16:58.424 INFO:tasks.workunit.client.0.smithi050.stdout:1/206: unlink d8/d14/d1d/f21 0 2023-01-04T18:16:58.425 INFO:tasks.workunit.client.0.smithi050.stdout:1/207: chown d8/d14/d1d/d3a/c29 0 1 2023-01-04T18:16:58.430 INFO:tasks.workunit.client.0.smithi050.stdout:7/290: mkdir d6/d28/d32/d67 0 2023-01-04T18:16:58.442 INFO:tasks.workunit.client.0.smithi050.stdout:7/291: dread d6/db/f19 [0,4194304] 0 2023-01-04T18:16:58.442 INFO:tasks.workunit.client.0.smithi050.stdout:7/292: getdents d6/db/d15/d2e/d66 0 2023-01-04T18:16:58.460 INFO:tasks.workunit.client.0.smithi050.stdout:7/293: dwrite d6/db/d15/d1b/f21 [0,4194304] 0 2023-01-04T18:16:58.464 INFO:tasks.workunit.client.0.smithi050.stdout:7/294: dread d6/f13 [0,4194304] 0 2023-01-04T18:16:58.485 INFO:tasks.workunit.client.0.smithi050.stdout:4/232: creat d14/d1b/f50 x:0 0 0 2023-01-04T18:16:58.485 INFO:tasks.workunit.client.0.smithi050.stdout:4/233: chown d14/d1b/d1f/d22/f4d 980019629 1 2023-01-04T18:16:58.485 INFO:tasks.workunit.client.0.smithi050.stdout:4/234: chown f0 286724151 1 2023-01-04T18:16:58.485 INFO:tasks.workunit.client.0.smithi050.stdout:4/235: write fe [1518367,40082] 0 2023-01-04T18:16:58.493 INFO:tasks.workunit.client.0.smithi050.stdout:9/268: creat d1/d3/d24/f55 x:0 0 0 2023-01-04T18:16:58.494 INFO:tasks.workunit.client.0.smithi050.stdout:3/266: symlink d0/d21/d46/l5a 0 2023-01-04T18:16:58.497 INFO:tasks.workunit.client.0.smithi050.stdout:3/267: dread d0/d10/f3e [0,4194304] 0 2023-01-04T18:16:58.497 INFO:tasks.workunit.client.0.smithi050.stdout:3/268: write d0/d21/f25 [1998215,10394] 0 2023-01-04T18:16:58.497 INFO:tasks.workunit.client.0.smithi050.stdout:3/269: chown d0/d21/d46 36 1 2023-01-04T18:16:58.505 INFO:tasks.workunit.client.0.smithi050.stdout:2/217: rename d1/d10/c31 to d1/d41/c47 0 2023-01-04T18:16:58.505 INFO:tasks.workunit.client.0.smithi050.stdout:2/218: chown d1/f8 236043738 1 2023-01-04T18:16:58.508 INFO:tasks.workunit.client.0.smithi050.stdout:8/279: mknod d3/d2a/d60/c61 0 2023-01-04T18:16:58.511 INFO:tasks.workunit.client.0.smithi050.stdout:1/208: creat d8/d14/f46 x:0 0 0 2023-01-04T18:16:58.523 INFO:tasks.workunit.client.0.smithi050.stdout:7/295: mknod d6/db/d15/d2e/c68 0 2023-01-04T18:16:58.525 INFO:tasks.workunit.client.0.smithi050.stdout:1/209: dwrite d8/d14/d1d/f33 [0,4194304] 0 2023-01-04T18:16:58.528 INFO:tasks.workunit.client.0.smithi050.stdout:4/236: getdents d14/d1b/d1f 0 2023-01-04T18:16:58.528 INFO:tasks.workunit.client.0.smithi050.stdout:4/237: write d14/d1b/d32/f3f [698965,67087] 0 2023-01-04T18:16:58.531 INFO:tasks.workunit.client.0.smithi050.stdout:9/269: mknod d1/d3/d11/d1f/c56 0 2023-01-04T18:16:58.533 INFO:tasks.workunit.client.0.smithi050.stdout:3/270: mknod d0/d1b/d2f/c5b 0 2023-01-04T18:16:58.536 INFO:tasks.workunit.client.0.smithi050.stdout:8/280: mknod d3/d2a/d30/d3b/d4d/d23/d55/c62 0 2023-01-04T18:16:58.536 INFO:tasks.workunit.client.0.smithi050.stdout:0/228: mknod d0/c44 0 2023-01-04T18:16:58.537 INFO:tasks.workunit.client.0.smithi050.stdout:0/229: write d0/d6/d8/f13 [3989184,21428] 0 2023-01-04T18:16:58.537 INFO:tasks.workunit.client.0.smithi050.stdout:0/230: dread - d0/d6/d28/d1a/f40 zero size 2023-01-04T18:16:58.539 INFO:tasks.workunit.client.0.smithi050.stdout:6/217: sync 2023-01-04T18:16:58.540 INFO:tasks.workunit.client.0.smithi050.stdout:5/395: sync 2023-01-04T18:16:58.540 INFO:tasks.workunit.client.0.smithi050.stdout:6/218: chown d0/d9/d25/f3a 55186 1 2023-01-04T18:16:58.540 INFO:tasks.workunit.client.0.smithi050.stdout:6/219: readlink d0/d9/l3c 0 2023-01-04T18:16:58.540 INFO:tasks.workunit.client.0.smithi050.stdout:6/220: chown d0/d9/cb 341289041 1 2023-01-04T18:16:58.540 INFO:tasks.workunit.client.0.smithi050.stdout:5/396: write d13/d15/d17/d27/d46/d4e/f3c [958479,44448] 0 2023-01-04T18:16:58.540 INFO:tasks.workunit.client.0.smithi050.stdout:7/296: symlink d6/db/d15/d2e/d4b/d53/l69 0 2023-01-04T18:16:58.547 INFO:tasks.workunit.client.0.smithi050.stdout:9/270: rmdir d1/d3/d13 39 2023-01-04T18:16:58.547 INFO:tasks.workunit.client.0.smithi050.stdout:9/271: fdatasync d1/d3/d11/f43 0 2023-01-04T18:16:58.548 INFO:tasks.workunit.client.0.smithi050.stdout:3/271: creat d0/d21/f5c x:0 0 0 2023-01-04T18:16:58.549 INFO:tasks.workunit.client.0.smithi050.stdout:2/219: symlink d1/l48 0 2023-01-04T18:16:58.550 INFO:tasks.workunit.client.0.smithi050.stdout:8/281: rmdir d3/d2a/d30/d3b/d4d/d23 39 2023-01-04T18:16:58.552 INFO:tasks.workunit.client.0.smithi050.stdout:0/231: symlink d0/d6/d28/d1a/l45 0 2023-01-04T18:16:58.554 INFO:tasks.workunit.client.0.smithi050.stdout:4/238: dwrite d14/d1b/f50 [0,4194304] 0 2023-01-04T18:16:58.554 INFO:tasks.workunit.client.0.smithi050.stdout:4/239: readlink d14/l2c 0 2023-01-04T18:16:58.555 INFO:tasks.workunit.client.0.smithi050.stdout:3/272: dread d0/dd/f11 [0,4194304] 0 2023-01-04T18:16:58.556 INFO:tasks.workunit.client.0.smithi050.stdout:3/273: dread - d0/d1b/d2f/f44 zero size 2023-01-04T18:16:58.556 INFO:tasks.workunit.client.0.smithi050.stdout:3/274: fsync d0/d1a/f24 0 2023-01-04T18:16:58.556 INFO:tasks.workunit.client.0.smithi050.stdout:3/275: chown d0/dd/l38 563 1 2023-01-04T18:16:58.556 INFO:tasks.workunit.client.0.smithi050.stdout:1/210: dwrite d8/f12 [0,4194304] 0 2023-01-04T18:16:58.557 INFO:tasks.workunit.client.0.smithi050.stdout:5/397: truncate d13/d15/d17/d27/d44/f45 3631133 0 2023-01-04T18:16:58.558 INFO:tasks.workunit.client.0.smithi050.stdout:1/211: write d8/d14/d1d/d3a/d23/f3e [2199410,113922] 0 2023-01-04T18:16:58.561 INFO:tasks.workunit.client.0.smithi050.stdout:1/212: dread d8/f11 [0,4194304] 0 2023-01-04T18:16:58.562 INFO:tasks.workunit.client.0.smithi050.stdout:9/272: rename d1/d3/d11/d1f/c56 to d1/d3/c57 0 2023-01-04T18:16:58.563 INFO:tasks.workunit.client.0.smithi050.stdout:9/273: write d1/d12/f44 [587043,121247] 0 2023-01-04T18:16:58.563 INFO:tasks.workunit.client.0.smithi050.stdout:2/220: truncate d1/f3 2733585 0 2023-01-04T18:16:58.565 INFO:tasks.workunit.client.0.smithi050.stdout:8/282: creat d3/d2a/d30/d3b/d4d/d23/f63 x:0 0 0 2023-01-04T18:16:58.569 INFO:tasks.workunit.client.0.smithi050.stdout:4/240: creat d14/f51 x:0 0 0 2023-01-04T18:16:58.569 INFO:tasks.workunit.client.0.smithi050.stdout:4/241: readlink d14/d1b/d1f/l2d 0 2023-01-04T18:16:58.571 INFO:tasks.workunit.client.0.smithi050.stdout:3/276: creat d0/d1b/d2f/d56/d3f/f5d x:0 0 0 2023-01-04T18:16:58.571 INFO:tasks.workunit.client.0.smithi050.stdout:3/277: write d0/d1b/d2f/d56/d32/f49 [752512,130295] 0 2023-01-04T18:16:58.576 INFO:tasks.workunit.client.0.smithi050.stdout:1/213: truncate d8/fd 842931 0 2023-01-04T18:16:58.577 INFO:tasks.workunit.client.0.smithi050.stdout:5/398: rename d13/d15/d17/d1f/d35/d42/d4a/f68 to d13/d15/d63/f8c 0 2023-01-04T18:16:58.577 INFO:tasks.workunit.client.0.smithi050.stdout:5/399: readlink d13/d15/l1a 0 2023-01-04T18:16:58.582 INFO:tasks.workunit.client.0.smithi050.stdout:2/221: truncate d1/dd/d11/d1e/f22 1349038 0 2023-01-04T18:16:58.584 INFO:tasks.workunit.client.0.smithi050.stdout:8/283: mknod d3/d2a/d30/d3b/d4d/d23/d55/d5f/c64 0 2023-01-04T18:16:58.585 INFO:tasks.workunit.client.0.smithi050.stdout:1/214: unlink d8/c38 0 2023-01-04T18:16:58.587 INFO:tasks.workunit.client.0.smithi050.stdout:1/215: mknod d8/d14/c47 0 2023-01-04T18:16:58.612 INFO:tasks.workunit.client.0.smithi050.stdout:6/221: dwrite d0/d9/fa [4194304,4194304] 0 2023-01-04T18:16:58.612 INFO:tasks.workunit.client.0.smithi050.stdout:6/222: read - d0/d9/d25/f3a zero size 2023-01-04T18:16:58.612 INFO:tasks.workunit.client.0.smithi050.stdout:6/223: read d0/d9/d25/f27 [80701,82439] 0 2023-01-04T18:16:58.618 INFO:tasks.workunit.client.0.smithi050.stdout:6/224: rename d0/d9/d38/d49 to d0/d4a 0 2023-01-04T18:16:58.625 INFO:tasks.workunit.client.0.smithi050.stdout:6/225: creat d0/d9/f4b x:0 0 0 2023-01-04T18:16:58.627 INFO:tasks.workunit.client.0.smithi050.stdout:8/284: dwrite d3/d2a/d30/d3b/d4d/d23/d55/f5a [0,4194304] 0 2023-01-04T18:16:58.628 INFO:tasks.workunit.client.0.smithi050.stdout:7/297: dwrite d6/db/d15/f36 [4194304,4194304] 0 2023-01-04T18:16:58.628 INFO:tasks.workunit.client.0.smithi050.stdout:7/298: chown d6/db/d15/d48 104264016 1 2023-01-04T18:16:58.628 INFO:tasks.workunit.client.0.smithi050.stdout:2/222: dwrite d1/f15 [0,4194304] 0 2023-01-04T18:16:58.628 INFO:tasks.workunit.client.0.smithi050.stdout:7/299: write d6/db/d15/d2e/f2f [286977,34723] 0 2023-01-04T18:16:58.629 INFO:tasks.workunit.client.0.smithi050.stdout:9/274: rmdir d1/d3/d11/d1f 39 2023-01-04T18:16:58.636 INFO:tasks.workunit.client.0.smithi050.stdout:3/278: dwrite d0/d10/f16 [0,4194304] 0 2023-01-04T18:16:58.637 INFO:tasks.workunit.client.0.smithi050.stdout:4/242: dwrite d14/d1b/d1f/d22/f4e [0,4194304] 0 2023-01-04T18:16:58.637 INFO:tasks.workunit.client.0.smithi050.stdout:4/243: chown d14/d1b/d1f/d22/f34 775047 1 2023-01-04T18:16:58.647 INFO:tasks.workunit.client.0.smithi050.stdout:2/223: symlink d1/dd/d28/d2c/d2e/l49 0 2023-01-04T18:16:58.648 INFO:tasks.workunit.client.0.smithi050.stdout:9/275: getdents d1/d12/d2d/d39 0 2023-01-04T18:16:58.651 INFO:tasks.workunit.client.0.smithi050.stdout:8/285: dread d3/d2a/d30/f3f [0,4194304] 0 2023-01-04T18:16:58.654 INFO:tasks.workunit.client.0.smithi050.stdout:9/276: read d1/d3/f19 [3304195,74283] 0 2023-01-04T18:16:58.658 INFO:tasks.workunit.client.0.smithi050.stdout:6/226: dwrite d0/f2f [4194304,4194304] 0 2023-01-04T18:16:58.667 INFO:tasks.workunit.client.0.smithi050.stdout:5/400: dwrite d13/d15/d17/f1b [0,4194304] 0 2023-01-04T18:16:58.667 INFO:tasks.workunit.client.0.smithi050.stdout:5/401: read d13/d15/d17/d1f/f80 [8802,54437] 0 2023-01-04T18:16:58.668 INFO:tasks.workunit.client.0.smithi050.stdout:7/300: dwrite d6/db/f60 [0,4194304] 0 2023-01-04T18:16:58.668 INFO:tasks.workunit.client.0.smithi050.stdout:7/301: fdatasync d6/db/d3b/f4c 0 2023-01-04T18:16:58.668 INFO:tasks.workunit.client.0.smithi050.stdout:3/279: dwrite d0/d1a/f57 [0,4194304] 0 2023-01-04T18:16:58.670 INFO:tasks.workunit.client.0.smithi050.stdout:1/216: dwrite d8/d14/d1d/d3a/d23/f26 [0,4194304] 0 2023-01-04T18:16:58.675 INFO:tasks.workunit.client.0.smithi050.stdout:1/217: dread d8/f13 [0,4194304] 0 2023-01-04T18:16:58.750 INFO:tasks.workunit.client.0.smithi050.stdout:4/244: creat d14/d1b/f52 x:0 0 0 2023-01-04T18:16:58.813 INFO:tasks.workunit.client.0.smithi050.stdout:2/224: link d1/dd/d28/d2c/d2e/d36/f42 d1/dd/f4a 0 2023-01-04T18:16:58.813 INFO:tasks.workunit.client.0.smithi050.stdout:2/225: fdatasync d1/f3 0 2023-01-04T18:16:58.814 INFO:tasks.workunit.client.0.smithi050.stdout:2/226: write d1/dd/d28/d2c/d2e/f40 [251729,98815] 0 2023-01-04T18:16:58.815 INFO:tasks.workunit.client.0.smithi050.stdout:8/286: link d3/d2a/d30/d3b/d53/c59 d3/c65 0 2023-01-04T18:16:58.821 INFO:tasks.workunit.client.0.smithi050.stdout:9/277: creat d1/d3/d13/f58 x:0 0 0 2023-01-04T18:16:58.821 INFO:tasks.workunit.client.0.smithi050.stdout:9/278: fsync d1/d3/f18 0 2023-01-04T18:16:58.827 INFO:tasks.workunit.client.0.smithi050.stdout:6/227: symlink d0/d9/l4c 0 2023-01-04T18:16:58.832 INFO:tasks.workunit.client.0.smithi050.stdout:5/402: unlink d13/d15/d17/d1f/f6d 0 2023-01-04T18:16:58.839 INFO:tasks.workunit.client.0.smithi050.stdout:9/279: dwrite d1/d3/d11/d1f/f4e [0,4194304] 0 2023-01-04T18:16:58.839 INFO:tasks.workunit.client.0.smithi050.stdout:9/280: chown d1/c20 0 1 2023-01-04T18:16:58.839 INFO:tasks.workunit.client.0.smithi050.stdout:7/302: mkdir d6/d28/d3c/d42/d5f/d6a 0 2023-01-04T18:16:58.846 INFO:tasks.workunit.client.0.smithi050.stdout:3/280: link d0/d1b/d2f/d56/d32/f49 d0/f5e 0 2023-01-04T18:16:58.852 INFO:tasks.workunit.client.0.smithi050.stdout:1/218: rmdir d8/d14/d1d/d3a 39 2023-01-04T18:16:58.861 INFO:tasks.workunit.client.0.smithi050.stdout:2/227: mkdir d1/dd/d11/d1e/d4b 0 2023-01-04T18:16:58.863 INFO:tasks.workunit.client.0.smithi050.stdout:8/287: unlink d3/d2a/d30/d3b/d4d/l32 0 2023-01-04T18:16:58.863 INFO:tasks.workunit.client.0.smithi050.stdout:8/288: chown d3/d2a/d30/d3b/d4d/d23/d31 104048 1 2023-01-04T18:16:58.869 INFO:tasks.workunit.client.0.smithi050.stdout:5/403: creat d13/d28/d7c/f8d x:0 0 0 2023-01-04T18:16:58.869 INFO:tasks.workunit.client.0.smithi050.stdout:6/228: fdatasync d0/d9/d38/d1c/f26 0 2023-01-04T18:16:58.874 INFO:tasks.workunit.client.0.smithi050.stdout:9/281: link d1/d3/lf d1/d3/d3b/l59 0 2023-01-04T18:16:58.878 INFO:tasks.workunit.client.0.smithi050.stdout:1/219: dwrite d8/fd [4194304,4194304] 0 2023-01-04T18:16:58.879 INFO:tasks.workunit.client.0.smithi050.stdout:7/303: rename d6/db/d15/d2e/d4b/d53 to d6/d6b 0 2023-01-04T18:16:58.879 INFO:tasks.workunit.client.0.smithi050.stdout:2/228: dwrite d1/dd/d11/d14/f23 [0,4194304] 0 2023-01-04T18:16:58.879 INFO:tasks.workunit.client.0.smithi050.stdout:2/229: readlink d1/d19/l1f 0 2023-01-04T18:16:58.885 INFO:tasks.workunit.client.0.smithi050.stdout:8/289: creat d3/d2a/d2d/f66 x:0 0 0 2023-01-04T18:16:58.885 INFO:tasks.workunit.client.0.smithi050.stdout:8/290: write d3/d2a/d30/d3b/d53/f54 [674434,112368] 0 2023-01-04T18:16:58.885 INFO:tasks.workunit.client.0.smithi050.stdout:7/304: dread d6/f1c [0,4194304] 0 2023-01-04T18:16:58.885 INFO:tasks.workunit.client.0.smithi050.stdout:7/305: chown d6/db/d15/lf 30893019 1 2023-01-04T18:16:58.886 INFO:tasks.workunit.client.0.smithi050.stdout:5/404: getdents d13/d15/d17 0 2023-01-04T18:16:58.886 INFO:tasks.workunit.client.0.smithi050.stdout:5/405: fdatasync d13/d15/d17/d1f/d35/d42/d4a/f5a 0 2023-01-04T18:16:58.886 INFO:tasks.workunit.client.0.smithi050.stdout:5/406: write d13/d15/d17/d27/d46/d4e/f37 [330882,27064] 0 2023-01-04T18:16:58.886 INFO:tasks.workunit.client.0.smithi050.stdout:5/407: chown d13/d15/d17/d1f 20 1 2023-01-04T18:16:58.888 INFO:tasks.workunit.client.0.smithi050.stdout:6/229: mkdir d0/d9/d25/d4d 0 2023-01-04T18:16:58.897 INFO:tasks.workunit.client.0.smithi050.stdout:9/282: rename d1/la to d1/d12/l5a 0 2023-01-04T18:16:58.897 INFO:tasks.workunit.client.0.smithi050.stdout:7/306: dread d6/db/d15/d1b/f46 [0,4194304] 0 2023-01-04T18:16:58.900 INFO:tasks.workunit.client.0.smithi050.stdout:2/230: unlink d1/dd/d28/d2c/d2e/d36/l3e 0 2023-01-04T18:16:58.903 INFO:tasks.workunit.client.0.smithi050.stdout:3/281: symlink d0/d1b/d2f/d31/l5f 0 2023-01-04T18:16:58.904 INFO:tasks.workunit.client.0.smithi050.stdout:8/291: truncate d3/d2a/d30/f3f 2893138 0 2023-01-04T18:16:58.904 INFO:tasks.workunit.client.0.smithi050.stdout:5/408: dwrite d13/d15/d17/f1b [4194304,4194304] 0 2023-01-04T18:16:58.905 INFO:tasks.workunit.client.0.smithi050.stdout:5/409: read d13/d15/d17/d27/d44/f45 [2069409,126883] 0 2023-01-04T18:16:58.907 INFO:tasks.workunit.client.0.smithi050.stdout:6/230: unlink d0/d9/df/c19 0 2023-01-04T18:16:58.908 INFO:tasks.workunit.client.0.smithi050.stdout:1/220: mkdir d8/d48 0 2023-01-04T18:16:58.908 INFO:tasks.workunit.client.0.smithi050.stdout:8/292: dread d3/d2a/d27/f33 [0,4194304] 0 2023-01-04T18:16:58.909 INFO:tasks.workunit.client.0.smithi050.stdout:8/293: chown d3/d5/f1d 105423 1 2023-01-04T18:16:58.910 INFO:tasks.workunit.client.0.smithi050.stdout:2/231: dread d1/dd/d11/d14/f30 [0,4194304] 0 2023-01-04T18:16:58.911 INFO:tasks.workunit.client.0.smithi050.stdout:9/283: creat d1/d3/d11/d1f/f5b x:0 0 0 2023-01-04T18:16:58.911 INFO:tasks.workunit.client.0.smithi050.stdout:2/232: read d1/f15 [559689,119284] 0 2023-01-04T18:16:58.912 INFO:tasks.workunit.client.0.smithi050.stdout:7/307: symlink d6/db/d15/d48/l6c 0 2023-01-04T18:16:58.922 INFO:tasks.workunit.client.0.smithi050.stdout:5/410: mkdir d13/d15/d17/d1f/d35/d42/d4a/d8e 0 2023-01-04T18:16:58.928 INFO:tasks.workunit.client.0.smithi050.stdout:6/231: symlink d0/d9/df/l4e 0 2023-01-04T18:16:58.931 INFO:tasks.workunit.client.0.smithi050.stdout:9/284: creat d1/d3/f5c x:0 0 0 2023-01-04T18:16:58.931 INFO:tasks.workunit.client.0.smithi050.stdout:0/232: sync 2023-01-04T18:16:58.931 INFO:tasks.workunit.client.0.smithi050.stdout:4/245: sync 2023-01-04T18:16:58.931 INFO:tasks.workunit.client.0.smithi050.stdout:4/246: fdatasync fd 0 2023-01-04T18:16:58.932 INFO:tasks.workunit.client.0.smithi050.stdout:9/285: write d1/d3/d11/d1f/f21 [847042,41668] 0 2023-01-04T18:16:58.934 INFO:tasks.workunit.client.0.smithi050.stdout:2/233: symlink d1/dd/d28/l4c 0 2023-01-04T18:16:58.938 INFO:tasks.workunit.client.0.smithi050.stdout:7/308: symlink d6/db/d20/l6d 0 2023-01-04T18:16:58.938 INFO:tasks.workunit.client.0.smithi050.stdout:7/309: fsync d6/db/d3b/f4c 0 2023-01-04T18:16:58.938 INFO:tasks.workunit.client.0.smithi050.stdout:7/310: truncate d6/db/d15/d1b/d5b/f63 274292 0 2023-01-04T18:16:58.939 INFO:tasks.workunit.client.0.smithi050.stdout:7/311: dread - d6/d28/d3c/d42/f56 zero size 2023-01-04T18:16:58.940 INFO:tasks.workunit.client.0.smithi050.stdout:3/282: rename d0/d21 to d0/d1b/d2f/d31/d60 0 2023-01-04T18:16:58.941 INFO:tasks.workunit.client.0.smithi050.stdout:3/283: truncate d0/d1b/d2f/d56/d32/f48 1038112 0 2023-01-04T18:16:58.941 INFO:tasks.workunit.client.0.smithi050.stdout:3/284: fsync d0/d10/f42 0 2023-01-04T18:16:58.942 INFO:tasks.workunit.client.0.smithi050.stdout:5/411: mkdir d13/d15/d17/d8f 0 2023-01-04T18:16:58.943 INFO:tasks.workunit.client.0.smithi050.stdout:6/232: symlink d0/d4a/l4f 0 2023-01-04T18:16:58.947 INFO:tasks.workunit.client.0.smithi050.stdout:2/234: creat d1/dd/d11/d12/f4d x:0 0 0 2023-01-04T18:16:58.947 INFO:tasks.workunit.client.0.smithi050.stdout:2/235: stat d1/dd/d28/d2c/f2d 0 2023-01-04T18:16:58.947 INFO:tasks.workunit.client.0.smithi050.stdout:2/236: dread - d1/dd/d28/d2c/f45 zero size 2023-01-04T18:16:58.948 INFO:tasks.workunit.client.0.smithi050.stdout:7/312: mkdir d6/db/d20/d4f/d6e 0 2023-01-04T18:16:58.951 INFO:tasks.workunit.client.0.smithi050.stdout:1/221: rename d8/d14/d1d/d3a/f36 to d8/d14/d1d/f49 0 2023-01-04T18:16:58.953 INFO:tasks.workunit.client.0.smithi050.stdout:5/412: creat d13/d15/d17/d27/d46/d4e/d4d/f90 x:0 0 0 2023-01-04T18:16:58.956 INFO:tasks.workunit.client.0.smithi050.stdout:3/285: dread d0/d1a/f57 [0,4194304] 0 2023-01-04T18:16:58.959 INFO:tasks.workunit.client.0.smithi050.stdout:6/233: symlink d0/d4a/l50 0 2023-01-04T18:16:58.959 INFO:tasks.workunit.client.0.smithi050.stdout:6/234: dread - d0/d9/d25/f39 zero size 2023-01-04T18:16:58.960 INFO:tasks.workunit.client.0.smithi050.stdout:6/235: dread - d0/d9/d25/d2d/f44 zero size 2023-01-04T18:16:58.961 INFO:tasks.workunit.client.0.smithi050.stdout:2/237: creat d1/d10/f4e x:0 0 0 2023-01-04T18:16:58.961 INFO:tasks.workunit.client.0.smithi050.stdout:2/238: write d1/dd/d11/f26 [4302498,57523] 0 2023-01-04T18:16:58.961 INFO:tasks.workunit.client.0.smithi050.stdout:0/233: dwrite d0/d6/d8/d35/f37 [0,4194304] 0 2023-01-04T18:16:58.962 INFO:tasks.workunit.client.0.smithi050.stdout:9/286: dwrite d1/d12/f22 [0,4194304] 0 2023-01-04T18:16:58.964 INFO:tasks.workunit.client.0.smithi050.stdout:9/287: dread d1/d3/d13/f15 [0,4194304] 0 2023-01-04T18:16:58.967 INFO:tasks.workunit.client.0.smithi050.stdout:7/313: creat d6/d28/d3c/d42/d5f/f6f x:0 0 0 2023-01-04T18:16:58.968 INFO:tasks.workunit.client.0.smithi050.stdout:6/236: dread d0/d9/d25/f27 [0,4194304] 0 2023-01-04T18:16:58.968 INFO:tasks.workunit.client.0.smithi050.stdout:4/247: dwrite f13 [0,4194304] 0 2023-01-04T18:16:58.968 INFO:tasks.workunit.client.0.smithi050.stdout:4/248: dread - d14/f51 zero size 2023-01-04T18:16:58.969 INFO:tasks.workunit.client.0.smithi050.stdout:6/237: truncate d0/f2f 8931179 0 2023-01-04T18:16:58.969 INFO:tasks.workunit.client.0.smithi050.stdout:8/294: rename d3/c6 to d3/d2a/d27/c67 0 2023-01-04T18:16:58.970 INFO:tasks.workunit.client.0.smithi050.stdout:5/413: rmdir d13/d15/d17/d27/d46/d4e 39 2023-01-04T18:16:58.970 INFO:tasks.workunit.client.0.smithi050.stdout:1/222: dwrite d8/d14/d1c/d28/f2b [0,4194304] 0 2023-01-04T18:16:58.970 INFO:tasks.workunit.client.0.smithi050.stdout:1/223: write d8/d14/f46 [27701,38207] 0 2023-01-04T18:16:58.970 INFO:tasks.workunit.client.0.smithi050.stdout:1/224: read - d8/f44 zero size 2023-01-04T18:16:58.970 INFO:tasks.workunit.client.0.smithi050.stdout:5/414: write d13/d15/d17/d1f/d35/f65 [1472330,108358] 0 2023-01-04T18:16:58.971 INFO:tasks.workunit.client.0.smithi050.stdout:5/415: write d13/d15/f26 [780619,91217] 0 2023-01-04T18:16:58.973 INFO:tasks.workunit.client.0.smithi050.stdout:3/286: symlink d0/d1b/d2f/d31/d60/l61 0 2023-01-04T18:16:58.977 INFO:tasks.workunit.client.0.smithi050.stdout:8/295: dread d3/d2a/d30/f3f [0,4194304] 0 2023-01-04T18:16:58.977 INFO:tasks.workunit.client.0.smithi050.stdout:2/239: creat d1/dd/d28/d2c/f4f x:0 0 0 2023-01-04T18:16:58.979 INFO:tasks.workunit.client.0.smithi050.stdout:0/234: getdents d0/d6/d28 0 2023-01-04T18:16:58.979 INFO:tasks.workunit.client.0.smithi050.stdout:0/235: stat d0 0 2023-01-04T18:16:58.979 INFO:tasks.workunit.client.0.smithi050.stdout:0/236: fsync d0/d6/d28/d1a/f40 0 2023-01-04T18:16:58.980 INFO:tasks.workunit.client.0.smithi050.stdout:9/288: creat d1/d3/d11/f5d x:0 0 0 2023-01-04T18:16:58.982 INFO:tasks.workunit.client.0.smithi050.stdout:7/314: rmdir d6/db/d15/d1b 39 2023-01-04T18:16:58.989 INFO:tasks.workunit.client.0.smithi050.stdout:5/416: dread d13/f19 [0,4194304] 0 2023-01-04T18:16:58.989 INFO:tasks.workunit.client.0.smithi050.stdout:0/237: dread d0/f3b [0,4194304] 0 2023-01-04T18:16:58.989 INFO:tasks.workunit.client.0.smithi050.stdout:5/417: write d13/d15/d17/d1f/d35/d59/f6a [288055,94633] 0 2023-01-04T18:16:58.989 INFO:tasks.workunit.client.0.smithi050.stdout:5/418: chown l9 330 1 2023-01-04T18:16:58.990 INFO:tasks.workunit.client.0.smithi050.stdout:6/238: symlink d0/d9/d25/d4d/l51 0 2023-01-04T18:16:58.990 INFO:tasks.workunit.client.0.smithi050.stdout:6/239: truncate d0/d9/d38/d1c/f26 756157 0 2023-01-04T18:16:58.992 INFO:tasks.workunit.client.0.smithi050.stdout:2/240: creat d1/dd/d11/d14/f50 x:0 0 0 2023-01-04T18:16:58.992 INFO:tasks.workunit.client.0.smithi050.stdout:2/241: dread - d1/d10/f4e zero size 2023-01-04T18:16:58.995 INFO:tasks.workunit.client.0.smithi050.stdout:9/289: mknod d1/d3/d11/d1f/c5e 0 2023-01-04T18:16:58.995 INFO:tasks.workunit.client.0.smithi050.stdout:9/290: readlink d1/d3/l54 0 2023-01-04T18:16:58.995 INFO:tasks.workunit.client.0.smithi050.stdout:1/225: rename d8/d14/d1d/d3a/d23/c32 to d8/d14/d1c/d28/c4a 0 2023-01-04T18:16:58.997 INFO:tasks.workunit.client.0.smithi050.stdout:5/419: write d13/d15/d17/d1f/d35/f65 [120868,60518] 0 2023-01-04T18:16:58.997 INFO:tasks.workunit.client.0.smithi050.stdout:4/249: dwrite d14/d1b/d1f/f4a [0,4194304] 0 2023-01-04T18:16:58.997 INFO:tasks.workunit.client.0.smithi050.stdout:4/250: readlink d14/d1b/d32/l3b 0 2023-01-04T18:16:59.001 INFO:tasks.workunit.client.0.smithi050.stdout:0/238: rename d0/d6/d8/c41 to d0/d6/d8/c46 0 2023-01-04T18:16:59.001 INFO:tasks.workunit.client.0.smithi050.stdout:3/287: dwrite d0/d1b/d2f/d31/f41 [0,4194304] 0 2023-01-04T18:16:59.003 INFO:tasks.workunit.client.0.smithi050.stdout:2/242: getdents d1/dd 0 2023-01-04T18:16:59.004 INFO:tasks.workunit.client.0.smithi050.stdout:6/240: creat d0/d9/df/f52 x:0 0 0 2023-01-04T18:16:59.009 INFO:tasks.workunit.client.0.smithi050.stdout:9/291: unlink d1/d3/d11/d1f/l45 0 2023-01-04T18:16:59.009 INFO:tasks.workunit.client.0.smithi050.stdout:5/420: truncate d13/d15/d17/d1f/d35/f3f 1946266 0 2023-01-04T18:16:59.009 INFO:tasks.workunit.client.0.smithi050.stdout:5/421: chown l9 0 1 2023-01-04T18:16:59.010 INFO:tasks.workunit.client.0.smithi050.stdout:5/422: truncate d13/d15/d17/d27/d46/d4e/f37 1106870 0 2023-01-04T18:16:59.012 INFO:tasks.workunit.client.0.smithi050.stdout:7/315: dwrite d6/f27 [0,4194304] 0 2023-01-04T18:16:59.013 INFO:tasks.workunit.client.0.smithi050.stdout:7/316: write d6/db/d15/d2e/f2f [198966,109875] 0 2023-01-04T18:16:59.015 INFO:tasks.workunit.client.0.smithi050.stdout:1/226: dwrite d8/d14/d1d/f33 [0,4194304] 0 2023-01-04T18:16:59.018 INFO:tasks.workunit.client.0.smithi050.stdout:0/239: dwrite d0/d6/d28/d1a/f23 [0,4194304] 0 2023-01-04T18:16:59.024 INFO:tasks.workunit.client.0.smithi050.stdout:8/296: getdents d3 0 2023-01-04T18:16:59.024 INFO:tasks.workunit.client.0.smithi050.stdout:8/297: dread - d3/d2a/d2d/f50 zero size 2023-01-04T18:16:59.027 INFO:tasks.workunit.client.0.smithi050.stdout:5/423: dread d13/d15/d17/d27/f2b [0,4194304] 0 2023-01-04T18:16:59.027 INFO:tasks.workunit.client.0.smithi050.stdout:1/227: dread d8/d14/d1d/f1e [0,4194304] 0 2023-01-04T18:16:59.027 INFO:tasks.workunit.client.0.smithi050.stdout:1/228: chown d8/d48 4605358 1 2023-01-04T18:16:59.029 INFO:tasks.workunit.client.0.smithi050.stdout:9/292: dwrite d1/d12/f22 [4194304,4194304] 0 2023-01-04T18:16:59.030 INFO:tasks.workunit.client.0.smithi050.stdout:9/293: dread d1/d3/f1b [0,4194304] 0 2023-01-04T18:16:59.031 INFO:tasks.workunit.client.0.smithi050.stdout:9/294: write d1/d12/f22 [6458350,128760] 0 2023-01-04T18:16:59.033 INFO:tasks.workunit.client.0.smithi050.stdout:9/295: write d1/d3/d11/f16 [2950634,130333] 0 2023-01-04T18:16:59.097 INFO:tasks.workunit.client.0.smithi050.stdout:4/251: rmdir d14/d1b/d1f/d22/d3e 39 2023-01-04T18:16:59.097 INFO:tasks.workunit.client.0.smithi050.stdout:4/252: getdents d14/d1b/d1f 0 2023-01-04T18:16:59.105 INFO:tasks.workunit.client.0.smithi050.stdout:3/288: creat d0/d1b/d2f/d31/f62 x:0 0 0 2023-01-04T18:16:59.110 INFO:tasks.workunit.client.0.smithi050.stdout:2/243: creat d1/dd/d28/d2c/d2e/d36/f51 x:0 0 0 2023-01-04T18:16:59.112 INFO:tasks.workunit.client.0.smithi050.stdout:4/253: dwrite d14/f1c [0,4194304] 0 2023-01-04T18:16:59.119 INFO:tasks.workunit.client.0.smithi050.stdout:6/241: symlink d0/d9/d25/d2d/l53 0 2023-01-04T18:16:59.121 INFO:tasks.workunit.client.0.smithi050.stdout:7/317: rename d6/d28/d32/d67 to d6/db/d15/d1b/d70 0 2023-01-04T18:16:59.125 INFO:tasks.workunit.client.0.smithi050.stdout:2/244: dwrite d1/dd/d11/d14/f50 [0,4194304] 0 2023-01-04T18:16:59.125 INFO:tasks.workunit.client.0.smithi050.stdout:2/245: stat d1/dd/d11/d12/c35 0 2023-01-04T18:16:59.125 INFO:tasks.workunit.client.0.smithi050.stdout:2/246: write d1/dd/d11/f26 [4793561,13517] 0 2023-01-04T18:16:59.125 INFO:tasks.workunit.client.0.smithi050.stdout:2/247: readlink d1/d10/l16 0 2023-01-04T18:16:59.127 INFO:tasks.workunit.client.0.smithi050.stdout:8/298: creat d3/f68 x:0 0 0 2023-01-04T18:16:59.130 INFO:tasks.workunit.client.0.smithi050.stdout:1/229: symlink d8/d14/d1d/d3a/l4b 0 2023-01-04T18:16:59.155 INFO:tasks.workunit.client.0.smithi050.stdout:9/296: link d1/d3/d13/f15 d1/d12/f5f 0 2023-01-04T18:16:59.173 INFO:tasks.workunit.client.0.smithi050.stdout:9/297: dwrite d1/d12/f5f [0,4194304] 0 2023-01-04T18:16:59.173 INFO:tasks.workunit.client.0.smithi050.stdout:9/298: dread - d1/d3/f5c zero size 2023-01-04T18:16:59.173 INFO:tasks.workunit.client.0.smithi050.stdout:9/299: write d1/d3/d3b/f27 [4439846,23357] 0 2023-01-04T18:16:59.198 INFO:tasks.workunit.client.0.smithi050.stdout:4/254: symlink d14/d1b/d32/l53 0 2023-01-04T18:16:59.211 INFO:tasks.workunit.client.0.smithi050.stdout:7/318: getdents d6/db 0 2023-01-04T18:16:59.214 INFO:tasks.workunit.client.0.smithi050.stdout:5/424: rename d13/d15/d17/d27/d44/d47/c74 to d13/d15/d17/d1f/d35/d59/c91 0 2023-01-04T18:16:59.214 INFO:tasks.workunit.client.0.smithi050.stdout:1/230: rename d8/d14/d1c to d8/d14/d1c/d4c 22 2023-01-04T18:16:59.215 INFO:tasks.workunit.client.0.smithi050.stdout:1/231: chown d8/d14/d1d/d3a/d23/c37 8 1 2023-01-04T18:16:59.215 INFO:tasks.workunit.client.0.smithi050.stdout:7/319: rename d6 to d6/db/d15/d1b/d71 22 2023-01-04T18:16:59.221 INFO:tasks.workunit.client.0.smithi050.stdout:5/425: write d13/d15/d17/d27/d44/f7b [235633,89462] 0 2023-01-04T18:16:59.223 INFO:tasks.workunit.client.0.smithi050.stdout:2/248: mkdir d1/dd/d11/d14/d44/d52 0 2023-01-04T18:16:59.223 INFO:tasks.workunit.client.0.smithi050.stdout:2/249: truncate d1/dd/d28/d2c/d2e/d36/f51 894695 0 2023-01-04T18:16:59.224 INFO:tasks.workunit.client.0.smithi050.stdout:8/299: symlink d3/d2a/d60/l69 0 2023-01-04T18:16:59.224 INFO:tasks.workunit.client.0.smithi050.stdout:9/300: mkdir d1/d12/d41/d60 0 2023-01-04T18:16:59.231 INFO:tasks.workunit.client.0.smithi050.stdout:4/255: rmdir d14/d1b/d1f 39 2023-01-04T18:16:59.232 INFO:tasks.workunit.client.0.smithi050.stdout:6/242: mkdir d0/d9/d38/d1c/d54 0 2023-01-04T18:16:59.232 INFO:tasks.workunit.client.0.smithi050.stdout:6/243: write d0/d9/d25/f3a [722076,102443] 0 2023-01-04T18:16:59.232 INFO:tasks.workunit.client.0.smithi050.stdout:6/244: fsync d0/d9/f17 0 2023-01-04T18:16:59.232 INFO:tasks.workunit.client.0.smithi050.stdout:6/245: write d0/d9/d25/f39 [906922,129570] 0 2023-01-04T18:16:59.232 INFO:tasks.workunit.client.0.smithi050.stdout:6/246: write d0/d9/d25/f27 [466928,63482] 0 2023-01-04T18:16:59.236 INFO:tasks.workunit.client.0.smithi050.stdout:5/426: link d13/l7f d13/d15/d17/d27/d46/d4e/d4d/l92 0 2023-01-04T18:16:59.236 INFO:tasks.workunit.client.0.smithi050.stdout:2/250: link d1/dd/d28/l4c d1/dd/l53 0 2023-01-04T18:16:59.239 INFO:tasks.workunit.client.0.smithi050.stdout:4/256: getdents d14/d1b 0 2023-01-04T18:16:59.242 INFO:tasks.workunit.client.0.smithi050.stdout:6/247: mknod d0/d9/d25/d2d/c55 0 2023-01-04T18:16:59.244 INFO:tasks.workunit.client.0.smithi050.stdout:1/232: dwrite f6 [0,4194304] 0 2023-01-04T18:16:59.244 INFO:tasks.workunit.client.0.smithi050.stdout:7/320: rename d6/d1d/d2b to d6/d28/d72 0 2023-01-04T18:16:59.245 INFO:tasks.workunit.client.0.smithi050.stdout:1/233: chown d8/c27 5413 1 2023-01-04T18:16:59.245 INFO:tasks.workunit.client.0.smithi050.stdout:1/234: chown d8/d14/d1d/d3a/d23/c37 1087 1 2023-01-04T18:16:59.246 INFO:tasks.workunit.client.0.smithi050.stdout:6/248: read d0/d9/f17 [775387,13521] 0 2023-01-04T18:16:59.246 INFO:tasks.workunit.client.0.smithi050.stdout:4/257: rename d14/d1b/d1f/d22/f49 to d14/d1b/d1f/d22/f54 0 2023-01-04T18:16:59.247 INFO:tasks.workunit.client.0.smithi050.stdout:7/321: creat d6/d1d/f73 x:0 0 0 2023-01-04T18:16:59.249 INFO:tasks.workunit.client.0.smithi050.stdout:4/258: read d14/f24 [3825974,77147] 0 2023-01-04T18:16:59.249 INFO:tasks.workunit.client.0.smithi050.stdout:9/301: dwrite d1/d3/d3b/d23/f3d [0,4194304] 0 2023-01-04T18:16:59.249 INFO:tasks.workunit.client.0.smithi050.stdout:9/302: write d1/d3/d24/f55 [202599,104026] 0 2023-01-04T18:16:59.250 INFO:tasks.workunit.client.0.smithi050.stdout:9/303: stat d1/d3/d3b/d23/c53 0 2023-01-04T18:16:59.250 INFO:tasks.workunit.client.0.smithi050.stdout:7/322: unlink d6/db/d15/d1b/d22/f25 0 2023-01-04T18:16:59.251 INFO:tasks.workunit.client.0.smithi050.stdout:1/235: rename d8/d14/d1d/d3a/d23/f26 to d8/f4d 0 2023-01-04T18:16:59.251 INFO:tasks.workunit.client.0.smithi050.stdout:1/236: fsync d8/d14/d1c/d28/f2b 0 2023-01-04T18:16:59.252 INFO:tasks.workunit.client.0.smithi050.stdout:1/237: write d8/d14/d1c/d28/f3f [213927,59722] 0 2023-01-04T18:16:59.254 INFO:tasks.workunit.client.0.smithi050.stdout:9/304: link d1/d3/d11/l3a d1/d12/d3f/l61 0 2023-01-04T18:16:59.254 INFO:tasks.workunit.client.0.smithi050.stdout:1/238: mknod d8/d14/d1c/c4e 0 2023-01-04T18:16:59.254 INFO:tasks.workunit.client.0.smithi050.stdout:1/239: read d8/d14/f46 [27645,85563] 0 2023-01-04T18:16:59.254 INFO:tasks.workunit.client.0.smithi050.stdout:6/249: read d0/d9/d38/fd [2210907,77245] 0 2023-01-04T18:16:59.259 INFO:tasks.workunit.client.0.smithi050.stdout:8/300: rename d3/c9 to d3/d2a/d30/d3b/d4d/d23/d55/c6a 0 2023-01-04T18:16:59.260 INFO:tasks.workunit.client.0.smithi050.stdout:6/250: creat d0/d9/df/f56 x:0 0 0 2023-01-04T18:16:59.260 INFO:tasks.workunit.client.0.smithi050.stdout:6/251: dread - d0/d9/df/f47 zero size 2023-01-04T18:16:59.262 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:16:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:57.919235+0000 mgr.smithi098.vhfzum (mgr.24455) 36 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 450 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 9.7 MiB/s rd, 19 MiB/s wr, 130 op/s 2023-01-04T18:16:59.262 INFO:tasks.workunit.client.0.smithi050.stdout:7/323: write d6/db/d15/d1b/f21 [2447465,130013] 0 2023-01-04T18:16:59.263 INFO:tasks.workunit.client.0.smithi050.stdout:7/324: chown d6/l9 233846 1 2023-01-04T18:16:59.266 INFO:tasks.workunit.client.0.smithi050.stdout:2/251: rename d1/f3 to d1/dd/d11/f54 0 2023-01-04T18:16:59.266 INFO:tasks.workunit.client.0.smithi050.stdout:2/252: chown d1/dd/d28/l4c 8 1 2023-01-04T18:16:59.266 INFO:tasks.workunit.client.0.smithi050.stdout:2/253: chown d1/dd/l53 2 1 2023-01-04T18:16:59.266 INFO:tasks.workunit.client.0.smithi050.stdout:2/254: chown d1/dd/d11/d14/d39/l3b 1 1 2023-01-04T18:16:59.267 INFO:tasks.workunit.client.0.smithi050.stdout:6/252: dread d0/d9/d38/d1c/f26 [0,4194304] 0 2023-01-04T18:16:59.267 INFO:tasks.workunit.client.0.smithi050.stdout:4/259: rename d14 to d14/d55 22 2023-01-04T18:16:59.269 INFO:tasks.workunit.client.0.smithi050.stdout:9/305: dread d1/d12/d2d/d39/f4d [0,4194304] 0 2023-01-04T18:16:59.274 INFO:tasks.workunit.client.0.smithi050.stdout:5/427: dwrite d13/d15/d17/d1f/d35/d42/d4a/f64 [0,4194304] 0 2023-01-04T18:16:59.289 INFO:tasks.workunit.client.0.smithi050.stdout:8/301: dwrite d3/d5/d46/f4a [0,4194304] 0 2023-01-04T18:16:59.289 INFO:tasks.workunit.client.0.smithi050.stdout:8/302: write d3/d2a/d60/d2c/f5e [356916,1159] 0 2023-01-04T18:16:59.290 INFO:tasks.workunit.client.0.smithi050.stdout:2/255: dwrite d1/dd/d28/d2c/f2d [0,4194304] 0 2023-01-04T18:16:59.291 INFO:tasks.workunit.client.0.smithi050.stdout:4/260: dwrite d14/f24 [4194304,4194304] 0 2023-01-04T18:16:59.291 INFO:tasks.workunit.client.0.smithi050.stdout:2/256: write d1/dd/d28/d2c/f4f [2160,46283] 0 2023-01-04T18:16:59.291 INFO:tasks.workunit.client.0.smithi050.stdout:2/257: write d1/f8 [9151342,106932] 0 2023-01-04T18:16:59.294 INFO:tasks.workunit.client.0.smithi050.stdout:4/261: write f4 [5624901,9063] 0 2023-01-04T18:16:59.295 INFO:tasks.workunit.client.0.smithi050.stdout:6/253: unlink d0/d9/d25/d2d/f44 0 2023-01-04T18:16:59.295 INFO:tasks.workunit.client.0.smithi050.stdout:6/254: chown d0/d9/d25/d2d/c55 0 1 2023-01-04T18:16:59.295 INFO:tasks.workunit.client.0.smithi050.stdout:9/306: symlink d1/d3/d11/d1f/l62 0 2023-01-04T18:16:59.301 INFO:tasks.workunit.client.0.smithi050.stdout:1/240: rmdir d8/d14/d1d 39 2023-01-04T18:16:59.305 INFO:tasks.workunit.client.0.smithi050.stdout:4/262: dread d14/d1b/d32/f37 [0,4194304] 0 2023-01-04T18:16:59.312 INFO:tasks.workunit.client.0.smithi050.stdout:9/307: dwrite d1/d12/f22 [0,4194304] 0 2023-01-04T18:16:59.313 INFO:tasks.workunit.client.0.smithi050.stdout:5/428: link d13/d15/d17/d1f/f30 d13/d28/f93 0 2023-01-04T18:16:59.320 INFO:tasks.workunit.client.0.smithi050.stdout:8/303: symlink d3/d5/l6b 0 2023-01-04T18:16:59.320 INFO:tasks.workunit.client.0.smithi050.stdout:8/304: chown d3/d2a/d30/d3b/d4d/d23/f63 1049729676 1 2023-01-04T18:16:59.320 INFO:tasks.workunit.client.0.smithi050.stdout:3/289: sync 2023-01-04T18:16:59.320 INFO:tasks.workunit.client.0.smithi050.stdout:3/290: write d0/d1b/f23 [219687,58281] 0 2023-01-04T18:16:59.321 INFO:tasks.workunit.client.0.smithi050.stdout:0/240: sync 2023-01-04T18:16:59.327 INFO:tasks.workunit.client.0.smithi050.stdout:6/255: unlink d0/d9/df/l4e 0 2023-01-04T18:16:59.327 INFO:tasks.workunit.client.0.smithi050.stdout:6/256: write d0/d9/df/f56 [836782,27073] 0 2023-01-04T18:16:59.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:16:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:57.919235+0000 mgr.smithi098.vhfzum (mgr.24455) 36 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 450 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 9.7 MiB/s rd, 19 MiB/s wr, 130 op/s 2023-01-04T18:16:59.335 INFO:tasks.workunit.client.0.smithi050.stdout:1/241: mknod d8/d14/d1d/d3a/d23/c4f 0 2023-01-04T18:16:59.336 INFO:tasks.workunit.client.0.smithi050.stdout:6/257: dread d0/d9/f29 [0,4194304] 0 2023-01-04T18:16:59.338 INFO:tasks.workunit.client.0.smithi050.stdout:4/263: rmdir d14/d1b/d1f/d22/d3e 39 2023-01-04T18:16:59.340 INFO:tasks.workunit.client.0.smithi050.stdout:9/308: rename d1/d3/d3b/d23 to d1/d3/d3b/d63 0 2023-01-04T18:16:59.341 INFO:tasks.workunit.client.0.smithi050.stdout:9/309: chown d1/d12/d2d/d39/c50 13 1 2023-01-04T18:16:59.341 INFO:tasks.workunit.client.0.smithi050.stdout:9/310: chown d1/d3/d11/d1f/f21 4 1 2023-01-04T18:16:59.341 INFO:tasks.workunit.client.0.smithi050.stdout:9/311: chown d1/d12/l5a 106460 1 2023-01-04T18:16:59.341 INFO:tasks.workunit.client.0.smithi050.stdout:9/312: stat d1/d3/f19 0 2023-01-04T18:16:59.341 INFO:tasks.workunit.client.0.smithi050.stdout:9/313: chown d1/d3/d11/d1f/l29 5 1 2023-01-04T18:16:59.397 INFO:tasks.workunit.client.0.smithi050.stdout:4/264: dwrite f13 [0,4194304] 0 2023-01-04T18:16:59.406 INFO:tasks.workunit.client.0.smithi050.stdout:5/429: unlink d13/d15/d17/d27/d46/c5e 0 2023-01-04T18:16:59.411 INFO:tasks.workunit.client.0.smithi050.stdout:4/265: dwrite f7 [0,4194304] 0 2023-01-04T18:16:59.413 INFO:tasks.workunit.client.0.smithi050.stdout:4/266: write f5 [1606821,97044] 0 2023-01-04T18:16:59.457 INFO:tasks.workunit.client.0.smithi050.stdout:8/305: truncate d3/d2a/d30/d3b/d4d/d23/d55/f5a 1538753 0 2023-01-04T18:16:59.457 INFO:tasks.workunit.client.0.smithi050.stdout:8/306: chown d3/d2a/f18 3 1 2023-01-04T18:16:59.458 INFO:tasks.workunit.client.0.smithi050.stdout:3/291: truncate d0/d1a/f4e 2935210 0 2023-01-04T18:16:59.461 INFO:tasks.workunit.client.0.smithi050.stdout:0/241: unlink d0/d6/d8/d35/f2e 0 2023-01-04T18:16:59.463 INFO:tasks.workunit.client.0.smithi050.stdout:1/242: creat d8/d14/d1d/f50 x:0 0 0 2023-01-04T18:16:59.464 INFO:tasks.workunit.client.0.smithi050.stdout:1/243: write d8/fd [5057572,59172] 0 2023-01-04T18:16:59.464 INFO:tasks.workunit.client.0.smithi050.stdout:1/244: chown d8/f44 53424 1 2023-01-04T18:16:59.467 INFO:tasks.workunit.client.0.smithi050.stdout:9/314: creat d1/d12/d41/d60/f64 x:0 0 0 2023-01-04T18:16:59.468 INFO:tasks.workunit.client.0.smithi050.stdout:0/242: dread d0/d6/d8/f2a [0,4194304] 0 2023-01-04T18:16:59.471 INFO:tasks.workunit.client.0.smithi050.stdout:5/430: creat d13/d15/d17/d27/d46/f94 x:0 0 0 2023-01-04T18:16:59.475 INFO:tasks.workunit.client.0.smithi050.stdout:4/267: rmdir d14/d1b/d1f/d22/d3e 39 2023-01-04T18:16:59.475 INFO:tasks.workunit.client.0.smithi050.stdout:8/307: link d3/l10 d3/d5/d46/l6c 0 2023-01-04T18:16:59.479 INFO:tasks.workunit.client.0.smithi050.stdout:3/292: symlink d0/dd/l63 0 2023-01-04T18:16:59.484 INFO:tasks.workunit.client.0.smithi050.stdout:9/315: mknod d1/d3/d3b/c65 0 2023-01-04T18:16:59.484 INFO:tasks.workunit.client.0.smithi050.stdout:9/316: chown d1/d3/d3b/d63/f3d 133705333 1 2023-01-04T18:16:59.484 INFO:tasks.workunit.client.0.smithi050.stdout:0/243: dwrite d0/d6/d28/d1a/f23 [0,4194304] 0 2023-01-04T18:16:59.485 INFO:tasks.workunit.client.0.smithi050.stdout:3/293: dread d0/d1a/f57 [0,4194304] 0 2023-01-04T18:16:59.485 INFO:tasks.workunit.client.0.smithi050.stdout:3/294: readlink d0/d1b/d2f/d56/d3f/l4a 0 2023-01-04T18:16:59.485 INFO:tasks.workunit.client.0.smithi050.stdout:5/431: creat d13/d15/d17/d1f/d35/d59/f95 x:0 0 0 2023-01-04T18:16:59.486 INFO:tasks.workunit.client.0.smithi050.stdout:4/268: mknod d14/d1b/d1f/d22/d3e/c56 0 2023-01-04T18:16:59.486 INFO:tasks.workunit.client.0.smithi050.stdout:8/308: truncate d3/d2a/f24 2123926 0 2023-01-04T18:16:59.491 INFO:tasks.workunit.client.0.smithi050.stdout:1/245: symlink d8/l51 0 2023-01-04T18:16:59.493 INFO:tasks.workunit.client.0.smithi050.stdout:1/246: write d8/f11 [2595580,82897] 0 2023-01-04T18:16:59.494 INFO:tasks.workunit.client.0.smithi050.stdout:4/269: dread d14/f1c [0,4194304] 0 2023-01-04T18:16:59.496 INFO:tasks.workunit.client.0.smithi050.stdout:0/244: rmdir d0 39 2023-01-04T18:16:59.496 INFO:tasks.workunit.client.0.smithi050.stdout:0/245: chown d0/d6/d28/d1a 791324167 1 2023-01-04T18:16:59.498 INFO:tasks.workunit.client.0.smithi050.stdout:3/295: rmdir d0/d1b/d2f/d31/d60 39 2023-01-04T18:16:59.499 INFO:tasks.workunit.client.0.smithi050.stdout:3/296: write d0/dd/f11 [492451,121565] 0 2023-01-04T18:16:59.504 INFO:tasks.workunit.client.0.smithi050.stdout:8/309: mknod d3/d2a/d30/d3b/d4d/d23/d55/c6d 0 2023-01-04T18:16:59.504 INFO:tasks.workunit.client.0.smithi050.stdout:5/432: mkdir d13/d15/d96 0 2023-01-04T18:16:59.505 INFO:tasks.workunit.client.0.smithi050.stdout:5/433: fsync d13/d15/d17/d27/d44/f82 0 2023-01-04T18:16:59.505 INFO:tasks.workunit.client.0.smithi050.stdout:5/434: truncate d13/d15/d17/d27/f6c 866594 0 2023-01-04T18:16:59.505 INFO:tasks.workunit.client.0.smithi050.stdout:5/435: write d13/d15/d17/d27/d44/f82 [56542,101401] 0 2023-01-04T18:16:59.507 INFO:tasks.workunit.client.0.smithi050.stdout:9/317: unlink d1/d3/d3b/d63/l2e 0 2023-01-04T18:16:59.508 INFO:tasks.workunit.client.0.smithi050.stdout:1/247: dwrite d8/d14/f30 [0,4194304] 0 2023-01-04T18:16:59.508 INFO:tasks.workunit.client.0.smithi050.stdout:1/248: dread - d8/d14/d1c/f40 zero size 2023-01-04T18:16:59.512 INFO:tasks.workunit.client.0.smithi050.stdout:4/270: rmdir d14/d1b/d1f/d22/d3e 39 2023-01-04T18:16:59.512 INFO:tasks.workunit.client.0.smithi050.stdout:0/246: creat d0/d6/d28/d1a/f47 x:0 0 0 2023-01-04T18:16:59.512 INFO:tasks.workunit.client.0.smithi050.stdout:0/247: write d0/d6/d8/d35/f2b [353234,31923] 0 2023-01-04T18:16:59.513 INFO:tasks.workunit.client.0.smithi050.stdout:8/310: creat d3/d2a/f6e x:0 0 0 2023-01-04T18:16:59.514 INFO:tasks.workunit.client.0.smithi050.stdout:3/297: dwrite d0/d1b/d2f/d31/d60/f39 [0,4194304] 0 2023-01-04T18:16:59.514 INFO:tasks.workunit.client.0.smithi050.stdout:3/298: stat d0/d1b/d2f/d31/f50 0 2023-01-04T18:16:59.515 INFO:tasks.workunit.client.0.smithi050.stdout:5/436: link d13/f3b d13/d15/d17/d1f/f97 0 2023-01-04T18:16:59.516 INFO:tasks.workunit.client.0.smithi050.stdout:5/437: write d13/d28/f36 [3312436,41419] 0 2023-01-04T18:16:59.517 INFO:tasks.workunit.client.0.smithi050.stdout:9/318: unlink d1/d3/d13/f58 0 2023-01-04T18:16:59.517 INFO:tasks.workunit.client.0.smithi050.stdout:9/319: readlink d1/d12/d2d/d39/l3c 0 2023-01-04T18:16:59.517 INFO:tasks.workunit.client.0.smithi050.stdout:9/320: fdatasync d1/d3/d13/f15 0 2023-01-04T18:16:59.521 INFO:tasks.workunit.client.0.smithi050.stdout:1/249: creat d8/d14/f52 x:0 0 0 2023-01-04T18:16:59.523 INFO:tasks.workunit.client.0.smithi050.stdout:4/271: creat d14/d1b/d1f/f57 x:0 0 0 2023-01-04T18:16:59.524 INFO:tasks.workunit.client.0.smithi050.stdout:8/311: dread d3/d2a/f18 [0,4194304] 0 2023-01-04T18:16:59.524 INFO:tasks.workunit.client.0.smithi050.stdout:0/248: creat d0/d6/d8/f48 x:0 0 0 2023-01-04T18:16:59.525 INFO:tasks.workunit.client.0.smithi050.stdout:0/249: write d0/d6/d8/d35/f34 [1024211,58991] 0 2023-01-04T18:16:59.529 INFO:tasks.workunit.client.0.smithi050.stdout:3/299: truncate d0/d10/f16 2419561 0 2023-01-04T18:16:59.536 INFO:tasks.workunit.client.0.smithi050.stdout:5/438: link d13/d15/d17/d27/d78/l7d d13/d15/d17/d1f/l98 0 2023-01-04T18:16:59.537 INFO:tasks.workunit.client.0.smithi050.stdout:9/321: stat d1/d3/c57 0 2023-01-04T18:16:59.537 INFO:tasks.workunit.client.0.smithi050.stdout:9/322: chown d1/d3/d3b/f27 117232 1 2023-01-04T18:16:59.538 INFO:tasks.workunit.client.0.smithi050.stdout:9/323: dread - d1/f47 zero size 2023-01-04T18:16:59.539 INFO:tasks.workunit.client.0.smithi050.stdout:1/250: mknod d8/d14/d1d/d3b/c53 0 2023-01-04T18:16:59.540 INFO:tasks.workunit.client.0.smithi050.stdout:1/251: read d8/f12 [2363781,64118] 0 2023-01-04T18:16:59.542 INFO:tasks.workunit.client.0.smithi050.stdout:4/272: link d14/d1b/d1f/d22/d3e/c40 d14/d1b/d1f/d22/d3e/c58 0 2023-01-04T18:16:59.544 INFO:tasks.workunit.client.0.smithi050.stdout:8/312: getdents d3/d2a/d27 0 2023-01-04T18:16:59.550 INFO:tasks.workunit.client.0.smithi050.stdout:0/250: creat d0/d6/d28/f49 x:0 0 0 2023-01-04T18:16:59.553 INFO:tasks.workunit.client.0.smithi050.stdout:1/252: dwrite d8/d14/d1d/d3a/d23/f3e [0,4194304] 0 2023-01-04T18:16:59.555 INFO:tasks.workunit.client.0.smithi050.stdout:3/300: link d0/d1b/d2f/d56/c37 d0/d1a/c64 0 2023-01-04T18:16:59.555 INFO:tasks.workunit.client.0.smithi050.stdout:3/301: dread - d0/d1b/d2f/d31/f62 zero size 2023-01-04T18:16:59.565 INFO:tasks.workunit.client.0.smithi050.stdout:9/324: creat d1/d12/d2d/d39/f66 x:0 0 0 2023-01-04T18:16:59.575 INFO:tasks.workunit.client.0.smithi050.stdout:5/439: write d13/d15/d17/d1f/d35/f3f [2199098,83822] 0 2023-01-04T18:16:59.576 INFO:tasks.workunit.client.0.smithi050.stdout:2/258: sync 2023-01-04T18:16:59.576 INFO:tasks.workunit.client.0.smithi050.stdout:7/325: sync 2023-01-04T18:16:59.576 INFO:tasks.workunit.client.0.smithi050.stdout:7/326: truncate d6/db/d15/d2e/f5d 696235 0 2023-01-04T18:16:59.577 INFO:tasks.workunit.client.0.smithi050.stdout:4/273: mkdir d14/d1b/d1f/d22/d3e/d44/d59 0 2023-01-04T18:16:59.577 INFO:tasks.workunit.client.0.smithi050.stdout:4/274: write d14/f1c [2874922,115082] 0 2023-01-04T18:16:59.578 INFO:tasks.workunit.client.0.smithi050.stdout:8/313: symlink d3/d5/d46/l6f 0 2023-01-04T18:16:59.579 INFO:tasks.workunit.client.0.smithi050.stdout:0/251: link d0/c1b d0/d6/d28/d1a/c4a 0 2023-01-04T18:16:59.581 INFO:tasks.workunit.client.0.smithi050.stdout:1/253: rename d8/cb to d8/d14/d1d/c54 0 2023-01-04T18:16:59.582 INFO:tasks.workunit.client.0.smithi050.stdout:1/254: dread d8/d14/d1d/f1e [0,4194304] 0 2023-01-04T18:16:59.582 INFO:tasks.workunit.client.0.smithi050.stdout:3/302: link d0/d10/f3e d0/d10/f65 0 2023-01-04T18:16:59.585 INFO:tasks.workunit.client.0.smithi050.stdout:5/440: symlink d13/d15/d17/d1f/l99 0 2023-01-04T18:16:59.587 INFO:tasks.workunit.client.0.smithi050.stdout:2/259: creat d1/f55 x:0 0 0 2023-01-04T18:16:59.587 INFO:tasks.workunit.client.0.smithi050.stdout:7/327: mknod d6/db/d3b/c74 0 2023-01-04T18:16:59.596 INFO:tasks.workunit.client.0.smithi050.stdout:8/314: dwrite d3/d2a/f18 [0,4194304] 0 2023-01-04T18:16:59.596 INFO:tasks.workunit.client.0.smithi050.stdout:8/315: read d3/d2a/d60/f39 [618226,67785] 0 2023-01-04T18:16:59.596 INFO:tasks.workunit.client.0.smithi050.stdout:4/275: creat d14/d1b/d1f/d22/d3e/f5a x:0 0 0 2023-01-04T18:16:59.596 INFO:tasks.workunit.client.0.smithi050.stdout:4/276: readlink d14/l28 0 2023-01-04T18:16:59.596 INFO:tasks.workunit.client.0.smithi050.stdout:4/277: fsync d14/d1b/d1f/d22/f54 0 2023-01-04T18:16:59.597 INFO:tasks.workunit.client.0.smithi050.stdout:0/252: symlink d0/d6/d8/d25/l4b 0 2023-01-04T18:16:59.599 INFO:tasks.workunit.client.0.smithi050.stdout:9/325: rename d1/d3/f1b to d1/d12/d41/f67 0 2023-01-04T18:16:59.601 INFO:tasks.workunit.client.0.smithi050.stdout:3/303: creat d0/d1b/d2f/d31/f66 x:0 0 0 2023-01-04T18:16:59.601 INFO:tasks.workunit.client.0.smithi050.stdout:3/304: dread - d0/d1b/d2f/f44 zero size 2023-01-04T18:16:59.601 INFO:tasks.workunit.client.0.smithi050.stdout:5/441: creat d13/d15/d17/d27/d78/f9a x:0 0 0 2023-01-04T18:16:59.603 INFO:tasks.workunit.client.0.smithi050.stdout:2/260: mknod d1/dd/d11/c56 0 2023-01-04T18:16:59.603 INFO:tasks.workunit.client.0.smithi050.stdout:2/261: readlink d1/dd/d11/le 0 2023-01-04T18:16:59.604 INFO:tasks.workunit.client.0.smithi050.stdout:2/262: write d1/dd/d28/d2c/f2d [3698868,79389] 0 2023-01-04T18:16:59.604 INFO:tasks.workunit.client.0.smithi050.stdout:2/263: fdatasync d1/dd/d28/d2c/d2e/d36/f42 0 2023-01-04T18:16:59.604 INFO:tasks.workunit.client.0.smithi050.stdout:2/264: chown d1/dd/l53 121 1 2023-01-04T18:16:59.604 INFO:tasks.workunit.client.0.smithi050.stdout:7/328: symlink d6/d28/l75 0 2023-01-04T18:16:59.605 INFO:tasks.workunit.client.0.smithi050.stdout:2/265: dread d1/dd/d28/d2c/f4f [0,4194304] 0 2023-01-04T18:16:59.605 INFO:tasks.workunit.client.0.smithi050.stdout:8/316: creat d3/d2a/d2d/f70 x:0 0 0 2023-01-04T18:16:59.607 INFO:tasks.workunit.client.0.smithi050.stdout:4/278: creat d14/d1b/d1f/f5b x:0 0 0 2023-01-04T18:16:59.607 INFO:tasks.workunit.client.0.smithi050.stdout:4/279: chown d14/d1b/d1f/d22/c3a 1 1 2023-01-04T18:16:59.607 INFO:tasks.workunit.client.0.smithi050.stdout:0/253: symlink d0/d6/d8/l4c 0 2023-01-04T18:16:59.609 INFO:tasks.workunit.client.0.smithi050.stdout:1/255: rename d8/d14/d1d/d3b/c53 to d8/d14/d1d/d3a/c55 0 2023-01-04T18:16:59.610 INFO:tasks.workunit.client.0.smithi050.stdout:9/326: symlink d1/d12/d2d/l68 0 2023-01-04T18:16:59.610 INFO:tasks.workunit.client.0.smithi050.stdout:9/327: write d1/d3/d24/f55 [300802,33118] 0 2023-01-04T18:16:59.613 INFO:tasks.workunit.client.0.smithi050.stdout:3/305: read d0/d10/f42 [144578,85128] 0 2023-01-04T18:16:59.613 INFO:tasks.workunit.client.0.smithi050.stdout:5/442: creat d13/d15/f9b x:0 0 0 2023-01-04T18:16:59.613 INFO:tasks.workunit.client.0.smithi050.stdout:5/443: write d13/d15/d17/d1f/f30 [151488,69655] 0 2023-01-04T18:16:59.615 INFO:tasks.workunit.client.0.smithi050.stdout:7/329: truncate f2 33870 0 2023-01-04T18:16:59.616 INFO:tasks.workunit.client.0.smithi050.stdout:5/444: fsync d13/d15/d17/d1f/f30 0 2023-01-04T18:16:59.617 INFO:tasks.workunit.client.0.smithi050.stdout:2/266: rmdir d1/dd/d11/d14/d44/d52 0 2023-01-04T18:16:59.618 INFO:tasks.workunit.client.0.smithi050.stdout:2/267: fdatasync d1/dd/d28/d2c/d2e/f40 0 2023-01-04T18:16:59.618 INFO:tasks.workunit.client.0.smithi050.stdout:6/258: sync 2023-01-04T18:16:59.618 INFO:tasks.workunit.client.0.smithi050.stdout:6/259: truncate d0/d9/d38/f23 918980 0 2023-01-04T18:16:59.619 INFO:tasks.workunit.client.0.smithi050.stdout:4/280: mknod d14/d1b/d1f/d22/d3e/d44/c5c 0 2023-01-04T18:16:59.620 INFO:tasks.workunit.client.0.smithi050.stdout:0/254: creat d0/f4d x:0 0 0 2023-01-04T18:16:59.622 INFO:tasks.workunit.client.0.smithi050.stdout:8/317: rename d3/d2a/d30/d3b/d4d/d23/f63 to d3/d2a/d60/f71 0 2023-01-04T18:16:59.623 INFO:tasks.workunit.client.0.smithi050.stdout:9/328: creat d1/d3/d11/d1f/f69 x:0 0 0 2023-01-04T18:16:59.623 INFO:tasks.workunit.client.0.smithi050.stdout:9/329: chown d1/d12/d2d/d39/l3c 47466 1 2023-01-04T18:16:59.623 INFO:tasks.workunit.client.0.smithi050.stdout:9/330: truncate d1/d12/d2d/f4c 38477 0 2023-01-04T18:16:59.624 INFO:tasks.workunit.client.0.smithi050.stdout:3/306: creat d0/d1b/d2f/d31/d60/f67 x:0 0 0 2023-01-04T18:16:59.626 INFO:tasks.workunit.client.0.smithi050.stdout:6/260: dread d0/d9/d25/f27 [0,4194304] 0 2023-01-04T18:16:59.626 INFO:tasks.workunit.client.0.smithi050.stdout:6/261: truncate d0/d9/f3b 393647 0 2023-01-04T18:16:59.626 INFO:tasks.workunit.client.0.smithi050.stdout:6/262: read - d0/d9/d38/d16/f3f zero size 2023-01-04T18:16:59.626 INFO:tasks.workunit.client.0.smithi050.stdout:7/330: creat d6/db/d3b/d5c/f76 x:0 0 0 2023-01-04T18:16:59.626 INFO:tasks.workunit.client.0.smithi050.stdout:7/331: chown d6/db/d3b/f61 5 1 2023-01-04T18:16:59.627 INFO:tasks.workunit.client.0.smithi050.stdout:5/445: creat d13/d15/d17/d27/d44/f9c x:0 0 0 2023-01-04T18:16:59.628 INFO:tasks.workunit.client.0.smithi050.stdout:7/332: write d6/f31 [988389,14140] 0 2023-01-04T18:16:59.628 INFO:tasks.workunit.client.0.smithi050.stdout:2/268: mknod d1/dd/d38/c57 0 2023-01-04T18:16:59.629 INFO:tasks.workunit.client.0.smithi050.stdout:2/269: stat d1/dd/d28/l2f 0 2023-01-04T18:16:59.629 INFO:tasks.workunit.client.0.smithi050.stdout:1/256: dwrite d8/d14/d1d/f50 [0,4194304] 0 2023-01-04T18:16:59.631 INFO:tasks.workunit.client.0.smithi050.stdout:8/318: rename d3/d2a/d30/d3b/d4d/d23/d55/c6d to d3/d2a/d30/c72 0 2023-01-04T18:16:59.631 INFO:tasks.workunit.client.0.smithi050.stdout:8/319: truncate d3/d2a/d60/f71 706992 0 2023-01-04T18:16:59.631 INFO:tasks.workunit.client.0.smithi050.stdout:8/320: chown d3/d2a/d30/d3b 7641 1 2023-01-04T18:16:59.631 INFO:tasks.workunit.client.0.smithi050.stdout:8/321: write d3/d2a/f6e [942291,82861] 0 2023-01-04T18:16:59.633 INFO:tasks.workunit.client.0.smithi050.stdout:9/331: symlink d1/d12/d41/l6a 0 2023-01-04T18:16:59.634 INFO:tasks.workunit.client.0.smithi050.stdout:5/446: mkdir d13/d15/d17/d1f/d35/d42/d9d 0 2023-01-04T18:16:59.642 INFO:tasks.workunit.client.0.smithi050.stdout:0/255: dread d0/d6/f21 [0,4194304] 0 2023-01-04T18:16:59.645 INFO:tasks.workunit.client.0.smithi050.stdout:1/257: creat d8/d14/d1d/f56 x:0 0 0 2023-01-04T18:16:59.646 INFO:tasks.workunit.client.0.smithi050.stdout:4/281: dwrite d14/f51 [0,4194304] 0 2023-01-04T18:16:59.647 INFO:tasks.workunit.client.0.smithi050.stdout:4/282: write d14/d1b/d1f/d22/d3e/f5a [725393,100063] 0 2023-01-04T18:16:59.647 INFO:tasks.workunit.client.0.smithi050.stdout:4/283: fsync d14/d1b/d1f/d22/f4d 0 2023-01-04T18:16:59.652 INFO:tasks.workunit.client.0.smithi050.stdout:2/270: dwrite d1/f55 [0,4194304] 0 2023-01-04T18:16:59.652 INFO:tasks.workunit.client.0.smithi050.stdout:2/271: rename d1/dd/d28/d2c to d1/dd/d28/d2c/d2e/d58 22 2023-01-04T18:16:59.652 INFO:tasks.workunit.client.0.smithi050.stdout:2/272: chown d1/d10/l3c 13551 1 2023-01-04T18:16:59.653 INFO:tasks.workunit.client.0.smithi050.stdout:2/273: write d1/dd/d28/f43 [491145,31655] 0 2023-01-04T18:16:59.653 INFO:tasks.workunit.client.0.smithi050.stdout:2/274: write d1/dd/d28/d2c/f4f [760866,89419] 0 2023-01-04T18:16:59.653 INFO:tasks.workunit.client.0.smithi050.stdout:8/322: mkdir d3/d2a/d73 0 2023-01-04T18:16:59.653 INFO:tasks.workunit.client.0.smithi050.stdout:3/307: dwrite d0/d1a/f58 [0,4194304] 0 2023-01-04T18:16:59.654 INFO:tasks.workunit.client.0.smithi050.stdout:9/332: getdents d1/d3/d11/d1f 0 2023-01-04T18:16:59.659 INFO:tasks.workunit.client.0.smithi050.stdout:5/447: mknod d13/d28/d7c/c9e 0 2023-01-04T18:16:59.659 INFO:tasks.workunit.client.0.smithi050.stdout:7/333: symlink d6/d1d/l77 0 2023-01-04T18:16:59.659 INFO:tasks.workunit.client.0.smithi050.stdout:7/334: fdatasync d6/db/d20/d55/f5e 0 2023-01-04T18:16:59.663 INFO:tasks.workunit.client.0.smithi050.stdout:0/256: link d0/d6/d8/l4c d0/d6/d8/d25/d3e/l4e 0 2023-01-04T18:16:59.663 INFO:tasks.workunit.client.0.smithi050.stdout:0/257: chown d0/d6/d8/cd 4064 1 2023-01-04T18:16:59.663 INFO:tasks.workunit.client.0.smithi050.stdout:6/263: dwrite d0/d9/f17 [0,4194304] 0 2023-01-04T18:16:59.663 INFO:tasks.workunit.client.0.smithi050.stdout:5/448: read d13/d15/d17/d27/f76 [256732,50037] 0 2023-01-04T18:16:59.667 INFO:tasks.workunit.client.0.smithi050.stdout:2/275: dread d1/dd/d11/d1e/f25 [0,4194304] 0 2023-01-04T18:16:59.671 INFO:tasks.workunit.client.0.smithi050.stdout:1/258: dread d8/f4d [0,4194304] 0 2023-01-04T18:16:59.716 INFO:tasks.workunit.client.0.smithi050.stdout:8/323: truncate d3/d2a/d30/d3b/d53/f54 409595 0 2023-01-04T18:16:59.716 INFO:tasks.workunit.client.0.smithi050.stdout:8/324: write d3/d2a/d2d/f70 [85645,60979] 0 2023-01-04T18:16:59.716 INFO:tasks.workunit.client.0.smithi050.stdout:8/325: fdatasync d3/d2a/d60/f71 0 2023-01-04T18:16:59.722 INFO:tasks.workunit.client.0.smithi050.stdout:4/284: dwrite d14/d1b/d1f/d22/d3e/f5a [0,4194304] 0 2023-01-04T18:16:59.722 INFO:tasks.workunit.client.0.smithi050.stdout:4/285: stat d14/d1b/d1f/d22/f42 0 2023-01-04T18:16:59.722 INFO:tasks.workunit.client.0.smithi050.stdout:4/286: chown d14/d1b/d1f/f5b 346031 1 2023-01-04T18:16:59.725 INFO:tasks.workunit.client.0.smithi050.stdout:6/264: dwrite d0/d9/df/f52 [0,4194304] 0 2023-01-04T18:16:59.725 INFO:tasks.workunit.client.0.smithi050.stdout:6/265: write d0/d9/f4b [705060,89865] 0 2023-01-04T18:16:59.726 INFO:tasks.workunit.client.0.smithi050.stdout:3/308: rename d0/d1b/d2f/d56/d3f/l4a to d0/d1b/d2f/l68 0 2023-01-04T18:16:59.729 INFO:tasks.workunit.client.0.smithi050.stdout:2/276: dwrite d1/f15 [0,4194304] 0 2023-01-04T18:16:59.731 INFO:tasks.workunit.client.0.smithi050.stdout:7/335: symlink d6/d6b/l78 0 2023-01-04T18:16:59.731 INFO:tasks.workunit.client.0.smithi050.stdout:7/336: readlink d6/d6b/l78 0 2023-01-04T18:16:59.731 INFO:tasks.workunit.client.0.smithi050.stdout:7/337: chown d6/d28/f2c 43 1 2023-01-04T18:16:59.735 INFO:tasks.workunit.client.0.smithi050.stdout:0/258: mkdir d0/d6/d8/d4f 0 2023-01-04T18:16:59.735 INFO:tasks.workunit.client.0.smithi050.stdout:0/259: chown d0/d6/d8/f13 1271571 1 2023-01-04T18:16:59.736 INFO:tasks.workunit.client.0.smithi050.stdout:3/309: dread d0/f4 [0,4194304] 0 2023-01-04T18:16:59.737 INFO:tasks.workunit.client.0.smithi050.stdout:7/338: write d6/db/d15/d48/f58 [737533,64608] 0 2023-01-04T18:16:59.739 INFO:tasks.workunit.client.0.smithi050.stdout:4/287: dwrite d14/d1b/d1f/d22/f54 [0,4194304] 0 2023-01-04T18:16:59.739 INFO:tasks.workunit.client.0.smithi050.stdout:4/288: dread - d14/d1b/d1f/f5b zero size 2023-01-04T18:16:59.740 INFO:tasks.workunit.client.0.smithi050.stdout:5/449: getdents d13/d15 0 2023-01-04T18:16:59.747 INFO:tasks.workunit.client.0.smithi050.stdout:4/289: dread d14/f1a [0,4194304] 0 2023-01-04T18:16:59.747 INFO:tasks.workunit.client.0.smithi050.stdout:4/290: dread - d14/d1b/d1f/d22/f34 zero size 2023-01-04T18:16:59.751 INFO:tasks.workunit.client.0.smithi050.stdout:1/259: mkdir d8/d14/d1c/d28/d57 0 2023-01-04T18:16:59.751 INFO:tasks.workunit.client.0.smithi050.stdout:1/260: dread - d8/f43 zero size 2023-01-04T18:16:59.751 INFO:tasks.workunit.client.0.smithi050.stdout:1/261: chown d8/fe 72 1 2023-01-04T18:16:59.754 INFO:tasks.workunit.client.0.smithi050.stdout:8/326: mkdir d3/d2a/d74 0 2023-01-04T18:16:59.761 INFO:tasks.workunit.client.0.smithi050.stdout:4/291: dwrite d14/f1c [0,4194304] 0 2023-01-04T18:16:59.761 INFO:tasks.workunit.client.0.smithi050.stdout:4/292: dread - d14/d1b/d1f/d22/f4d zero size 2023-01-04T18:16:59.772 INFO:tasks.workunit.client.0.smithi050.stdout:6/266: mknod d0/d9/d25/d4d/c57 0 2023-01-04T18:16:59.774 INFO:tasks.workunit.client.0.smithi050.stdout:2/277: creat d1/dd/d11/d12/f59 x:0 0 0 2023-01-04T18:16:59.775 INFO:tasks.workunit.client.0.smithi050.stdout:0/260: unlink d0/d6/d8/d25/l33 0 2023-01-04T18:16:59.776 INFO:tasks.workunit.client.0.smithi050.stdout:3/310: symlink d0/d10/l69 0 2023-01-04T18:16:59.778 INFO:tasks.workunit.client.0.smithi050.stdout:7/339: link d6/d1d/l77 d6/db/d15/d2e/d4b/l79 0 2023-01-04T18:16:59.780 INFO:tasks.workunit.client.0.smithi050.stdout:5/450: creat d13/d15/d17/d1f/d35/d42/f9f x:0 0 0 2023-01-04T18:16:59.781 INFO:tasks.workunit.client.0.smithi050.stdout:8/327: mknod d3/d5/c75 0 2023-01-04T18:16:59.782 INFO:tasks.workunit.client.0.smithi050.stdout:6/267: creat d0/d9/d38/d1c/d54/f58 x:0 0 0 2023-01-04T18:16:59.783 INFO:tasks.workunit.client.0.smithi050.stdout:2/278: mkdir d1/d19/d5a 0 2023-01-04T18:16:59.784 INFO:tasks.workunit.client.0.smithi050.stdout:3/311: mknod d0/d1b/d2f/d31/d60/d46/c6a 0 2023-01-04T18:16:59.784 INFO:tasks.workunit.client.0.smithi050.stdout:3/312: fsync d0/fb 0 2023-01-04T18:16:59.784 INFO:tasks.workunit.client.0.smithi050.stdout:7/340: mkdir d6/db/d3b/d5c/d7a 0 2023-01-04T18:16:59.785 INFO:tasks.workunit.client.0.smithi050.stdout:7/341: fsync d6/f13 0 2023-01-04T18:16:59.785 INFO:tasks.workunit.client.0.smithi050.stdout:8/328: rmdir d3/d2a/d60/d2c 39 2023-01-04T18:16:59.785 INFO:tasks.workunit.client.0.smithi050.stdout:8/329: stat d3/d5/c19 0 2023-01-04T18:16:59.786 INFO:tasks.workunit.client.0.smithi050.stdout:6/268: symlink d0/d9/d25/d2d/l59 0 2023-01-04T18:16:59.787 INFO:tasks.workunit.client.0.smithi050.stdout:2/279: creat d1/dd/d28/d2c/d2e/d36/f5b x:0 0 0 2023-01-04T18:16:59.788 INFO:tasks.workunit.client.0.smithi050.stdout:5/451: dread d13/d15/d17/f4c [0,4194304] 0 2023-01-04T18:16:59.789 INFO:tasks.workunit.client.0.smithi050.stdout:8/330: creat d3/d2a/d2d/f76 x:0 0 0 2023-01-04T18:16:59.789 INFO:tasks.workunit.client.0.smithi050.stdout:6/269: dread d0/d9/d38/d1c/f26 [0,4194304] 0 2023-01-04T18:16:59.789 INFO:tasks.workunit.client.0.smithi050.stdout:5/452: write d13/d15/f9b [1037592,81046] 0 2023-01-04T18:16:59.789 INFO:tasks.workunit.client.0.smithi050.stdout:8/331: getdents d3/d2a/d27 0 2023-01-04T18:16:59.789 INFO:tasks.workunit.client.0.smithi050.stdout:5/453: readlink d13/d15/d17/d1f/d35/d42/d4a/l54 0 2023-01-04T18:16:59.789 INFO:tasks.workunit.client.0.smithi050.stdout:5/454: fdatasync d13/d15/f34 0 2023-01-04T18:16:59.793 INFO:tasks.workunit.client.0.smithi050.stdout:0/261: dwrite d0/d6/d8/d35/f34 [4194304,4194304] 0 2023-01-04T18:16:59.807 INFO:tasks.workunit.client.0.smithi050.stdout:8/332: dread d3/d2a/d60/f39 [0,4194304] 0 2023-01-04T18:16:59.809 INFO:tasks.workunit.client.0.smithi050.stdout:8/333: write d3/d5/d46/f4a [1145442,121779] 0 2023-01-04T18:16:59.816 INFO:tasks.workunit.client.0.smithi050.stdout:3/313: dwrite d0/d1b/d2f/d56/f53 [0,4194304] 0 2023-01-04T18:16:59.816 INFO:tasks.workunit.client.0.smithi050.stdout:4/293: dwrite fc [0,4194304] 0 2023-01-04T18:16:59.816 INFO:tasks.workunit.client.0.smithi050.stdout:4/294: dread - d14/d1b/d1f/d22/f34 zero size 2023-01-04T18:16:59.817 INFO:tasks.workunit.client.0.smithi050.stdout:7/342: dwrite d6/db/f19 [0,4194304] 0 2023-01-04T18:16:59.822 INFO:tasks.workunit.client.0.smithi050.stdout:2/280: symlink d1/dd/d11/d14/d44/l5c 0 2023-01-04T18:16:59.822 INFO:tasks.workunit.client.0.smithi050.stdout:2/281: chown d1/dd/d28/d2c/d2e/d36/f42 9 1 2023-01-04T18:16:59.823 INFO:tasks.workunit.client.0.smithi050.stdout:8/334: dwrite d3/d2a/d60/d2c/f5e [0,4194304] 0 2023-01-04T18:16:59.826 INFO:tasks.workunit.client.0.smithi050.stdout:6/270: creat d0/d9/d25/d4d/f5a x:0 0 0 2023-01-04T18:16:59.828 INFO:tasks.workunit.client.0.smithi050.stdout:5/455: rename d13/d15/d17/c25 to d13/d15/d17/d27/d46/ca0 0 2023-01-04T18:16:59.828 INFO:tasks.workunit.client.0.smithi050.stdout:5/456: dread - d13/d15/d17/d27/d78/f9a zero size 2023-01-04T18:16:59.871 INFO:tasks.workunit.client.0.smithi050.stdout:0/262: unlink d0/d6/d28/d1a/f47 0 2023-01-04T18:16:59.871 INFO:tasks.workunit.client.0.smithi050.stdout:0/263: readlink d0/l16 0 2023-01-04T18:16:59.871 INFO:tasks.workunit.client.0.smithi050.stdout:6/271: dwrite d0/d9/d38/f15 [0,4194304] 0 2023-01-04T18:16:59.878 INFO:tasks.workunit.client.0.smithi050.stdout:3/314: mkdir d0/d1b/d2f/d56/d6b 0 2023-01-04T18:16:59.884 INFO:tasks.workunit.client.0.smithi050.stdout:4/295: mkdir d14/d1b/d1f/d22/d3e/d44/d59/d5d 0 2023-01-04T18:16:59.885 INFO:tasks.workunit.client.0.smithi050.stdout:7/343: symlink d6/db/d15/d2e/d66/l7b 0 2023-01-04T18:16:59.887 INFO:tasks.workunit.client.0.smithi050.stdout:2/282: mknod d1/d10/c5d 0 2023-01-04T18:16:59.889 INFO:tasks.workunit.client.0.smithi050.stdout:6/272: dwrite d0/d9/df/f30 [0,4194304] 0 2023-01-04T18:16:59.901 INFO:tasks.workunit.client.0.smithi050.stdout:5/457: rmdir d13/d15/d17/d27/d46/d4e/d4d 39 2023-01-04T18:16:59.901 INFO:tasks.workunit.client.0.smithi050.stdout:5/458: fdatasync d13/d15/f34 0 2023-01-04T18:16:59.905 INFO:tasks.workunit.client.0.smithi050.stdout:0/264: rename d0/d6/f36 to d0/d6/d3a/f50 0 2023-01-04T18:16:59.908 INFO:tasks.workunit.client.0.smithi050.stdout:3/315: truncate d0/d1b/d2f/d31/d60/f27 2574258 0 2023-01-04T18:16:59.911 INFO:tasks.workunit.client.0.smithi050.stdout:4/296: symlink d14/d1b/d1f/d22/d3e/l5e 0 2023-01-04T18:16:59.913 INFO:tasks.workunit.client.0.smithi050.stdout:2/283: symlink d1/dd/d11/d14/d39/l5e 0 2023-01-04T18:16:59.916 INFO:tasks.workunit.client.0.smithi050.stdout:6/273: creat d0/d9/d38/f5b x:0 0 0 2023-01-04T18:16:59.917 INFO:tasks.workunit.client.0.smithi050.stdout:2/284: dread d1/d19/f21 [0,4194304] 0 2023-01-04T18:16:59.917 INFO:tasks.workunit.client.0.smithi050.stdout:3/316: getdents d0/d1b/d2f/d31 0 2023-01-04T18:16:59.919 INFO:tasks.workunit.client.0.smithi050.stdout:4/297: truncate d14/f1a 2306586 0 2023-01-04T18:16:59.922 INFO:tasks.workunit.client.0.smithi050.stdout:7/344: unlink d6/d1d/c33 0 2023-01-04T18:16:59.922 INFO:tasks.workunit.client.0.smithi050.stdout:7/345: write d6/db/f2a [6046175,65270] 0 2023-01-04T18:16:59.923 INFO:tasks.workunit.client.0.smithi050.stdout:6/274: mkdir d0/d5c 0 2023-01-04T18:16:59.923 INFO:tasks.workunit.client.0.smithi050.stdout:6/275: fdatasync d0/f2e 0 2023-01-04T18:16:59.923 INFO:tasks.workunit.client.0.smithi050.stdout:6/276: write d0/d9/d38/f5b [328710,1377] 0 2023-01-04T18:16:59.924 INFO:tasks.workunit.client.0.smithi050.stdout:6/277: write d0/f14 [550691,57998] 0 2023-01-04T18:16:59.924 INFO:tasks.workunit.client.0.smithi050.stdout:4/298: mkdir d14/d1b/d1f/d22/d3e/d44/d59/d5f 0 2023-01-04T18:16:59.925 INFO:tasks.workunit.client.0.smithi050.stdout:2/285: dread d1/dd/d11/d14/f23 [0,4194304] 0 2023-01-04T18:16:59.925 INFO:tasks.workunit.client.0.smithi050.stdout:2/286: truncate d1/dd/d11/f54 3163248 0 2023-01-04T18:16:59.925 INFO:tasks.workunit.client.0.smithi050.stdout:5/459: dwrite d13/d15/d17/d1f/f97 [0,4194304] 0 2023-01-04T18:16:59.927 INFO:tasks.workunit.client.0.smithi050.stdout:0/265: dwrite d0/d6/d8/d35/f2b [0,4194304] 0 2023-01-04T18:16:59.927 INFO:tasks.workunit.client.0.smithi050.stdout:0/266: dread - d0/d6/d28/f49 zero size 2023-01-04T18:16:59.928 INFO:tasks.workunit.client.0.smithi050.stdout:7/346: creat d6/f7c x:0 0 0 2023-01-04T18:16:59.928 INFO:tasks.workunit.client.0.smithi050.stdout:7/347: read - d6/f7c zero size 2023-01-04T18:16:59.930 INFO:tasks.workunit.client.0.smithi050.stdout:6/278: mkdir d0/d5c/d5d 0 2023-01-04T18:16:59.930 INFO:tasks.workunit.client.0.smithi050.stdout:3/317: dread d0/fb [4194304,4194304] 0 2023-01-04T18:16:59.934 INFO:tasks.workunit.client.0.smithi050.stdout:4/299: creat d14/d1b/d1f/d22/d3e/f60 x:0 0 0 2023-01-04T18:16:59.939 INFO:tasks.workunit.client.0.smithi050.stdout:2/287: creat d1/d19/f5f x:0 0 0 2023-01-04T18:16:59.939 INFO:tasks.workunit.client.0.smithi050.stdout:2/288: chown d1/d19/d5a 31 1 2023-01-04T18:16:59.940 INFO:tasks.workunit.client.0.smithi050.stdout:2/289: stat d1/dd/d11/le 0 2023-01-04T18:16:59.943 INFO:tasks.workunit.client.0.smithi050.stdout:5/460: mknod d13/d15/d17/d1f/d35/d59/ca1 0 2023-01-04T18:16:59.943 INFO:tasks.workunit.client.0.smithi050.stdout:5/461: write d13/d15/f26 [965604,54322] 0 2023-01-04T18:16:59.944 INFO:tasks.workunit.client.0.smithi050.stdout:7/348: dwrite d6/db/f19 [0,4194304] 0 2023-01-04T18:16:59.944 INFO:tasks.workunit.client.0.smithi050.stdout:7/349: dread - d6/f7c zero size 2023-01-04T18:16:59.945 INFO:tasks.workunit.client.0.smithi050.stdout:7/350: dread - d6/db/f43 zero size 2023-01-04T18:16:59.945 INFO:tasks.workunit.client.0.smithi050.stdout:7/351: truncate d6/db/d3b/f61 43444 0 2023-01-04T18:16:59.950 INFO:tasks.workunit.client.0.smithi050.stdout:4/300: dwrite f0 [0,4194304] 0 2023-01-04T18:16:59.950 INFO:tasks.workunit.client.0.smithi050.stdout:4/301: chown d14/d1b/f2f 36827960 1 2023-01-04T18:16:59.951 INFO:tasks.workunit.client.0.smithi050.stdout:4/302: fsync d14/d1b/d1f/d22/f42 0 2023-01-04T18:16:59.959 INFO:tasks.workunit.client.0.smithi050.stdout:7/352: dwrite d6/db/f43 [0,4194304] 0 2023-01-04T18:16:59.959 INFO:tasks.workunit.client.0.smithi050.stdout:7/353: chown d6/db/d15/d48 115194555 1 2023-01-04T18:16:59.966 INFO:tasks.workunit.client.0.smithi050.stdout:0/267: rename d0/d6/d3a to d0/d6/d8/d51 0 2023-01-04T18:16:59.966 INFO:tasks.workunit.client.0.smithi050.stdout:0/268: dread - d0/d6/d28/d1a/f40 zero size 2023-01-04T18:16:59.968 INFO:tasks.workunit.client.0.smithi050.stdout:6/279: symlink d0/d9/d38/l5e 0 2023-01-04T18:16:59.969 INFO:tasks.workunit.client.0.smithi050.stdout:3/318: creat d0/dd/f6c x:0 0 0 2023-01-04T18:16:59.969 INFO:tasks.workunit.client.0.smithi050.stdout:3/319: fdatasync d0/f40 0 2023-01-04T18:16:59.970 INFO:tasks.workunit.client.0.smithi050.stdout:4/303: dwrite fc [0,4194304] 0 2023-01-04T18:16:59.976 INFO:tasks.workunit.client.0.smithi050.stdout:9/333: sync 2023-01-04T18:16:59.976 INFO:tasks.workunit.client.0.smithi050.stdout:0/269: dread d0/d6/d28/d1a/f23 [0,4194304] 0 2023-01-04T18:16:59.976 INFO:tasks.workunit.client.0.smithi050.stdout:1/262: sync 2023-01-04T18:16:59.976 INFO:tasks.workunit.client.0.smithi050.stdout:1/263: stat d8/f4d 0 2023-01-04T18:17:00.001 INFO:tasks.workunit.client.0.smithi050.stdout:3/320: dwrite d0/d10/f16 [0,4194304] 0 2023-01-04T18:17:00.001 INFO:tasks.workunit.client.0.smithi050.stdout:3/321: write d0/d1b/f23 [600173,31449] 0 2023-01-04T18:17:00.001 INFO:tasks.workunit.client.0.smithi050.stdout:3/322: fsync d0/d1b/d2f/d31/f3d 0 2023-01-04T18:17:00.002 INFO:tasks.workunit.client.0.smithi050.stdout:3/323: chown d0/d1b/d2f/d31/f50 20 1 2023-01-04T18:17:00.113 INFO:tasks.workunit.client.0.smithi050.stdout:1/264: dwrite d8/d14/d1d/f50 [0,4194304] 0 2023-01-04T18:17:00.114 INFO:tasks.workunit.client.0.smithi050.stdout:1/265: write d8/d14/d1d/f56 [835739,32529] 0 2023-01-04T18:17:00.114 INFO:tasks.workunit.client.0.smithi050.stdout:1/266: chown d8/d14/d1c 82625 1 2023-01-04T18:17:00.116 INFO:tasks.workunit.client.0.smithi050.stdout:7/354: symlink d6/db/d15/d1b/l7d 0 2023-01-04T18:17:00.116 INFO:tasks.workunit.client.0.smithi050.stdout:7/355: chown d6/db/d3a/c51 73281031 1 2023-01-04T18:17:00.123 INFO:tasks.workunit.client.0.smithi050.stdout:5/462: rename d13/d15/d17/d27/d44/d47/f84 to d13/d15/d17/d1f/d35/fa2 0 2023-01-04T18:17:00.123 INFO:tasks.workunit.client.0.smithi050.stdout:5/463: write d13/d15/d17/d27/d46/d4e/f3c [1122503,70481] 0 2023-01-04T18:17:00.123 INFO:tasks.workunit.client.0.smithi050.stdout:5/464: write d13/d15/d17/d27/d46/d4e/d4d/f90 [689383,50319] 0 2023-01-04T18:17:00.123 INFO:tasks.workunit.client.0.smithi050.stdout:4/304: dread d14/d1b/d32/f35 [0,4194304] 0 2023-01-04T18:17:00.126 INFO:tasks.workunit.client.0.smithi050.stdout:2/290: truncate d1/dd/d11/d1e/f20 2710193 0 2023-01-04T18:17:00.126 INFO:tasks.workunit.client.0.smithi050.stdout:2/291: write d1/d10/f4e [737021,84727] 0 2023-01-04T18:17:00.127 INFO:tasks.workunit.client.0.smithi050.stdout:2/292: readlink d1/dd/d28/d2c/d2e/l49 0 2023-01-04T18:17:00.127 INFO:tasks.workunit.client.0.smithi050.stdout:9/334: mknod d1/d12/d41/d60/c6b 0 2023-01-04T18:17:00.129 INFO:tasks.workunit.client.0.smithi050.stdout:0/270: creat d0/d6/d8/d51/f52 x:0 0 0 2023-01-04T18:17:00.131 INFO:tasks.workunit.client.0.smithi050.stdout:3/324: truncate d0/d10/f65 85001 0 2023-01-04T18:17:00.133 INFO:tasks.workunit.client.0.smithi050.stdout:3/325: dread d0/f3 [0,4194304] 0 2023-01-04T18:17:00.135 INFO:tasks.workunit.client.0.smithi050.stdout:1/267: mkdir d8/d14/d1d/d3a/d58 0 2023-01-04T18:17:00.138 INFO:tasks.workunit.client.0.smithi050.stdout:7/356: rmdir d6/d28/d72 0 2023-01-04T18:17:00.139 INFO:tasks.workunit.client.0.smithi050.stdout:5/465: rmdir d13/d15/d17/d1f/d35 39 2023-01-04T18:17:00.139 INFO:tasks.workunit.client.0.smithi050.stdout:5/466: stat d13/d15/d17/d1f/d35/d59/ca1 0 2023-01-04T18:17:00.142 INFO:tasks.workunit.client.0.smithi050.stdout:4/305: symlink d14/d1b/d1f/d22/l61 0 2023-01-04T18:17:00.142 INFO:tasks.workunit.client.0.smithi050.stdout:4/306: chown d14/d1b/d1f/f57 39784 1 2023-01-04T18:17:00.143 INFO:tasks.workunit.client.0.smithi050.stdout:2/293: getdents d1/dd/d11 0 2023-01-04T18:17:00.144 INFO:tasks.workunit.client.0.smithi050.stdout:8/335: sync 2023-01-04T18:17:00.145 INFO:tasks.workunit.client.0.smithi050.stdout:0/271: creat d0/f53 x:0 0 0 2023-01-04T18:17:00.181 INFO:tasks.workunit.client.0.smithi050.stdout:4/307: dwrite f3 [0,4194304] 0 2023-01-04T18:17:00.188 INFO:tasks.workunit.client.0.smithi050.stdout:3/326: creat d0/d1b/d2f/d56/d32/f6d x:0 0 0 2023-01-04T18:17:00.188 INFO:tasks.workunit.client.0.smithi050.stdout:3/327: chown d0/dd/f1e 12990 1 2023-01-04T18:17:00.192 INFO:tasks.workunit.client.0.smithi050.stdout:1/268: rename d8/d14/d1d/f49 to d8/d14/d1c/d28/f59 0 2023-01-04T18:17:00.197 INFO:tasks.workunit.client.0.smithi050.stdout:5/467: link d13/d15/d17/d1f/d35/d42/d4a/f64 d13/d15/d17/d1f/fa3 0 2023-01-04T18:17:00.198 INFO:tasks.workunit.client.0.smithi050.stdout:5/468: dread d13/d28/f93 [0,4194304] 0 2023-01-04T18:17:00.199 INFO:tasks.workunit.client.0.smithi050.stdout:2/294: getdents d1/d10 0 2023-01-04T18:17:00.204 INFO:tasks.workunit.client.0.smithi050.stdout:8/336: symlink d3/d2a/d30/d3b/d53/l77 0 2023-01-04T18:17:00.205 INFO:tasks.workunit.client.0.smithi050.stdout:8/337: write d3/d2a/d30/d3b/d53/f54 [100775,63342] 0 2023-01-04T18:17:00.206 INFO:tasks.workunit.client.0.smithi050.stdout:0/272: symlink d0/d6/d28/d1a/l54 0 2023-01-04T18:17:00.206 INFO:tasks.workunit.client.0.smithi050.stdout:8/338: write d3/d5/f1d [674618,30177] 0 2023-01-04T18:17:00.206 INFO:tasks.workunit.client.0.smithi050.stdout:8/339: stat d3/d2a/d27/c34 0 2023-01-04T18:17:00.212 INFO:tasks.workunit.client.0.smithi050.stdout:4/308: link d14/d1b/d32/c4c d14/d1b/d1f/d22/d3e/d44/d59/d5f/c62 0 2023-01-04T18:17:00.213 INFO:tasks.workunit.client.0.smithi050.stdout:3/328: truncate d0/d1b/d2f/d31/d60/f25 1614657 0 2023-01-04T18:17:00.213 INFO:tasks.workunit.client.0.smithi050.stdout:3/329: chown d0/d1b/d2f/d31/f66 61857 1 2023-01-04T18:17:00.217 INFO:tasks.workunit.client.0.smithi050.stdout:1/269: truncate f6 3067062 0 2023-01-04T18:17:00.217 INFO:tasks.workunit.client.0.smithi050.stdout:1/270: fsync d8/d14/f46 0 2023-01-04T18:17:00.220 INFO:tasks.workunit.client.0.smithi050.stdout:7/357: rename d6/d1d/d1f/c47 to d6/db/d15/c7e 0 2023-01-04T18:17:00.220 INFO:tasks.workunit.client.0.smithi050.stdout:7/358: chown d6/db/d3a/c51 17816397 1 2023-01-04T18:17:00.220 INFO:tasks.workunit.client.0.smithi050.stdout:7/359: readlink d6/db/l18 0 2023-01-04T18:17:00.221 INFO:tasks.workunit.client.0.smithi050.stdout:2/295: mknod d1/dd/d28/d2c/d2e/d36/c60 0 2023-01-04T18:17:00.221 INFO:tasks.workunit.client.0.smithi050.stdout:2/296: chown d1/c13 55649 1 2023-01-04T18:17:00.222 INFO:tasks.workunit.client.0.smithi050.stdout:8/340: creat d3/d2a/d30/d3b/d4d/d23/d31/f78 x:0 0 0 2023-01-04T18:17:00.223 INFO:tasks.workunit.client.0.smithi050.stdout:0/273: dwrite d0/d6/d8/f48 [0,4194304] 0 2023-01-04T18:17:00.224 INFO:tasks.workunit.client.0.smithi050.stdout:4/309: mkdir d14/d1b/d1f/d63 0 2023-01-04T18:17:00.228 INFO:tasks.workunit.client.0.smithi050.stdout:3/330: mknod d0/d1b/d2f/c6e 0 2023-01-04T18:17:00.229 INFO:tasks.workunit.client.0.smithi050.stdout:1/271: truncate d8/d14/d1d/f33 274924 0 2023-01-04T18:17:00.232 INFO:tasks.workunit.client.0.smithi050.stdout:1/272: dread d8/d14/d1c/d28/f3f [0,4194304] 0 2023-01-04T18:17:00.233 INFO:tasks.workunit.client.0.smithi050.stdout:5/469: rename d13/d15/d17/f1b to d13/d28/fa4 0 2023-01-04T18:17:00.234 INFO:tasks.workunit.client.0.smithi050.stdout:2/297: creat d1/dd/d11/d14/d39/f61 x:0 0 0 2023-01-04T18:17:00.240 INFO:tasks.workunit.client.0.smithi050.stdout:8/341: creat d3/d2a/d30/d3b/f79 x:0 0 0 2023-01-04T18:17:00.245 INFO:tasks.workunit.client.0.smithi050.stdout:0/274: creat d0/d6/f55 x:0 0 0 2023-01-04T18:17:00.247 INFO:tasks.workunit.client.0.smithi050.stdout:4/310: mknod d14/d1b/d1f/c64 0 2023-01-04T18:17:00.249 INFO:tasks.workunit.client.0.smithi050.stdout:3/331: mknod d0/dd/c6f 0 2023-01-04T18:17:00.250 INFO:tasks.workunit.client.0.smithi050.stdout:1/273: creat d8/d14/d1d/d3a/d58/f5a x:0 0 0 2023-01-04T18:17:00.250 INFO:tasks.workunit.client.0.smithi050.stdout:3/332: read d0/d1b/d2f/d31/f50 [1736735,16257] 0 2023-01-04T18:17:00.251 INFO:tasks.workunit.client.0.smithi050.stdout:5/470: dwrite d13/d15/d17/d27/d46/d4e/f37 [0,4194304] 0 2023-01-04T18:17:00.252 INFO:tasks.workunit.client.0.smithi050.stdout:7/360: rename d6/d1d/f73 to d6/db/d20/d55/f7f 0 2023-01-04T18:17:00.253 INFO:tasks.workunit.client.0.smithi050.stdout:2/298: mkdir d1/dd/d62 0 2023-01-04T18:17:00.253 INFO:tasks.workunit.client.0.smithi050.stdout:2/299: chown d1/d19/f5f 309114 1 2023-01-04T18:17:00.255 INFO:tasks.workunit.client.0.smithi050.stdout:8/342: mkdir d3/d2a/d30/d3b/d4d/d1b/d7a 0 2023-01-04T18:17:00.256 INFO:tasks.workunit.client.0.smithi050.stdout:4/311: write d14/f15 [3519435,98528] 0 2023-01-04T18:17:00.260 INFO:tasks.workunit.client.0.smithi050.stdout:1/274: getdents d8/d14/d1d/d3a/d23 0 2023-01-04T18:17:00.261 INFO:tasks.workunit.client.0.smithi050.stdout:3/333: creat d0/d10/f70 x:0 0 0 2023-01-04T18:17:00.269 INFO:tasks.workunit.client.0.smithi050.stdout:5/471: creat d13/fa5 x:0 0 0 2023-01-04T18:17:00.270 INFO:tasks.workunit.client.0.smithi050.stdout:5/472: truncate d13/d15/d17/d1f/d35/d42/f6f 222923 0 2023-01-04T18:17:00.270 INFO:tasks.workunit.client.0.smithi050.stdout:7/361: mkdir d6/d1d/d1f/d80 0 2023-01-04T18:17:00.271 INFO:tasks.workunit.client.0.smithi050.stdout:2/300: creat d1/dd/d28/d2c/f63 x:0 0 0 2023-01-04T18:17:00.271 INFO:tasks.workunit.client.0.smithi050.stdout:2/301: fsync d1/f15 0 2023-01-04T18:17:00.272 INFO:tasks.workunit.client.0.smithi050.stdout:2/302: fsync d1/dd/d11/d12/f59 0 2023-01-04T18:17:00.272 INFO:tasks.workunit.client.0.smithi050.stdout:8/343: link d3/d2a/d60/l58 d3/d2a/d30/d3b/d4d/d23/d55/d5f/l7b 0 2023-01-04T18:17:00.273 INFO:tasks.workunit.client.0.smithi050.stdout:4/312: link d14/f18 d14/f65 0 2023-01-04T18:17:00.274 INFO:tasks.workunit.client.0.smithi050.stdout:4/313: write d14/d1b/d32/f35 [677794,67419] 0 2023-01-04T18:17:00.274 INFO:tasks.workunit.client.0.smithi050.stdout:4/314: write fe [2596052,92580] 0 2023-01-04T18:17:00.274 INFO:tasks.workunit.client.0.smithi050.stdout:0/275: dwrite d0/d6/f26 [0,4194304] 0 2023-01-04T18:17:00.274 INFO:tasks.workunit.client.0.smithi050.stdout:1/275: creat d8/d14/f5b x:0 0 0 2023-01-04T18:17:00.277 INFO:tasks.workunit.client.0.smithi050.stdout:3/334: mkdir d0/d1b/d2f/d71 0 2023-01-04T18:17:00.277 INFO:tasks.workunit.client.0.smithi050.stdout:3/335: chown d0/d10/l3c 430591429 1 2023-01-04T18:17:00.277 INFO:tasks.workunit.client.0.smithi050.stdout:3/336: truncate d0/d1a/f24 5239156 0 2023-01-04T18:17:00.278 INFO:tasks.workunit.client.0.smithi050.stdout:5/473: rmdir d13/d15/d63 39 2023-01-04T18:17:00.279 INFO:tasks.workunit.client.0.smithi050.stdout:3/337: dread d0/d1b/f23 [0,4194304] 0 2023-01-04T18:17:00.279 INFO:tasks.workunit.client.0.smithi050.stdout:7/362: truncate d6/f31 912594 0 2023-01-04T18:17:00.283 INFO:tasks.workunit.client.0.smithi050.stdout:8/344: symlink d3/d2a/d30/d3b/d4d/d23/d55/l7c 0 2023-01-04T18:17:00.283 INFO:tasks.workunit.client.0.smithi050.stdout:8/345: dread - d3/d2a/d30/d3b/d4d/d23/d31/f78 zero size 2023-01-04T18:17:00.283 INFO:tasks.workunit.client.0.smithi050.stdout:8/346: fsync d3/d2a/d30/d3b/d4d/d23/d55/f57 0 2023-01-04T18:17:00.290 INFO:tasks.workunit.client.0.smithi050.stdout:6/280: sync 2023-01-04T18:17:00.291 INFO:tasks.workunit.client.0.smithi050.stdout:0/276: getdents d0 0 2023-01-04T18:17:00.309 INFO:tasks.workunit.client.0.smithi050.stdout:4/315: dwrite d14/d1b/d32/f3f [0,4194304] 0 2023-01-04T18:17:00.309 INFO:tasks.workunit.client.0.smithi050.stdout:4/316: read fd [303070,37001] 0 2023-01-04T18:17:00.309 INFO:tasks.workunit.client.0.smithi050.stdout:4/317: chown l1 0 1 2023-01-04T18:17:00.310 INFO:tasks.workunit.client.0.smithi050.stdout:4/318: dread - d14/d1b/d1f/d22/f34 zero size 2023-01-04T18:17:00.310 INFO:tasks.workunit.client.0.smithi050.stdout:4/319: chown d14/d1b/d1f/f27 2 1 2023-01-04T18:17:00.312 INFO:tasks.workunit.client.0.smithi050.stdout:1/276: dwrite d8/f11 [4194304,4194304] 0 2023-01-04T18:17:00.319 INFO:tasks.workunit.client.0.smithi050.stdout:7/363: dwrite d6/d28/f2c [4194304,4194304] 0 2023-01-04T18:17:00.321 INFO:tasks.workunit.client.0.smithi050.stdout:1/277: dread d8/d14/f30 [0,4194304] 0 2023-01-04T18:17:00.322 INFO:tasks.workunit.client.0.smithi050.stdout:1/278: read d8/f11 [467975,58909] 0 2023-01-04T18:17:00.322 INFO:tasks.workunit.client.0.smithi050.stdout:1/279: getdents d8/d14/d1c/d28/d57 0 2023-01-04T18:17:00.322 INFO:tasks.workunit.client.0.smithi050.stdout:6/281: dwrite d0/f14 [0,4194304] 0 2023-01-04T18:17:00.322 INFO:tasks.workunit.client.0.smithi050.stdout:6/282: chown d0/d9/cc 3 1 2023-01-04T18:17:00.343 INFO:tasks.workunit.client.0.smithi050.stdout:5/474: symlink d13/d15/d96/la6 0 2023-01-04T18:17:00.344 INFO:tasks.workunit.client.0.smithi050.stdout:3/338: creat d0/d1b/d2f/d31/f72 x:0 0 0 2023-01-04T18:17:00.345 INFO:tasks.workunit.client.0.smithi050.stdout:2/303: dread d1/dd/d28/d2c/d2e/d36/f51 [0,4194304] 0 2023-01-04T18:17:00.345 INFO:tasks.workunit.client.0.smithi050.stdout:2/304: chown d1/dd/d28 49 1 2023-01-04T18:17:00.345 INFO:tasks.workunit.client.0.smithi050.stdout:2/305: dread - d1/dd/d28/d2c/f45 zero size 2023-01-04T18:17:00.349 INFO:tasks.workunit.client.0.smithi050.stdout:9/335: sync 2023-01-04T18:17:00.351 INFO:tasks.workunit.client.0.smithi050.stdout:0/277: mknod d0/d6/d8/d4f/c56 0 2023-01-04T18:17:00.351 INFO:tasks.workunit.client.0.smithi050.stdout:0/278: chown d0/d6/d8/d25/d3e/l4e 1574 1 2023-01-04T18:17:00.354 INFO:tasks.workunit.client.0.smithi050.stdout:4/320: mkdir d14/d1b/d66 0 2023-01-04T18:17:00.354 INFO:tasks.workunit.client.0.smithi050.stdout:4/321: chown d14/l16 36198441 1 2023-01-04T18:17:00.354 INFO:tasks.workunit.client.0.smithi050.stdout:4/322: fsync f0 0 2023-01-04T18:17:00.354 INFO:tasks.workunit.client.0.smithi050.stdout:4/323: dread - d14/d1b/f1e zero size 2023-01-04T18:17:00.367 INFO:tasks.workunit.client.0.smithi050.stdout:1/280: mkdir d8/d48/d5c 0 2023-01-04T18:17:00.369 INFO:tasks.workunit.client.0.smithi050.stdout:6/283: link d0/c4 d0/d9/d25/c5f 0 2023-01-04T18:17:00.381 INFO:tasks.workunit.client.0.smithi050.stdout:5/475: getdents d13/d15/d17/d27/d46/d4e/d4d 0 2023-01-04T18:17:00.381 INFO:tasks.workunit.client.0.smithi050.stdout:5/476: chown d13/d15/d17/d1f/f30 1708 1 2023-01-04T18:17:00.381 INFO:tasks.workunit.client.0.smithi050.stdout:5/477: stat d13/c23 0 2023-01-04T18:17:00.381 INFO:tasks.workunit.client.0.smithi050.stdout:5/478: chown d13/d28/d7c/f8d 314108491 1 2023-01-04T18:17:00.387 INFO:tasks.workunit.client.0.smithi050.stdout:3/339: creat d0/d1b/d2f/d56/d32/f73 x:0 0 0 2023-01-04T18:17:00.389 INFO:tasks.workunit.client.0.smithi050.stdout:2/306: creat d1/dd/d28/d2c/d2e/d3f/f64 x:0 0 0 2023-01-04T18:17:00.389 INFO:tasks.workunit.client.0.smithi050.stdout:2/307: fdatasync d1/dd/d11/d14/d39/f61 0 2023-01-04T18:17:00.389 INFO:tasks.workunit.client.0.smithi050.stdout:2/308: write d1/dd/d11/f54 [549146,90914] 0 2023-01-04T18:17:00.390 INFO:tasks.workunit.client.0.smithi050.stdout:2/309: readlink d1/dd/d28/l2f 0 2023-01-04T18:17:00.393 INFO:tasks.workunit.client.0.smithi050.stdout:0/279: symlink d0/d6/d8/d4f/l57 0 2023-01-04T18:17:00.394 INFO:tasks.workunit.client.0.smithi050.stdout:4/324: creat d14/d1b/d1f/d22/f67 x:0 0 0 2023-01-04T18:17:00.394 INFO:tasks.workunit.client.0.smithi050.stdout:4/325: readlink d14/l28 0 2023-01-04T18:17:00.395 INFO:tasks.workunit.client.0.smithi050.stdout:0/280: read d0/d6/f3c [7068358,110416] 0 2023-01-04T18:17:00.395 INFO:tasks.workunit.client.0.smithi050.stdout:7/364: mkdir d6/d1d/d81 0 2023-01-04T18:17:00.397 INFO:tasks.workunit.client.0.smithi050.stdout:1/281: creat d8/d14/d1c/f5d x:0 0 0 2023-01-04T18:17:00.397 INFO:tasks.workunit.client.0.smithi050.stdout:1/282: write f6 [3113727,53012] 0 2023-01-04T18:17:00.398 INFO:tasks.workunit.client.0.smithi050.stdout:6/284: unlink d0/d9/d38/c21 0 2023-01-04T18:17:00.401 INFO:tasks.workunit.client.0.smithi050.stdout:5/479: rename d13/d15/d17/d27/d44/f45 to d13/d15/d17/d8f/fa7 0 2023-01-04T18:17:00.403 INFO:tasks.workunit.client.0.smithi050.stdout:3/340: link d0/f40 d0/d1b/d2f/f74 0 2023-01-04T18:17:00.404 INFO:tasks.workunit.client.0.smithi050.stdout:2/310: rmdir d1/dd/d28/d2c/d2e 39 2023-01-04T18:17:00.406 INFO:tasks.workunit.client.0.smithi050.stdout:9/336: symlink d1/d3/d11/l6c 0 2023-01-04T18:17:00.406 INFO:tasks.workunit.client.0.smithi050.stdout:9/337: stat d1/d12/d2d/d39/l3c 0 2023-01-04T18:17:00.408 INFO:tasks.workunit.client.0.smithi050.stdout:4/326: creat d14/d1b/d1f/d22/d3e/d44/f68 x:0 0 0 2023-01-04T18:17:00.408 INFO:tasks.workunit.client.0.smithi050.stdout:4/327: chown d14/d1b/d1f/d22/f4d 222585 1 2023-01-04T18:17:00.411 INFO:tasks.workunit.client.0.smithi050.stdout:0/281: link d0/d6/f3c d0/d6/f58 0 2023-01-04T18:17:00.411 INFO:tasks.workunit.client.0.smithi050.stdout:0/282: truncate d0/d6/d28/f49 1043844 0 2023-01-04T18:17:00.411 INFO:tasks.workunit.client.0.smithi050.stdout:0/283: fdatasync d0/d6/d8/f48 0 2023-01-04T18:17:00.412 INFO:tasks.workunit.client.0.smithi050.stdout:7/365: mkdir d6/db/d20/d55/d82 0 2023-01-04T18:17:00.413 INFO:tasks.workunit.client.0.smithi050.stdout:1/283: creat d8/d48/d5c/f5e x:0 0 0 2023-01-04T18:17:00.420 INFO:tasks.workunit.client.0.smithi050.stdout:5/480: rename d13/d15/d17/d1f/d35/d42/d9d to d13/d15/d17/d27/da8 0 2023-01-04T18:17:00.421 INFO:tasks.workunit.client.0.smithi050.stdout:4/328: dread d14/d1b/d1f/d22/f54 [0,4194304] 0 2023-01-04T18:17:00.421 INFO:tasks.workunit.client.0.smithi050.stdout:4/329: dread - d14/d1b/f1e zero size 2023-01-04T18:17:00.421 INFO:tasks.workunit.client.0.smithi050.stdout:4/330: chown d14/d1b/d1f/l36 7842625 1 2023-01-04T18:17:00.424 INFO:tasks.workunit.client.0.smithi050.stdout:3/341: symlink d0/d1b/d2f/d31/d60/l75 0 2023-01-04T18:17:00.424 INFO:tasks.workunit.client.0.smithi050.stdout:0/284: creat d0/f59 x:0 0 0 2023-01-04T18:17:00.425 INFO:tasks.workunit.client.0.smithi050.stdout:0/285: dread - d0/f53 zero size 2023-01-04T18:17:00.425 INFO:tasks.workunit.client.0.smithi050.stdout:6/285: dwrite d0/f14 [0,4194304] 0 2023-01-04T18:17:00.426 INFO:tasks.workunit.client.0.smithi050.stdout:9/338: dwrite d1/d3/d3b/d63/f3d [0,4194304] 0 2023-01-04T18:17:00.426 INFO:tasks.workunit.client.0.smithi050.stdout:7/366: creat d6/d28/d32/f83 x:0 0 0 2023-01-04T18:17:00.431 INFO:tasks.workunit.client.0.smithi050.stdout:4/331: rename d14/l2c to d14/d1b/d66/l69 0 2023-01-04T18:17:00.435 INFO:tasks.workunit.client.0.smithi050.stdout:0/286: mknod d0/d6/d8/d25/d3e/c5a 0 2023-01-04T18:17:00.435 INFO:tasks.workunit.client.0.smithi050.stdout:0/287: dread - d0/f59 zero size 2023-01-04T18:17:00.435 INFO:tasks.workunit.client.0.smithi050.stdout:0/288: write d0/d6/f55 [539215,96677] 0 2023-01-04T18:17:00.438 INFO:tasks.workunit.client.0.smithi050.stdout:4/332: mkdir d14/d1b/d1f/d22/d6a 0 2023-01-04T18:17:00.438 INFO:tasks.workunit.client.0.smithi050.stdout:4/333: dread - d14/d1b/d1f/d22/d3e/d44/f68 zero size 2023-01-04T18:17:00.438 INFO:tasks.workunit.client.0.smithi050.stdout:4/334: fsync d14/d1b/d1f/d22/f4e 0 2023-01-04T18:17:00.440 INFO:tasks.workunit.client.0.smithi050.stdout:1/284: dwrite d8/d14/f30 [0,4194304] 0 2023-01-04T18:17:00.440 INFO:tasks.workunit.client.0.smithi050.stdout:0/289: getdents d0/d6/d28 0 2023-01-04T18:17:00.441 INFO:tasks.workunit.client.0.smithi050.stdout:0/290: write d0/d6/d28/d1a/f30 [214848,102152] 0 2023-01-04T18:17:00.442 INFO:tasks.workunit.client.0.smithi050.stdout:4/335: rename d14/d1b/d1f/f5b to d14/d1b/d1f/d22/d6a/f6b 0 2023-01-04T18:17:00.443 INFO:tasks.workunit.client.0.smithi050.stdout:4/336: chown d14/d1b/d1f/d22/d3e/c56 2 1 2023-01-04T18:17:00.443 INFO:tasks.workunit.client.0.smithi050.stdout:6/286: dread d0/d9/df/f30 [4194304,4194304] 0 2023-01-04T18:17:00.443 INFO:tasks.workunit.client.0.smithi050.stdout:0/291: write d0/f4 [6120088,98818] 0 2023-01-04T18:17:00.444 INFO:tasks.workunit.client.0.smithi050.stdout:2/311: dwrite d1/dd/d28/d2c/d2e/f40 [0,4194304] 0 2023-01-04T18:17:00.445 INFO:tasks.workunit.client.0.smithi050.stdout:1/285: symlink d8/d48/l5f 0 2023-01-04T18:17:00.446 INFO:tasks.workunit.client.0.smithi050.stdout:6/287: mkdir d0/d9/d38/d60 0 2023-01-04T18:17:00.446 INFO:tasks.workunit.client.0.smithi050.stdout:6/288: truncate d0/f14 4422700 0 2023-01-04T18:17:00.448 INFO:tasks.workunit.client.0.smithi050.stdout:4/337: write d14/d1b/d32/f45 [1563202,79027] 0 2023-01-04T18:17:00.451 INFO:tasks.workunit.client.0.smithi050.stdout:5/481: dwrite d13/d15/d17/d1f/d35/d59/f95 [0,4194304] 0 2023-01-04T18:17:00.452 INFO:tasks.workunit.client.0.smithi050.stdout:5/482: truncate d13/d15/d17/d1f/f53 137359 0 2023-01-04T18:17:00.453 INFO:tasks.workunit.client.0.smithi050.stdout:2/312: creat d1/dd/d11/f65 x:0 0 0 2023-01-04T18:17:00.453 INFO:tasks.workunit.client.0.smithi050.stdout:2/313: chown d1/dd/d11/d1e/f22 132 1 2023-01-04T18:17:00.453 INFO:tasks.workunit.client.0.smithi050.stdout:2/314: chown d1/dd/d28/d2c/f4f 461619 1 2023-01-04T18:17:00.453 INFO:tasks.workunit.client.0.smithi050.stdout:2/315: truncate d1/d10/f4e 933462 0 2023-01-04T18:17:00.454 INFO:tasks.workunit.client.0.smithi050.stdout:5/483: write d13/f19 [1391996,39226] 0 2023-01-04T18:17:00.454 INFO:tasks.workunit.client.0.smithi050.stdout:3/342: dwrite d0/d1b/d2f/d56/d32/f73 [0,4194304] 0 2023-01-04T18:17:00.455 INFO:tasks.workunit.client.0.smithi050.stdout:0/292: dread d0/d6/f26 [0,4194304] 0 2023-01-04T18:17:00.455 INFO:tasks.workunit.client.0.smithi050.stdout:6/289: mknod d0/d5c/d5d/c61 0 2023-01-04T18:17:00.459 INFO:tasks.workunit.client.0.smithi050.stdout:9/339: dwrite d1/d12/d41/f4a [0,4194304] 0 2023-01-04T18:17:00.460 INFO:tasks.workunit.client.0.smithi050.stdout:7/367: dwrite d6/f23 [0,4194304] 0 2023-01-04T18:17:00.465 INFO:tasks.workunit.client.0.smithi050.stdout:5/484: mkdir d13/d15/d17/d27/d46/d4e/d4d/da9 0 2023-01-04T18:17:00.470 INFO:tasks.workunit.client.0.smithi050.stdout:1/286: rename d8/d14/d1c/d28/f41 to d8/f60 0 2023-01-04T18:17:00.473 INFO:tasks.workunit.client.0.smithi050.stdout:2/316: dwrite d1/dd/d11/f27 [4194304,4194304] 0 2023-01-04T18:17:00.473 INFO:tasks.workunit.client.0.smithi050.stdout:1/287: read d8/f11 [7891248,16552] 0 2023-01-04T18:17:00.474 INFO:tasks.workunit.client.0.smithi050.stdout:9/340: dread d1/d3/d11/d1f/f21 [0,4194304] 0 2023-01-04T18:17:00.480 INFO:tasks.workunit.client.0.smithi050.stdout:3/343: mkdir d0/d1b/d2f/d76 0 2023-01-04T18:17:00.480 INFO:tasks.workunit.client.0.smithi050.stdout:3/344: fsync d0/f3 0 2023-01-04T18:17:00.481 INFO:tasks.workunit.client.0.smithi050.stdout:3/345: chown d0/d1b/d2f/l51 6099 1 2023-01-04T18:17:00.487 INFO:tasks.workunit.client.0.smithi050.stdout:0/293: mknod d0/d6/d8/d51/c5b 0 2023-01-04T18:17:00.490 INFO:tasks.workunit.client.0.smithi050.stdout:4/338: dwrite fc [0,4194304] 0 2023-01-04T18:17:00.491 INFO:tasks.workunit.client.0.smithi050.stdout:7/368: dwrite d6/db/d15/d1b/d22/f39 [0,4194304] 0 2023-01-04T18:17:00.491 INFO:tasks.workunit.client.0.smithi050.stdout:7/369: fdatasync d6/db/d3b/f4c 0 2023-01-04T18:17:00.494 INFO:tasks.workunit.client.0.smithi050.stdout:6/290: truncate d0/d9/f3b 204582 0 2023-01-04T18:17:00.494 INFO:tasks.workunit.client.0.smithi050.stdout:6/291: dread - d0/d9/d38/d1c/d54/f58 zero size 2023-01-04T18:17:00.502 INFO:tasks.workunit.client.0.smithi050.stdout:4/339: dwrite d14/d1b/d32/f3c [0,4194304] 0 2023-01-04T18:17:00.548 INFO:tasks.workunit.client.0.smithi050.stdout:2/317: mkdir d1/dd/d28/d2c/d66 0 2023-01-04T18:17:00.549 INFO:tasks.workunit.client.0.smithi050.stdout:2/318: write d1/dd/d11/d1e/f20 [200024,2832] 0 2023-01-04T18:17:00.549 INFO:tasks.workunit.client.0.smithi050.stdout:2/319: getdents d1/dd/d11/d1e/d4b 0 2023-01-04T18:17:00.552 INFO:tasks.workunit.client.0.smithi050.stdout:1/288: creat d8/d14/d1c/d28/d57/f61 x:0 0 0 2023-01-04T18:17:00.552 INFO:tasks.workunit.client.0.smithi050.stdout:1/289: truncate d8/d14/d1d/f50 5051994 0 2023-01-04T18:17:00.553 INFO:tasks.workunit.client.0.smithi050.stdout:8/347: sync 2023-01-04T18:17:00.553 INFO:tasks.workunit.client.0.smithi050.stdout:8/348: fsync d3/d2a/d27/f33 0 2023-01-04T18:17:00.559 INFO:tasks.workunit.client.0.smithi050.stdout:3/346: symlink d0/d1b/d2f/d76/l77 0 2023-01-04T18:17:00.560 INFO:tasks.workunit.client.0.smithi050.stdout:2/320: dread d1/dd/d28/d2c/d2e/f40 [0,4194304] 0 2023-01-04T18:17:00.562 INFO:tasks.workunit.client.0.smithi050.stdout:3/347: write d0/d1b/d2f/d31/f50 [3521741,112347] 0 2023-01-04T18:17:00.562 INFO:tasks.workunit.client.0.smithi050.stdout:3/348: truncate d0/d1b/d2f/d56/d32/f48 1417569 0 2023-01-04T18:17:00.565 INFO:tasks.workunit.client.0.smithi050.stdout:6/292: symlink d0/d9/d25/d4d/l62 0 2023-01-04T18:17:00.569 INFO:tasks.workunit.client.0.smithi050.stdout:4/340: link f13 d14/f6c 0 2023-01-04T18:17:00.569 INFO:tasks.workunit.client.0.smithi050.stdout:4/341: write d14/d1b/d1f/d22/f4e [4283898,94825] 0 2023-01-04T18:17:00.569 INFO:tasks.workunit.client.0.smithi050.stdout:4/342: chown d14/d1b/f2f 26353529 1 2023-01-04T18:17:00.570 INFO:tasks.workunit.client.0.smithi050.stdout:4/343: write f9 [5927600,101625] 0 2023-01-04T18:17:00.574 INFO:tasks.workunit.client.0.smithi050.stdout:6/293: dread d0/d9/d38/f15 [0,4194304] 0 2023-01-04T18:17:00.576 INFO:tasks.workunit.client.0.smithi050.stdout:8/349: truncate d3/f25 3237310 0 2023-01-04T18:17:00.577 INFO:tasks.workunit.client.0.smithi050.stdout:9/341: link d1/d12/d2d/d39/l52 d1/d3/d11/l6d 0 2023-01-04T18:17:00.578 INFO:tasks.workunit.client.0.smithi050.stdout:9/342: write d1/d12/d41/f4a [1088132,30369] 0 2023-01-04T18:17:00.581 INFO:tasks.workunit.client.0.smithi050.stdout:2/321: link d1/dd/d28/d2c/f4f d1/d41/f67 0 2023-01-04T18:17:00.583 INFO:tasks.workunit.client.0.smithi050.stdout:3/349: symlink d0/dd/l78 0 2023-01-04T18:17:00.583 INFO:tasks.workunit.client.0.smithi050.stdout:7/370: truncate f2 194502 0 2023-01-04T18:17:00.584 INFO:tasks.workunit.client.0.smithi050.stdout:1/290: dwrite d8/d14/f46 [0,4194304] 0 2023-01-04T18:17:00.586 INFO:tasks.workunit.client.0.smithi050.stdout:5/485: dwrite d13/d15/d17/d1f/f53 [0,4194304] 0 2023-01-04T18:17:00.586 INFO:tasks.workunit.client.0.smithi050.stdout:4/344: rename l1 to d14/d1b/d1f/l6d 0 2023-01-04T18:17:00.586 INFO:tasks.workunit.client.0.smithi050.stdout:1/291: dread d8/d14/d1d/f1e [0,4194304] 0 2023-01-04T18:17:00.591 INFO:tasks.workunit.client.0.smithi050.stdout:6/294: truncate d0/d9/df/f22 2416935 0 2023-01-04T18:17:00.596 INFO:tasks.workunit.client.0.smithi050.stdout:9/343: creat d1/d3/d24/f6e x:0 0 0 2023-01-04T18:17:00.598 INFO:tasks.workunit.client.0.smithi050.stdout:2/322: mkdir d1/d41/d68 0 2023-01-04T18:17:00.603 INFO:tasks.workunit.client.0.smithi050.stdout:4/345: dwrite d14/d1b/d32/f45 [0,4194304] 0 2023-01-04T18:17:00.606 INFO:tasks.workunit.client.0.smithi050.stdout:3/350: mknod d0/c79 0 2023-01-04T18:17:00.607 INFO:tasks.workunit.client.0.smithi050.stdout:7/371: getdents d6/db/d20/d55 0 2023-01-04T18:17:00.620 INFO:tasks.workunit.client.0.smithi050.stdout:7/372: write d6/db/d15/d1b/d22/f39 [3646103,32874] 0 2023-01-04T18:17:00.620 INFO:tasks.workunit.client.0.smithi050.stdout:7/373: chown f2 13460366 1 2023-01-04T18:17:00.624 INFO:tasks.workunit.client.0.smithi050.stdout:5/486: mknod d13/d15/d96/caa 0 2023-01-04T18:17:00.624 INFO:tasks.workunit.client.0.smithi050.stdout:1/292: stat d8/d14/d1d/c54 0 2023-01-04T18:17:00.626 INFO:tasks.workunit.client.0.smithi050.stdout:6/295: creat d0/d9/d38/d1c/d54/f63 x:0 0 0 2023-01-04T18:17:00.627 INFO:tasks.workunit.client.0.smithi050.stdout:9/344: truncate d1/d3/d24/f55 47191 0 2023-01-04T18:17:00.630 INFO:tasks.workunit.client.0.smithi050.stdout:3/351: mknod d0/d1b/d2f/d76/c7a 0 2023-01-04T18:17:00.631 INFO:tasks.workunit.client.0.smithi050.stdout:4/346: dwrite d14/d1b/d1f/f4a [0,4194304] 0 2023-01-04T18:17:00.634 INFO:tasks.workunit.client.0.smithi050.stdout:7/374: rename d6/db/d15/d2e/f2f to d6/db/d3a/f84 0 2023-01-04T18:17:00.635 INFO:tasks.workunit.client.0.smithi050.stdout:2/323: dwrite d1/f15 [4194304,4194304] 0 2023-01-04T18:17:00.635 INFO:tasks.workunit.client.0.smithi050.stdout:2/324: truncate d1/dd/d28/d2c/f45 852388 0 2023-01-04T18:17:00.635 INFO:tasks.workunit.client.0.smithi050.stdout:2/325: read - d1/dd/d11/d12/f4d zero size 2023-01-04T18:17:00.636 INFO:tasks.workunit.client.0.smithi050.stdout:2/326: read d1/dd/d11/d14/f23 [1175658,73802] 0 2023-01-04T18:17:00.637 INFO:tasks.workunit.client.0.smithi050.stdout:6/296: creat d0/d9/d25/f64 x:0 0 0 2023-01-04T18:17:00.638 INFO:tasks.workunit.client.0.smithi050.stdout:8/350: dwrite d3/f25 [0,4194304] 0 2023-01-04T18:17:00.638 INFO:tasks.workunit.client.0.smithi050.stdout:8/351: fdatasync d3/f68 0 2023-01-04T18:17:00.639 INFO:tasks.workunit.client.0.smithi050.stdout:1/293: dread d8/d14/f46 [0,4194304] 0 2023-01-04T18:17:00.640 INFO:tasks.workunit.client.0.smithi050.stdout:3/352: creat d0/d1b/d2f/d71/f7b x:0 0 0 2023-01-04T18:17:00.640 INFO:tasks.workunit.client.0.smithi050.stdout:3/353: fdatasync d0/d1b/d2f/d31/d60/f39 0 2023-01-04T18:17:00.640 INFO:tasks.workunit.client.0.smithi050.stdout:3/354: write d0/f40 [4247976,102136] 0 2023-01-04T18:17:00.640 INFO:tasks.workunit.client.0.smithi050.stdout:7/375: write d6/db/d15/f36 [6443563,38962] 0 2023-01-04T18:17:00.641 INFO:tasks.workunit.client.0.smithi050.stdout:8/352: read d3/d2a/f18 [1155618,96346] 0 2023-01-04T18:17:00.641 INFO:tasks.workunit.client.0.smithi050.stdout:4/347: symlink d14/d1b/d1f/d63/l6e 0 2023-01-04T18:17:00.643 INFO:tasks.workunit.client.0.smithi050.stdout:5/487: rename d13/d15/d96/caa to d13/d15/d17/d27/cab 0 2023-01-04T18:17:00.643 INFO:tasks.workunit.client.0.smithi050.stdout:9/345: dwrite d1/d12/d2d/d39/f4d [0,4194304] 0 2023-01-04T18:17:00.646 INFO:tasks.workunit.client.0.smithi050.stdout:2/327: mkdir d1/dd/d62/d69 0 2023-01-04T18:17:00.648 INFO:tasks.workunit.client.0.smithi050.stdout:6/297: creat d0/f65 x:0 0 0 2023-01-04T18:17:00.648 INFO:tasks.workunit.client.0.smithi050.stdout:6/298: dread - d0/d9/d25/d4d/f5a zero size 2023-01-04T18:17:00.654 INFO:tasks.workunit.client.0.smithi050.stdout:1/294: symlink d8/d14/d1d/d3a/d58/l62 0 2023-01-04T18:17:00.656 INFO:tasks.workunit.client.0.smithi050.stdout:3/355: symlink d0/dd/d45/l7c 0 2023-01-04T18:17:00.659 INFO:tasks.workunit.client.0.smithi050.stdout:7/376: creat d6/db/d15/d1b/d70/f85 x:0 0 0 2023-01-04T18:17:00.662 INFO:tasks.workunit.client.0.smithi050.stdout:8/353: creat d3/d2a/d30/d3b/d4d/d1b/f7d x:0 0 0 2023-01-04T18:17:00.662 INFO:tasks.workunit.client.0.smithi050.stdout:8/354: fsync d3/d2a/f6e 0 2023-01-04T18:17:00.665 INFO:tasks.workunit.client.0.smithi050.stdout:4/348: mkdir d14/d1b/d1f/d22/d3e/d44/d59/d5f/d6f 0 2023-01-04T18:17:00.665 INFO:tasks.workunit.client.0.smithi050.stdout:9/346: dwrite d1/d3/d11/d1f/f69 [0,4194304] 0 2023-01-04T18:17:00.666 INFO:tasks.workunit.client.0.smithi050.stdout:4/349: write f7 [2839310,66314] 0 2023-01-04T18:17:00.666 INFO:tasks.workunit.client.0.smithi050.stdout:4/350: truncate d14/f65 3397479 0 2023-01-04T18:17:00.666 INFO:tasks.workunit.client.0.smithi050.stdout:9/347: write d1/d12/f22 [3779006,1935] 0 2023-01-04T18:17:00.667 INFO:tasks.workunit.client.0.smithi050.stdout:5/488: rename d13/d15/d17/d27/f6c to d13/d15/d66/fac 0 2023-01-04T18:17:00.676 INFO:tasks.workunit.client.0.smithi050.stdout:2/328: link d1/d41/c47 d1/dd/d28/d2c/c6a 0 2023-01-04T18:17:00.676 INFO:tasks.workunit.client.0.smithi050.stdout:2/329: fsync d1/dd/d11/d14/d39/f61 0 2023-01-04T18:17:00.677 INFO:tasks.workunit.client.0.smithi050.stdout:2/330: write d1/dd/d11/f27 [7001143,39322] 0 2023-01-04T18:17:00.678 INFO:tasks.workunit.client.0.smithi050.stdout:6/299: creat d0/d9/d25/d4d/f66 x:0 0 0 2023-01-04T18:17:00.678 INFO:tasks.workunit.client.0.smithi050.stdout:6/300: read - d0/d9/d25/d4d/f5a zero size 2023-01-04T18:17:00.678 INFO:tasks.workunit.client.0.smithi050.stdout:2/331: read d1/dd/d11/d14/f50 [312584,19821] 0 2023-01-04T18:17:00.679 INFO:tasks.workunit.client.0.smithi050.stdout:1/295: creat d8/d14/f63 x:0 0 0 2023-01-04T18:17:00.679 INFO:tasks.workunit.client.0.smithi050.stdout:1/296: write d8/f13 [2235358,24061] 0 2023-01-04T18:17:00.682 INFO:tasks.workunit.client.0.smithi050.stdout:3/356: mknod d0/d1b/d2f/d56/d3f/c7d 0 2023-01-04T18:17:00.685 INFO:tasks.workunit.client.0.smithi050.stdout:7/377: creat d6/db/d20/f86 x:0 0 0 2023-01-04T18:17:00.685 INFO:tasks.workunit.client.0.smithi050.stdout:7/378: truncate d6/d28/d3c/d42/f56 737854 0 2023-01-04T18:17:00.686 INFO:tasks.workunit.client.0.smithi050.stdout:8/355: mkdir d3/d5/d7e 0 2023-01-04T18:17:00.690 INFO:tasks.workunit.client.0.smithi050.stdout:4/351: mknod d14/d1b/d32/c70 0 2023-01-04T18:17:00.691 INFO:tasks.workunit.client.0.smithi050.stdout:9/348: mkdir d1/d6f 0 2023-01-04T18:17:00.691 INFO:tasks.workunit.client.0.smithi050.stdout:9/349: chown d1/d3/f5c 20821 1 2023-01-04T18:17:00.691 INFO:tasks.workunit.client.0.smithi050.stdout:9/350: dread - d1/d12/d2d/d39/f66 zero size 2023-01-04T18:17:00.694 INFO:tasks.workunit.client.0.smithi050.stdout:5/489: mkdir d13/d15/d96/dad 0 2023-01-04T18:17:00.694 INFO:tasks.workunit.client.0.smithi050.stdout:2/332: dwrite d1/dd/d11/d14/f23 [0,4194304] 0 2023-01-04T18:17:00.701 INFO:tasks.workunit.client.0.smithi050.stdout:6/301: mknod d0/d4a/c67 0 2023-01-04T18:17:00.702 INFO:tasks.workunit.client.0.smithi050.stdout:6/302: readlink d0/d9/l3c 0 2023-01-04T18:17:00.702 INFO:tasks.workunit.client.0.smithi050.stdout:6/303: chown d0/c2c 224 1 2023-01-04T18:17:00.704 INFO:tasks.workunit.client.0.smithi050.stdout:1/297: rename d8/fe to d8/d14/d1d/d3a/d31/f64 0 2023-01-04T18:17:00.704 INFO:tasks.workunit.client.0.smithi050.stdout:1/298: stat d8/f11 0 2023-01-04T18:17:00.704 INFO:tasks.workunit.client.0.smithi050.stdout:1/299: chown d8/d14/d1c/d28/d57/f61 30135 1 2023-01-04T18:17:00.704 INFO:tasks.workunit.client.0.smithi050.stdout:1/300: fdatasync d8/d14/d1c/d28/f3f 0 2023-01-04T18:17:00.715 INFO:tasks.workunit.client.0.smithi050.stdout:5/490: dwrite d13/d15/d17/d1f/d35/f65 [0,4194304] 0 2023-01-04T18:17:00.715 INFO:tasks.workunit.client.0.smithi050.stdout:5/491: truncate d13/d15/d17/d27/d46/d4e/f3c 1891848 0 2023-01-04T18:17:00.715 INFO:tasks.workunit.client.0.smithi050.stdout:5/492: dread - d13/d15/d17/d1f/d35/fa2 zero size 2023-01-04T18:17:00.724 INFO:tasks.workunit.client.0.smithi050.stdout:1/301: dwrite d8/d14/d1d/f1f [4194304,4194304] 0 2023-01-04T18:17:00.724 INFO:tasks.workunit.client.0.smithi050.stdout:1/302: truncate d8/d48/d5c/f5e 127495 0 2023-01-04T18:17:00.733 INFO:tasks.workunit.client.0.smithi050.stdout:5/493: dwrite d13/d15/d17/d1f/f97 [0,4194304] 0 2023-01-04T18:17:00.735 INFO:tasks.workunit.client.0.smithi050.stdout:1/303: dread d8/fd [4194304,4194304] 0 2023-01-04T18:17:00.735 INFO:tasks.workunit.client.0.smithi050.stdout:1/304: chown d8/d14/d1c/d28/d57/f61 47633248 1 2023-01-04T18:17:00.736 INFO:tasks.workunit.client.0.smithi050.stdout:1/305: read d8/f11 [1549341,101610] 0 2023-01-04T18:17:00.736 INFO:tasks.workunit.client.0.smithi050.stdout:1/306: chown d8/d14/d1c/f5d 2 1 2023-01-04T18:17:00.740 INFO:tasks.workunit.client.0.smithi050.stdout:3/357: creat d0/d1b/d2f/d31/f7e x:0 0 0 2023-01-04T18:17:00.741 INFO:tasks.workunit.client.0.smithi050.stdout:7/379: read d6/d28/d3c/d42/f56 [550114,76892] 0 2023-01-04T18:17:00.742 INFO:tasks.workunit.client.0.smithi050.stdout:8/356: mkdir d3/d2a/d30/d3b/d4d/d1b/d7f 0 2023-01-04T18:17:00.743 INFO:tasks.workunit.client.0.smithi050.stdout:4/352: link d14/d1b/d1f/d22/f42 d14/d1b/d1f/d63/f71 0 2023-01-04T18:17:00.746 INFO:tasks.workunit.client.0.smithi050.stdout:9/351: getdents d1/d12/d41/d60 0 2023-01-04T18:17:00.752 INFO:tasks.workunit.client.0.smithi050.stdout:9/352: dread d1/d3/f18 [0,4194304] 0 2023-01-04T18:17:00.753 INFO:tasks.workunit.client.0.smithi050.stdout:5/494: dwrite d13/d15/d17/d1f/d35/d42/f7a [0,4194304] 0 2023-01-04T18:17:00.758 INFO:tasks.workunit.client.0.smithi050.stdout:9/353: dread d1/d12/f22 [0,4194304] 0 2023-01-04T18:17:00.781 INFO:tasks.workunit.client.0.smithi050.stdout:1/307: creat d8/d48/d5c/f65 x:0 0 0 2023-01-04T18:17:00.782 INFO:tasks.workunit.client.0.smithi050.stdout:3/358: mkdir d0/d1b/d2f/d56/d6b/d7f 0 2023-01-04T18:17:00.787 INFO:tasks.workunit.client.0.smithi050.stdout:7/380: unlink d6/db/d20/f86 0 2023-01-04T18:17:00.787 INFO:tasks.workunit.client.0.smithi050.stdout:7/381: write d6/db/d15/d1b/d22/f39 [4621728,60509] 0 2023-01-04T18:17:00.788 INFO:tasks.workunit.client.0.smithi050.stdout:8/357: creat d3/d2a/d30/d3b/d4d/d1b/d7a/f80 x:0 0 0 2023-01-04T18:17:00.795 INFO:tasks.workunit.client.0.smithi050.stdout:1/308: dwrite d8/d14/f52 [0,4194304] 0 2023-01-04T18:17:00.803 INFO:tasks.workunit.client.0.smithi050.stdout:0/294: sync 2023-01-04T18:17:00.809 INFO:tasks.workunit.client.0.smithi050.stdout:5/495: rename d13/c23 to d13/d15/d17/d27/da8/cae 0 2023-01-04T18:17:00.810 INFO:tasks.workunit.client.0.smithi050.stdout:8/358: dwrite d3/d2a/d30/d3b/f79 [0,4194304] 0 2023-01-04T18:17:00.812 INFO:tasks.workunit.client.0.smithi050.stdout:9/354: symlink d1/d12/d41/l70 0 2023-01-04T18:17:00.813 INFO:tasks.workunit.client.0.smithi050.stdout:6/304: dread d0/d9/f3b [0,4194304] 0 2023-01-04T18:17:00.813 INFO:tasks.workunit.client.0.smithi050.stdout:6/305: chown d0/d9/d38/l5e 0 1 2023-01-04T18:17:00.817 INFO:tasks.workunit.client.0.smithi050.stdout:3/359: mkdir d0/d1b/d2f/d31/d60/d46/d80 0 2023-01-04T18:17:00.817 INFO:tasks.workunit.client.0.smithi050.stdout:3/360: fdatasync d0/d1b/d2f/d31/f3d 0 2023-01-04T18:17:00.818 INFO:tasks.workunit.client.0.smithi050.stdout:7/382: unlink d6/f49 0 2023-01-04T18:17:00.819 INFO:tasks.workunit.client.0.smithi050.stdout:7/383: write d6/db/f19 [4006561,126985] 0 2023-01-04T18:17:00.819 INFO:tasks.workunit.client.0.smithi050.stdout:7/384: chown d6/db/d15/c7e 3 1 2023-01-04T18:17:00.819 INFO:tasks.workunit.client.0.smithi050.stdout:7/385: write d6/db/d3b/f61 [1975,85311] 22 2023-01-04T18:17:00.824 INFO:tasks.workunit.client.0.smithi050.stdout:1/309: creat d8/f66 x:0 0 0 2023-01-04T18:17:00.831 INFO:tasks.workunit.client.0.smithi050.stdout:4/353: dread d14/d1b/f41 [0,4194304] 0 2023-01-04T18:17:00.833 INFO:tasks.workunit.client.0.smithi050.stdout:0/295: symlink d0/d6/d8/l5c 0 2023-01-04T18:17:00.836 INFO:tasks.workunit.client.0.smithi050.stdout:5/496: creat d13/d15/d17/d27/d46/d4e/d4d/faf x:0 0 0 2023-01-04T18:17:00.836 INFO:tasks.workunit.client.0.smithi050.stdout:0/296: write d0/d6/d8/f1c [3608621,33745] 0 2023-01-04T18:17:00.842 INFO:tasks.workunit.client.0.smithi050.stdout:0/297: write d0/d6/d8/f1c [3201126,8985] 0 2023-01-04T18:17:00.845 INFO:tasks.workunit.client.0.smithi050.stdout:8/359: dwrite d3/d2a/d2d/f66 [0,4194304] 0 2023-01-04T18:17:00.846 INFO:tasks.workunit.client.0.smithi050.stdout:8/360: read d3/d5/d46/f4a [2871712,18900] 0 2023-01-04T18:17:00.848 INFO:tasks.workunit.client.0.smithi050.stdout:7/386: dwrite d6/db/d15/d48/f58 [0,4194304] 0 2023-01-04T18:17:00.853 INFO:tasks.workunit.client.0.smithi050.stdout:8/361: read d3/d2a/d30/d3b/d4d/d23/d55/f5a [940522,86167] 0 2023-01-04T18:17:00.855 INFO:tasks.workunit.client.0.smithi050.stdout:1/310: dwrite d8/d14/f5b [0,4194304] 0 2023-01-04T18:17:00.856 INFO:tasks.workunit.client.0.smithi050.stdout:1/311: write d8/d14/d1d/d3a/d23/f3e [131902,57090] 0 2023-01-04T18:17:00.856 INFO:tasks.workunit.client.0.smithi050.stdout:5/497: dwrite d13/d15/d17/d1f/f97 [0,4194304] 0 2023-01-04T18:17:00.869 INFO:tasks.workunit.client.0.smithi050.stdout:9/355: creat d1/d12/d41/f71 x:0 0 0 2023-01-04T18:17:00.870 INFO:tasks.workunit.client.0.smithi050.stdout:6/306: mkdir d0/d9/df/d68 0 2023-01-04T18:17:00.871 INFO:tasks.workunit.client.0.smithi050.stdout:3/361: rename d0/l17 to d0/dd/d45/l81 0 2023-01-04T18:17:00.871 INFO:tasks.workunit.client.0.smithi050.stdout:3/362: fsync d0/d1b/d2f/d31/f50 0 2023-01-04T18:17:00.931 INFO:tasks.workunit.client.0.smithi050.stdout:9/356: dwrite d1/d12/d2d/d39/f4d [0,4194304] 0 2023-01-04T18:17:00.931 INFO:tasks.workunit.client.0.smithi050.stdout:9/357: dread - d1/d3/f5c zero size 2023-01-04T18:17:00.933 INFO:tasks.workunit.client.0.smithi050.stdout:7/387: symlink d6/d28/l87 0 2023-01-04T18:17:00.935 INFO:tasks.workunit.client.0.smithi050.stdout:8/362: creat d3/d2a/d60/f81 x:0 0 0 2023-01-04T18:17:00.935 INFO:tasks.workunit.client.0.smithi050.stdout:8/363: chown d3/l10 20178557 1 2023-01-04T18:17:00.944 INFO:tasks.workunit.client.0.smithi050.stdout:5/498: rmdir d13/d15/d17/d1f/d35/d59/d87 39 2023-01-04T18:17:00.948 INFO:tasks.workunit.client.0.smithi050.stdout:1/312: rename d8/d14/d1d to d8/d48/d5c/d67 0 2023-01-04T18:17:00.949 INFO:tasks.workunit.client.0.smithi050.stdout:1/313: write f6 [2527517,128430] 0 2023-01-04T18:17:00.949 INFO:tasks.workunit.client.0.smithi050.stdout:1/314: read - d8/d14/d1c/d28/d57/f61 zero size 2023-01-04T18:17:00.949 INFO:tasks.workunit.client.0.smithi050.stdout:1/315: stat d8/d14/f35 0 2023-01-04T18:17:00.952 INFO:tasks.workunit.client.0.smithi050.stdout:3/363: creat d0/d1b/d2f/d31/d60/d46/d80/f82 x:0 0 0 2023-01-04T18:17:00.954 INFO:tasks.workunit.client.0.smithi050.stdout:2/333: sync 2023-01-04T18:17:00.956 INFO:tasks.workunit.client.0.smithi050.stdout:9/358: link d1/d12/d2d/l68 d1/d12/l72 0 2023-01-04T18:17:00.956 INFO:tasks.workunit.client.0.smithi050.stdout:9/359: fsync d1/d3/d13/f15 0 2023-01-04T18:17:00.962 INFO:tasks.workunit.client.0.smithi050.stdout:3/364: rename d0/d1b/d2f/d31/f72 to d0/d1b/d2f/d31/f83 0 2023-01-04T18:17:00.964 INFO:tasks.workunit.client.0.smithi050.stdout:2/334: symlink d1/d41/d68/l6b 0 2023-01-04T18:17:00.965 INFO:tasks.workunit.client.0.smithi050.stdout:2/335: read d1/f55 [2564743,113198] 0 2023-01-04T18:17:00.965 INFO:tasks.workunit.client.0.smithi050.stdout:2/336: chown d1/l48 53916 1 2023-01-04T18:17:00.965 INFO:tasks.workunit.client.0.smithi050.stdout:2/337: write d1/dd/d28/d2c/d2e/d36/f51 [352853,25102] 0 2023-01-04T18:17:00.965 INFO:tasks.workunit.client.0.smithi050.stdout:9/360: creat d1/d3/d11/d1f/f73 x:0 0 0 2023-01-04T18:17:00.967 INFO:tasks.workunit.client.0.smithi050.stdout:3/365: creat d0/d1b/d2f/d56/d3f/f84 x:0 0 0 2023-01-04T18:17:00.968 INFO:tasks.workunit.client.0.smithi050.stdout:3/366: chown d0/d1b/d2f/d56/d3f 7 1 2023-01-04T18:17:00.971 INFO:tasks.workunit.client.0.smithi050.stdout:2/338: symlink d1/dd/l6c 0 2023-01-04T18:17:00.971 INFO:tasks.workunit.client.0.smithi050.stdout:2/339: fdatasync d1/dd/d11/f27 0 2023-01-04T18:17:00.971 INFO:tasks.workunit.client.0.smithi050.stdout:2/340: chown d1/dd/d11/d14/d39/l5e 1629 1 2023-01-04T18:17:00.972 INFO:tasks.workunit.client.0.smithi050.stdout:5/499: dwrite d13/fa5 [0,4194304] 0 2023-01-04T18:17:00.972 INFO:tasks.workunit.client.0.smithi050.stdout:8/364: dwrite d3/d2a/d30/d3b/d4d/d23/d31/f78 [0,4194304] 0 2023-01-04T18:17:00.972 INFO:tasks.workunit.client.0.smithi050.stdout:5/500: readlink d13/d15/d17/d1f/l99 0 2023-01-04T18:17:00.972 INFO:tasks.workunit.client.0.smithi050.stdout:7/388: dwrite d6/db/f40 [0,4194304] 0 2023-01-04T18:17:00.972 INFO:tasks.workunit.client.0.smithi050.stdout:7/389: dread - d6/db/d15/d48/f57 zero size 2023-01-04T18:17:00.973 INFO:tasks.workunit.client.0.smithi050.stdout:9/361: creat d1/d12/f74 x:0 0 0 2023-01-04T18:17:00.975 INFO:tasks.workunit.client.0.smithi050.stdout:1/316: dwrite d8/d48/d5c/d67/d3a/d58/f5a [0,4194304] 0 2023-01-04T18:17:00.975 INFO:tasks.workunit.client.0.smithi050.stdout:1/317: chown d8/d14/f52 4192395 1 2023-01-04T18:17:00.979 INFO:tasks.workunit.client.0.smithi050.stdout:9/362: dread d1/d12/d2d/d39/f4d [0,4194304] 0 2023-01-04T18:17:00.986 INFO:tasks.workunit.client.0.smithi050.stdout:1/318: dread d8/d14/d1c/d28/f2b [0,4194304] 0 2023-01-04T18:17:00.991 INFO:tasks.workunit.client.0.smithi050.stdout:3/367: creat d0/d1b/d2f/d31/d60/d46/f85 x:0 0 0 2023-01-04T18:17:00.995 INFO:tasks.workunit.client.0.smithi050.stdout:8/365: rmdir d3/d2a/d30/d3b/d53 39 2023-01-04T18:17:00.997 INFO:tasks.workunit.client.0.smithi050.stdout:5/501: creat d13/d15/d17/d1f/d62/fb0 x:0 0 0 2023-01-04T18:17:00.998 INFO:tasks.workunit.client.0.smithi050.stdout:5/502: write d13/d15/d17/d1f/d35/d42/d4a/f64 [2761624,39052] 0 2023-01-04T18:17:00.998 INFO:tasks.workunit.client.0.smithi050.stdout:5/503: write d13/d15/d17/d1f/d35/d42/f9f [637739,24522] 0 2023-01-04T18:17:01.004 INFO:tasks.workunit.client.0.smithi050.stdout:1/319: rename d8/d48/d5c/d67/f50 to d8/d48/d5c/d67/d3b/f68 0 2023-01-04T18:17:01.008 INFO:tasks.workunit.client.0.smithi050.stdout:3/368: creat d0/d1b/d2f/d31/f86 x:0 0 0 2023-01-04T18:17:01.010 INFO:tasks.workunit.client.0.smithi050.stdout:2/341: mknod d1/c6d 0 2023-01-04T18:17:01.010 INFO:tasks.workunit.client.0.smithi050.stdout:2/342: chown d1/f55 88335691 1 2023-01-04T18:17:01.015 INFO:tasks.workunit.client.0.smithi050.stdout:8/366: mkdir d3/d2a/d30/d3b/d4d/d23/d55/d5f/d82 0 2023-01-04T18:17:01.015 INFO:tasks.workunit.client.0.smithi050.stdout:8/367: stat d3/d2a/d60/f39 0 2023-01-04T18:17:01.017 INFO:tasks.workunit.client.0.smithi050.stdout:5/504: mkdir d13/d15/d17/d27/d46/d4e/d4d/db1 0 2023-01-04T18:17:01.018 INFO:tasks.workunit.client.0.smithi050.stdout:3/369: symlink d0/d1b/d2f/l87 0 2023-01-04T18:17:01.018 INFO:tasks.workunit.client.0.smithi050.stdout:3/370: truncate d0/d1b/d2f/d56/d32/f49 1004046 0 2023-01-04T18:17:01.023 INFO:tasks.workunit.client.0.smithi050.stdout:8/368: dread d3/d2a/d60/d2c/f5e [0,4194304] 0 2023-01-04T18:17:01.023 INFO:tasks.workunit.client.0.smithi050.stdout:5/505: mkdir d13/d15/d66/db2 0 2023-01-04T18:17:01.023 INFO:tasks.workunit.client.0.smithi050.stdout:5/506: fsync d13/d15/d17/d1f/d35/d42/f79 0 2023-01-04T18:17:01.023 INFO:tasks.workunit.client.0.smithi050.stdout:5/507: chown d13/d15/d17/d27/da8/cae 15194286 1 2023-01-04T18:17:01.025 INFO:tasks.workunit.client.0.smithi050.stdout:8/369: link d3/d2a/d27/c67 d3/d5/c83 0 2023-01-04T18:17:01.026 INFO:tasks.workunit.client.0.smithi050.stdout:5/508: link d13/f14 d13/d15/d17/d27/fb3 0 2023-01-04T18:17:01.028 INFO:tasks.workunit.client.0.smithi050.stdout:8/370: mkdir d3/d2a/d60/d84 0 2023-01-04T18:17:01.030 INFO:tasks.workunit.client.0.smithi050.stdout:1/320: dwrite d8/d14/f35 [0,4194304] 0 2023-01-04T18:17:01.030 INFO:tasks.workunit.client.0.smithi050.stdout:1/321: truncate d8/d48/d5c/f65 212504 0 2023-01-04T18:17:01.030 INFO:tasks.workunit.client.0.smithi050.stdout:1/322: chown d8/d14/d1c/d28/f3f 231220 1 2023-01-04T18:17:01.030 INFO:tasks.workunit.client.0.smithi050.stdout:1/323: write d8/d14/d1c/d28/f59 [142904,108690] 0 2023-01-04T18:17:01.030 INFO:tasks.workunit.client.0.smithi050.stdout:1/324: chown c2 7061 1 2023-01-04T18:17:01.031 INFO:tasks.workunit.client.0.smithi050.stdout:1/325: readlink d8/d14/d1c/l2e 0 2023-01-04T18:17:01.031 INFO:tasks.workunit.client.0.smithi050.stdout:3/371: dread d0/d10/f42 [0,4194304] 0 2023-01-04T18:17:01.031 INFO:tasks.workunit.client.0.smithi050.stdout:2/343: dwrite d1/dd/d11/d14/f33 [0,4194304] 0 2023-01-04T18:17:01.031 INFO:tasks.workunit.client.0.smithi050.stdout:2/344: fsync d1/f55 0 2023-01-04T18:17:01.032 INFO:tasks.workunit.client.0.smithi050.stdout:5/509: creat d13/d15/d17/d1f/d62/fb4 x:0 0 0 2023-01-04T18:17:01.032 INFO:tasks.workunit.client.0.smithi050.stdout:5/510: chown d13/d15/d17/d1f/f30 537047 1 2023-01-04T18:17:01.035 INFO:tasks.workunit.client.0.smithi050.stdout:3/372: mknod d0/d10/c88 0 2023-01-04T18:17:01.035 INFO:tasks.workunit.client.0.smithi050.stdout:3/373: fsync d0/d1b/d2f/d31/d60/d46/f85 0 2023-01-04T18:17:01.036 INFO:tasks.workunit.client.0.smithi050.stdout:1/326: write d8/fd [5601170,106479] 0 2023-01-04T18:17:01.036 INFO:tasks.workunit.client.0.smithi050.stdout:1/327: stat d8/d14/d1c/d28 0 2023-01-04T18:17:01.036 INFO:tasks.workunit.client.0.smithi050.stdout:1/328: fsync d8/f13 0 2023-01-04T18:17:01.082 INFO:tasks.workunit.client.0.smithi050.stdout:8/371: dwrite d3/f68 [0,4194304] 0 2023-01-04T18:17:01.094 INFO:tasks.workunit.client.0.smithi050.stdout:2/345: mkdir d1/dd/d11/d1e/d6e 0 2023-01-04T18:17:01.095 INFO:tasks.workunit.client.0.smithi050.stdout:2/346: stat d1/d19/f21 0 2023-01-04T18:17:01.095 INFO:tasks.workunit.client.0.smithi050.stdout:1/329: truncate d8/d48/d5c/d67/d3a/d31/f64 1027335 0 2023-01-04T18:17:01.158 INFO:tasks.workunit.client.0.smithi050.stdout:8/372: mkdir d3/d2a/d2d/d85 0 2023-01-04T18:17:01.159 INFO:tasks.workunit.client.0.smithi050.stdout:8/373: dread d3/d2a/d30/d3b/d53/f54 [0,4194304] 0 2023-01-04T18:17:01.165 INFO:tasks.workunit.client.0.smithi050.stdout:1/330: rmdir d8/d14/d1c/d28/d57 39 2023-01-04T18:17:01.167 INFO:tasks.workunit.client.0.smithi050.stdout:6/307: sync 2023-01-04T18:17:01.167 INFO:tasks.workunit.client.0.smithi050.stdout:4/354: sync 2023-01-04T18:17:01.167 INFO:tasks.workunit.client.0.smithi050.stdout:0/298: sync 2023-01-04T18:17:01.167 INFO:tasks.workunit.client.0.smithi050.stdout:6/308: truncate d0/d9/df/f56 920897 0 2023-01-04T18:17:01.168 INFO:tasks.workunit.client.0.smithi050.stdout:0/299: truncate d0/d6/f26 4612328 0 2023-01-04T18:17:01.171 INFO:tasks.workunit.client.0.smithi050.stdout:8/374: rmdir d3/d5/d7e 0 2023-01-04T18:17:01.171 INFO:tasks.workunit.client.0.smithi050.stdout:8/375: stat d3/d2a/d30/d3b/d4d/d23/d55/c62 0 2023-01-04T18:17:01.173 INFO:tasks.workunit.client.0.smithi050.stdout:6/309: symlink d0/d5c/d5d/l69 0 2023-01-04T18:17:01.179 INFO:tasks.workunit.client.0.smithi050.stdout:8/376: write d3/f68 [4178691,85853] 0 2023-01-04T18:17:01.181 INFO:tasks.workunit.client.0.smithi050.stdout:8/377: mkdir d3/d2a/d2d/d86 0 2023-01-04T18:17:01.187 INFO:tasks.workunit.client.0.smithi050.stdout:1/331: dwrite d8/d48/d5c/d67/f33 [0,4194304] 0 2023-01-04T18:17:01.190 INFO:tasks.workunit.client.0.smithi050.stdout:1/332: rmdir d8/d48/d5c/d67 39 2023-01-04T18:17:01.192 INFO:tasks.workunit.client.0.smithi050.stdout:1/333: link d8/d48/d5c/d67/f56 d8/d48/d5c/d67/d3a/f69 0 2023-01-04T18:17:01.193 INFO:tasks.workunit.client.0.smithi050.stdout:1/334: mkdir d8/d14/d1c/d28/d57/d6a 0 2023-01-04T18:17:01.210 INFO:tasks.workunit.client.0.smithi050.stdout:6/310: dwrite d0/d9/d38/f5b [0,4194304] 0 2023-01-04T18:17:01.212 INFO:tasks.workunit.client.0.smithi050.stdout:6/311: creat d0/d5c/d5d/f6a x:0 0 0 2023-01-04T18:17:01.212 INFO:tasks.workunit.client.0.smithi050.stdout:6/312: dread - d0/d9/d25/f64 zero size 2023-01-04T18:17:01.213 INFO:tasks.workunit.client.0.smithi050.stdout:6/313: chown d0/d4a/c67 1 1 2023-01-04T18:17:01.213 INFO:tasks.workunit.client.0.smithi050.stdout:0/300: dwrite d0/d6/d28/d1a/f20 [0,4194304] 0 2023-01-04T18:17:01.213 INFO:tasks.workunit.client.0.smithi050.stdout:6/314: mkdir d0/d9/d38/d16/d6b 0 2023-01-04T18:17:01.214 INFO:tasks.workunit.client.0.smithi050.stdout:1/335: dwrite d8/d48/d5c/f5e [0,4194304] 0 2023-01-04T18:17:01.214 INFO:tasks.workunit.client.0.smithi050.stdout:1/336: readlink d8/d48/d5c/d67/d3a/l4b 0 2023-01-04T18:17:01.215 INFO:tasks.workunit.client.0.smithi050.stdout:4/355: dwrite d14/d1b/d1f/d22/f54 [4194304,4194304] 0 2023-01-04T18:17:01.215 INFO:tasks.workunit.client.0.smithi050.stdout:8/378: dwrite d3/d2a/d30/d3b/d4d/d1b/d7a/f80 [0,4194304] 0 2023-01-04T18:17:01.216 INFO:tasks.workunit.client.0.smithi050.stdout:8/379: fsync d3/d2a/d30/d3b/f79 0 2023-01-04T18:17:01.217 INFO:tasks.workunit.client.0.smithi050.stdout:6/315: write d0/d9/fa [665706,29492] 0 2023-01-04T18:17:01.217 INFO:tasks.workunit.client.0.smithi050.stdout:1/337: mknod d8/d48/d5c/d67/d3a/d23/c6b 0 2023-01-04T18:17:01.219 INFO:tasks.workunit.client.0.smithi050.stdout:0/301: dread d0/d6/d8/d51/f50 [0,4194304] 0 2023-01-04T18:17:01.224 INFO:tasks.workunit.client.0.smithi050.stdout:4/356: stat d14/d1b/d1f/l2d 0 2023-01-04T18:17:01.225 INFO:tasks.workunit.client.0.smithi050.stdout:4/357: write d14/d1b/d32/f35 [797963,128669] 0 2023-01-04T18:17:01.231 INFO:tasks.workunit.client.0.smithi050.stdout:8/380: dwrite d3/d2a/d60/f81 [0,4194304] 0 2023-01-04T18:17:01.231 INFO:tasks.workunit.client.0.smithi050.stdout:8/381: write d3/d2a/f24 [3155439,62825] 0 2023-01-04T18:17:01.232 INFO:tasks.workunit.client.0.smithi050.stdout:8/382: write d3/d2a/d30/d3b/d4d/d23/d55/f57 [714201,98854] 0 2023-01-04T18:17:01.234 INFO:tasks.workunit.client.0.smithi050.stdout:4/358: dread d14/d1b/d32/f3c [0,4194304] 0 2023-01-04T18:17:01.241 INFO:tasks.workunit.client.0.smithi050.stdout:6/316: symlink d0/d5c/d5d/l6c 0 2023-01-04T18:17:01.241 INFO:tasks.workunit.client.0.smithi050.stdout:6/317: chown d0/d9/d38/d16/d6b 70741466 1 2023-01-04T18:17:01.241 INFO:tasks.workunit.client.0.smithi050.stdout:6/318: dread - d0/d9/d38/d1c/d54/f63 zero size 2023-01-04T18:17:01.241 INFO:tasks.workunit.client.0.smithi050.stdout:6/319: write d0/f14 [2289067,41084] 0 2023-01-04T18:17:01.244 INFO:tasks.workunit.client.0.smithi050.stdout:1/338: creat d8/d48/d5c/f6c x:0 0 0 2023-01-04T18:17:01.244 INFO:tasks.workunit.client.0.smithi050.stdout:1/339: fdatasync d8/d48/d5c/d67/f33 0 2023-01-04T18:17:01.245 INFO:tasks.workunit.client.0.smithi050.stdout:0/302: symlink d0/d6/d8/d51/l5d 0 2023-01-04T18:17:01.251 INFO:tasks.workunit.client.0.smithi050.stdout:8/383: mknod d3/d2a/d2d/c87 0 2023-01-04T18:17:01.251 INFO:tasks.workunit.client.0.smithi050.stdout:8/384: chown d3/d2a/d30/d3b/c3c 3 1 2023-01-04T18:17:01.251 INFO:tasks.workunit.client.0.smithi050.stdout:8/385: chown d3/d2a/d60/c61 100 1 2023-01-04T18:17:01.252 INFO:tasks.workunit.client.0.smithi050.stdout:4/359: symlink d14/d1b/d1f/d63/l72 0 2023-01-04T18:17:01.254 INFO:tasks.workunit.client.0.smithi050.stdout:3/374: sync 2023-01-04T18:17:01.254 INFO:tasks.workunit.client.0.smithi050.stdout:5/511: sync 2023-01-04T18:17:01.255 INFO:tasks.workunit.client.0.smithi050.stdout:9/363: sync 2023-01-04T18:17:01.255 INFO:tasks.workunit.client.0.smithi050.stdout:7/390: sync 2023-01-04T18:17:01.255 INFO:tasks.workunit.client.0.smithi050.stdout:2/347: sync 2023-01-04T18:17:01.256 INFO:tasks.workunit.client.0.smithi050.stdout:9/364: read d1/d12/f5f [3538566,21079] 0 2023-01-04T18:17:01.256 INFO:tasks.workunit.client.0.smithi050.stdout:9/365: dread - d1/d12/f74 zero size 2023-01-04T18:17:01.256 INFO:tasks.workunit.client.0.smithi050.stdout:4/360: mknod d14/d1b/c73 0 2023-01-04T18:17:01.256 INFO:tasks.workunit.client.0.smithi050.stdout:4/361: chown d14/d1b/f41 3 1 2023-01-04T18:17:01.256 INFO:tasks.workunit.client.0.smithi050.stdout:8/386: truncate d3/d2a/d30/d3b/d4d/f2b 4113411 0 2023-01-04T18:17:01.256 INFO:tasks.workunit.client.0.smithi050.stdout:6/320: dread d0/d9/f29 [0,4194304] 0 2023-01-04T18:17:01.256 INFO:tasks.workunit.client.0.smithi050.stdout:6/321: truncate d0/d9/d25/d4d/f66 217264 0 2023-01-04T18:17:01.257 INFO:tasks.workunit.client.0.smithi050.stdout:5/512: rename d13/d15/d63/f8c to d13/d15/d66/db2/fb5 0 2023-01-04T18:17:01.258 INFO:tasks.workunit.client.0.smithi050.stdout:7/391: mknod d6/d1d/d81/c88 0 2023-01-04T18:17:01.259 INFO:tasks.workunit.client.0.smithi050.stdout:2/348: creat d1/d19/d5a/f6f x:0 0 0 2023-01-04T18:17:01.259 INFO:tasks.workunit.client.0.smithi050.stdout:2/349: readlink d1/dd/d11/d14/d39/l3b 0 2023-01-04T18:17:01.259 INFO:tasks.workunit.client.0.smithi050.stdout:2/350: chown d1/dd/d28/f43 923 1 2023-01-04T18:17:01.269 INFO:tasks.workunit.client.0.smithi050.stdout:1/340: dwrite d8/d14/d1c/d28/f59 [0,4194304] 0 2023-01-04T18:17:01.272 INFO:tasks.workunit.client.0.smithi050.stdout:9/366: dwrite d1/d12/d41/f71 [0,4194304] 0 2023-01-04T18:17:01.272 INFO:tasks.workunit.client.0.smithi050.stdout:9/367: write d1/d3/d11/d1f/f5b [364112,93068] 0 2023-01-04T18:17:01.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:16:59.919694+0000 mgr.smithi098.vhfzum (mgr.24455) 37 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 820 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 36 MiB/s rd, 74 MiB/s wr, 263 op/s 2023-01-04T18:17:01.318 INFO:tasks.workunit.client.0.smithi050.stdout:8/387: dread d3/d5/f1d [0,4194304] 0 2023-01-04T18:17:01.326 INFO:tasks.workunit.client.0.smithi050.stdout:3/375: dwrite d0/d1b/f23 [0,4194304] 0 2023-01-04T18:17:01.326 INFO:tasks.workunit.client.0.smithi050.stdout:3/376: fdatasync d0/d1b/d2f/d71/f7b 0 2023-01-04T18:17:01.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:16:59.919694+0000 mgr.smithi098.vhfzum (mgr.24455) 37 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 820 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 36 MiB/s rd, 74 MiB/s wr, 263 op/s 2023-01-04T18:17:01.346 INFO:tasks.workunit.client.0.smithi050.stdout:6/322: link d0/d9/l3c d0/l6d 0 2023-01-04T18:17:01.389 INFO:tasks.workunit.client.0.smithi050.stdout:5/513: creat d13/d15/d17/d1f/d35/d59/fb6 x:0 0 0 2023-01-04T18:17:01.390 INFO:tasks.workunit.client.0.smithi050.stdout:7/392: creat d6/d1d/d81/f89 x:0 0 0 2023-01-04T18:17:01.390 INFO:tasks.workunit.client.0.smithi050.stdout:7/393: chown d6/db/d15/d1b/d22/f54 7284180 1 2023-01-04T18:17:01.393 INFO:tasks.workunit.client.0.smithi050.stdout:2/351: symlink d1/dd/d11/d14/d39/l70 0 2023-01-04T18:17:01.399 INFO:tasks.workunit.client.0.smithi050.stdout:1/341: creat d8/d48/d5c/d67/d3a/f6d x:0 0 0 2023-01-04T18:17:01.407 INFO:tasks.workunit.client.0.smithi050.stdout:9/368: mkdir d1/d12/d41/d60/d75 0 2023-01-04T18:17:01.407 INFO:tasks.workunit.client.0.smithi050.stdout:8/388: truncate d3/d2a/d60/f39 350315 0 2023-01-04T18:17:01.410 INFO:tasks.workunit.client.0.smithi050.stdout:2/352: dwrite d1/dd/d11/d14/f30 [4194304,4194304] 0 2023-01-04T18:17:01.412 INFO:tasks.workunit.client.0.smithi050.stdout:3/377: getdents d0/dd/d45 0 2023-01-04T18:17:01.412 INFO:tasks.workunit.client.0.smithi050.stdout:3/378: write d0/f40 [4987477,74462] 0 2023-01-04T18:17:01.419 INFO:tasks.workunit.client.0.smithi050.stdout:6/323: creat d0/d9/d25/d4d/f6e x:0 0 0 2023-01-04T18:17:01.422 INFO:tasks.workunit.client.0.smithi050.stdout:5/514: creat d13/d15/d17/d1f/fb7 x:0 0 0 2023-01-04T18:17:01.424 INFO:tasks.workunit.client.0.smithi050.stdout:7/394: mkdir d6/db/d20/d4f/d8a 0 2023-01-04T18:17:01.424 INFO:tasks.workunit.client.0.smithi050.stdout:7/395: write d6/db/d3b/d5c/f76 [338804,36890] 0 2023-01-04T18:17:01.425 INFO:tasks.workunit.client.0.smithi050.stdout:1/342: rename d8/d48/d5c/d67/c54 to d8/d48/c6e 0 2023-01-04T18:17:01.430 INFO:tasks.workunit.client.0.smithi050.stdout:8/389: creat d3/d2a/d30/d3b/d4d/f88 x:0 0 0 2023-01-04T18:17:01.437 INFO:tasks.workunit.client.0.smithi050.stdout:7/396: rmdir d6/db/d15/d2e/d66 39 2023-01-04T18:17:01.438 INFO:tasks.workunit.client.0.smithi050.stdout:3/379: symlink d0/d1b/d2f/d31/d60/d46/l89 0 2023-01-04T18:17:01.438 INFO:tasks.workunit.client.0.smithi050.stdout:3/380: fsync d0/d1b/d2f/d31/f4b 0 2023-01-04T18:17:01.440 INFO:tasks.workunit.client.0.smithi050.stdout:2/353: rename d1/d19/l2b to d1/dd/d38/l71 0 2023-01-04T18:17:01.440 INFO:tasks.workunit.client.0.smithi050.stdout:2/354: chown d1/dd/d11/d14 136003 1 2023-01-04T18:17:01.440 INFO:tasks.workunit.client.0.smithi050.stdout:2/355: fdatasync d1/dd/d11/f26 0 2023-01-04T18:17:01.440 INFO:tasks.workunit.client.0.smithi050.stdout:2/356: chown d1/dd/d11/d14 6999177 1 2023-01-04T18:17:01.441 INFO:tasks.workunit.client.0.smithi050.stdout:1/343: unlink d8/f66 0 2023-01-04T18:17:01.443 INFO:tasks.workunit.client.0.smithi050.stdout:9/369: mknod d1/d3/d11/c76 0 2023-01-04T18:17:01.444 INFO:tasks.workunit.client.0.smithi050.stdout:8/390: stat d3/d5/c83 0 2023-01-04T18:17:01.446 INFO:tasks.workunit.client.0.smithi050.stdout:5/515: dwrite d13/d15/d17/d1f/f53 [0,4194304] 0 2023-01-04T18:17:01.446 INFO:tasks.workunit.client.0.smithi050.stdout:5/516: truncate d13/d28/f93 1169997 0 2023-01-04T18:17:01.447 INFO:tasks.workunit.client.0.smithi050.stdout:3/381: truncate d0/d1b/d2f/d31/f41 3539151 0 2023-01-04T18:17:01.448 INFO:tasks.workunit.client.0.smithi050.stdout:5/517: write d13/d15/d17/d1f/d35/d42/f79 [2792865,1617] 0 2023-01-04T18:17:01.450 INFO:tasks.workunit.client.0.smithi050.stdout:6/324: rename d0/d9/d25/d4d/f5a to d0/f6f 0 2023-01-04T18:17:01.456 INFO:tasks.workunit.client.0.smithi050.stdout:7/397: dwrite d6/db/d15/d1b/d22/f39 [0,4194304] 0 2023-01-04T18:17:01.456 INFO:tasks.workunit.client.0.smithi050.stdout:7/398: dread - d6/db/d3b/f4c zero size 2023-01-04T18:17:01.463 INFO:tasks.workunit.client.0.smithi050.stdout:3/382: dwrite d0/d1b/d2f/d31/f4b [4194304,4194304] 0 2023-01-04T18:17:01.463 INFO:tasks.workunit.client.0.smithi050.stdout:3/383: dread - d0/d1b/d2f/d31/f86 zero size 2023-01-04T18:17:01.467 INFO:tasks.workunit.client.0.smithi050.stdout:1/344: creat d8/f6f x:0 0 0 2023-01-04T18:17:01.467 INFO:tasks.workunit.client.0.smithi050.stdout:1/345: fdatasync d8/f4d 0 2023-01-04T18:17:01.468 INFO:tasks.workunit.client.0.smithi050.stdout:0/303: sync 2023-01-04T18:17:01.468 INFO:tasks.workunit.client.0.smithi050.stdout:4/362: sync 2023-01-04T18:17:01.468 INFO:tasks.workunit.client.0.smithi050.stdout:4/363: truncate f13 9033164 0 2023-01-04T18:17:01.469 INFO:tasks.workunit.client.0.smithi050.stdout:9/370: mkdir d1/d3/d13/d77 0 2023-01-04T18:17:01.471 INFO:tasks.workunit.client.0.smithi050.stdout:8/391: creat d3/d2a/f89 x:0 0 0 2023-01-04T18:17:01.471 INFO:tasks.workunit.client.0.smithi050.stdout:8/392: chown d3/d2a/d60/f40 1980 1 2023-01-04T18:17:01.471 INFO:tasks.workunit.client.0.smithi050.stdout:8/393: dread - d3/d2a/f89 zero size 2023-01-04T18:17:01.472 INFO:tasks.workunit.client.0.smithi050.stdout:8/394: write d3/d2a/d2d/f50 [412313,75979] 0 2023-01-04T18:17:01.480 INFO:tasks.workunit.client.0.smithi050.stdout:5/518: rename d13/d15/d17 to d13/d15/d66/db8 0 2023-01-04T18:17:01.481 INFO:tasks.workunit.client.0.smithi050.stdout:3/384: dwrite d0/d1b/d2f/d56/d32/f48 [0,4194304] 0 2023-01-04T18:17:01.481 INFO:tasks.workunit.client.0.smithi050.stdout:3/385: readlink d0/d1b/d2f/d31/d60/l2e 0 2023-01-04T18:17:01.485 INFO:tasks.workunit.client.0.smithi050.stdout:1/346: dwrite d8/f60 [0,4194304] 0 2023-01-04T18:17:01.485 INFO:tasks.workunit.client.0.smithi050.stdout:1/347: fdatasync d8/fd 0 2023-01-04T18:17:01.488 INFO:tasks.workunit.client.0.smithi050.stdout:6/325: creat d0/d9/df/f70 x:0 0 0 2023-01-04T18:17:01.489 INFO:tasks.workunit.client.0.smithi050.stdout:6/326: getdents d0/d9/d38/d60 0 2023-01-04T18:17:01.489 INFO:tasks.workunit.client.0.smithi050.stdout:6/327: fsync d0/d9/df/f56 0 2023-01-04T18:17:01.490 INFO:tasks.workunit.client.0.smithi050.stdout:7/399: mkdir d6/d6b/d8b 0 2023-01-04T18:17:01.490 INFO:tasks.workunit.client.0.smithi050.stdout:7/400: chown d6/d28/d3c/d42/d5f 3617715 1 2023-01-04T18:17:01.490 INFO:tasks.workunit.client.0.smithi050.stdout:5/519: dread d13/d15/d66/db8/d1f/f97 [0,4194304] 0 2023-01-04T18:17:01.491 INFO:tasks.workunit.client.0.smithi050.stdout:5/520: fdatasync d13/d28/d7c/f8d 0 2023-01-04T18:17:01.491 INFO:tasks.workunit.client.0.smithi050.stdout:5/521: chown d13/d15/d66/db8/d27/da8 7974410 1 2023-01-04T18:17:01.491 INFO:tasks.workunit.client.0.smithi050.stdout:5/522: chown d13/d15/d66/db8/d1f/d35/d59/f95 106 1 2023-01-04T18:17:01.493 INFO:tasks.workunit.client.0.smithi050.stdout:4/364: unlink d14/c25 0 2023-01-04T18:17:01.494 INFO:tasks.workunit.client.0.smithi050.stdout:6/328: read d0/d9/d38/f23 [604939,114757] 0 2023-01-04T18:17:01.494 INFO:tasks.workunit.client.0.smithi050.stdout:6/329: fdatasync d0/d9/d25/f27 0 2023-01-04T18:17:01.494 INFO:tasks.workunit.client.0.smithi050.stdout:1/348: dread d8/d48/d5c/d67/f1f [0,4194304] 0 2023-01-04T18:17:01.494 INFO:tasks.workunit.client.0.smithi050.stdout:1/349: write d8/d48/d5c/d67/f1e [1313561,80776] 0 2023-01-04T18:17:01.494 INFO:tasks.workunit.client.0.smithi050.stdout:9/371: mknod d1/d12/d41/d60/c78 0 2023-01-04T18:17:01.495 INFO:tasks.workunit.client.0.smithi050.stdout:1/350: write d8/d14/f52 [1081531,78188] 0 2023-01-04T18:17:01.497 INFO:tasks.workunit.client.0.smithi050.stdout:8/395: truncate d3/d2a/d30/d3b/d4d/d23/d55/f5a 140196 0 2023-01-04T18:17:01.512 INFO:tasks.workunit.client.0.smithi050.stdout:0/304: rename d0/f4 to d0/d6/d8/f5e 0 2023-01-04T18:17:01.514 INFO:tasks.workunit.client.0.smithi050.stdout:4/365: dwrite d14/f31 [0,4194304] 0 2023-01-04T18:17:01.514 INFO:tasks.workunit.client.0.smithi050.stdout:4/366: read - d14/d1b/d1f/d22/f34 zero size 2023-01-04T18:17:01.514 INFO:tasks.workunit.client.0.smithi050.stdout:4/367: fsync d14/d1b/d1f/f46 0 2023-01-04T18:17:01.515 INFO:tasks.workunit.client.0.smithi050.stdout:4/368: read d14/d1b/d32/f3c [271479,122184] 0 2023-01-04T18:17:01.521 INFO:tasks.workunit.client.0.smithi050.stdout:3/386: creat d0/d1a/f8a x:0 0 0 2023-01-04T18:17:01.523 INFO:tasks.workunit.client.0.smithi050.stdout:1/351: dwrite d8/d48/d5c/d67/f1e [0,4194304] 0 2023-01-04T18:17:01.525 INFO:tasks.workunit.client.0.smithi050.stdout:7/401: creat d6/db/d15/d1b/f8c x:0 0 0 2023-01-04T18:17:01.528 INFO:tasks.workunit.client.0.smithi050.stdout:5/523: symlink d13/d15/d63/lb9 0 2023-01-04T18:17:01.531 INFO:tasks.workunit.client.0.smithi050.stdout:3/387: dread d0/f40 [0,4194304] 0 2023-01-04T18:17:01.531 INFO:tasks.workunit.client.0.smithi050.stdout:3/388: chown d0/d1b/d2f/l51 3245 1 2023-01-04T18:17:01.532 INFO:tasks.workunit.client.0.smithi050.stdout:6/330: mkdir d0/d71 0 2023-01-04T18:17:01.533 INFO:tasks.workunit.client.0.smithi050.stdout:9/372: symlink d1/d6f/l79 0 2023-01-04T18:17:01.534 INFO:tasks.workunit.client.0.smithi050.stdout:4/369: dwrite d14/d1b/d1f/d22/d3e/d44/f68 [0,4194304] 0 2023-01-04T18:17:01.534 INFO:tasks.workunit.client.0.smithi050.stdout:9/373: read d1/d3/d11/d1f/f4e [2396044,61358] 0 2023-01-04T18:17:01.534 INFO:tasks.workunit.client.0.smithi050.stdout:9/374: write d1/d12/d2d/d39/f4d [4711754,86547] 0 2023-01-04T18:17:01.535 INFO:tasks.workunit.client.0.smithi050.stdout:4/370: dread d14/d1b/d1f/d22/f42 [0,4194304] 0 2023-01-04T18:17:01.536 INFO:tasks.workunit.client.0.smithi050.stdout:8/396: creat d3/d2a/d30/d3b/d4d/d23/d55/d5f/f8a x:0 0 0 2023-01-04T18:17:01.538 INFO:tasks.workunit.client.0.smithi050.stdout:0/305: mknod d0/d6/d28/d1a/c5f 0 2023-01-04T18:17:01.538 INFO:tasks.workunit.client.0.smithi050.stdout:0/306: fdatasync d0/d6/f55 0 2023-01-04T18:17:01.539 INFO:tasks.workunit.client.0.smithi050.stdout:7/402: dwrite d6/db/d20/d55/f5e [0,4194304] 0 2023-01-04T18:17:01.551 INFO:tasks.workunit.client.0.smithi050.stdout:1/352: creat d8/d48/d5c/d67/d3a/f70 x:0 0 0 2023-01-04T18:17:01.551 INFO:tasks.workunit.client.0.smithi050.stdout:1/353: chown d8/d14/d1c/d28/f3f 1443 1 2023-01-04T18:17:01.552 INFO:tasks.workunit.client.0.smithi050.stdout:5/524: creat d13/d15/d66/db8/d27/d46/d4e/d4d/db1/fba x:0 0 0 2023-01-04T18:17:01.555 INFO:tasks.workunit.client.0.smithi050.stdout:3/389: getdents d0/d1b/d2f/d71 0 2023-01-04T18:17:01.556 INFO:tasks.workunit.client.0.smithi050.stdout:6/331: truncate d0/f2f 2696968 0 2023-01-04T18:17:01.556 INFO:tasks.workunit.client.0.smithi050.stdout:6/332: readlink d0/d9/df/l35 0 2023-01-04T18:17:01.563 INFO:tasks.workunit.client.0.smithi050.stdout:3/390: dread d0/d1a/f4e [0,4194304] 0 2023-01-04T18:17:01.563 INFO:tasks.workunit.client.0.smithi050.stdout:3/391: chown d0/d1b 85711 1 2023-01-04T18:17:01.569 INFO:tasks.workunit.client.0.smithi050.stdout:4/371: symlink d14/d1b/d1f/d63/l74 0 2023-01-04T18:17:01.570 INFO:tasks.workunit.client.0.smithi050.stdout:8/397: mkdir d3/d2a/d27/d8b 0 2023-01-04T18:17:01.573 INFO:tasks.workunit.client.0.smithi050.stdout:0/307: link d0/f3b d0/d6/d28/f60 0 2023-01-04T18:17:01.573 INFO:tasks.workunit.client.0.smithi050.stdout:0/308: dread - d0/d6/d28/d1a/f40 zero size 2023-01-04T18:17:01.576 INFO:tasks.workunit.client.0.smithi050.stdout:7/403: creat d6/db/d3b/d5c/d7a/f8d x:0 0 0 2023-01-04T18:17:01.576 INFO:tasks.workunit.client.0.smithi050.stdout:0/309: dread d0/d6/d28/d1a/f23 [0,4194304] 0 2023-01-04T18:17:01.578 INFO:tasks.workunit.client.0.smithi050.stdout:0/310: write d0/d6/d8/f18 [662668,96658] 0 2023-01-04T18:17:01.578 INFO:tasks.workunit.client.0.smithi050.stdout:1/354: unlink d8/l51 0 2023-01-04T18:17:01.578 INFO:tasks.workunit.client.0.smithi050.stdout:1/355: fdatasync d8/d48/d5c/d67/d3a/d31/f64 0 2023-01-04T18:17:01.578 INFO:tasks.workunit.client.0.smithi050.stdout:1/356: chown d8/f11 7112025 1 2023-01-04T18:17:01.580 INFO:tasks.workunit.client.0.smithi050.stdout:6/333: getdents d0/d9/d38/d1c 0 2023-01-04T18:17:01.582 INFO:tasks.workunit.client.0.smithi050.stdout:9/375: dwrite d1/d3/d3b/d63/f1c [0,4194304] 0 2023-01-04T18:17:01.583 INFO:tasks.workunit.client.0.smithi050.stdout:1/357: read d8/fd [1714492,72246] 0 2023-01-04T18:17:01.584 INFO:tasks.workunit.client.0.smithi050.stdout:1/358: write d8/f4d [4133737,111484] 0 2023-01-04T18:17:01.584 INFO:tasks.workunit.client.0.smithi050.stdout:1/359: chown d8/f12 267657 1 2023-01-04T18:17:01.584 INFO:tasks.workunit.client.0.smithi050.stdout:3/392: mknod d0/d1b/d2f/d31/c8b 0 2023-01-04T18:17:01.587 INFO:tasks.workunit.client.0.smithi050.stdout:4/372: symlink d14/d1b/l75 0 2023-01-04T18:17:01.588 INFO:tasks.workunit.client.0.smithi050.stdout:8/398: mknod d3/d2a/d30/d3b/d4d/d23/c8c 0 2023-01-04T18:17:01.591 INFO:tasks.workunit.client.0.smithi050.stdout:7/404: rmdir d6/db/d15/d2e 39 2023-01-04T18:17:01.595 INFO:tasks.workunit.client.0.smithi050.stdout:0/311: link d0/d6/fa d0/d6/d8/d25/d3e/f61 0 2023-01-04T18:17:01.595 INFO:tasks.workunit.client.0.smithi050.stdout:6/334: getdents d0/d4a 0 2023-01-04T18:17:01.596 INFO:tasks.workunit.client.0.smithi050.stdout:9/376: dread d1/d3/d13/f15 [0,4194304] 0 2023-01-04T18:17:01.596 INFO:tasks.workunit.client.0.smithi050.stdout:3/393: creat d0/d10/f8c x:0 0 0 2023-01-04T18:17:01.599 INFO:tasks.workunit.client.0.smithi050.stdout:4/373: rename la to d14/d1b/d1f/d22/d3e/d44/l76 0 2023-01-04T18:17:01.600 INFO:tasks.workunit.client.0.smithi050.stdout:3/394: write d0/fb [1693048,124619] 0 2023-01-04T18:17:01.600 INFO:tasks.workunit.client.0.smithi050.stdout:3/395: write d0/d10/f8c [786938,94075] 0 2023-01-04T18:17:01.601 INFO:tasks.workunit.client.0.smithi050.stdout:8/399: symlink d3/d2a/d30/d3b/d4d/d1b/l8d 0 2023-01-04T18:17:01.605 INFO:tasks.workunit.client.0.smithi050.stdout:1/360: dwrite d8/d48/d5c/d67/d3a/d58/f5a [0,4194304] 0 2023-01-04T18:17:01.605 INFO:tasks.workunit.client.0.smithi050.stdout:1/361: truncate d8/d14/d1c/f40 479601 0 2023-01-04T18:17:01.605 INFO:tasks.workunit.client.0.smithi050.stdout:7/405: creat d6/db/d20/d55/f8e x:0 0 0 2023-01-04T18:17:01.607 INFO:tasks.workunit.client.0.smithi050.stdout:1/362: dread d8/d14/d1c/d28/f3f [0,4194304] 0 2023-01-04T18:17:01.608 INFO:tasks.workunit.client.0.smithi050.stdout:0/312: rmdir d0/d6/d28 39 2023-01-04T18:17:01.608 INFO:tasks.workunit.client.0.smithi050.stdout:0/313: fsync d0/d6/d28/d1a/f20 0 2023-01-04T18:17:01.608 INFO:tasks.workunit.client.0.smithi050.stdout:6/335: link d0/c1a d0/d5c/d5d/c72 0 2023-01-04T18:17:01.609 INFO:tasks.workunit.client.0.smithi050.stdout:6/336: truncate d0/f65 87058 0 2023-01-04T18:17:01.610 INFO:tasks.workunit.client.0.smithi050.stdout:9/377: unlink d1/d3/d24/f6e 0 2023-01-04T18:17:01.612 INFO:tasks.workunit.client.0.smithi050.stdout:3/396: symlink d0/d10/l8d 0 2023-01-04T18:17:01.619 INFO:tasks.workunit.client.0.smithi050.stdout:9/378: link d1/d3/d11/d42/c4b d1/d12/d3f/c7a 0 2023-01-04T18:17:01.619 INFO:tasks.workunit.client.0.smithi050.stdout:9/379: truncate d1/d3/d3b/d63/f3d 4466914 0 2023-01-04T18:17:01.619 INFO:tasks.workunit.client.0.smithi050.stdout:9/380: readlink d1/d12/d41/l6a 0 2023-01-04T18:17:01.619 INFO:tasks.workunit.client.0.smithi050.stdout:9/381: read d1/d12/d41/f67 [226159,127286] 0 2023-01-04T18:17:01.640 INFO:tasks.workunit.client.0.smithi050.stdout:4/374: dwrite d14/d1b/d1f/d22/d3e/f5a [0,4194304] 0 2023-01-04T18:17:01.649 INFO:tasks.workunit.client.0.smithi050.stdout:1/363: dwrite d8/d48/d5c/d67/f56 [0,4194304] 0 2023-01-04T18:17:01.649 INFO:tasks.workunit.client.0.smithi050.stdout:8/400: dwrite d3/d2a/d60/f39 [0,4194304] 0 2023-01-04T18:17:01.650 INFO:tasks.workunit.client.0.smithi050.stdout:7/406: dwrite d6/f27 [0,4194304] 0 2023-01-04T18:17:01.650 INFO:tasks.workunit.client.0.smithi050.stdout:6/337: dwrite d0/d9/df/f30 [4194304,4194304] 0 2023-01-04T18:17:01.651 INFO:tasks.workunit.client.0.smithi050.stdout:7/407: chown d6/f1c 84 1 2023-01-04T18:17:01.651 INFO:tasks.workunit.client.0.smithi050.stdout:7/408: dread - d6/db/d15/d1b/d70/f85 zero size 2023-01-04T18:17:01.651 INFO:tasks.workunit.client.0.smithi050.stdout:7/409: write d6/d28/d3c/d42/f56 [1140726,103527] 0 2023-01-04T18:17:01.654 INFO:tasks.workunit.client.0.smithi050.stdout:0/314: rmdir d0 39 2023-01-04T18:17:01.656 INFO:tasks.workunit.client.0.smithi050.stdout:3/397: creat d0/d1b/d2f/d31/f8e x:0 0 0 2023-01-04T18:17:01.657 INFO:tasks.workunit.client.0.smithi050.stdout:7/410: dread d6/db/f19 [0,4194304] 0 2023-01-04T18:17:01.671 INFO:tasks.workunit.client.0.smithi050.stdout:4/375: dwrite d14/f21 [4194304,4194304] 0 2023-01-04T18:17:01.671 INFO:tasks.workunit.client.0.smithi050.stdout:4/376: stat d14/d1b/d1f/d22/d3e/l5e 0 2023-01-04T18:17:01.672 INFO:tasks.workunit.client.0.smithi050.stdout:1/364: dwrite d8/d14/d1c/f5d [0,4194304] 0 2023-01-04T18:17:01.681 INFO:tasks.workunit.client.0.smithi050.stdout:8/401: rename d3/d2a/d30/d3b/d4d/f2b to d3/f8e 0 2023-01-04T18:17:01.682 INFO:tasks.workunit.client.0.smithi050.stdout:6/338: creat d0/d9/d25/d2d/f73 x:0 0 0 2023-01-04T18:17:01.682 INFO:tasks.workunit.client.0.smithi050.stdout:7/411: dwrite d6/f23 [0,4194304] 0 2023-01-04T18:17:01.688 INFO:tasks.workunit.client.0.smithi050.stdout:2/357: sync 2023-01-04T18:17:01.688 INFO:tasks.workunit.client.0.smithi050.stdout:2/358: chown d1/f8 6828 1 2023-01-04T18:17:01.688 INFO:tasks.workunit.client.0.smithi050.stdout:2/359: stat d1/dd/d11/l17 0 2023-01-04T18:17:01.693 INFO:tasks.workunit.client.0.smithi050.stdout:4/377: mknod d14/d1b/d1f/d63/c77 0 2023-01-04T18:17:01.693 INFO:tasks.workunit.client.0.smithi050.stdout:4/378: write d14/d1b/d1f/d22/d6a/f6b [88408,42339] 0 2023-01-04T18:17:01.696 INFO:tasks.workunit.client.0.smithi050.stdout:1/365: unlink d8/d48/d5c/d67/d3a/l4b 0 2023-01-04T18:17:01.700 INFO:tasks.workunit.client.0.smithi050.stdout:3/398: rename d0/d1b/d2f/d31/d60 to d0/d8f 0 2023-01-04T18:17:01.701 INFO:tasks.workunit.client.0.smithi050.stdout:3/399: read d0/d1b/d2f/d31/f4b [4067472,17931] 0 2023-01-04T18:17:01.702 INFO:tasks.workunit.client.0.smithi050.stdout:8/402: mknod d3/d2a/d30/c8f 0 2023-01-04T18:17:01.704 INFO:tasks.workunit.client.0.smithi050.stdout:2/360: dwrite d1/dd/f4a [0,4194304] 0 2023-01-04T18:17:01.704 INFO:tasks.workunit.client.0.smithi050.stdout:6/339: mkdir d0/d9/df/d74 0 2023-01-04T18:17:01.708 INFO:tasks.workunit.client.0.smithi050.stdout:4/379: unlink d14/f6c 0 2023-01-04T18:17:01.712 INFO:tasks.workunit.client.0.smithi050.stdout:7/412: rename d6/db/d3a/c51 to d6/d28/d3c/d62/c8f 0 2023-01-04T18:17:01.712 INFO:tasks.workunit.client.0.smithi050.stdout:1/366: dwrite f6 [0,4194304] 0 2023-01-04T18:17:01.713 INFO:tasks.workunit.client.0.smithi050.stdout:1/367: truncate d8/d48/d5c/d67/d3b/f68 5968361 0 2023-01-04T18:17:01.713 INFO:tasks.workunit.client.0.smithi050.stdout:3/400: creat d0/dd/f90 x:0 0 0 2023-01-04T18:17:01.714 INFO:tasks.workunit.client.0.smithi050.stdout:3/401: chown d0/d8f/l61 7810303 1 2023-01-04T18:17:01.717 INFO:tasks.workunit.client.0.smithi050.stdout:8/403: unlink d3/d2a/d60/f81 0 2023-01-04T18:17:01.717 INFO:tasks.workunit.client.0.smithi050.stdout:8/404: chown d3/d5/d46 81411578 1 2023-01-04T18:17:01.722 INFO:tasks.workunit.client.0.smithi050.stdout:2/361: getdents d1/dd/d11 0 2023-01-04T18:17:01.724 INFO:tasks.workunit.client.0.smithi050.stdout:6/340: mknod d0/d4a/c75 0 2023-01-04T18:17:01.726 INFO:tasks.workunit.client.0.smithi050.stdout:7/413: mkdir d6/d90 0 2023-01-04T18:17:01.730 INFO:tasks.workunit.client.0.smithi050.stdout:3/402: unlink d0/d1b/d2f/f74 0 2023-01-04T18:17:01.731 INFO:tasks.workunit.client.0.smithi050.stdout:2/362: mknod d1/dd/d28/d2c/d66/c72 0 2023-01-04T18:17:01.734 INFO:tasks.workunit.client.0.smithi050.stdout:1/368: dwrite d8/fd [8388608,4194304] 0 2023-01-04T18:17:01.734 INFO:tasks.workunit.client.0.smithi050.stdout:1/369: chown d8/d48/d5c/d67/d3a 683645545 1 2023-01-04T18:17:01.735 INFO:tasks.workunit.client.0.smithi050.stdout:6/341: mknod d0/d4a/c76 0 2023-01-04T18:17:01.735 INFO:tasks.workunit.client.0.smithi050.stdout:4/380: dwrite d14/f21 [4194304,4194304] 0 2023-01-04T18:17:01.735 INFO:tasks.workunit.client.0.smithi050.stdout:7/414: creat d6/d6b/d8b/f91 x:0 0 0 2023-01-04T18:17:01.740 INFO:tasks.workunit.client.0.smithi050.stdout:3/403: link d0/d10/l8d d0/d1b/d2f/d56/d32/l91 0 2023-01-04T18:17:01.743 INFO:tasks.workunit.client.0.smithi050.stdout:8/405: dwrite d3/d2a/d30/d3b/f79 [0,4194304] 0 2023-01-04T18:17:01.743 INFO:tasks.workunit.client.0.smithi050.stdout:8/406: truncate d3/d2a/d30/d3b/d4d/f88 429182 0 2023-01-04T18:17:01.744 INFO:tasks.workunit.client.0.smithi050.stdout:2/363: mknod d1/dd/d11/d1e/d6e/c73 0 2023-01-04T18:17:01.744 INFO:tasks.workunit.client.0.smithi050.stdout:6/342: write d0/f2f [1162806,55767] 0 2023-01-04T18:17:01.752 INFO:tasks.workunit.client.0.smithi050.stdout:7/415: link d6/d28/d32/c34 d6/db/d20/c92 0 2023-01-04T18:17:01.753 INFO:tasks.workunit.client.0.smithi050.stdout:3/404: symlink d0/d1b/d2f/d56/d32/l92 0 2023-01-04T18:17:01.756 INFO:tasks.workunit.client.0.smithi050.stdout:8/407: creat d3/d2a/f90 x:0 0 0 2023-01-04T18:17:01.756 INFO:tasks.workunit.client.0.smithi050.stdout:8/408: write d3/d2a/d30/d3b/d4d/d1b/f7d [787460,49389] 0 2023-01-04T18:17:01.758 INFO:tasks.workunit.client.0.smithi050.stdout:6/343: mkdir d0/d9/d38/d16/d77 0 2023-01-04T18:17:01.759 INFO:tasks.workunit.client.0.smithi050.stdout:7/416: link d6/db/f2a d6/d1d/d1f/d80/f93 0 2023-01-04T18:17:01.762 INFO:tasks.workunit.client.0.smithi050.stdout:3/405: creat d0/d8f/f93 x:0 0 0 2023-01-04T18:17:01.762 INFO:tasks.workunit.client.0.smithi050.stdout:6/344: symlink d0/d9/d25/l78 0 2023-01-04T18:17:01.762 INFO:tasks.workunit.client.0.smithi050.stdout:6/345: chown d0/d9/d25/d4d/f6e 19 1 2023-01-04T18:17:01.764 INFO:tasks.workunit.client.0.smithi050.stdout:3/406: rename d0/d1b/d2f/d76/c7a to d0/d1b/d2f/d56/d6b/d7f/c94 0 2023-01-04T18:17:01.765 INFO:tasks.workunit.client.0.smithi050.stdout:6/346: unlink d0/l6d 0 2023-01-04T18:17:01.768 INFO:tasks.workunit.client.0.smithi050.stdout:3/407: write d0/f40 [4683697,127014] 0 2023-01-04T18:17:01.769 INFO:tasks.workunit.client.0.smithi050.stdout:6/347: read d0/d9/f17 [753225,58707] 0 2023-01-04T18:17:01.770 INFO:tasks.workunit.client.0.smithi050.stdout:3/408: creat d0/dd/d45/f95 x:0 0 0 2023-01-04T18:17:01.770 INFO:tasks.workunit.client.0.smithi050.stdout:1/370: dwrite d8/d48/d5c/d67/d3a/d31/f64 [0,4194304] 0 2023-01-04T18:17:01.771 INFO:tasks.workunit.client.0.smithi050.stdout:8/409: dread d3/f68 [0,4194304] 0 2023-01-04T18:17:01.772 INFO:tasks.workunit.client.0.smithi050.stdout:6/348: mknod d0/d71/c79 0 2023-01-04T18:17:01.772 INFO:tasks.workunit.client.0.smithi050.stdout:3/409: mknod d0/d8f/d46/d80/c96 0 2023-01-04T18:17:01.775 INFO:tasks.workunit.client.0.smithi050.stdout:1/371: rename d8/d14/c47 to d8/d48/d5c/d67/c71 0 2023-01-04T18:17:01.776 INFO:tasks.workunit.client.0.smithi050.stdout:6/349: write d0/d9/f17 [1102937,123007] 0 2023-01-04T18:17:01.777 INFO:tasks.workunit.client.0.smithi050.stdout:6/350: write d0/f14 [83821,41786] 0 2023-01-04T18:17:01.778 INFO:tasks.workunit.client.0.smithi050.stdout:6/351: fdatasync d0/d9/d25/d4d/f6e 0 2023-01-04T18:17:01.778 INFO:tasks.workunit.client.0.smithi050.stdout:8/410: mknod d3/d2a/d73/c91 0 2023-01-04T18:17:01.779 INFO:tasks.workunit.client.0.smithi050.stdout:4/381: dwrite d14/d1b/d1f/d63/f71 [0,4194304] 0 2023-01-04T18:17:01.780 INFO:tasks.workunit.client.0.smithi050.stdout:3/410: rename d0/f18 to d0/d1b/d2f/d31/f97 0 2023-01-04T18:17:01.782 INFO:tasks.workunit.client.0.smithi050.stdout:2/364: dwrite d1/dd/d11/d1e/f25 [0,4194304] 0 2023-01-04T18:17:01.783 INFO:tasks.workunit.client.0.smithi050.stdout:7/417: dwrite d6/d28/f2c [0,4194304] 0 2023-01-04T18:17:01.786 INFO:tasks.workunit.client.0.smithi050.stdout:8/411: mkdir d3/d2a/d74/d92 0 2023-01-04T18:17:01.786 INFO:tasks.workunit.client.0.smithi050.stdout:8/412: chown d3/d2a/d30/d3b/d4d/d1b/d7f 120205782 1 2023-01-04T18:17:01.791 INFO:tasks.workunit.client.0.smithi050.stdout:4/382: creat d14/d1b/d1f/d22/d3e/d44/d59/d5f/f78 x:0 0 0 2023-01-04T18:17:01.796 INFO:tasks.workunit.client.0.smithi050.stdout:3/411: mkdir d0/d1b/d2f/d56/d98 0 2023-01-04T18:17:01.798 INFO:tasks.workunit.client.0.smithi050.stdout:2/365: creat d1/dd/f74 x:0 0 0 2023-01-04T18:17:01.798 INFO:tasks.workunit.client.0.smithi050.stdout:2/366: chown d1/dd/d11/d1e/d6e 179407473 1 2023-01-04T18:17:01.799 INFO:tasks.workunit.client.0.smithi050.stdout:7/418: rename d6/db/d15/c41 to d6/d1d/d1f/d80/c94 0 2023-01-04T18:17:01.800 INFO:tasks.workunit.client.0.smithi050.stdout:7/419: write d6/db/f40 [38387,57547] 0 2023-01-04T18:17:01.801 INFO:tasks.workunit.client.0.smithi050.stdout:3/412: link d0/d10/f42 d0/d1b/d2f/d56/d6b/f99 0 2023-01-04T18:17:01.803 INFO:tasks.workunit.client.0.smithi050.stdout:1/372: dwrite d8/d48/d5c/d67/d3a/f70 [0,4194304] 0 2023-01-04T18:17:01.803 INFO:tasks.workunit.client.0.smithi050.stdout:2/367: creat d1/dd/d38/f75 x:0 0 0 2023-01-04T18:17:01.804 INFO:tasks.workunit.client.0.smithi050.stdout:6/352: dwrite d0/d9/df/f22 [0,4194304] 0 2023-01-04T18:17:01.807 INFO:tasks.workunit.client.0.smithi050.stdout:6/353: fsync d0/d9/f17 0 2023-01-04T18:17:01.809 INFO:tasks.workunit.client.0.smithi050.stdout:6/354: write d0/d9/df/f52 [2200604,51829] 0 2023-01-04T18:17:01.809 INFO:tasks.workunit.client.0.smithi050.stdout:6/355: fdatasync d0/d5c/d5d/f6a 0 2023-01-04T18:17:01.810 INFO:tasks.workunit.client.0.smithi050.stdout:8/413: rename d3/d2a/d30/d3b/d4d/d1b to d3/d2a/d27/d93 0 2023-01-04T18:17:01.810 INFO:tasks.workunit.client.0.smithi050.stdout:4/383: rename d14/d1b/d1f/d22/d3e to d14/d1b/d1f/d22/d3e/d44/d59/d79 22 2023-01-04T18:17:01.810 INFO:tasks.workunit.client.0.smithi050.stdout:4/384: chown d14/d1b/d32/c4c 165 1 2023-01-04T18:17:01.811 INFO:tasks.workunit.client.0.smithi050.stdout:7/420: symlink d6/db/d3b/l95 0 2023-01-04T18:17:01.811 INFO:tasks.workunit.client.0.smithi050.stdout:7/421: write d6/f31 [4125142,104679] 0 2023-01-04T18:17:01.815 INFO:tasks.workunit.client.0.smithi050.stdout:3/413: stat d0/c8 0 2023-01-04T18:17:01.820 INFO:tasks.workunit.client.0.smithi050.stdout:1/373: mkdir d8/d48/d5c/d67/d3a/d58/d72 0 2023-01-04T18:17:01.820 INFO:tasks.workunit.client.0.smithi050.stdout:1/374: truncate d8/d48/d5c/d67/f33 4564250 0 2023-01-04T18:17:01.820 INFO:tasks.workunit.client.0.smithi050.stdout:1/375: dread - d8/d14/f63 zero size 2023-01-04T18:17:01.823 INFO:tasks.workunit.client.0.smithi050.stdout:2/368: creat d1/dd/d11/d14/f76 x:0 0 0 2023-01-04T18:17:01.826 INFO:tasks.workunit.client.0.smithi050.stdout:4/385: mknod d14/d1b/d1f/d63/c7a 0 2023-01-04T18:17:01.828 INFO:tasks.workunit.client.0.smithi050.stdout:7/422: creat d6/d28/d3c/f96 x:0 0 0 2023-01-04T18:17:01.828 INFO:tasks.workunit.client.0.smithi050.stdout:7/423: truncate d6/db/d3b/f61 356772 0 2023-01-04T18:17:01.833 INFO:tasks.workunit.client.0.smithi050.stdout:3/414: creat d0/dd/d45/f9a x:0 0 0 2023-01-04T18:17:01.837 INFO:tasks.workunit.client.0.smithi050.stdout:2/369: rename d1/dd/d11/d14/f50 to d1/dd/d62/f77 0 2023-01-04T18:17:01.838 INFO:tasks.workunit.client.0.smithi050.stdout:8/414: dwrite d3/f25 [0,4194304] 0 2023-01-04T18:17:01.838 INFO:tasks.workunit.client.0.smithi050.stdout:4/386: write d14/d1b/d32/f45 [584771,43406] 0 2023-01-04T18:17:01.838 INFO:tasks.workunit.client.0.smithi050.stdout:4/387: chown d14/d1b/d1f/f57 85743 1 2023-01-04T18:17:01.839 INFO:tasks.workunit.client.0.smithi050.stdout:4/388: read d14/d1b/d1f/d22/d6a/f6b [1096,77238] 0 2023-01-04T18:17:01.842 INFO:tasks.workunit.client.0.smithi050.stdout:6/356: dwrite d0/d9/d38/d16/f3f [0,4194304] 0 2023-01-04T18:17:01.843 INFO:tasks.workunit.client.0.smithi050.stdout:7/424: symlink d6/db/d15/d1b/l97 0 2023-01-04T18:17:01.845 INFO:tasks.workunit.client.0.smithi050.stdout:1/376: dwrite d8/f4d [4194304,4194304] 0 2023-01-04T18:17:01.845 INFO:tasks.workunit.client.0.smithi050.stdout:3/415: mknod d0/d1b/d2f/c9b 0 2023-01-04T18:17:01.854 INFO:tasks.workunit.client.0.smithi050.stdout:8/415: dread d3/d2a/d30/f3f [0,4194304] 0 2023-01-04T18:17:01.856 INFO:tasks.workunit.client.0.smithi050.stdout:8/416: read d3/d2a/d60/f40 [3564753,110152] 0 2023-01-04T18:17:01.856 INFO:tasks.workunit.client.0.smithi050.stdout:8/417: readlink d3/l3a 0 2023-01-04T18:17:01.869 INFO:tasks.workunit.client.0.smithi050.stdout:1/377: dwrite d8/d14/d1c/d28/f2b [0,4194304] 0 2023-01-04T18:17:01.870 INFO:tasks.workunit.client.0.smithi050.stdout:2/370: dwrite d1/d19/d5a/f6f [0,4194304] 0 2023-01-04T18:17:01.870 INFO:tasks.workunit.client.0.smithi050.stdout:6/357: dwrite d0/f2e [0,4194304] 0 2023-01-04T18:17:01.883 INFO:tasks.workunit.client.0.smithi050.stdout:6/358: dread d0/d9/f17 [0,4194304] 0 2023-01-04T18:17:01.884 INFO:tasks.workunit.client.0.smithi050.stdout:6/359: chown d0/d9/d38/d16/d6b 71364 1 2023-01-04T18:17:01.884 INFO:tasks.workunit.client.0.smithi050.stdout:6/360: fdatasync d0/d9/f17 0 2023-01-04T18:17:01.898 INFO:tasks.workunit.client.0.smithi050.stdout:6/361: dwrite d0/f65 [0,4194304] 0 2023-01-04T18:17:01.933 INFO:tasks.workunit.client.0.smithi050.stdout:7/425: symlink d6/d90/l98 0 2023-01-04T18:17:01.933 INFO:tasks.workunit.client.0.smithi050.stdout:7/426: chown d6/l14 484 1 2023-01-04T18:17:01.934 INFO:tasks.workunit.client.0.smithi050.stdout:5/525: sync 2023-01-04T18:17:01.934 INFO:tasks.workunit.client.0.smithi050.stdout:0/315: sync 2023-01-04T18:17:01.934 INFO:tasks.workunit.client.0.smithi050.stdout:9/382: sync 2023-01-04T18:17:01.934 INFO:tasks.workunit.client.0.smithi050.stdout:9/383: chown d1/d12/d41/l6a 290578232 1 2023-01-04T18:17:01.935 INFO:tasks.workunit.client.0.smithi050.stdout:5/526: read d13/d15/d66/db8/d1f/d35/d42/f7a [1274592,10322] 0 2023-01-04T18:17:01.935 INFO:tasks.workunit.client.0.smithi050.stdout:3/416: rename d0/d1b/d2f/d76 to d0/d1b/d2f/d56/d98/d9c 0 2023-01-04T18:17:01.937 INFO:tasks.workunit.client.0.smithi050.stdout:8/418: mkdir d3/d2a/d74/d92/d94 0 2023-01-04T18:17:01.938 INFO:tasks.workunit.client.0.smithi050.stdout:8/419: stat d3/d2a/d30/d3b/d4d/d23/d55 0 2023-01-04T18:17:01.938 INFO:tasks.workunit.client.0.smithi050.stdout:1/378: creat d8/d14/d1c/f73 x:0 0 0 2023-01-04T18:17:01.939 INFO:tasks.workunit.client.0.smithi050.stdout:1/379: write d8/d14/f30 [238276,64842] 0 2023-01-04T18:17:01.977 INFO:tasks.workunit.client.0.smithi050.stdout:8/420: dwrite d3/d2a/f90 [0,4194304] 0 2023-01-04T18:17:01.977 INFO:tasks.workunit.client.0.smithi050.stdout:8/421: fdatasync d3/d2a/d30/f3f 0 2023-01-04T18:17:02.007 INFO:tasks.workunit.client.0.smithi050.stdout:5/527: dwrite d13/d15/f26 [0,4194304] 0 2023-01-04T18:17:02.014 INFO:tasks.workunit.client.0.smithi050.stdout:1/380: dwrite d8/d14/d1c/f5d [0,4194304] 0 2023-01-04T18:17:02.023 INFO:tasks.workunit.client.0.smithi050.stdout:2/371: link d1/dd/d11/f26 d1/d10/f78 0 2023-01-04T18:17:02.035 INFO:tasks.workunit.client.0.smithi050.stdout:6/362: rmdir d0/d9/d38/d1c/d54 39 2023-01-04T18:17:02.036 INFO:tasks.workunit.client.0.smithi050.stdout:6/363: dread - d0/d9/d25/d4d/f6e zero size 2023-01-04T18:17:02.036 INFO:tasks.workunit.client.0.smithi050.stdout:6/364: fdatasync d0/d9/d25/f64 0 2023-01-04T18:17:02.042 INFO:tasks.workunit.client.0.smithi050.stdout:9/384: mkdir d1/d3/d24/d7b 0 2023-01-04T18:17:02.048 INFO:tasks.workunit.client.0.smithi050.stdout:7/427: rename d6/db/d3b/d5c to d6/d28/d99 0 2023-01-04T18:17:02.048 INFO:tasks.workunit.client.0.smithi050.stdout:7/428: chown d6/db/d15/d1b 40 1 2023-01-04T18:17:02.048 INFO:tasks.workunit.client.0.smithi050.stdout:7/429: chown d6/d1d/d1f/l38 110 1 2023-01-04T18:17:02.048 INFO:tasks.workunit.client.0.smithi050.stdout:7/430: readlink d6/db/d15/l30 0 2023-01-04T18:17:02.048 INFO:tasks.workunit.client.0.smithi050.stdout:7/431: write d6/db/f2a [4125244,121642] 0 2023-01-04T18:17:02.053 INFO:tasks.workunit.client.0.smithi050.stdout:8/422: mknod d3/d2a/d27/d93/c95 0 2023-01-04T18:17:02.058 INFO:tasks.workunit.client.0.smithi050.stdout:5/528: stat d13/d15/d66/db8/l24 0 2023-01-04T18:17:02.058 INFO:tasks.workunit.client.0.smithi050.stdout:5/529: dread - d13/d15/d66/db8/d27/d46/f94 zero size 2023-01-04T18:17:02.060 INFO:tasks.workunit.client.0.smithi050.stdout:1/381: link d8/d14/d1c/d28/f59 d8/d14/f74 0 2023-01-04T18:17:02.066 INFO:tasks.workunit.client.0.smithi050.stdout:2/372: mkdir d1/dd/d28/d79 0 2023-01-04T18:17:02.066 INFO:tasks.workunit.client.0.smithi050.stdout:2/373: chown d1/dd/d28/d2c/d2e/d36/f5b 7 1 2023-01-04T18:17:02.068 INFO:tasks.workunit.client.0.smithi050.stdout:6/365: mkdir d0/d9/d38/d60/d7a 0 2023-01-04T18:17:02.071 INFO:tasks.workunit.client.0.smithi050.stdout:9/385: mkdir d1/d12/d41/d60/d7c 0 2023-01-04T18:17:02.071 INFO:tasks.workunit.client.0.smithi050.stdout:9/386: truncate d1/d3/f5c 411057 0 2023-01-04T18:17:02.075 INFO:tasks.workunit.client.0.smithi050.stdout:0/316: rename d0/d6/d8/l4c to d0/d6/d28/d1a/l62 0 2023-01-04T18:17:02.075 INFO:tasks.workunit.client.0.smithi050.stdout:5/530: rename d13/d15 to d13/d15/d66/db8/d27/d78/dbb 22 2023-01-04T18:17:02.077 INFO:tasks.workunit.client.0.smithi050.stdout:7/432: truncate d6/db/d15/d48/f58 1330480 0 2023-01-04T18:17:02.078 INFO:tasks.workunit.client.0.smithi050.stdout:8/423: getdents d3/d2a/d30/d3b/d4d/d23/d55/d5f 0 2023-01-04T18:17:02.079 INFO:tasks.workunit.client.0.smithi050.stdout:2/374: mknod d1/dd/d11/d1e/d6e/c7a 0 2023-01-04T18:17:02.081 INFO:tasks.workunit.client.0.smithi050.stdout:1/382: dwrite d8/d14/d1c/d28/f59 [4194304,4194304] 0 2023-01-04T18:17:02.082 INFO:tasks.workunit.client.0.smithi050.stdout:1/383: read d8/d14/f74 [8329716,91269] 0 2023-01-04T18:17:02.082 INFO:tasks.workunit.client.0.smithi050.stdout:1/384: readlink d8/d48/d5c/d67/d3a/d23/l2a 0 2023-01-04T18:17:02.087 INFO:tasks.workunit.client.0.smithi050.stdout:9/387: dread d1/d12/f44 [0,4194304] 0 2023-01-04T18:17:02.099 INFO:tasks.workunit.client.0.smithi050.stdout:2/375: dread d1/dd/f4a [0,4194304] 0 2023-01-04T18:17:02.099 INFO:tasks.workunit.client.0.smithi050.stdout:2/376: write d1/dd/d28/d2c/d2e/d36/f51 [1281818,109346] 0 2023-01-04T18:17:02.099 INFO:tasks.workunit.client.0.smithi050.stdout:2/377: write d1/dd/d28/d2c/d2e/d3f/f64 [317961,46358] 0 2023-01-04T18:17:02.104 INFO:tasks.workunit.client.0.smithi050.stdout:6/366: dwrite d0/d9/df/f22 [4194304,4194304] 0 2023-01-04T18:17:02.105 INFO:tasks.workunit.client.0.smithi050.stdout:6/367: fsync d0/d9/df/f70 0 2023-01-04T18:17:02.105 INFO:tasks.workunit.client.0.smithi050.stdout:7/433: dwrite d6/db/d15/d1b/d22/f37 [4194304,4194304] 0 2023-01-04T18:17:02.118 INFO:tasks.workunit.client.0.smithi050.stdout:5/531: mkdir d13/d15/d66/db8/d27/d46/d4e/d4d/db1/dbc 0 2023-01-04T18:17:02.118 INFO:tasks.workunit.client.0.smithi050.stdout:6/368: dwrite d0/d9/df/f47 [0,4194304] 0 2023-01-04T18:17:02.118 INFO:tasks.workunit.client.0.smithi050.stdout:6/369: write d0/f6f [852695,4229] 0 2023-01-04T18:17:02.119 INFO:tasks.workunit.client.0.smithi050.stdout:6/370: dread - d0/d5c/d5d/f6a zero size 2023-01-04T18:17:02.119 INFO:tasks.workunit.client.0.smithi050.stdout:6/371: dread - d0/d5c/d5d/f6a zero size 2023-01-04T18:17:02.119 INFO:tasks.workunit.client.0.smithi050.stdout:6/372: fdatasync d0/d9/d38/d1c/f26 0 2023-01-04T18:17:02.119 INFO:tasks.workunit.client.0.smithi050.stdout:8/424: getdents d3/d2a/d30/d3b/d53 0 2023-01-04T18:17:02.177 INFO:tasks.workunit.client.0.smithi050.stdout:1/385: link d8/d14/d1c/l2e d8/d48/l75 0 2023-01-04T18:17:02.182 INFO:tasks.workunit.client.0.smithi050.stdout:9/388: symlink d1/d3/l7d 0 2023-01-04T18:17:02.183 INFO:tasks.workunit.client.0.smithi050.stdout:2/378: symlink d1/dd/d11/d1e/d6e/l7b 0 2023-01-04T18:17:02.183 INFO:tasks.workunit.client.0.smithi050.stdout:2/379: fsync d1/dd/d11/f26 0 2023-01-04T18:17:02.209 INFO:tasks.workunit.client.0.smithi050.stdout:7/434: symlink d6/db/d20/d55/l9a 0 2023-01-04T18:17:02.214 INFO:tasks.workunit.client.0.smithi050.stdout:2/380: dwrite d1/dd/d28/d2c/f45 [0,4194304] 0 2023-01-04T18:17:02.214 INFO:tasks.workunit.client.0.smithi050.stdout:2/381: dread - d1/dd/d11/d12/f59 zero size 2023-01-04T18:17:02.214 INFO:tasks.workunit.client.0.smithi050.stdout:1/386: dwrite d8/d14/f5b [0,4194304] 0 2023-01-04T18:17:02.214 INFO:tasks.workunit.client.0.smithi050.stdout:1/387: chown d8/c42 7471638 1 2023-01-04T18:17:02.214 INFO:tasks.workunit.client.0.smithi050.stdout:6/373: truncate d0/d9/d38/f5b 534717 0 2023-01-04T18:17:02.214 INFO:tasks.workunit.client.0.smithi050.stdout:6/374: chown d0/d9/d38/f5b 3589 1 2023-01-04T18:17:02.221 INFO:tasks.workunit.client.0.smithi050.stdout:7/435: dread d6/f7 [0,4194304] 0 2023-01-04T18:17:02.229 INFO:tasks.workunit.client.0.smithi050.stdout:2/382: dwrite d1/dd/d28/d2c/f63 [0,4194304] 0 2023-01-04T18:17:02.230 INFO:tasks.workunit.client.0.smithi050.stdout:2/383: chown d1/d19/f5f 57 1 2023-01-04T18:17:02.236 INFO:tasks.workunit.client.0.smithi050.stdout:2/384: dread d1/dd/d28/f43 [0,4194304] 0 2023-01-04T18:17:02.261 INFO:tasks.workunit.client.0.smithi050.stdout:9/389: creat d1/d12/d41/d60/d7c/f7e x:0 0 0 2023-01-04T18:17:02.267 INFO:tasks.workunit.client.0.smithi050.stdout:7/436: creat d6/db/d15/f9b x:0 0 0 2023-01-04T18:17:02.268 INFO:tasks.workunit.client.0.smithi050.stdout:8/425: dread d3/d2a/d60/f71 [0,4194304] 0 2023-01-04T18:17:02.270 INFO:tasks.workunit.client.0.smithi050.stdout:4/389: sync 2023-01-04T18:17:02.275 INFO:tasks.workunit.client.0.smithi050.stdout:3/417: sync 2023-01-04T18:17:02.302 INFO:tasks.workunit.client.0.smithi050.stdout:3/418: dwrite d0/f5e [0,4194304] 0 2023-01-04T18:17:02.309 INFO:tasks.workunit.client.0.smithi050.stdout:3/419: dread d0/fe [0,4194304] 0 2023-01-04T18:17:02.314 INFO:tasks.workunit.client.0.smithi050.stdout:5/532: sync 2023-01-04T18:17:02.316 INFO:tasks.workunit.client.0.smithi050.stdout:0/317: sync 2023-01-04T18:17:02.317 INFO:tasks.workunit.client.0.smithi050.stdout:2/385: truncate d1/dd/d11/f27 4789846 0 2023-01-04T18:17:02.318 INFO:tasks.workunit.client.0.smithi050.stdout:1/388: dread d8/d48/d5c/f65 [0,4194304] 0 2023-01-04T18:17:02.323 INFO:tasks.workunit.client.0.smithi050.stdout:4/390: mknod d14/d1b/d1f/d63/c7b 0 2023-01-04T18:17:02.329 INFO:tasks.workunit.client.0.smithi050.stdout:5/533: unlink d13/d15/d66/db8/d1f/d35/d42/f7a 0 2023-01-04T18:17:02.330 INFO:tasks.workunit.client.0.smithi050.stdout:5/534: readlink d13/d28/l72 0 2023-01-04T18:17:02.334 INFO:tasks.workunit.client.0.smithi050.stdout:9/390: rename d1/d3/l54 to d1/d3/d11/l7f 0 2023-01-04T18:17:02.334 INFO:tasks.workunit.client.0.smithi050.stdout:9/391: write d1/d3/f18 [615633,48926] 0 2023-01-04T18:17:02.338 INFO:tasks.workunit.client.0.smithi050.stdout:2/386: unlink d1/dd/d28/d2c/d2e/d36/f5b 0 2023-01-04T18:17:02.341 INFO:tasks.workunit.client.0.smithi050.stdout:1/389: rmdir d8/d48/d5c/d67/d3b 39 2023-01-04T18:17:02.348 INFO:tasks.workunit.client.0.smithi050.stdout:8/426: rename d3/d5 to d3/d2a/d27/d93/d7f/d96 0 2023-01-04T18:17:02.349 INFO:tasks.workunit.client.0.smithi050.stdout:8/427: fdatasync d3/d2a/d60/f40 0 2023-01-04T18:17:02.349 INFO:tasks.workunit.client.0.smithi050.stdout:8/428: write d3/d2a/d27/f33 [2411504,60798] 0 2023-01-04T18:17:02.350 INFO:tasks.workunit.client.0.smithi050.stdout:8/429: truncate d3/d2a/d27/d93/f7d 1294814 0 2023-01-04T18:17:02.351 INFO:tasks.workunit.client.0.smithi050.stdout:0/318: dwrite d0/d6/fa [0,4194304] 0 2023-01-04T18:17:02.352 INFO:tasks.workunit.client.0.smithi050.stdout:8/430: creat d3/d2a/d30/d3b/d53/f97 x:0 0 0 2023-01-04T18:17:02.352 INFO:tasks.workunit.client.0.smithi050.stdout:3/420: rename d0/d10/l1f to d0/d1b/l9d 0 2023-01-04T18:17:02.357 INFO:tasks.workunit.client.0.smithi050.stdout:8/431: dread d3/d2a/d30/f3f [0,4194304] 0 2023-01-04T18:17:02.357 INFO:tasks.workunit.client.0.smithi050.stdout:8/432: chown d3/d2a/d2d/d85 882788889 1 2023-01-04T18:17:02.357 INFO:tasks.workunit.client.0.smithi050.stdout:8/433: readlink d3/d2a/d60/l69 0 2023-01-04T18:17:02.357 INFO:tasks.workunit.client.0.smithi050.stdout:8/434: dread - d3/d2a/f89 zero size 2023-01-04T18:17:02.358 INFO:tasks.workunit.client.0.smithi050.stdout:5/535: dwrite d13/d28/fa4 [0,4194304] 0 2023-01-04T18:17:02.360 INFO:tasks.workunit.client.0.smithi050.stdout:4/391: rename d14/d1b/d32/f3c to d14/d1b/d1f/d22/f7c 0 2023-01-04T18:17:02.360 INFO:tasks.workunit.client.0.smithi050.stdout:0/319: mknod d0/d6/d8/d25/c63 0 2023-01-04T18:17:02.361 INFO:tasks.workunit.client.0.smithi050.stdout:3/421: truncate d0/d1a/f24 4136023 0 2023-01-04T18:17:02.368 INFO:tasks.workunit.client.0.smithi050.stdout:5/536: creat d13/fbd x:0 0 0 2023-01-04T18:17:02.371 INFO:tasks.workunit.client.0.smithi050.stdout:9/392: rename d1/d3/d13/f36 to d1/d12/d41/d60/d75/f80 0 2023-01-04T18:17:02.376 INFO:tasks.workunit.client.0.smithi050.stdout:8/435: dwrite d3/d2a/f24 [4194304,4194304] 0 2023-01-04T18:17:02.376 INFO:tasks.workunit.client.0.smithi050.stdout:8/436: chown d3/d2a/d30/d3b/d53/f97 3 1 2023-01-04T18:17:02.376 INFO:tasks.workunit.client.0.smithi050.stdout:8/437: truncate d3/d2a/d60/f39 5200801 0 2023-01-04T18:17:02.376 INFO:tasks.workunit.client.0.smithi050.stdout:9/393: write d1/d12/f22 [7033285,76494] 0 2023-01-04T18:17:02.377 INFO:tasks.workunit.client.0.smithi050.stdout:0/320: dwrite d0/d6/f58 [0,4194304] 0 2023-01-04T18:17:02.381 INFO:tasks.workunit.client.0.smithi050.stdout:4/392: dread f11 [0,4194304] 0 2023-01-04T18:17:02.382 INFO:tasks.workunit.client.0.smithi050.stdout:0/321: dread d0/d6/d28/d1a/f23 [0,4194304] 0 2023-01-04T18:17:02.386 INFO:tasks.workunit.client.0.smithi050.stdout:3/422: creat d0/d1b/d2f/f9e x:0 0 0 2023-01-04T18:17:02.386 INFO:tasks.workunit.client.0.smithi050.stdout:4/393: dread d14/d1b/d1f/d22/f7c [0,4194304] 0 2023-01-04T18:17:02.387 INFO:tasks.workunit.client.0.smithi050.stdout:5/537: mkdir d13/d15/d66/db8/d1f/d35/d59/d87/dbe 0 2023-01-04T18:17:02.391 INFO:tasks.workunit.client.0.smithi050.stdout:2/387: rename d1/dd/d28/d2c/d2e/l49 to d1/d19/l7c 0 2023-01-04T18:17:02.391 INFO:tasks.workunit.client.0.smithi050.stdout:2/388: chown d1/dd/d11/f65 0 1 2023-01-04T18:17:02.393 INFO:tasks.workunit.client.0.smithi050.stdout:4/394: dread d14/f15 [0,4194304] 0 2023-01-04T18:17:02.400 INFO:tasks.workunit.client.0.smithi050.stdout:8/438: mknod d3/d2a/d74/d92/c98 0 2023-01-04T18:17:02.400 INFO:tasks.workunit.client.0.smithi050.stdout:6/375: sync 2023-01-04T18:17:02.400 INFO:tasks.workunit.client.0.smithi050.stdout:6/376: readlink d0/d4a/l50 0 2023-01-04T18:17:02.404 INFO:tasks.workunit.client.0.smithi050.stdout:5/538: dwrite d13/d15/f34 [0,4194304] 0 2023-01-04T18:17:02.404 INFO:tasks.workunit.client.0.smithi050.stdout:5/539: fsync d13/d15/d66/db8/d1f/d35/fa2 0 2023-01-04T18:17:02.411 INFO:tasks.workunit.client.0.smithi050.stdout:5/540: dread d13/d15/d66/db8/d1f/d35/d42/d4a/f5a [0,4194304] 0 2023-01-04T18:17:02.412 INFO:tasks.workunit.client.0.smithi050.stdout:0/322: symlink d0/l64 0 2023-01-04T18:17:02.416 INFO:tasks.workunit.client.0.smithi050.stdout:3/423: symlink d0/d10/l9f 0 2023-01-04T18:17:02.416 INFO:tasks.workunit.client.0.smithi050.stdout:1/390: rename d8/d14/f63 to d8/d14/d1c/f76 0 2023-01-04T18:17:02.416 INFO:tasks.workunit.client.0.smithi050.stdout:0/323: write d0/d6/d28/f60 [3432629,32933] 0 2023-01-04T18:17:02.416 INFO:tasks.workunit.client.0.smithi050.stdout:0/324: write d0/d6/d8/d35/f42 [1089993,13390] 0 2023-01-04T18:17:02.418 INFO:tasks.workunit.client.0.smithi050.stdout:2/389: rename d1/dd/d11/d1e/f22 to d1/dd/d11/d1e/f7d 0 2023-01-04T18:17:02.418 INFO:tasks.workunit.client.0.smithi050.stdout:2/390: write d1/dd/d11/f27 [5777512,36717] 0 2023-01-04T18:17:02.418 INFO:tasks.workunit.client.0.smithi050.stdout:2/391: chown d1/dd/d11/f27 39 1 2023-01-04T18:17:02.419 INFO:tasks.workunit.client.0.smithi050.stdout:8/439: mknod d3/d2a/d30/d3b/c99 0 2023-01-04T18:17:02.420 INFO:tasks.workunit.client.0.smithi050.stdout:7/437: sync 2023-01-04T18:17:02.420 INFO:tasks.workunit.client.0.smithi050.stdout:7/438: read d6/d28/f3d [3419294,49467] 0 2023-01-04T18:17:02.421 INFO:tasks.workunit.client.0.smithi050.stdout:7/439: read - d6/db/d15/d1b/d70/f85 zero size 2023-01-04T18:17:02.421 INFO:tasks.workunit.client.0.smithi050.stdout:7/440: write d6/db/d15/d1b/f8c [465100,31392] 0 2023-01-04T18:17:02.421 INFO:tasks.workunit.client.0.smithi050.stdout:7/441: readlink d6/l9 0 2023-01-04T18:17:02.421 INFO:tasks.workunit.client.0.smithi050.stdout:6/377: symlink d0/d5c/d5d/l7b 0 2023-01-04T18:17:02.425 INFO:tasks.workunit.client.0.smithi050.stdout:9/394: mknod d1/d3/d11/c81 0 2023-01-04T18:17:02.426 INFO:tasks.workunit.client.0.smithi050.stdout:5/541: creat d13/d15/d66/db8/d1f/d35/d42/d4a/fbf x:0 0 0 2023-01-04T18:17:02.433 INFO:tasks.workunit.client.0.smithi050.stdout:1/391: dwrite d8/d48/d5c/d67/f1f [8388608,4194304] 0 2023-01-04T18:17:02.433 INFO:tasks.workunit.client.0.smithi050.stdout:1/392: truncate d8/d48/d5c/d67/d3a/d58/f5a 4320142 0 2023-01-04T18:17:02.433 INFO:tasks.workunit.client.0.smithi050.stdout:1/393: truncate d8/d14/d1c/d28/d57/f61 953366 0 2023-01-04T18:17:02.433 INFO:tasks.workunit.client.0.smithi050.stdout:3/424: rename d0/d1b/d2f/d56/d98/d9c/l77 to d0/d1b/d2f/d56/d98/d9c/la0 0 2023-01-04T18:17:02.436 INFO:tasks.workunit.client.0.smithi050.stdout:4/395: rename d14/d1b/d1f/f26 to d14/d1b/d1f/d22/d3e/d44/f7d 0 2023-01-04T18:17:02.438 INFO:tasks.workunit.client.0.smithi050.stdout:1/394: write d8/d48/d5c/d67/d3a/d58/f5a [3497781,47166] 0 2023-01-04T18:17:02.441 INFO:tasks.workunit.client.0.smithi050.stdout:9/395: dwrite d1/d3/d24/f55 [0,4194304] 0 2023-01-04T18:17:02.441 INFO:tasks.workunit.client.0.smithi050.stdout:9/396: fsync d1/d3/d13/f15 0 2023-01-04T18:17:02.444 INFO:tasks.workunit.client.0.smithi050.stdout:0/325: symlink d0/d6/d8/d25/d3e/l65 0 2023-01-04T18:17:02.448 INFO:tasks.workunit.client.0.smithi050.stdout:4/396: dwrite d14/d1b/d1f/d22/f4d [0,4194304] 0 2023-01-04T18:17:02.449 INFO:tasks.workunit.client.0.smithi050.stdout:4/397: write d14/d1b/d1f/d22/f7c [2231605,127896] 0 2023-01-04T18:17:02.451 INFO:tasks.workunit.client.0.smithi050.stdout:8/440: creat d3/d2a/d27/d93/d7f/d96/f9a x:0 0 0 2023-01-04T18:17:02.454 INFO:tasks.workunit.client.0.smithi050.stdout:6/378: truncate d0/f14 2178093 0 2023-01-04T18:17:02.456 INFO:tasks.workunit.client.0.smithi050.stdout:7/442: dread d6/db/d15/d1b/d22/f54 [0,4194304] 0 2023-01-04T18:17:02.456 INFO:tasks.workunit.client.0.smithi050.stdout:4/398: dread f3 [0,4194304] 0 2023-01-04T18:17:02.459 INFO:tasks.workunit.client.0.smithi050.stdout:5/542: mkdir d13/d15/d63/dc0 0 2023-01-04T18:17:02.459 INFO:tasks.workunit.client.0.smithi050.stdout:5/543: fdatasync d13/f19 0 2023-01-04T18:17:02.459 INFO:tasks.workunit.client.0.smithi050.stdout:3/425: rmdir d0/d8f/d46 39 2023-01-04T18:17:02.469 INFO:tasks.workunit.client.0.smithi050.stdout:1/395: creat d8/d14/d1c/d28/d57/d6a/f77 x:0 0 0 2023-01-04T18:17:02.469 INFO:tasks.workunit.client.0.smithi050.stdout:1/396: truncate d8/d14/f46 4859117 0 2023-01-04T18:17:02.469 INFO:tasks.workunit.client.0.smithi050.stdout:1/397: chown d8/d48/d5c/d67/d3b/f68 10786859 1 2023-01-04T18:17:02.473 INFO:tasks.workunit.client.0.smithi050.stdout:9/397: creat d1/d12/d2d/d39/f82 x:0 0 0 2023-01-04T18:17:02.475 INFO:tasks.workunit.client.0.smithi050.stdout:0/326: creat d0/d6/d8/d35/f66 x:0 0 0 2023-01-04T18:17:02.480 INFO:tasks.workunit.client.0.smithi050.stdout:6/379: dwrite d0/d9/d38/d1c/d54/f63 [0,4194304] 0 2023-01-04T18:17:02.480 INFO:tasks.workunit.client.0.smithi050.stdout:7/443: dwrite d6/d28/d3c/d42/d5f/f6f [0,4194304] 0 2023-01-04T18:17:02.480 INFO:tasks.workunit.client.0.smithi050.stdout:7/444: chown d6/db/d20/d55/f5e 0 1 2023-01-04T18:17:02.480 INFO:tasks.workunit.client.0.smithi050.stdout:6/380: fsync d0/d9/d25/f39 0 2023-01-04T18:17:02.481 INFO:tasks.workunit.client.0.smithi050.stdout:1/398: dread d8/f4d [8388608,4194304] 0 2023-01-04T18:17:02.482 INFO:tasks.workunit.client.0.smithi050.stdout:8/441: creat d3/d2a/f9b x:0 0 0 2023-01-04T18:17:02.484 INFO:tasks.workunit.client.0.smithi050.stdout:4/399: getdents d14/d1b/d1f/d22/d3e 0 2023-01-04T18:17:02.485 INFO:tasks.workunit.client.0.smithi050.stdout:3/426: rmdir d0/d10 39 2023-01-04T18:17:02.486 INFO:tasks.workunit.client.0.smithi050.stdout:4/400: write d14/f21 [509478,12783] 0 2023-01-04T18:17:02.490 INFO:tasks.workunit.client.0.smithi050.stdout:2/392: rename d1/d10/l16 to d1/l7e 0 2023-01-04T18:17:02.494 INFO:tasks.workunit.client.0.smithi050.stdout:0/327: mkdir d0/d6/d8/d35/d67 0 2023-01-04T18:17:02.494 INFO:tasks.workunit.client.0.smithi050.stdout:9/398: dread d1/d12/f22 [4194304,4194304] 0 2023-01-04T18:17:02.494 INFO:tasks.workunit.client.0.smithi050.stdout:4/401: dread d14/d1b/d1f/d22/d6a/f6b [0,4194304] 0 2023-01-04T18:17:02.501 INFO:tasks.workunit.client.0.smithi050.stdout:6/381: unlink d0/d9/d25/d2d/c55 0 2023-01-04T18:17:02.502 INFO:tasks.workunit.client.0.smithi050.stdout:7/445: dwrite d6/db/d15/d48/f58 [0,4194304] 0 2023-01-04T18:17:02.502 INFO:tasks.workunit.client.0.smithi050.stdout:3/427: dwrite d0/dd/f90 [0,4194304] 0 2023-01-04T18:17:02.502 INFO:tasks.workunit.client.0.smithi050.stdout:3/428: readlink d0/d10/l69 0 2023-01-04T18:17:02.503 INFO:tasks.workunit.client.0.smithi050.stdout:1/399: link d8/d14/d1c/d28/f3f d8/d14/d1c/f78 0 2023-01-04T18:17:02.503 INFO:tasks.workunit.client.0.smithi050.stdout:1/400: chown d8/f6f 62763613 1 2023-01-04T18:17:02.503 INFO:tasks.workunit.client.0.smithi050.stdout:1/401: chown d8/d48/l5f 46136 1 2023-01-04T18:17:02.507 INFO:tasks.workunit.client.0.smithi050.stdout:8/442: mkdir d3/d2a/d74/d92/d94/d9c 0 2023-01-04T18:17:02.508 INFO:tasks.workunit.client.0.smithi050.stdout:4/402: dwrite d14/d1b/d1f/d22/d3e/d44/d59/d5f/f78 [0,4194304] 0 2023-01-04T18:17:02.511 INFO:tasks.workunit.client.0.smithi050.stdout:5/544: rename d13/d15/d66/db8/f40 to d13/d15/d66/db8/d27/d46/d4e/d4d/db1/fc1 0 2023-01-04T18:17:02.512 INFO:tasks.workunit.client.0.smithi050.stdout:5/545: write d13/d28/fa4 [6332809,77956] 0 2023-01-04T18:17:02.514 INFO:tasks.workunit.client.0.smithi050.stdout:2/393: mkdir d1/d19/d5a/d7f 0 2023-01-04T18:17:02.514 INFO:tasks.workunit.client.0.smithi050.stdout:2/394: chown d1/dd/d11/d14/d44/l5c 52409 1 2023-01-04T18:17:02.516 INFO:tasks.workunit.client.0.smithi050.stdout:0/328: mkdir d0/d6/d8/d25/d3e/d68 0 2023-01-04T18:17:02.517 INFO:tasks.workunit.client.0.smithi050.stdout:0/329: write d0/d6/d8/d35/f34 [3014356,120775] 0 2023-01-04T18:17:02.519 INFO:tasks.workunit.client.0.smithi050.stdout:6/382: creat d0/d9/d25/d4d/f7c x:0 0 0 2023-01-04T18:17:02.520 INFO:tasks.workunit.client.0.smithi050.stdout:6/383: read d0/d9/d38/d1c/d54/f63 [571231,32152] 0 2023-01-04T18:17:02.520 INFO:tasks.workunit.client.0.smithi050.stdout:6/384: stat d0/d9/l4c 0 2023-01-04T18:17:02.522 INFO:tasks.workunit.client.0.smithi050.stdout:7/446: mknod d6/d6b/d8b/c9c 0 2023-01-04T18:17:02.522 INFO:tasks.workunit.client.0.smithi050.stdout:7/447: truncate d6/d6b/d8b/f91 775668 0 2023-01-04T18:17:02.522 INFO:tasks.workunit.client.0.smithi050.stdout:7/448: chown d6/db/d15/d2e/d4b/l79 14872256 1 2023-01-04T18:17:02.523 INFO:tasks.workunit.client.0.smithi050.stdout:7/449: write d6/d28/d3c/f96 [719909,116969] 0 2023-01-04T18:17:02.528 INFO:tasks.workunit.client.0.smithi050.stdout:3/429: mknod d0/d8f/ca1 0 2023-01-04T18:17:02.535 INFO:tasks.workunit.client.0.smithi050.stdout:1/402: creat d8/d48/d5c/d67/d3a/f79 x:0 0 0 2023-01-04T18:17:02.539 INFO:tasks.workunit.client.0.smithi050.stdout:8/443: mknod d3/d2a/d30/d3b/d4d/d23/d55/d5f/d82/c9d 0 2023-01-04T18:17:02.539 INFO:tasks.workunit.client.0.smithi050.stdout:8/444: readlink d3/d2a/d30/d3b/d4d/d23/d55/d5f/l7b 0 2023-01-04T18:17:02.542 INFO:tasks.workunit.client.0.smithi050.stdout:4/403: mkdir d14/d1b/d1f/d22/d7e 0 2023-01-04T18:17:02.551 INFO:tasks.workunit.client.0.smithi050.stdout:9/399: rename d1/d12/d2d/f49 to d1/d12/d3f/f83 0 2023-01-04T18:17:02.551 INFO:tasks.workunit.client.0.smithi050.stdout:4/404: dread d14/d1b/d1f/d22/f4e [0,4194304] 0 2023-01-04T18:17:02.552 INFO:tasks.workunit.client.0.smithi050.stdout:9/400: write d1/d3/d3b/d63/f1c [4252068,111113] 0 2023-01-04T18:17:02.552 INFO:tasks.workunit.client.0.smithi050.stdout:5/546: creat d13/d15/d66/db8/d1f/d35/d42/fc2 x:0 0 0 2023-01-04T18:17:02.552 INFO:tasks.workunit.client.0.smithi050.stdout:5/547: fdatasync d13/d15/d66/db8/d1f/d35/f3f 0 2023-01-04T18:17:02.553 INFO:tasks.workunit.client.0.smithi050.stdout:5/548: chown d13/d15/d66/db8/d1f/fb7 233365484 1 2023-01-04T18:17:02.554 INFO:tasks.workunit.client.0.smithi050.stdout:0/330: creat d0/d6/d8/d4f/f69 x:0 0 0 2023-01-04T18:17:02.554 INFO:tasks.workunit.client.0.smithi050.stdout:0/331: readlink d0/l64 0 2023-01-04T18:17:02.554 INFO:tasks.workunit.client.0.smithi050.stdout:0/332: readlink d0/d6/d8/d51/l5d 0 2023-01-04T18:17:02.555 INFO:tasks.workunit.client.0.smithi050.stdout:4/405: write d14/d1b/d1f/d22/f42 [3644193,123888] 0 2023-01-04T18:17:02.556 INFO:tasks.workunit.client.0.smithi050.stdout:4/406: read d14/d1b/d1f/d22/f7c [1052518,108243] 0 2023-01-04T18:17:02.558 INFO:tasks.workunit.client.0.smithi050.stdout:6/385: getdents d0/d9/d38/d16 0 2023-01-04T18:17:02.558 INFO:tasks.workunit.client.0.smithi050.stdout:8/445: dwrite d3/d2a/d60/f39 [0,4194304] 0 2023-01-04T18:17:02.558 INFO:tasks.workunit.client.0.smithi050.stdout:8/446: fsync d3/d2a/d30/d3b/d4d/d23/d55/d5f/f8a 0 2023-01-04T18:17:02.559 INFO:tasks.workunit.client.0.smithi050.stdout:7/450: getdents d6/db/d15/d2e/d4b 0 2023-01-04T18:17:02.559 INFO:tasks.workunit.client.0.smithi050.stdout:7/451: stat d6/d6b/d8b/f91 0 2023-01-04T18:17:02.561 INFO:tasks.workunit.client.0.smithi050.stdout:3/430: symlink d0/d8f/la2 0 2023-01-04T18:17:02.562 INFO:tasks.workunit.client.0.smithi050.stdout:1/403: creat d8/d48/d5c/d67/d3a/d58/f7a x:0 0 0 2023-01-04T18:17:02.568 INFO:tasks.workunit.client.0.smithi050.stdout:2/395: rename d1/dd/d28/d2c/f4f to d1/dd/d11/d1e/d6e/f80 0 2023-01-04T18:17:02.569 INFO:tasks.workunit.client.0.smithi050.stdout:2/396: chown d1/dd/l53 7122 1 2023-01-04T18:17:02.571 INFO:tasks.workunit.client.0.smithi050.stdout:4/407: mkdir d14/d1b/d1f/d22/d3e/d44/d59/d5d/d7f 0 2023-01-04T18:17:02.571 INFO:tasks.workunit.client.0.smithi050.stdout:4/408: chown d14/d1b/d1f/d22/f34 211 1 2023-01-04T18:17:02.575 INFO:tasks.workunit.client.0.smithi050.stdout:6/386: mkdir d0/d9/df/d74/d7d 0 2023-01-04T18:17:02.578 INFO:tasks.workunit.client.0.smithi050.stdout:8/447: unlink d3/d2a/d30/d3b/d4d/c16 0 2023-01-04T18:17:02.579 INFO:tasks.workunit.client.0.smithi050.stdout:7/452: mkdir d6/d28/d32/d9d 0 2023-01-04T18:17:02.579 INFO:tasks.workunit.client.0.smithi050.stdout:7/453: stat d6/db/d15/d1b/d22/f37 0 2023-01-04T18:17:02.579 INFO:tasks.workunit.client.0.smithi050.stdout:7/454: chown d6/d1d 158816467 1 2023-01-04T18:17:02.581 INFO:tasks.workunit.client.0.smithi050.stdout:5/549: dwrite d13/d15/f73 [0,4194304] 0 2023-01-04T18:17:02.583 INFO:tasks.workunit.client.0.smithi050.stdout:3/431: link d0/d1b/d2f/d56/d32/f48 d0/d1b/d2f/d56/fa3 0 2023-01-04T18:17:02.584 INFO:tasks.workunit.client.0.smithi050.stdout:2/397: link d1/d19/f21 d1/dd/d28/d2c/d2e/d3f/f81 0 2023-01-04T18:17:02.587 INFO:tasks.workunit.client.0.smithi050.stdout:6/387: unlink d0/d5c/d5d/f6a 0 2023-01-04T18:17:02.587 INFO:tasks.workunit.client.0.smithi050.stdout:6/388: readlink d0/l32 0 2023-01-04T18:17:02.588 INFO:tasks.workunit.client.0.smithi050.stdout:2/398: creat d1/dd/d62/d69/f82 x:0 0 0 2023-01-04T18:17:02.589 INFO:tasks.workunit.client.0.smithi050.stdout:6/389: creat d0/d4a/f7e x:0 0 0 2023-01-04T18:17:02.589 INFO:tasks.workunit.client.0.smithi050.stdout:6/390: chown d0/d9/d25/d4d/f66 11454 1 2023-01-04T18:17:02.590 INFO:tasks.workunit.client.0.smithi050.stdout:7/455: dread d6/db/d3b/f61 [0,4194304] 0 2023-01-04T18:17:02.590 INFO:tasks.workunit.client.0.smithi050.stdout:2/399: mkdir d1/dd/d11/d1e/d83 0 2023-01-04T18:17:02.591 INFO:tasks.workunit.client.0.smithi050.stdout:7/456: creat d6/db/d3b/f9e x:0 0 0 2023-01-04T18:17:02.592 INFO:tasks.workunit.client.0.smithi050.stdout:9/401: dwrite d1/f47 [0,4194304] 0 2023-01-04T18:17:02.593 INFO:tasks.workunit.client.0.smithi050.stdout:2/400: rename d1/d10/f78 to d1/dd/d62/d69/f84 0 2023-01-04T18:17:02.593 INFO:tasks.workunit.client.0.smithi050.stdout:2/401: rename d1/dd/d11/d12 to d1/dd/d11/d12/d85 22 2023-01-04T18:17:02.594 INFO:tasks.workunit.client.0.smithi050.stdout:2/402: dread - d1/dd/d11/d14/d39/f61 zero size 2023-01-04T18:17:02.594 INFO:tasks.workunit.client.0.smithi050.stdout:2/403: fdatasync d1/dd/d28/d2c/d2e/f40 0 2023-01-04T18:17:02.594 INFO:tasks.workunit.client.0.smithi050.stdout:6/391: read d0/d9/d38/d16/f3f [3621549,71563] 0 2023-01-04T18:17:02.598 INFO:tasks.workunit.client.0.smithi050.stdout:2/404: rename d1/dd/d28/d2c/f45 to d1/f86 0 2023-01-04T18:17:02.600 INFO:tasks.workunit.client.0.smithi050.stdout:7/457: dread d6/db/f40 [0,4194304] 0 2023-01-04T18:17:02.601 INFO:tasks.workunit.client.0.smithi050.stdout:7/458: mknod d6/d1d/d81/c9f 0 2023-01-04T18:17:02.601 INFO:tasks.workunit.client.0.smithi050.stdout:0/333: dwrite d0/d6/fa [4194304,4194304] 0 2023-01-04T18:17:02.602 INFO:tasks.workunit.client.0.smithi050.stdout:0/334: chown d0/d6/f21 57145478 1 2023-01-04T18:17:02.602 INFO:tasks.workunit.client.0.smithi050.stdout:0/335: dread - d0/f4d zero size 2023-01-04T18:17:02.602 INFO:tasks.workunit.client.0.smithi050.stdout:6/392: dread d0/d9/d38/f15 [0,4194304] 0 2023-01-04T18:17:02.602 INFO:tasks.workunit.client.0.smithi050.stdout:9/402: dread d1/d12/d41/f67 [0,4194304] 0 2023-01-04T18:17:02.602 INFO:tasks.workunit.client.0.smithi050.stdout:7/459: symlink d6/d6b/la0 0 2023-01-04T18:17:02.604 INFO:tasks.workunit.client.0.smithi050.stdout:0/336: mknod d0/d6/d28/c6a 0 2023-01-04T18:17:02.606 INFO:tasks.workunit.client.0.smithi050.stdout:6/393: rmdir d0/d9/df/d74/d7d 0 2023-01-04T18:17:02.606 INFO:tasks.workunit.client.0.smithi050.stdout:9/403: rmdir d1/d3/d11/d42 39 2023-01-04T18:17:02.609 INFO:tasks.workunit.client.0.smithi050.stdout:7/460: rename d6/db/d3b/l95 to d6/db/d15/d1b/d70/la1 0 2023-01-04T18:17:02.609 INFO:tasks.workunit.client.0.smithi050.stdout:7/461: stat d6/db/d20/d55/f5e 0 2023-01-04T18:17:02.609 INFO:tasks.workunit.client.0.smithi050.stdout:7/462: chown d6/db/d15/d48/f58 7705 1 2023-01-04T18:17:02.610 INFO:tasks.workunit.client.0.smithi050.stdout:6/394: mknod d0/d9/d25/d40/c7f 0 2023-01-04T18:17:02.611 INFO:tasks.workunit.client.0.smithi050.stdout:9/404: symlink d1/d12/l84 0 2023-01-04T18:17:02.612 INFO:tasks.workunit.client.0.smithi050.stdout:9/405: creat d1/d12/d2d/f85 x:0 0 0 2023-01-04T18:17:02.612 INFO:tasks.workunit.client.0.smithi050.stdout:9/406: chown d1/d3/d11 852289 1 2023-01-04T18:17:02.613 INFO:tasks.workunit.client.0.smithi050.stdout:5/550: dwrite d13/d15/d66/db8/d27/d46/d4e/d4d/f77 [0,4194304] 0 2023-01-04T18:17:02.613 INFO:tasks.workunit.client.0.smithi050.stdout:9/407: mknod d1/d3/d11/d42/c86 0 2023-01-04T18:17:02.613 INFO:tasks.workunit.client.0.smithi050.stdout:8/448: dwrite d3/d2a/d2d/f70 [0,4194304] 0 2023-01-04T18:17:02.614 INFO:tasks.workunit.client.0.smithi050.stdout:5/551: write d13/d15/d66/db8/d27/f2b [3506756,19015] 0 2023-01-04T18:17:02.614 INFO:tasks.workunit.client.0.smithi050.stdout:5/552: write d13/d15/f9b [1638613,9218] 0 2023-01-04T18:17:02.614 INFO:tasks.workunit.client.0.smithi050.stdout:9/408: rmdir d1/d3/d11/d42 39 2023-01-04T18:17:02.615 INFO:tasks.workunit.client.0.smithi050.stdout:7/463: write d6/f31 [3404480,117014] 0 2023-01-04T18:17:02.615 INFO:tasks.workunit.client.0.smithi050.stdout:8/449: write d3/d2a/d30/d3b/f79 [3778915,90385] 0 2023-01-04T18:17:02.616 INFO:tasks.workunit.client.0.smithi050.stdout:5/553: mkdir d13/d15/d66/db8/d27/dc3 0 2023-01-04T18:17:02.616 INFO:tasks.workunit.client.0.smithi050.stdout:5/554: chown d13/d15/d66/db8/d27/d44/f9c 25 1 2023-01-04T18:17:02.617 INFO:tasks.workunit.client.0.smithi050.stdout:7/464: mknod d6/db/d20/d55/ca2 0 2023-01-04T18:17:02.617 INFO:tasks.workunit.client.0.smithi050.stdout:8/450: symlink d3/d2a/d27/l9e 0 2023-01-04T18:17:02.622 INFO:tasks.workunit.client.0.smithi050.stdout:1/404: dwrite d8/d14/d1c/d28/d57/f61 [0,4194304] 0 2023-01-04T18:17:02.622 INFO:tasks.workunit.client.0.smithi050.stdout:3/432: dwrite d0/d1b/d2f/d31/f41 [0,4194304] 0 2023-01-04T18:17:02.623 INFO:tasks.workunit.client.0.smithi050.stdout:1/405: read d8/d48/d5c/d67/d3a/d23/f3e [1176142,17113] 0 2023-01-04T18:17:02.623 INFO:tasks.workunit.client.0.smithi050.stdout:1/406: fsync d8/d48/d5c/f65 0 2023-01-04T18:17:02.624 INFO:tasks.workunit.client.0.smithi050.stdout:6/395: dread d0/d9/d38/fd [4194304,4194304] 0 2023-01-04T18:17:02.624 INFO:tasks.workunit.client.0.smithi050.stdout:6/396: fsync d0/f2f 0 2023-01-04T18:17:02.629 INFO:tasks.workunit.client.0.smithi050.stdout:9/409: dread d1/d3/d11/d1f/f69 [0,4194304] 0 2023-01-04T18:17:02.630 INFO:tasks.workunit.client.0.smithi050.stdout:0/337: dwrite d0/d6/d8/d35/f42 [0,4194304] 0 2023-01-04T18:17:02.630 INFO:tasks.workunit.client.0.smithi050.stdout:0/338: truncate d0/d6/d28/d1a/f30 342254 0 2023-01-04T18:17:02.636 INFO:tasks.workunit.client.0.smithi050.stdout:1/407: dread d8/d48/d5c/d67/d3a/f70 [0,4194304] 0 2023-01-04T18:17:02.636 INFO:tasks.workunit.client.0.smithi050.stdout:1/408: write d8/d14/f5b [4517378,73018] 0 2023-01-04T18:17:02.656 INFO:tasks.workunit.client.0.smithi050.stdout:5/555: rmdir d13/d15/d66 39 2023-01-04T18:17:02.657 INFO:tasks.workunit.client.0.smithi050.stdout:8/451: mkdir d3/d2a/d27/d8b/d9f 0 2023-01-04T18:17:02.674 INFO:tasks.workunit.client.0.smithi050.stdout:2/405: getdents d1 0 2023-01-04T18:17:02.674 INFO:tasks.workunit.client.0.smithi050.stdout:2/406: dread - d1/dd/d11/d14/d39/f61 zero size 2023-01-04T18:17:02.682 INFO:tasks.workunit.client.0.smithi050.stdout:3/433: symlink d0/dd/d45/la4 0 2023-01-04T18:17:02.686 INFO:tasks.workunit.client.0.smithi050.stdout:6/397: creat d0/d9/d38/d60/f80 x:0 0 0 2023-01-04T18:17:02.686 INFO:tasks.workunit.client.0.smithi050.stdout:3/434: write d0/d1b/d2f/d56/d32/f73 [3075084,93874] 0 2023-01-04T18:17:02.687 INFO:tasks.workunit.client.0.smithi050.stdout:9/410: getdents d1/d3/d11/d42 0 2023-01-04T18:17:02.687 INFO:tasks.workunit.client.0.smithi050.stdout:9/411: truncate d1/d12/d41/d60/d75/f80 4502720 0 2023-01-04T18:17:02.688 INFO:tasks.workunit.client.0.smithi050.stdout:9/412: chown d1/d3/d3b/d63/c53 243 1 2023-01-04T18:17:02.688 INFO:tasks.workunit.client.0.smithi050.stdout:2/407: dwrite d1/dd/d11/f65 [0,4194304] 0 2023-01-04T18:17:02.688 INFO:tasks.workunit.client.0.smithi050.stdout:3/435: write d0/d8f/f39 [2597644,39466] 0 2023-01-04T18:17:02.688 INFO:tasks.workunit.client.0.smithi050.stdout:3/436: fdatasync d0/d1b/d2f/d56/d32/f49 0 2023-01-04T18:17:02.705 INFO:tasks.workunit.client.0.smithi050.stdout:1/409: creat d8/d14/f7b x:0 0 0 2023-01-04T18:17:02.705 INFO:tasks.workunit.client.0.smithi050.stdout:1/410: chown d8/d48/d5c/d67/d3a/d23/c37 29589967 1 2023-01-04T18:17:02.705 INFO:tasks.workunit.client.0.smithi050.stdout:5/556: truncate d13/d15/d66/db2/fb5 447172 0 2023-01-04T18:17:02.709 INFO:tasks.workunit.client.0.smithi050.stdout:7/465: rename d6/db/d15/d2e/c68 to d6/d1d/ca3 0 2023-01-04T18:17:02.709 INFO:tasks.workunit.client.0.smithi050.stdout:7/466: symlink d6/d1d/d81/la4 2 2023-01-04T18:17:02.710 INFO:tasks.workunit.client.0.smithi050.stdout:8/452: mknod d3/d2a/d74/d92/d94/ca0 0 2023-01-04T18:17:02.710 INFO:tasks.workunit.client.0.smithi050.stdout:8/453: dread - d3/d2a/d30/d3b/d4d/d23/d55/d5f/f8a zero size 2023-01-04T18:17:02.713 INFO:tasks.workunit.client.0.smithi050.stdout:7/467: dread d6/f8 [0,4194304] 0 2023-01-04T18:17:02.713 INFO:tasks.workunit.client.0.smithi050.stdout:7/468: dread - d6/d28/d99/f64 zero size 2023-01-04T18:17:02.722 INFO:tasks.workunit.client.0.smithi050.stdout:1/411: dwrite d8/f44 [0,4194304] 0 2023-01-04T18:17:02.725 INFO:tasks.workunit.client.0.smithi050.stdout:6/398: mknod d0/d5c/d5d/c81 0 2023-01-04T18:17:02.726 INFO:tasks.workunit.client.0.smithi050.stdout:9/413: rmdir d1/d12 39 2023-01-04T18:17:02.732 INFO:tasks.workunit.client.0.smithi050.stdout:5/557: unlink d13/d15/d66/db8/d1f/d35/f3a 0 2023-01-04T18:17:02.735 INFO:tasks.workunit.client.0.smithi050.stdout:9/414: dread d1/d3/f4 [0,4194304] 0 2023-01-04T18:17:02.735 INFO:tasks.workunit.client.0.smithi050.stdout:9/415: dread - d1/d12/d2d/f85 zero size 2023-01-04T18:17:02.736 INFO:tasks.workunit.client.0.smithi050.stdout:2/408: rename d1/d19/d5a/f6f to d1/dd/d28/d2c/d66/f87 0 2023-01-04T18:17:02.738 INFO:tasks.workunit.client.0.smithi050.stdout:8/454: getdents d3/d2a/d30/d3b/d4d/d23 0 2023-01-04T18:17:02.739 INFO:tasks.workunit.client.0.smithi050.stdout:8/455: readlink d3/d2a/d27/l29 0 2023-01-04T18:17:02.739 INFO:tasks.workunit.client.0.smithi050.stdout:9/416: write d1/d3/d24/f55 [2450556,94660] 0 2023-01-04T18:17:02.741 INFO:tasks.workunit.client.0.smithi050.stdout:9/417: read d1/d3/d3b/d63/f1c [2128328,93180] 0 2023-01-04T18:17:02.741 INFO:tasks.workunit.client.0.smithi050.stdout:7/469: truncate d6/db/f2a 541768 0 2023-01-04T18:17:02.741 INFO:tasks.workunit.client.0.smithi050.stdout:1/412: dwrite d8/d48/d5c/f5e [4194304,4194304] 0 2023-01-04T18:17:02.746 INFO:tasks.workunit.client.0.smithi050.stdout:6/399: rmdir d0/d71 39 2023-01-04T18:17:02.750 INFO:tasks.workunit.client.0.smithi050.stdout:5/558: dwrite d13/d15/d66/db8/d27/d46/d4e/d4d/f90 [0,4194304] 0 2023-01-04T18:17:02.751 INFO:tasks.workunit.client.0.smithi050.stdout:3/437: rename d0/d1b/d2f/d31/f66 to d0/d1b/d2f/d56/d3f/fa5 0 2023-01-04T18:17:02.755 INFO:tasks.workunit.client.0.smithi050.stdout:8/456: rename d3/d2a/d73 to d3/d2a/d73/da1 22 2023-01-04T18:17:02.757 INFO:tasks.workunit.client.0.smithi050.stdout:3/438: write d0/f40 [2407136,57686] 0 2023-01-04T18:17:02.758 INFO:tasks.workunit.client.0.smithi050.stdout:3/439: stat d0/d10/l3c 0 2023-01-04T18:17:02.758 INFO:tasks.workunit.client.0.smithi050.stdout:3/440: dread - d0/d1b/d2f/f44 zero size 2023-01-04T18:17:02.786 INFO:tasks.workunit.client.0.smithi050.stdout:2/409: mknod d1/d41/c88 0 2023-01-04T18:17:02.790 INFO:tasks.workunit.client.0.smithi050.stdout:9/418: symlink d1/d3/d13/l87 0 2023-01-04T18:17:02.793 INFO:tasks.workunit.client.0.smithi050.stdout:2/410: dread d1/dd/d11/d14/f23 [0,4194304] 0 2023-01-04T18:17:02.793 INFO:tasks.workunit.client.0.smithi050.stdout:2/411: truncate d1/dd/d11/d12/f4d 582487 0 2023-01-04T18:17:02.793 INFO:tasks.workunit.client.0.smithi050.stdout:7/470: creat d6/db/d3a/fa5 x:0 0 0 2023-01-04T18:17:02.798 INFO:tasks.workunit.client.0.smithi050.stdout:1/413: creat d8/d48/d5c/f7c x:0 0 0 2023-01-04T18:17:02.804 INFO:tasks.workunit.client.0.smithi050.stdout:5/559: mknod d13/d15/d66/db8/d27/da8/cc4 0 2023-01-04T18:17:02.804 INFO:tasks.workunit.client.0.smithi050.stdout:5/560: chown ce 14 1 2023-01-04T18:17:02.807 INFO:tasks.workunit.client.0.smithi050.stdout:8/457: mknod d3/d2a/ca2 0 2023-01-04T18:17:02.808 INFO:tasks.workunit.client.0.smithi050.stdout:3/441: link d0/d1b/d2f/d56/d32/f73 d0/d1b/d2f/d56/d32/fa6 0 2023-01-04T18:17:02.816 INFO:tasks.workunit.client.0.smithi050.stdout:9/419: mknod d1/d3/d11/d42/c88 0 2023-01-04T18:17:02.822 INFO:tasks.workunit.client.0.smithi050.stdout:7/471: unlink d6/d28/l87 0 2023-01-04T18:17:02.822 INFO:tasks.workunit.client.0.smithi050.stdout:1/414: creat d8/d14/d1c/d28/d57/d6a/f7d x:0 0 0 2023-01-04T18:17:02.824 INFO:tasks.workunit.client.0.smithi050.stdout:8/458: getdents d3/d2a/d30/d3b/d4d/d23/d55/d5f/d82 0 2023-01-04T18:17:02.825 INFO:tasks.workunit.client.0.smithi050.stdout:3/442: mknod d0/d10/ca7 0 2023-01-04T18:17:02.825 INFO:tasks.workunit.client.0.smithi050.stdout:3/443: chown d0/d8f/f25 1301234 1 2023-01-04T18:17:02.825 INFO:tasks.workunit.client.0.smithi050.stdout:3/444: stat d0/d8f/f5c 0 2023-01-04T18:17:02.826 INFO:tasks.workunit.client.0.smithi050.stdout:3/445: stat d0/d1b/d2f/d56/l4c 0 2023-01-04T18:17:02.828 INFO:tasks.workunit.client.0.smithi050.stdout:9/420: rename d1/d12/d41/d60/d75 to d1/d3/d89 0 2023-01-04T18:17:02.829 INFO:tasks.workunit.client.0.smithi050.stdout:2/412: dread d1/dd/d11/d12/f4d [0,4194304] 0 2023-01-04T18:17:02.829 INFO:tasks.workunit.client.0.smithi050.stdout:2/413: fdatasync d1/dd/d11/f26 0 2023-01-04T18:17:02.829 INFO:tasks.workunit.client.0.smithi050.stdout:2/414: chown d1/dd/d11/d14/d39/f61 2004716 1 2023-01-04T18:17:02.830 INFO:tasks.workunit.client.0.smithi050.stdout:7/472: mkdir d6/db/d15/d1b/d22/da6 0 2023-01-04T18:17:02.834 INFO:tasks.workunit.client.0.smithi050.stdout:8/459: creat d3/d2a/d30/d3b/d4d/d23/d55/d5f/d82/fa3 x:0 0 0 2023-01-04T18:17:02.834 INFO:tasks.workunit.client.0.smithi050.stdout:8/460: fdatasync d3/d2a/d27/d93/d7a/f80 0 2023-01-04T18:17:02.836 INFO:tasks.workunit.client.0.smithi050.stdout:3/446: symlink d0/d1b/d2f/d56/d3f/la8 0 2023-01-04T18:17:02.836 INFO:tasks.workunit.client.0.smithi050.stdout:1/415: rmdir d8/d14/d1c/d28 39 2023-01-04T18:17:02.841 INFO:tasks.workunit.client.0.smithi050.stdout:9/421: symlink d1/d3/d13/l8a 0 2023-01-04T18:17:02.842 INFO:tasks.workunit.client.0.smithi050.stdout:9/422: chown d1/d12/d2d/d39/f66 11283928 1 2023-01-04T18:17:02.844 INFO:tasks.workunit.client.0.smithi050.stdout:7/473: rename d6/db/d15/f36 to d6/db/d15/d1b/d22/da6/fa7 0 2023-01-04T18:17:02.845 INFO:tasks.workunit.client.0.smithi050.stdout:5/561: dread d13/d15/d66/db2/fb5 [0,4194304] 0 2023-01-04T18:17:02.846 INFO:tasks.workunit.client.0.smithi050.stdout:3/447: truncate d0/d1a/f24 1690872 0 2023-01-04T18:17:02.847 INFO:tasks.workunit.client.0.smithi050.stdout:1/416: dread d8/d48/d5c/d67/d3a/f69 [0,4194304] 0 2023-01-04T18:17:02.847 INFO:tasks.workunit.client.0.smithi050.stdout:1/417: chown d8/f13 5087372 1 2023-01-04T18:17:02.847 INFO:tasks.workunit.client.0.smithi050.stdout:1/418: dread - d8/d14/d1c/d28/d57/d6a/f7d zero size 2023-01-04T18:17:02.847 INFO:tasks.workunit.client.0.smithi050.stdout:9/423: mknod d1/d3/d24/d7b/c8b 0 2023-01-04T18:17:02.847 INFO:tasks.workunit.client.0.smithi050.stdout:3/448: read d0/d1b/d2f/d31/f4b [277694,114066] 0 2023-01-04T18:17:02.848 INFO:tasks.workunit.client.0.smithi050.stdout:8/461: rename d3/d2a/d27/c67 to d3/d2a/ca4 0 2023-01-04T18:17:02.848 INFO:tasks.workunit.client.0.smithi050.stdout:8/462: chown d3/d2a/d2d/f66 1624 1 2023-01-04T18:17:02.849 INFO:tasks.workunit.client.0.smithi050.stdout:2/415: dwrite d1/dd/d11/d1e/f25 [0,4194304] 0 2023-01-04T18:17:02.849 INFO:tasks.workunit.client.0.smithi050.stdout:2/416: rename d1/d19/d5a to d1/d19/d5a/d7f/d89 22 2023-01-04T18:17:02.849 INFO:tasks.workunit.client.0.smithi050.stdout:7/474: write d6/db/d15/d1b/f21 [1082021,82562] 0 2023-01-04T18:17:02.849 INFO:tasks.workunit.client.0.smithi050.stdout:5/562: symlink d13/d15/d66/db8/d27/d44/d47/lc5 0 2023-01-04T18:17:02.850 INFO:tasks.workunit.client.0.smithi050.stdout:7/475: write d6/db/d15/f16 [691110,102033] 0 2023-01-04T18:17:02.850 INFO:tasks.workunit.client.0.smithi050.stdout:1/419: truncate d8/d14/f5b 1770326 0 2023-01-04T18:17:02.851 INFO:tasks.workunit.client.0.smithi050.stdout:1/420: chown d8/d48/d5c/d67/d3a/d58/f7a 205445 1 2023-01-04T18:17:02.852 INFO:tasks.workunit.client.0.smithi050.stdout:9/424: creat d1/d3/d13/d77/f8c x:0 0 0 2023-01-04T18:17:02.852 INFO:tasks.workunit.client.0.smithi050.stdout:9/425: chown d1/d12/d41/f71 7879151 1 2023-01-04T18:17:02.852 INFO:tasks.workunit.client.0.smithi050.stdout:9/426: readlink d1/d3/d13/l8a 0 2023-01-04T18:17:02.852 INFO:tasks.workunit.client.0.smithi050.stdout:3/449: symlink d0/d1b/d2f/d56/la9 0 2023-01-04T18:17:02.854 INFO:tasks.workunit.client.0.smithi050.stdout:8/463: mknod d3/d2a/d30/d3b/d53/ca5 0 2023-01-04T18:17:02.854 INFO:tasks.workunit.client.0.smithi050.stdout:8/464: chown d3/d2a/d27/d8b/d9f 15831 1 2023-01-04T18:17:02.867 INFO:tasks.workunit.client.0.smithi050.stdout:7/476: dwrite d6/db/d3a/fa5 [0,4194304] 0 2023-01-04T18:17:02.867 INFO:tasks.workunit.client.0.smithi050.stdout:7/477: dread - d6/db/d15/d1b/d70/f85 zero size 2023-01-04T18:17:02.884 INFO:tasks.workunit.client.0.smithi050.stdout:2/417: symlink d1/d19/d5a/d7f/l8a 0 2023-01-04T18:17:02.884 INFO:tasks.workunit.client.0.smithi050.stdout:5/563: symlink d13/d15/d66/db8/d27/dc3/lc6 0 2023-01-04T18:17:02.886 INFO:tasks.workunit.client.0.smithi050.stdout:1/421: mknod d8/d48/d5c/d67/d3a/d31/c7e 0 2023-01-04T18:17:02.890 INFO:tasks.workunit.client.0.smithi050.stdout:3/450: mknod d0/d1b/d2f/d56/d32/caa 0 2023-01-04T18:17:02.892 INFO:tasks.workunit.client.0.smithi050.stdout:8/465: link d3/d2a/d73/c91 d3/d2a/d27/d8b/ca6 0 2023-01-04T18:17:02.902 INFO:tasks.workunit.client.0.smithi050.stdout:7/478: truncate d6/d28/d3c/d42/d5f/f6f 2108830 0 2023-01-04T18:17:02.902 INFO:tasks.workunit.client.0.smithi050.stdout:7/479: write d6/db/d3b/f4c [682759,78756] 0 2023-01-04T18:17:02.908 INFO:tasks.workunit.client.0.smithi050.stdout:2/418: rmdir d1/dd/d11 39 2023-01-04T18:17:02.908 INFO:tasks.workunit.client.0.smithi050.stdout:2/419: write d1/d10/f4e [1867585,11872] 0 2023-01-04T18:17:02.910 INFO:tasks.workunit.client.0.smithi050.stdout:5/564: dread - d13/d15/d66/db8/d1f/fb7 zero size 2023-01-04T18:17:02.911 INFO:tasks.workunit.client.0.smithi050.stdout:1/422: mkdir d8/d48/d5c/d67/d3a/d31/d7f 0 2023-01-04T18:17:02.914 INFO:tasks.workunit.client.0.smithi050.stdout:3/451: unlink d0/d8f/d46/l5a 0 2023-01-04T18:17:02.915 INFO:tasks.workunit.client.0.smithi050.stdout:8/466: rename d3/d2a/d27/d93/c95 to d3/d2a/d30/d3b/d4d/d23/d31/ca7 0 2023-01-04T18:17:02.918 INFO:tasks.workunit.client.0.smithi050.stdout:7/480: symlink d6/db/d15/d1b/la8 0 2023-01-04T18:17:02.922 INFO:tasks.workunit.client.0.smithi050.stdout:1/423: creat d8/d48/d5c/d67/d3a/d58/d72/f80 x:0 0 0 2023-01-04T18:17:02.924 INFO:tasks.workunit.client.0.smithi050.stdout:3/452: getdents d0/d8f 0 2023-01-04T18:17:02.925 INFO:tasks.workunit.client.0.smithi050.stdout:8/467: creat d3/d2a/d60/fa8 x:0 0 0 2023-01-04T18:17:02.927 INFO:tasks.workunit.client.0.smithi050.stdout:7/481: unlink d6/db/d15/d1b/d22/f37 0 2023-01-04T18:17:02.927 INFO:tasks.workunit.client.0.smithi050.stdout:7/482: fsync d6/f31 0 2023-01-04T18:17:02.927 INFO:tasks.workunit.client.0.smithi050.stdout:7/483: readlink d6/d6b/la0 0 2023-01-04T18:17:02.929 INFO:tasks.workunit.client.0.smithi050.stdout:5/565: mknod d13/d15/d66/db8/d1f/d35/d59/d87/dbe/cc7 0 2023-01-04T18:17:02.929 INFO:tasks.workunit.client.0.smithi050.stdout:2/420: dwrite d1/dd/d11/d12/f4d [0,4194304] 0 2023-01-04T18:17:02.929 INFO:tasks.workunit.client.0.smithi050.stdout:2/421: readlink d1/dd/d11/d14/d39/l70 0 2023-01-04T18:17:02.930 INFO:tasks.workunit.client.0.smithi050.stdout:1/424: symlink d8/d14/l81 0 2023-01-04T18:17:02.937 INFO:tasks.workunit.client.0.smithi050.stdout:7/484: creat d6/d28/d99/d7a/fa9 x:0 0 0 2023-01-04T18:17:02.941 INFO:tasks.workunit.client.0.smithi050.stdout:5/566: creat d13/d15/d66/db8/d1f/d35/d42/d4a/d8e/fc8 x:0 0 0 2023-01-04T18:17:02.941 INFO:tasks.workunit.client.0.smithi050.stdout:5/567: readlink l9 0 2023-01-04T18:17:02.941 INFO:tasks.workunit.client.0.smithi050.stdout:5/568: truncate d13/d15/d66/db8/d27/d46/f94 257128 0 2023-01-04T18:17:02.941 INFO:tasks.workunit.client.0.smithi050.stdout:5/569: chown d13/fbd 15897841 1 2023-01-04T18:17:02.941 INFO:tasks.workunit.client.0.smithi050.stdout:5/570: truncate d13/d15/d66/db8/d1f/d35/d59/fb6 247497 0 2023-01-04T18:17:02.944 INFO:tasks.workunit.client.0.smithi050.stdout:1/425: dread d8/d48/d5c/d67/d3a/d58/f5a [0,4194304] 0 2023-01-04T18:17:02.945 INFO:tasks.workunit.client.0.smithi050.stdout:8/468: mknod d3/d2a/d27/d93/d7f/d96/d46/ca9 0 2023-01-04T18:17:02.947 INFO:tasks.workunit.client.0.smithi050.stdout:7/485: rename d6/d6b/l78 to d6/db/d15/d1b/d22/laa 0 2023-01-04T18:17:02.948 INFO:tasks.workunit.client.0.smithi050.stdout:8/469: symlink d3/d2a/d30/d3b/d4d/d23/d55/laa 0 2023-01-04T18:17:02.948 INFO:tasks.workunit.client.0.smithi050.stdout:3/453: dwrite d0/d8f/f93 [0,4194304] 0 2023-01-04T18:17:02.949 INFO:tasks.workunit.client.0.smithi050.stdout:1/426: rename d8/d48/d5c/d67/d3a/d58/f5a to d8/d14/f82 0 2023-01-04T18:17:02.950 INFO:tasks.workunit.client.0.smithi050.stdout:7/486: creat d6/d6b/d8b/fab x:0 0 0 2023-01-04T18:17:02.951 INFO:tasks.workunit.client.0.smithi050.stdout:8/470: creat d3/d2a/d27/d8b/fab x:0 0 0 2023-01-04T18:17:02.951 INFO:tasks.workunit.client.0.smithi050.stdout:8/471: readlink d3/d2a/d30/d3b/d4d/l1e 0 2023-01-04T18:17:02.953 INFO:tasks.workunit.client.0.smithi050.stdout:1/427: getdents d8/d48/d5c/d67/d3a/d31 0 2023-01-04T18:17:02.954 INFO:tasks.workunit.client.0.smithi050.stdout:7/487: creat d6/db/d15/d1b/d22/da6/fac x:0 0 0 2023-01-04T18:17:02.956 INFO:tasks.workunit.client.0.smithi050.stdout:2/422: dwrite d1/dd/f74 [0,4194304] 0 2023-01-04T18:17:02.956 INFO:tasks.workunit.client.0.smithi050.stdout:1/428: creat d8/d48/f83 x:0 0 0 2023-01-04T18:17:02.957 INFO:tasks.workunit.client.0.smithi050.stdout:3/454: write d0/d1a/f58 [2646416,34802] 0 2023-01-04T18:17:02.957 INFO:tasks.workunit.client.0.smithi050.stdout:5/571: dread d13/d15/d66/db8/d1f/d35/d59/f95 [0,4194304] 0 2023-01-04T18:17:02.957 INFO:tasks.workunit.client.0.smithi050.stdout:3/455: write d0/d8f/d46/d80/f82 [289673,65352] 0 2023-01-04T18:17:02.957 INFO:tasks.workunit.client.0.smithi050.stdout:3/456: stat d0/f4 0 2023-01-04T18:17:02.958 INFO:tasks.workunit.client.0.smithi050.stdout:5/572: write d13/d15/d66/db8/d27/d44/f7b [2908834,78550] 0 2023-01-04T18:17:02.972 INFO:tasks.workunit.client.0.smithi050.stdout:2/423: creat d1/dd/d11/d14/f8b x:0 0 0 2023-01-04T18:17:02.974 INFO:tasks.workunit.client.0.smithi050.stdout:1/429: mkdir d8/d48/d5c/d67/d3b/d84 0 2023-01-04T18:17:02.978 INFO:tasks.workunit.client.0.smithi050.stdout:5/573: truncate d13/f3b 643310 0 2023-01-04T18:17:02.978 INFO:tasks.workunit.client.0.smithi050.stdout:5/574: chown d13/d15/d66/db8/d1f/d35/d49 0 1 2023-01-04T18:17:02.979 INFO:tasks.workunit.client.0.smithi050.stdout:2/424: getdents d1/dd/d62 0 2023-01-04T18:17:02.981 INFO:tasks.workunit.client.0.smithi050.stdout:1/430: unlink d8/d48/l5f 0 2023-01-04T18:17:02.981 INFO:tasks.workunit.client.0.smithi050.stdout:1/431: chown d8/d48/d5c/d67/d3a/d58 34 1 2023-01-04T18:17:02.983 INFO:tasks.workunit.client.0.smithi050.stdout:8/472: dwrite d3/d2a/f24 [4194304,4194304] 0 2023-01-04T18:17:02.983 INFO:tasks.workunit.client.0.smithi050.stdout:2/425: unlink d1/dd/d28/d2c/f63 0 2023-01-04T18:17:02.984 INFO:tasks.workunit.client.0.smithi050.stdout:2/426: chown d1/dd/d62 265896586 1 2023-01-04T18:17:02.984 INFO:tasks.workunit.client.0.smithi050.stdout:2/427: fdatasync d1/dd/d11/f65 0 2023-01-04T18:17:02.984 INFO:tasks.workunit.client.0.smithi050.stdout:3/457: dwrite d0/d1b/d2f/d56/d6b/f99 [8388608,4194304] 0 2023-01-04T18:17:02.985 INFO:tasks.workunit.client.0.smithi050.stdout:7/488: dwrite d6/db/d15/d1b/d70/f85 [0,4194304] 0 2023-01-04T18:17:02.985 INFO:tasks.workunit.client.0.smithi050.stdout:1/432: rmdir d8/d48/d5c/d67/d3a/d58/d72 39 2023-01-04T18:17:02.990 INFO:tasks.workunit.client.0.smithi050.stdout:2/428: dread d1/d10/f4e [0,4194304] 0 2023-01-04T18:17:02.991 INFO:tasks.workunit.client.0.smithi050.stdout:4/409: sync 2023-01-04T18:17:02.991 INFO:tasks.workunit.client.0.smithi050.stdout:6/400: sync 2023-01-04T18:17:02.991 INFO:tasks.workunit.client.0.smithi050.stdout:0/339: sync 2023-01-04T18:17:02.991 INFO:tasks.workunit.client.0.smithi050.stdout:0/340: truncate d0/d6/f21 4879917 0 2023-01-04T18:17:02.998 INFO:tasks.workunit.client.0.smithi050.stdout:2/429: write d1/dd/f4a [3402866,82894] 0 2023-01-04T18:17:02.998 INFO:tasks.workunit.client.0.smithi050.stdout:2/430: chown d1/dd/d11/d14/f8b 0 1 2023-01-04T18:17:03.002 INFO:tasks.workunit.client.0.smithi050.stdout:7/489: link d6/d28/d32/c34 d6/d28/d3c/d62/cad 0 2023-01-04T18:17:03.007 INFO:tasks.workunit.client.0.smithi050.stdout:5/575: dread d13/d15/d66/db8/d1f/f97 [0,4194304] 0 2023-01-04T18:17:03.007 INFO:tasks.workunit.client.0.smithi050.stdout:3/458: dwrite d0/d8f/d46/d80/f82 [0,4194304] 0 2023-01-04T18:17:03.009 INFO:tasks.workunit.client.0.smithi050.stdout:1/433: creat d8/d14/d1c/f85 x:0 0 0 2023-01-04T18:17:03.011 INFO:tasks.workunit.client.0.smithi050.stdout:8/473: dread d3/d2a/d30/d3b/d4d/f88 [0,4194304] 0 2023-01-04T18:17:03.012 INFO:tasks.workunit.client.0.smithi050.stdout:6/401: dwrite d0/d9/d38/fd [0,4194304] 0 2023-01-04T18:17:03.013 INFO:tasks.workunit.client.0.smithi050.stdout:6/402: readlink d0/d5c/d5d/l6c 0 2023-01-04T18:17:03.013 INFO:tasks.workunit.client.0.smithi050.stdout:4/410: mkdir d14/d1b/d1f/d22/d3e/d44/d59/d5f/d80 0 2023-01-04T18:17:03.013 INFO:tasks.workunit.client.0.smithi050.stdout:0/341: creat d0/d6/d28/d1a/f6b x:0 0 0 2023-01-04T18:17:03.016 INFO:tasks.workunit.client.0.smithi050.stdout:0/342: read d0/d6/d28/d1a/f20 [2351851,112488] 0 2023-01-04T18:17:03.016 INFO:tasks.workunit.client.0.smithi050.stdout:0/343: chown d0/d6/d28/d1a/f40 396705316 1 2023-01-04T18:17:03.017 INFO:tasks.workunit.client.0.smithi050.stdout:2/431: getdents d1/dd/d62/d69 0 2023-01-04T18:17:03.017 INFO:tasks.workunit.client.0.smithi050.stdout:1/434: dread d8/f13 [0,4194304] 0 2023-01-04T18:17:03.018 INFO:tasks.workunit.client.0.smithi050.stdout:2/432: write d1/d19/f21 [1806192,43384] 0 2023-01-04T18:17:03.019 INFO:tasks.workunit.client.0.smithi050.stdout:7/490: creat d6/d28/d3c/d42/d5f/d6a/fae x:0 0 0 2023-01-04T18:17:03.022 INFO:tasks.workunit.client.0.smithi050.stdout:5/576: symlink d13/d28/d7c/d83/lc9 0 2023-01-04T18:17:03.024 INFO:tasks.workunit.client.0.smithi050.stdout:3/459: rmdir d0/d10 39 2023-01-04T18:17:03.025 INFO:tasks.workunit.client.0.smithi050.stdout:3/460: write d0/dd/f11 [3656231,22616] 0 2023-01-04T18:17:03.025 INFO:tasks.workunit.client.0.smithi050.stdout:3/461: fsync d0/d8f/f39 0 2023-01-04T18:17:03.028 INFO:tasks.workunit.client.0.smithi050.stdout:6/403: rename d0/d9/df/f22 to d0/d9/d38/d60/f82 0 2023-01-04T18:17:03.030 INFO:tasks.workunit.client.0.smithi050.stdout:4/411: link d14/d1b/d1f/d63/l6e d14/d1b/d66/l81 0 2023-01-04T18:17:03.032 INFO:tasks.workunit.client.0.smithi050.stdout:0/344: stat d0/d6/d8/d35/c32 0 2023-01-04T18:17:03.032 INFO:tasks.workunit.client.0.smithi050.stdout:0/345: write d0/d6/d8/d4f/f69 [238141,17752] 0 2023-01-04T18:17:03.033 INFO:tasks.workunit.client.0.smithi050.stdout:1/435: mknod d8/d14/d1c/c86 0 2023-01-04T18:17:03.033 INFO:tasks.workunit.client.0.smithi050.stdout:1/436: stat d8/d48/d5c/d67/f1f 0 2023-01-04T18:17:03.033 INFO:tasks.workunit.client.0.smithi050.stdout:1/437: write d8/d48/d5c/d67/d3a/f6d [268880,130608] 0 2023-01-04T18:17:03.035 INFO:tasks.workunit.client.0.smithi050.stdout:7/491: dread d6/db/d3a/fa5 [0,4194304] 0 2023-01-04T18:17:03.035 INFO:tasks.workunit.client.0.smithi050.stdout:7/492: fsync d6/db/d15/d1b/d22/da6/fa7 0 2023-01-04T18:17:03.035 INFO:tasks.workunit.client.0.smithi050.stdout:7/493: write d6/d28/d99/f64 [931853,33181] 0 2023-01-04T18:17:03.035 INFO:tasks.workunit.client.0.smithi050.stdout:7/494: write d6/db/d3a/f84 [906310,40214] 0 2023-01-04T18:17:03.037 INFO:tasks.workunit.client.0.smithi050.stdout:5/577: getdents d13/d15/d66/db8/d27/dc3 0 2023-01-04T18:17:03.039 INFO:tasks.workunit.client.0.smithi050.stdout:2/433: dwrite d1/dd/d11/d12/f4d [0,4194304] 0 2023-01-04T18:17:03.039 INFO:tasks.workunit.client.0.smithi050.stdout:2/434: chown d1/dd/f3a 318367298 1 2023-01-04T18:17:03.039 INFO:tasks.workunit.client.0.smithi050.stdout:8/474: link d3/d2a/d27/d93/d7f/d96/c75 d3/d2a/d60/cac 0 2023-01-04T18:17:03.040 INFO:tasks.workunit.client.0.smithi050.stdout:2/435: write d1/dd/d11/f27 [5756517,80547] 0 2023-01-04T18:17:03.041 INFO:tasks.workunit.client.0.smithi050.stdout:6/404: rename d0/d9/df/d68 to d0/d71/d83 0 2023-01-04T18:17:03.041 INFO:tasks.workunit.client.0.smithi050.stdout:6/405: read d0/d9/f3b [199450,24026] 0 2023-01-04T18:17:03.043 INFO:tasks.workunit.client.0.smithi050.stdout:7/495: dread d6/f31 [0,4194304] 0 2023-01-04T18:17:03.046 INFO:tasks.workunit.client.0.smithi050.stdout:4/412: symlink d14/d1b/d32/l82 0 2023-01-04T18:17:03.046 INFO:tasks.workunit.client.0.smithi050.stdout:4/413: chown d14/d1b/d1f/d22/f4d 0 1 2023-01-04T18:17:03.046 INFO:tasks.workunit.client.0.smithi050.stdout:4/414: read d14/d1b/d1f/d22/f42 [3743370,7315] 0 2023-01-04T18:17:03.047 INFO:tasks.workunit.client.0.smithi050.stdout:0/346: symlink d0/d6/l6c 0 2023-01-04T18:17:03.047 INFO:tasks.workunit.client.0.smithi050.stdout:2/436: dread d1/dd/f3a [0,4194304] 0 2023-01-04T18:17:03.048 INFO:tasks.workunit.client.0.smithi050.stdout:9/427: sync 2023-01-04T18:17:03.049 INFO:tasks.workunit.client.0.smithi050.stdout:5/578: mkdir d13/d15/d66/db8/d27/dca 0 2023-01-04T18:17:03.052 INFO:tasks.workunit.client.0.smithi050.stdout:1/438: rename d8/d48/d5c/d67/d3a/d23/l3d to d8/d48/d5c/d67/l87 0 2023-01-04T18:17:03.057 INFO:tasks.workunit.client.0.smithi050.stdout:6/406: mknod d0/c84 0 2023-01-04T18:17:03.058 INFO:tasks.workunit.client.0.smithi050.stdout:5/579: dread d13/d15/d66/db8/d27/d46/d4e/d4d/f77 [0,4194304] 0 2023-01-04T18:17:03.065 INFO:tasks.workunit.client.0.smithi050.stdout:0/347: dwrite d0/d6/f58 [0,4194304] 0 2023-01-04T18:17:03.066 INFO:tasks.workunit.client.0.smithi050.stdout:0/348: getdents d0/d6/d8/d35/d67 0 2023-01-04T18:17:03.066 INFO:tasks.workunit.client.0.smithi050.stdout:7/496: dwrite d6/db/d15/d2e/f5d [0,4194304] 0 2023-01-04T18:17:03.171 INFO:tasks.workunit.client.0.smithi050.stdout:4/415: mknod d14/d1b/d1f/d22/d3e/d44/d59/c83 0 2023-01-04T18:17:03.173 INFO:tasks.workunit.client.0.smithi050.stdout:2/437: rename d1/d19/f21 to d1/d19/f8c 0 2023-01-04T18:17:03.174 INFO:tasks.workunit.client.0.smithi050.stdout:9/428: creat d1/d3/d13/f8d x:0 0 0 2023-01-04T18:17:03.174 INFO:tasks.workunit.client.0.smithi050.stdout:6/407: symlink d0/d71/l85 0 2023-01-04T18:17:03.175 INFO:tasks.workunit.client.0.smithi050.stdout:6/408: write d0/d9/d38/f5b [587350,4155] 0 2023-01-04T18:17:03.175 INFO:tasks.workunit.client.0.smithi050.stdout:6/409: write d0/f14 [1465248,91982] 0 2023-01-04T18:17:03.178 INFO:tasks.workunit.client.0.smithi050.stdout:5/580: rmdir d13/d15/d66/db8/d1f/d35/d59/d87 39 2023-01-04T18:17:03.178 INFO:tasks.workunit.client.0.smithi050.stdout:5/581: dread - d13/d15/d66/db8/d1f/d35/fa2 zero size 2023-01-04T18:17:03.178 INFO:tasks.workunit.client.0.smithi050.stdout:5/582: getdents d13/d15/d96/dad 0 2023-01-04T18:17:03.178 INFO:tasks.workunit.client.0.smithi050.stdout:5/583: readlink d13/l7f 0 2023-01-04T18:17:03.180 INFO:tasks.workunit.client.0.smithi050.stdout:0/349: unlink d0/d6/d28/d1a/f20 0 2023-01-04T18:17:03.186 INFO:tasks.workunit.client.0.smithi050.stdout:7/497: getdents d6/db/d15/d1b/d22/da6 0 2023-01-04T18:17:03.186 INFO:tasks.workunit.client.0.smithi050.stdout:7/498: chown d6/f8 7 1 2023-01-04T18:17:03.190 INFO:tasks.workunit.client.0.smithi050.stdout:4/416: dwrite d14/d1b/d1f/d22/d6a/f6b [0,4194304] 0 2023-01-04T18:17:03.191 INFO:tasks.workunit.client.0.smithi050.stdout:4/417: readlink d14/l16 0 2023-01-04T18:17:03.196 INFO:tasks.workunit.client.0.smithi050.stdout:0/350: dread d0/d6/d8/d35/f2b [0,4194304] 0 2023-01-04T18:17:03.196 INFO:tasks.workunit.client.0.smithi050.stdout:0/351: chown d0/d6/d28/f60 79939220 1 2023-01-04T18:17:03.202 INFO:tasks.workunit.client.0.smithi050.stdout:2/438: symlink d1/dd/l8d 0 2023-01-04T18:17:03.204 INFO:tasks.workunit.client.0.smithi050.stdout:7/499: dwrite d6/db/d3b/f9e [0,4194304] 0 2023-01-04T18:17:03.205 INFO:tasks.workunit.client.0.smithi050.stdout:9/429: unlink d1/d3/d11/d1f/l29 0 2023-01-04T18:17:03.211 INFO:tasks.workunit.client.0.smithi050.stdout:6/410: rmdir d0/d9/d38 39 2023-01-04T18:17:03.215 INFO:tasks.workunit.client.0.smithi050.stdout:5/584: getdents d13/d15/d66/db8/d1f/d35 0 2023-01-04T18:17:03.219 INFO:tasks.workunit.client.0.smithi050.stdout:4/418: truncate fc 3319179 0 2023-01-04T18:17:03.221 INFO:tasks.workunit.client.0.smithi050.stdout:0/352: creat d0/f6d x:0 0 0 2023-01-04T18:17:03.221 INFO:tasks.workunit.client.0.smithi050.stdout:0/353: fdatasync d0/d6/f21 0 2023-01-04T18:17:03.221 INFO:tasks.workunit.client.0.smithi050.stdout:0/354: fdatasync d0/f4d 0 2023-01-04T18:17:03.223 INFO:tasks.workunit.client.0.smithi050.stdout:2/439: creat d1/dd/d28/d2c/d2e/d3f/f8e x:0 0 0 2023-01-04T18:17:03.223 INFO:tasks.workunit.client.0.smithi050.stdout:2/440: chown d1/dd/f4a 229 1 2023-01-04T18:17:03.261 INFO:tasks.workunit.client.0.smithi050.stdout:2/441: dwrite d1/dd/d11/d12/f59 [0,4194304] 0 2023-01-04T18:17:03.261 INFO:tasks.workunit.client.0.smithi050.stdout:2/442: chown d1/dd/d28/d2c/d2e/d36/f51 361929489 1 2023-01-04T18:17:03.262 INFO:tasks.workunit.client.0.smithi050.stdout:2/443: dread d1/dd/d28/d2c/d2e/d36/f51 [0,4194304] 0 2023-01-04T18:17:03.263 INFO:tasks.workunit.client.0.smithi050.stdout:2/444: chown d1/d10/f4e 678984024 1 2023-01-04T18:17:03.276 INFO:tasks.workunit.client.0.smithi050.stdout:7/500: rename d6/db/d15/d1b/d5b/f63 to d6/d28/d3c/d42/d5f/d6a/faf 0 2023-01-04T18:17:03.277 INFO:tasks.workunit.client.0.smithi050.stdout:7/501: write d6/d28/d3c/d42/d5f/f6f [50547,42645] 0 2023-01-04T18:17:03.278 INFO:tasks.workunit.client.0.smithi050.stdout:9/430: mkdir d1/d12/d41/d60/d8e 0 2023-01-04T18:17:03.278 INFO:tasks.workunit.client.0.smithi050.stdout:9/431: stat d1/d3/d11/d1f/f5b 0 2023-01-04T18:17:03.278 INFO:tasks.workunit.client.0.smithi050.stdout:9/432: truncate d1/d3/d11/d1f/f5b 1146311 0 2023-01-04T18:17:03.279 INFO:tasks.workunit.client.0.smithi050.stdout:6/411: mknod d0/d9/d38/d16/d77/c86 0 2023-01-04T18:17:03.279 INFO:tasks.workunit.client.0.smithi050.stdout:6/412: read d0/d9/df/f47 [353915,45009] 0 2023-01-04T18:17:03.282 INFO:tasks.workunit.client.0.smithi050.stdout:5/585: symlink d13/d15/d96/dad/lcb 0 2023-01-04T18:17:03.283 INFO:tasks.workunit.client.0.smithi050.stdout:4/419: creat d14/f84 x:0 0 0 2023-01-04T18:17:03.328 INFO:tasks.workunit.client.0.smithi050.stdout:2/445: creat d1/d19/d5a/d7f/f8f x:0 0 0 2023-01-04T18:17:03.334 INFO:tasks.workunit.client.0.smithi050.stdout:7/502: unlink d6/d1d/d81/f89 0 2023-01-04T18:17:03.336 INFO:tasks.workunit.client.0.smithi050.stdout:9/433: mknod d1/d12/d41/d60/c8f 0 2023-01-04T18:17:03.339 INFO:tasks.workunit.client.0.smithi050.stdout:6/413: rename d0/f2e to d0/d71/f87 0 2023-01-04T18:17:03.341 INFO:tasks.workunit.client.0.smithi050.stdout:5/586: creat d13/d15/d66/db8/d27/d46/d4e/d4d/da9/fcc x:0 0 0 2023-01-04T18:17:03.343 INFO:tasks.workunit.client.0.smithi050.stdout:2/446: truncate d1/dd/d62/d69/f84 4463551 0 2023-01-04T18:17:03.345 INFO:tasks.workunit.client.0.smithi050.stdout:7/503: symlink d6/d1d/d1f/lb0 0 2023-01-04T18:17:03.346 INFO:tasks.workunit.client.0.smithi050.stdout:9/434: creat d1/d12/d41/d60/f90 x:0 0 0 2023-01-04T18:17:03.346 INFO:tasks.workunit.client.0.smithi050.stdout:6/414: mknod d0/d71/c88 0 2023-01-04T18:17:03.347 INFO:tasks.workunit.client.0.smithi050.stdout:5/587: creat d13/d15/d66/db8/d27/d46/d4e/d4d/fcd x:0 0 0 2023-01-04T18:17:03.356 INFO:tasks.workunit.client.0.smithi050.stdout:2/447: creat d1/d19/f90 x:0 0 0 2023-01-04T18:17:03.358 INFO:tasks.workunit.client.0.smithi050.stdout:7/504: creat d6/d28/d3c/d42/d5f/fb1 x:0 0 0 2023-01-04T18:17:03.358 INFO:tasks.workunit.client.0.smithi050.stdout:7/505: chown d6/f8 18015502 1 2023-01-04T18:17:03.360 INFO:tasks.workunit.client.0.smithi050.stdout:9/435: getdents d1/d6f 0 2023-01-04T18:17:03.360 INFO:tasks.workunit.client.0.smithi050.stdout:9/436: readlink d1/d3/d13/l8a 0 2023-01-04T18:17:03.361 INFO:tasks.workunit.client.0.smithi050.stdout:6/415: getdents d0/d9/d38/d16/d77 0 2023-01-04T18:17:03.361 INFO:tasks.workunit.client.0.smithi050.stdout:6/416: chown d0/d9/d38/d1c/d54/f63 25808070 1 2023-01-04T18:17:03.365 INFO:tasks.workunit.client.0.smithi050.stdout:6/417: dread d0/d9/df/f56 [0,4194304] 0 2023-01-04T18:17:03.365 INFO:tasks.workunit.client.0.smithi050.stdout:5/588: link d13/f14 d13/d15/d66/db8/d27/fce 0 2023-01-04T18:17:03.366 INFO:tasks.workunit.client.0.smithi050.stdout:9/437: creat d1/d3/d24/d7b/f91 x:0 0 0 2023-01-04T18:17:03.366 INFO:tasks.workunit.client.0.smithi050.stdout:9/438: dread - d1/d3/d11/f43 zero size 2023-01-04T18:17:03.373 INFO:tasks.workunit.client.0.smithi050.stdout:5/589: creat d13/d15/d66/db8/d1f/d35/d59/fcf x:0 0 0 2023-01-04T18:17:03.382 INFO:tasks.workunit.client.0.smithi050.stdout:2/448: dwrite d1/dd/f74 [0,4194304] 0 2023-01-04T18:17:03.383 INFO:tasks.workunit.client.0.smithi050.stdout:6/418: dwrite d0/d4a/f7e [0,4194304] 0 2023-01-04T18:17:03.383 INFO:tasks.workunit.client.0.smithi050.stdout:7/506: dwrite d6/f31 [0,4194304] 0 2023-01-04T18:17:03.495 INFO:tasks.workunit.client.0.smithi050.stdout:2/449: fsync d1/d19/f90 0 2023-01-04T18:17:03.495 INFO:tasks.workunit.client.0.smithi050.stdout:2/450: readlink d1/dd/l8d 0 2023-01-04T18:17:03.495 INFO:tasks.workunit.client.0.smithi050.stdout:2/451: write d1/dd/d11/d14/d39/f61 [565290,113922] 0 2023-01-04T18:17:03.516 INFO:tasks.workunit.client.0.smithi050.stdout:9/439: link d1/d12/d2d/f85 d1/d12/d2d/d39/f92 0 2023-01-04T18:17:03.524 INFO:tasks.workunit.client.0.smithi050.stdout:5/590: mkdir d13/d15/d66/db8/d1f/d35/d59/d87/dd0 0 2023-01-04T18:17:03.525 INFO:tasks.workunit.client.0.smithi050.stdout:5/591: dread d13/d28/f93 [0,4194304] 0 2023-01-04T18:17:03.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:01.920206+0000 mgr.smithi098.vhfzum (mgr.24455) 38 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 820 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 35 MiB/s rd, 74 MiB/s wr, 206 op/s 2023-01-04T18:17:03.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:02.101970+0000 mon.smithi050 (mon.0) 595 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:17:03.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:02.108888+0000 mon.smithi098 (mon.1) 46 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-01-04T18:17:03.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:02.109301+0000 mgr.smithi098.vhfzum (mgr.24455) 39 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-01-04T18:17:03.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:02.110192+0000 mon.smithi098 (mon.1) 47 : audit [INF] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi050.front.sepia.ceph.com:9095"}]: dispatch 2023-01-04T18:17:03.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:02.110689+0000 mgr.smithi098.vhfzum (mgr.24455) 40 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi050.front.sepia.ceph.com:9095"}]: dispatch 2023-01-04T18:17:03.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:02.116229+0000 mon.smithi050 (mon.0) 596 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:17:03.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:02.121510+0000 mon.smithi098 (mon.1) 48 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:17:03.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:02.125961+0000 mon.smithi050 (mon.0) 597 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:17:03.564 INFO:tasks.workunit.client.0.smithi050.stdout:7/507: getdents d6/db/d20/d4f 0 2023-01-04T18:17:03.564 INFO:tasks.workunit.client.0.smithi050.stdout:7/508: write d6/db/d15/f44 [828086,115089] 0 2023-01-04T18:17:03.566 INFO:tasks.workunit.client.0.smithi050.stdout:2/452: rmdir d1/dd/d28/d2c/d2e/d3f 39 2023-01-04T18:17:03.566 INFO:tasks.workunit.client.0.smithi050.stdout:2/453: fdatasync d1/dd/d28/d2c/d2e/d3f/f8e 0 2023-01-04T18:17:03.573 INFO:tasks.workunit.client.0.smithi050.stdout:2/454: dread d1/dd/d62/d69/f84 [0,4194304] 0 2023-01-04T18:17:03.576 INFO:tasks.workunit.client.0.smithi050.stdout:2/455: rename d1/d19 to d1/dd/d11/d14/d91 0 2023-01-04T18:17:03.577 INFO:tasks.workunit.client.0.smithi050.stdout:2/456: mknod d1/dd/d11/d14/c92 0 2023-01-04T18:17:03.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:01.920206+0000 mgr.smithi098.vhfzum (mgr.24455) 38 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 820 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 35 MiB/s rd, 74 MiB/s wr, 206 op/s 2023-01-04T18:17:03.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:02.101970+0000 mon.smithi050 (mon.0) 595 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:17:03.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:02.108888+0000 mon.smithi098 (mon.1) 46 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-01-04T18:17:03.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:02.109301+0000 mgr.smithi098.vhfzum (mgr.24455) 39 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-01-04T18:17:03.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:02.110192+0000 mon.smithi098 (mon.1) 47 : audit [INF] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi050.front.sepia.ceph.com:9095"}]: dispatch 2023-01-04T18:17:03.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:02.110689+0000 mgr.smithi098.vhfzum (mgr.24455) 40 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi050.front.sepia.ceph.com:9095"}]: dispatch 2023-01-04T18:17:03.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:02.116229+0000 mon.smithi050 (mon.0) 596 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:17:03.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:02.121510+0000 mon.smithi098 (mon.1) 48 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:17:03.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:02.125961+0000 mon.smithi050 (mon.0) 597 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:17:03.583 INFO:tasks.workunit.client.0.smithi050.stdout:7/509: dwrite d6/d28/d3c/d42/d5f/fb1 [0,4194304] 0 2023-01-04T18:17:03.586 INFO:tasks.workunit.client.0.smithi050.stdout:7/510: symlink d6/db/d3b/lb2 0 2023-01-04T18:17:03.586 INFO:tasks.workunit.client.0.smithi050.stdout:7/511: readlink d6/d28/l75 0 2023-01-04T18:17:03.586 INFO:tasks.workunit.client.0.smithi050.stdout:7/512: readlink d6/db/d15/d1b/l97 0 2023-01-04T18:17:03.587 INFO:tasks.workunit.client.0.smithi050.stdout:7/513: read d6/f7 [418523,52829] 0 2023-01-04T18:17:03.588 INFO:tasks.workunit.client.0.smithi050.stdout:2/457: dread d1/dd/d11/d12/f4d [0,4194304] 0 2023-01-04T18:17:03.588 INFO:tasks.workunit.client.0.smithi050.stdout:7/514: link d6/d28/d99/f64 d6/db/d3a/fb3 0 2023-01-04T18:17:03.588 INFO:tasks.workunit.client.0.smithi050.stdout:7/515: stat d6/d28/d99 0 2023-01-04T18:17:03.589 INFO:tasks.workunit.client.0.smithi050.stdout:2/458: write d1/dd/d11/d14/f30 [3812144,123876] 0 2023-01-04T18:17:03.590 INFO:tasks.workunit.client.0.smithi050.stdout:7/516: rmdir d6/d6b/d8b 39 2023-01-04T18:17:03.590 INFO:tasks.workunit.client.0.smithi050.stdout:7/517: chown d6/db/d3b/f9e 71192 1 2023-01-04T18:17:03.593 INFO:tasks.workunit.client.0.smithi050.stdout:7/518: unlink d6/d28/d3c/d42/d5f/d6a/fae 0 2023-01-04T18:17:03.655 INFO:tasks.workunit.client.0.smithi050.stdout:2/459: dwrite d1/dd/d11/d1e/f20 [0,4194304] 0 2023-01-04T18:17:03.660 INFO:tasks.workunit.client.0.smithi050.stdout:7/519: unlink d6/f1c 0 2023-01-04T18:17:03.665 INFO:tasks.workunit.client.0.smithi050.stdout:2/460: creat d1/dd/d11/d14/d91/d5a/d7f/f93 x:0 0 0 2023-01-04T18:17:03.665 INFO:tasks.workunit.client.0.smithi050.stdout:2/461: chown d1/dd/d11/d14/d39/l3b 183359 1 2023-01-04T18:17:03.665 INFO:tasks.workunit.client.0.smithi050.stdout:2/462: chown d1/dd/d11/d1e/d6e/c73 1748970 1 2023-01-04T18:17:03.666 INFO:tasks.workunit.client.0.smithi050.stdout:2/463: write d1/dd/d11/d14/d91/d5a/d7f/f93 [164664,61734] 0 2023-01-04T18:17:03.666 INFO:tasks.workunit.client.0.smithi050.stdout:7/520: creat d6/fb4 x:0 0 0 2023-01-04T18:17:03.669 INFO:tasks.workunit.client.0.smithi050.stdout:1/439: sync 2023-01-04T18:17:03.669 INFO:tasks.workunit.client.0.smithi050.stdout:3/462: sync 2023-01-04T18:17:03.669 INFO:tasks.workunit.client.0.smithi050.stdout:8/475: sync 2023-01-04T18:17:03.669 INFO:tasks.workunit.client.0.smithi050.stdout:1/440: truncate d8/d14/d1c/f76 648973 0 2023-01-04T18:17:03.669 INFO:tasks.workunit.client.0.smithi050.stdout:1/441: fdatasync f6 0 2023-01-04T18:17:03.669 INFO:tasks.workunit.client.0.smithi050.stdout:1/442: readlink d8/d14/d1c/l25 0 2023-01-04T18:17:03.669 INFO:tasks.workunit.client.0.smithi050.stdout:2/464: rename d1/dd/d11/d14/c92 to d1/dd/d11/d1e/c94 0 2023-01-04T18:17:03.670 INFO:tasks.workunit.client.0.smithi050.stdout:4/420: sync 2023-01-04T18:17:03.670 INFO:tasks.workunit.client.0.smithi050.stdout:0/355: sync 2023-01-04T18:17:03.670 INFO:tasks.workunit.client.0.smithi050.stdout:2/465: dread d1/dd/d11/d14/d39/f61 [0,4194304] 0 2023-01-04T18:17:03.671 INFO:tasks.workunit.client.0.smithi050.stdout:3/463: dread d0/d10/f8c [0,4194304] 0 2023-01-04T18:17:03.672 INFO:tasks.workunit.client.0.smithi050.stdout:2/466: write d1/dd/d11/f26 [2923397,77237] 0 2023-01-04T18:17:03.672 INFO:tasks.workunit.client.0.smithi050.stdout:2/467: chown d1/dd/d11/l17 2586 1 2023-01-04T18:17:03.674 INFO:tasks.workunit.client.0.smithi050.stdout:8/476: creat d3/d2a/d30/d3b/d4d/fad x:0 0 0 2023-01-04T18:17:03.674 INFO:tasks.workunit.client.0.smithi050.stdout:7/521: creat d6/db/d15/d2e/d4b/fb5 x:0 0 0 2023-01-04T18:17:03.675 INFO:tasks.workunit.client.0.smithi050.stdout:4/421: dread d14/d1b/d32/f35 [0,4194304] 0 2023-01-04T18:17:03.675 INFO:tasks.workunit.client.0.smithi050.stdout:4/422: chown d14/d1b/d1f/d22/d3e/d44/d59/d5f/d80 58 1 2023-01-04T18:17:03.676 INFO:tasks.workunit.client.0.smithi050.stdout:1/443: link d8/c27 d8/d48/d5c/c88 0 2023-01-04T18:17:03.677 INFO:tasks.workunit.client.0.smithi050.stdout:3/464: mkdir d0/dab 0 2023-01-04T18:17:03.678 INFO:tasks.workunit.client.0.smithi050.stdout:0/356: dread d0/d6/d8/d35/f2b [0,4194304] 0 2023-01-04T18:17:03.686 INFO:tasks.workunit.client.0.smithi050.stdout:2/468: creat d1/dd/d28/d2c/d66/f95 x:0 0 0 2023-01-04T18:17:03.689 INFO:tasks.workunit.client.0.smithi050.stdout:8/477: creat d3/d2a/d27/d93/d7f/fae x:0 0 0 2023-01-04T18:17:03.692 INFO:tasks.workunit.client.0.smithi050.stdout:7/522: creat d6/d28/d3c/d62/fb6 x:0 0 0 2023-01-04T18:17:03.694 INFO:tasks.workunit.client.0.smithi050.stdout:2/469: write d1/dd/d11/d1e/f25 [124795,130632] 0 2023-01-04T18:17:03.698 INFO:tasks.workunit.client.0.smithi050.stdout:3/465: symlink d0/d1b/d2f/d56/d98/lac 0 2023-01-04T18:17:03.702 INFO:tasks.workunit.client.0.smithi050.stdout:6/419: sync 2023-01-04T18:17:03.707 INFO:tasks.workunit.client.0.smithi050.stdout:0/357: dwrite d0/f6d [0,4194304] 0 2023-01-04T18:17:03.707 INFO:tasks.workunit.client.0.smithi050.stdout:4/423: dwrite d14/d1b/d32/f37 [0,4194304] 0 2023-01-04T18:17:03.707 INFO:tasks.workunit.client.0.smithi050.stdout:1/444: dwrite d8/d14/d1c/f78 [0,4194304] 0 2023-01-04T18:17:03.707 INFO:tasks.workunit.client.0.smithi050.stdout:8/478: mkdir d3/d2a/d2d/d85/daf 0 2023-01-04T18:17:03.709 INFO:tasks.workunit.client.0.smithi050.stdout:8/479: write d3/d2a/f90 [844593,2290] 0 2023-01-04T18:17:03.711 INFO:tasks.workunit.client.0.smithi050.stdout:3/466: creat d0/d8f/d46/fad x:0 0 0 2023-01-04T18:17:03.713 INFO:tasks.workunit.client.0.smithi050.stdout:6/420: mkdir d0/d9/d25/d40/d89 0 2023-01-04T18:17:03.714 INFO:tasks.workunit.client.0.smithi050.stdout:6/421: write d0/d9/df/f56 [400945,27387] 0 2023-01-04T18:17:03.714 INFO:tasks.workunit.client.0.smithi050.stdout:6/422: truncate d0/d9/df/f70 56095 0 2023-01-04T18:17:03.717 INFO:tasks.workunit.client.0.smithi050.stdout:7/523: dwrite d6/db/d15/d48/f57 [0,4194304] 0 2023-01-04T18:17:03.717 INFO:tasks.workunit.client.0.smithi050.stdout:7/524: truncate d6/db/d3b/f61 1074170 0 2023-01-04T18:17:03.717 INFO:tasks.workunit.client.0.smithi050.stdout:6/423: write d0/d9/d38/d60/f82 [7532674,79834] 0 2023-01-04T18:17:03.720 INFO:tasks.workunit.client.0.smithi050.stdout:7/525: dread d6/db/d15/d1b/f8c [0,4194304] 0 2023-01-04T18:17:03.720 INFO:tasks.workunit.client.0.smithi050.stdout:0/358: mknod d0/d6/d8/d25/c6e 0 2023-01-04T18:17:03.726 INFO:tasks.workunit.client.0.smithi050.stdout:4/424: dread f5 [0,4194304] 0 2023-01-04T18:17:03.726 INFO:tasks.workunit.client.0.smithi050.stdout:2/470: dwrite d1/f86 [0,4194304] 0 2023-01-04T18:17:03.731 INFO:tasks.workunit.client.0.smithi050.stdout:8/480: truncate d3/d2a/d27/d93/d7f/d96/f9a 417105 0 2023-01-04T18:17:03.739 INFO:tasks.workunit.client.0.smithi050.stdout:6/424: dwrite d0/d9/f4b [0,4194304] 0 2023-01-04T18:17:03.739 INFO:tasks.workunit.client.0.smithi050.stdout:3/467: dwrite d0/d8f/f25 [0,4194304] 0 2023-01-04T18:17:03.741 INFO:tasks.workunit.client.0.smithi050.stdout:7/526: truncate d6/db/d3a/fb3 662241 0 2023-01-04T18:17:03.743 INFO:tasks.workunit.client.0.smithi050.stdout:0/359: link d0/d6/f26 d0/d6/d8/d35/f6f 0 2023-01-04T18:17:03.744 INFO:tasks.workunit.client.0.smithi050.stdout:4/425: rmdir d14/d1b/d66 39 2023-01-04T18:17:03.750 INFO:tasks.workunit.client.0.smithi050.stdout:1/445: rename d8/d14/f46 to d8/f89 0 2023-01-04T18:17:03.752 INFO:tasks.workunit.client.0.smithi050.stdout:8/481: creat d3/d2a/d27/d93/fb0 x:0 0 0 2023-01-04T18:17:03.752 INFO:tasks.workunit.client.0.smithi050.stdout:8/482: dread - d3/d2a/d30/d3b/d4d/fad zero size 2023-01-04T18:17:03.757 INFO:tasks.workunit.client.0.smithi050.stdout:3/468: mknod d0/d8f/d46/d80/cae 0 2023-01-04T18:17:03.759 INFO:tasks.workunit.client.0.smithi050.stdout:0/360: creat d0/d6/d28/d1a/f70 x:0 0 0 2023-01-04T18:17:03.761 INFO:tasks.workunit.client.0.smithi050.stdout:2/471: rename d1/dd/d28/d2c/d2e/d36/c60 to d1/dd/d28/d2c/d2e/c96 0 2023-01-04T18:17:03.761 INFO:tasks.workunit.client.0.smithi050.stdout:6/425: dwrite d0/d9/d38/d1c/f26 [0,4194304] 0 2023-01-04T18:17:03.762 INFO:tasks.workunit.client.0.smithi050.stdout:4/426: dwrite d14/d1b/d1f/d22/d3e/f60 [0,4194304] 0 2023-01-04T18:17:03.764 INFO:tasks.workunit.client.0.smithi050.stdout:1/446: creat d8/d14/d1c/d28/d57/d6a/f8a x:0 0 0 2023-01-04T18:17:03.766 INFO:tasks.workunit.client.0.smithi050.stdout:6/426: dread d0/f14 [0,4194304] 0 2023-01-04T18:17:03.766 INFO:tasks.workunit.client.0.smithi050.stdout:6/427: truncate d0/d9/d25/f3a 1650741 0 2023-01-04T18:17:03.767 INFO:tasks.workunit.client.0.smithi050.stdout:8/483: creat d3/d2a/d74/d92/d94/fb1 x:0 0 0 2023-01-04T18:17:03.771 INFO:tasks.workunit.client.0.smithi050.stdout:3/469: creat d0/d1b/d2f/faf x:0 0 0 2023-01-04T18:17:03.773 INFO:tasks.workunit.client.0.smithi050.stdout:3/470: write d0/d1b/d2f/d56/d32/f49 [3248421,34679] 0 2023-01-04T18:17:03.773 INFO:tasks.workunit.client.0.smithi050.stdout:3/471: stat d0/d1b/d2f/d71/f7b 0 2023-01-04T18:17:03.773 INFO:tasks.workunit.client.0.smithi050.stdout:8/484: dread d3/d2a/d30/d3b/d4d/d23/d55/f57 [0,4194304] 0 2023-01-04T18:17:03.773 INFO:tasks.workunit.client.0.smithi050.stdout:7/527: link d6/l14 d6/d28/d3c/lb7 0 2023-01-04T18:17:03.774 INFO:tasks.workunit.client.0.smithi050.stdout:7/528: chown l3 1681200127 1 2023-01-04T18:17:03.778 INFO:tasks.workunit.client.0.smithi050.stdout:0/361: rename d0/d6/d8/d51/f52 to d0/d6/d8/d25/d3e/f71 0 2023-01-04T18:17:03.779 INFO:tasks.workunit.client.0.smithi050.stdout:2/472: link d1/dd/d11/d14/f76 d1/f97 0 2023-01-04T18:17:03.781 INFO:tasks.workunit.client.0.smithi050.stdout:1/447: dwrite d8/d14/f30 [0,4194304] 0 2023-01-04T18:17:03.783 INFO:tasks.workunit.client.0.smithi050.stdout:3/472: dread d0/d1b/f23 [0,4194304] 0 2023-01-04T18:17:03.788 INFO:tasks.workunit.client.0.smithi050.stdout:7/529: dwrite d6/db/d15/d2e/d4b/fb5 [0,4194304] 0 2023-01-04T18:17:03.788 INFO:tasks.workunit.client.0.smithi050.stdout:7/530: fdatasync d6/db/f19 0 2023-01-04T18:17:03.789 INFO:tasks.workunit.client.0.smithi050.stdout:4/427: mkdir d14/d1b/d1f/d22/d3e/d85 0 2023-01-04T18:17:03.797 INFO:tasks.workunit.client.0.smithi050.stdout:8/485: creat d3/d2a/d27/d93/d7f/d96/d46/fb2 x:0 0 0 2023-01-04T18:17:03.797 INFO:tasks.workunit.client.0.smithi050.stdout:8/486: write d3/d2a/d30/d3b/d4d/fad [142112,84917] 0 2023-01-04T18:17:03.797 INFO:tasks.workunit.client.0.smithi050.stdout:8/487: chown d3/d2a/f6e 87009 1 2023-01-04T18:17:03.799 INFO:tasks.workunit.client.0.smithi050.stdout:6/428: rename d0/d9/d25/f64 to d0/d71/f8a 0 2023-01-04T18:17:03.801 INFO:tasks.workunit.client.0.smithi050.stdout:0/362: truncate d0/d6/d28/d1a/f30 178196 0 2023-01-04T18:17:03.801 INFO:tasks.workunit.client.0.smithi050.stdout:0/363: write d0/d6/d28/f49 [471866,9028] 0 2023-01-04T18:17:03.804 INFO:tasks.workunit.client.0.smithi050.stdout:2/473: mknod d1/dd/d11/d14/d91/d5a/d7f/c98 0 2023-01-04T18:17:03.808 INFO:tasks.workunit.client.0.smithi050.stdout:1/448: link d8/f4d d8/d48/d5c/d67/d3b/d84/f8b 0 2023-01-04T18:17:03.809 INFO:tasks.workunit.client.0.smithi050.stdout:0/364: dread d0/d6/f21 [0,4194304] 0 2023-01-04T18:17:03.811 INFO:tasks.workunit.client.0.smithi050.stdout:3/473: creat d0/d1b/d2f/d56/fb0 x:0 0 0 2023-01-04T18:17:03.813 INFO:tasks.workunit.client.0.smithi050.stdout:0/365: write d0/d6/d28/d1a/f30 [98533,120589] 0 2023-01-04T18:17:03.819 INFO:tasks.workunit.client.0.smithi050.stdout:0/366: dread d0/d6/d8/f2a [0,4194304] 0 2023-01-04T18:17:03.831 INFO:tasks.workunit.client.0.smithi050.stdout:7/531: creat d6/d6b/d8b/fb8 x:0 0 0 2023-01-04T18:17:03.835 INFO:tasks.workunit.client.0.smithi050.stdout:4/428: mknod d14/c86 0 2023-01-04T18:17:03.837 INFO:tasks.workunit.client.0.smithi050.stdout:8/488: creat d3/d2a/d27/d93/d7f/d96/fb3 x:0 0 0 2023-01-04T18:17:03.837 INFO:tasks.workunit.client.0.smithi050.stdout:8/489: stat d3/d2a/d30/d3b/c99 0 2023-01-04T18:17:03.837 INFO:tasks.workunit.client.0.smithi050.stdout:8/490: getdents d3/d2a/d30/d3b/d4d/d23 0 2023-01-04T18:17:03.837 INFO:tasks.workunit.client.0.smithi050.stdout:8/491: fdatasync d3/d2a/d27/d93/d7f/fae 0 2023-01-04T18:17:03.839 INFO:tasks.workunit.client.0.smithi050.stdout:9/440: sync 2023-01-04T18:17:03.839 INFO:tasks.workunit.client.0.smithi050.stdout:9/441: fdatasync d1/d3/f4 0 2023-01-04T18:17:03.843 INFO:tasks.workunit.client.0.smithi050.stdout:2/474: mkdir d1/dd/d11/d14/d39/d99 0 2023-01-04T18:17:03.849 INFO:tasks.workunit.client.0.smithi050.stdout:3/474: link d0/d10/l36 d0/d1b/d2f/d56/d98/d9c/lb1 0 2023-01-04T18:17:03.849 INFO:tasks.workunit.client.0.smithi050.stdout:3/475: dread - d0/f13 zero size 2023-01-04T18:17:03.850 INFO:tasks.workunit.client.0.smithi050.stdout:0/367: symlink d0/l72 0 2023-01-04T18:17:03.850 INFO:tasks.workunit.client.0.smithi050.stdout:0/368: write d0/d6/d28/f49 [538413,79693] 0 2023-01-04T18:17:03.850 INFO:tasks.workunit.client.0.smithi050.stdout:0/369: fsync d0/f6d 0 2023-01-04T18:17:03.850 INFO:tasks.workunit.client.0.smithi050.stdout:0/370: fsync d0/d6/d8/d4f/f69 0 2023-01-04T18:17:03.851 INFO:tasks.workunit.client.0.smithi050.stdout:0/371: write d0/f4d [692038,81246] 0 2023-01-04T18:17:03.851 INFO:tasks.workunit.client.0.smithi050.stdout:0/372: chown d0/d6/d8/f13 6756663 1 2023-01-04T18:17:03.851 INFO:tasks.workunit.client.0.smithi050.stdout:0/373: fdatasync d0/d6/f58 0 2023-01-04T18:17:03.852 INFO:tasks.workunit.client.0.smithi050.stdout:7/532: mknod d6/db/d20/d4f/d6e/cb9 0 2023-01-04T18:17:03.855 INFO:tasks.workunit.client.0.smithi050.stdout:4/429: mkdir d14/d1b/d1f/d22/d87 0 2023-01-04T18:17:03.856 INFO:tasks.workunit.client.0.smithi050.stdout:8/492: symlink d3/d2a/d30/d3b/d4d/d23/d31/lb4 0 2023-01-04T18:17:03.856 INFO:tasks.workunit.client.0.smithi050.stdout:8/493: write d3/d2a/d60/f71 [500574,44697] 0 2023-01-04T18:17:03.856 INFO:tasks.workunit.client.0.smithi050.stdout:4/430: write d14/f15 [3364893,98147] 0 2023-01-04T18:17:03.857 INFO:tasks.workunit.client.0.smithi050.stdout:9/442: mknod d1/d12/d41/d60/d7c/c93 0 2023-01-04T18:17:03.858 INFO:tasks.workunit.client.0.smithi050.stdout:9/443: read - d1/d3/d11/d1f/f73 zero size 2023-01-04T18:17:03.858 INFO:tasks.workunit.client.0.smithi050.stdout:9/444: fsync d1/d12/d41/f71 0 2023-01-04T18:17:03.858 INFO:tasks.workunit.client.0.smithi050.stdout:9/445: dread - d1/d12/d41/d60/f90 zero size 2023-01-04T18:17:03.858 INFO:tasks.workunit.client.0.smithi050.stdout:6/429: dread d0/d9/d25/d4d/f66 [0,4194304] 0 2023-01-04T18:17:03.860 INFO:tasks.workunit.client.0.smithi050.stdout:2/475: link d1/dd/f74 d1/dd/d28/d2c/f9a 0 2023-01-04T18:17:03.861 INFO:tasks.workunit.client.0.smithi050.stdout:1/449: dread d8/d14/d1c/f40 [0,4194304] 0 2023-01-04T18:17:03.861 INFO:tasks.workunit.client.0.smithi050.stdout:3/476: creat d0/d1b/d2f/d56/d32/fb2 x:0 0 0 2023-01-04T18:17:03.863 INFO:tasks.workunit.client.0.smithi050.stdout:0/374: rename d0/d6/d8/d25/d3e to d0/d73 0 2023-01-04T18:17:03.865 INFO:tasks.workunit.client.0.smithi050.stdout:7/533: getdents d6/d28/d3c/d42/d5f/d6a 0 2023-01-04T18:17:03.865 INFO:tasks.workunit.client.0.smithi050.stdout:7/534: write d6/fb4 [6825,102493] 0 2023-01-04T18:17:03.865 INFO:tasks.workunit.client.0.smithi050.stdout:7/535: stat d6/db/d15/f9b 0 2023-01-04T18:17:03.866 INFO:tasks.workunit.client.0.smithi050.stdout:7/536: chown d6/db/d15/d2e/f5d 5705 1 2023-01-04T18:17:03.866 INFO:tasks.workunit.client.0.smithi050.stdout:8/494: link d3/d2a/d60/fa8 d3/d2a/d2d/fb5 0 2023-01-04T18:17:03.871 INFO:tasks.workunit.client.0.smithi050.stdout:4/431: unlink d14/d1b/d1f/d63/l6e 0 2023-01-04T18:17:03.873 INFO:tasks.workunit.client.0.smithi050.stdout:6/430: symlink d0/l8b 0 2023-01-04T18:17:03.874 INFO:tasks.workunit.client.0.smithi050.stdout:2/476: link d1/dd/d11/d14/l1b d1/dd/d28/d2c/d66/l9b 0 2023-01-04T18:17:03.875 INFO:tasks.workunit.client.0.smithi050.stdout:8/495: dread d3/d2a/d60/d2c/f5e [0,4194304] 0 2023-01-04T18:17:03.875 INFO:tasks.workunit.client.0.smithi050.stdout:5/592: sync 2023-01-04T18:17:03.876 INFO:tasks.workunit.client.0.smithi050.stdout:3/477: mknod d0/cb3 0 2023-01-04T18:17:03.876 INFO:tasks.workunit.client.0.smithi050.stdout:3/478: truncate d0/d1b/d2f/d31/f86 652526 0 2023-01-04T18:17:03.878 INFO:tasks.workunit.client.0.smithi050.stdout:3/479: read d0/d1b/d2f/d56/f53 [499572,114595] 0 2023-01-04T18:17:03.878 INFO:tasks.workunit.client.0.smithi050.stdout:3/480: chown d0/d1b/d2f/d56/d6b/f99 1 1 2023-01-04T18:17:03.878 INFO:tasks.workunit.client.0.smithi050.stdout:3/481: write d0/d1b/d2f/d56/d32/f6d [584295,102174] 0 2023-01-04T18:17:03.880 INFO:tasks.workunit.client.0.smithi050.stdout:1/450: rename d8/d48/d5c/d67/d3a/d58 to d8/d48/d8c 0 2023-01-04T18:17:03.884 INFO:tasks.workunit.client.0.smithi050.stdout:9/446: dwrite d1/d3/d3b/d63/f3d [4194304,4194304] 0 2023-01-04T18:17:03.884 INFO:tasks.workunit.client.0.smithi050.stdout:7/537: dread d6/db/d15/d1b/f21 [0,4194304] 0 2023-01-04T18:17:03.884 INFO:tasks.workunit.client.0.smithi050.stdout:9/447: write d1/d3/f5c [61595,15927] 0 2023-01-04T18:17:03.885 INFO:tasks.workunit.client.0.smithi050.stdout:9/448: truncate d1/d12/d2d/f85 972226 0 2023-01-04T18:17:03.887 INFO:tasks.workunit.client.0.smithi050.stdout:0/375: mknod d0/d6/c74 0 2023-01-04T18:17:03.888 INFO:tasks.workunit.client.0.smithi050.stdout:3/482: dread d0/dd/f90 [0,4194304] 0 2023-01-04T18:17:03.888 INFO:tasks.workunit.client.0.smithi050.stdout:3/483: fsync d0/d8f/f25 0 2023-01-04T18:17:03.888 INFO:tasks.workunit.client.0.smithi050.stdout:3/484: fsync d0/d10/f65 0 2023-01-04T18:17:03.890 INFO:tasks.workunit.client.0.smithi050.stdout:6/431: mknod d0/d71/c8c 0 2023-01-04T18:17:03.890 INFO:tasks.workunit.client.0.smithi050.stdout:6/432: write d0/d71/f8a [398365,97957] 0 2023-01-04T18:17:03.891 INFO:tasks.workunit.client.0.smithi050.stdout:6/433: write d0/d9/d25/f39 [730270,60791] 0 2023-01-04T18:17:03.893 INFO:tasks.workunit.client.0.smithi050.stdout:4/432: dwrite d14/d1b/d1f/f27 [0,4194304] 0 2023-01-04T18:17:03.894 INFO:tasks.workunit.client.0.smithi050.stdout:2/477: creat d1/dd/d11/f9c x:0 0 0 2023-01-04T18:17:03.894 INFO:tasks.workunit.client.0.smithi050.stdout:2/478: readlink d1/dd/l53 0 2023-01-04T18:17:03.895 INFO:tasks.workunit.client.0.smithi050.stdout:2/479: dread - d1/dd/d11/d14/d91/f5f zero size 2023-01-04T18:17:03.896 INFO:tasks.workunit.client.0.smithi050.stdout:8/496: rmdir d3/d2a/d30/d3b/d4d/d23 39 2023-01-04T18:17:03.897 INFO:tasks.workunit.client.0.smithi050.stdout:8/497: stat d3/d2a/d30/d3b/d4d/d23/d31/f78 0 2023-01-04T18:17:03.897 INFO:tasks.workunit.client.0.smithi050.stdout:0/376: dread d0/d73/f61 [0,4194304] 0 2023-01-04T18:17:03.898 INFO:tasks.workunit.client.0.smithi050.stdout:1/451: dwrite d8/d48/d5c/d67/d3b/d84/f8b [8388608,4194304] 0 2023-01-04T18:17:03.906 INFO:tasks.workunit.client.0.smithi050.stdout:5/593: link d13/d15/d66/db8/d27/d78/l7d d13/d15/d66/db8/d27/d46/d4e/d4d/ld1 0 2023-01-04T18:17:03.908 INFO:tasks.workunit.client.0.smithi050.stdout:7/538: rename d6/f31 to d6/db/d20/d55/fba 0 2023-01-04T18:17:03.914 INFO:tasks.workunit.client.0.smithi050.stdout:3/485: rmdir d0/dab 0 2023-01-04T18:17:03.915 INFO:tasks.workunit.client.0.smithi050.stdout:6/434: link d0/c84 d0/d9/d38/d16/c8d 0 2023-01-04T18:17:03.915 INFO:tasks.workunit.client.0.smithi050.stdout:6/435: chown d0/d4a 63617686 1 2023-01-04T18:17:03.917 INFO:tasks.workunit.client.0.smithi050.stdout:2/480: dwrite d1/dd/d38/f75 [0,4194304] 0 2023-01-04T18:17:03.917 INFO:tasks.workunit.client.0.smithi050.stdout:1/452: dread d8/d14/f30 [0,4194304] 0 2023-01-04T18:17:03.917 INFO:tasks.workunit.client.0.smithi050.stdout:1/453: dread - d8/d48/d5c/f7c zero size 2023-01-04T18:17:03.918 INFO:tasks.workunit.client.0.smithi050.stdout:0/377: dwrite d0/f3b [0,4194304] 0 2023-01-04T18:17:03.918 INFO:tasks.workunit.client.0.smithi050.stdout:0/378: dread - d0/d6/d28/d1a/f40 zero size 2023-01-04T18:17:03.919 INFO:tasks.workunit.client.0.smithi050.stdout:4/433: truncate d14/d1b/d1f/f46 3684965 0 2023-01-04T18:17:03.921 INFO:tasks.workunit.client.0.smithi050.stdout:7/539: creat d6/db/d20/d55/fbb x:0 0 0 2023-01-04T18:17:03.925 INFO:tasks.workunit.client.0.smithi050.stdout:6/436: truncate d0/d4a/f7e 1040464 0 2023-01-04T18:17:03.925 INFO:tasks.workunit.client.0.smithi050.stdout:6/437: chown d0/d9/d25/f27 101 1 2023-01-04T18:17:03.927 INFO:tasks.workunit.client.0.smithi050.stdout:5/594: dread d13/d15/d66/db8/d1f/d35/f65 [0,4194304] 0 2023-01-04T18:17:03.929 INFO:tasks.workunit.client.0.smithi050.stdout:3/486: write d0/d1a/f58 [1054401,16460] 0 2023-01-04T18:17:03.931 INFO:tasks.workunit.client.0.smithi050.stdout:2/481: creat d1/dd/d11/d14/d91/f9d x:0 0 0 2023-01-04T18:17:03.938 INFO:tasks.workunit.client.0.smithi050.stdout:2/482: dread d1/dd/d11/f65 [0,4194304] 0 2023-01-04T18:17:03.951 INFO:tasks.workunit.client.0.smithi050.stdout:0/379: dwrite d0/d6/d28/d1a/f30 [0,4194304] 0 2023-01-04T18:17:03.952 INFO:tasks.workunit.client.0.smithi050.stdout:6/438: dwrite d0/d9/d25/d4d/f6e [0,4194304] 0 2023-01-04T18:17:04.003 INFO:tasks.workunit.client.0.smithi050.stdout:1/454: creat d8/d48/d5c/d67/d3b/d84/f8d x:0 0 0 2023-01-04T18:17:04.004 INFO:tasks.workunit.client.0.smithi050.stdout:1/455: fdatasync d8/f4d 0 2023-01-04T18:17:04.007 INFO:tasks.workunit.client.0.smithi050.stdout:8/498: mkdir d3/d2a/d27/d93/d7f/d96/db6 0 2023-01-04T18:17:04.010 INFO:tasks.workunit.client.0.smithi050.stdout:7/540: symlink d6/d6b/lbc 0 2023-01-04T18:17:04.010 INFO:tasks.workunit.client.0.smithi050.stdout:7/541: readlink l3 0 2023-01-04T18:17:04.011 INFO:tasks.workunit.client.0.smithi050.stdout:7/542: chown d6/l14 1850190 1 2023-01-04T18:17:04.012 INFO:tasks.workunit.client.0.smithi050.stdout:9/449: truncate d1/d3/d3b/d63/f3d 6925649 0 2023-01-04T18:17:04.015 INFO:tasks.workunit.client.0.smithi050.stdout:9/450: write d1/d3/d3b/f27 [2898217,47559] 0 2023-01-04T18:17:04.018 INFO:tasks.workunit.client.0.smithi050.stdout:5/595: creat d13/d15/d66/db8/d1f/d35/fd2 x:0 0 0 2023-01-04T18:17:04.023 INFO:tasks.workunit.client.0.smithi050.stdout:3/487: getdents d0/d1b/d2f/d56/d98 0 2023-01-04T18:17:04.033 INFO:tasks.workunit.client.0.smithi050.stdout:2/483: truncate d1/dd/d28/d2c/d2e/d36/f42 3562736 0 2023-01-04T18:17:04.033 INFO:tasks.workunit.client.0.smithi050.stdout:2/484: fsync d1/dd/d11/d1e/d6e/f80 0 2023-01-04T18:17:04.034 INFO:tasks.workunit.client.0.smithi050.stdout:0/380: rename d0/d6/d8/d4f/c56 to d0/d73/c75 0 2023-01-04T18:17:04.035 INFO:tasks.workunit.client.0.smithi050.stdout:0/381: stat d0/d6/d28/d1a/c31 0 2023-01-04T18:17:04.043 INFO:tasks.workunit.client.0.smithi050.stdout:6/439: link d0/d9/d38/d16/d77/c86 d0/d9/d38/d60/d7a/c8e 0 2023-01-04T18:17:04.043 INFO:tasks.workunit.client.0.smithi050.stdout:6/440: getdents d0/d71/d83 0 2023-01-04T18:17:04.044 INFO:tasks.workunit.client.0.smithi050.stdout:1/456: symlink d8/d48/d5c/d67/d3b/l8e 0 2023-01-04T18:17:04.055 INFO:tasks.workunit.client.0.smithi050.stdout:8/499: link d3/d2a/d27/d93/d7f/d96/d46/l6c d3/d2a/d27/d8b/lb7 0 2023-01-04T18:17:04.055 INFO:tasks.workunit.client.0.smithi050.stdout:8/500: write d3/d2a/d60/f71 [1508345,10924] 0 2023-01-04T18:17:04.055 INFO:tasks.workunit.client.0.smithi050.stdout:8/501: dread - d3/d2a/d27/d93/d7f/fae zero size 2023-01-04T18:17:04.056 INFO:tasks.workunit.client.0.smithi050.stdout:8/502: truncate d3/d2a/d30/d3b/d53/f97 610104 0 2023-01-04T18:17:04.056 INFO:tasks.workunit.client.0.smithi050.stdout:9/451: creat d1/d3/d13/f94 x:0 0 0 2023-01-04T18:17:04.057 INFO:tasks.workunit.client.0.smithi050.stdout:5/596: mkdir d13/d15/d66/db8/d27/dca/dd3 0 2023-01-04T18:17:04.057 INFO:tasks.workunit.client.0.smithi050.stdout:5/597: read - d13/d15/d66/db8/d1f/d35/fa2 zero size 2023-01-04T18:17:04.059 INFO:tasks.workunit.client.0.smithi050.stdout:3/488: link d0/fb d0/d1b/d2f/d56/d98/fb4 0 2023-01-04T18:17:04.061 INFO:tasks.workunit.client.0.smithi050.stdout:2/485: creat d1/dd/d11/d1e/d6e/f9e x:0 0 0 2023-01-04T18:17:04.061 INFO:tasks.workunit.client.0.smithi050.stdout:2/486: stat d1/f8 0 2023-01-04T18:17:04.063 INFO:tasks.workunit.client.0.smithi050.stdout:0/382: rmdir d0/d6/d8 39 2023-01-04T18:17:04.063 INFO:tasks.workunit.client.0.smithi050.stdout:0/383: fsync d0/f6d 0 2023-01-04T18:17:04.064 INFO:tasks.workunit.client.0.smithi050.stdout:1/457: mknod d8/d48/d5c/d67/d3a/d31/d7f/c8f 0 2023-01-04T18:17:04.068 INFO:tasks.workunit.client.0.smithi050.stdout:8/503: symlink d3/d2a/d60/d84/lb8 0 2023-01-04T18:17:04.068 INFO:tasks.workunit.client.0.smithi050.stdout:8/504: write d3/d2a/d30/d3b/d4d/f88 [401057,23614] 0 2023-01-04T18:17:04.071 INFO:tasks.workunit.client.0.smithi050.stdout:2/487: creat d1/dd/d11/d14/d91/d5a/d7f/f9f x:0 0 0 2023-01-04T18:17:04.071 INFO:tasks.workunit.client.0.smithi050.stdout:2/488: stat d1/dd/d28/d2c/f9a 0 2023-01-04T18:17:04.072 INFO:tasks.workunit.client.0.smithi050.stdout:0/384: symlink d0/d6/d8/d51/l76 0 2023-01-04T18:17:04.073 INFO:tasks.workunit.client.0.smithi050.stdout:8/505: rmdir d3/d2a/d74/d92 39 2023-01-04T18:17:04.073 INFO:tasks.workunit.client.0.smithi050.stdout:8/506: fsync d3/d2a/d2d/f70 0 2023-01-04T18:17:04.086 INFO:tasks.workunit.client.0.smithi050.stdout:6/441: read d0/d9/f29 [6892471,116243] 0 2023-01-04T18:17:04.087 INFO:tasks.workunit.client.0.smithi050.stdout:6/442: write d0/f65 [4743912,80827] 0 2023-01-04T18:17:04.087 INFO:tasks.workunit.client.0.smithi050.stdout:6/443: readlink d0/l8b 0 2023-01-04T18:17:04.087 INFO:tasks.workunit.client.0.smithi050.stdout:5/598: dwrite d13/d15/d66/db8/d8f/fa7 [4194304,4194304] 0 2023-01-04T18:17:04.088 INFO:tasks.workunit.client.0.smithi050.stdout:9/452: dwrite d1/d3/d11/f5d [0,4194304] 0 2023-01-04T18:17:04.088 INFO:tasks.workunit.client.0.smithi050.stdout:9/453: dread - d1/d12/f74 zero size 2023-01-04T18:17:04.095 INFO:tasks.workunit.client.0.smithi050.stdout:0/385: dwrite d0/d6/d8/f5e [4194304,4194304] 0 2023-01-04T18:17:04.100 INFO:tasks.workunit.client.0.smithi050.stdout:5/599: dread d13/d15/d66/db8/d27/d46/d4e/d4d/f51 [0,4194304] 0 2023-01-04T18:17:04.105 INFO:tasks.workunit.client.0.smithi050.stdout:8/507: creat d3/fb9 x:0 0 0 2023-01-04T18:17:04.116 INFO:tasks.workunit.client.0.smithi050.stdout:0/386: creat d0/d6/d28/f77 x:0 0 0 2023-01-04T18:17:04.116 INFO:tasks.workunit.client.0.smithi050.stdout:5/600: stat d13/d15/d66/db8/d1f/d62/l81 0 2023-01-04T18:17:04.118 INFO:tasks.workunit.client.0.smithi050.stdout:0/387: dread d0/d6/d8/d35/f37 [4194304,4194304] 0 2023-01-04T18:17:04.119 INFO:tasks.workunit.client.0.smithi050.stdout:0/388: fdatasync d0/f6d 0 2023-01-04T18:17:04.119 INFO:tasks.workunit.client.0.smithi050.stdout:0/389: chown d0/d6/c74 213922059 1 2023-01-04T18:17:04.119 INFO:tasks.workunit.client.0.smithi050.stdout:0/390: dread - d0/d6/d28/f77 zero size 2023-01-04T18:17:04.119 INFO:tasks.workunit.client.0.smithi050.stdout:0/391: write d0/d6/f21 [5024677,15030] 0 2023-01-04T18:17:04.119 INFO:tasks.workunit.client.0.smithi050.stdout:0/392: dread - d0/f59 zero size 2023-01-04T18:17:04.120 INFO:tasks.workunit.client.0.smithi050.stdout:0/393: chown d0/d6/f58 9273 1 2023-01-04T18:17:04.120 INFO:tasks.workunit.client.0.smithi050.stdout:8/508: mknod d3/d2a/d60/cba 0 2023-01-04T18:17:04.120 INFO:tasks.workunit.client.0.smithi050.stdout:8/509: fsync d3/d2a/d2d/f70 0 2023-01-04T18:17:04.120 INFO:tasks.workunit.client.0.smithi050.stdout:5/601: symlink d13/d15/d66/db8/d27/dca/ld4 0 2023-01-04T18:17:04.121 INFO:tasks.workunit.client.0.smithi050.stdout:0/394: symlink d0/d73/l78 0 2023-01-04T18:17:04.122 INFO:tasks.workunit.client.0.smithi050.stdout:8/510: stat d3/d2a/d27/d93/d7f/d96/c75 0 2023-01-04T18:17:04.122 INFO:tasks.workunit.client.0.smithi050.stdout:0/395: mkdir d0/d73/d79 0 2023-01-04T18:17:04.123 INFO:tasks.workunit.client.0.smithi050.stdout:0/396: chown d0 473 1 2023-01-04T18:17:04.124 INFO:tasks.workunit.client.0.smithi050.stdout:8/511: rename d3/d2a/d30/c8f to d3/d2a/d74/d92/d94/d9c/cbb 0 2023-01-04T18:17:04.125 INFO:tasks.workunit.client.0.smithi050.stdout:0/397: getdents d0/d6/d8/d25 0 2023-01-04T18:17:04.127 INFO:tasks.workunit.client.0.smithi050.stdout:0/398: getdents d0/d6/d8/d35 0 2023-01-04T18:17:04.135 INFO:tasks.workunit.client.0.smithi050.stdout:8/512: dread d3/d2a/f18 [0,4194304] 0 2023-01-04T18:17:04.137 INFO:tasks.workunit.client.0.smithi050.stdout:8/513: rename d3/d2a/d27/d93/d7f/fae to d3/d2a/d74/d92/d94/d9c/fbc 0 2023-01-04T18:17:04.137 INFO:tasks.workunit.client.0.smithi050.stdout:8/514: creat d3/d2a/d27/d93/d7f/d96/d46/fbd x:0 0 0 2023-01-04T18:17:04.174 INFO:tasks.workunit.client.0.smithi050.stdout:1/458: dwrite d8/d48/d5c/d67/d3b/f68 [4194304,4194304] 0 2023-01-04T18:17:04.177 INFO:tasks.workunit.client.0.smithi050.stdout:3/489: dwrite d0/d8f/f25 [0,4194304] 0 2023-01-04T18:17:04.179 INFO:tasks.workunit.client.0.smithi050.stdout:0/399: dread d0/d6/d8/f2a [0,4194304] 0 2023-01-04T18:17:04.179 INFO:tasks.workunit.client.0.smithi050.stdout:1/459: rmdir d8/d48/d5c/d67/d3a/d31 39 2023-01-04T18:17:04.179 INFO:tasks.workunit.client.0.smithi050.stdout:1/460: chown d8/d48/d5c/d67/l87 522289 1 2023-01-04T18:17:04.180 INFO:tasks.workunit.client.0.smithi050.stdout:1/461: write d8/d14/d1c/d28/d57/d6a/f8a [476115,691] 0 2023-01-04T18:17:04.180 INFO:tasks.workunit.client.0.smithi050.stdout:1/462: write d8/d14/f5b [2401396,33876] 0 2023-01-04T18:17:04.180 INFO:tasks.workunit.client.0.smithi050.stdout:2/489: dwrite d1/f97 [0,4194304] 0 2023-01-04T18:17:04.183 INFO:tasks.workunit.client.0.smithi050.stdout:1/463: write d8/d14/d1c/f78 [2073615,100419] 0 2023-01-04T18:17:04.183 INFO:tasks.workunit.client.0.smithi050.stdout:0/400: read d0/d6/d8/f5e [34973,56874] 0 2023-01-04T18:17:04.184 INFO:tasks.workunit.client.0.smithi050.stdout:8/515: dread d3/d2a/d2d/f66 [0,4194304] 0 2023-01-04T18:17:04.184 INFO:tasks.workunit.client.0.smithi050.stdout:2/490: dread d1/dd/d11/d1e/f7d [0,4194304] 0 2023-01-04T18:17:04.184 INFO:tasks.workunit.client.0.smithi050.stdout:3/490: unlink d0/f13 0 2023-01-04T18:17:04.185 INFO:tasks.workunit.client.0.smithi050.stdout:6/444: dwrite d0/d9/df/f47 [0,4194304] 0 2023-01-04T18:17:04.185 INFO:tasks.workunit.client.0.smithi050.stdout:6/445: readlink d0/d9/d25/d2d/l34 0 2023-01-04T18:17:04.186 INFO:tasks.workunit.client.0.smithi050.stdout:6/446: write d0/d9/fa [3160934,59339] 0 2023-01-04T18:17:04.186 INFO:tasks.workunit.client.0.smithi050.stdout:6/447: fsync d0/f6f 0 2023-01-04T18:17:04.186 INFO:tasks.workunit.client.0.smithi050.stdout:5/602: dwrite d13/d15/d66/db8/d1f/f56 [0,4194304] 0 2023-01-04T18:17:04.187 INFO:tasks.workunit.client.0.smithi050.stdout:6/448: chown d0/d4a/f7e 1896 1 2023-01-04T18:17:04.193 INFO:tasks.workunit.client.0.smithi050.stdout:1/464: truncate d8/d48/d5c/d67/f1e 1383172 0 2023-01-04T18:17:04.195 INFO:tasks.workunit.client.0.smithi050.stdout:0/401: mkdir d0/d73/d68/d7a 0 2023-01-04T18:17:04.197 INFO:tasks.workunit.client.0.smithi050.stdout:8/516: link d3/d2a/d30/d3b/c99 d3/d2a/d30/d3b/d4d/d23/cbe 0 2023-01-04T18:17:04.198 INFO:tasks.workunit.client.0.smithi050.stdout:8/517: readlink d3/d2a/d30/d3b/d4d/d23/d55/laa 0 2023-01-04T18:17:04.198 INFO:tasks.workunit.client.0.smithi050.stdout:8/518: read - d3/fb9 zero size 2023-01-04T18:17:04.200 INFO:tasks.workunit.client.0.smithi050.stdout:0/402: write d0/d6/d8/d35/f37 [2981582,127563] 0 2023-01-04T18:17:04.202 INFO:tasks.workunit.client.0.smithi050.stdout:3/491: creat d0/d8f/d46/fb5 x:0 0 0 2023-01-04T18:17:04.202 INFO:tasks.workunit.client.0.smithi050.stdout:2/491: link d1/dd/d11/d1e/d6e/c7a d1/d41/ca0 0 2023-01-04T18:17:04.209 INFO:tasks.workunit.client.0.smithi050.stdout:3/492: write d0/d1b/f23 [855312,93427] 0 2023-01-04T18:17:04.209 INFO:tasks.workunit.client.0.smithi050.stdout:3/493: write d0/d10/f8c [1573205,24960] 0 2023-01-04T18:17:04.212 INFO:tasks.workunit.client.0.smithi050.stdout:2/492: dread d1/f8 [4194304,4194304] 0 2023-01-04T18:17:04.332 INFO:tasks.workunit.client.0.smithi050.stdout:5/603: mknod d13/d28/d7c/d83/cd5 0 2023-01-04T18:17:04.332 INFO:tasks.workunit.client.0.smithi050.stdout:6/449: mkdir d0/d9/d25/d8f 0 2023-01-04T18:17:04.333 INFO:tasks.workunit.client.0.smithi050.stdout:6/450: read d0/d9/f29 [1375012,74407] 0 2023-01-04T18:17:04.343 INFO:tasks.workunit.client.0.smithi050.stdout:1/465: rename d8/d48/d5c/d67/d3a/d23/c4f to d8/d48/d5c/d67/d3b/c90 0 2023-01-04T18:17:04.344 INFO:tasks.workunit.client.0.smithi050.stdout:1/466: chown d8/d48/d5c/d67/d3a/d23 2 1 2023-01-04T18:17:04.357 INFO:tasks.workunit.client.0.smithi050.stdout:0/403: creat d0/d6/d8/d51/f7b x:0 0 0 2023-01-04T18:17:04.357 INFO:tasks.workunit.client.0.smithi050.stdout:4/434: sync 2023-01-04T18:17:04.360 INFO:tasks.workunit.client.0.smithi050.stdout:3/494: mknod d0/d8f/d46/cb6 0 2023-01-04T18:17:04.364 INFO:tasks.workunit.client.0.smithi050.stdout:6/451: symlink d0/d9/d25/d40/d89/l90 0 2023-01-04T18:17:04.364 INFO:tasks.workunit.client.0.smithi050.stdout:6/452: fdatasync d0/d9/d25/d4d/f66 0 2023-01-04T18:17:04.368 INFO:tasks.workunit.client.0.smithi050.stdout:5/604: dwrite d13/d15/d66/db8/f4c [0,4194304] 0 2023-01-04T18:17:04.368 INFO:tasks.workunit.client.0.smithi050.stdout:5/605: chown l9 4 1 2023-01-04T18:17:04.370 INFO:tasks.workunit.client.0.smithi050.stdout:1/467: dwrite d8/d48/d5c/d67/d3a/f69 [0,4194304] 0 2023-01-04T18:17:04.372 INFO:tasks.workunit.client.0.smithi050.stdout:2/493: rename d1/dd/d11/d1e to d1/dd/d62/da1 0 2023-01-04T18:17:04.372 INFO:tasks.workunit.client.0.smithi050.stdout:2/494: truncate d1/dd/d11/d14/d91/f9d 76028 0 2023-01-04T18:17:04.372 INFO:tasks.workunit.client.0.smithi050.stdout:0/404: creat d0/d6/d8/d51/f7c x:0 0 0 2023-01-04T18:17:04.372 INFO:tasks.workunit.client.0.smithi050.stdout:6/453: dread d0/d9/f4b [0,4194304] 0 2023-01-04T18:17:04.379 INFO:tasks.workunit.client.0.smithi050.stdout:3/495: getdents d0/d1b/d2f/d56/d6b/d7f 0 2023-01-04T18:17:04.382 INFO:tasks.workunit.client.0.smithi050.stdout:5/606: creat d13/d15/d66/db8/d1f/d35/d42/d4a/fd6 x:0 0 0 2023-01-04T18:17:04.382 INFO:tasks.workunit.client.0.smithi050.stdout:5/607: chown d13/d15/d66/db8/d1f/d35/d59/c91 220454 1 2023-01-04T18:17:04.404 INFO:tasks.workunit.client.0.smithi050.stdout:1/468: mkdir d8/d48/d5c/d67/d91 0 2023-01-04T18:17:04.405 INFO:tasks.workunit.client.0.smithi050.stdout:2/495: mkdir d1/dd/d28/d2c/d66/da2 0 2023-01-04T18:17:04.407 INFO:tasks.workunit.client.0.smithi050.stdout:0/405: rename d0/d6/d8/f5e to d0/d6/d8/d51/f7d 0 2023-01-04T18:17:04.408 INFO:tasks.workunit.client.0.smithi050.stdout:6/454: symlink d0/d9/d38/d16/d77/l91 0 2023-01-04T18:17:04.409 INFO:tasks.workunit.client.0.smithi050.stdout:4/435: link d14/d1b/d1f/d22/d3e/d44/d59/d5f/c62 d14/d1b/d66/c88 0 2023-01-04T18:17:04.412 INFO:tasks.workunit.client.0.smithi050.stdout:5/608: symlink d13/d15/d66/db8/d27/d78/ld7 0 2023-01-04T18:17:04.412 INFO:tasks.workunit.client.0.smithi050.stdout:5/609: truncate d13/d28/d7c/f8d 1035885 0 2023-01-04T18:17:04.412 INFO:tasks.workunit.client.0.smithi050.stdout:5/610: fsync d13/d15/d66/db8/d1f/d35/d42/d4a/fbf 0 2023-01-04T18:17:04.415 INFO:tasks.workunit.client.0.smithi050.stdout:1/469: mkdir d8/d14/d1c/d28/d57/d6a/d92 0 2023-01-04T18:17:04.415 INFO:tasks.workunit.client.0.smithi050.stdout:2/496: dread d1/f8 [0,4194304] 0 2023-01-04T18:17:04.416 INFO:tasks.workunit.client.0.smithi050.stdout:0/406: rename d0/d6/d8/d35/f42 to d0/f7e 0 2023-01-04T18:17:04.420 INFO:tasks.workunit.client.0.smithi050.stdout:5/611: unlink d13/d15/d66/db8/d1f/d35/f65 0 2023-01-04T18:17:04.425 INFO:tasks.workunit.client.0.smithi050.stdout:1/470: creat d8/d14/d1c/d28/f93 x:0 0 0 2023-01-04T18:17:04.425 INFO:tasks.workunit.client.0.smithi050.stdout:1/471: readlink d8/l1a 0 2023-01-04T18:17:04.430 INFO:tasks.workunit.client.0.smithi050.stdout:6/455: rename d0/d5c/d5d/c61 to d0/d9/d38/d16/c92 0 2023-01-04T18:17:04.432 INFO:tasks.workunit.client.0.smithi050.stdout:0/407: creat d0/d73/d68/f7f x:0 0 0 2023-01-04T18:17:04.432 INFO:tasks.workunit.client.0.smithi050.stdout:0/408: truncate d0/f53 331811 0 2023-01-04T18:17:04.432 INFO:tasks.workunit.client.0.smithi050.stdout:0/409: dread - d0/d6/d8/d51/f7c zero size 2023-01-04T18:17:04.433 INFO:tasks.workunit.client.0.smithi050.stdout:0/410: stat d0/d6/d8/l10 0 2023-01-04T18:17:04.433 INFO:tasks.workunit.client.0.smithi050.stdout:0/411: dread - d0/d6/d28/d1a/f40 zero size 2023-01-04T18:17:04.433 INFO:tasks.workunit.client.0.smithi050.stdout:4/436: dwrite d14/d1b/d1f/f57 [0,4194304] 0 2023-01-04T18:17:04.435 INFO:tasks.workunit.client.0.smithi050.stdout:1/472: symlink d8/d48/d8c/d72/l94 0 2023-01-04T18:17:04.435 INFO:tasks.workunit.client.0.smithi050.stdout:2/497: dwrite d1/dd/d28/d2c/f2d [0,4194304] 0 2023-01-04T18:17:04.435 INFO:tasks.workunit.client.0.smithi050.stdout:5/612: dread d13/d15/d66/db8/d1f/d35/d42/d4a/f64 [0,4194304] 0 2023-01-04T18:17:04.436 INFO:tasks.workunit.client.0.smithi050.stdout:6/456: truncate d0/d9/d38/f15 918905 0 2023-01-04T18:17:04.437 INFO:tasks.workunit.client.0.smithi050.stdout:0/412: creat d0/d6/d8/d51/f80 x:0 0 0 2023-01-04T18:17:04.439 INFO:tasks.workunit.client.0.smithi050.stdout:6/457: dread d0/f14 [0,4194304] 0 2023-01-04T18:17:04.441 INFO:tasks.workunit.client.0.smithi050.stdout:4/437: creat d14/d1b/d1f/d22/d7e/f89 x:0 0 0 2023-01-04T18:17:04.445 INFO:tasks.workunit.client.0.smithi050.stdout:2/498: dread d1/dd/d11/d14/f33 [0,4194304] 0 2023-01-04T18:17:04.446 INFO:tasks.workunit.client.0.smithi050.stdout:4/438: dread d14/d1b/d32/f35 [0,4194304] 0 2023-01-04T18:17:04.448 INFO:tasks.workunit.client.0.smithi050.stdout:1/473: creat d8/d14/d1c/d28/d57/d6a/f95 x:0 0 0 2023-01-04T18:17:04.449 INFO:tasks.workunit.client.0.smithi050.stdout:1/474: readlink d8/d48/l75 0 2023-01-04T18:17:04.452 INFO:tasks.workunit.client.0.smithi050.stdout:5/613: creat d13/d15/d66/db8/d1f/d35/d59/fd8 x:0 0 0 2023-01-04T18:17:04.452 INFO:tasks.workunit.client.0.smithi050.stdout:0/413: mknod d0/d73/c81 0 2023-01-04T18:17:04.452 INFO:tasks.workunit.client.0.smithi050.stdout:0/414: truncate d0/d6/d28/d1a/f6b 620976 0 2023-01-04T18:17:04.452 INFO:tasks.workunit.client.0.smithi050.stdout:0/415: write d0/f53 [1178594,10078] 0 2023-01-04T18:17:04.452 INFO:tasks.workunit.client.0.smithi050.stdout:0/416: write d0/f59 [1037466,16652] 0 2023-01-04T18:17:04.453 INFO:tasks.workunit.client.0.smithi050.stdout:6/458: dread d0/d9/d25/d4d/f66 [0,4194304] 0 2023-01-04T18:17:04.454 INFO:tasks.workunit.client.0.smithi050.stdout:2/499: mknod d1/dd/d11/d12/ca3 0 2023-01-04T18:17:04.456 INFO:tasks.workunit.client.0.smithi050.stdout:1/475: mknod d8/d14/c96 0 2023-01-04T18:17:04.456 INFO:tasks.workunit.client.0.smithi050.stdout:1/476: stat d8/d14/d1c/f5d 0 2023-01-04T18:17:04.456 INFO:tasks.workunit.client.0.smithi050.stdout:1/477: chown d8/d14/d1c/d28/d57/d6a/d92 2860367 1 2023-01-04T18:17:04.456 INFO:tasks.workunit.client.0.smithi050.stdout:1/478: stat d8/d14/l81 0 2023-01-04T18:17:04.459 INFO:tasks.workunit.client.0.smithi050.stdout:6/459: dread d0/d71/f87 [0,4194304] 0 2023-01-04T18:17:04.461 INFO:tasks.workunit.client.0.smithi050.stdout:9/454: sync 2023-01-04T18:17:04.461 INFO:tasks.workunit.client.0.smithi050.stdout:7/543: sync 2023-01-04T18:17:04.461 INFO:tasks.workunit.client.0.smithi050.stdout:9/455: read - d1/d12/d2d/d39/f66 zero size 2023-01-04T18:17:04.467 INFO:tasks.workunit.client.0.smithi050.stdout:4/439: dwrite d14/d1b/d32/f45 [0,4194304] 0 2023-01-04T18:17:04.474 INFO:tasks.workunit.client.0.smithi050.stdout:6/460: dwrite d0/f14 [0,4194304] 0 2023-01-04T18:17:04.481 INFO:tasks.workunit.client.0.smithi050.stdout:0/417: mknod d0/d6/d28/c82 0 2023-01-04T18:17:04.482 INFO:tasks.workunit.client.0.smithi050.stdout:2/500: mknod d1/dd/d11/d14/d39/d99/ca4 0 2023-01-04T18:17:04.486 INFO:tasks.workunit.client.0.smithi050.stdout:7/544: mkdir d6/db/d3a/dbd 0 2023-01-04T18:17:04.487 INFO:tasks.workunit.client.0.smithi050.stdout:1/479: getdents d8/d14 0 2023-01-04T18:17:04.488 INFO:tasks.workunit.client.0.smithi050.stdout:9/456: unlink d1/d12/d41/l70 0 2023-01-04T18:17:04.488 INFO:tasks.workunit.client.0.smithi050.stdout:9/457: write d1/d3/d11/f16 [4530892,110274] 0 2023-01-04T18:17:04.491 INFO:tasks.workunit.client.0.smithi050.stdout:4/440: rename d14/d1b/d1f/d22/d7e to d14/d1b/d1f/d22/d3e/d8a 0 2023-01-04T18:17:04.491 INFO:tasks.workunit.client.0.smithi050.stdout:4/441: readlink d14/d1b/d1f/d22/d3e/l5e 0 2023-01-04T18:17:04.497 INFO:tasks.workunit.client.0.smithi050.stdout:6/461: mkdir d0/d4a/d93 0 2023-01-04T18:17:04.497 INFO:tasks.workunit.client.0.smithi050.stdout:6/462: fsync d0/d9/d38/d60/f82 0 2023-01-04T18:17:04.497 INFO:tasks.workunit.client.0.smithi050.stdout:0/418: symlink d0/d6/d28/d1a/l83 0 2023-01-04T18:17:04.499 INFO:tasks.workunit.client.0.smithi050.stdout:2/501: unlink d1/dd/d11/d14/f23 0 2023-01-04T18:17:04.510 INFO:tasks.workunit.client.0.smithi050.stdout:7/545: unlink d6/d28/d3c/d42/d5f/d6a/faf 0 2023-01-04T18:17:04.510 INFO:tasks.workunit.client.0.smithi050.stdout:7/546: fdatasync d6/d28/d3c/d42/d5f/f6f 0 2023-01-04T18:17:04.510 INFO:tasks.workunit.client.0.smithi050.stdout:1/480: mknod d8/d48/d5c/d67/d3a/d31/d7f/c97 0 2023-01-04T18:17:04.511 INFO:tasks.workunit.client.0.smithi050.stdout:9/458: rmdir d1/d3/d24/d7b 39 2023-01-04T18:17:04.511 INFO:tasks.workunit.client.0.smithi050.stdout:9/459: fsync d1/d12/d41/d60/d7c/f7e 0 2023-01-04T18:17:04.511 INFO:tasks.workunit.client.0.smithi050.stdout:9/460: dread - d1/d12/d41/d60/d7c/f7e zero size 2023-01-04T18:17:04.511 INFO:tasks.workunit.client.0.smithi050.stdout:4/442: truncate d14/d1b/d32/f3f 730543 0 2023-01-04T18:17:04.513 INFO:tasks.workunit.client.0.smithi050.stdout:6/463: creat d0/d9/d25/d40/d89/f94 x:0 0 0 2023-01-04T18:17:04.513 INFO:tasks.workunit.client.0.smithi050.stdout:6/464: write d0/d9/df/f70 [475658,118932] 0 2023-01-04T18:17:04.514 INFO:tasks.workunit.client.0.smithi050.stdout:6/465: write d0/d9/d25/d2d/f73 [253419,40054] 0 2023-01-04T18:17:04.515 INFO:tasks.workunit.client.0.smithi050.stdout:0/419: dwrite d0/d6/d28/d1a/f23 [0,4194304] 0 2023-01-04T18:17:04.516 INFO:tasks.workunit.client.0.smithi050.stdout:2/502: rename d1/dd/d28/d2c/d2e/f40 to d1/dd/d11/d14/d39/d99/fa5 0 2023-01-04T18:17:04.517 INFO:tasks.workunit.client.0.smithi050.stdout:4/443: read d14/d1b/d32/f37 [1553710,22874] 0 2023-01-04T18:17:04.517 INFO:tasks.workunit.client.0.smithi050.stdout:1/481: dread d8/d14/d1c/d28/f59 [0,4194304] 0 2023-01-04T18:17:04.517 INFO:tasks.workunit.client.0.smithi050.stdout:7/547: mknod d6/db/d3a/cbe 0 2023-01-04T18:17:04.519 INFO:tasks.workunit.client.0.smithi050.stdout:6/466: symlink d0/d5c/d5d/l95 0 2023-01-04T18:17:04.522 INFO:tasks.workunit.client.0.smithi050.stdout:0/420: mkdir d0/d73/d68/d7a/d84 0 2023-01-04T18:17:04.523 INFO:tasks.workunit.client.0.smithi050.stdout:0/421: write d0/d6/d28/d1a/f23 [286378,81603] 0 2023-01-04T18:17:04.527 INFO:tasks.workunit.client.0.smithi050.stdout:9/461: dwrite d1/d12/d41/f67 [0,4194304] 0 2023-01-04T18:17:04.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:17:02.127293+0000 mgr.smithi098.vhfzum (mgr.24455) 41 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi098.vhfzum) 2023-01-04T18:17:04.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:17:02.127704+0000 mgr.smithi098.vhfzum (mgr.24455) 42 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi098.vhfzum) 2023-01-04T18:17:04.564 INFO:tasks.workunit.client.0.smithi050.stdout:9/462: dwrite d1/d12/d41/d60/f90 [0,4194304] 0 2023-01-04T18:17:04.577 INFO:tasks.workunit.client.0.smithi050.stdout:2/503: creat d1/dd/d62/da1/d83/fa6 x:0 0 0 2023-01-04T18:17:04.580 INFO:tasks.workunit.client.0.smithi050.stdout:9/463: dwrite d1/d12/d2d/d39/f82 [0,4194304] 0 2023-01-04T18:17:04.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:17:02.127293+0000 mgr.smithi098.vhfzum (mgr.24455) 41 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi098.vhfzum) 2023-01-04T18:17:04.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:17:02.127704+0000 mgr.smithi098.vhfzum (mgr.24455) 42 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi098.vhfzum) 2023-01-04T18:17:04.581 INFO:tasks.workunit.client.0.smithi050.stdout:4/444: unlink d14/d1b/d1f/l36 0 2023-01-04T18:17:04.583 INFO:tasks.workunit.client.0.smithi050.stdout:7/548: truncate d6/db/d20/d55/fba 2909733 0 2023-01-04T18:17:04.584 INFO:tasks.workunit.client.0.smithi050.stdout:6/467: mknod d0/d9/df/c96 0 2023-01-04T18:17:04.586 INFO:tasks.workunit.client.0.smithi050.stdout:9/464: dread d1/d12/f5f [0,4194304] 0 2023-01-04T18:17:04.592 INFO:tasks.workunit.client.0.smithi050.stdout:0/422: rmdir d0/d73/d68 39 2023-01-04T18:17:04.606 INFO:tasks.workunit.client.0.smithi050.stdout:2/504: mkdir d1/dd/d28/d2c/d2e/d3f/da7 0 2023-01-04T18:17:04.607 INFO:tasks.workunit.client.0.smithi050.stdout:0/423: dwrite d0/d6/d28/f60 [0,4194304] 0 2023-01-04T18:17:04.611 INFO:tasks.workunit.client.0.smithi050.stdout:4/445: link fe d14/d1b/d1f/d22/d3e/d44/d59/d5f/d6f/f8b 0 2023-01-04T18:17:04.614 INFO:tasks.workunit.client.0.smithi050.stdout:2/505: dread d1/dd/d11/f54 [0,4194304] 0 2023-01-04T18:17:04.614 INFO:tasks.workunit.client.0.smithi050.stdout:2/506: truncate d1/dd/d11/d14/d91/d5a/d7f/f93 1070199 0 2023-01-04T18:17:04.615 INFO:tasks.workunit.client.0.smithi050.stdout:6/468: mknod d0/d5c/c97 0 2023-01-04T18:17:04.620 INFO:tasks.workunit.client.0.smithi050.stdout:9/465: mkdir d1/d12/d41/d60/d95 0 2023-01-04T18:17:04.622 INFO:tasks.workunit.client.0.smithi050.stdout:3/496: sync 2023-01-04T18:17:04.622 INFO:tasks.workunit.client.0.smithi050.stdout:8/519: sync 2023-01-04T18:17:04.622 INFO:tasks.workunit.client.0.smithi050.stdout:2/507: mknod d1/dd/d62/da1/ca8 0 2023-01-04T18:17:04.622 INFO:tasks.workunit.client.0.smithi050.stdout:7/549: dread d6/d28/d99/f64 [0,4194304] 0 2023-01-04T18:17:04.624 INFO:tasks.workunit.client.0.smithi050.stdout:6/469: dread d0/d9/fa [4194304,4194304] 0 2023-01-04T18:17:04.624 INFO:tasks.workunit.client.0.smithi050.stdout:2/508: write d1/d10/f4e [1375178,76251] 0 2023-01-04T18:17:04.625 INFO:tasks.workunit.client.0.smithi050.stdout:6/470: read d0/f14 [1671180,52128] 0 2023-01-04T18:17:04.625 INFO:tasks.workunit.client.0.smithi050.stdout:9/466: unlink d1/d12/d41/d60/d7c/f7e 0 2023-01-04T18:17:04.627 INFO:tasks.workunit.client.0.smithi050.stdout:2/509: write d1/dd/d62/da1/f7d [387011,127239] 0 2023-01-04T18:17:04.628 INFO:tasks.workunit.client.0.smithi050.stdout:0/424: dwrite d0/f4d [0,4194304] 0 2023-01-04T18:17:04.629 INFO:tasks.workunit.client.0.smithi050.stdout:0/425: fsync d0/d73/f71 0 2023-01-04T18:17:04.629 INFO:tasks.workunit.client.0.smithi050.stdout:8/520: write d3/d2a/d27/d93/d7f/d96/f1d [22267,75636] 0 2023-01-04T18:17:04.629 INFO:tasks.workunit.client.0.smithi050.stdout:3/497: getdents d0/d1b/d2f/d56/d32 0 2023-01-04T18:17:04.630 INFO:tasks.workunit.client.0.smithi050.stdout:3/498: write d0/d1b/d2f/d56/d3f/fa5 [878737,18308] 0 2023-01-04T18:17:04.630 INFO:tasks.workunit.client.0.smithi050.stdout:3/499: truncate d0/d1b/d2f/f44 190 0 2023-01-04T18:17:04.631 INFO:tasks.workunit.client.0.smithi050.stdout:4/446: dwrite f5 [4194304,4194304] 0 2023-01-04T18:17:04.632 INFO:tasks.workunit.client.0.smithi050.stdout:7/550: rename d6/f7 to d6/fbf 0 2023-01-04T18:17:04.632 INFO:tasks.workunit.client.0.smithi050.stdout:7/551: fdatasync d6/db/d15/d1b/d22/f54 0 2023-01-04T18:17:04.643 INFO:tasks.workunit.client.0.smithi050.stdout:6/471: creat d0/d9/f98 x:0 0 0 2023-01-04T18:17:04.643 INFO:tasks.workunit.client.0.smithi050.stdout:6/472: fdatasync d0/d9/d25/d4d/f7c 0 2023-01-04T18:17:04.646 INFO:tasks.workunit.client.0.smithi050.stdout:2/510: mknod d1/dd/d62/d69/ca9 0 2023-01-04T18:17:04.646 INFO:tasks.workunit.client.0.smithi050.stdout:2/511: read - d1/dd/d11/d14/d91/f90 zero size 2023-01-04T18:17:04.650 INFO:tasks.workunit.client.0.smithi050.stdout:3/500: creat d0/d1b/d2f/fb7 x:0 0 0 2023-01-04T18:17:04.652 INFO:tasks.workunit.client.0.smithi050.stdout:4/447: creat d14/d1b/d1f/d22/d3e/d44/d59/d5f/f8c x:0 0 0 2023-01-04T18:17:04.652 INFO:tasks.workunit.client.0.smithi050.stdout:4/448: getdents d14/d1b/d1f/d22/d3e/d85 0 2023-01-04T18:17:04.653 INFO:tasks.workunit.client.0.smithi050.stdout:4/449: write d14/d1b/d1f/d22/d3e/d44/d59/d5f/f78 [1704705,120482] 0 2023-01-04T18:17:04.654 INFO:tasks.workunit.client.0.smithi050.stdout:4/450: fdatasync d14/f1c 0 2023-01-04T18:17:04.654 INFO:tasks.workunit.client.0.smithi050.stdout:4/451: readlink d14/d1b/d1f/l6d 0 2023-01-04T18:17:04.655 INFO:tasks.workunit.client.0.smithi050.stdout:7/552: creat d6/d28/d3c/d42/d5f/fc0 x:0 0 0 2023-01-04T18:17:04.656 INFO:tasks.workunit.client.0.smithi050.stdout:2/512: rename d1/dd/d38/c57 to d1/dd/d62/da1/caa 0 2023-01-04T18:17:04.657 INFO:tasks.workunit.client.0.smithi050.stdout:3/501: rmdir d0/dd/d45 39 2023-01-04T18:17:04.658 INFO:tasks.workunit.client.0.smithi050.stdout:4/452: rmdir d14/d1b/d66 39 2023-01-04T18:17:04.659 INFO:tasks.workunit.client.0.smithi050.stdout:4/453: read - d14/d1b/d1f/d22/d3e/d8a/f89 zero size 2023-01-04T18:17:04.659 INFO:tasks.workunit.client.0.smithi050.stdout:4/454: fsync d14/d1b/d1f/d22/f54 0 2023-01-04T18:17:04.659 INFO:tasks.workunit.client.0.smithi050.stdout:7/553: mknod d6/d6b/d8b/cc1 0 2023-01-04T18:17:04.660 INFO:tasks.workunit.client.0.smithi050.stdout:9/467: dwrite d1/d3/d13/f94 [0,4194304] 0 2023-01-04T18:17:04.660 INFO:tasks.workunit.client.0.smithi050.stdout:9/468: stat d1/d3/d13/f8d 0 2023-01-04T18:17:04.661 INFO:tasks.workunit.client.0.smithi050.stdout:7/554: read d6/db/d15/d2e/d4b/fb5 [4063885,91588] 0 2023-01-04T18:17:04.663 INFO:tasks.workunit.client.0.smithi050.stdout:2/513: getdents d1/dd/d11 0 2023-01-04T18:17:04.663 INFO:tasks.workunit.client.0.smithi050.stdout:2/514: stat d1/dd/d62/da1/d83/fa6 0 2023-01-04T18:17:04.663 INFO:tasks.workunit.client.0.smithi050.stdout:2/515: chown d1/f86 1367 1 2023-01-04T18:17:04.663 INFO:tasks.workunit.client.0.smithi050.stdout:6/473: dwrite d0/d9/d38/d60/f82 [0,4194304] 0 2023-01-04T18:17:04.664 INFO:tasks.workunit.client.0.smithi050.stdout:4/455: creat d14/d1b/d1f/d22/d3e/f8d x:0 0 0 2023-01-04T18:17:04.664 INFO:tasks.workunit.client.0.smithi050.stdout:4/456: chown d14/d1b/d1f/d22/d3e 26961398 1 2023-01-04T18:17:04.664 INFO:tasks.workunit.client.0.smithi050.stdout:4/457: fdatasync f11 0 2023-01-04T18:17:04.664 INFO:tasks.workunit.client.0.smithi050.stdout:0/426: dwrite d0/d6/d28/d1a/f40 [0,4194304] 0 2023-01-04T18:17:04.666 INFO:tasks.workunit.client.0.smithi050.stdout:8/521: dwrite d3/d2a/d30/d3b/d53/f54 [0,4194304] 0 2023-01-04T18:17:04.666 INFO:tasks.workunit.client.0.smithi050.stdout:8/522: chown d3/d2a/d2d 989135 1 2023-01-04T18:17:04.666 INFO:tasks.workunit.client.0.smithi050.stdout:8/523: chown d3/d2a/d30/d3b/d4d/d23/d55/f57 23 1 2023-01-04T18:17:04.666 INFO:tasks.workunit.client.0.smithi050.stdout:8/524: fsync d3/d2a/d30/d3b/d4d/d23/d55/d5f/f8a 0 2023-01-04T18:17:04.666 INFO:tasks.workunit.client.0.smithi050.stdout:8/525: fsync d3/d2a/d27/d93/d7a/f80 0 2023-01-04T18:17:04.667 INFO:tasks.workunit.client.0.smithi050.stdout:2/516: unlink d1/dd/d28/d2c/d2e/d36/f42 0 2023-01-04T18:17:04.678 INFO:tasks.workunit.client.0.smithi050.stdout:3/502: dread d0/dd/f11 [0,4194304] 0 2023-01-04T18:17:04.678 INFO:tasks.workunit.client.0.smithi050.stdout:3/503: write d0/d1b/d2f/faf [407666,27591] 0 2023-01-04T18:17:04.681 INFO:tasks.workunit.client.0.smithi050.stdout:3/504: read d0/d1a/f58 [751660,89165] 0 2023-01-04T18:17:04.682 INFO:tasks.workunit.client.0.smithi050.stdout:7/555: dwrite d6/d1d/d1f/d80/f93 [0,4194304] 0 2023-01-04T18:17:04.683 INFO:tasks.workunit.client.0.smithi050.stdout:4/458: dwrite d14/d1b/d1f/f57 [4194304,4194304] 0 2023-01-04T18:17:04.691 INFO:tasks.workunit.client.0.smithi050.stdout:6/474: getdents d0/d9/df 0 2023-01-04T18:17:04.695 INFO:tasks.workunit.client.0.smithi050.stdout:7/556: dwrite d6/d28/d3c/d42/f56 [0,4194304] 0 2023-01-04T18:17:04.696 INFO:tasks.workunit.client.0.smithi050.stdout:7/557: dread d6/db/d15/d1b/f8c [0,4194304] 0 2023-01-04T18:17:04.709 INFO:tasks.workunit.client.0.smithi050.stdout:0/427: link d0/d6/l6c d0/d73/d68/d7a/l85 0 2023-01-04T18:17:04.710 INFO:tasks.workunit.client.0.smithi050.stdout:5/614: sync 2023-01-04T18:17:04.715 INFO:tasks.workunit.client.0.smithi050.stdout:8/526: creat d3/d2a/d30/d3b/d4d/d23/d55/d5f/fbf x:0 0 0 2023-01-04T18:17:04.722 INFO:tasks.workunit.client.0.smithi050.stdout:3/505: symlink d0/d8f/lb8 0 2023-01-04T18:17:04.725 INFO:tasks.workunit.client.0.smithi050.stdout:4/459: creat d14/d1b/d1f/d22/d6a/f8e x:0 0 0 2023-01-04T18:17:04.726 INFO:tasks.workunit.client.0.smithi050.stdout:6/475: stat d0/c84 0 2023-01-04T18:17:04.737 INFO:tasks.workunit.client.0.smithi050.stdout:7/558: mkdir d6/db/d20/d4f/d6e/dc2 0 2023-01-04T18:17:04.738 INFO:tasks.workunit.client.0.smithi050.stdout:7/559: stat d6/db/d3a/fb3 0 2023-01-04T18:17:04.738 INFO:tasks.workunit.client.0.smithi050.stdout:7/560: chown d6/d28/d3c/d42/f56 52152608 1 2023-01-04T18:17:04.739 INFO:tasks.workunit.client.0.smithi050.stdout:7/561: dread d6/f13 [0,4194304] 0 2023-01-04T18:17:04.739 INFO:tasks.workunit.client.0.smithi050.stdout:7/562: dread - d6/d28/d3c/d42/d5f/fc0 zero size 2023-01-04T18:17:04.742 INFO:tasks.workunit.client.0.smithi050.stdout:6/476: dwrite d0/d9/d25/f39 [0,4194304] 0 2023-01-04T18:17:04.742 INFO:tasks.workunit.client.0.smithi050.stdout:6/477: write d0/d9/d38/d60/f80 [409590,103316] 0 2023-01-04T18:17:04.745 INFO:tasks.workunit.client.0.smithi050.stdout:0/428: creat d0/d6/d8/d51/f86 x:0 0 0 2023-01-04T18:17:04.746 INFO:tasks.workunit.client.0.smithi050.stdout:6/478: fdatasync d0/d9/d38/d60/f80 0 2023-01-04T18:17:04.749 INFO:tasks.workunit.client.0.smithi050.stdout:5/615: mkdir d13/d15/d66/db8/dd9 0 2023-01-04T18:17:04.749 INFO:tasks.workunit.client.0.smithi050.stdout:6/479: dread d0/d4a/f7e [0,4194304] 0 2023-01-04T18:17:04.749 INFO:tasks.workunit.client.0.smithi050.stdout:6/480: fsync d0/d9/d38/d16/f37 0 2023-01-04T18:17:04.752 INFO:tasks.workunit.client.0.smithi050.stdout:8/527: mknod d3/d2a/d30/d3b/cc0 0 2023-01-04T18:17:04.752 INFO:tasks.workunit.client.0.smithi050.stdout:7/563: dwrite d6/db/d20/d55/f5e [0,4194304] 0 2023-01-04T18:17:04.753 INFO:tasks.workunit.client.0.smithi050.stdout:3/506: rename d0/d8f/ca1 to d0/d1b/d2f/d71/cb9 0 2023-01-04T18:17:04.755 INFO:tasks.workunit.client.0.smithi050.stdout:4/460: creat d14/d1b/f8f x:0 0 0 2023-01-04T18:17:04.761 INFO:tasks.workunit.client.0.smithi050.stdout:0/429: rmdir d0/d73/d68/d7a 39 2023-01-04T18:17:04.761 INFO:tasks.workunit.client.0.smithi050.stdout:0/430: chown d0/d6/d28/d1a/l83 0 1 2023-01-04T18:17:04.762 INFO:tasks.workunit.client.0.smithi050.stdout:4/461: dread d14/d1b/d1f/d22/d3e/d44/d59/d5f/f78 [0,4194304] 0 2023-01-04T18:17:04.762 INFO:tasks.workunit.client.0.smithi050.stdout:4/462: stat d14/d1b/d1f/d22/d3e/d44/d59/d5f/f78 0 2023-01-04T18:17:04.763 INFO:tasks.workunit.client.0.smithi050.stdout:6/481: link d0/d5c/c97 d0/d9/d38/d16/d77/c99 0 2023-01-04T18:17:04.765 INFO:tasks.workunit.client.0.smithi050.stdout:4/463: write f3 [1104185,110883] 0 2023-01-04T18:17:04.766 INFO:tasks.workunit.client.0.smithi050.stdout:8/528: mkdir d3/d2a/d27/dc1 0 2023-01-04T18:17:04.766 INFO:tasks.workunit.client.0.smithi050.stdout:8/529: write d3/d2a/d60/fa8 [869194,51794] 0 2023-01-04T18:17:04.770 INFO:tasks.workunit.client.0.smithi050.stdout:7/564: unlink d6/db/d15/d1b/d22/da6/fac 0 2023-01-04T18:17:04.770 INFO:tasks.workunit.client.0.smithi050.stdout:7/565: getdents d6/db/d20/d4f/d8a 0 2023-01-04T18:17:04.770 INFO:tasks.workunit.client.0.smithi050.stdout:0/431: symlink d0/d73/d68/l87 0 2023-01-04T18:17:04.773 INFO:tasks.workunit.client.0.smithi050.stdout:6/482: link d0/d9/d38/f5b d0/d9/d25/f9a 0 2023-01-04T18:17:04.774 INFO:tasks.workunit.client.0.smithi050.stdout:8/530: getdents d3 0 2023-01-04T18:17:04.775 INFO:tasks.workunit.client.0.smithi050.stdout:8/531: write d3/d2a/d30/d3b/d4d/fad [308132,52880] 0 2023-01-04T18:17:04.776 INFO:tasks.workunit.client.0.smithi050.stdout:7/566: truncate d6/db/d20/d55/fba 2419779 0 2023-01-04T18:17:04.776 INFO:tasks.workunit.client.0.smithi050.stdout:5/616: dwrite d13/d15/d66/db8/d1f/d35/f3f [0,4194304] 0 2023-01-04T18:17:04.776 INFO:tasks.workunit.client.0.smithi050.stdout:3/507: dwrite d0/d1b/f1c [0,4194304] 0 2023-01-04T18:17:04.777 INFO:tasks.workunit.client.0.smithi050.stdout:3/508: chown d0/dd/c55 1 1 2023-01-04T18:17:04.778 INFO:tasks.workunit.client.0.smithi050.stdout:5/617: write d13/d15/d66/db8/d1f/d35/d42/d4a/f64 [1714403,44426] 0 2023-01-04T18:17:04.778 INFO:tasks.workunit.client.0.smithi050.stdout:0/432: creat d0/d73/d79/f88 x:0 0 0 2023-01-04T18:17:04.779 INFO:tasks.workunit.client.0.smithi050.stdout:6/483: truncate d0/d9/d38/d1c/d54/f63 2231802 0 2023-01-04T18:17:04.779 INFO:tasks.workunit.client.0.smithi050.stdout:6/484: fdatasync d0/d9/d38/f15 0 2023-01-04T18:17:04.786 INFO:tasks.workunit.client.0.smithi050.stdout:8/532: creat d3/d2a/d27/dc1/fc2 x:0 0 0 2023-01-04T18:17:04.792 INFO:tasks.workunit.client.0.smithi050.stdout:0/433: dread d0/d6/f3c [4194304,4194304] 0 2023-01-04T18:17:04.792 INFO:tasks.workunit.client.0.smithi050.stdout:0/434: dread - d0/d6/d8/d51/f7c zero size 2023-01-04T18:17:04.792 INFO:tasks.workunit.client.0.smithi050.stdout:0/435: fdatasync d0/d6/d8/d51/f50 0 2023-01-04T18:17:04.793 INFO:tasks.workunit.client.0.smithi050.stdout:3/509: symlink d0/dd/lba 0 2023-01-04T18:17:04.793 INFO:tasks.workunit.client.0.smithi050.stdout:4/464: dwrite d14/d1b/d32/f35 [0,4194304] 0 2023-01-04T18:17:04.795 INFO:tasks.workunit.client.0.smithi050.stdout:7/567: dwrite d6/db/f43 [0,4194304] 0 2023-01-04T18:17:04.797 INFO:tasks.workunit.client.0.smithi050.stdout:5/618: mknod d13/d15/d66/db8/d1f/d62/cda 0 2023-01-04T18:17:04.799 INFO:tasks.workunit.client.0.smithi050.stdout:0/436: dread d0/d6/f26 [0,4194304] 0 2023-01-04T18:17:04.799 INFO:tasks.workunit.client.0.smithi050.stdout:0/437: fdatasync d0/d6/d28/d1a/f6b 0 2023-01-04T18:17:04.800 INFO:tasks.workunit.client.0.smithi050.stdout:6/485: link d0/f6f d0/d9/d38/d1c/f9b 0 2023-01-04T18:17:04.820 INFO:tasks.workunit.client.0.smithi050.stdout:8/533: dwrite d3/d2a/d30/d3b/d4d/fad [0,4194304] 0 2023-01-04T18:17:04.820 INFO:tasks.workunit.client.0.smithi050.stdout:0/438: dwrite d0/d6/d8/d51/f86 [0,4194304] 0 2023-01-04T18:17:04.821 INFO:tasks.workunit.client.0.smithi050.stdout:0/439: write d0/d73/d79/f88 [785798,45528] 0 2023-01-04T18:17:04.841 INFO:tasks.workunit.client.0.smithi050.stdout:1/482: sync 2023-01-04T18:17:04.841 INFO:tasks.workunit.client.0.smithi050.stdout:1/483: truncate d8/f43 223779 0 2023-01-04T18:17:04.843 INFO:tasks.workunit.client.0.smithi050.stdout:7/568: mknod d6/d28/d3c/d42/d5f/d6a/cc3 0 2023-01-04T18:17:04.844 INFO:tasks.workunit.client.0.smithi050.stdout:7/569: read d6/f13 [472834,66978] 0 2023-01-04T18:17:04.845 INFO:tasks.workunit.client.0.smithi050.stdout:5/619: mknod d13/d15/d66/db8/d8f/cdb 0 2023-01-04T18:17:04.847 INFO:tasks.workunit.client.0.smithi050.stdout:6/486: creat d0/d9/d38/d16/f9c x:0 0 0 2023-01-04T18:17:04.848 INFO:tasks.workunit.client.0.smithi050.stdout:6/487: readlink d0/l32 0 2023-01-04T18:17:04.848 INFO:tasks.workunit.client.0.smithi050.stdout:6/488: write d0/d9/d38/f5b [1631776,122538] 0 2023-01-04T18:17:04.848 INFO:tasks.workunit.client.0.smithi050.stdout:8/534: mkdir d3/d2a/d2d/dc3 0 2023-01-04T18:17:04.855 INFO:tasks.workunit.client.0.smithi050.stdout:4/465: rename d14/d1b/d1f/d22/d3e/d44/d59/d5f/f8c to d14/d1b/d66/f90 0 2023-01-04T18:17:04.855 INFO:tasks.workunit.client.0.smithi050.stdout:4/466: chown d14/d1b/d1f/d22/d3e/d8a/f89 19541791 1 2023-01-04T18:17:04.858 INFO:tasks.workunit.client.0.smithi050.stdout:5/620: dread d13/d15/d66/db8/f4c [0,4194304] 0 2023-01-04T18:17:04.858 INFO:tasks.workunit.client.0.smithi050.stdout:8/535: link d3/d2a/d30/d3b/d4d/d23/c44 d3/d2a/d30/d3b/d4d/d23/d55/cc4 0 2023-01-04T18:17:04.867 INFO:tasks.workunit.client.0.smithi050.stdout:5/621: dread d13/d15/d66/db8/d27/fb3 [0,4194304] 0 2023-01-04T18:17:04.867 INFO:tasks.workunit.client.0.smithi050.stdout:5/622: fdatasync d13/d15/d66/db8/d1f/d35/d42/d4a/f64 0 2023-01-04T18:17:04.867 INFO:tasks.workunit.client.0.smithi050.stdout:6/489: dwrite d0/d71/f8a [0,4194304] 0 2023-01-04T18:17:04.868 INFO:tasks.workunit.client.0.smithi050.stdout:5/623: link d13/d15/d66/db8/d27/l5d d13/d15/d66/db8/d1f/d35/d42/d4a/ldc 0 2023-01-04T18:17:04.869 INFO:tasks.workunit.client.0.smithi050.stdout:6/490: stat d0/d5c/c97 0 2023-01-04T18:17:04.870 INFO:tasks.workunit.client.0.smithi050.stdout:6/491: chown d0/d5c/d5d/l6c 1269 1 2023-01-04T18:17:04.870 INFO:tasks.workunit.client.0.smithi050.stdout:5/624: write d13/d15/d66/db8/d1f/fa3 [4777758,17220] 0 2023-01-04T18:17:04.870 INFO:tasks.workunit.client.0.smithi050.stdout:5/625: getdents d13/d15/d66/db8/d27/d44/d47 0 2023-01-04T18:17:04.871 INFO:tasks.workunit.client.0.smithi050.stdout:8/536: dread d3/d2a/d2d/f70 [0,4194304] 0 2023-01-04T18:17:04.872 INFO:tasks.workunit.client.0.smithi050.stdout:8/537: read - d3/d2a/d74/d92/d94/fb1 zero size 2023-01-04T18:17:04.872 INFO:tasks.workunit.client.0.smithi050.stdout:5/626: creat d13/d15/d66/db8/d1f/d35/d59/fdd x:0 0 0 2023-01-04T18:17:04.872 INFO:tasks.workunit.client.0.smithi050.stdout:8/538: creat d3/d2a/d30/d3b/d4d/d23/d55/d5f/fc5 x:0 0 0 2023-01-04T18:17:04.872 INFO:tasks.workunit.client.0.smithi050.stdout:8/539: dread - d3/d2a/d30/d3b/d4d/d23/d55/d5f/fc5 zero size 2023-01-04T18:17:04.873 INFO:tasks.workunit.client.0.smithi050.stdout:5/627: mknod d13/d15/d66/db8/d27/cde 0 2023-01-04T18:17:04.873 INFO:tasks.workunit.client.0.smithi050.stdout:5/628: truncate d13/d15/f9b 1587960 0 2023-01-04T18:17:04.875 INFO:tasks.workunit.client.0.smithi050.stdout:5/629: link d13/d15/c50 d13/d15/d66/db8/d27/d44/cdf 0 2023-01-04T18:17:04.876 INFO:tasks.workunit.client.0.smithi050.stdout:5/630: dread d13/d15/d66/fac [0,4194304] 0 2023-01-04T18:17:04.876 INFO:tasks.workunit.client.0.smithi050.stdout:5/631: mknod d13/d15/d63/ce0 0 2023-01-04T18:17:04.877 INFO:tasks.workunit.client.0.smithi050.stdout:5/632: creat d13/d15/d66/db8/d27/dca/dd3/fe1 x:0 0 0 2023-01-04T18:17:04.878 INFO:tasks.workunit.client.0.smithi050.stdout:5/633: mknod d13/d15/d66/db8/d1f/d35/d42/d4a/d8e/ce2 0 2023-01-04T18:17:04.880 INFO:tasks.workunit.client.0.smithi050.stdout:5/634: unlink d13/d15/d66/db8/d1f/d35/d42/d4a/d8e/fc8 0 2023-01-04T18:17:04.883 INFO:tasks.workunit.client.0.smithi050.stdout:5/635: dread d13/d28/f36 [0,4194304] 0 2023-01-04T18:17:04.884 INFO:tasks.workunit.client.0.smithi050.stdout:5/636: creat d13/d15/d66/db8/d27/d46/d4e/d4d/da9/fe3 x:0 0 0 2023-01-04T18:17:04.887 INFO:tasks.workunit.client.0.smithi050.stdout:5/637: write d13/d15/d66/db8/d27/d46/d4e/d4d/f90 [1499226,5957] 0 2023-01-04T18:17:04.888 INFO:tasks.workunit.client.0.smithi050.stdout:5/638: creat d13/fe4 x:0 0 0 2023-01-04T18:17:04.890 INFO:tasks.workunit.client.0.smithi050.stdout:5/639: link d13/d15/d66/db8/d27/d46/d4e/f3c d13/d15/d63/fe5 0 2023-01-04T18:17:04.890 INFO:tasks.workunit.client.0.smithi050.stdout:5/640: fsync d13/d15/d66/db8/d1f/d35/d42/f9f 0 2023-01-04T18:17:04.890 INFO:tasks.workunit.client.0.smithi050.stdout:5/641: fdatasync d13/d28/d7c/f8d 0 2023-01-04T18:17:04.890 INFO:tasks.workunit.client.0.smithi050.stdout:5/642: write d13/d15/d66/db8/d27/dca/dd3/fe1 [151141,130939] 0 2023-01-04T18:17:04.924 INFO:tasks.workunit.client.0.smithi050.stdout:4/467: write d14/d1b/d1f/d22/f4e [2304490,95333] 0 2023-01-04T18:17:04.924 INFO:tasks.workunit.client.0.smithi050.stdout:4/468: chown d14/d1b/d1f/d22/d3e/d44/d59/d5d/d7f 1082023 1 2023-01-04T18:17:04.926 INFO:tasks.workunit.client.0.smithi050.stdout:4/469: creat d14/d1b/d1f/d22/d3e/f91 x:0 0 0 2023-01-04T18:17:04.929 INFO:tasks.workunit.client.0.smithi050.stdout:2/517: sync 2023-01-04T18:17:04.929 INFO:tasks.workunit.client.0.smithi050.stdout:9/469: sync 2023-01-04T18:17:04.930 INFO:tasks.workunit.client.0.smithi050.stdout:4/470: truncate d14/d1b/d1f/f57 2965666 0 2023-01-04T18:17:04.932 INFO:tasks.workunit.client.0.smithi050.stdout:8/540: dwrite d3/d2a/d27/d93/d7f/d96/d46/f4a [0,4194304] 0 2023-01-04T18:17:04.933 INFO:tasks.workunit.client.0.smithi050.stdout:5/643: dwrite d13/d15/d66/db8/d1f/f56 [0,4194304] 0 2023-01-04T18:17:04.936 INFO:tasks.workunit.client.0.smithi050.stdout:4/471: dread d14/d1b/d1f/f4a [0,4194304] 0 2023-01-04T18:17:04.946 INFO:tasks.workunit.client.0.smithi050.stdout:9/470: getdents d1/d12/d41 0 2023-01-04T18:17:04.954 INFO:tasks.workunit.client.0.smithi050.stdout:2/518: symlink d1/dd/d11/d12/lab 0 2023-01-04T18:17:04.957 INFO:tasks.workunit.client.0.smithi050.stdout:8/541: truncate d3/d2a/d60/f39 866394 0 2023-01-04T18:17:04.958 INFO:tasks.workunit.client.0.smithi050.stdout:8/542: dread d3/d2a/d2d/f50 [0,4194304] 0 2023-01-04T18:17:04.967 INFO:tasks.workunit.client.0.smithi050.stdout:5/644: mkdir d13/d15/d66/db8/d1f/d35/d59/d87/de6 0 2023-01-04T18:17:04.969 INFO:tasks.workunit.client.0.smithi050.stdout:4/472: creat d14/d1b/d1f/d22/d6a/f92 x:0 0 0 2023-01-04T18:17:04.975 INFO:tasks.workunit.client.0.smithi050.stdout:9/471: creat d1/d12/d41/d60/d95/f96 x:0 0 0 2023-01-04T18:17:04.977 INFO:tasks.workunit.client.0.smithi050.stdout:2/519: write d1/dd/d28/d2c/f9a [4898867,67260] 0 2023-01-04T18:17:04.980 INFO:tasks.workunit.client.0.smithi050.stdout:5/645: rmdir d13/d15/d66/db8/d1f/d35/d42/d4a 39 2023-01-04T18:17:04.984 INFO:tasks.workunit.client.0.smithi050.stdout:8/543: dwrite d3/d2a/d27/d93/d7f/d96/d46/f4a [0,4194304] 0 2023-01-04T18:17:04.984 INFO:tasks.workunit.client.0.smithi050.stdout:8/544: dread - d3/d2a/f89 zero size 2023-01-04T18:17:04.984 INFO:tasks.workunit.client.0.smithi050.stdout:8/545: fdatasync d3/d2a/d74/d92/d94/d9c/fbc 0 2023-01-04T18:17:04.984 INFO:tasks.workunit.client.0.smithi050.stdout:8/546: chown d3/d2a/d2d 489 1 2023-01-04T18:17:04.984 INFO:tasks.workunit.client.0.smithi050.stdout:8/547: stat d3/d2a/d60 0 2023-01-04T18:17:04.984 INFO:tasks.workunit.client.0.smithi050.stdout:8/548: dread - d3/d2a/d30/d3b/d4d/d23/d55/d5f/d82/fa3 zero size 2023-01-04T18:17:04.987 INFO:tasks.workunit.client.0.smithi050.stdout:9/472: unlink d1/d3/d11/d1f/f69 0 2023-01-04T18:17:04.988 INFO:tasks.workunit.client.0.smithi050.stdout:9/473: chown d1 7877 1 2023-01-04T18:17:04.989 INFO:tasks.workunit.client.0.smithi050.stdout:2/520: symlink d1/dd/d28/d2c/d2e/d36/lac 0 2023-01-04T18:17:04.992 INFO:tasks.workunit.client.0.smithi050.stdout:4/473: dwrite fe [0,4194304] 0 2023-01-04T18:17:04.994 INFO:tasks.workunit.client.0.smithi050.stdout:8/549: creat d3/fc6 x:0 0 0 2023-01-04T18:17:04.996 INFO:tasks.workunit.client.0.smithi050.stdout:9/474: mkdir d1/d3/d24/d97 0 2023-01-04T18:17:04.998 INFO:tasks.workunit.client.0.smithi050.stdout:5/646: dwrite d13/d15/d66/db8/d1f/d35/d59/fb6 [0,4194304] 0 2023-01-04T18:17:05.001 INFO:tasks.workunit.client.0.smithi050.stdout:4/474: unlink c6 0 2023-01-04T18:17:05.002 INFO:tasks.workunit.client.0.smithi050.stdout:8/550: creat d3/d2a/d74/fc7 x:0 0 0 2023-01-04T18:17:05.003 INFO:tasks.workunit.client.0.smithi050.stdout:8/551: write d3/d2a/d27/d93/d7f/d96/d46/fb2 [679546,19148] 0 2023-01-04T18:17:05.003 INFO:tasks.workunit.client.0.smithi050.stdout:8/552: chown d3/d2a/d27/d8b 66 1 2023-01-04T18:17:05.005 INFO:tasks.workunit.client.0.smithi050.stdout:8/553: write d3/d2a/f18 [3050880,15388] 0 2023-01-04T18:17:05.005 INFO:tasks.workunit.client.0.smithi050.stdout:2/521: rename d1/dd/d11/f27 to d1/dd/d62/da1/d6e/fad 0 2023-01-04T18:17:05.007 INFO:tasks.workunit.client.0.smithi050.stdout:2/522: write d1/dd/d11/d14/d91/f90 [325007,78244] 0 2023-01-04T18:17:05.012 INFO:tasks.workunit.client.0.smithi050.stdout:2/523: symlink d1/dd/d28/d2c/d2e/d3f/lae 0 2023-01-04T18:17:05.014 INFO:tasks.workunit.client.0.smithi050.stdout:2/524: link d1/l48 d1/dd/d28/laf 0 2023-01-04T18:17:05.017 INFO:tasks.workunit.client.0.smithi050.stdout:4/475: dwrite d14/f1c [4194304,4194304] 0 2023-01-04T18:17:05.018 INFO:tasks.workunit.client.0.smithi050.stdout:4/476: write f9 [7590690,35557] 0 2023-01-04T18:17:05.022 INFO:tasks.workunit.client.0.smithi050.stdout:4/477: dread d14/d1b/d1f/f4a [0,4194304] 0 2023-01-04T18:17:05.023 INFO:tasks.workunit.client.0.smithi050.stdout:4/478: mknod d14/d1b/d1f/d22/d6a/c93 0 2023-01-04T18:17:05.023 INFO:tasks.workunit.client.0.smithi050.stdout:9/475: dwrite d1/d12/d41/f67 [4194304,4194304] 0 2023-01-04T18:17:05.028 INFO:tasks.workunit.client.0.smithi050.stdout:5/647: dwrite d13/d15/d66/db8/d27/d46/d4e/d4d/db1/fba [0,4194304] 0 2023-01-04T18:17:05.028 INFO:tasks.workunit.client.0.smithi050.stdout:5/648: readlink d13/d15/d63/lb9 0 2023-01-04T18:17:05.028 INFO:tasks.workunit.client.0.smithi050.stdout:9/476: link d1/d12/d41/f71 d1/d6f/f98 0 2023-01-04T18:17:05.028 INFO:tasks.workunit.client.0.smithi050.stdout:9/477: chown d1/d3/d13 7 1 2023-01-04T18:17:05.029 INFO:tasks.workunit.client.0.smithi050.stdout:9/478: read - d1/d12/f74 zero size 2023-01-04T18:17:05.030 INFO:tasks.workunit.client.0.smithi050.stdout:5/649: dread d13/d28/f93 [0,4194304] 0 2023-01-04T18:17:05.030 INFO:tasks.workunit.client.0.smithi050.stdout:5/650: chown d13/d15/d66/db8/d27/d46 2 1 2023-01-04T18:17:05.031 INFO:tasks.workunit.client.0.smithi050.stdout:4/479: write fe [3005717,26860] 0 2023-01-04T18:17:05.035 INFO:tasks.workunit.client.0.smithi050.stdout:8/554: dwrite d3/d2a/d27/d93/d7f/d96/d46/fbd [0,4194304] 0 2023-01-04T18:17:05.036 INFO:tasks.workunit.client.0.smithi050.stdout:8/555: chown d3/d2a/d30/d3b/d4d/d23/d31/f78 246 1 2023-01-04T18:17:05.036 INFO:tasks.workunit.client.0.smithi050.stdout:8/556: stat d3/d2a/d60/d2c/f5e 0 2023-01-04T18:17:05.036 INFO:tasks.workunit.client.0.smithi050.stdout:8/557: dread - d3/d2a/d27/d8b/fab zero size 2023-01-04T18:17:05.040 INFO:tasks.workunit.client.0.smithi050.stdout:2/525: dwrite d1/f15 [0,4194304] 0 2023-01-04T18:17:05.055 INFO:tasks.workunit.client.0.smithi050.stdout:5/651: dwrite d13/d15/d66/db8/d1f/fb7 [0,4194304] 0 2023-01-04T18:17:05.061 INFO:tasks.workunit.client.0.smithi050.stdout:3/510: sync 2023-01-04T18:17:05.061 INFO:tasks.workunit.client.0.smithi050.stdout:3/511: fdatasync d0/d1b/d2f/d71/f7b 0 2023-01-04T18:17:05.062 INFO:tasks.workunit.client.0.smithi050.stdout:8/558: dwrite d3/d2a/d74/fc7 [0,4194304] 0 2023-01-04T18:17:05.062 INFO:tasks.workunit.client.0.smithi050.stdout:8/559: read - d3/d2a/d27/d93/d7f/d96/fb3 zero size 2023-01-04T18:17:05.063 INFO:tasks.workunit.client.0.smithi050.stdout:2/526: dwrite d1/dd/d28/d2c/d2e/d3f/f8e [0,4194304] 0 2023-01-04T18:17:05.063 INFO:tasks.workunit.client.0.smithi050.stdout:4/480: rename fc to d14/d1b/d1f/d22/d3e/d85/f94 0 2023-01-04T18:17:05.172 INFO:tasks.workunit.client.0.smithi050.stdout:5/652: truncate d13/d15/d66/db2/fb5 839576 0 2023-01-04T18:17:05.172 INFO:tasks.workunit.client.0.smithi050.stdout:5/653: fdatasync d13/d15/d66/db8/d1f/d35/d42/d4a/f64 0 2023-01-04T18:17:05.172 INFO:tasks.workunit.client.0.smithi050.stdout:7/570: sync 2023-01-04T18:17:05.172 INFO:tasks.workunit.client.0.smithi050.stdout:0/440: sync 2023-01-04T18:17:05.172 INFO:tasks.workunit.client.0.smithi050.stdout:1/484: sync 2023-01-04T18:17:05.172 INFO:tasks.workunit.client.0.smithi050.stdout:0/441: readlink d0/d73/d68/l87 0 2023-01-04T18:17:05.172 INFO:tasks.workunit.client.0.smithi050.stdout:0/442: truncate d0/d73/f71 1003551 0 2023-01-04T18:17:05.172 INFO:tasks.workunit.client.0.smithi050.stdout:6/492: sync 2023-01-04T18:17:05.173 INFO:tasks.workunit.client.0.smithi050.stdout:7/571: write d6/db/d20/d55/fba [348718,61748] 0 2023-01-04T18:17:05.173 INFO:tasks.workunit.client.0.smithi050.stdout:3/512: mkdir d0/d1b/d2f/d56/d32/dbb 0 2023-01-04T18:17:05.173 INFO:tasks.workunit.client.0.smithi050.stdout:3/513: fsync d0/f4 0 2023-01-04T18:17:05.180 INFO:tasks.workunit.client.0.smithi050.stdout:8/560: unlink d3/c65 0 2023-01-04T18:17:05.191 INFO:tasks.workunit.client.0.smithi050.stdout:6/493: dwrite d0/d9/d25/d2d/f73 [0,4194304] 0 2023-01-04T18:17:05.191 INFO:tasks.workunit.client.0.smithi050.stdout:6/494: chown d0/d9/f4b 29470171 1 2023-01-04T18:17:05.192 INFO:tasks.workunit.client.0.smithi050.stdout:3/514: dwrite d0/d1b/d2f/f44 [0,4194304] 0 2023-01-04T18:17:05.218 INFO:tasks.workunit.client.0.smithi050.stdout:5/654: creat d13/d15/d66/db8/d27/d46/d4e/fe7 x:0 0 0 2023-01-04T18:17:05.218 INFO:tasks.workunit.client.0.smithi050.stdout:5/655: fdatasync d13/d15/d66/db8/d27/f2b 0 2023-01-04T18:17:05.218 INFO:tasks.workunit.client.0.smithi050.stdout:1/485: getdents d8/d48/d5c/d67/d3a/d31/d7f 0 2023-01-04T18:17:05.223 INFO:tasks.workunit.client.0.smithi050.stdout:8/561: symlink d3/d2a/d30/d3b/d53/lc8 0 2023-01-04T18:17:05.229 INFO:tasks.workunit.client.0.smithi050.stdout:3/515: creat d0/d1b/d2f/fbc x:0 0 0 2023-01-04T18:17:05.229 INFO:tasks.workunit.client.0.smithi050.stdout:3/516: fsync d0/d10/f8c 0 2023-01-04T18:17:05.229 INFO:tasks.workunit.client.0.smithi050.stdout:3/517: dread - d0/d1b/d2f/d31/f83 zero size 2023-01-04T18:17:05.231 INFO:tasks.workunit.client.0.smithi050.stdout:2/527: mkdir d1/dd/db0 0 2023-01-04T18:17:05.231 INFO:tasks.workunit.client.0.smithi050.stdout:4/481: mknod d14/d1b/d66/c95 0 2023-01-04T18:17:05.233 INFO:tasks.workunit.client.0.smithi050.stdout:5/656: link d13/d28/f36 d13/d28/d7c/d83/fe8 0 2023-01-04T18:17:05.237 INFO:tasks.workunit.client.0.smithi050.stdout:1/486: unlink d8/f11 0 2023-01-04T18:17:05.239 INFO:tasks.workunit.client.0.smithi050.stdout:7/572: creat d6/d28/d32/fc4 x:0 0 0 2023-01-04T18:17:05.239 INFO:tasks.workunit.client.0.smithi050.stdout:7/573: chown d6/d6b/lbc 166496 1 2023-01-04T18:17:05.239 INFO:tasks.workunit.client.0.smithi050.stdout:8/562: mkdir d3/d2a/d74/d92/d94/dc9 0 2023-01-04T18:17:05.240 INFO:tasks.workunit.client.0.smithi050.stdout:3/518: mknod d0/d1b/d2f/d56/d32/dbb/cbd 0 2023-01-04T18:17:05.255 INFO:tasks.workunit.client.0.smithi050.stdout:7/574: dwrite d6/d28/d32/f4e [0,4194304] 0 2023-01-04T18:17:05.257 INFO:tasks.workunit.client.0.smithi050.stdout:7/575: dread d6/d28/d99/f76 [0,4194304] 0 2023-01-04T18:17:05.326 INFO:tasks.workunit.client.0.smithi050.stdout:2/528: mkdir d1/dd/d11/d14/d91/d5a/d7f/db1 0 2023-01-04T18:17:05.327 INFO:tasks.workunit.client.0.smithi050.stdout:4/482: symlink d14/d1b/d1f/d22/d6a/l96 0 2023-01-04T18:17:05.328 INFO:tasks.workunit.client.0.smithi050.stdout:4/483: write d14/d1b/f50 [1464926,125645] 0 2023-01-04T18:17:05.329 INFO:tasks.workunit.client.0.smithi050.stdout:8/563: creat d3/d2a/d30/d3b/d53/fca x:0 0 0 2023-01-04T18:17:05.330 INFO:tasks.workunit.client.0.smithi050.stdout:4/484: write f0 [2494758,53707] 0 2023-01-04T18:17:05.344 INFO:tasks.workunit.client.0.smithi050.stdout:4/485: dread fd [0,4194304] 0 2023-01-04T18:17:05.348 INFO:tasks.workunit.client.0.smithi050.stdout:5/657: dwrite d13/d15/d66/db8/d8f/fa7 [0,4194304] 0 2023-01-04T18:17:05.350 INFO:tasks.workunit.client.0.smithi050.stdout:3/519: getdents d0/d1b/d2f/d56/d6b 0 2023-01-04T18:17:05.352 INFO:tasks.workunit.client.0.smithi050.stdout:8/564: dwrite d3/d2a/d60/d2c/f5e [4194304,4194304] 0 2023-01-04T18:17:05.355 INFO:tasks.workunit.client.0.smithi050.stdout:3/520: dread d0/dd/f90 [0,4194304] 0 2023-01-04T18:17:05.355 INFO:tasks.workunit.client.0.smithi050.stdout:8/565: dread d3/d2a/d60/fa8 [0,4194304] 0 2023-01-04T18:17:05.356 INFO:tasks.workunit.client.0.smithi050.stdout:8/566: fdatasync d3/d2a/d30/d3b/d4d/fad 0 2023-01-04T18:17:05.375 INFO:tasks.workunit.client.0.smithi050.stdout:0/443: truncate d0/d73/f71 851248 0 2023-01-04T18:17:05.382 INFO:tasks.workunit.client.0.smithi050.stdout:3/521: dwrite d0/fe [0,4194304] 0 2023-01-04T18:17:05.382 INFO:tasks.workunit.client.0.smithi050.stdout:3/522: write d0/f3 [906390,76058] 0 2023-01-04T18:17:05.387 INFO:tasks.workunit.client.0.smithi050.stdout:3/523: dread d0/f40 [4194304,4194304] 0 2023-01-04T18:17:05.389 INFO:tasks.workunit.client.0.smithi050.stdout:9/479: sync 2023-01-04T18:17:05.392 INFO:tasks.workunit.client.0.smithi050.stdout:4/486: symlink d14/d1b/d1f/d22/d3e/d44/d59/d5d/l97 0 2023-01-04T18:17:05.393 INFO:tasks.workunit.client.0.smithi050.stdout:5/658: creat d13/d15/d66/db8/d1f/d35/d59/d87/fe9 x:0 0 0 2023-01-04T18:17:05.402 INFO:tasks.workunit.client.0.smithi050.stdout:0/444: creat d0/d6/d8/f89 x:0 0 0 2023-01-04T18:17:05.402 INFO:tasks.workunit.client.0.smithi050.stdout:0/445: chown d0/d6/d28/d1a/c2c 19293594 1 2023-01-04T18:17:05.402 INFO:tasks.workunit.client.0.smithi050.stdout:0/446: chown d0/d6/d28/l29 257012 1 2023-01-04T18:17:05.408 INFO:tasks.workunit.client.0.smithi050.stdout:3/524: link d0/f2c d0/d10/fbe 0 2023-01-04T18:17:05.413 INFO:tasks.workunit.client.0.smithi050.stdout:7/576: unlink d6/d28/d32/fc4 0 2023-01-04T18:17:05.413 INFO:tasks.workunit.client.0.smithi050.stdout:7/577: readlink d6/db/d15/d1b/d22/laa 0 2023-01-04T18:17:05.416 INFO:tasks.workunit.client.0.smithi050.stdout:9/480: dwrite d1/d3/d3b/d63/f1c [4194304,4194304] 0 2023-01-04T18:17:05.416 INFO:tasks.workunit.client.0.smithi050.stdout:9/481: fsync d1/d3/d13/f15 0 2023-01-04T18:17:05.416 INFO:tasks.workunit.client.0.smithi050.stdout:4/487: rmdir d14/d1b/d1f/d63 39 2023-01-04T18:17:05.419 INFO:tasks.workunit.client.0.smithi050.stdout:5/659: creat d13/d15/d66/db8/d1f/d35/d49/fea x:0 0 0 2023-01-04T18:17:05.420 INFO:tasks.workunit.client.0.smithi050.stdout:8/567: mkdir d3/d2a/d30/d3b/d4d/d23/d55/d5f/d82/dcb 0 2023-01-04T18:17:05.460 INFO:tasks.workunit.client.0.smithi050.stdout:0/447: rmdir d0/d6/d8 39 2023-01-04T18:17:05.461 INFO:tasks.workunit.client.0.smithi050.stdout:6/495: sync 2023-01-04T18:17:05.464 INFO:tasks.workunit.client.0.smithi050.stdout:3/525: unlink d0/d8f/la2 0 2023-01-04T18:17:05.467 INFO:tasks.workunit.client.0.smithi050.stdout:7/578: creat d6/db/d15/d1b/fc5 x:0 0 0 2023-01-04T18:17:05.467 INFO:tasks.workunit.client.0.smithi050.stdout:7/579: chown d6/d1d/l77 387033606 1 2023-01-04T18:17:05.467 INFO:tasks.workunit.client.0.smithi050.stdout:7/580: chown d6/db/d15/d1b/d22 0 1 2023-01-04T18:17:05.469 INFO:tasks.workunit.client.0.smithi050.stdout:4/488: symlink d14/d1b/d1f/l98 0 2023-01-04T18:17:05.473 INFO:tasks.workunit.client.0.smithi050.stdout:5/660: write d13/d15/d66/db8/d27/d46/d4e/d4d/db1/fba [153992,103495] 0 2023-01-04T18:17:05.475 INFO:tasks.workunit.client.0.smithi050.stdout:0/448: stat d0/d73/c75 0 2023-01-04T18:17:05.475 INFO:tasks.workunit.client.0.smithi050.stdout:8/568: mkdir d3/d2a/d74/d92/dcc 0 2023-01-04T18:17:05.477 INFO:tasks.workunit.client.0.smithi050.stdout:3/526: link d0/d8f/d46/cb6 d0/d1b/d2f/d31/cbf 0 2023-01-04T18:17:05.479 INFO:tasks.workunit.client.0.smithi050.stdout:0/449: write d0/d6/d8/f48 [2486547,63780] 0 2023-01-04T18:17:05.480 INFO:tasks.workunit.client.0.smithi050.stdout:7/581: creat d6/d28/d32/d9d/fc6 x:0 0 0 2023-01-04T18:17:05.480 INFO:tasks.workunit.client.0.smithi050.stdout:0/450: read d0/d6/d8/d51/f50 [1894662,9285] 0 2023-01-04T18:17:05.484 INFO:tasks.workunit.client.0.smithi050.stdout:4/489: creat d14/d1b/d1f/d22/d3e/d44/d59/d5f/f99 x:0 0 0 2023-01-04T18:17:05.487 INFO:tasks.workunit.client.0.smithi050.stdout:2/529: sync 2023-01-04T18:17:05.488 INFO:tasks.workunit.client.0.smithi050.stdout:6/496: dwrite d0/f2f [0,4194304] 0 2023-01-04T18:17:05.488 INFO:tasks.workunit.client.0.smithi050.stdout:1/487: sync 2023-01-04T18:17:05.488 INFO:tasks.workunit.client.0.smithi050.stdout:1/488: write d8/d14/d1c/d28/d57/d6a/f95 [476950,1197] 0 2023-01-04T18:17:05.488 INFO:tasks.workunit.client.0.smithi050.stdout:1/489: write d8/d48/d5c/d67/d3a/d23/f3e [1187885,33980] 0 2023-01-04T18:17:05.490 INFO:tasks.workunit.client.0.smithi050.stdout:5/661: mkdir d13/d15/d66/db8/d27/d46/d4e/d4d/deb 0 2023-01-04T18:17:05.490 INFO:tasks.workunit.client.0.smithi050.stdout:6/497: dread d0/d9/d25/f9a [0,4194304] 0 2023-01-04T18:17:05.490 INFO:tasks.workunit.client.0.smithi050.stdout:6/498: truncate d0/f6f 1470995 0 2023-01-04T18:17:05.491 INFO:tasks.workunit.client.0.smithi050.stdout:8/569: creat d3/d2a/d30/d3b/d53/fcd x:0 0 0 2023-01-04T18:17:05.491 INFO:tasks.workunit.client.0.smithi050.stdout:8/570: write d3/fc6 [732515,83525] 0 2023-01-04T18:17:05.492 INFO:tasks.workunit.client.0.smithi050.stdout:7/582: unlink d6/d6b/d8b/fab 0 2023-01-04T18:17:05.494 INFO:tasks.workunit.client.0.smithi050.stdout:3/527: dwrite d0/d8f/d46/f85 [0,4194304] 0 2023-01-04T18:17:05.495 INFO:tasks.workunit.client.0.smithi050.stdout:0/451: rmdir d0/d6/d28 39 2023-01-04T18:17:05.500 INFO:tasks.workunit.client.0.smithi050.stdout:2/530: mknod d1/dd/d28/cb2 0 2023-01-04T18:17:05.500 INFO:tasks.workunit.client.0.smithi050.stdout:2/531: read - d1/dd/d11/d14/d91/f5f zero size 2023-01-04T18:17:05.500 INFO:tasks.workunit.client.0.smithi050.stdout:2/532: truncate d1/dd/d62/da1/f25 4854631 0 2023-01-04T18:17:05.500 INFO:tasks.workunit.client.0.smithi050.stdout:2/533: getdents d1/dd/db0 0 2023-01-04T18:17:05.502 INFO:tasks.workunit.client.0.smithi050.stdout:1/490: symlink d8/d48/d5c/d67/d3b/l98 0 2023-01-04T18:17:05.503 INFO:tasks.workunit.client.0.smithi050.stdout:5/662: mkdir d13/d15/d66/db8/d1f/d35/d42/dec 0 2023-01-04T18:17:05.503 INFO:tasks.workunit.client.0.smithi050.stdout:5/663: getdents d13/d15/d66/db8/d1f/d35/d42/dec 0 2023-01-04T18:17:05.505 INFO:tasks.workunit.client.0.smithi050.stdout:6/499: truncate d0/d9/df/f30 5896748 0 2023-01-04T18:17:05.506 INFO:tasks.workunit.client.0.smithi050.stdout:7/583: truncate d6/d28/d3c/d42/d5f/f6f 2002583 0 2023-01-04T18:17:05.514 INFO:tasks.workunit.client.0.smithi050.stdout:3/528: creat d0/d1a/fc0 x:0 0 0 2023-01-04T18:17:05.517 INFO:tasks.workunit.client.0.smithi050.stdout:1/491: creat d8/d14/d1c/d28/d57/d6a/d92/f99 x:0 0 0 2023-01-04T18:17:05.518 INFO:tasks.workunit.client.0.smithi050.stdout:5/664: mknod d13/d15/d66/db8/d27/dc3/ced 0 2023-01-04T18:17:05.520 INFO:tasks.workunit.client.0.smithi050.stdout:6/500: unlink d0/d9/df/f52 0 2023-01-04T18:17:05.521 INFO:tasks.workunit.client.0.smithi050.stdout:4/490: dwrite d14/d1b/f2f [4194304,4194304] 0 2023-01-04T18:17:05.522 INFO:tasks.workunit.client.0.smithi050.stdout:7/584: getdents d6/db/d20/d4f/d6e 0 2023-01-04T18:17:05.522 INFO:tasks.workunit.client.0.smithi050.stdout:7/585: fdatasync d6/d28/d3c/d42/f56 0 2023-01-04T18:17:05.522 INFO:tasks.workunit.client.0.smithi050.stdout:3/529: getdents d0/d1b/d2f/d56/d32/dbb 0 2023-01-04T18:17:05.522 INFO:tasks.workunit.client.0.smithi050.stdout:3/530: chown d0/dd/d45/l81 1142549 1 2023-01-04T18:17:05.523 INFO:tasks.workunit.client.0.smithi050.stdout:2/534: dwrite d1/dd/d62/da1/d83/fa6 [0,4194304] 0 2023-01-04T18:17:05.523 INFO:tasks.workunit.client.0.smithi050.stdout:8/571: dwrite d3/f20 [0,4194304] 0 2023-01-04T18:17:05.525 INFO:tasks.workunit.client.0.smithi050.stdout:3/531: read d0/d1b/d2f/d56/d32/f73 [2786454,5803] 0 2023-01-04T18:17:05.526 INFO:tasks.workunit.client.0.smithi050.stdout:2/535: write d1/f55 [1755729,78189] 0 2023-01-04T18:17:05.534 INFO:tasks.workunit.client.0.smithi050.stdout:1/492: rename d8/d14/d1c/c4e to d8/d14/d1c/d28/d57/d6a/c9a 0 2023-01-04T18:17:05.537 INFO:tasks.workunit.client.0.smithi050.stdout:4/491: mknod d14/d1b/d1f/d22/d3e/d44/d59/d5f/c9a 0 2023-01-04T18:17:05.539 INFO:tasks.workunit.client.0.smithi050.stdout:7/586: unlink d6/d28/d32/d9d/fc6 0 2023-01-04T18:17:05.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:03.920680+0000 mgr.smithi098.vhfzum (mgr.24455) 43 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 820 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 35 MiB/s rd, 74 MiB/s wr, 206 op/s 2023-01-04T18:17:05.541 INFO:tasks.workunit.client.0.smithi050.stdout:8/572: creat d3/d2a/d27/d93/fce x:0 0 0 2023-01-04T18:17:05.543 INFO:tasks.workunit.client.0.smithi050.stdout:2/536: creat d1/dd/d11/d12/fb3 x:0 0 0 2023-01-04T18:17:05.543 INFO:tasks.workunit.client.0.smithi050.stdout:2/537: read d1/dd/d28/d2c/d2e/d3f/f64 [332023,42090] 0 2023-01-04T18:17:05.544 INFO:tasks.workunit.client.0.smithi050.stdout:0/452: rmdir d0/d6/d8/d35/d67 0 2023-01-04T18:17:05.544 INFO:tasks.workunit.client.0.smithi050.stdout:0/453: fdatasync d0/d6/f58 0 2023-01-04T18:17:05.548 INFO:tasks.workunit.client.0.smithi050.stdout:1/493: truncate d8/d48/d5c/d67/f56 668610 0 2023-01-04T18:17:05.548 INFO:tasks.workunit.client.0.smithi050.stdout:1/494: readlink d8/d48/d8c/d72/l94 0 2023-01-04T18:17:05.548 INFO:tasks.workunit.client.0.smithi050.stdout:8/573: creat d3/d2a/d74/d92/fcf x:0 0 0 2023-01-04T18:17:05.548 INFO:tasks.workunit.client.0.smithi050.stdout:8/574: readlink d3/d2a/d30/d3b/d4d/d23/d55/laa 0 2023-01-04T18:17:05.548 INFO:tasks.workunit.client.0.smithi050.stdout:8/575: chown d3/d2a/d27/d93/d7f/d96/d46/f4a 40894 1 2023-01-04T18:17:05.548 INFO:tasks.workunit.client.0.smithi050.stdout:2/538: rmdir d1/dd/d11/d14/d91/d5a/d7f/db1 0 2023-01-04T18:17:05.548 INFO:tasks.workunit.client.0.smithi050.stdout:4/492: dread f7 [0,4194304] 0 2023-01-04T18:17:05.549 INFO:tasks.workunit.client.0.smithi050.stdout:1/495: creat d8/d14/d1c/d28/d57/d6a/f9b x:0 0 0 2023-01-04T18:17:05.549 INFO:tasks.workunit.client.0.smithi050.stdout:1/496: dread - d8/d14/d1c/f73 zero size 2023-01-04T18:17:05.549 INFO:tasks.workunit.client.0.smithi050.stdout:7/587: dread d6/db/f2a [0,4194304] 0 2023-01-04T18:17:05.551 INFO:tasks.workunit.client.0.smithi050.stdout:8/576: rename d3/d2a/d27/d93/l8d to d3/d2a/d27/ld0 0 2023-01-04T18:17:05.551 INFO:tasks.workunit.client.0.smithi050.stdout:8/577: chown d3/d2a/f6e 106103144 1 2023-01-04T18:17:05.552 INFO:tasks.workunit.client.0.smithi050.stdout:8/578: write d3/d2a/d27/dc1/fc2 [929922,23236] 0 2023-01-04T18:17:05.554 INFO:tasks.workunit.client.0.smithi050.stdout:2/539: symlink d1/dd/d28/d2c/d2e/d3f/da7/lb4 0 2023-01-04T18:17:05.557 INFO:tasks.workunit.client.0.smithi050.stdout:3/532: dwrite d0/d1b/d2f/d56/d3f/fa5 [0,4194304] 0 2023-01-04T18:17:05.558 INFO:tasks.workunit.client.0.smithi050.stdout:6/501: dwrite d0/d9/d25/d4d/f6e [0,4194304] 0 2023-01-04T18:17:05.558 INFO:tasks.workunit.client.0.smithi050.stdout:6/502: chown d0/d9/f4b 931480095 1 2023-01-04T18:17:05.558 INFO:tasks.workunit.client.0.smithi050.stdout:5/665: dwrite d13/f19 [0,4194304] 0 2023-01-04T18:17:05.561 INFO:tasks.workunit.client.0.smithi050.stdout:4/493: creat d14/d1b/d1f/d22/d6a/f9b x:0 0 0 2023-01-04T18:17:05.562 INFO:tasks.workunit.client.0.smithi050.stdout:7/588: rename d6/d28/d3c/d62 to d6/db/d15/d48/dc7 0 2023-01-04T18:17:05.563 INFO:tasks.workunit.client.0.smithi050.stdout:0/454: dwrite d0/d6/d28/f49 [0,4194304] 0 2023-01-04T18:17:05.571 INFO:tasks.workunit.client.0.smithi050.stdout:5/666: symlink d13/d15/d66/db8/lee 0 2023-01-04T18:17:05.571 INFO:tasks.workunit.client.0.smithi050.stdout:5/667: truncate d13/d15/d66/db8/d1f/d62/fb0 300068 0 2023-01-04T18:17:05.572 INFO:tasks.workunit.client.0.smithi050.stdout:1/497: dread d8/f89 [0,4194304] 0 2023-01-04T18:17:05.572 INFO:tasks.workunit.client.0.smithi050.stdout:5/668: write d13/d15/d66/db8/d27/fb3 [3389086,113697] 0 2023-01-04T18:17:05.573 INFO:tasks.workunit.client.0.smithi050.stdout:4/494: write f13 [6241723,16108] 0 2023-01-04T18:17:05.573 INFO:tasks.workunit.client.0.smithi050.stdout:4/495: fdatasync d14/d1b/d1f/d22/d3e/d44/d59/d5f/f99 0 2023-01-04T18:17:05.575 INFO:tasks.workunit.client.0.smithi050.stdout:2/540: rename d1/dd/d11/d14/d39 to d1/dd/d11/db5 0 2023-01-04T18:17:05.577 INFO:tasks.workunit.client.0.smithi050.stdout:7/589: mkdir d6/db/d15/dc8 0 2023-01-04T18:17:05.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:05 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:03.920680+0000 mgr.smithi098.vhfzum (mgr.24455) 43 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 820 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 35 MiB/s rd, 74 MiB/s wr, 206 op/s 2023-01-04T18:17:05.585 INFO:tasks.workunit.client.0.smithi050.stdout:0/455: rmdir d0/d6/d8/d51 39 2023-01-04T18:17:05.588 INFO:tasks.workunit.client.0.smithi050.stdout:1/498: unlink d8/d48/c6e 0 2023-01-04T18:17:05.589 INFO:tasks.workunit.client.0.smithi050.stdout:5/669: creat d13/d15/d66/db8/d27/d46/d4e/d4d/da9/fef x:0 0 0 2023-01-04T18:17:05.590 INFO:tasks.workunit.client.0.smithi050.stdout:4/496: creat d14/d1b/d66/f9c x:0 0 0 2023-01-04T18:17:05.590 INFO:tasks.workunit.client.0.smithi050.stdout:4/497: write d14/d1b/d1f/d22/d3e/f91 [569280,85017] 0 2023-01-04T18:17:05.591 INFO:tasks.workunit.client.0.smithi050.stdout:8/579: dwrite d3/d2a/d27/d8b/fab [0,4194304] 0 2023-01-04T18:17:05.592 INFO:tasks.workunit.client.0.smithi050.stdout:3/533: dwrite d0/dd/d45/f9a [0,4194304] 0 2023-01-04T18:17:05.594 INFO:tasks.workunit.client.0.smithi050.stdout:2/541: link d1/dd/d62/d69/f82 d1/dd/d11/d14/d91/d5a/fb6 0 2023-01-04T18:17:05.594 INFO:tasks.workunit.client.0.smithi050.stdout:2/542: chown d1/dd/d11/d14/f8b 1007809 1 2023-01-04T18:17:05.595 INFO:tasks.workunit.client.0.smithi050.stdout:6/503: dwrite d0/d9/d38/d1c/f9b [0,4194304] 0 2023-01-04T18:17:05.595 INFO:tasks.workunit.client.0.smithi050.stdout:6/504: fdatasync d0/f2f 0 2023-01-04T18:17:05.597 INFO:tasks.workunit.client.0.smithi050.stdout:7/590: mknod d6/d90/cc9 0 2023-01-04T18:17:05.610 INFO:tasks.workunit.client.0.smithi050.stdout:0/456: mkdir d0/d6/d28/d1a/d8a 0 2023-01-04T18:17:05.610 INFO:tasks.workunit.client.0.smithi050.stdout:0/457: write d0/d6/d28/d1a/f70 [959022,43291] 0 2023-01-04T18:17:05.610 INFO:tasks.workunit.client.0.smithi050.stdout:4/498: mkdir d14/d1b/d1f/d22/d3e/d44/d59/d5f/d80/d9d 0 2023-01-04T18:17:05.612 INFO:tasks.workunit.client.0.smithi050.stdout:0/458: write d0/d6/d8/d51/f50 [2371579,34512] 0 2023-01-04T18:17:05.612 INFO:tasks.workunit.client.0.smithi050.stdout:0/459: write d0/d6/d8/d51/f80 [1008197,107976] 0 2023-01-04T18:17:05.613 INFO:tasks.workunit.client.0.smithi050.stdout:4/499: write d14/d1b/d1f/d22/f54 [6247377,91766] 0 2023-01-04T18:17:05.613 INFO:tasks.workunit.client.0.smithi050.stdout:8/580: mkdir d3/d2a/d2d/d86/dd1 0 2023-01-04T18:17:05.616 INFO:tasks.workunit.client.0.smithi050.stdout:1/499: dwrite d8/d14/d1c/d28/d57/d6a/f9b [0,4194304] 0 2023-01-04T18:17:05.620 INFO:tasks.workunit.client.0.smithi050.stdout:2/543: dwrite d1/dd/d11/d14/d91/f5f [0,4194304] 0 2023-01-04T18:17:05.623 INFO:tasks.workunit.client.0.smithi050.stdout:7/591: dwrite d6/db/d20/d55/f5e [0,4194304] 0 2023-01-04T18:17:05.623 INFO:tasks.workunit.client.0.smithi050.stdout:3/534: dwrite d0/d1a/f8a [0,4194304] 0 2023-01-04T18:17:05.624 INFO:tasks.workunit.client.0.smithi050.stdout:2/544: dread d1/dd/d62/d69/f84 [0,4194304] 0 2023-01-04T18:17:05.624 INFO:tasks.workunit.client.0.smithi050.stdout:5/670: dwrite d13/d15/d66/db8/d1f/fa3 [0,4194304] 0 2023-01-04T18:17:05.643 INFO:tasks.workunit.client.0.smithi050.stdout:5/671: dwrite d13/d15/d66/db8/f4c [0,4194304] 0 2023-01-04T18:17:05.643 INFO:tasks.workunit.client.0.smithi050.stdout:6/505: symlink d0/d9/d25/d40/d89/l9d 0 2023-01-04T18:17:05.644 INFO:tasks.workunit.client.0.smithi050.stdout:5/672: read d13/d15/d66/db8/d27/fce [363575,38691] 0 2023-01-04T18:17:05.647 INFO:tasks.workunit.client.0.smithi050.stdout:0/460: rename d0/d6/d28/c82 to d0/d6/d28/c8b 0 2023-01-04T18:17:05.647 INFO:tasks.workunit.client.0.smithi050.stdout:9/482: sync 2023-01-04T18:17:05.648 INFO:tasks.workunit.client.0.smithi050.stdout:9/483: write d1/d12/f44 [985250,78187] 0 2023-01-04T18:17:05.649 INFO:tasks.workunit.client.0.smithi050.stdout:9/484: fdatasync d1/d12/d2d/d39/f66 0 2023-01-04T18:17:05.649 INFO:tasks.workunit.client.0.smithi050.stdout:4/500: mkdir d14/d9e 0 2023-01-04T18:17:05.650 INFO:tasks.workunit.client.0.smithi050.stdout:4/501: stat d14/d1b/d1f/c64 0 2023-01-04T18:17:05.650 INFO:tasks.workunit.client.0.smithi050.stdout:4/502: chown d14/f1c 0 1 2023-01-04T18:17:05.650 INFO:tasks.workunit.client.0.smithi050.stdout:4/503: chown d14/d1b/d32/f45 60 1 2023-01-04T18:17:05.651 INFO:tasks.workunit.client.0.smithi050.stdout:8/581: creat d3/d2a/d27/dc1/fd2 x:0 0 0 2023-01-04T18:17:05.651 INFO:tasks.workunit.client.0.smithi050.stdout:8/582: readlink d3/d2a/d27/l29 0 2023-01-04T18:17:05.651 INFO:tasks.workunit.client.0.smithi050.stdout:8/583: read d3/d2a/d2d/f50 [467965,53573] 0 2023-01-04T18:17:05.655 INFO:tasks.workunit.client.0.smithi050.stdout:1/500: creat d8/d48/d5c/d67/d3b/f9c x:0 0 0 2023-01-04T18:17:05.662 INFO:tasks.workunit.client.0.smithi050.stdout:7/592: rmdir d6/db/d15/dc8 0 2023-01-04T18:17:05.668 INFO:tasks.workunit.client.0.smithi050.stdout:3/535: mknod d0/d1b/d2f/d56/d32/dbb/cc1 0 2023-01-04T18:17:05.669 INFO:tasks.workunit.client.0.smithi050.stdout:2/545: creat d1/dd/d11/d14/d44/fb7 x:0 0 0 2023-01-04T18:17:05.673 INFO:tasks.workunit.client.0.smithi050.stdout:6/506: rmdir d0/d9/d38/d60/d7a 39 2023-01-04T18:17:05.674 INFO:tasks.workunit.client.0.smithi050.stdout:5/673: creat d13/d28/d7c/ff0 x:0 0 0 2023-01-04T18:17:05.676 INFO:tasks.workunit.client.0.smithi050.stdout:0/461: creat d0/d6/d8/d25/f8c x:0 0 0 2023-01-04T18:17:05.679 INFO:tasks.workunit.client.0.smithi050.stdout:9/485: unlink d1/d3/d11/d1f/l46 0 2023-01-04T18:17:05.680 INFO:tasks.workunit.client.0.smithi050.stdout:4/504: mknod d14/d1b/d1f/d22/d3e/d44/d59/c9f 0 2023-01-04T18:17:05.684 INFO:tasks.workunit.client.0.smithi050.stdout:3/536: getdents d0/d1b 0 2023-01-04T18:17:05.687 INFO:tasks.workunit.client.0.smithi050.stdout:8/584: getdents d3/d2a/d27/d93/d7f 0 2023-01-04T18:17:05.687 INFO:tasks.workunit.client.0.smithi050.stdout:7/593: link d6/d1d/d1f/l38 d6/db/d15/d1b/d22/da6/lca 0 2023-01-04T18:17:05.689 INFO:tasks.workunit.client.0.smithi050.stdout:2/546: rmdir d1/dd/d28/d2c 39 2023-01-04T18:17:05.689 INFO:tasks.workunit.client.0.smithi050.stdout:5/674: mknod d13/d15/d66/db8/d27/d46/d4e/d4d/db1/cf1 0 2023-01-04T18:17:05.691 INFO:tasks.workunit.client.0.smithi050.stdout:4/505: dread d14/f15 [0,4194304] 0 2023-01-04T18:17:05.692 INFO:tasks.workunit.client.0.smithi050.stdout:7/594: write d6/f23 [1786418,64741] 0 2023-01-04T18:17:05.696 INFO:tasks.workunit.client.0.smithi050.stdout:3/537: dread d0/d1b/d2f/d31/f4b [4194304,4194304] 0 2023-01-04T18:17:05.696 INFO:tasks.workunit.client.0.smithi050.stdout:7/595: dread d6/db/d3b/f4c [0,4194304] 0 2023-01-04T18:17:05.701 INFO:tasks.workunit.client.0.smithi050.stdout:6/507: dwrite d0/d9/d38/d16/f3f [0,4194304] 0 2023-01-04T18:17:05.701 INFO:tasks.workunit.client.0.smithi050.stdout:6/508: stat d0/d9/cc 0 2023-01-04T18:17:05.704 INFO:tasks.workunit.client.0.smithi050.stdout:9/486: dwrite d1/d12/d2d/f85 [0,4194304] 0 2023-01-04T18:17:05.716 INFO:tasks.workunit.client.0.smithi050.stdout:7/596: dwrite d6/db/d15/f16 [0,4194304] 0 2023-01-04T18:17:05.718 INFO:tasks.workunit.client.0.smithi050.stdout:6/509: dwrite d0/d9/d38/f5b [0,4194304] 0 2023-01-04T18:17:05.718 INFO:tasks.workunit.client.0.smithi050.stdout:6/510: truncate d0/d9/d38/f15 1922649 0 2023-01-04T18:17:05.718 INFO:tasks.workunit.client.0.smithi050.stdout:6/511: read d0/d9/f29 [2806989,120181] 0 2023-01-04T18:17:05.720 INFO:tasks.workunit.client.0.smithi050.stdout:6/512: write d0/d9/f29 [635483,23284] 0 2023-01-04T18:17:05.750 INFO:tasks.workunit.client.0.smithi050.stdout:8/585: mknod d3/d2a/d27/d93/d7f/cd3 0 2023-01-04T18:17:05.751 INFO:tasks.workunit.client.0.smithi050.stdout:2/547: symlink d1/dd/d11/d14/lb8 0 2023-01-04T18:17:05.751 INFO:tasks.workunit.client.0.smithi050.stdout:2/548: truncate d1/d41/f67 1583296 0 2023-01-04T18:17:05.757 INFO:tasks.workunit.client.0.smithi050.stdout:1/501: dread d8/f43 [0,4194304] 0 2023-01-04T18:17:05.758 INFO:tasks.workunit.client.0.smithi050.stdout:1/502: write d8/d48/d5c/d67/d3a/d31/f64 [1585203,129556] 0 2023-01-04T18:17:05.760 INFO:tasks.workunit.client.0.smithi050.stdout:4/506: mkdir d14/d1b/d1f/d22/da0 0 2023-01-04T18:17:05.761 INFO:tasks.workunit.client.0.smithi050.stdout:3/538: mkdir d0/d8f/d46/dc2 0 2023-01-04T18:17:05.767 INFO:tasks.workunit.client.0.smithi050.stdout:9/487: getdents d1/d3/d11/d1f 0 2023-01-04T18:17:05.768 INFO:tasks.workunit.client.0.smithi050.stdout:8/586: dwrite d3/d2a/d2d/f70 [0,4194304] 0 2023-01-04T18:17:05.768 INFO:tasks.workunit.client.0.smithi050.stdout:8/587: write d3/d2a/d60/d2c/f5e [879604,98369] 0 2023-01-04T18:17:05.775 INFO:tasks.workunit.client.0.smithi050.stdout:7/597: creat d6/db/d20/d55/d82/fcb x:0 0 0 2023-01-04T18:17:05.777 INFO:tasks.workunit.client.0.smithi050.stdout:6/513: mknod d0/c9e 0 2023-01-04T18:17:05.787 INFO:tasks.workunit.client.0.smithi050.stdout:5/675: dread d13/d28/d7c/f8d [0,4194304] 0 2023-01-04T18:17:05.788 INFO:tasks.workunit.client.0.smithi050.stdout:1/503: link d8/d48/d5c/d67/d3a/f6d d8/d14/d1c/d28/f9d 0 2023-01-04T18:17:05.790 INFO:tasks.workunit.client.0.smithi050.stdout:8/588: dwrite d3/d2a/d2d/f66 [0,4194304] 0 2023-01-04T18:17:05.791 INFO:tasks.workunit.client.0.smithi050.stdout:3/539: unlink d0/d1b/d2f/d31/c8b 0 2023-01-04T18:17:05.792 INFO:tasks.workunit.client.0.smithi050.stdout:9/488: creat d1/d12/d41/d60/d95/f99 x:0 0 0 2023-01-04T18:17:05.793 INFO:tasks.workunit.client.0.smithi050.stdout:9/489: read d1/d3/f19 [3530738,52863] 0 2023-01-04T18:17:05.801 INFO:tasks.workunit.client.0.smithi050.stdout:7/598: link d6/db/d20/d55/f5e d6/db/d3b/fcc 0 2023-01-04T18:17:05.804 INFO:tasks.workunit.client.0.smithi050.stdout:6/514: mkdir d0/d9/d38/d16/d77/d9f 0 2023-01-04T18:17:05.805 INFO:tasks.workunit.client.0.smithi050.stdout:5/676: mkdir d13/d15/d66/db8/d27/d44/df2 0 2023-01-04T18:17:05.806 INFO:tasks.workunit.client.0.smithi050.stdout:1/504: mknod d8/d48/d8c/c9e 0 2023-01-04T18:17:05.807 INFO:tasks.workunit.client.0.smithi050.stdout:4/507: symlink d14/d1b/d66/la1 0 2023-01-04T18:17:05.809 INFO:tasks.workunit.client.0.smithi050.stdout:4/508: write d14/d1b/d1f/d22/d3e/d44/d59/d5f/d6f/f8b [1489170,129453] 0 2023-01-04T18:17:05.810 INFO:tasks.workunit.client.0.smithi050.stdout:4/509: write d14/f31 [3231131,84500] 0 2023-01-04T18:17:05.811 INFO:tasks.workunit.client.0.smithi050.stdout:4/510: readlink d14/d1b/d1f/d22/d3e/l4f 0 2023-01-04T18:17:05.813 INFO:tasks.workunit.client.0.smithi050.stdout:1/505: dread d8/d48/d5c/d67/d3a/d23/f3e [0,4194304] 0 2023-01-04T18:17:05.814 INFO:tasks.workunit.client.0.smithi050.stdout:8/589: symlink d3/d2a/d27/d8b/ld4 0 2023-01-04T18:17:05.815 INFO:tasks.workunit.client.0.smithi050.stdout:8/590: read d3/d2a/d30/d3b/f79 [1133088,33121] 0 2023-01-04T18:17:05.817 INFO:tasks.workunit.client.0.smithi050.stdout:3/540: mkdir d0/d1a/dc3 0 2023-01-04T18:17:05.817 INFO:tasks.workunit.client.0.smithi050.stdout:3/541: chown d0/f5e 3447166 1 2023-01-04T18:17:05.818 INFO:tasks.workunit.client.0.smithi050.stdout:9/490: creat d1/d3/d3b/f9a x:0 0 0 2023-01-04T18:17:05.819 INFO:tasks.workunit.client.0.smithi050.stdout:7/599: mknod d6/db/d15/d2e/ccd 0 2023-01-04T18:17:05.819 INFO:tasks.workunit.client.0.smithi050.stdout:7/600: readlink d6/db/d15/d1b/l3e 0 2023-01-04T18:17:05.822 INFO:tasks.workunit.client.0.smithi050.stdout:6/515: rmdir d0/d9/d38/d16/d77/d9f 0 2023-01-04T18:17:05.823 INFO:tasks.workunit.client.0.smithi050.stdout:5/677: rename d13/d15/d66/db8/d27/d46/d4e/fe7 to d13/d15/d66/db8/d27/d46/d4e/d4d/db1/ff3 0 2023-01-04T18:17:05.827 INFO:tasks.workunit.client.0.smithi050.stdout:1/506: symlink d8/d48/d5c/d67/d3a/l9f 0 2023-01-04T18:17:05.829 INFO:tasks.workunit.client.0.smithi050.stdout:3/542: truncate d0/d10/f42 1329805 0 2023-01-04T18:17:05.829 INFO:tasks.workunit.client.0.smithi050.stdout:3/543: dread - d0/d1b/d2f/fb7 zero size 2023-01-04T18:17:05.830 INFO:tasks.workunit.client.0.smithi050.stdout:4/511: dread d14/f31 [0,4194304] 0 2023-01-04T18:17:05.831 INFO:tasks.workunit.client.0.smithi050.stdout:7/601: link d6/db/d15/d1b/d22/f39 d6/db/d15/d1b/d5b/fce 0 2023-01-04T18:17:05.833 INFO:tasks.workunit.client.0.smithi050.stdout:6/516: symlink d0/d9/d38/d16/d77/la0 0 2023-01-04T18:17:05.838 INFO:tasks.workunit.client.0.smithi050.stdout:5/678: symlink d13/d15/d66/db8/dd9/lf4 0 2023-01-04T18:17:05.839 INFO:tasks.workunit.client.0.smithi050.stdout:5/679: chown d13/d15/d66/db8/l24 1 1 2023-01-04T18:17:05.840 INFO:tasks.workunit.client.0.smithi050.stdout:8/591: rename d3/d2a/d30/d3b/d4d/d23/d55/l7c to d3/d2a/d73/ld5 0 2023-01-04T18:17:05.840 INFO:tasks.workunit.client.0.smithi050.stdout:9/491: dwrite d1/d3/d11/d1f/f5b [0,4194304] 0 2023-01-04T18:17:05.840 INFO:tasks.workunit.client.0.smithi050.stdout:4/512: symlink d14/d1b/d1f/la2 0 2023-01-04T18:17:05.842 INFO:tasks.workunit.client.0.smithi050.stdout:7/602: mknod d6/d28/d3c/d42/ccf 0 2023-01-04T18:17:05.843 INFO:tasks.workunit.client.0.smithi050.stdout:4/513: dread d14/d1b/d1f/d22/f4e [4194304,4194304] 0 2023-01-04T18:17:05.889 INFO:tasks.workunit.client.0.smithi050.stdout:3/544: dwrite d0/d10/f70 [0,4194304] 0 2023-01-04T18:17:05.890 INFO:tasks.workunit.client.0.smithi050.stdout:8/592: dwrite d3/d2a/d27/d93/f7d [0,4194304] 0 2023-01-04T18:17:05.891 INFO:tasks.workunit.client.0.smithi050.stdout:1/507: dwrite d8/d48/d5c/d67/d3b/f68 [0,4194304] 0 2023-01-04T18:17:05.892 INFO:tasks.workunit.client.0.smithi050.stdout:1/508: write d8/d14/d1c/d28/f2b [1293123,1877] 0 2023-01-04T18:17:05.902 INFO:tasks.workunit.client.0.smithi050.stdout:1/509: dread d8/d14/d1c/f78 [0,4194304] 0 2023-01-04T18:17:05.902 INFO:tasks.workunit.client.0.smithi050.stdout:1/510: dread - d8/d48/d8c/d72/f80 zero size 2023-01-04T18:17:05.902 INFO:tasks.workunit.client.0.smithi050.stdout:1/511: stat d8/d48/d5c/d67/d3b/d84/f8b 0 2023-01-04T18:17:05.902 INFO:tasks.workunit.client.0.smithi050.stdout:1/512: stat d8/d48/d5c/d67/d3a/d23/f3e 0 2023-01-04T18:17:05.908 INFO:tasks.workunit.client.0.smithi050.stdout:3/545: dwrite d0/d8f/f25 [0,4194304] 0 2023-01-04T18:17:05.910 INFO:tasks.workunit.client.0.smithi050.stdout:5/680: symlink d13/d15/d66/db8/d1f/d62/lf5 0 2023-01-04T18:17:05.910 INFO:tasks.workunit.client.0.smithi050.stdout:5/681: dread - d13/d15/d66/db8/d1f/d35/d49/fea zero size 2023-01-04T18:17:05.914 INFO:tasks.workunit.client.0.smithi050.stdout:9/492: mknod d1/d3/d24/d7b/c9b 0 2023-01-04T18:17:05.914 INFO:tasks.workunit.client.0.smithi050.stdout:9/493: truncate d1/d12/d41/d60/f64 893463 0 2023-01-04T18:17:05.914 INFO:tasks.workunit.client.0.smithi050.stdout:9/494: dread - d1/d12/d41/d60/d95/f96 zero size 2023-01-04T18:17:05.914 INFO:tasks.workunit.client.0.smithi050.stdout:9/495: readlink d1/d12/d3f/l61 0 2023-01-04T18:17:05.915 INFO:tasks.workunit.client.0.smithi050.stdout:4/514: truncate d14/d1b/d1f/d22/f4d 312301 0 2023-01-04T18:17:05.918 INFO:tasks.workunit.client.0.smithi050.stdout:8/593: chown d3/d2a/d27/d93/d7f/d96/c83 1375 1 2023-01-04T18:17:05.923 INFO:tasks.workunit.client.0.smithi050.stdout:1/513: rename d8/d14/d1c/d28/d57/d6a/f9b to d8/d14/d1c/d28/fa0 0 2023-01-04T18:17:05.925 INFO:tasks.workunit.client.0.smithi050.stdout:1/514: write d8/f60 [3553436,73690] 0 2023-01-04T18:17:05.925 INFO:tasks.workunit.client.0.smithi050.stdout:1/515: write d8/d48/f83 [171382,120947] 0 2023-01-04T18:17:05.930 INFO:tasks.workunit.client.0.smithi050.stdout:3/546: creat d0/d1b/d2f/d56/fc4 x:0 0 0 2023-01-04T18:17:05.931 INFO:tasks.workunit.client.0.smithi050.stdout:9/496: dwrite d1/d12/d41/d60/d95/f99 [0,4194304] 0 2023-01-04T18:17:05.932 INFO:tasks.workunit.client.0.smithi050.stdout:5/682: symlink d13/d15/d66/db8/d27/d44/lf6 0 2023-01-04T18:17:05.932 INFO:tasks.workunit.client.0.smithi050.stdout:5/683: chown d13/d15/d66/db8/d27/l32 41 1 2023-01-04T18:17:05.936 INFO:tasks.workunit.client.0.smithi050.stdout:4/515: creat d14/d1b/d1f/d22/d3e/d44/d59/d5f/d80/fa3 x:0 0 0 2023-01-04T18:17:05.953 INFO:tasks.workunit.client.0.smithi050.stdout:4/516: dwrite d14/d1b/f2f [0,4194304] 0 2023-01-04T18:17:05.954 INFO:tasks.workunit.client.0.smithi050.stdout:4/517: write d14/d1b/d1f/d22/d3e/f60 [3783617,102818] 0 2023-01-04T18:17:05.954 INFO:tasks.workunit.client.0.smithi050.stdout:4/518: stat d14/d1b/d66/f9c 0 2023-01-04T18:17:05.955 INFO:tasks.workunit.client.0.smithi050.stdout:8/594: symlink d3/d2a/d27/d93/d7f/ld6 0 2023-01-04T18:17:05.955 INFO:tasks.workunit.client.0.smithi050.stdout:8/595: fsync d3/d2a/d2d/f76 0 2023-01-04T18:17:05.956 INFO:tasks.workunit.client.0.smithi050.stdout:1/516: rename d8/d48/d5c/d67/d3a/c29 to d8/d14/ca1 0 2023-01-04T18:17:05.958 INFO:tasks.workunit.client.0.smithi050.stdout:3/547: symlink d0/d1b/lc5 0 2023-01-04T18:17:05.960 INFO:tasks.workunit.client.0.smithi050.stdout:3/548: dread d0/dd/f1e [0,4194304] 0 2023-01-04T18:17:05.960 INFO:tasks.workunit.client.0.smithi050.stdout:3/549: chown d0 1501405708 1 2023-01-04T18:17:05.961 INFO:tasks.workunit.client.0.smithi050.stdout:3/550: write d0/d8f/f27 [352456,18596] 0 2023-01-04T18:17:05.964 INFO:tasks.workunit.client.0.smithi050.stdout:9/497: stat d1/d3/d24/l4f 0 2023-01-04T18:17:05.965 INFO:tasks.workunit.client.0.smithi050.stdout:9/498: chown d1/d3/d11/d1f/f4e 0 1 2023-01-04T18:17:05.965 INFO:tasks.workunit.client.0.smithi050.stdout:9/499: stat d1/d12/d41/d60/d7c 0 2023-01-04T18:17:05.971 INFO:tasks.workunit.client.0.smithi050.stdout:4/519: creat d14/d1b/d1f/d22/d3e/fa4 x:0 0 0 2023-01-04T18:17:05.973 INFO:tasks.workunit.client.0.smithi050.stdout:8/596: creat d3/d2a/fd7 x:0 0 0 2023-01-04T18:17:05.973 INFO:tasks.workunit.client.0.smithi050.stdout:8/597: write d3/d2a/d30/d3b/d53/f97 [231880,39862] 0 2023-01-04T18:17:05.974 INFO:tasks.workunit.client.0.smithi050.stdout:1/517: rename d8/d48/d5c/d67/d3a/d31/d7f/c97 to d8/d48/d5c/d67/d3a/d31/d7f/ca2 0 2023-01-04T18:17:05.974 INFO:tasks.workunit.client.0.smithi050.stdout:8/598: read d3/f68 [1341773,69590] 0 2023-01-04T18:17:05.979 INFO:tasks.workunit.client.0.smithi050.stdout:3/551: rename d0/d1b/d2f/c6e to d0/d1a/cc6 0 2023-01-04T18:17:05.981 INFO:tasks.workunit.client.0.smithi050.stdout:9/500: symlink d1/d12/d2d/l9c 0 2023-01-04T18:17:05.981 INFO:tasks.workunit.client.0.smithi050.stdout:9/501: truncate d1/d12/d41/d60/d95/f96 1034854 0 2023-01-04T18:17:05.981 INFO:tasks.workunit.client.0.smithi050.stdout:9/502: fdatasync d1/d3/d13/f8d 0 2023-01-04T18:17:05.984 INFO:tasks.workunit.client.0.smithi050.stdout:4/520: mkdir d14/d1b/d1f/d63/da5 0 2023-01-04T18:17:05.986 INFO:tasks.workunit.client.0.smithi050.stdout:1/518: truncate d8/d48/d5c/d67/f1f 921835 0 2023-01-04T18:17:05.986 INFO:tasks.workunit.client.0.smithi050.stdout:1/519: stat d8/d48 0 2023-01-04T18:17:05.988 INFO:tasks.workunit.client.0.smithi050.stdout:8/599: mkdir d3/d2a/d2d/d85/daf/dd8 0 2023-01-04T18:17:05.989 INFO:tasks.workunit.client.0.smithi050.stdout:8/600: getdents d3/d2a/d74/d92/d94/dc9 0 2023-01-04T18:17:05.989 INFO:tasks.workunit.client.0.smithi050.stdout:8/601: fdatasync d3/d2a/d74/d92/fcf 0 2023-01-04T18:17:05.989 INFO:tasks.workunit.client.0.smithi050.stdout:8/602: fdatasync d3/d2a/d2d/f70 0 2023-01-04T18:17:05.989 INFO:tasks.workunit.client.0.smithi050.stdout:8/603: chown d3/d2a/d27/d93/d7f/d96/d46/fb2 3999 1 2023-01-04T18:17:05.989 INFO:tasks.workunit.client.0.smithi050.stdout:8/604: readlink d3/d2a/d27/d8b/ld4 0 2023-01-04T18:17:05.989 INFO:tasks.workunit.client.0.smithi050.stdout:3/552: unlink d0/d1b/d2f/d56/c37 0 2023-01-04T18:17:05.992 INFO:tasks.workunit.client.0.smithi050.stdout:4/521: mkdir d14/d1b/d1f/d22/d3e/d85/da6 0 2023-01-04T18:17:05.997 INFO:tasks.workunit.client.0.smithi050.stdout:8/605: mknod d3/d2a/d27/cd9 0 2023-01-04T18:17:05.999 INFO:tasks.workunit.client.0.smithi050.stdout:3/553: readlink d0/d1b/d2f/d56/d98/d9c/lb1 0 2023-01-04T18:17:06.003 INFO:tasks.workunit.client.0.smithi050.stdout:4/522: symlink d14/la7 0 2023-01-04T18:17:06.003 INFO:tasks.workunit.client.0.smithi050.stdout:4/523: fsync d14/f1a 0 2023-01-04T18:17:06.004 INFO:tasks.workunit.client.0.smithi050.stdout:1/520: dwrite d8/d48/d5c/d67/d3a/f79 [0,4194304] 0 2023-01-04T18:17:06.005 INFO:tasks.workunit.client.0.smithi050.stdout:9/503: dread d1/d12/d41/d60/f64 [0,4194304] 0 2023-01-04T18:17:06.008 INFO:tasks.workunit.client.0.smithi050.stdout:4/524: unlink f9 0 2023-01-04T18:17:06.011 INFO:tasks.workunit.client.0.smithi050.stdout:4/525: dread d14/f1a [0,4194304] 0 2023-01-04T18:17:06.012 INFO:tasks.workunit.client.0.smithi050.stdout:2/549: sync 2023-01-04T18:17:06.012 INFO:tasks.workunit.client.0.smithi050.stdout:0/462: sync 2023-01-04T18:17:06.012 INFO:tasks.workunit.client.0.smithi050.stdout:2/550: dread - d1/dd/d11/d14/d44/fb7 zero size 2023-01-04T18:17:06.014 INFO:tasks.workunit.client.0.smithi050.stdout:1/521: creat d8/d48/d5c/d67/d91/fa3 x:0 0 0 2023-01-04T18:17:06.015 INFO:tasks.workunit.client.0.smithi050.stdout:3/554: mkdir d0/d1b/d2f/d56/d98/dc7 0 2023-01-04T18:17:06.017 INFO:tasks.workunit.client.0.smithi050.stdout:8/606: dwrite d3/d2a/d30/d3b/d4d/d23/d55/d5f/f8a [0,4194304] 0 2023-01-04T18:17:06.018 INFO:tasks.workunit.client.0.smithi050.stdout:0/463: creat d0/d6/d8/d51/f8d x:0 0 0 2023-01-04T18:17:06.019 INFO:tasks.workunit.client.0.smithi050.stdout:0/464: write d0/d6/d8/d25/f8c [635470,99016] 0 2023-01-04T18:17:06.024 INFO:tasks.workunit.client.0.smithi050.stdout:1/522: creat d8/d48/d8c/d72/fa4 x:0 0 0 2023-01-04T18:17:06.024 INFO:tasks.workunit.client.0.smithi050.stdout:1/523: write d8/d48/d5c/f7c [972904,129699] 0 2023-01-04T18:17:06.027 INFO:tasks.workunit.client.0.smithi050.stdout:3/555: rename d0/d1b/d2f/d71/cb9 to d0/d1b/d2f/d56/d6b/d7f/cc8 0 2023-01-04T18:17:06.029 INFO:tasks.workunit.client.0.smithi050.stdout:4/526: dread d14/f65 [0,4194304] 0 2023-01-04T18:17:06.034 INFO:tasks.workunit.client.0.smithi050.stdout:9/504: dwrite d1/d3/d11/d1f/f4e [0,4194304] 0 2023-01-04T18:17:06.035 INFO:tasks.workunit.client.0.smithi050.stdout:2/551: dwrite d1/dd/d62/d69/f82 [0,4194304] 0 2023-01-04T18:17:06.039 INFO:tasks.workunit.client.0.smithi050.stdout:2/552: dread d1/dd/d11/f26 [0,4194304] 0 2023-01-04T18:17:06.040 INFO:tasks.workunit.client.0.smithi050.stdout:1/524: dread d8/f4d [4194304,4194304] 0 2023-01-04T18:17:06.098 INFO:tasks.workunit.client.0.smithi050.stdout:8/607: unlink d3/d2a/d30/d3b/d4d/d23/d31/f78 0 2023-01-04T18:17:06.098 INFO:tasks.workunit.client.0.smithi050.stdout:8/608: write d3/d2a/d27/d93/f7d [4444442,47717] 0 2023-01-04T18:17:06.099 INFO:tasks.workunit.client.0.smithi050.stdout:8/609: read d3/d2a/d27/f33 [2353114,82518] 0 2023-01-04T18:17:06.099 INFO:tasks.workunit.client.0.smithi050.stdout:8/610: write d3/d2a/d2d/f50 [903737,111495] 0 2023-01-04T18:17:06.099 INFO:tasks.workunit.client.0.smithi050.stdout:8/611: write d3/d2a/f9b [303348,18312] 0 2023-01-04T18:17:06.099 INFO:tasks.workunit.client.0.smithi050.stdout:8/612: read - d3/d2a/d74/d92/d94/d9c/fbc zero size 2023-01-04T18:17:06.102 INFO:tasks.workunit.client.0.smithi050.stdout:0/465: mkdir d0/d6/d8/d25/d8e 0 2023-01-04T18:17:06.107 INFO:tasks.workunit.client.0.smithi050.stdout:4/527: symlink d14/d1b/d1f/d22/d3e/d85/la8 0 2023-01-04T18:17:06.107 INFO:tasks.workunit.client.0.smithi050.stdout:4/528: truncate d14/f1a 2950074 0 2023-01-04T18:17:06.111 INFO:tasks.workunit.client.0.smithi050.stdout:9/505: rmdir d1/d3/d3b/d63 39 2023-01-04T18:17:06.120 INFO:tasks.workunit.client.0.smithi050.stdout:2/553: stat d1/dd/d11/d14/d91/l7c 0 2023-01-04T18:17:06.120 INFO:tasks.workunit.client.0.smithi050.stdout:2/554: stat d1/dd/d28/d2c/f2d 0 2023-01-04T18:17:06.121 INFO:tasks.workunit.client.0.smithi050.stdout:1/525: creat d8/d14/d1c/d28/d57/fa5 x:0 0 0 2023-01-04T18:17:06.155 INFO:tasks.workunit.client.0.smithi050.stdout:8/613: mknod d3/d2a/d27/d8b/d9f/cda 0 2023-01-04T18:17:06.157 INFO:tasks.workunit.client.0.smithi050.stdout:8/614: dread d3/d2a/d27/dc1/fc2 [0,4194304] 0 2023-01-04T18:17:06.159 INFO:tasks.workunit.client.0.smithi050.stdout:0/466: mknod d0/d73/d68/c8f 0 2023-01-04T18:17:06.160 INFO:tasks.workunit.client.0.smithi050.stdout:7/603: sync 2023-01-04T18:17:06.160 INFO:tasks.workunit.client.0.smithi050.stdout:6/517: sync 2023-01-04T18:17:06.160 INFO:tasks.workunit.client.0.smithi050.stdout:7/604: chown d6/d28/d3c/d42/d5f/fb1 31931356 1 2023-01-04T18:17:06.160 INFO:tasks.workunit.client.0.smithi050.stdout:7/605: fdatasync d6/d6b/d8b/f91 0 2023-01-04T18:17:06.160 INFO:tasks.workunit.client.0.smithi050.stdout:7/606: fsync d6/d28/d99/d7a/f8d 0 2023-01-04T18:17:06.161 INFO:tasks.workunit.client.0.smithi050.stdout:4/529: symlink d14/d1b/d1f/d22/d3e/d8a/la9 0 2023-01-04T18:17:06.165 INFO:tasks.workunit.client.0.smithi050.stdout:9/506: unlink d1/d3/d11/l6c 0 2023-01-04T18:17:06.166 INFO:tasks.workunit.client.0.smithi050.stdout:1/526: truncate d8/d14/d1c/d28/f3f 1001532 0 2023-01-04T18:17:06.173 INFO:tasks.workunit.client.0.smithi050.stdout:0/467: truncate d0/d6/d28/f49 3532669 0 2023-01-04T18:17:06.176 INFO:tasks.workunit.client.0.smithi050.stdout:7/607: creat d6/db/d20/d4f/d6e/fd0 x:0 0 0 2023-01-04T18:17:06.177 INFO:tasks.workunit.client.0.smithi050.stdout:9/507: symlink d1/d3/d13/l9d 0 2023-01-04T18:17:06.178 INFO:tasks.workunit.client.0.smithi050.stdout:9/508: stat d1/c37 0 2023-01-04T18:17:06.179 INFO:tasks.workunit.client.0.smithi050.stdout:0/468: mknod d0/d73/d68/c90 0 2023-01-04T18:17:06.189 INFO:tasks.workunit.client.0.smithi050.stdout:9/509: dread d1/d3/f18 [0,4194304] 0 2023-01-04T18:17:06.189 INFO:tasks.workunit.client.0.smithi050.stdout:9/510: rename d1/d12/d41/d60 to d1/d12/d41/d60/d95/d9e 22 2023-01-04T18:17:06.189 INFO:tasks.workunit.client.0.smithi050.stdout:9/511: write d1/d12/d41/d60/d95/f99 [4286012,74760] 0 2023-01-04T18:17:06.191 INFO:tasks.workunit.client.0.smithi050.stdout:8/615: dwrite d3/d2a/d30/d3b/d4d/fad [0,4194304] 0 2023-01-04T18:17:06.194 INFO:tasks.workunit.client.0.smithi050.stdout:4/530: dwrite f11 [0,4194304] 0 2023-01-04T18:17:06.194 INFO:tasks.workunit.client.0.smithi050.stdout:6/518: dwrite d0/d9/d38/f23 [0,4194304] 0 2023-01-04T18:17:06.195 INFO:tasks.workunit.client.0.smithi050.stdout:1/527: dwrite d8/d14/d1c/d28/f93 [0,4194304] 0 2023-01-04T18:17:06.195 INFO:tasks.workunit.client.0.smithi050.stdout:1/528: dread - d8/d14/d1c/f85 zero size 2023-01-04T18:17:06.195 INFO:tasks.workunit.client.0.smithi050.stdout:1/529: chown d8/d14/d1c/f73 13283061 1 2023-01-04T18:17:06.195 INFO:tasks.workunit.client.0.smithi050.stdout:8/616: mknod d3/d2a/d30/d3b/d4d/d23/d55/d5f/d82/dcb/cdb 0 2023-01-04T18:17:06.196 INFO:tasks.workunit.client.0.smithi050.stdout:0/469: dwrite d0/d6/d8/d51/f8d [0,4194304] 0 2023-01-04T18:17:06.200 INFO:tasks.workunit.client.0.smithi050.stdout:4/531: symlink d14/d1b/d1f/d22/d3e/laa 0 2023-01-04T18:17:06.202 INFO:tasks.workunit.client.0.smithi050.stdout:1/530: write d8/d48/d5c/d67/d3a/f79 [290027,52478] 0 2023-01-04T18:17:06.218 INFO:tasks.workunit.client.0.smithi050.stdout:8/617: dwrite d3/d2a/f89 [0,4194304] 0 2023-01-04T18:17:06.220 INFO:tasks.workunit.client.0.smithi050.stdout:9/512: dwrite d1/d3/f19 [0,4194304] 0 2023-01-04T18:17:06.234 INFO:tasks.workunit.client.0.smithi050.stdout:6/519: creat d0/d9/d38/d16/fa1 x:0 0 0 2023-01-04T18:17:06.235 INFO:tasks.workunit.client.0.smithi050.stdout:7/608: getdents d6/db/d20/d4f/d6e 0 2023-01-04T18:17:06.235 INFO:tasks.workunit.client.0.smithi050.stdout:7/609: chown d6/db/d15/d48/f57 0 1 2023-01-04T18:17:06.235 INFO:tasks.workunit.client.0.smithi050.stdout:7/610: readlink d6/db/d15/d48/l6c 0 2023-01-04T18:17:06.241 INFO:tasks.workunit.client.0.smithi050.stdout:4/532: truncate f5 5393030 0 2023-01-04T18:17:06.249 INFO:tasks.workunit.client.0.smithi050.stdout:1/531: symlink d8/d48/d5c/la6 0 2023-01-04T18:17:06.249 INFO:tasks.workunit.client.0.smithi050.stdout:1/532: stat d8/f4d 0 2023-01-04T18:17:06.249 INFO:tasks.workunit.client.0.smithi050.stdout:1/533: truncate d8/d48/d8c/d72/fa4 222244 0 2023-01-04T18:17:06.250 INFO:tasks.workunit.client.0.smithi050.stdout:9/513: dwrite d1/d12/d2d/f85 [0,4194304] 0 2023-01-04T18:17:06.251 INFO:tasks.workunit.client.0.smithi050.stdout:8/618: truncate d3/d2a/d74/fc7 1475239 0 2023-01-04T18:17:06.258 INFO:tasks.workunit.client.0.smithi050.stdout:1/534: dread d8/d14/d1c/d28/f93 [0,4194304] 0 2023-01-04T18:17:06.265 INFO:tasks.workunit.client.0.smithi050.stdout:6/520: creat d0/d9/d25/d2d/fa2 x:0 0 0 2023-01-04T18:17:06.269 INFO:tasks.workunit.client.0.smithi050.stdout:7/611: symlink d6/db/d20/d4f/d6e/ld1 0 2023-01-04T18:17:06.269 INFO:tasks.workunit.client.0.smithi050.stdout:7/612: chown d6/db/d15/d1b/d70/f85 304018504 1 2023-01-04T18:17:06.269 INFO:tasks.workunit.client.0.smithi050.stdout:7/613: dread - d6/db/d20/d55/f7f zero size 2023-01-04T18:17:06.271 INFO:tasks.workunit.client.0.smithi050.stdout:9/514: dwrite d1/d3/d11/f16 [0,4194304] 0 2023-01-04T18:17:06.273 INFO:tasks.workunit.client.0.smithi050.stdout:4/533: creat d14/d1b/d32/fab x:0 0 0 2023-01-04T18:17:06.281 INFO:tasks.workunit.client.0.smithi050.stdout:8/619: creat d3/d2a/d2d/fdc x:0 0 0 2023-01-04T18:17:06.284 INFO:tasks.workunit.client.0.smithi050.stdout:7/614: mkdir d6/db/d3a/dd2 0 2023-01-04T18:17:06.287 INFO:tasks.workunit.client.0.smithi050.stdout:8/620: creat d3/d2a/d30/d3b/d53/fdd x:0 0 0 2023-01-04T18:17:06.292 INFO:tasks.workunit.client.0.smithi050.stdout:8/621: creat d3/d2a/d74/d92/fde x:0 0 0 2023-01-04T18:17:06.296 INFO:tasks.workunit.client.0.smithi050.stdout:8/622: rename d3/d2a/l4e to d3/d2a/d30/d3b/d4d/ldf 0 2023-01-04T18:17:06.296 INFO:tasks.workunit.client.0.smithi050.stdout:8/623: fdatasync d3/d2a/d27/f33 0 2023-01-04T18:17:06.298 INFO:tasks.workunit.client.0.smithi050.stdout:8/624: readlink d3/d2a/d27/d93/d7f/d96/l6b 0 2023-01-04T18:17:06.301 INFO:tasks.workunit.client.0.smithi050.stdout:5/684: sync 2023-01-04T18:17:06.307 INFO:tasks.workunit.client.0.smithi050.stdout:5/685: dread d13/d15/d66/db8/d1f/d35/d42/d4a/f64 [0,4194304] 0 2023-01-04T18:17:06.330 INFO:tasks.workunit.client.0.smithi050.stdout:6/521: dwrite d0/d9/d38/d1c/f26 [0,4194304] 0 2023-01-04T18:17:06.332 INFO:tasks.workunit.client.0.smithi050.stdout:1/535: dwrite d8/d48/d5c/f6c [0,4194304] 0 2023-01-04T18:17:06.332 INFO:tasks.workunit.client.0.smithi050.stdout:1/536: dread - d8/d14/d1c/f85 zero size 2023-01-04T18:17:06.332 INFO:tasks.workunit.client.0.smithi050.stdout:1/537: chown d8/c17 14569 1 2023-01-04T18:17:06.332 INFO:tasks.workunit.client.0.smithi050.stdout:1/538: dread - d8/d14/d1c/d28/d57/d6a/f7d zero size 2023-01-04T18:17:06.332 INFO:tasks.workunit.client.0.smithi050.stdout:9/515: dwrite d1/d3/f18 [0,4194304] 0 2023-01-04T18:17:06.333 INFO:tasks.workunit.client.0.smithi050.stdout:5/686: dwrite d13/d28/d7c/ff0 [0,4194304] 0 2023-01-04T18:17:06.333 INFO:tasks.workunit.client.0.smithi050.stdout:8/625: dwrite d3/d2a/d27/d93/fce [0,4194304] 0 2023-01-04T18:17:06.333 INFO:tasks.workunit.client.0.smithi050.stdout:7/615: dwrite d6/f23 [0,4194304] 0 2023-01-04T18:17:06.337 INFO:tasks.workunit.client.0.smithi050.stdout:4/534: dwrite d14/d1b/d1f/d63/f71 [0,4194304] 0 2023-01-04T18:17:06.337 INFO:tasks.workunit.client.0.smithi050.stdout:4/535: write d14/d1b/f1e [1022818,70631] 0 2023-01-04T18:17:06.337 INFO:tasks.workunit.client.0.smithi050.stdout:4/536: stat d14/d1b/d1f/d22/d3e/d44/d59/d5f/d6f 0 2023-01-04T18:17:06.341 INFO:tasks.workunit.client.0.smithi050.stdout:8/626: dread d3/d2a/d30/f3f [0,4194304] 0 2023-01-04T18:17:06.342 INFO:tasks.workunit.client.0.smithi050.stdout:8/627: stat d3 0 2023-01-04T18:17:06.343 INFO:tasks.workunit.client.0.smithi050.stdout:6/522: dread d0/d9/df/f30 [0,4194304] 0 2023-01-04T18:17:06.343 INFO:tasks.workunit.client.0.smithi050.stdout:6/523: fdatasync d0/d9/d38/d60/f80 0 2023-01-04T18:17:06.348 INFO:tasks.workunit.client.0.smithi050.stdout:9/516: mkdir d1/d12/d9f 0 2023-01-04T18:17:06.354 INFO:tasks.workunit.client.0.smithi050.stdout:7/616: link d6/d28/d32/c34 d6/db/d15/d2e/d66/cd3 0 2023-01-04T18:17:06.357 INFO:tasks.workunit.client.0.smithi050.stdout:1/539: dwrite d8/d14/f5b [0,4194304] 0 2023-01-04T18:17:06.357 INFO:tasks.workunit.client.0.smithi050.stdout:5/687: dwrite d13/f14 [4194304,4194304] 0 2023-01-04T18:17:06.357 INFO:tasks.workunit.client.0.smithi050.stdout:5/688: chown d13/d15/d66/db8/d1f/d35/d59/d87/c8a 284 1 2023-01-04T18:17:06.357 INFO:tasks.workunit.client.0.smithi050.stdout:4/537: mknod d14/d1b/d1f/d63/da5/cac 0 2023-01-04T18:17:06.357 INFO:tasks.workunit.client.0.smithi050.stdout:7/617: read d6/db/d15/d1b/d5b/fce [2432553,65275] 0 2023-01-04T18:17:06.359 INFO:tasks.workunit.client.0.smithi050.stdout:2/555: sync 2023-01-04T18:17:06.359 INFO:tasks.workunit.client.0.smithi050.stdout:3/556: sync 2023-01-04T18:17:06.364 INFO:tasks.workunit.client.0.smithi050.stdout:8/628: creat d3/d2a/d27/d93/d7a/fe0 x:0 0 0 2023-01-04T18:17:06.364 INFO:tasks.workunit.client.0.smithi050.stdout:6/524: mkdir d0/d9/df/da3 0 2023-01-04T18:17:06.366 INFO:tasks.workunit.client.0.smithi050.stdout:9/517: truncate d1/d12/f22 3732668 0 2023-01-04T18:17:06.372 INFO:tasks.workunit.client.0.smithi050.stdout:1/540: symlink d8/d48/d8c/la7 0 2023-01-04T18:17:06.374 INFO:tasks.workunit.client.0.smithi050.stdout:2/556: dread d1/dd/d62/da1/d83/fa6 [0,4194304] 0 2023-01-04T18:17:06.375 INFO:tasks.workunit.client.0.smithi050.stdout:1/541: write d8/d48/d5c/d67/d3a/f70 [3127715,76790] 0 2023-01-04T18:17:06.376 INFO:tasks.workunit.client.0.smithi050.stdout:0/470: sync 2023-01-04T18:17:06.377 INFO:tasks.workunit.client.0.smithi050.stdout:4/538: dwrite d14/f31 [0,4194304] 0 2023-01-04T18:17:06.378 INFO:tasks.workunit.client.0.smithi050.stdout:5/689: creat d13/d28/d7c/d83/ff7 x:0 0 0 2023-01-04T18:17:06.378 INFO:tasks.workunit.client.0.smithi050.stdout:5/690: read - d13/d15/d66/db8/d27/d44/f9c zero size 2023-01-04T18:17:06.378 INFO:tasks.workunit.client.0.smithi050.stdout:7/618: creat d6/d28/fd4 x:0 0 0 2023-01-04T18:17:06.380 INFO:tasks.workunit.client.0.smithi050.stdout:2/557: dread d1/dd/d11/d12/f4d [0,4194304] 0 2023-01-04T18:17:06.380 INFO:tasks.workunit.client.0.smithi050.stdout:2/558: write d1/dd/d62/da1/d6e/fad [4952929,102229] 0 2023-01-04T18:17:06.382 INFO:tasks.workunit.client.0.smithi050.stdout:3/557: mkdir d0/d1b/d2f/d56/d98/d9c/dc9 0 2023-01-04T18:17:06.382 INFO:tasks.workunit.client.0.smithi050.stdout:3/558: readlink d0/dd/l38 0 2023-01-04T18:17:06.383 INFO:tasks.workunit.client.0.smithi050.stdout:0/471: dread d0/d6/f3c [0,4194304] 0 2023-01-04T18:17:06.384 INFO:tasks.workunit.client.0.smithi050.stdout:0/472: read d0/d6/d8/d51/f50 [638742,55706] 0 2023-01-04T18:17:06.384 INFO:tasks.workunit.client.0.smithi050.stdout:8/629: unlink d3/fb9 0 2023-01-04T18:17:06.387 INFO:tasks.workunit.client.0.smithi050.stdout:6/525: truncate d0/d9/f4b 3122854 0 2023-01-04T18:17:06.389 INFO:tasks.workunit.client.0.smithi050.stdout:9/518: truncate d1/d3/d3b/f27 4428698 0 2023-01-04T18:17:06.396 INFO:tasks.workunit.client.0.smithi050.stdout:1/542: link d8/d14/d1c/f85 d8/d14/fa8 0 2023-01-04T18:17:06.398 INFO:tasks.workunit.client.0.smithi050.stdout:4/539: creat d14/d1b/d1f/d63/fad x:0 0 0 2023-01-04T18:17:06.401 INFO:tasks.workunit.client.0.smithi050.stdout:5/691: getdents d13/d15/d66/db8/d27/d46/d4e/d4d 0 2023-01-04T18:17:06.401 INFO:tasks.workunit.client.0.smithi050.stdout:0/473: dwrite d0/f6d [0,4194304] 0 2023-01-04T18:17:06.402 INFO:tasks.workunit.client.0.smithi050.stdout:7/619: truncate d6/db/d15/f16 4077828 0 2023-01-04T18:17:06.408 INFO:tasks.workunit.client.0.smithi050.stdout:3/559: mkdir d0/d8f/d46/d80/dca 0 2023-01-04T18:17:06.408 INFO:tasks.workunit.client.0.smithi050.stdout:3/560: write d0/dd/f6c [544087,66528] 0 2023-01-04T18:17:06.410 INFO:tasks.workunit.client.0.smithi050.stdout:8/630: symlink d3/d2a/d74/d92/d94/dc9/le1 0 2023-01-04T18:17:06.410 INFO:tasks.workunit.client.0.smithi050.stdout:8/631: chown d3/d2a/d27/d93/d7a 777707 1 2023-01-04T18:17:06.411 INFO:tasks.workunit.client.0.smithi050.stdout:1/543: unlink d8/d48/f83 0 2023-01-04T18:17:06.413 INFO:tasks.workunit.client.0.smithi050.stdout:4/540: creat d14/d1b/d1f/d22/fae x:0 0 0 2023-01-04T18:17:06.413 INFO:tasks.workunit.client.0.smithi050.stdout:4/541: chown d14/d1b/d66 0 1 2023-01-04T18:17:06.413 INFO:tasks.workunit.client.0.smithi050.stdout:4/542: chown d14/d1b/d1f/d22/d3e 60 1 2023-01-04T18:17:06.413 INFO:tasks.workunit.client.0.smithi050.stdout:4/543: dread - d14/d1b/d1f/d22/d6a/f92 zero size 2023-01-04T18:17:06.413 INFO:tasks.workunit.client.0.smithi050.stdout:4/544: stat d14/d1b 0 2023-01-04T18:17:06.413 INFO:tasks.workunit.client.0.smithi050.stdout:4/545: chown d14/d1b/d1f/c47 243680374 1 2023-01-04T18:17:06.413 INFO:tasks.workunit.client.0.smithi050.stdout:4/546: fsync d14/d1b/d1f/d22/d6a/f9b 0 2023-01-04T18:17:06.417 INFO:tasks.workunit.client.0.smithi050.stdout:5/692: rename d13/d15/d66/db8/d27/d46/d4e/d4d/deb to d13/d15/d66/db8/d27/dca/dd3/df8 0 2023-01-04T18:17:06.417 INFO:tasks.workunit.client.0.smithi050.stdout:6/526: dwrite d0/d9/d38/d1c/f9b [0,4194304] 0 2023-01-04T18:17:06.418 INFO:tasks.workunit.client.0.smithi050.stdout:2/559: link d1/dd/d11/d12/f4d d1/dd/d38/fb9 0 2023-01-04T18:17:06.418 INFO:tasks.workunit.client.0.smithi050.stdout:2/560: chown d1/dd/d28/d2c/d2e/d3f 1686477140 1 2023-01-04T18:17:06.418 INFO:tasks.workunit.client.0.smithi050.stdout:2/561: write d1/dd/d11/d14/d91/f9d [361997,85759] 0 2023-01-04T18:17:06.419 INFO:tasks.workunit.client.0.smithi050.stdout:9/519: dread d1/d3/d3b/d63/f1c [0,4194304] 0 2023-01-04T18:17:06.419 INFO:tasks.workunit.client.0.smithi050.stdout:9/520: write d1/d3/d11/f43 [590916,21854] 0 2023-01-04T18:17:06.420 INFO:tasks.workunit.client.0.smithi050.stdout:1/544: write d8/d14/f35 [3315654,89905] 0 2023-01-04T18:17:06.420 INFO:tasks.workunit.client.0.smithi050.stdout:8/632: truncate d3/d2a/d30/d3b/d53/f54 1451269 0 2023-01-04T18:17:06.420 INFO:tasks.workunit.client.0.smithi050.stdout:8/633: chown d3/d2a/d27/d93/d7f/d96/d46/fb2 192 1 2023-01-04T18:17:06.422 INFO:tasks.workunit.client.0.smithi050.stdout:0/474: rename d0/d6/d8/d51/c5b to d0/d6/d28/c91 0 2023-01-04T18:17:06.424 INFO:tasks.workunit.client.0.smithi050.stdout:6/527: rmdir d0/d9/df/da3 0 2023-01-04T18:17:06.425 INFO:tasks.workunit.client.0.smithi050.stdout:9/521: dread d1/d3/d3b/f27 [0,4194304] 0 2023-01-04T18:17:06.429 INFO:tasks.workunit.client.0.smithi050.stdout:2/562: creat d1/dd/d62/da1/d83/fba x:0 0 0 2023-01-04T18:17:06.429 INFO:tasks.workunit.client.0.smithi050.stdout:0/475: dread d0/f59 [0,4194304] 0 2023-01-04T18:17:06.429 INFO:tasks.workunit.client.0.smithi050.stdout:3/561: dread d0/d1b/d2f/d56/f53 [0,4194304] 0 2023-01-04T18:17:06.432 INFO:tasks.workunit.client.0.smithi050.stdout:4/547: dwrite d14/d1b/d1f/d22/f7c [0,4194304] 0 2023-01-04T18:17:06.432 INFO:tasks.workunit.client.0.smithi050.stdout:4/548: chown d14/d1b/d1f/d22/d3e/d44/d59/d5f/c9a 149381 1 2023-01-04T18:17:06.440 INFO:tasks.workunit.client.0.smithi050.stdout:9/522: dread d1/d3/f18 [0,4194304] 0 2023-01-04T18:17:06.440 INFO:tasks.workunit.client.0.smithi050.stdout:1/545: creat d8/d48/d5c/d67/fa9 x:0 0 0 2023-01-04T18:17:06.440 INFO:tasks.workunit.client.0.smithi050.stdout:6/528: dwrite d0/d9/d25/d4d/f66 [0,4194304] 0 2023-01-04T18:17:06.440 INFO:tasks.workunit.client.0.smithi050.stdout:8/634: creat d3/d2a/d30/fe2 x:0 0 0 2023-01-04T18:17:06.440 INFO:tasks.workunit.client.0.smithi050.stdout:8/635: fsync d3/d2a/d30/d3b/d4d/f88 0 2023-01-04T18:17:06.441 INFO:tasks.workunit.client.0.smithi050.stdout:7/620: rename d6/db/d3a/cbe to d6/d28/d32/cd5 0 2023-01-04T18:17:06.441 INFO:tasks.workunit.client.0.smithi050.stdout:7/621: chown d6/db/d15/f9b 4 1 2023-01-04T18:17:06.441 INFO:tasks.workunit.client.0.smithi050.stdout:7/622: stat d6/d6b 0 2023-01-04T18:17:06.447 INFO:tasks.workunit.client.0.smithi050.stdout:2/563: truncate d1/dd/d28/d2c/f2d 935172 0 2023-01-04T18:17:06.450 INFO:tasks.workunit.client.0.smithi050.stdout:0/476: symlink d0/d73/d68/d7a/d84/l92 0 2023-01-04T18:17:06.450 INFO:tasks.workunit.client.0.smithi050.stdout:2/564: dread d1/dd/d62/da1/f7d [0,4194304] 0 2023-01-04T18:17:06.451 INFO:tasks.workunit.client.0.smithi050.stdout:9/523: creat d1/d12/d9f/fa0 x:0 0 0 2023-01-04T18:17:06.458 INFO:tasks.workunit.client.0.smithi050.stdout:1/546: rmdir d8/d48/d5c/d67 39 2023-01-04T18:17:06.458 INFO:tasks.workunit.client.0.smithi050.stdout:1/547: read d8/d48/d5c/d67/d3b/f68 [4402650,35966] 0 2023-01-04T18:17:06.462 INFO:tasks.workunit.client.0.smithi050.stdout:1/548: dread d8/d14/d1c/d28/f59 [0,4194304] 0 2023-01-04T18:17:06.466 INFO:tasks.workunit.client.0.smithi050.stdout:6/529: mkdir d0/d9/d38/d16/d6b/da4 0 2023-01-04T18:17:06.466 INFO:tasks.workunit.client.0.smithi050.stdout:5/693: rename d13/d15/d66/db8/d27/da8 to d13/d15/d66/db8/d27/dc3/df9 0 2023-01-04T18:17:06.467 INFO:tasks.workunit.client.0.smithi050.stdout:7/623: unlink d6/d28/d32/c4d 0 2023-01-04T18:17:06.470 INFO:tasks.workunit.client.0.smithi050.stdout:0/477: mknod d0/d6/d8/d25/c93 0 2023-01-04T18:17:06.472 INFO:tasks.workunit.client.0.smithi050.stdout:0/478: read d0/d6/d28/d1a/f30 [818450,20766] 0 2023-01-04T18:17:06.474 INFO:tasks.workunit.client.0.smithi050.stdout:9/524: creat d1/d3/d11/fa1 x:0 0 0 2023-01-04T18:17:06.474 INFO:tasks.workunit.client.0.smithi050.stdout:9/525: getdents d1/d3/d24/d97 0 2023-01-04T18:17:06.475 INFO:tasks.workunit.client.0.smithi050.stdout:8/636: dwrite d3/d2a/d60/f40 [0,4194304] 0 2023-01-04T18:17:06.475 INFO:tasks.workunit.client.0.smithi050.stdout:8/637: write d3/d2a/d30/d3b/d53/fca [678566,53093] 0 2023-01-04T18:17:06.475 INFO:tasks.workunit.client.0.smithi050.stdout:8/638: write d3/d2a/d30/d3b/d4d/d23/d55/f57 [748431,85213] 0 2023-01-04T18:17:06.476 INFO:tasks.workunit.client.0.smithi050.stdout:3/562: dwrite d0/d1a/f24 [0,4194304] 0 2023-01-04T18:17:06.476 INFO:tasks.workunit.client.0.smithi050.stdout:3/563: chown d0/d1b/l52 151492449 1 2023-01-04T18:17:06.476 INFO:tasks.workunit.client.0.smithi050.stdout:3/564: write d0/f2c [1690671,84522] 0 2023-01-04T18:17:06.478 INFO:tasks.workunit.client.0.smithi050.stdout:1/549: symlink d8/d48/d5c/d67/d3a/d31/laa 0 2023-01-04T18:17:06.478 INFO:tasks.workunit.client.0.smithi050.stdout:1/550: truncate d8/f6f 670056 0 2023-01-04T18:17:06.479 INFO:tasks.workunit.client.0.smithi050.stdout:2/565: dread d1/dd/f3a [0,4194304] 0 2023-01-04T18:17:06.480 INFO:tasks.workunit.client.0.smithi050.stdout:4/549: rename d14/d1b/d66/c88 to d14/d1b/d1f/d22/d3e/d44/d59/d5d/d7f/caf 0 2023-01-04T18:17:06.480 INFO:tasks.workunit.client.0.smithi050.stdout:4/550: write d14/d1b/d1f/d63/fad [54393,120161] 0 2023-01-04T18:17:06.482 INFO:tasks.workunit.client.0.smithi050.stdout:6/530: mkdir d0/d9/d38/d16/da5 0 2023-01-04T18:17:06.489 INFO:tasks.workunit.client.0.smithi050.stdout:5/694: truncate d13/d15/d66/db8/d1f/d35/d42/d4a/f64 2365178 0 2023-01-04T18:17:06.490 INFO:tasks.workunit.client.0.smithi050.stdout:5/695: dread - d13/d15/d66/db8/d1f/d35/d42/fc2 zero size 2023-01-04T18:17:06.490 INFO:tasks.workunit.client.0.smithi050.stdout:7/624: creat d6/db/d20/d55/fd6 x:0 0 0 2023-01-04T18:17:06.494 INFO:tasks.workunit.client.0.smithi050.stdout:1/551: dread d8/f13 [0,4194304] 0 2023-01-04T18:17:06.497 INFO:tasks.workunit.client.0.smithi050.stdout:9/526: getdents d1/d12/d41/d60 0 2023-01-04T18:17:06.497 INFO:tasks.workunit.client.0.smithi050.stdout:9/527: chown d1/d3/d24/d7b/f91 58 1 2023-01-04T18:17:06.497 INFO:tasks.workunit.client.0.smithi050.stdout:8/639: getdents d3/d2a/d30 0 2023-01-04T18:17:06.497 INFO:tasks.workunit.client.0.smithi050.stdout:8/640: getdents d3/d2a/d30 0 2023-01-04T18:17:06.497 INFO:tasks.workunit.client.0.smithi050.stdout:3/565: mkdir d0/d1b/d2f/d56/d6b/dcb 0 2023-01-04T18:17:06.497 INFO:tasks.workunit.client.0.smithi050.stdout:9/528: write d1/d3/d11/d1f/f5b [4856976,69902] 0 2023-01-04T18:17:06.498 INFO:tasks.workunit.client.0.smithi050.stdout:3/566: dread - d0/dd/d45/f95 zero size 2023-01-04T18:17:06.498 INFO:tasks.workunit.client.0.smithi050.stdout:2/566: mkdir d1/dd/d62/da1/d6e/dbb 0 2023-01-04T18:17:06.498 INFO:tasks.workunit.client.0.smithi050.stdout:6/531: dwrite d0/d9/f4b [0,4194304] 0 2023-01-04T18:17:06.570 INFO:tasks.workunit.client.0.smithi050.stdout:0/479: rename d0/d6/d28/c91 to d0/d6/d8/d25/d8e/c94 0 2023-01-04T18:17:06.571 INFO:tasks.workunit.client.0.smithi050.stdout:4/551: symlink d14/d9e/lb0 0 2023-01-04T18:17:06.571 INFO:tasks.workunit.client.0.smithi050.stdout:4/552: fsync d14/d1b/d1f/d22/d3e/fa4 0 2023-01-04T18:17:06.572 INFO:tasks.workunit.client.0.smithi050.stdout:0/480: dread d0/d6/f55 [0,4194304] 0 2023-01-04T18:17:06.573 INFO:tasks.workunit.client.0.smithi050.stdout:1/552: mknod d8/d14/d1c/d28/d57/d6a/cab 0 2023-01-04T18:17:06.573 INFO:tasks.workunit.client.0.smithi050.stdout:1/553: stat d8/d48/d5c/d67/d3a/d31/d7f 0 2023-01-04T18:17:06.575 INFO:tasks.workunit.client.0.smithi050.stdout:9/529: creat d1/d12/d41/d60/fa2 x:0 0 0 2023-01-04T18:17:06.662 INFO:tasks.workunit.client.0.smithi050.stdout:3/567: creat d0/d1b/d2f/d56/d6b/fcc x:0 0 0 2023-01-04T18:17:06.669 INFO:tasks.workunit.client.0.smithi050.stdout:6/532: creat d0/d71/fa6 x:0 0 0 2023-01-04T18:17:06.669 INFO:tasks.workunit.client.0.smithi050.stdout:6/533: write d0/d71/fa6 [14556,6066] 0 2023-01-04T18:17:06.669 INFO:tasks.workunit.client.0.smithi050.stdout:6/534: write d0/d9/d38/d16/f37 [1346492,64318] 0 2023-01-04T18:17:06.675 INFO:tasks.workunit.client.0.smithi050.stdout:6/535: dread d0/d9/f17 [0,4194304] 0 2023-01-04T18:17:06.689 INFO:tasks.workunit.client.0.smithi050.stdout:7/625: rename d6/d28/d3c to d6/d28/d99/dd7 0 2023-01-04T18:17:06.690 INFO:tasks.workunit.client.0.smithi050.stdout:7/626: fsync d6/db/d15/d48/f57 0 2023-01-04T18:17:06.690 INFO:tasks.workunit.client.0.smithi050.stdout:7/627: chown d6/db/d20 3 1 2023-01-04T18:17:06.690 INFO:tasks.workunit.client.0.smithi050.stdout:7/628: read - d6/f7c zero size 2023-01-04T18:17:06.696 INFO:tasks.workunit.client.0.smithi050.stdout:4/553: rmdir d14/d1b/d1f/d22/d3e/d44/d59/d5f/d80 39 2023-01-04T18:17:06.699 INFO:tasks.workunit.client.0.smithi050.stdout:1/554: mkdir d8/d48/dac 0 2023-01-04T18:17:06.699 INFO:tasks.workunit.client.0.smithi050.stdout:1/555: write d8/f60 [4999564,78179] 0 2023-01-04T18:17:06.699 INFO:tasks.workunit.client.0.smithi050.stdout:1/556: stat d8/d48/d8c/c9e 0 2023-01-04T18:17:06.699 INFO:tasks.workunit.client.0.smithi050.stdout:3/568: fdatasync d0/d1a/f4e 0 2023-01-04T18:17:06.701 INFO:tasks.workunit.client.0.smithi050.stdout:1/557: dread d8/d14/d1c/d28/f3f [0,4194304] 0 2023-01-04T18:17:06.704 INFO:tasks.workunit.client.0.smithi050.stdout:6/536: creat d0/fa7 x:0 0 0 2023-01-04T18:17:06.704 INFO:tasks.workunit.client.0.smithi050.stdout:6/537: write d0/d9/f4b [4940561,84290] 0 2023-01-04T18:17:06.705 INFO:tasks.workunit.client.0.smithi050.stdout:9/530: rename d1/d3/d11/fa1 to d1/d12/d41/fa3 0 2023-01-04T18:17:06.707 INFO:tasks.workunit.client.0.smithi050.stdout:7/629: truncate d6/d28/d99/f64 629032 0 2023-01-04T18:17:06.707 INFO:tasks.workunit.client.0.smithi050.stdout:7/630: chown d6/db/d20/d4f/d6e 94049 1 2023-01-04T18:17:06.708 INFO:tasks.workunit.client.0.smithi050.stdout:4/554: creat d14/d1b/d1f/d22/d3e/d44/d59/d5f/fb1 x:0 0 0 2023-01-04T18:17:06.710 INFO:tasks.workunit.client.0.smithi050.stdout:3/569: unlink d0/f3 0 2023-01-04T18:17:06.713 INFO:tasks.workunit.client.0.smithi050.stdout:1/558: mknod d8/d48/d5c/d67/d91/cad 0 2023-01-04T18:17:06.713 INFO:tasks.workunit.client.0.smithi050.stdout:1/559: chown d8/f12 15 1 2023-01-04T18:17:06.715 INFO:tasks.workunit.client.0.smithi050.stdout:6/538: creat d0/d4a/d93/fa8 x:0 0 0 2023-01-04T18:17:06.715 INFO:tasks.workunit.client.0.smithi050.stdout:6/539: write d0/d9/d25/f39 [4388119,66931] 0 2023-01-04T18:17:06.715 INFO:tasks.workunit.client.0.smithi050.stdout:6/540: read d0/d9/d25/f3a [688831,101839] 0 2023-01-04T18:17:06.719 INFO:tasks.workunit.client.0.smithi050.stdout:4/555: dread d14/f1c [4194304,4194304] 0 2023-01-04T18:17:06.722 INFO:tasks.workunit.client.0.smithi050.stdout:6/541: write d0/d9/d38/d1c/f9b [2896747,5877] 0 2023-01-04T18:17:06.722 INFO:tasks.workunit.client.0.smithi050.stdout:6/542: chown d0/d4a/l50 3 1 2023-01-04T18:17:06.722 INFO:tasks.workunit.client.0.smithi050.stdout:9/531: rename d1/d12/l84 to d1/d12/d3f/la4 0 2023-01-04T18:17:06.723 INFO:tasks.workunit.client.0.smithi050.stdout:9/532: fdatasync d1/d12/d2d/d39/f82 0 2023-01-04T18:17:06.730 INFO:tasks.workunit.client.0.smithi050.stdout:9/533: symlink d1/d3/d3b/la5 0 2023-01-04T18:17:06.730 INFO:tasks.workunit.client.0.smithi050.stdout:9/534: chown d1/d12/d41 75829 1 2023-01-04T18:17:06.731 INFO:tasks.workunit.client.0.smithi050.stdout:7/631: dread d6/d6b/d8b/f91 [0,4194304] 0 2023-01-04T18:17:06.734 INFO:tasks.workunit.client.0.smithi050.stdout:7/632: symlink d6/db/d20/ld8 0 2023-01-04T18:17:06.739 INFO:tasks.workunit.client.0.smithi050.stdout:7/633: rename d6/d28/d99/d7a/fa9 to d6/d6b/d8b/fd9 0 2023-01-04T18:17:06.741 INFO:tasks.workunit.client.0.smithi050.stdout:7/634: read d6/f23 [594978,32148] 0 2023-01-04T18:17:06.743 INFO:tasks.workunit.client.0.smithi050.stdout:7/635: mkdir d6/db/d15/d1b/d5b/dda 0 2023-01-04T18:17:06.750 INFO:tasks.workunit.client.0.smithi050.stdout:4/556: dwrite d14/d1b/d1f/d22/d3e/d8a/f89 [0,4194304] 0 2023-01-04T18:17:06.751 INFO:tasks.workunit.client.0.smithi050.stdout:6/543: dwrite d0/d9/d25/d4d/f66 [0,4194304] 0 2023-01-04T18:17:06.752 INFO:tasks.workunit.client.0.smithi050.stdout:9/535: dwrite d1/d12/d41/d60/d95/f99 [4194304,4194304] 0 2023-01-04T18:17:06.752 INFO:tasks.workunit.client.0.smithi050.stdout:1/560: dwrite d8/d48/d5c/d67/d3a/f70 [0,4194304] 0 2023-01-04T18:17:06.754 INFO:tasks.workunit.client.0.smithi050.stdout:4/557: rmdir d14/d1b/d1f/d22/d3e/d44/d59/d5d 39 2023-01-04T18:17:06.754 INFO:tasks.workunit.client.0.smithi050.stdout:4/558: fsync d14/f15 0 2023-01-04T18:17:06.756 INFO:tasks.workunit.client.0.smithi050.stdout:6/544: truncate d0/d9/df/f56 841432 0 2023-01-04T18:17:06.761 INFO:tasks.workunit.client.0.smithi050.stdout:0/481: sync 2023-01-04T18:17:06.761 INFO:tasks.workunit.client.0.smithi050.stdout:5/696: sync 2023-01-04T18:17:06.761 INFO:tasks.workunit.client.0.smithi050.stdout:2/567: sync 2023-01-04T18:17:06.761 INFO:tasks.workunit.client.0.smithi050.stdout:8/641: sync 2023-01-04T18:17:06.761 INFO:tasks.workunit.client.0.smithi050.stdout:8/642: fdatasync d3/d2a/d2d/f66 0 2023-01-04T18:17:06.762 INFO:tasks.workunit.client.0.smithi050.stdout:2/568: read d1/dd/d38/fb9 [2416104,82749] 0 2023-01-04T18:17:06.762 INFO:tasks.workunit.client.0.smithi050.stdout:2/569: chown d1/dd/d28/d2c/d66/f95 486998 1 2023-01-04T18:17:06.762 INFO:tasks.workunit.client.0.smithi050.stdout:2/570: chown d1/dd/d11/db5/d99/ca4 3237 1 2023-01-04T18:17:06.762 INFO:tasks.workunit.client.0.smithi050.stdout:5/697: write d13/d28/d7c/ff0 [1627046,36054] 0 2023-01-04T18:17:06.765 INFO:tasks.workunit.client.0.smithi050.stdout:7/636: dwrite d6/fbf [0,4194304] 0 2023-01-04T18:17:06.765 INFO:tasks.workunit.client.0.smithi050.stdout:7/637: chown d6/d28/d99/dd7/l45 192 1 2023-01-04T18:17:06.765 INFO:tasks.workunit.client.0.smithi050.stdout:9/536: rename d1/d6f/f98 to d1/d3/d24/fa6 0 2023-01-04T18:17:06.765 INFO:tasks.workunit.client.0.smithi050.stdout:9/537: readlink d1/d12/l5a 0 2023-01-04T18:17:06.765 INFO:tasks.workunit.client.0.smithi050.stdout:9/538: chown d1/c20 9081065 1 2023-01-04T18:17:06.766 INFO:tasks.workunit.client.0.smithi050.stdout:4/559: dread d14/d1b/f41 [0,4194304] 0 2023-01-04T18:17:06.771 INFO:tasks.workunit.client.0.smithi050.stdout:6/545: symlink d0/d4a/la9 0 2023-01-04T18:17:06.771 INFO:tasks.workunit.client.0.smithi050.stdout:0/482: symlink d0/d6/d8/l95 0 2023-01-04T18:17:06.776 INFO:tasks.workunit.client.0.smithi050.stdout:8/643: creat d3/d2a/d60/d2c/fe3 x:0 0 0 2023-01-04T18:17:06.777 INFO:tasks.workunit.client.0.smithi050.stdout:5/698: mknod d13/d15/d66/db8/d27/d44/cfa 0 2023-01-04T18:17:06.777 INFO:tasks.workunit.client.0.smithi050.stdout:8/644: dread d3/d2a/d30/d3b/d53/fca [0,4194304] 0 2023-01-04T18:17:06.785 INFO:tasks.workunit.client.0.smithi050.stdout:7/638: creat d6/d1d/d1f/fdb x:0 0 0 2023-01-04T18:17:06.785 INFO:tasks.workunit.client.0.smithi050.stdout:7/639: chown d6/db/d15/d2e/f5d 7834551 1 2023-01-04T18:17:06.786 INFO:tasks.workunit.client.0.smithi050.stdout:7/640: dread d6/db/d3a/f84 [0,4194304] 0 2023-01-04T18:17:06.787 INFO:tasks.workunit.client.0.smithi050.stdout:1/561: rename d8/d14/d1c/d28/fa0 to d8/d14/d1c/d28/d57/d6a/d92/fae 0 2023-01-04T18:17:06.788 INFO:tasks.workunit.client.0.smithi050.stdout:9/539: symlink d1/d3/d13/d77/la7 0 2023-01-04T18:17:06.789 INFO:tasks.workunit.client.0.smithi050.stdout:4/560: unlink d14/d1b/d1f/d63/da5/cac 0 2023-01-04T18:17:06.789 INFO:tasks.workunit.client.0.smithi050.stdout:4/561: write d14/f84 [830954,125685] 0 2023-01-04T18:17:06.790 INFO:tasks.workunit.client.0.smithi050.stdout:4/562: chown fd 0 1 2023-01-04T18:17:06.791 INFO:tasks.workunit.client.0.smithi050.stdout:6/546: getdents d0/d9/d38 0 2023-01-04T18:17:06.791 INFO:tasks.workunit.client.0.smithi050.stdout:6/547: chown d0/d5c/c97 10760 1 2023-01-04T18:17:06.792 INFO:tasks.workunit.client.0.smithi050.stdout:6/548: write d0/d9/d38/f5b [2925733,11019] 0 2023-01-04T18:17:06.792 INFO:tasks.workunit.client.0.smithi050.stdout:0/483: creat d0/d73/d68/d7a/f96 x:0 0 0 2023-01-04T18:17:06.793 INFO:tasks.workunit.client.0.smithi050.stdout:5/699: mknod d13/d15/d66/cfb 0 2023-01-04T18:17:06.794 INFO:tasks.workunit.client.0.smithi050.stdout:5/700: write d13/d15/d66/db8/d1f/d35/d59/d87/f89 [975818,28773] 0 2023-01-04T18:17:06.794 INFO:tasks.workunit.client.0.smithi050.stdout:5/701: read d13/d15/d66/db8/d27/dca/dd3/fe1 [214985,74088] 0 2023-01-04T18:17:06.796 INFO:tasks.workunit.client.0.smithi050.stdout:9/540: dread d1/d12/d2d/d39/f92 [0,4194304] 0 2023-01-04T18:17:06.799 INFO:tasks.workunit.client.0.smithi050.stdout:0/484: dread d0/d6/d8/d51/f8d [0,4194304] 0 2023-01-04T18:17:06.854 INFO:tasks.workunit.client.0.smithi050.stdout:7/641: dwrite d6/db/d15/d1b/d70/f85 [0,4194304] 0 2023-01-04T18:17:06.863 INFO:tasks.workunit.client.0.smithi050.stdout:2/571: rename d1/dd/d62/da1/c94 to d1/dd/d28/d2c/d66/da2/cbc 0 2023-01-04T18:17:06.866 INFO:tasks.workunit.client.0.smithi050.stdout:1/562: mkdir d8/d14/d1c/d28/d57/d6a/daf 0 2023-01-04T18:17:06.866 INFO:tasks.workunit.client.0.smithi050.stdout:6/549: creat d0/d4a/d93/faa x:0 0 0 2023-01-04T18:17:06.866 INFO:tasks.workunit.client.0.smithi050.stdout:6/550: write d0/d9/d25/d2d/f73 [4558109,93145] 0 2023-01-04T18:17:06.871 INFO:tasks.workunit.client.0.smithi050.stdout:8/645: symlink d3/d2a/d30/d3b/d4d/d23/d55/d5f/d82/le4 0 2023-01-04T18:17:06.871 INFO:tasks.workunit.client.0.smithi050.stdout:8/646: fsync d3/d2a/d74/d92/d94/d9c/fbc 0 2023-01-04T18:17:06.872 INFO:tasks.workunit.client.0.smithi050.stdout:9/541: dread d1/d12/d41/d60/f64 [0,4194304] 0 2023-01-04T18:17:06.874 INFO:tasks.workunit.client.0.smithi050.stdout:0/485: link d0/d6/d28/d1a/f30 d0/d6/d8/d35/f97 0 2023-01-04T18:17:06.874 INFO:tasks.workunit.client.0.smithi050.stdout:0/486: dread - d0/d73/d68/f7f zero size 2023-01-04T18:17:06.875 INFO:tasks.workunit.client.0.smithi050.stdout:7/642: creat d6/db/d20/d4f/d8a/fdc x:0 0 0 2023-01-04T18:17:06.876 INFO:tasks.workunit.client.0.smithi050.stdout:7/643: dread - d6/f7c zero size 2023-01-04T18:17:06.876 INFO:tasks.workunit.client.0.smithi050.stdout:7/644: chown d6/db 1 1 2023-01-04T18:17:06.876 INFO:tasks.workunit.client.0.smithi050.stdout:2/572: readlink d1/dd/l53 0 2023-01-04T18:17:06.940 INFO:tasks.workunit.client.0.smithi050.stdout:6/551: dwrite d0/d9/d25/f39 [0,4194304] 0 2023-01-04T18:17:06.945 INFO:tasks.workunit.client.0.smithi050.stdout:1/563: unlink d8/d14/f52 0 2023-01-04T18:17:06.945 INFO:tasks.workunit.client.0.smithi050.stdout:1/564: write d8/f60 [5765050,26406] 0 2023-01-04T18:17:06.948 INFO:tasks.workunit.client.0.smithi050.stdout:5/702: creat d13/d15/d66/db8/d27/d46/d4e/d4d/db1/dbc/ffc x:0 0 0 2023-01-04T18:17:06.952 INFO:tasks.workunit.client.0.smithi050.stdout:9/542: mkdir d1/d3/d24/d97/da8 0 2023-01-04T18:17:06.953 INFO:tasks.workunit.client.0.smithi050.stdout:9/543: write d1/d3/d13/d77/f8c [778595,37690] 0 2023-01-04T18:17:06.954 INFO:tasks.workunit.client.0.smithi050.stdout:0/487: creat d0/d6/d8/d25/d8e/f98 x:0 0 0 2023-01-04T18:17:06.955 INFO:tasks.workunit.client.0.smithi050.stdout:7/645: mknod d6/d90/cdd 0 2023-01-04T18:17:06.958 INFO:tasks.workunit.client.0.smithi050.stdout:2/573: rename d1/dd/d11/d12/ca3 to d1/dd/d62/cbd 0 2023-01-04T18:17:06.960 INFO:tasks.workunit.client.0.smithi050.stdout:1/565: mknod d8/d48/dac/cb0 0 2023-01-04T18:17:06.962 INFO:tasks.workunit.client.0.smithi050.stdout:5/703: getdents d13/d15/d96/dad 0 2023-01-04T18:17:06.963 INFO:tasks.workunit.client.0.smithi050.stdout:1/566: fdatasync d8/f60 0 2023-01-04T18:17:06.963 INFO:tasks.workunit.client.0.smithi050.stdout:1/567: chown d8/d48/dac/cb0 478057 1 2023-01-04T18:17:06.969 INFO:tasks.workunit.client.0.smithi050.stdout:9/544: unlink d1/d12/d41/f67 0 2023-01-04T18:17:06.972 INFO:tasks.workunit.client.0.smithi050.stdout:6/552: rename d0/d9/d25/d8f to d0/d9/d38/d16/d6b/da4/dab 0 2023-01-04T18:17:06.974 INFO:tasks.workunit.client.0.smithi050.stdout:2/574: mknod d1/dd/d28/d79/cbe 0 2023-01-04T18:17:06.974 INFO:tasks.workunit.client.0.smithi050.stdout:2/575: read d1/f97 [2263566,72698] 0 2023-01-04T18:17:06.977 INFO:tasks.workunit.client.0.smithi050.stdout:5/704: mkdir d13/d15/d66/db8/d1f/d35/d42/dfd 0 2023-01-04T18:17:06.978 INFO:tasks.workunit.client.0.smithi050.stdout:9/545: truncate d1/d3/d11/f5d 1304439 0 2023-01-04T18:17:06.981 INFO:tasks.workunit.client.0.smithi050.stdout:0/488: dwrite d0/d6/d8/d35/f97 [0,4194304] 0 2023-01-04T18:17:06.981 INFO:tasks.workunit.client.0.smithi050.stdout:7/646: mkdir d6/d28/dde 0 2023-01-04T18:17:06.981 INFO:tasks.workunit.client.0.smithi050.stdout:7/647: chown d6/d28/d99/dd7/d42/ccf 32 1 2023-01-04T18:17:06.982 INFO:tasks.workunit.client.0.smithi050.stdout:5/705: read d13/d15/d66/db8/d27/d46/d4e/f37 [3497352,90865] 0 2023-01-04T18:17:06.982 INFO:tasks.workunit.client.0.smithi050.stdout:5/706: read - d13/d15/d66/db8/d27/d46/d4e/d4d/db1/dbc/ffc zero size 2023-01-04T18:17:06.983 INFO:tasks.workunit.client.0.smithi050.stdout:6/553: truncate d0/d9/d38/fd 1597478 0 2023-01-04T18:17:06.983 INFO:tasks.workunit.client.0.smithi050.stdout:6/554: chown d0/d9/l36 60 1 2023-01-04T18:17:06.987 INFO:tasks.workunit.client.0.smithi050.stdout:0/489: unlink d0/d6/d8/d25/c6e 0 2023-01-04T18:17:06.989 INFO:tasks.workunit.client.0.smithi050.stdout:1/568: dwrite d8/d14/d1c/d28/f59 [0,4194304] 0 2023-01-04T18:17:06.989 INFO:tasks.workunit.client.0.smithi050.stdout:1/569: chown d8/d48/d5c/d67/d3a/f70 3405 1 2023-01-04T18:17:06.989 INFO:tasks.workunit.client.0.smithi050.stdout:1/570: stat d8/d48/d5c/d67/d3a/l9f 0 2023-01-04T18:17:06.989 INFO:tasks.workunit.client.0.smithi050.stdout:1/571: chown d8/d14/d1c/d28/d57/d6a 206122 1 2023-01-04T18:17:06.989 INFO:tasks.workunit.client.0.smithi050.stdout:1/572: chown d8/d48/d8c/l62 154 1 2023-01-04T18:17:06.989 INFO:tasks.workunit.client.0.smithi050.stdout:1/573: fsync d8/d14/f82 0 2023-01-04T18:17:06.990 INFO:tasks.workunit.client.0.smithi050.stdout:1/574: fsync d8/d14/d1c/f40 0 2023-01-04T18:17:06.990 INFO:tasks.workunit.client.0.smithi050.stdout:7/648: symlink d6/db/d20/d55/ldf 0 2023-01-04T18:17:06.992 INFO:tasks.workunit.client.0.smithi050.stdout:5/707: link d13/d15/d66/db8/d27/d44/lf6 d13/d15/d66/db8/d27/d46/lfe 0 2023-01-04T18:17:06.993 INFO:tasks.workunit.client.0.smithi050.stdout:2/576: dread d1/dd/f4a [0,4194304] 0 2023-01-04T18:17:06.993 INFO:tasks.workunit.client.0.smithi050.stdout:7/649: read d6/db/d3a/fa5 [3133287,55564] 0 2023-01-04T18:17:06.993 INFO:tasks.workunit.client.0.smithi050.stdout:7/650: stat d6/db/d20/d55 0 2023-01-04T18:17:06.994 INFO:tasks.workunit.client.0.smithi050.stdout:5/708: dread d13/f3b [0,4194304] 0 2023-01-04T18:17:06.994 INFO:tasks.workunit.client.0.smithi050.stdout:7/651: write d6/f13 [1019201,120985] 0 2023-01-04T18:17:06.994 INFO:tasks.workunit.client.0.smithi050.stdout:1/575: dread d8/d14/f30 [0,4194304] 0 2023-01-04T18:17:06.995 INFO:tasks.workunit.client.0.smithi050.stdout:6/555: rename d0/d9/d38/d16/f3f to d0/d9/d38/d16/fac 0 2023-01-04T18:17:06.996 INFO:tasks.workunit.client.0.smithi050.stdout:9/546: dwrite d1/d3/d13/f8d [0,4194304] 0 2023-01-04T18:17:06.997 INFO:tasks.workunit.client.0.smithi050.stdout:0/490: rename d0/d6/d8/cd to d0/d6/d28/d1a/c99 0 2023-01-04T18:17:07.000 INFO:tasks.workunit.client.0.smithi050.stdout:2/577: truncate d1/f86 3707795 0 2023-01-04T18:17:07.003 INFO:tasks.workunit.client.0.smithi050.stdout:5/709: creat d13/d15/d66/db8/d27/d44/df2/fff x:0 0 0 2023-01-04T18:17:07.003 INFO:tasks.workunit.client.0.smithi050.stdout:5/710: stat d13/d15/d66/db8/d1f/d35/d49/fea 0 2023-01-04T18:17:07.003 INFO:tasks.workunit.client.0.smithi050.stdout:5/711: chown d13/d15/d66/db8/d1f/d62/fb0 518 1 2023-01-04T18:17:07.005 INFO:tasks.workunit.client.0.smithi050.stdout:7/652: rmdir d6/db 39 2023-01-04T18:17:07.016 INFO:tasks.workunit.client.0.smithi050.stdout:1/576: creat d8/d14/d1c/fb1 x:0 0 0 2023-01-04T18:17:07.018 INFO:tasks.workunit.client.0.smithi050.stdout:6/556: dwrite d0/d9/d38/d1c/d54/f58 [0,4194304] 0 2023-01-04T18:17:07.020 INFO:tasks.workunit.client.0.smithi050.stdout:0/491: dwrite d0/d6/d8/d35/f2b [4194304,4194304] 0 2023-01-04T18:17:07.020 INFO:tasks.workunit.client.0.smithi050.stdout:0/492: write d0/d6/d8/f89 [932313,43857] 0 2023-01-04T18:17:07.030 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:17:05.645516+0000 mgr.smithi098.vhfzum (mgr.24455) 44 : cephadm [INF] Upgrade: Updating mgr.smithi050.emnywo 2023-01-04T18:17:07.030 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:05.649819+0000 mon.smithi050 (mon.0) 598 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:17:07.031 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:05.651413+0000 mon.smithi098 (mon.1) 49 : audit [INF] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi050.emnywo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-01-04T18:17:07.031 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:05.651761+0000 mon.smithi050 (mon.0) 599 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi050.emnywo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-01-04T18:17:07.031 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:05.652722+0000 mon.smithi098 (mon.1) 50 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mgr services"}]: dispatch 2023-01-04T18:17:07.031 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:05.653378+0000 mon.smithi098 (mon.1) 51 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:17:07.031 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:17:05.653895+0000 mgr.smithi098.vhfzum (mgr.24455) 45 : cephadm [INF] Deploying daemon mgr.smithi050.emnywo on smithi050 2023-01-04T18:17:07.031 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:05.921359+0000 mgr.smithi098.vhfzum (mgr.24455) 46 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 68 MiB/s rd, 149 MiB/s wr, 347 op/s 2023-01-04T18:17:07.036 INFO:tasks.workunit.client.0.smithi050.stdout:6/557: dwrite d0/d9/df/f70 [0,4194304] 0 2023-01-04T18:17:07.041 INFO:tasks.workunit.client.0.smithi050.stdout:7/653: link d6/d1d/d81/c9f d6/d90/ce0 0 2023-01-04T18:17:07.042 INFO:tasks.workunit.client.0.smithi050.stdout:7/654: read d6/db/d15/d1b/d22/f54 [3298674,50444] 0 2023-01-04T18:17:07.042 INFO:tasks.workunit.client.0.smithi050.stdout:7/655: readlink l5 0 2023-01-04T18:17:07.042 INFO:tasks.workunit.client.0.smithi050.stdout:1/577: unlink d8/d48/d5c/d67/c71 0 2023-01-04T18:17:07.050 INFO:tasks.workunit.client.0.smithi050.stdout:5/712: dwrite d13/d15/d66/db8/d1f/f80 [0,4194304] 0 2023-01-04T18:17:07.058 INFO:tasks.workunit.client.0.smithi050.stdout:0/493: creat d0/d73/d79/f9a x:0 0 0 2023-01-04T18:17:07.059 INFO:tasks.workunit.client.0.smithi050.stdout:1/578: dwrite d8/d14/d1c/d28/f3f [0,4194304] 0 2023-01-04T18:17:07.060 INFO:tasks.workunit.client.0.smithi050.stdout:1/579: fsync d8/d14/d1c/d28/d57/d6a/f8a 0 2023-01-04T18:17:07.063 INFO:tasks.workunit.client.0.smithi050.stdout:1/580: dread d8/d48/d5c/d67/d3a/d23/f3e [0,4194304] 0 2023-01-04T18:17:07.063 INFO:tasks.workunit.client.0.smithi050.stdout:9/547: symlink d1/d3/d11/la9 0 2023-01-04T18:17:07.063 INFO:tasks.workunit.client.0.smithi050.stdout:9/548: stat d1/d3/d3b/f9a 0 2023-01-04T18:17:07.078 INFO:tasks.workunit.client.0.smithi050.stdout:6/558: mknod d0/d9/d38/cad 0 2023-01-04T18:17:07.079 INFO:tasks.workunit.client.0.smithi050.stdout:6/559: write d0/d9/d38/d1c/d54/f58 [1784139,66935] 0 2023-01-04T18:17:07.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:17:05.645516+0000 mgr.smithi098.vhfzum (mgr.24455) 44 : cephadm [INF] Upgrade: Updating mgr.smithi050.emnywo 2023-01-04T18:17:07.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:05.649819+0000 mon.smithi050 (mon.0) 598 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:17:07.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:05.651413+0000 mon.smithi098 (mon.1) 49 : audit [INF] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi050.emnywo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-01-04T18:17:07.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:05.651761+0000 mon.smithi050 (mon.0) 599 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi050.emnywo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-01-04T18:17:07.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:05.652722+0000 mon.smithi098 (mon.1) 50 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mgr services"}]: dispatch 2023-01-04T18:17:07.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:05.653378+0000 mon.smithi098 (mon.1) 51 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:17:07.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:17:05.653895+0000 mgr.smithi098.vhfzum (mgr.24455) 45 : cephadm [INF] Deploying daemon mgr.smithi050.emnywo on smithi050 2023-01-04T18:17:07.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:05.921359+0000 mgr.smithi098.vhfzum (mgr.24455) 46 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 68 MiB/s rd, 149 MiB/s wr, 347 op/s 2023-01-04T18:17:07.081 INFO:tasks.workunit.client.0.smithi050.stdout:7/656: creat d6/db/d15/d1b/d5b/dda/fe1 x:0 0 0 2023-01-04T18:17:07.087 INFO:tasks.workunit.client.0.smithi050.stdout:0/494: symlink d0/d6/d8/d25/d8e/l9b 0 2023-01-04T18:17:07.091 INFO:tasks.workunit.client.0.smithi050.stdout:1/581: creat d8/d14/fb2 x:0 0 0 2023-01-04T18:17:07.092 INFO:tasks.workunit.client.0.smithi050.stdout:9/549: creat d1/d6f/faa x:0 0 0 2023-01-04T18:17:07.092 INFO:tasks.workunit.client.0.smithi050.stdout:9/550: fsync d1/d3/d11/f5d 0 2023-01-04T18:17:07.095 INFO:tasks.workunit.client.0.smithi050.stdout:7/657: mkdir d6/db/d20/d4f/d8a/de2 0 2023-01-04T18:17:07.096 INFO:tasks.workunit.client.0.smithi050.stdout:7/658: write d6/db/d15/d2e/d4b/fb5 [716475,60745] 0 2023-01-04T18:17:07.096 INFO:tasks.workunit.client.0.smithi050.stdout:7/659: chown d6/d1d/d1f/d80/c94 1619 1 2023-01-04T18:17:07.096 INFO:tasks.workunit.client.0.smithi050.stdout:0/495: mkdir d0/d6/d28/d9c 0 2023-01-04T18:17:07.097 INFO:tasks.workunit.client.0.smithi050.stdout:1/582: dread d8/fd [4194304,4194304] 0 2023-01-04T18:17:07.097 INFO:tasks.workunit.client.0.smithi050.stdout:1/583: stat d8/d48/d8c/c9e 0 2023-01-04T18:17:07.097 INFO:tasks.workunit.client.0.smithi050.stdout:6/560: dwrite d0/d9/d25/f27 [0,4194304] 0 2023-01-04T18:17:07.098 INFO:tasks.workunit.client.0.smithi050.stdout:6/561: chown d0/d9/d25/f9a 75 1 2023-01-04T18:17:07.099 INFO:tasks.workunit.client.0.smithi050.stdout:0/496: creat d0/d6/d28/d9c/f9d x:0 0 0 2023-01-04T18:17:07.102 INFO:tasks.workunit.client.0.smithi050.stdout:9/551: dread d1/d3/d3b/d63/f1c [0,4194304] 0 2023-01-04T18:17:07.102 INFO:tasks.workunit.client.0.smithi050.stdout:9/552: read d1/d12/d2d/d39/f4d [4747525,106410] 0 2023-01-04T18:17:07.106 INFO:tasks.workunit.client.0.smithi050.stdout:7/660: read d6/d28/f2c [6200853,41183] 0 2023-01-04T18:17:07.106 INFO:tasks.workunit.client.0.smithi050.stdout:5/713: dread d13/d15/d66/db8/d27/d46/d4e/d4d/f90 [0,4194304] 0 2023-01-04T18:17:07.106 INFO:tasks.workunit.client.0.smithi050.stdout:5/714: write d13/d15/f34 [4677948,24416] 0 2023-01-04T18:17:07.106 INFO:tasks.workunit.client.0.smithi050.stdout:5/715: chown d13/d15/d66/db8/d8f/fa7 123957 1 2023-01-04T18:17:07.107 INFO:tasks.workunit.client.0.smithi050.stdout:5/716: write d13/d15/d66/db8/d1f/d35/d59/d87/f89 [836244,117861] 0 2023-01-04T18:17:07.112 INFO:tasks.workunit.client.0.smithi050.stdout:0/497: dread d0/d6/d8/d51/f86 [0,4194304] 0 2023-01-04T18:17:07.117 INFO:tasks.workunit.client.0.smithi050.stdout:3/570: sync 2023-01-04T18:17:07.129 INFO:tasks.workunit.client.0.smithi050.stdout:9/553: dwrite d1/d12/d41/f4a [0,4194304] 0 2023-01-04T18:17:07.129 INFO:tasks.workunit.client.0.smithi050.stdout:9/554: write d1/d12/f74 [936167,119323] 0 2023-01-04T18:17:07.131 INFO:tasks.workunit.client.0.smithi050.stdout:6/562: dwrite d0/d4a/f7e [0,4194304] 0 2023-01-04T18:17:07.131 INFO:tasks.workunit.client.0.smithi050.stdout:6/563: stat d0/d9/d38/d16/d6b/da4/dab 0 2023-01-04T18:17:07.131 INFO:tasks.workunit.client.0.smithi050.stdout:6/564: chown d0/d9/d25/d2d/l53 12 1 2023-01-04T18:17:07.176 INFO:tasks.workunit.client.0.smithi050.stdout:4/563: sync 2023-01-04T18:17:07.176 INFO:tasks.workunit.client.0.smithi050.stdout:4/564: dread - d14/d1b/d66/f9c zero size 2023-01-04T18:17:07.176 INFO:tasks.workunit.client.0.smithi050.stdout:4/565: read d14/f1a [2359464,70621] 0 2023-01-04T18:17:07.191 INFO:tasks.workunit.client.0.smithi050.stdout:7/661: truncate d6/d28/d32/f4e 3068857 0 2023-01-04T18:17:07.191 INFO:tasks.workunit.client.0.smithi050.stdout:7/662: write d6/db/d20/d55/f7f [1042373,478] 0 2023-01-04T18:17:07.192 INFO:tasks.workunit.client.0.smithi050.stdout:7/663: dread - d6/d6b/d8b/fb8 zero size 2023-01-04T18:17:07.192 INFO:tasks.workunit.client.0.smithi050.stdout:7/664: write d6/db/d3a/fa5 [4551046,98214] 0 2023-01-04T18:17:07.192 INFO:tasks.workunit.client.0.smithi050.stdout:7/665: fsync d6/db/d15/d1b/fc5 0 2023-01-04T18:17:07.192 INFO:tasks.workunit.client.0.smithi050.stdout:5/717: symlink d13/d15/d66/db8/d27/d78/l100 0 2023-01-04T18:17:07.195 INFO:tasks.workunit.client.0.smithi050.stdout:0/498: mkdir d0/d6/d28/d1a/d8a/d9e 0 2023-01-04T18:17:07.202 INFO:tasks.workunit.client.0.smithi050.stdout:3/571: rename d0/d1b/d2f/d56/d3f to d0/d1b/d2f/d56/d98/d9c/dcd 0 2023-01-04T18:17:07.202 INFO:tasks.workunit.client.0.smithi050.stdout:3/572: fdatasync d0/d1b/d2f/f44 0 2023-01-04T18:17:07.205 INFO:tasks.workunit.client.0.smithi050.stdout:9/555: symlink d1/d12/d41/d60/d8e/lab 0 2023-01-04T18:17:07.205 INFO:tasks.workunit.client.0.smithi050.stdout:9/556: read - d1/d6f/faa zero size 2023-01-04T18:17:07.209 INFO:tasks.workunit.client.0.smithi050.stdout:0/499: dwrite d0/d73/f71 [0,4194304] 0 2023-01-04T18:17:07.213 INFO:tasks.workunit.client.0.smithi050.stdout:3/573: dread d0/d8f/f25 [0,4194304] 0 2023-01-04T18:17:07.213 INFO:tasks.workunit.client.0.smithi050.stdout:3/574: fdatasync d0/d1b/d2f/d31/f86 0 2023-01-04T18:17:07.213 INFO:tasks.workunit.client.0.smithi050.stdout:3/575: truncate d0/d1b/d2f/d31/f62 557629 0 2023-01-04T18:17:07.216 INFO:tasks.workunit.client.0.smithi050.stdout:6/565: mknod d0/d9/d25/d4d/cae 0 2023-01-04T18:17:07.216 INFO:tasks.workunit.client.0.smithi050.stdout:6/566: truncate d0/d9/f3b 496358 0 2023-01-04T18:17:07.216 INFO:tasks.workunit.client.0.smithi050.stdout:6/567: stat d0/d9/d38/cad 0 2023-01-04T18:17:07.228 INFO:tasks.workunit.client.0.smithi050.stdout:9/557: dwrite d1/d12/f44 [0,4194304] 0 2023-01-04T18:17:07.228 INFO:tasks.workunit.client.0.smithi050.stdout:9/558: write d1/d3/d3b/f9a [175910,127033] 0 2023-01-04T18:17:07.228 INFO:tasks.workunit.client.0.smithi050.stdout:9/559: truncate d1/d12/d2d/d39/f66 378800 0 2023-01-04T18:17:07.265 INFO:tasks.workunit.client.0.smithi050.stdout:4/566: creat d14/d1b/d1f/d22/d3e/d44/d59/d5d/fb2 x:0 0 0 2023-01-04T18:17:07.268 INFO:tasks.workunit.client.0.smithi050.stdout:7/666: getdents d6/d1d/d1f 0 2023-01-04T18:17:07.268 INFO:tasks.workunit.client.0.smithi050.stdout:7/667: chown d6/db/d15/d1b/d70/la1 1 1 2023-01-04T18:17:07.269 INFO:tasks.workunit.client.0.smithi050.stdout:5/718: mkdir d13/d15/d66/db8/d27/d44/d101 0 2023-01-04T18:17:07.270 INFO:tasks.workunit.client.0.smithi050.stdout:5/719: fdatasync d13/d28/d7c/d83/fe8 0 2023-01-04T18:17:07.270 INFO:tasks.workunit.client.0.smithi050.stdout:8/647: sync 2023-01-04T18:17:07.270 INFO:tasks.workunit.client.0.smithi050.stdout:8/648: chown d3/d2a/d27/l9e 281 1 2023-01-04T18:17:07.312 INFO:tasks.workunit.client.0.smithi050.stdout:0/500: rename d0/d73/d68/d7a to d0/d9f 0 2023-01-04T18:17:07.312 INFO:tasks.workunit.client.0.smithi050.stdout:0/501: fdatasync d0/f53 0 2023-01-04T18:17:07.313 INFO:tasks.workunit.client.0.smithi050.stdout:6/568: rmdir d0/d9/d38/d1c/d54 39 2023-01-04T18:17:07.317 INFO:tasks.workunit.client.0.smithi050.stdout:9/560: symlink d1/d12/d41/lac 0 2023-01-04T18:17:07.318 INFO:tasks.workunit.client.0.smithi050.stdout:4/567: getdents d14/d1b 0 2023-01-04T18:17:07.318 INFO:tasks.workunit.client.0.smithi050.stdout:4/568: write d14/d1b/d1f/d22/d3e/d44/d59/d5d/fb2 [62786,105694] 0 2023-01-04T18:17:07.319 INFO:tasks.workunit.client.0.smithi050.stdout:6/569: dread d0/d9/d38/d1c/d54/f63 [0,4194304] 0 2023-01-04T18:17:07.319 INFO:tasks.workunit.client.0.smithi050.stdout:6/570: write d0/d4a/d93/fa8 [17485,22677] 0 2023-01-04T18:17:07.319 INFO:tasks.workunit.client.0.smithi050.stdout:6/571: stat d0/d9/d38/d16/d77/l91 0 2023-01-04T18:17:07.320 INFO:tasks.workunit.client.0.smithi050.stdout:6/572: readlink d0/d9/l36 0 2023-01-04T18:17:07.330 INFO:tasks.workunit.client.0.smithi050.stdout:5/720: mkdir d13/d15/d66/db8/d27/dca/d102 0 2023-01-04T18:17:07.330 INFO:tasks.workunit.client.0.smithi050.stdout:5/721: chown d13/d28/fa4 4662944 1 2023-01-04T18:17:07.331 INFO:tasks.workunit.client.0.smithi050.stdout:8/649: mkdir d3/d2a/d27/d93/d7f/d96/db6/de5 0 2023-01-04T18:17:07.336 INFO:tasks.workunit.client.0.smithi050.stdout:0/502: getdents d0/d6/d8/d35 0 2023-01-04T18:17:07.337 INFO:tasks.workunit.client.0.smithi050.stdout:9/561: symlink d1/d3/d24/d97/da8/lad 0 2023-01-04T18:17:07.339 INFO:tasks.workunit.client.0.smithi050.stdout:0/503: dread d0/d6/d8/d35/f6f [0,4194304] 0 2023-01-04T18:17:07.339 INFO:tasks.workunit.client.0.smithi050.stdout:0/504: fdatasync d0/d73/d79/f9a 0 2023-01-04T18:17:07.339 INFO:tasks.workunit.client.0.smithi050.stdout:4/569: mknod d14/d1b/cb3 0 2023-01-04T18:17:07.340 INFO:tasks.workunit.client.0.smithi050.stdout:6/573: creat d0/d5c/d5d/faf x:0 0 0 2023-01-04T18:17:07.340 INFO:tasks.workunit.client.0.smithi050.stdout:6/574: read - d0/d9/d38/d16/f9c zero size 2023-01-04T18:17:07.341 INFO:tasks.workunit.client.0.smithi050.stdout:6/575: chown d0/d9/d38/l45 375143 1 2023-01-04T18:17:07.342 INFO:tasks.workunit.client.0.smithi050.stdout:5/722: creat d13/d15/d66/db8/d27/d78/f103 x:0 0 0 2023-01-04T18:17:07.345 INFO:tasks.workunit.client.0.smithi050.stdout:8/650: creat d3/d2a/d30/d3b/d4d/d23/d55/d5f/d82/dcb/fe6 x:0 0 0 2023-01-04T18:17:07.346 INFO:tasks.workunit.client.0.smithi050.stdout:2/578: sync 2023-01-04T18:17:07.348 INFO:tasks.workunit.client.0.smithi050.stdout:9/562: rename d1/d12/d2d/f4c to d1/d12/d2d/d39/fae 0 2023-01-04T18:17:07.348 INFO:tasks.workunit.client.0.smithi050.stdout:0/505: creat d0/d73/d68/fa0 x:0 0 0 2023-01-04T18:17:07.349 INFO:tasks.workunit.client.0.smithi050.stdout:4/570: creat d14/d9e/fb4 x:0 0 0 2023-01-04T18:17:07.349 INFO:tasks.workunit.client.0.smithi050.stdout:5/723: symlink d13/d15/l104 0 2023-01-04T18:17:07.354 INFO:tasks.workunit.client.0.smithi050.stdout:0/506: dread d0/f3b [0,4194304] 0 2023-01-04T18:17:07.395 INFO:tasks.workunit.client.0.smithi050.stdout:4/571: dread d14/d1b/d1f/d22/d3e/f5a [0,4194304] 0 2023-01-04T18:17:07.397 INFO:tasks.workunit.client.0.smithi050.stdout:4/572: write d14/d1b/f2f [2745031,11819] 0 2023-01-04T18:17:07.397 INFO:tasks.workunit.client.0.smithi050.stdout:4/573: chown d14/d1b/d1f/d22/d3e/d85/la8 0 1 2023-01-04T18:17:07.414 INFO:tasks.workunit.client.0.smithi050.stdout:4/574: dwrite f13 [4194304,4194304] 0 2023-01-04T18:17:07.415 INFO:tasks.workunit.client.0.smithi050.stdout:8/651: rename d3/f68 to d3/d2a/d27/dc1/fe7 0 2023-01-04T18:17:07.418 INFO:tasks.workunit.client.0.smithi050.stdout:5/724: creat d13/d15/d66/db8/d1f/d35/d42/dfd/f105 x:0 0 0 2023-01-04T18:17:07.418 INFO:tasks.workunit.client.0.smithi050.stdout:5/725: read - d13/d15/d66/db8/d27/d78/f103 zero size 2023-01-04T18:17:07.419 INFO:tasks.workunit.client.0.smithi050.stdout:0/507: mkdir d0/d9f/da1 0 2023-01-04T18:17:07.426 INFO:tasks.workunit.client.0.smithi050.stdout:4/575: mkdir d14/d1b/d1f/d22/d3e/d44/d59/db5 0 2023-01-04T18:17:07.431 INFO:tasks.workunit.client.0.smithi050.stdout:9/563: rename d1/d3/d24/d97/da8/lad to d1/d3/d24/d7b/laf 0 2023-01-04T18:17:07.432 INFO:tasks.workunit.client.0.smithi050.stdout:8/652: creat d3/d2a/d74/d92/d94/dc9/fe8 x:0 0 0 2023-01-04T18:17:07.435 INFO:tasks.workunit.client.0.smithi050.stdout:3/576: sync 2023-01-04T18:17:07.436 INFO:tasks.workunit.client.0.smithi050.stdout:1/584: sync 2023-01-04T18:17:07.436 INFO:tasks.workunit.client.0.smithi050.stdout:1/585: fdatasync d8/d14/d1c/f85 0 2023-01-04T18:17:07.436 INFO:tasks.workunit.client.0.smithi050.stdout:3/577: dread - d0/d1b/d2f/d56/d6b/fcc zero size 2023-01-04T18:17:07.436 INFO:tasks.workunit.client.0.smithi050.stdout:0/508: creat d0/d73/fa2 x:0 0 0 2023-01-04T18:17:07.437 INFO:tasks.workunit.client.0.smithi050.stdout:4/576: mkdir d14/d1b/d1f/d63/da5/db6 0 2023-01-04T18:17:07.438 INFO:tasks.workunit.client.0.smithi050.stdout:5/726: rename d13/d15/d66/db8/d1f/d35/d49/l4b to d13/d15/d66/db8/d27/d44/d47/l106 0 2023-01-04T18:17:07.443 INFO:tasks.workunit.client.0.smithi050.stdout:9/564: creat d1/d3/d24/d97/da8/fb0 x:0 0 0 2023-01-04T18:17:07.444 INFO:tasks.workunit.client.0.smithi050.stdout:8/653: truncate d3/d2a/d27/d93/d7a/f80 3914785 0 2023-01-04T18:17:07.446 INFO:tasks.workunit.client.0.smithi050.stdout:3/578: link d0/d1b/d2f/l68 d0/d8f/d46/dc2/lce 0 2023-01-04T18:17:07.447 INFO:tasks.workunit.client.0.smithi050.stdout:0/509: symlink d0/d6/d8/d51/la3 0 2023-01-04T18:17:07.453 INFO:tasks.workunit.client.0.smithi050.stdout:4/577: mknod d14/d1b/d1f/d22/d3e/d85/da6/cb7 0 2023-01-04T18:17:07.457 INFO:tasks.workunit.client.0.smithi050.stdout:1/586: rename d8/d48/d5c/d67/f1f to d8/d14/fb3 0 2023-01-04T18:17:07.466 INFO:tasks.workunit.client.0.smithi050.stdout:8/654: dwrite d3/d2a/d30/d3b/d4d/d23/d55/d5f/d82/dcb/fe6 [0,4194304] 0 2023-01-04T18:17:07.466 INFO:tasks.workunit.client.0.smithi050.stdout:8/655: stat d3/d2a/d30/d3b/d4d/d23/d31/lb4 0 2023-01-04T18:17:07.468 INFO:tasks.workunit.client.0.smithi050.stdout:0/510: creat d0/d6/d8/d35/fa4 x:0 0 0 2023-01-04T18:17:07.470 INFO:tasks.workunit.client.0.smithi050.stdout:5/727: rename d13/d15/d96/dad to d13/d107 0 2023-01-04T18:17:07.471 INFO:tasks.workunit.client.0.smithi050.stdout:3/579: dwrite d0/d1b/d2f/d31/f83 [0,4194304] 0 2023-01-04T18:17:07.472 INFO:tasks.workunit.client.0.smithi050.stdout:9/565: dread d1/d12/d41/d60/d95/f96 [0,4194304] 0 2023-01-04T18:17:07.475 INFO:tasks.workunit.client.0.smithi050.stdout:9/566: dread d1/d12/f74 [0,4194304] 0 2023-01-04T18:17:07.475 INFO:tasks.workunit.client.0.smithi050.stdout:9/567: chown d1/d3/d3b/d63/c53 40860 1 2023-01-04T18:17:07.475 INFO:tasks.workunit.client.0.smithi050.stdout:9/568: chown d1/d3/f19 225028 1 2023-01-04T18:17:07.477 INFO:tasks.workunit.client.0.smithi050.stdout:4/578: dwrite d14/d1b/d32/f37 [0,4194304] 0 2023-01-04T18:17:07.478 INFO:tasks.workunit.client.0.smithi050.stdout:1/587: dwrite d8/d14/d1c/f73 [0,4194304] 0 2023-01-04T18:17:07.480 INFO:tasks.workunit.client.0.smithi050.stdout:8/656: rmdir d3/d2a/d30/d3b 39 2023-01-04T18:17:07.484 INFO:tasks.workunit.client.0.smithi050.stdout:0/511: unlink d0/d6/d8/d35/f2b 0 2023-01-04T18:17:07.487 INFO:tasks.workunit.client.0.smithi050.stdout:5/728: creat d13/d15/d66/db8/d1f/d35/d42/dec/f108 x:0 0 0 2023-01-04T18:17:07.487 INFO:tasks.workunit.client.0.smithi050.stdout:5/729: chown d13/d15/d66/fac 26946356 1 2023-01-04T18:17:07.492 INFO:tasks.workunit.client.0.smithi050.stdout:4/579: dwrite d14/d1b/d1f/d22/d3e/f60 [0,4194304] 0 2023-01-04T18:17:07.495 INFO:tasks.workunit.client.0.smithi050.stdout:3/580: dwrite d0/d1b/d2f/d31/f97 [4194304,4194304] 0 2023-01-04T18:17:07.496 INFO:tasks.workunit.client.0.smithi050.stdout:9/569: unlink d1/d12/d2d/d39/f82 0 2023-01-04T18:17:07.496 INFO:tasks.workunit.client.0.smithi050.stdout:9/570: dread - d1/d12/d9f/fa0 zero size 2023-01-04T18:17:07.503 INFO:tasks.workunit.client.0.smithi050.stdout:1/588: creat d8/d48/d5c/d67/d3a/d31/fb4 x:0 0 0 2023-01-04T18:17:07.503 INFO:tasks.workunit.client.0.smithi050.stdout:1/589: truncate d8/d14/d1c/f40 599665 0 2023-01-04T18:17:07.504 INFO:tasks.workunit.client.0.smithi050.stdout:0/512: mknod d0/d9f/d84/ca5 0 2023-01-04T18:17:07.504 INFO:tasks.workunit.client.0.smithi050.stdout:0/513: readlink d0/d6/d8/d51/l5d 0 2023-01-04T18:17:07.507 INFO:tasks.workunit.client.0.smithi050.stdout:5/730: creat d13/d15/d66/db8/d27/f109 x:0 0 0 2023-01-04T18:17:07.507 INFO:tasks.workunit.client.0.smithi050.stdout:5/731: chown d13/d15/d66/db8/d27/d78/f9a 364839 1 2023-01-04T18:17:07.509 INFO:tasks.workunit.client.0.smithi050.stdout:4/580: link d14/d1b/d32/c70 d14/d1b/d1f/d22/cb8 0 2023-01-04T18:17:07.510 INFO:tasks.workunit.client.0.smithi050.stdout:8/657: dwrite d3/d2a/d2d/fb5 [0,4194304] 0 2023-01-04T18:17:07.511 INFO:tasks.workunit.client.0.smithi050.stdout:8/658: chown d3/d2a/d30 7551 1 2023-01-04T18:17:07.513 INFO:tasks.workunit.client.0.smithi050.stdout:8/659: dread d3/d2a/d2d/f50 [0,4194304] 0 2023-01-04T18:17:07.515 INFO:tasks.workunit.client.0.smithi050.stdout:9/571: getdents d1/d12/d41/d60 0 2023-01-04T18:17:07.515 INFO:tasks.workunit.client.0.smithi050.stdout:9/572: stat d1/d6f/l79 0 2023-01-04T18:17:07.516 INFO:tasks.workunit.client.0.smithi050.stdout:3/581: dwrite d0/d10/f42 [0,4194304] 0 2023-01-04T18:17:07.516 INFO:tasks.workunit.client.0.smithi050.stdout:3/582: chown d0/d8f/lb8 84757 1 2023-01-04T18:17:07.517 INFO:tasks.workunit.client.0.smithi050.stdout:7/668: sync 2023-01-04T18:17:07.518 INFO:tasks.workunit.client.0.smithi050.stdout:7/669: fdatasync d6/d28/d99/dd7/d42/d5f/fc0 0 2023-01-04T18:17:07.520 INFO:tasks.workunit.client.0.smithi050.stdout:1/590: creat d8/d14/d1c/d28/fb5 x:0 0 0 2023-01-04T18:17:07.522 INFO:tasks.workunit.client.0.smithi050.stdout:5/732: creat d13/d15/d66/db8/d1f/d35/f10a x:0 0 0 2023-01-04T18:17:07.522 INFO:tasks.workunit.client.0.smithi050.stdout:5/733: write d13/d15/d66/db8/d1f/d62/fb4 [818645,77738] 0 2023-01-04T18:17:07.522 INFO:tasks.workunit.client.0.smithi050.stdout:5/734: fdatasync d13/d15/d66/db8/d1f/d35/d42/dfd/f105 0 2023-01-04T18:17:07.525 INFO:tasks.workunit.client.0.smithi050.stdout:4/581: mknod d14/d1b/d1f/d22/d3e/d44/d59/d5f/d6f/cb9 0 2023-01-04T18:17:07.533 INFO:tasks.workunit.client.0.smithi050.stdout:0/514: dwrite d0/d6/fa [0,4194304] 0 2023-01-04T18:17:07.565 INFO:tasks.workunit.client.0.smithi050.stdout:3/583: dwrite d0/f5e [0,4194304] 0 2023-01-04T18:17:07.565 INFO:tasks.workunit.client.0.smithi050.stdout:7/670: dwrite d6/d28/d99/dd7/d42/d5f/fb1 [0,4194304] 0 2023-01-04T18:17:07.565 INFO:tasks.workunit.client.0.smithi050.stdout:7/671: chown d6/db/d15/f16 32 1 2023-01-04T18:17:07.599 INFO:tasks.workunit.client.0.smithi050.stdout:8/660: symlink d3/d2a/d74/le9 0 2023-01-04T18:17:07.599 INFO:tasks.workunit.client.0.smithi050.stdout:8/661: dread - d3/d2a/d30/d3b/d53/fdd zero size 2023-01-04T18:17:07.599 INFO:tasks.workunit.client.0.smithi050.stdout:8/662: stat d3/d2a/d60/d2c/f5e 0 2023-01-04T18:17:07.603 INFO:tasks.workunit.client.0.smithi050.stdout:5/735: creat d13/d15/d66/db8/dd9/f10b x:0 0 0 2023-01-04T18:17:07.606 INFO:tasks.workunit.client.0.smithi050.stdout:6/576: sync 2023-01-04T18:17:07.606 INFO:tasks.workunit.client.0.smithi050.stdout:2/579: sync 2023-01-04T18:17:07.606 INFO:tasks.workunit.client.0.smithi050.stdout:6/577: fsync d0/d9/d38/d16/f37 0 2023-01-04T18:17:07.606 INFO:tasks.workunit.client.0.smithi050.stdout:2/580: write d1/dd/d11/d14/d91/f5f [4439165,4866] 0 2023-01-04T18:17:07.607 INFO:tasks.workunit.client.0.smithi050.stdout:2/581: chown d1/dd/d11/f54 2941299 1 2023-01-04T18:17:07.607 INFO:tasks.workunit.client.0.smithi050.stdout:2/582: chown d1/dd/d28/d2c/d66/l9b 273786 1 2023-01-04T18:17:07.609 INFO:tasks.workunit.client.0.smithi050.stdout:4/582: mknod d14/d1b/d1f/d63/da5/db6/cba 0 2023-01-04T18:17:07.610 INFO:tasks.workunit.client.0.smithi050.stdout:4/583: fdatasync d14/d1b/d1f/d22/f67 0 2023-01-04T18:17:07.613 INFO:tasks.workunit.client.0.smithi050.stdout:0/515: unlink d0/d6/d28/d1a/l54 0 2023-01-04T18:17:07.614 INFO:tasks.workunit.client.0.smithi050.stdout:3/584: mknod d0/d8f/d46/d80/ccf 0 2023-01-04T18:17:07.614 INFO:tasks.workunit.client.0.smithi050.stdout:3/585: fdatasync d0/d10/f42 0 2023-01-04T18:17:07.618 INFO:tasks.workunit.client.0.smithi050.stdout:7/672: truncate d6/db/f60 2718026 0 2023-01-04T18:17:07.619 INFO:tasks.workunit.client.0.smithi050.stdout:7/673: fsync d6/d28/d99/dd7/d42/f56 0 2023-01-04T18:17:07.624 INFO:tasks.workunit.client.0.smithi050.stdout:8/663: creat d3/d2a/d30/d3b/d53/fea x:0 0 0 2023-01-04T18:17:07.625 INFO:tasks.workunit.client.0.smithi050.stdout:2/583: truncate d1/dd/d11/d14/d91/d5a/fb6 3695481 0 2023-01-04T18:17:07.625 INFO:tasks.workunit.client.0.smithi050.stdout:2/584: stat d1/dd/d62/da1/d6e/f9e 0 2023-01-04T18:17:07.626 INFO:tasks.workunit.client.0.smithi050.stdout:4/584: rename f11 to d14/d1b/d1f/d22/d3e/d85/da6/fbb 0 2023-01-04T18:17:07.627 INFO:tasks.workunit.client.0.smithi050.stdout:8/664: mkdir d3/d2a/d27/deb 0 2023-01-04T18:17:07.628 INFO:tasks.workunit.client.0.smithi050.stdout:2/585: creat d1/dd/d62/d69/fbf x:0 0 0 2023-01-04T18:17:07.629 INFO:tasks.workunit.client.0.smithi050.stdout:3/586: mkdir d0/d1a/dc3/dd0 0 2023-01-04T18:17:07.630 INFO:tasks.workunit.client.0.smithi050.stdout:8/665: symlink d3/d2a/d2d/d85/daf/lec 0 2023-01-04T18:17:07.631 INFO:tasks.workunit.client.0.smithi050.stdout:3/587: creat d0/d1b/d2f/d56/d6b/dcb/fd1 x:0 0 0 2023-01-04T18:17:07.647 INFO:tasks.workunit.client.0.smithi050.stdout:5/736: dwrite d13/d15/d66/db8/d1f/d35/d59/f95 [0,4194304] 0 2023-01-04T18:17:07.654 INFO:tasks.workunit.client.0.smithi050.stdout:3/588: rename d0/c79 to d0/d1b/d2f/d71/cd2 0 2023-01-04T18:17:07.657 INFO:tasks.workunit.client.0.smithi050.stdout:5/737: creat d13/d15/d63/dc0/f10c x:0 0 0 2023-01-04T18:17:07.657 INFO:tasks.workunit.client.0.smithi050.stdout:6/578: dwrite d0/d5c/d5d/faf [0,4194304] 0 2023-01-04T18:17:07.657 INFO:tasks.workunit.client.0.smithi050.stdout:6/579: dread - d0/d4a/d93/faa zero size 2023-01-04T18:17:07.657 INFO:tasks.workunit.client.0.smithi050.stdout:6/580: write d0/d9/d38/d16/f9c [587489,100157] 0 2023-01-04T18:17:07.657 INFO:tasks.workunit.client.0.smithi050.stdout:6/581: write d0/d9/f3b [1323843,40462] 0 2023-01-04T18:17:07.658 INFO:tasks.workunit.client.0.smithi050.stdout:9/573: dwrite d1/d12/d41/d60/f64 [0,4194304] 0 2023-01-04T18:17:07.658 INFO:tasks.workunit.client.0.smithi050.stdout:3/589: symlink d0/d1b/d2f/d56/d32/dbb/ld3 0 2023-01-04T18:17:07.659 INFO:tasks.workunit.client.0.smithi050.stdout:5/738: getdents d13 0 2023-01-04T18:17:07.660 INFO:tasks.workunit.client.0.smithi050.stdout:7/674: dwrite d6/db/d15/d48/dc7/fb6 [0,4194304] 0 2023-01-04T18:17:07.660 INFO:tasks.workunit.client.0.smithi050.stdout:7/675: fsync d6/f13 0 2023-01-04T18:17:07.661 INFO:tasks.workunit.client.0.smithi050.stdout:4/585: dwrite d14/d1b/f52 [0,4194304] 0 2023-01-04T18:17:07.661 INFO:tasks.workunit.client.0.smithi050.stdout:8/666: dwrite d3/f8e [0,4194304] 0 2023-01-04T18:17:07.673 INFO:tasks.workunit.client.0.smithi050.stdout:9/574: creat d1/d12/d9f/fb1 x:0 0 0 2023-01-04T18:17:07.673 INFO:tasks.workunit.client.0.smithi050.stdout:9/575: read d1/d12/f74 [898380,108141] 0 2023-01-04T18:17:07.673 INFO:tasks.workunit.client.0.smithi050.stdout:9/576: chown d1/d3/d11/d1f/f73 16 1 2023-01-04T18:17:07.675 INFO:tasks.workunit.client.0.smithi050.stdout:3/590: rename d0/dd/c4f to d0/d1b/d2f/d56/cd4 0 2023-01-04T18:17:07.677 INFO:tasks.workunit.client.0.smithi050.stdout:5/739: mkdir d13/d15/d66/db8/d1f/d35/d42/d10d 0 2023-01-04T18:17:07.678 INFO:tasks.workunit.client.0.smithi050.stdout:6/582: dwrite d0/d9/f29 [0,4194304] 0 2023-01-04T18:17:07.714 INFO:tasks.workunit.client.0.smithi050.stdout:9/577: dwrite d1/d12/d3f/f83 [0,4194304] 0 2023-01-04T18:17:07.787 INFO:tasks.workunit.client.0.smithi050.stdout:7/676: unlink d6/d1d/d1f/lb0 0 2023-01-04T18:17:07.793 INFO:tasks.workunit.client.0.smithi050.stdout:8/667: creat d3/d2a/d74/d92/d94/fed x:0 0 0 2023-01-04T18:17:07.793 INFO:tasks.workunit.client.0.smithi050.stdout:8/668: write d3/d2a/d74/d92/fcf [745743,50852] 0 2023-01-04T18:17:07.794 INFO:tasks.workunit.client.0.smithi050.stdout:8/669: write d3/d2a/d30/d3b/d4d/d23/d55/d5f/f8a [2409664,113554] 0 2023-01-04T18:17:07.799 INFO:tasks.workunit.client.0.smithi050.stdout:4/586: rename d14/d1b/d1f/d22/d3e/d44/d59/d5f/f99 to d14/d1b/d32/fbc 0 2023-01-04T18:17:07.807 INFO:tasks.workunit.client.0.smithi050.stdout:7/677: dwrite d6/d6b/d8b/f91 [0,4194304] 0 2023-01-04T18:17:07.813 INFO:tasks.workunit.client.0.smithi050.stdout:9/578: symlink d1/d12/d3f/lb2 0 2023-01-04T18:17:07.813 INFO:tasks.workunit.client.0.smithi050.stdout:9/579: write d1/d3/d24/d97/da8/fb0 [792396,45633] 0 2023-01-04T18:17:07.814 INFO:tasks.workunit.client.0.smithi050.stdout:9/580: truncate d1/d3/d11/d1f/f21 5087305 0 2023-01-04T18:17:07.819 INFO:tasks.workunit.client.0.smithi050.stdout:8/670: link d3/d2a/d30/d3b/d4d/d23/d31/lb4 d3/d2a/d27/d93/d7f/d96/d46/lee 0 2023-01-04T18:17:07.819 INFO:tasks.workunit.client.0.smithi050.stdout:8/671: stat d3/d2a/d30/d3b/d4d/d23/d55/d5f 0 2023-01-04T18:17:07.824 INFO:tasks.workunit.client.0.smithi050.stdout:4/587: mknod d14/d1b/cbd 0 2023-01-04T18:17:07.825 INFO:tasks.workunit.client.0.smithi050.stdout:4/588: read d14/d1b/d1f/d22/f7c [2315436,88605] 0 2023-01-04T18:17:07.825 INFO:tasks.workunit.client.0.smithi050.stdout:4/589: truncate d14/d1b/d1f/d22/d3e/f8d 14396 0 2023-01-04T18:17:07.825 INFO:tasks.workunit.client.0.smithi050.stdout:4/590: readlink d14/d1b/d1f/la2 0 2023-01-04T18:17:07.835 INFO:tasks.workunit.client.0.smithi050.stdout:9/581: mkdir d1/d12/d41/d60/d7c/db3 0 2023-01-04T18:17:07.837 INFO:tasks.workunit.client.0.smithi050.stdout:8/672: unlink d3/d2a/d30/d3b/d4d/d23/d31/c3e 0 2023-01-04T18:17:07.837 INFO:tasks.workunit.client.0.smithi050.stdout:8/673: chown d3/fc6 136 1 2023-01-04T18:17:07.840 INFO:tasks.workunit.client.0.smithi050.stdout:3/591: rename d0/d1b/d2f/d56/d98/lac to d0/d1b/d2f/d56/d32/dbb/ld5 0 2023-01-04T18:17:07.842 INFO:tasks.workunit.client.0.smithi050.stdout:4/591: symlink d14/d1b/d1f/d63/da5/lbe 0 2023-01-04T18:17:07.842 INFO:tasks.workunit.client.0.smithi050.stdout:4/592: chown d14/d1b/d1f/d22/d3e/d44/d59/d5f 241899269 1 2023-01-04T18:17:07.844 INFO:tasks.workunit.client.0.smithi050.stdout:9/582: mknod d1/d3/d11/d42/cb4 0 2023-01-04T18:17:07.845 INFO:tasks.workunit.client.0.smithi050.stdout:8/674: creat d3/d2a/d30/d3b/d4d/d23/d55/d5f/d82/dcb/fef x:0 0 0 2023-01-04T18:17:07.848 INFO:tasks.workunit.client.0.smithi050.stdout:7/678: rename d6/d28/d99/dd7/d42/d5f to d6/d90/de3 0 2023-01-04T18:17:07.853 INFO:tasks.workunit.client.0.smithi050.stdout:7/679: dread d6/f27 [0,4194304] 0 2023-01-04T18:17:07.853 INFO:tasks.workunit.client.0.smithi050.stdout:7/680: fsync d6/db/f60 0 2023-01-04T18:17:07.853 INFO:tasks.workunit.client.0.smithi050.stdout:3/592: unlink d0/d1b/d2f/d56/d32/l2a 0 2023-01-04T18:17:07.853 INFO:tasks.workunit.client.0.smithi050.stdout:4/593: read d14/d1b/d1f/d22/d3e/f8d [10837,71542] 0 2023-01-04T18:17:07.855 INFO:tasks.workunit.client.0.smithi050.stdout:8/675: creat d3/d2a/d74/d92/ff0 x:0 0 0 2023-01-04T18:17:07.859 INFO:tasks.workunit.client.0.smithi050.stdout:7/681: truncate d6/d28/d99/dd7/d42/f56 1332743 0 2023-01-04T18:17:07.859 INFO:tasks.workunit.client.0.smithi050.stdout:7/682: chown d6/db/d20/d4f/d6e/ld1 4527517 1 2023-01-04T18:17:07.861 INFO:tasks.workunit.client.0.smithi050.stdout:3/593: symlink d0/d1b/d2f/d56/d98/d9c/dc9/ld6 0 2023-01-04T18:17:07.863 INFO:tasks.workunit.client.0.smithi050.stdout:4/594: rename d14/d1b/d1f/d63/l72 to d14/d1b/d1f/d22/da0/lbf 0 2023-01-04T18:17:07.863 INFO:tasks.workunit.client.0.smithi050.stdout:4/595: chown d14/d1b/d1f/d22/f4d 6 1 2023-01-04T18:17:07.865 INFO:tasks.workunit.client.0.smithi050.stdout:9/583: dread d1/d12/d2d/d39/fae [0,4194304] 0 2023-01-04T18:17:07.865 INFO:tasks.workunit.client.0.smithi050.stdout:8/676: mknod d3/d2a/d2d/d86/cf1 0 2023-01-04T18:17:07.866 INFO:tasks.workunit.client.0.smithi050.stdout:9/584: write d1/d3/d24/d97/da8/fb0 [382150,115551] 0 2023-01-04T18:17:07.873 INFO:tasks.workunit.client.0.smithi050.stdout:7/683: symlink d6/db/d15/d1b/le4 0 2023-01-04T18:17:07.875 INFO:tasks.workunit.client.0.smithi050.stdout:3/594: unlink d0/d1b/d2f/d56/d98/d9c/dcd/f5d 0 2023-01-04T18:17:07.876 INFO:tasks.workunit.client.0.smithi050.stdout:4/596: creat d14/d1b/d1f/d63/da5/db6/fc0 x:0 0 0 2023-01-04T18:17:07.876 INFO:tasks.workunit.client.0.smithi050.stdout:4/597: chown d14/f21 44 1 2023-01-04T18:17:07.881 INFO:tasks.workunit.client.0.smithi050.stdout:3/595: mknod d0/d1a/dc3/cd7 0 2023-01-04T18:17:07.881 INFO:tasks.workunit.client.0.smithi050.stdout:4/598: rmdir d14/d1b 39 2023-01-04T18:17:07.884 INFO:tasks.workunit.client.0.smithi050.stdout:9/585: dwrite d1/d3/d3b/d63/f3d [4194304,4194304] 0 2023-01-04T18:17:07.884 INFO:tasks.workunit.client.0.smithi050.stdout:9/586: stat d1/d3/d11 0 2023-01-04T18:17:07.884 INFO:tasks.workunit.client.0.smithi050.stdout:8/677: unlink d3/d2a/d27/d93/d7f/d96/c1c 0 2023-01-04T18:17:07.888 INFO:tasks.workunit.client.0.smithi050.stdout:7/684: link d6/db/d20/d4f/d6e/fd0 d6/db/d3b/fe5 0 2023-01-04T18:17:07.888 INFO:tasks.workunit.client.0.smithi050.stdout:7/685: chown d6/db/d3a/fb3 50 1 2023-01-04T18:17:07.895 INFO:tasks.workunit.client.0.smithi050.stdout:9/587: dread d1/d12/d41/d60/d95/f99 [4194304,4194304] 0 2023-01-04T18:17:07.994 INFO:tasks.workunit.client.0.smithi050.stdout:3/596: dwrite d0/dd/f11 [0,4194304] 0 2023-01-04T18:17:07.995 INFO:tasks.workunit.client.0.smithi050.stdout:7/686: dwrite d6/f13 [0,4194304] 0 2023-01-04T18:17:08.027 INFO:tasks.workunit.client.0.smithi050.stdout:8/678: rmdir d3/d2a/d30 39 2023-01-04T18:17:08.028 INFO:tasks.workunit.client.0.smithi050.stdout:8/679: read d3/d2a/f24 [3077463,90653] 0 2023-01-04T18:17:08.028 INFO:tasks.workunit.client.0.smithi050.stdout:8/680: dread - d3/d2a/d27/d93/d7a/fe0 zero size 2023-01-04T18:17:08.029 INFO:tasks.workunit.client.0.smithi050.stdout:9/588: creat d1/d3/d3b/fb5 x:0 0 0 2023-01-04T18:17:08.030 INFO:tasks.workunit.client.0.smithi050.stdout:3/597: creat d0/d1a/dc3/fd8 x:0 0 0 2023-01-04T18:17:08.030 INFO:tasks.workunit.client.0.smithi050.stdout:3/598: fdatasync d0/d1b/d2f/d56/fb0 0 2023-01-04T18:17:08.048 INFO:tasks.workunit.client.0.smithi050.stdout:7/687: mkdir d6/d28/dde/de6 0 2023-01-04T18:17:08.049 INFO:tasks.workunit.client.0.smithi050.stdout:8/681: symlink d3/d2a/d60/lf2 0 2023-01-04T18:17:08.050 INFO:tasks.workunit.client.0.smithi050.stdout:0/516: sync 2023-01-04T18:17:08.050 INFO:tasks.workunit.client.0.smithi050.stdout:1/591: sync 2023-01-04T18:17:08.050 INFO:tasks.workunit.client.0.smithi050.stdout:2/586: sync 2023-01-04T18:17:08.050 INFO:tasks.workunit.client.0.smithi050.stdout:5/740: sync 2023-01-04T18:17:08.051 INFO:tasks.workunit.client.0.smithi050.stdout:6/583: sync 2023-01-04T18:17:08.052 INFO:tasks.workunit.client.0.smithi050.stdout:9/589: creat d1/d3/d24/fb6 x:0 0 0 2023-01-04T18:17:08.052 INFO:tasks.workunit.client.0.smithi050.stdout:9/590: write d1/d3/d24/d97/da8/fb0 [1365143,46193] 0 2023-01-04T18:17:08.052 INFO:tasks.workunit.client.0.smithi050.stdout:3/599: dwrite d0/d1b/d2f/faf [0,4194304] 0 2023-01-04T18:17:08.054 INFO:tasks.workunit.client.0.smithi050.stdout:0/517: dread d0/d6/d8/f89 [0,4194304] 0 2023-01-04T18:17:08.055 INFO:tasks.workunit.client.0.smithi050.stdout:8/682: dread d3/d2a/d30/d3b/d53/f54 [0,4194304] 0 2023-01-04T18:17:08.055 INFO:tasks.workunit.client.0.smithi050.stdout:8/683: stat d3/d2a/d30/d3b/d4d/f88 0 2023-01-04T18:17:08.058 INFO:tasks.workunit.client.0.smithi050.stdout:6/584: rmdir d0/d9/d38/d1c/d54 39 2023-01-04T18:17:08.060 INFO:tasks.workunit.client.0.smithi050.stdout:2/587: rename d1/dd/d11/d14/f76 to d1/dd/d28/d2c/fc0 0 2023-01-04T18:17:08.061 INFO:tasks.workunit.client.0.smithi050.stdout:5/741: creat d13/d15/d66/db8/d27/d44/d101/f10e x:0 0 0 2023-01-04T18:17:08.061 INFO:tasks.workunit.client.0.smithi050.stdout:2/588: write d1/dd/d38/fb9 [2880607,52551] 0 2023-01-04T18:17:08.062 INFO:tasks.workunit.client.0.smithi050.stdout:1/592: dread d8/d14/d1c/d28/f59 [4194304,4194304] 0 2023-01-04T18:17:08.062 INFO:tasks.workunit.client.0.smithi050.stdout:1/593: chown d8/d48/d5c/c88 0 1 2023-01-04T18:17:08.062 INFO:tasks.workunit.client.0.smithi050.stdout:9/591: creat d1/d6f/fb7 x:0 0 0 2023-01-04T18:17:08.063 INFO:tasks.workunit.client.0.smithi050.stdout:2/589: dread d1/dd/d28/d2c/d2e/d3f/f64 [0,4194304] 0 2023-01-04T18:17:08.063 INFO:tasks.workunit.client.0.smithi050.stdout:1/594: read d8/d48/d5c/d67/d3b/f68 [2811683,7808] 0 2023-01-04T18:17:08.069 INFO:tasks.workunit.client.0.smithi050.stdout:3/600: mknod d0/d8f/cd9 0 2023-01-04T18:17:08.069 INFO:tasks.workunit.client.0.smithi050.stdout:3/601: write d0/fe [5182372,41406] 0 2023-01-04T18:17:08.069 INFO:tasks.workunit.client.0.smithi050.stdout:3/602: readlink d0/dd/d45/l7c 0 2023-01-04T18:17:08.069 INFO:tasks.workunit.client.0.smithi050.stdout:3/603: write d0/d1b/d2f/d56/d6b/dcb/fd1 [687555,82401] 0 2023-01-04T18:17:08.070 INFO:tasks.workunit.client.0.smithi050.stdout:0/518: link d0/d6/d28/d1a/f70 d0/d6/d8/d4f/fa6 0 2023-01-04T18:17:08.070 INFO:tasks.workunit.client.0.smithi050.stdout:0/519: write d0/d6/d8/f89 [1233053,64791] 0 2023-01-04T18:17:08.071 INFO:tasks.workunit.client.0.smithi050.stdout:7/688: dwrite d6/d90/de3/fc0 [0,4194304] 0 2023-01-04T18:17:08.071 INFO:tasks.workunit.client.0.smithi050.stdout:6/585: rmdir d0/d9/d25/d2d 39 2023-01-04T18:17:08.076 INFO:tasks.workunit.client.0.smithi050.stdout:8/684: rename d3/d2a/d27/d93/d7f/d96/d46/fb2 to d3/d2a/d27/dc1/ff3 0 2023-01-04T18:17:08.076 INFO:tasks.workunit.client.0.smithi050.stdout:8/685: chown d3/d2a/d27/dc1/fe7 1388166 1 2023-01-04T18:17:08.082 INFO:tasks.workunit.client.0.smithi050.stdout:5/742: creat d13/d15/d66/db2/f10f x:0 0 0 2023-01-04T18:17:08.082 INFO:tasks.workunit.client.0.smithi050.stdout:5/743: readlink l10 0 2023-01-04T18:17:08.083 INFO:tasks.workunit.client.0.smithi050.stdout:9/592: truncate d1/d3/d24/f55 3105611 0 2023-01-04T18:17:08.087 INFO:tasks.workunit.client.0.smithi050.stdout:1/595: rmdir d8/d14/d1c/d28/d57/d6a 39 2023-01-04T18:17:08.089 INFO:tasks.workunit.client.0.smithi050.stdout:7/689: dwrite d6/d28/f2c [4194304,4194304] 0 2023-01-04T18:17:08.090 INFO:tasks.workunit.client.0.smithi050.stdout:1/596: dread d8/d48/d5c/d67/d3a/f6d [0,4194304] 0 2023-01-04T18:17:08.090 INFO:tasks.workunit.client.0.smithi050.stdout:1/597: chown d8/d48/d5c/d67/d3a/f6d 4 1 2023-01-04T18:17:08.093 INFO:tasks.workunit.client.0.smithi050.stdout:3/604: getdents d0/d1b/d2f/d56/d98/d9c 0 2023-01-04T18:17:08.096 INFO:tasks.workunit.client.0.smithi050.stdout:0/520: mknod d0/d73/ca7 0 2023-01-04T18:17:08.106 INFO:tasks.workunit.client.0.smithi050.stdout:1/598: dwrite d8/d14/d1c/f40 [0,4194304] 0 2023-01-04T18:17:08.106 INFO:tasks.workunit.client.0.smithi050.stdout:1/599: fsync d8/d48/d5c/d67/fa9 0 2023-01-04T18:17:08.108 INFO:tasks.workunit.client.0.smithi050.stdout:6/586: mknod d0/d9/d25/cb0 0 2023-01-04T18:17:08.108 INFO:tasks.workunit.client.0.smithi050.stdout:3/605: dwrite d0/dd/d45/f95 [0,4194304] 0 2023-01-04T18:17:08.109 INFO:tasks.workunit.client.0.smithi050.stdout:2/590: rename d1/dd/d11/d14/d44/l5c to d1/dd/d11/db5/lc1 0 2023-01-04T18:17:08.112 INFO:tasks.workunit.client.0.smithi050.stdout:8/686: creat d3/d2a/d2d/d86/ff4 x:0 0 0 2023-01-04T18:17:08.112 INFO:tasks.workunit.client.0.smithi050.stdout:8/687: getdents d3/d2a/d27/d93/d7f/d96/db6/de5 0 2023-01-04T18:17:08.114 INFO:tasks.workunit.client.0.smithi050.stdout:4/599: sync 2023-01-04T18:17:08.114 INFO:tasks.workunit.client.0.smithi050.stdout:8/688: write d3/d2a/f24 [5430549,119363] 0 2023-01-04T18:17:08.115 INFO:tasks.workunit.client.0.smithi050.stdout:4/600: write d14/d1b/d1f/d22/d3e/d85/f94 [525790,14377] 0 2023-01-04T18:17:08.115 INFO:tasks.workunit.client.0.smithi050.stdout:5/744: symlink d13/d15/d63/l110 0 2023-01-04T18:17:08.115 INFO:tasks.workunit.client.0.smithi050.stdout:4/601: write d14/d1b/d32/f45 [2173665,80311] 0 2023-01-04T18:17:08.118 INFO:tasks.workunit.client.0.smithi050.stdout:9/593: symlink d1/d3/d13/d77/lb8 0 2023-01-04T18:17:08.118 INFO:tasks.workunit.client.0.smithi050.stdout:9/594: dread - d1/d6f/fb7 zero size 2023-01-04T18:17:08.120 INFO:tasks.workunit.client.0.smithi050.stdout:7/690: symlink d6/d28/d32/d9d/le7 0 2023-01-04T18:17:08.121 INFO:tasks.workunit.client.0.smithi050.stdout:0/521: creat d0/d6/d8/d35/fa8 x:0 0 0 2023-01-04T18:17:08.125 INFO:tasks.workunit.client.0.smithi050.stdout:1/600: creat d8/d48/d5c/d67/d3b/fb6 x:0 0 0 2023-01-04T18:17:08.125 INFO:tasks.workunit.client.0.smithi050.stdout:4/602: dread d14/d1b/d1f/f46 [0,4194304] 0 2023-01-04T18:17:08.126 INFO:tasks.workunit.client.0.smithi050.stdout:6/587: mkdir d0/d4a/d93/db1 0 2023-01-04T18:17:08.129 INFO:tasks.workunit.client.0.smithi050.stdout:9/595: dread d1/d12/f5f [0,4194304] 0 2023-01-04T18:17:08.130 INFO:tasks.workunit.client.0.smithi050.stdout:9/596: write d1/d3/d3b/f9a [1004934,80194] 0 2023-01-04T18:17:08.130 INFO:tasks.workunit.client.0.smithi050.stdout:9/597: chown d1/d3/d11/l7f 0 1 2023-01-04T18:17:08.134 INFO:tasks.workunit.client.0.smithi050.stdout:5/745: dwrite d13/fe4 [0,4194304] 0 2023-01-04T18:17:08.140 INFO:tasks.workunit.client.0.smithi050.stdout:1/601: dread d8/d48/d5c/d67/d3a/f79 [0,4194304] 0 2023-01-04T18:17:08.158 INFO:tasks.workunit.client.0.smithi050.stdout:3/606: unlink d0/d1b/d2f/l87 0 2023-01-04T18:17:08.158 INFO:tasks.workunit.client.0.smithi050.stdout:3/607: fdatasync d0/d1a/f24 0 2023-01-04T18:17:08.158 INFO:tasks.workunit.client.0.smithi050.stdout:3/608: fdatasync d0/fb 0 2023-01-04T18:17:08.160 INFO:tasks.workunit.client.0.smithi050.stdout:2/591: symlink d1/dd/d28/d2c/d2e/d36/lc2 0 2023-01-04T18:17:08.162 INFO:tasks.workunit.client.0.smithi050.stdout:8/689: creat d3/d2a/d27/d93/d7f/d96/ff5 x:0 0 0 2023-01-04T18:17:08.165 INFO:tasks.workunit.client.0.smithi050.stdout:0/522: symlink d0/d6/d8/d25/d8e/la9 0 2023-01-04T18:17:08.166 INFO:tasks.workunit.client.0.smithi050.stdout:0/523: fsync d0/d6/d8/d25/f8c 0 2023-01-04T18:17:08.166 INFO:tasks.workunit.client.0.smithi050.stdout:0/524: readlink d0/d6/d28/d1a/l39 0 2023-01-04T18:17:08.167 INFO:tasks.workunit.client.0.smithi050.stdout:4/603: truncate d14/f1c 107957 0 2023-01-04T18:17:08.167 INFO:tasks.workunit.client.0.smithi050.stdout:4/604: readlink d14/d1b/d32/l82 0 2023-01-04T18:17:08.167 INFO:tasks.workunit.client.0.smithi050.stdout:4/605: fsync d14/d1b/d1f/f4a 0 2023-01-04T18:17:08.170 INFO:tasks.workunit.client.0.smithi050.stdout:6/588: rmdir d0/d9/d25/d40/d89 39 2023-01-04T18:17:08.170 INFO:tasks.workunit.client.0.smithi050.stdout:6/589: fsync d0/d9/d25/f27 0 2023-01-04T18:17:08.172 INFO:tasks.workunit.client.0.smithi050.stdout:9/598: rename d1/d3/f4 to d1/d3/d89/fb9 0 2023-01-04T18:17:08.172 INFO:tasks.workunit.client.0.smithi050.stdout:9/599: read - d1/d3/d24/fb6 zero size 2023-01-04T18:17:08.172 INFO:tasks.workunit.client.0.smithi050.stdout:8/690: dread d3/d2a/d27/d93/fce [0,4194304] 0 2023-01-04T18:17:08.183 INFO:tasks.workunit.client.0.smithi050.stdout:5/746: mkdir d13/d15/d66/db8/d27/d44/df2/d111 0 2023-01-04T18:17:08.183 INFO:tasks.workunit.client.0.smithi050.stdout:5/747: dread - d13/d15/d66/db8/dd9/f10b zero size 2023-01-04T18:17:08.188 INFO:tasks.workunit.client.0.smithi050.stdout:1/602: creat d8/d14/d1c/d28/d57/d6a/d92/fb7 x:0 0 0 2023-01-04T18:17:08.189 INFO:tasks.workunit.client.0.smithi050.stdout:1/603: readlink d8/d48/l75 0 2023-01-04T18:17:08.192 INFO:tasks.workunit.client.0.smithi050.stdout:6/590: dwrite d0/d9/d38/f15 [0,4194304] 0 2023-01-04T18:17:08.192 INFO:tasks.workunit.client.0.smithi050.stdout:6/591: chown d0/c4 59236 1 2023-01-04T18:17:08.193 INFO:tasks.workunit.client.0.smithi050.stdout:3/609: chown d0/d1a/c2b 77634725 1 2023-01-04T18:17:08.194 INFO:tasks.workunit.client.0.smithi050.stdout:1/604: dread d8/f89 [0,4194304] 0 2023-01-04T18:17:08.195 INFO:tasks.workunit.client.0.smithi050.stdout:6/592: write d0/d9/d38/d60/f82 [751583,37837] 0 2023-01-04T18:17:08.195 INFO:tasks.workunit.client.0.smithi050.stdout:6/593: stat d0/d9/d25/d40/c7f 0 2023-01-04T18:17:08.196 INFO:tasks.workunit.client.0.smithi050.stdout:2/592: link d1/dd/d11/d14/d44/fb7 d1/d41/fc3 0 2023-01-04T18:17:08.197 INFO:tasks.workunit.client.0.smithi050.stdout:0/525: unlink d0/d6/d28/f60 0 2023-01-04T18:17:08.202 INFO:tasks.workunit.client.0.smithi050.stdout:9/600: unlink d1/c37 0 2023-01-04T18:17:08.205 INFO:tasks.workunit.client.0.smithi050.stdout:8/691: creat d3/d2a/d27/deb/ff6 x:0 0 0 2023-01-04T18:17:08.212 INFO:tasks.workunit.client.0.smithi050.stdout:5/748: symlink d13/d15/d66/db8/d27/d46/d4e/d4d/db1/dbc/l112 0 2023-01-04T18:17:08.213 INFO:tasks.workunit.client.0.smithi050.stdout:3/610: getdents d0/d1b/d2f/d56/d6b/dcb 0 2023-01-04T18:17:08.213 INFO:tasks.workunit.client.0.smithi050.stdout:3/611: dread - d0/d1b/d2f/d56/d32/fb2 zero size 2023-01-04T18:17:08.216 INFO:tasks.workunit.client.0.smithi050.stdout:1/605: creat d8/fb8 x:0 0 0 2023-01-04T18:17:08.216 INFO:tasks.workunit.client.0.smithi050.stdout:1/606: stat d8/d14/d1c/d28/fb5 0 2023-01-04T18:17:08.219 INFO:tasks.workunit.client.0.smithi050.stdout:6/594: mknod d0/d9/df/d74/cb2 0 2023-01-04T18:17:08.220 INFO:tasks.workunit.client.0.smithi050.stdout:6/595: write d0/d9/d38/d1c/d54/f63 [2691693,120381] 0 2023-01-04T18:17:08.230 INFO:tasks.workunit.client.0.smithi050.stdout:5/749: dwrite d13/d15/d66/db8/d1f/d35/d59/fb6 [0,4194304] 0 2023-01-04T18:17:08.257 INFO:tasks.workunit.client.0.smithi050.stdout:2/593: symlink d1/dd/d62/da1/d83/lc4 0 2023-01-04T18:17:08.258 INFO:tasks.workunit.client.0.smithi050.stdout:0/526: unlink d0/d9f/l85 0 2023-01-04T18:17:08.259 INFO:tasks.workunit.client.0.smithi050.stdout:4/606: mkdir d14/d1b/d66/dc1 0 2023-01-04T18:17:08.260 INFO:tasks.workunit.client.0.smithi050.stdout:9/601: rename d1/d3/d3b/fb5 to d1/d3/d13/d77/fba 0 2023-01-04T18:17:08.332 INFO:tasks.workunit.client.0.smithi050.stdout:8/692: rmdir d3/d2a/d74 39 2023-01-04T18:17:08.334 INFO:tasks.workunit.client.0.smithi050.stdout:6/596: creat d0/d4a/fb3 x:0 0 0 2023-01-04T18:17:08.335 INFO:tasks.workunit.client.0.smithi050.stdout:6/597: stat d0/d9/d25/d2d/l59 0 2023-01-04T18:17:08.343 INFO:tasks.workunit.client.0.smithi050.stdout:5/750: symlink d13/d15/d66/db8/d27/l113 0 2023-01-04T18:17:08.343 INFO:tasks.workunit.client.0.smithi050.stdout:3/612: dread d0/d1a/f58 [0,4194304] 0 2023-01-04T18:17:08.343 INFO:tasks.workunit.client.0.smithi050.stdout:3/613: fsync d0/f5e 0 2023-01-04T18:17:08.343 INFO:tasks.workunit.client.0.smithi050.stdout:3/614: write d0/d10/f3e [838865,96810] 0 2023-01-04T18:17:08.343 INFO:tasks.workunit.client.0.smithi050.stdout:3/615: write d0/d1b/d2f/fbc [369561,25521] 0 2023-01-04T18:17:08.344 INFO:tasks.workunit.client.0.smithi050.stdout:2/594: mkdir d1/dd/d11/d14/d91/d5a/d7f/dc5 0 2023-01-04T18:17:08.347 INFO:tasks.workunit.client.0.smithi050.stdout:0/527: mknod d0/caa 0 2023-01-04T18:17:08.347 INFO:tasks.workunit.client.0.smithi050.stdout:0/528: truncate d0/d6/d8/f89 1705002 0 2023-01-04T18:17:08.349 INFO:tasks.workunit.client.0.smithi050.stdout:4/607: truncate d14/d1b/d1f/d22/d6a/f6b 3791813 0 2023-01-04T18:17:08.349 INFO:tasks.workunit.client.0.smithi050.stdout:9/602: creat d1/d12/d9f/fbb x:0 0 0 2023-01-04T18:17:08.359 INFO:tasks.workunit.client.0.smithi050.stdout:9/603: dread d1/d12/f44 [0,4194304] 0 2023-01-04T18:17:08.365 INFO:tasks.workunit.client.0.smithi050.stdout:5/751: dwrite d13/d15/d66/db8/d1f/d35/d42/d4a/f5a [0,4194304] 0 2023-01-04T18:17:08.370 INFO:tasks.workunit.client.0.smithi050.stdout:8/693: mknod d3/d2a/d2d/d86/cf7 0 2023-01-04T18:17:08.375 INFO:tasks.workunit.client.0.smithi050.stdout:6/598: rename d0/d9/d38/l5e to d0/d4a/d93/db1/lb4 0 2023-01-04T18:17:08.375 INFO:tasks.workunit.client.0.smithi050.stdout:6/599: dread - d0/d9/f2b zero size 2023-01-04T18:17:08.554 INFO:tasks.workunit.client.0.smithi050.stdout:3/616: creat d0/d1b/d2f/d71/fda x:0 0 0 2023-01-04T18:17:08.562 INFO:tasks.workunit.client.0.smithi050.stdout:3/617: dread d0/d1b/d2f/d56/d98/fb4 [0,4194304] 0 2023-01-04T18:17:08.562 INFO:tasks.workunit.client.0.smithi050.stdout:3/618: write d0/d8f/f27 [2776360,80484] 0 2023-01-04T18:17:08.562 INFO:tasks.workunit.client.0.smithi050.stdout:3/619: chown d0/dd/c55 908377 1 2023-01-04T18:17:08.578 INFO:tasks.workunit.client.0.smithi050.stdout:4/608: creat d14/d1b/d1f/d22/d87/fc2 x:0 0 0 2023-01-04T18:17:08.579 INFO:tasks.workunit.client.0.smithi050.stdout:4/609: write d14/d1b/d32/f45 [1737188,26712] 0 2023-01-04T18:17:08.592 INFO:tasks.workunit.client.0.smithi050.stdout:2/595: unlink d1/f8 0 2023-01-04T18:17:08.592 INFO:tasks.workunit.client.0.smithi050.stdout:2/596: dread - d1/dd/d62/da1/d6e/f9e zero size 2023-01-04T18:17:08.592 INFO:tasks.workunit.client.0.smithi050.stdout:2/597: stat d1/dd/d11 0 2023-01-04T18:17:08.592 INFO:tasks.workunit.client.0.smithi050.stdout:2/598: chown d1/dd/d62/da1/caa 6 1 2023-01-04T18:17:08.592 INFO:tasks.workunit.client.0.smithi050.stdout:2/599: write d1/dd/d11/f9c [7916,97314] 0 2023-01-04T18:17:08.596 INFO:tasks.workunit.client.0.smithi050.stdout:9/604: unlink d1/d3/d11/c76 0 2023-01-04T18:17:08.596 INFO:tasks.workunit.client.0.smithi050.stdout:4/610: dwrite d14/d1b/d1f/f57 [0,4194304] 0 2023-01-04T18:17:08.596 INFO:tasks.workunit.client.0.smithi050.stdout:9/605: stat d1/d6f/l79 0 2023-01-04T18:17:08.597 INFO:tasks.workunit.client.0.smithi050.stdout:9/606: readlink d1/d3/d13/d77/lb8 0 2023-01-04T18:17:08.597 INFO:tasks.workunit.client.0.smithi050.stdout:4/611: readlink d14/la7 0 2023-01-04T18:17:08.603 INFO:tasks.workunit.client.0.smithi050.stdout:8/694: stat d3/d2a/d30/d3b/d4d/d23/d55/f5a 0 2023-01-04T18:17:08.609 INFO:tasks.workunit.client.0.smithi050.stdout:6/600: creat d0/fb5 x:0 0 0 2023-01-04T18:17:08.609 INFO:tasks.workunit.client.0.smithi050.stdout:6/601: chown d0/d9/c20 98233286 1 2023-01-04T18:17:08.617 INFO:tasks.workunit.client.0.smithi050.stdout:5/752: dwrite d13/d15/d66/db8/d27/d46/d4e/d4d/da9/fe3 [0,4194304] 0 2023-01-04T18:17:08.620 INFO:tasks.workunit.client.0.smithi050.stdout:3/620: creat d0/d1b/d2f/d56/d6b/fdb x:0 0 0 2023-01-04T18:17:08.626 INFO:tasks.workunit.client.0.smithi050.stdout:2/600: mknod d1/cc6 0 2023-01-04T18:17:08.626 INFO:tasks.workunit.client.0.smithi050.stdout:2/601: write d1/dd/d28/d2c/d66/f87 [4303703,912] 0 2023-01-04T18:17:08.628 INFO:tasks.workunit.client.0.smithi050.stdout:7/691: sync 2023-01-04T18:17:08.630 INFO:tasks.workunit.client.0.smithi050.stdout:1/607: sync 2023-01-04T18:17:08.632 INFO:tasks.workunit.client.0.smithi050.stdout:9/607: symlink d1/d3/d3b/lbc 0 2023-01-04T18:17:08.635 INFO:tasks.workunit.client.0.smithi050.stdout:4/612: creat d14/d1b/d1f/d22/d3e/d44/d59/d5f/d6f/fc3 x:0 0 0 2023-01-04T18:17:08.635 INFO:tasks.workunit.client.0.smithi050.stdout:4/613: write d14/d1b/d1f/d22/d87/fc2 [806542,19998] 0 2023-01-04T18:17:08.637 INFO:tasks.workunit.client.0.smithi050.stdout:0/529: sync 2023-01-04T18:17:08.640 INFO:tasks.workunit.client.0.smithi050.stdout:6/602: mkdir d0/db6 0 2023-01-04T18:17:08.644 INFO:tasks.workunit.client.0.smithi050.stdout:5/753: link d13/d28/fa4 d13/d15/d66/db8/d27/d44/d101/f114 0 2023-01-04T18:17:08.646 INFO:tasks.workunit.client.0.smithi050.stdout:3/621: mknod d0/d1b/d2f/d56/d98/d9c/cdc 0 2023-01-04T18:17:08.653 INFO:tasks.workunit.client.0.smithi050.stdout:2/602: mknod d1/dd/d28/d2c/cc7 0 2023-01-04T18:17:08.655 INFO:tasks.workunit.client.0.smithi050.stdout:7/692: symlink d6/d1d/d1f/le8 0 2023-01-04T18:17:08.663 INFO:tasks.workunit.client.0.smithi050.stdout:1/608: mkdir d8/d48/d5c/d67/d3b/db9 0 2023-01-04T18:17:08.663 INFO:tasks.workunit.client.0.smithi050.stdout:1/609: fsync d8/d48/d5c/d67/d3a/f6d 0 2023-01-04T18:17:08.663 INFO:tasks.workunit.client.0.smithi050.stdout:4/614: unlink d14/d1b/d1f/d22/d3e/c58 0 2023-01-04T18:17:08.666 INFO:tasks.workunit.client.0.smithi050.stdout:6/603: unlink d0/fa7 0 2023-01-04T18:17:08.668 INFO:tasks.workunit.client.0.smithi050.stdout:8/695: rename d3/d2a/d74/d92/fcf to d3/d2a/d30/d3b/d4d/d23/d55/d5f/d82/ff8 0 2023-01-04T18:17:08.668 INFO:tasks.workunit.client.0.smithi050.stdout:1/610: creat d8/d48/fba x:0 0 0 2023-01-04T18:17:08.668 INFO:tasks.workunit.client.0.smithi050.stdout:1/611: chown d8/d48/d5c/d67/d3b/c90 0 1 2023-01-04T18:17:08.668 INFO:tasks.workunit.client.0.smithi050.stdout:1/612: chown d8/d14/fb3 1041904232 1 2023-01-04T18:17:08.669 INFO:tasks.workunit.client.0.smithi050.stdout:0/530: creat d0/d73/d68/fab x:0 0 0 2023-01-04T18:17:08.669 INFO:tasks.workunit.client.0.smithi050.stdout:0/531: write d0/d6/d28/f49 [3793019,129005] 0 2023-01-04T18:17:08.669 INFO:tasks.workunit.client.0.smithi050.stdout:2/603: symlink d1/dd/d11/d12/lc8 0 2023-01-04T18:17:08.671 INFO:tasks.workunit.client.0.smithi050.stdout:4/615: rename d14 to d14/d1b/d32/dc4 22 2023-01-04T18:17:08.671 INFO:tasks.workunit.client.0.smithi050.stdout:4/616: write d14/d1b/f41 [1456281,99545] 0 2023-01-04T18:17:08.672 INFO:tasks.workunit.client.0.smithi050.stdout:6/604: unlink d0/d9/cb 0 2023-01-04T18:17:08.677 INFO:tasks.workunit.client.0.smithi050.stdout:1/613: link d8/d48/d5c/d67/d3b/l8e d8/d48/d8c/d72/lbb 0 2023-01-04T18:17:08.677 INFO:tasks.workunit.client.0.smithi050.stdout:2/604: write d1/dd/d11/d14/d91/f5f [1642860,109152] 0 2023-01-04T18:17:08.678 INFO:tasks.workunit.client.0.smithi050.stdout:9/608: dwrite d1/d3/d13/f94 [0,4194304] 0 2023-01-04T18:17:08.678 INFO:tasks.workunit.client.0.smithi050.stdout:9/609: write d1/d12/d41/d60/fa2 [547083,76414] 0 2023-01-04T18:17:08.678 INFO:tasks.workunit.client.0.smithi050.stdout:5/754: dwrite d13/d15/d66/db8/d1f/d35/d42/d4a/fbf [0,4194304] 0 2023-01-04T18:17:08.678 INFO:tasks.workunit.client.0.smithi050.stdout:5/755: dread - d13/d15/d66/db8/d1f/d35/d42/dec/f108 zero size 2023-01-04T18:17:08.680 INFO:tasks.workunit.client.0.smithi050.stdout:0/532: symlink d0/d6/d28/d1a/lac 0 2023-01-04T18:17:08.681 INFO:tasks.workunit.client.0.smithi050.stdout:4/617: mknod d14/d1b/d66/dc1/cc5 0 2023-01-04T18:17:08.683 INFO:tasks.workunit.client.0.smithi050.stdout:3/622: dwrite d0/d1b/d2f/d31/f8e [0,4194304] 0 2023-01-04T18:17:08.684 INFO:tasks.workunit.client.0.smithi050.stdout:6/605: rename d0/d71 to d0/d5c/db7 0 2023-01-04T18:17:08.690 INFO:tasks.workunit.client.0.smithi050.stdout:6/606: write d0/d5c/d5d/faf [2858866,25845] 0 2023-01-04T18:17:08.699 INFO:tasks.workunit.client.0.smithi050.stdout:1/614: dread d8/d14/d1c/d28/f3f [0,4194304] 0 2023-01-04T18:17:08.700 INFO:tasks.workunit.client.0.smithi050.stdout:1/615: readlink d8/d48/d8c/d72/lbb 0 2023-01-04T18:17:08.700 INFO:tasks.workunit.client.0.smithi050.stdout:4/618: write d14/d1b/d1f/d22/d3e/d85/da6/fbb [1868482,50765] 0 2023-01-04T18:17:08.700 INFO:tasks.workunit.client.0.smithi050.stdout:4/619: truncate d14/d1b/d1f/d22/d3e/d44/d59/d5f/f78 4911871 0 2023-01-04T18:17:08.700 INFO:tasks.workunit.client.0.smithi050.stdout:4/620: read - d14/d1b/d1f/d22/d3e/d44/d59/d5f/fb1 zero size 2023-01-04T18:17:08.700 INFO:tasks.workunit.client.0.smithi050.stdout:7/693: dwrite d6/db/d3b/f4c [0,4194304] 0 2023-01-04T18:17:08.700 INFO:tasks.workunit.client.0.smithi050.stdout:7/694: fsync d6/db/d20/d4f/d8a/fdc 0 2023-01-04T18:17:08.700 INFO:tasks.workunit.client.0.smithi050.stdout:7/695: chown d6/db/d15/d1b/d22/f39 4424 1 2023-01-04T18:17:08.700 INFO:tasks.workunit.client.0.smithi050.stdout:7/696: fsync d6/f23 0 2023-01-04T18:17:08.700 INFO:tasks.workunit.client.0.smithi050.stdout:8/696: dwrite d3/d2a/d60/f71 [0,4194304] 0 2023-01-04T18:17:08.701 INFO:tasks.workunit.client.0.smithi050.stdout:0/533: truncate d0/d6/d8/f2a 1663617 0 2023-01-04T18:17:08.701 INFO:tasks.workunit.client.0.smithi050.stdout:8/697: write d3/d2a/d2d/f50 [1325884,27238] 0 2023-01-04T18:17:08.701 INFO:tasks.workunit.client.0.smithi050.stdout:0/534: write d0/d6/d8/d35/fa4 [700143,114453] 0 2023-01-04T18:17:08.701 INFO:tasks.workunit.client.0.smithi050.stdout:0/535: dread - d0/d6/d28/f77 zero size 2023-01-04T18:17:08.701 INFO:tasks.workunit.client.0.smithi050.stdout:0/536: fsync d0/d6/d8/d35/fa8 0 2023-01-04T18:17:08.701 INFO:tasks.workunit.client.0.smithi050.stdout:0/537: write d0/d6/d8/d35/f66 [118126,119826] 0 2023-01-04T18:17:08.701 INFO:tasks.workunit.client.0.smithi050.stdout:8/698: read d3/d2a/f89 [3080546,111678] 0 2023-01-04T18:17:08.702 INFO:tasks.workunit.client.0.smithi050.stdout:2/605: dwrite d1/dd/d11/d12/f59 [0,4194304] 0 2023-01-04T18:17:08.702 INFO:tasks.workunit.client.0.smithi050.stdout:2/606: dread - d1/dd/d11/d14/f8b zero size 2023-01-04T18:17:08.702 INFO:tasks.workunit.client.0.smithi050.stdout:2/607: dread - d1/dd/d62/da1/d6e/f9e zero size 2023-01-04T18:17:08.702 INFO:tasks.workunit.client.0.smithi050.stdout:2/608: chown d1/dd/d28/d2c 4216107 1 2023-01-04T18:17:08.702 INFO:tasks.workunit.client.0.smithi050.stdout:4/621: write d14/d1b/d1f/f57 [2968686,22313] 0 2023-01-04T18:17:08.702 INFO:tasks.workunit.client.0.smithi050.stdout:9/610: dwrite d1/d12/d2d/d39/f4d [4194304,4194304] 0 2023-01-04T18:17:08.709 INFO:tasks.workunit.client.0.smithi050.stdout:3/623: dread d0/d1a/f57 [0,4194304] 0 2023-01-04T18:17:08.710 INFO:tasks.workunit.client.0.smithi050.stdout:3/624: chown d0/d10/f70 726916806 1 2023-01-04T18:17:08.710 INFO:tasks.workunit.client.0.smithi050.stdout:3/625: fdatasync d0/d1b/d2f/d31/f8e 0 2023-01-04T18:17:08.714 INFO:tasks.workunit.client.0.smithi050.stdout:1/616: dwrite d8/d14/d1c/d28/d57/d6a/f95 [0,4194304] 0 2023-01-04T18:17:08.714 INFO:tasks.workunit.client.0.smithi050.stdout:1/617: write d8/d48/d5c/f65 [557276,38665] 0 2023-01-04T18:17:08.723 INFO:tasks.workunit.client.0.smithi050.stdout:2/609: dwrite d1/dd/d11/d14/f33 [0,4194304] 0 2023-01-04T18:17:08.748 INFO:tasks.workunit.client.0.smithi050.stdout:7/697: link d6/db/d15/d1b/d22/da6/lca d6/le9 0 2023-01-04T18:17:08.754 INFO:tasks.workunit.client.0.smithi050.stdout:0/538: creat d0/d6/d28/fad x:0 0 0 2023-01-04T18:17:08.754 INFO:tasks.workunit.client.0.smithi050.stdout:0/539: truncate d0/d6/d8/f18 9264151 0 2023-01-04T18:17:08.755 INFO:tasks.workunit.client.0.smithi050.stdout:0/540: write d0/d6/f26 [5278639,97480] 0 2023-01-04T18:17:08.755 INFO:tasks.workunit.client.0.smithi050.stdout:0/541: chown d0/d73/d68/c90 1 1 2023-01-04T18:17:08.758 INFO:tasks.workunit.client.0.smithi050.stdout:8/699: mknod d3/d2a/d27/d93/d7f/d96/db6/cf9 0 2023-01-04T18:17:08.758 INFO:tasks.workunit.client.0.smithi050.stdout:8/700: write d3/d2a/d60/d2c/fe3 [721664,13662] 0 2023-01-04T18:17:08.765 INFO:tasks.workunit.client.0.smithi050.stdout:5/756: mkdir d13/d15/d66/db8/d27/d46/d4e/d4d/d115 0 2023-01-04T18:17:08.773 INFO:tasks.workunit.client.0.smithi050.stdout:5/757: dread d13/d15/d66/db8/d1f/f80 [0,4194304] 0 2023-01-04T18:17:08.782 INFO:tasks.workunit.client.0.smithi050.stdout:4/622: creat d14/d1b/d1f/fc6 x:0 0 0 2023-01-04T18:17:08.784 INFO:tasks.workunit.client.0.smithi050.stdout:9/611: mkdir d1/d3/d11/d42/dbd 0 2023-01-04T18:17:08.788 INFO:tasks.workunit.client.0.smithi050.stdout:8/701: dwrite d3/d2a/f9b [0,4194304] 0 2023-01-04T18:17:08.788 INFO:tasks.workunit.client.0.smithi050.stdout:8/702: stat d3/d2a/d60/lf2 0 2023-01-04T18:17:08.789 INFO:tasks.workunit.client.0.smithi050.stdout:3/626: rmdir d0/d8f/d46 39 2023-01-04T18:17:08.793 INFO:tasks.workunit.client.0.smithi050.stdout:1/618: getdents d8/d14/d1c/d28/d57 0 2023-01-04T18:17:08.796 INFO:tasks.workunit.client.0.smithi050.stdout:2/610: creat d1/dd/d11/d14/d91/d5a/d7f/dc5/fc9 x:0 0 0 2023-01-04T18:17:08.796 INFO:tasks.workunit.client.0.smithi050.stdout:7/698: symlink d6/d6b/lea 0 2023-01-04T18:17:08.805 INFO:tasks.workunit.client.0.smithi050.stdout:7/699: dread d6/d1d/d1f/d80/f93 [0,4194304] 0 2023-01-04T18:17:08.807 INFO:tasks.workunit.client.0.smithi050.stdout:7/700: write d6/db/d15/d1b/d22/f54 [3320281,58840] 0 2023-01-04T18:17:08.808 INFO:tasks.workunit.client.0.smithi050.stdout:9/612: dwrite d1/d12/d9f/fa0 [0,4194304] 0 2023-01-04T18:17:08.809 INFO:tasks.workunit.client.0.smithi050.stdout:7/701: write d6/d90/de3/fc0 [3793020,84138] 0 2023-01-04T18:17:08.810 INFO:tasks.workunit.client.0.smithi050.stdout:0/542: mknod d0/d6/d28/d1a/d8a/cae 0 2023-01-04T18:17:08.812 INFO:tasks.workunit.client.0.smithi050.stdout:0/543: dread d0/d6/d8/d35/f66 [0,4194304] 0 2023-01-04T18:17:08.812 INFO:tasks.workunit.client.0.smithi050.stdout:0/544: fsync d0/f3b 0 2023-01-04T18:17:08.812 INFO:tasks.workunit.client.0.smithi050.stdout:0/545: truncate d0/d6/d8/d4f/fa6 1119796 0 2023-01-04T18:17:08.813 INFO:tasks.workunit.client.0.smithi050.stdout:9/613: write d1/d3/f19 [2068245,73452] 0 2023-01-04T18:17:08.813 INFO:tasks.workunit.client.0.smithi050.stdout:0/546: read d0/d73/f71 [3737104,10219] 0 2023-01-04T18:17:08.814 INFO:tasks.workunit.client.0.smithi050.stdout:0/547: fsync d0/d6/d8/d51/f7b 0 2023-01-04T18:17:08.814 INFO:tasks.workunit.client.0.smithi050.stdout:0/548: write d0/f7e [2056109,89129] 0 2023-01-04T18:17:08.815 INFO:tasks.workunit.client.0.smithi050.stdout:5/758: rmdir d13/d15/d66/db8/d27/d46/d4e 39 2023-01-04T18:17:08.816 INFO:tasks.workunit.client.0.smithi050.stdout:5/759: write d13/d15/d66/db8/d27/d46/d4e/f3c [2464336,55125] 0 2023-01-04T18:17:08.819 INFO:tasks.workunit.client.0.smithi050.stdout:4/623: rename d14/f65 to d14/d1b/d1f/d22/d3e/d44/d59/d5d/fc7 0 2023-01-04T18:17:08.827 INFO:tasks.workunit.client.0.smithi050.stdout:8/703: dwrite d3/d2a/d27/dc1/fd2 [0,4194304] 0 2023-01-04T18:17:08.832 INFO:tasks.workunit.client.0.smithi050.stdout:8/704: write d3/d2a/d27/d93/d7a/f80 [902897,112720] 0 2023-01-04T18:17:08.832 INFO:tasks.workunit.client.0.smithi050.stdout:8/705: chown d3/d2a/d27/f33 872 1 2023-01-04T18:17:08.833 INFO:tasks.workunit.client.0.smithi050.stdout:7/702: dwrite d6/db/d15/d48/dc7/fb6 [4194304,4194304] 0 2023-01-04T18:17:08.834 INFO:tasks.workunit.client.0.smithi050.stdout:4/624: dwrite d14/d1b/f8f [0,4194304] 0 2023-01-04T18:17:08.843 INFO:tasks.workunit.client.0.smithi050.stdout:7/703: dread d6/db/d3a/fa5 [0,4194304] 0 2023-01-04T18:17:08.848 INFO:tasks.workunit.client.0.smithi050.stdout:3/627: mknod d0/cdd 0 2023-01-04T18:17:08.849 INFO:tasks.workunit.client.0.smithi050.stdout:3/628: chown d0/d1b/d2f/d56/d98/d9c/lb1 0 1 2023-01-04T18:17:08.849 INFO:tasks.workunit.client.0.smithi050.stdout:3/629: read - d0/d8f/f67 zero size 2023-01-04T18:17:08.849 INFO:tasks.workunit.client.0.smithi050.stdout:3/630: chown d0/d1b/d2f/d56/d32/dbb 30 1 2023-01-04T18:17:08.849 INFO:tasks.workunit.client.0.smithi050.stdout:3/631: fdatasync d0/d10/fbe 0 2023-01-04T18:17:08.851 INFO:tasks.workunit.client.0.smithi050.stdout:1/619: unlink d8/d14/d1c/d28/d57/d6a/f77 0 2023-01-04T18:17:08.865 INFO:tasks.workunit.client.0.smithi050.stdout:0/549: mkdir d0/d6/d28/d1a/daf 0 2023-01-04T18:17:08.866 INFO:tasks.workunit.client.0.smithi050.stdout:0/550: readlink d0/d6/d8/l10 0 2023-01-04T18:17:08.867 INFO:tasks.workunit.client.0.smithi050.stdout:1/620: dwrite d8/d14/d1c/d28/f93 [0,4194304] 0 2023-01-04T18:17:08.870 INFO:tasks.workunit.client.0.smithi050.stdout:5/760: mkdir d13/d116 0 2023-01-04T18:17:08.870 INFO:tasks.workunit.client.0.smithi050.stdout:5/761: fdatasync d13/d15/d66/db8/d1f/d35/d59/f95 0 2023-01-04T18:17:08.870 INFO:tasks.workunit.client.0.smithi050.stdout:5/762: fdatasync d13/fa5 0 2023-01-04T18:17:08.870 INFO:tasks.workunit.client.0.smithi050.stdout:5/763: fdatasync d13/d15/d66/db8/d1f/fb7 0 2023-01-04T18:17:08.876 INFO:tasks.workunit.client.0.smithi050.stdout:2/611: rename d1/dd/d11/d14/d91/d5a/d7f/dc5 to d1/dd/d28/d2c/d2e/dca 0 2023-01-04T18:17:08.881 INFO:tasks.workunit.client.0.smithi050.stdout:0/551: dwrite d0/d6/d28/d1a/f23 [0,4194304] 0 2023-01-04T18:17:08.881 INFO:tasks.workunit.client.0.smithi050.stdout:0/552: chown d0/d6/d28/d1a/f24 702438 1 2023-01-04T18:17:08.888 INFO:tasks.workunit.client.0.smithi050.stdout:8/706: creat d3/d2a/d27/d93/d7f/d96/d46/ffa x:0 0 0 2023-01-04T18:17:08.888 INFO:tasks.workunit.client.0.smithi050.stdout:8/707: fdatasync d3/d2a/f6e 0 2023-01-04T18:17:08.894 INFO:tasks.workunit.client.0.smithi050.stdout:0/553: dwrite d0/f53 [0,4194304] 0 2023-01-04T18:17:08.894 INFO:tasks.workunit.client.0.smithi050.stdout:0/554: fsync d0/d6/f3c 0 2023-01-04T18:17:08.905 INFO:tasks.workunit.client.0.smithi050.stdout:4/625: symlink d14/d1b/d1f/d63/da5/lc8 0 2023-01-04T18:17:08.908 INFO:tasks.workunit.client.0.smithi050.stdout:7/704: mknod d6/db/d3a/ceb 0 2023-01-04T18:17:08.908 INFO:tasks.workunit.client.0.smithi050.stdout:3/632: symlink d0/d8f/d46/dc2/lde 0 2023-01-04T18:17:08.914 INFO:tasks.workunit.client.0.smithi050.stdout:1/621: mknod d8/d14/cbc 0 2023-01-04T18:17:08.914 INFO:tasks.workunit.client.0.smithi050.stdout:1/622: fsync d8/d14/d1c/d28/d57/fa5 0 2023-01-04T18:17:08.915 INFO:tasks.workunit.client.0.smithi050.stdout:5/764: chown d13/d15/d66/db8/d1f/l4f 378 1 2023-01-04T18:17:08.915 INFO:tasks.workunit.client.0.smithi050.stdout:5/765: read - d13/d15/d66/db8/d1f/d35/fd2 zero size 2023-01-04T18:17:08.915 INFO:tasks.workunit.client.0.smithi050.stdout:5/766: chown d13/d15/d66 16 1 2023-01-04T18:17:08.917 INFO:tasks.workunit.client.0.smithi050.stdout:2/612: creat d1/dd/d62/da1/d4b/fcb x:0 0 0 2023-01-04T18:17:08.918 INFO:tasks.workunit.client.0.smithi050.stdout:6/607: sync 2023-01-04T18:17:08.918 INFO:tasks.workunit.client.0.smithi050.stdout:6/608: chown d0/d9/d38/d16/d77/la0 308866 1 2023-01-04T18:17:08.918 INFO:tasks.workunit.client.0.smithi050.stdout:6/609: fsync d0/d9/f98 0 2023-01-04T18:17:08.918 INFO:tasks.workunit.client.0.smithi050.stdout:6/610: chown d0/d9/d38/d16/d6b/da4 0 1 2023-01-04T18:17:08.918 INFO:tasks.workunit.client.0.smithi050.stdout:6/611: dread - d0/d9/d38/d16/fa1 zero size 2023-01-04T18:17:08.919 INFO:tasks.workunit.client.0.smithi050.stdout:2/613: write d1/dd/d38/f75 [1756860,14641] 0 2023-01-04T18:17:08.921 INFO:tasks.workunit.client.0.smithi050.stdout:0/555: mknod d0/d6/d8/cb0 0 2023-01-04T18:17:08.921 INFO:tasks.workunit.client.0.smithi050.stdout:7/705: mknod d6/d28/d99/d7a/cec 0 2023-01-04T18:17:08.922 INFO:tasks.workunit.client.0.smithi050.stdout:1/623: creat d8/d48/d5c/d67/d3b/fbd x:0 0 0 2023-01-04T18:17:08.923 INFO:tasks.workunit.client.0.smithi050.stdout:6/612: dread d0/d9/d38/fd [0,4194304] 0 2023-01-04T18:17:08.924 INFO:tasks.workunit.client.0.smithi050.stdout:5/767: truncate d13/d15/d66/db8/d27/d46/d4e/d4d/db1/fba 2766795 0 2023-01-04T18:17:08.924 INFO:tasks.workunit.client.0.smithi050.stdout:6/613: write d0/f6f [1660823,119108] 0 2023-01-04T18:17:08.924 INFO:tasks.workunit.client.0.smithi050.stdout:5/768: write d13/d15/d66/db8/d27/fce [3430190,123850] 0 2023-01-04T18:17:08.928 INFO:tasks.workunit.client.0.smithi050.stdout:3/633: dwrite d0/d8f/d46/fb5 [0,4194304] 0 2023-01-04T18:17:08.928 INFO:tasks.workunit.client.0.smithi050.stdout:8/708: mkdir d3/d2a/d30/d3b/d4d/d23/dfb 0 2023-01-04T18:17:08.929 INFO:tasks.workunit.client.0.smithi050.stdout:4/626: dwrite d14/d1b/d32/f37 [0,4194304] 0 2023-01-04T18:17:08.930 INFO:tasks.workunit.client.0.smithi050.stdout:4/627: readlink d14/l20 0 2023-01-04T18:17:08.930 INFO:tasks.workunit.client.0.smithi050.stdout:0/556: creat d0/d6/d8/d25/fb1 x:0 0 0 2023-01-04T18:17:08.930 INFO:tasks.workunit.client.0.smithi050.stdout:0/557: fdatasync d0/d6/d8/d51/f50 0 2023-01-04T18:17:08.930 INFO:tasks.workunit.client.0.smithi050.stdout:0/558: fsync d0/d6/d8/d35/f6f 0 2023-01-04T18:17:08.930 INFO:tasks.workunit.client.0.smithi050.stdout:5/769: write d13/d15/d66/db8/d1f/d35/f3f [1168484,53605] 0 2023-01-04T18:17:08.931 INFO:tasks.workunit.client.0.smithi050.stdout:7/706: rmdir d6/db/d15/d1b/d22 39 2023-01-04T18:17:08.932 INFO:tasks.workunit.client.0.smithi050.stdout:7/707: dread - d6/db/d15/f9b zero size 2023-01-04T18:17:08.932 INFO:tasks.workunit.client.0.smithi050.stdout:7/708: truncate d6/d28/d99/dd7/f96 1844931 0 2023-01-04T18:17:08.934 INFO:tasks.workunit.client.0.smithi050.stdout:1/624: creat d8/d48/dac/fbe x:0 0 0 2023-01-04T18:17:08.934 INFO:tasks.workunit.client.0.smithi050.stdout:1/625: stat d8/d14/d1c/d28/d57/d6a/cab 0 2023-01-04T18:17:08.934 INFO:tasks.workunit.client.0.smithi050.stdout:1/626: dread - d8/d14/fa8 zero size 2023-01-04T18:17:08.934 INFO:tasks.workunit.client.0.smithi050.stdout:1/627: read - d8/d14/fa8 zero size 2023-01-04T18:17:08.934 INFO:tasks.workunit.client.0.smithi050.stdout:1/628: truncate d8/d14/fb3 1309682 0 2023-01-04T18:17:08.934 INFO:tasks.workunit.client.0.smithi050.stdout:1/629: fdatasync d8/d48/d5c/d67/f56 0 2023-01-04T18:17:08.935 INFO:tasks.workunit.client.0.smithi050.stdout:6/614: rename d0/d9/df/f70 to d0/d9/d38/d16/d6b/fb8 0 2023-01-04T18:17:08.939 INFO:tasks.workunit.client.0.smithi050.stdout:2/614: dwrite d1/dd/d28/d2c/d66/f87 [0,4194304] 0 2023-01-04T18:17:08.941 INFO:tasks.workunit.client.0.smithi050.stdout:3/634: rmdir d0/dd/d45 39 2023-01-04T18:17:08.942 INFO:tasks.workunit.client.0.smithi050.stdout:8/709: mknod d3/d2a/cfc 0 2023-01-04T18:17:08.944 INFO:tasks.workunit.client.0.smithi050.stdout:8/710: dread d3/d2a/f6e [0,4194304] 0 2023-01-04T18:17:08.944 INFO:tasks.workunit.client.0.smithi050.stdout:8/711: truncate d3/d2a/d60/d2c/fe3 1314179 0 2023-01-04T18:17:08.944 INFO:tasks.workunit.client.0.smithi050.stdout:8/712: chown d3/d2a/d60/f40 0 1 2023-01-04T18:17:08.944 INFO:tasks.workunit.client.0.smithi050.stdout:0/559: creat d0/d6/d28/d1a/d8a/d9e/fb2 x:0 0 0 2023-01-04T18:17:08.949 INFO:tasks.workunit.client.0.smithi050.stdout:0/560: dread d0/d6/d8/d51/f8d [0,4194304] 0 2023-01-04T18:17:08.953 INFO:tasks.workunit.client.0.smithi050.stdout:4/628: dwrite d14/d1b/d1f/d22/f7c [4194304,4194304] 0 2023-01-04T18:17:08.960 INFO:tasks.workunit.client.0.smithi050.stdout:0/561: dread d0/d6/d8/f48 [0,4194304] 0 2023-01-04T18:17:08.961 INFO:tasks.workunit.client.0.smithi050.stdout:0/562: dread d0/d6/d8/d4f/f69 [0,4194304] 0 2023-01-04T18:17:08.961 INFO:tasks.workunit.client.0.smithi050.stdout:0/563: chown d0/d73/d68/fa0 3258 1 2023-01-04T18:17:08.986 INFO:tasks.workunit.client.0.smithi050.stdout:0/564: read d0/d6/d8/d25/f8c [484533,124986] 0 2023-01-04T18:17:08.991 INFO:tasks.workunit.client.0.smithi050.stdout:8/713: dwrite d3/d2a/d2d/f70 [4194304,4194304] 0 2023-01-04T18:17:08.992 INFO:tasks.workunit.client.0.smithi050.stdout:8/714: dread - d3/d2a/fd7 zero size 2023-01-04T18:17:09.021 INFO:tasks.workunit.client.0.smithi050.stdout:5/770: truncate d13/d15/d66/db8/d1f/d62/fb0 271351 0 2023-01-04T18:17:09.022 INFO:tasks.workunit.client.0.smithi050.stdout:1/630: rmdir d8/d48/d5c/d67 39 2023-01-04T18:17:09.096 INFO:tasks.workunit.client.0.smithi050.stdout:7/709: rename d6/db/d15/d2e/d4b to d6/ded 0 2023-01-04T18:17:09.101 INFO:tasks.workunit.client.0.smithi050.stdout:3/635: creat d0/d1b/d2f/d56/d6b/d7f/fdf x:0 0 0 2023-01-04T18:17:09.113 INFO:tasks.workunit.client.0.smithi050.stdout:3/636: dread d0/d1b/d2f/d56/d32/f73 [0,4194304] 0 2023-01-04T18:17:09.119 INFO:tasks.workunit.client.0.smithi050.stdout:8/715: symlink d3/d2a/d30/d3b/d53/lfd 0 2023-01-04T18:17:09.121 INFO:tasks.workunit.client.0.smithi050.stdout:5/771: mknod d13/d15/d66/db8/dd9/c117 0 2023-01-04T18:17:09.124 INFO:tasks.workunit.client.0.smithi050.stdout:1/631: creat d8/d48/d8c/d72/fbf x:0 0 0 2023-01-04T18:17:09.124 INFO:tasks.workunit.client.0.smithi050.stdout:1/632: dread - d8/d48/d8c/d72/f80 zero size 2023-01-04T18:17:09.128 INFO:tasks.workunit.client.0.smithi050.stdout:9/614: sync 2023-01-04T18:17:09.131 INFO:tasks.workunit.client.0.smithi050.stdout:6/615: rename d0/d9/d38/d16/fa1 to d0/d9/df/d74/fb9 0 2023-01-04T18:17:09.131 INFO:tasks.workunit.client.0.smithi050.stdout:7/710: mkdir d6/db/d15/d48/dc7/dee 0 2023-01-04T18:17:09.133 INFO:tasks.workunit.client.0.smithi050.stdout:3/637: dwrite d0/d1b/d2f/d31/f83 [0,4194304] 0 2023-01-04T18:17:09.135 INFO:tasks.workunit.client.0.smithi050.stdout:8/716: truncate d3/d2a/d30/d3b/f79 1187178 0 2023-01-04T18:17:09.137 INFO:tasks.workunit.client.0.smithi050.stdout:1/633: unlink d8/d14/d1c/d28/f93 0 2023-01-04T18:17:09.147 INFO:tasks.workunit.client.0.smithi050.stdout:3/638: dwrite d0/dd/f1e [0,4194304] 0 2023-01-04T18:17:09.149 INFO:tasks.workunit.client.0.smithi050.stdout:3/639: dread d0/d10/f65 [0,4194304] 0 2023-01-04T18:17:09.149 INFO:tasks.workunit.client.0.smithi050.stdout:3/640: readlink d0/dd/l38 0 2023-01-04T18:17:09.225 INFO:tasks.workunit.client.0.smithi050.stdout:9/615: link d1/d12/d2d/d39/fae d1/d12/d41/d60/fbe 0 2023-01-04T18:17:09.227 INFO:tasks.workunit.client.0.smithi050.stdout:4/629: rename d14/d1b/d1f/d22/d3e/d44/d59/d5f/c62 to d14/d1b/d1f/d22/d87/cc9 0 2023-01-04T18:17:09.232 INFO:tasks.workunit.client.0.smithi050.stdout:6/616: mkdir d0/d9/df/dba 0 2023-01-04T18:17:09.238 INFO:tasks.workunit.client.0.smithi050.stdout:1/634: unlink d8/d48/d5c/d67/d3b/f9c 0 2023-01-04T18:17:09.256 INFO:tasks.workunit.client.0.smithi050.stdout:1/635: dwrite d8/d14/d1c/d28/d57/d6a/f7d [0,4194304] 0 2023-01-04T18:17:09.257 INFO:tasks.workunit.client.0.smithi050.stdout:9/616: getdents d1/d3/d11 0 2023-01-04T18:17:09.261 INFO:tasks.workunit.client.0.smithi050.stdout:2/615: sync 2023-01-04T18:17:09.285 INFO:tasks.workunit.client.0.smithi050.stdout:0/565: rename d0/d6/d28/d1a/l62 to d0/d73/lb3 0 2023-01-04T18:17:09.287 INFO:tasks.workunit.client.0.smithi050.stdout:4/630: mkdir d14/d1b/d1f/d22/d3e/d44/d59/dca 0 2023-01-04T18:17:09.288 INFO:tasks.workunit.client.0.smithi050.stdout:6/617: creat d0/d9/d38/d16/d6b/da4/fbb x:0 0 0 2023-01-04T18:17:09.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:07.921790+0000 mgr.smithi098.vhfzum (mgr.24455) 47 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 59 MiB/s rd, 131 MiB/s wr, 273 op/s 2023-01-04T18:17:09.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:08.179750+0000 mon.smithi098 (mon.1) 52 : audit [INF] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.vhfzum/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:17:09.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:08.180167+0000 mon.smithi050 (mon.0) 600 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.vhfzum/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:17:09.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:08.180700+0000 mon.smithi098 (mon.1) 53 : audit [INF] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.vhfzum/trash_purge_schedule"}]: dispatch 2023-01-04T18:17:09.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:08.181051+0000 mon.smithi050 (mon.0) 601 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.vhfzum/trash_purge_schedule"}]: dispatch 2023-01-04T18:17:09.325 INFO:tasks.workunit.client.0.smithi050.stdout:9/617: mkdir d1/d3/dbf 0 2023-01-04T18:17:09.326 INFO:tasks.workunit.client.0.smithi050.stdout:2/616: mkdir d1/dd/d11/dcc 0 2023-01-04T18:17:09.328 INFO:tasks.workunit.client.0.smithi050.stdout:4/631: dwrite d14/d1b/d1f/d22/d6a/f9b [0,4194304] 0 2023-01-04T18:17:09.328 INFO:tasks.workunit.client.0.smithi050.stdout:4/632: readlink d14/d1b/d1f/d63/da5/lc8 0 2023-01-04T18:17:09.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:07.921790+0000 mgr.smithi098.vhfzum (mgr.24455) 47 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 1.3 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 59 MiB/s rd, 131 MiB/s wr, 273 op/s 2023-01-04T18:17:09.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:08.179750+0000 mon.smithi098 (mon.1) 52 : audit [INF] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.vhfzum/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:17:09.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:08.180167+0000 mon.smithi050 (mon.0) 600 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.vhfzum/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:17:09.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:08.180700+0000 mon.smithi098 (mon.1) 53 : audit [INF] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.vhfzum/trash_purge_schedule"}]: dispatch 2023-01-04T18:17:09.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:08.181051+0000 mon.smithi050 (mon.0) 601 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.vhfzum/trash_purge_schedule"}]: dispatch 2023-01-04T18:17:09.332 INFO:tasks.workunit.client.0.smithi050.stdout:6/618: creat d0/d5c/fbc x:0 0 0 2023-01-04T18:17:09.332 INFO:tasks.workunit.client.0.smithi050.stdout:9/618: link d1/d12/d2d/d39/l3c d1/d12/d41/d60/lc0 0 2023-01-04T18:17:09.332 INFO:tasks.workunit.client.0.smithi050.stdout:9/619: chown d1/d3/d11/d42/dbd 3157 1 2023-01-04T18:17:09.333 INFO:tasks.workunit.client.0.smithi050.stdout:9/620: fdatasync d1/d3/d89/f80 0 2023-01-04T18:17:09.337 INFO:tasks.workunit.client.0.smithi050.stdout:4/633: dread d14/f21 [4194304,4194304] 0 2023-01-04T18:17:09.352 INFO:tasks.workunit.client.0.smithi050.stdout:9/621: write d1/d3/d13/f15 [3119782,71497] 0 2023-01-04T18:17:09.353 INFO:tasks.workunit.client.0.smithi050.stdout:9/622: readlink d1/d3/d13/d77/lb8 0 2023-01-04T18:17:09.353 INFO:tasks.workunit.client.0.smithi050.stdout:4/634: dread d14/d1b/f52 [0,4194304] 0 2023-01-04T18:17:09.353 INFO:tasks.workunit.client.0.smithi050.stdout:4/635: dread - d14/d9e/fb4 zero size 2023-01-04T18:17:09.354 INFO:tasks.workunit.client.0.smithi050.stdout:4/636: write d14/d1b/d66/f9c [123482,63988] 0 2023-01-04T18:17:09.354 INFO:tasks.workunit.client.0.smithi050.stdout:9/623: creat d1/d12/d41/d60/d8e/fc1 x:0 0 0 2023-01-04T18:17:09.355 INFO:tasks.workunit.client.0.smithi050.stdout:9/624: rmdir d1/d3/d24 39 2023-01-04T18:17:09.367 INFO:tasks.workunit.client.0.smithi050.stdout:6/619: dwrite d0/d5c/d5d/faf [0,4194304] 0 2023-01-04T18:17:09.368 INFO:tasks.workunit.client.0.smithi050.stdout:2/617: dwrite d1/dd/d38/fb9 [0,4194304] 0 2023-01-04T18:17:09.369 INFO:tasks.workunit.client.0.smithi050.stdout:9/625: dread d1/d3/d13/f8d [0,4194304] 0 2023-01-04T18:17:09.369 INFO:tasks.workunit.client.0.smithi050.stdout:6/620: write d0/d9/d38/f15 [2987866,107332] 0 2023-01-04T18:17:09.370 INFO:tasks.workunit.client.0.smithi050.stdout:9/626: truncate d1/d12/d41/d60/d95/f99 4926647 0 2023-01-04T18:17:09.370 INFO:tasks.workunit.client.0.smithi050.stdout:9/627: readlink d1/d3/d3b/lbc 0 2023-01-04T18:17:09.370 INFO:tasks.workunit.client.0.smithi050.stdout:6/621: mknod d0/d9/df/cbd 0 2023-01-04T18:17:09.371 INFO:tasks.workunit.client.0.smithi050.stdout:9/628: symlink d1/d12/d2d/lc2 0 2023-01-04T18:17:09.372 INFO:tasks.workunit.client.0.smithi050.stdout:6/622: rmdir d0/d4a/d93/db1 39 2023-01-04T18:17:09.373 INFO:tasks.workunit.client.0.smithi050.stdout:9/629: mkdir d1/d3/d3b/d63/dc3 0 2023-01-04T18:17:09.377 INFO:tasks.workunit.client.0.smithi050.stdout:9/630: write d1/d3/d3b/f27 [1063021,55620] 0 2023-01-04T18:17:09.378 INFO:tasks.workunit.client.0.smithi050.stdout:9/631: symlink d1/d12/d3f/lc4 0 2023-01-04T18:17:09.379 INFO:tasks.workunit.client.0.smithi050.stdout:4/637: dwrite d14/d1b/f52 [0,4194304] 0 2023-01-04T18:17:09.380 INFO:tasks.workunit.client.0.smithi050.stdout:9/632: creat d1/d3/d11/d42/fc5 x:0 0 0 2023-01-04T18:17:09.384 INFO:tasks.workunit.client.0.smithi050.stdout:5/772: sync 2023-01-04T18:17:09.385 INFO:tasks.workunit.client.0.smithi050.stdout:7/711: sync 2023-01-04T18:17:09.385 INFO:tasks.workunit.client.0.smithi050.stdout:3/641: sync 2023-01-04T18:17:09.385 INFO:tasks.workunit.client.0.smithi050.stdout:8/717: sync 2023-01-04T18:17:09.385 INFO:tasks.workunit.client.0.smithi050.stdout:5/773: readlink d13/d15/d66/db8/lee 0 2023-01-04T18:17:09.385 INFO:tasks.workunit.client.0.smithi050.stdout:3/642: chown d0/d1b/d2f/d56/cd4 22224 1 2023-01-04T18:17:09.385 INFO:tasks.workunit.client.0.smithi050.stdout:7/712: fdatasync d6/db/d20/d55/fbb 0 2023-01-04T18:17:09.385 INFO:tasks.workunit.client.0.smithi050.stdout:5/774: readlink d13/d28/l3d 0 2023-01-04T18:17:09.385 INFO:tasks.workunit.client.0.smithi050.stdout:3/643: stat d0/d8f/d46/fad 0 2023-01-04T18:17:09.385 INFO:tasks.workunit.client.0.smithi050.stdout:9/633: unlink d1/d12/d9f/fb1 0 2023-01-04T18:17:09.385 INFO:tasks.workunit.client.0.smithi050.stdout:9/634: truncate d1/d3/d24/d7b/f91 762243 0 2023-01-04T18:17:09.390 INFO:tasks.workunit.client.0.smithi050.stdout:8/718: getdents d3/d2a/d27/d8b 0 2023-01-04T18:17:09.390 INFO:tasks.workunit.client.0.smithi050.stdout:3/644: readlink d0/d1a/l22 0 2023-01-04T18:17:09.390 INFO:tasks.workunit.client.0.smithi050.stdout:3/645: fdatasync d0/d1b/d2f/d56/d6b/fcc 0 2023-01-04T18:17:09.390 INFO:tasks.workunit.client.0.smithi050.stdout:8/719: dread - d3/d2a/d30/d3b/d53/fcd zero size 2023-01-04T18:17:09.390 INFO:tasks.workunit.client.0.smithi050.stdout:3/646: readlink d0/d1b/d2f/d56/la9 0 2023-01-04T18:17:09.391 INFO:tasks.workunit.client.0.smithi050.stdout:7/713: symlink d6/db/d20/d4f/lef 0 2023-01-04T18:17:09.392 INFO:tasks.workunit.client.0.smithi050.stdout:5/775: symlink d13/d15/d66/db8/d1f/d35/d42/d4a/l118 0 2023-01-04T18:17:09.461 INFO:tasks.workunit.client.0.smithi050.stdout:8/720: getdents d3/d2a/d30/d3b/d4d/d23 0 2023-01-04T18:17:09.462 INFO:tasks.workunit.client.0.smithi050.stdout:3/647: creat d0/d8f/d46/fe0 x:0 0 0 2023-01-04T18:17:09.462 INFO:tasks.workunit.client.0.smithi050.stdout:3/648: fdatasync d0/f4 0 2023-01-04T18:17:09.463 INFO:tasks.workunit.client.0.smithi050.stdout:4/638: dread f0 [0,4194304] 0 2023-01-04T18:17:09.463 INFO:tasks.workunit.client.0.smithi050.stdout:6/623: dwrite d0/d9/f3b [0,4194304] 0 2023-01-04T18:17:09.463 INFO:tasks.workunit.client.0.smithi050.stdout:6/624: chown d0/d9/d25/l78 5 1 2023-01-04T18:17:09.465 INFO:tasks.workunit.client.0.smithi050.stdout:7/714: creat d6/d6b/d8b/ff0 x:0 0 0 2023-01-04T18:17:09.465 INFO:tasks.workunit.client.0.smithi050.stdout:7/715: truncate d6/d6b/d8b/ff0 714947 0 2023-01-04T18:17:09.465 INFO:tasks.workunit.client.0.smithi050.stdout:7/716: chown d6/db/d20/d55/f5e 8 1 2023-01-04T18:17:09.465 INFO:tasks.workunit.client.0.smithi050.stdout:7/717: truncate d6/db/d15/d1b/fc5 528371 0 2023-01-04T18:17:09.467 INFO:tasks.workunit.client.0.smithi050.stdout:9/635: mkdir d1/d3/d3b/d63/dc6 0 2023-01-04T18:17:09.467 INFO:tasks.workunit.client.0.smithi050.stdout:9/636: fdatasync d1/d3/d3b/f27 0 2023-01-04T18:17:09.467 INFO:tasks.workunit.client.0.smithi050.stdout:8/721: truncate d3/d2a/d27/dc1/fd2 175867 0 2023-01-04T18:17:09.467 INFO:tasks.workunit.client.0.smithi050.stdout:4/639: write d14/f1a [1064810,109781] 0 2023-01-04T18:17:09.473 INFO:tasks.workunit.client.0.smithi050.stdout:8/722: dread d3/d2a/d30/d3b/f79 [0,4194304] 0 2023-01-04T18:17:09.473 INFO:tasks.workunit.client.0.smithi050.stdout:8/723: chown d3/d2a/cfc 849 1 2023-01-04T18:17:09.473 INFO:tasks.workunit.client.0.smithi050.stdout:5/776: dwrite d13/d15/d66/db8/d1f/d35/d42/f6f [0,4194304] 0 2023-01-04T18:17:09.476 INFO:tasks.workunit.client.0.smithi050.stdout:6/625: symlink d0/d4a/d93/lbe 0 2023-01-04T18:17:09.476 INFO:tasks.workunit.client.0.smithi050.stdout:7/718: symlink d6/d90/de3/d6a/lf1 0 2023-01-04T18:17:09.524 INFO:tasks.workunit.client.0.smithi050.stdout:9/637: link d1/d12/d2d/d39/f66 d1/d3/d11/d42/fc7 0 2023-01-04T18:17:09.527 INFO:tasks.workunit.client.0.smithi050.stdout:4/640: mkdir d14/d1b/d1f/d63/dcb 0 2023-01-04T18:17:09.540 INFO:tasks.workunit.client.0.smithi050.stdout:3/649: mkdir d0/d1b/d2f/d56/d98/de1 0 2023-01-04T18:17:09.540 INFO:tasks.workunit.client.0.smithi050.stdout:3/650: chown d0/d8f/d46/d80/ccf 371186 1 2023-01-04T18:17:09.552 INFO:tasks.workunit.client.0.smithi050.stdout:6/626: creat d0/d5c/fbf x:0 0 0 2023-01-04T18:17:09.553 INFO:tasks.workunit.client.0.smithi050.stdout:6/627: fsync d0/d9/d38/d60/f82 0 2023-01-04T18:17:09.554 INFO:tasks.workunit.client.0.smithi050.stdout:7/719: rename d6/db/d3b/f4c to d6/d6b/ff2 0 2023-01-04T18:17:09.555 INFO:tasks.workunit.client.0.smithi050.stdout:7/720: write d6/ded/fb5 [3148199,95178] 0 2023-01-04T18:17:09.557 INFO:tasks.workunit.client.0.smithi050.stdout:9/638: symlink d1/d12/d9f/lc8 0 2023-01-04T18:17:09.629 INFO:tasks.workunit.client.0.smithi050.stdout:4/641: link d14/l16 d14/d1b/d1f/lcc 0 2023-01-04T18:17:09.632 INFO:tasks.workunit.client.0.smithi050.stdout:9/639: dread d1/f47 [0,4194304] 0 2023-01-04T18:17:09.632 INFO:tasks.workunit.client.0.smithi050.stdout:4/642: write d14/f31 [995770,130210] 0 2023-01-04T18:17:09.635 INFO:tasks.workunit.client.0.smithi050.stdout:7/721: rename f2 to d6/db/d20/d55/d82/ff3 0 2023-01-04T18:17:09.635 INFO:tasks.workunit.client.0.smithi050.stdout:7/722: fsync d6/db/d15/d1b/d5b/dda/fe1 0 2023-01-04T18:17:09.639 INFO:tasks.workunit.client.0.smithi050.stdout:7/723: rmdir d6/d6b 39 2023-01-04T18:17:09.640 INFO:tasks.workunit.client.0.smithi050.stdout:4/643: rename d14/d1b/d1f/d22/d3e/d44/c5c to d14/d9e/ccd 0 2023-01-04T18:17:09.641 INFO:tasks.workunit.client.0.smithi050.stdout:4/644: fsync d14/f1a 0 2023-01-04T18:17:09.641 INFO:tasks.workunit.client.0.smithi050.stdout:4/645: readlink d14/d1b/l75 0 2023-01-04T18:17:09.645 INFO:tasks.workunit.client.0.smithi050.stdout:7/724: symlink d6/d1d/d81/lf4 0 2023-01-04T18:17:09.645 INFO:tasks.workunit.client.0.smithi050.stdout:7/725: stat d6/d28/d32/f4e 0 2023-01-04T18:17:09.649 INFO:tasks.workunit.client.0.smithi050.stdout:7/726: creat d6/d28/d99/dd7/d42/ff5 x:0 0 0 2023-01-04T18:17:09.649 INFO:tasks.workunit.client.0.smithi050.stdout:7/727: write d6/db/d15/d1b/f21 [4449767,67450] 0 2023-01-04T18:17:09.650 INFO:tasks.workunit.client.0.smithi050.stdout:7/728: creat d6/d28/ff6 x:0 0 0 2023-01-04T18:17:09.652 INFO:tasks.workunit.client.0.smithi050.stdout:7/729: creat d6/db/d15/d48/dc7/dee/ff7 x:0 0 0 2023-01-04T18:17:09.658 INFO:tasks.workunit.client.0.smithi050.stdout:7/730: creat d6/db/d15/d1b/d70/ff8 x:0 0 0 2023-01-04T18:17:09.659 INFO:tasks.workunit.client.0.smithi050.stdout:7/731: write d6/db/d20/d4f/d8a/fdc [348460,67640] 0 2023-01-04T18:17:09.659 INFO:tasks.workunit.client.0.smithi050.stdout:7/732: fsync d6/fbf 0 2023-01-04T18:17:09.664 INFO:tasks.workunit.client.0.smithi050.stdout:1/636: sync 2023-01-04T18:17:09.664 INFO:tasks.workunit.client.0.smithi050.stdout:1/637: dread - d8/d48/d5c/d67/d91/fa3 zero size 2023-01-04T18:17:09.664 INFO:tasks.workunit.client.0.smithi050.stdout:0/566: sync 2023-01-04T18:17:09.664 INFO:tasks.workunit.client.0.smithi050.stdout:4/646: dwrite d14/d1b/d32/fbc [0,4194304] 0 2023-01-04T18:17:09.665 INFO:tasks.workunit.client.0.smithi050.stdout:9/640: dwrite d1/d12/d41/d60/d95/f99 [0,4194304] 0 2023-01-04T18:17:09.665 INFO:tasks.workunit.client.0.smithi050.stdout:3/651: dwrite d0/d1a/f8a [0,4194304] 0 2023-01-04T18:17:09.669 INFO:tasks.workunit.client.0.smithi050.stdout:0/567: link d0/d9f/f96 d0/d9f/fb4 0 2023-01-04T18:17:09.670 INFO:tasks.workunit.client.0.smithi050.stdout:0/568: truncate d0/d6/d8/d51/f7b 918498 0 2023-01-04T18:17:09.670 INFO:tasks.workunit.client.0.smithi050.stdout:1/638: dread d8/d14/d1c/f78 [0,4194304] 0 2023-01-04T18:17:09.670 INFO:tasks.workunit.client.0.smithi050.stdout:1/639: fdatasync d8/d14/d1c/d28/f59 0 2023-01-04T18:17:09.672 INFO:tasks.workunit.client.0.smithi050.stdout:4/647: creat d14/d9e/fce x:0 0 0 2023-01-04T18:17:09.673 INFO:tasks.workunit.client.0.smithi050.stdout:7/733: dwrite d6/db/f40 [0,4194304] 0 2023-01-04T18:17:09.674 INFO:tasks.workunit.client.0.smithi050.stdout:7/734: write d6/db/f2a [3101636,42379] 0 2023-01-04T18:17:09.675 INFO:tasks.workunit.client.0.smithi050.stdout:3/652: truncate d0/dd/f1e 415487 0 2023-01-04T18:17:09.675 INFO:tasks.workunit.client.0.smithi050.stdout:9/641: dread d1/d3/d11/f16 [0,4194304] 0 2023-01-04T18:17:09.693 INFO:tasks.workunit.client.0.smithi050.stdout:1/640: creat d8/d48/fc0 x:0 0 0 2023-01-04T18:17:09.697 INFO:tasks.workunit.client.0.smithi050.stdout:9/642: dwrite d1/d3/f5c [0,4194304] 0 2023-01-04T18:17:09.697 INFO:tasks.workunit.client.0.smithi050.stdout:9/643: readlink d1/d3/d13/l87 0 2023-01-04T18:17:09.699 INFO:tasks.workunit.client.0.smithi050.stdout:4/648: rename d14/d1b/d1f/d22/f34 to d14/d1b/d1f/d22/d3e/d85/fcf 0 2023-01-04T18:17:09.749 INFO:tasks.workunit.client.0.smithi050.stdout:7/735: mknod d6/db/d20/d55/d82/cf9 0 2023-01-04T18:17:09.753 INFO:tasks.workunit.client.0.smithi050.stdout:3/653: truncate d0/d1b/d2f/d56/d32/f73 3623740 0 2023-01-04T18:17:09.758 INFO:tasks.workunit.client.0.smithi050.stdout:1/641: mknod d8/d48/d5c/cc1 0 2023-01-04T18:17:09.758 INFO:tasks.workunit.client.0.smithi050.stdout:1/642: fsync d8/d48/d5c/d67/d3a/f69 0 2023-01-04T18:17:09.758 INFO:tasks.workunit.client.0.smithi050.stdout:1/643: truncate d8/d48/d5c/d67/fa9 76481 0 2023-01-04T18:17:09.758 INFO:tasks.workunit.client.0.smithi050.stdout:1/644: fdatasync d8/d48/d8c/d72/fa4 0 2023-01-04T18:17:09.768 INFO:tasks.workunit.client.0.smithi050.stdout:8/724: sync 2023-01-04T18:17:09.768 INFO:tasks.workunit.client.0.smithi050.stdout:2/618: sync 2023-01-04T18:17:09.768 INFO:tasks.workunit.client.0.smithi050.stdout:5/777: sync 2023-01-04T18:17:09.769 INFO:tasks.workunit.client.0.smithi050.stdout:5/778: dread - d13/d15/d66/db8/dd9/f10b zero size 2023-01-04T18:17:09.769 INFO:tasks.workunit.client.0.smithi050.stdout:5/779: getdents d13/d15/d66/db8/d1f/d35/d42/d10d 0 2023-01-04T18:17:09.769 INFO:tasks.workunit.client.0.smithi050.stdout:2/619: write d1/f97 [1586491,33074] 0 2023-01-04T18:17:09.771 INFO:tasks.workunit.client.0.smithi050.stdout:4/649: mknod d14/d1b/d1f/d63/da5/cd0 0 2023-01-04T18:17:09.772 INFO:tasks.workunit.client.0.smithi050.stdout:4/650: read d14/d1b/f1e [653568,16309] 0 2023-01-04T18:17:09.772 INFO:tasks.workunit.client.0.smithi050.stdout:4/651: fsync d14/d1b/d1f/f4a 0 2023-01-04T18:17:09.774 INFO:tasks.workunit.client.0.smithi050.stdout:7/736: creat d6/db/d20/d4f/ffa x:0 0 0 2023-01-04T18:17:09.776 INFO:tasks.workunit.client.0.smithi050.stdout:3/654: link d0/d1a/f4e d0/fe2 0 2023-01-04T18:17:09.777 INFO:tasks.workunit.client.0.smithi050.stdout:1/645: getdents d8/d48/d5c/d67/d3b/d84 0 2023-01-04T18:17:09.780 INFO:tasks.workunit.client.0.smithi050.stdout:8/725: unlink d3/d2a/d27/d93/d7f/d96/ff5 0 2023-01-04T18:17:09.780 INFO:tasks.workunit.client.0.smithi050.stdout:5/780: readlink d13/d15/d66/db8/d27/d46/d4e/d4d/l92 0 2023-01-04T18:17:09.784 INFO:tasks.workunit.client.0.smithi050.stdout:2/620: mknod d1/dd/d11/d12/ccd 0 2023-01-04T18:17:09.785 INFO:tasks.workunit.client.0.smithi050.stdout:4/652: creat d14/d1b/d32/fd1 x:0 0 0 2023-01-04T18:17:09.785 INFO:tasks.workunit.client.0.smithi050.stdout:7/737: creat d6/d28/d99/dd7/d42/ffb x:0 0 0 2023-01-04T18:17:09.785 INFO:tasks.workunit.client.0.smithi050.stdout:7/738: dread - d6/db/d20/d55/d82/fcb zero size 2023-01-04T18:17:09.787 INFO:tasks.workunit.client.0.smithi050.stdout:3/655: creat d0/d1b/d2f/d56/d6b/fe3 x:0 0 0 2023-01-04T18:17:09.787 INFO:tasks.workunit.client.0.smithi050.stdout:1/646: symlink d8/d14/d1c/d28/d57/d6a/daf/lc2 0 2023-01-04T18:17:09.789 INFO:tasks.workunit.client.0.smithi050.stdout:1/647: dread d8/d48/d5c/d67/d3a/f6d [0,4194304] 0 2023-01-04T18:17:09.789 INFO:tasks.workunit.client.0.smithi050.stdout:1/648: fsync d8/d48/d5c/d67/d3a/d31/f64 0 2023-01-04T18:17:09.790 INFO:tasks.workunit.client.0.smithi050.stdout:1/649: write d8/d48/d5c/f5e [3448276,15168] 0 2023-01-04T18:17:09.790 INFO:tasks.workunit.client.0.smithi050.stdout:8/726: link d3/d2a/d74/d92/d94/fb1 d3/d2a/d74/d92/d94/dc9/ffe 0 2023-01-04T18:17:09.793 INFO:tasks.workunit.client.0.smithi050.stdout:5/781: unlink d13/d15/d66/db8/d1f/d35/f10a 0 2023-01-04T18:17:09.793 INFO:tasks.workunit.client.0.smithi050.stdout:2/621: mkdir d1/dd/d28/d2c/dce 0 2023-01-04T18:17:09.794 INFO:tasks.workunit.client.0.smithi050.stdout:4/653: mknod d14/d1b/d1f/d22/d3e/d44/d59/db5/cd2 0 2023-01-04T18:17:09.795 INFO:tasks.workunit.client.0.smithi050.stdout:7/739: creat d6/db/d15/d48/dc7/dee/ffc x:0 0 0 2023-01-04T18:17:09.799 INFO:tasks.workunit.client.0.smithi050.stdout:1/650: dread d8/d14/f5b [0,4194304] 0 2023-01-04T18:17:09.799 INFO:tasks.workunit.client.0.smithi050.stdout:3/656: rmdir d0/d1b/d2f/d56/d98/d9c/dcd 39 2023-01-04T18:17:09.800 INFO:tasks.workunit.client.0.smithi050.stdout:3/657: chown d0/dd/c6f 0 1 2023-01-04T18:17:09.802 INFO:tasks.workunit.client.0.smithi050.stdout:8/727: mkdir d3/d2a/dff 0 2023-01-04T18:17:09.804 INFO:tasks.workunit.client.0.smithi050.stdout:5/782: link d13/d28/f3e d13/d15/d66/db8/d27/d46/d4e/d4d/db1/f119 0 2023-01-04T18:17:09.808 INFO:tasks.workunit.client.0.smithi050.stdout:2/622: getdents d1/dd/d28/d79 0 2023-01-04T18:17:09.813 INFO:tasks.workunit.client.0.smithi050.stdout:7/740: dwrite d6/db/d3b/fcc [0,4194304] 0 2023-01-04T18:17:09.814 INFO:tasks.workunit.client.0.smithi050.stdout:4/654: truncate d14/d1b/d1f/d22/d3e/f5a 3904774 0 2023-01-04T18:17:09.818 INFO:tasks.workunit.client.0.smithi050.stdout:1/651: symlink d8/d14/d1c/d28/d57/lc3 0 2023-01-04T18:17:09.821 INFO:tasks.workunit.client.0.smithi050.stdout:3/658: mknod d0/d1b/d2f/d56/d98/d9c/dcd/ce4 0 2023-01-04T18:17:09.822 INFO:tasks.workunit.client.0.smithi050.stdout:8/728: symlink d3/d2a/d30/d3b/d4d/d23/d31/l100 0 2023-01-04T18:17:09.824 INFO:tasks.workunit.client.0.smithi050.stdout:2/623: dread d1/dd/d11/d12/f4d [0,4194304] 0 2023-01-04T18:17:09.824 INFO:tasks.workunit.client.0.smithi050.stdout:2/624: fsync d1/dd/d28/d2c/f2d 0 2023-01-04T18:17:09.827 INFO:tasks.workunit.client.0.smithi050.stdout:2/625: write d1/dd/d28/d2c/f2d [536498,46311] 0 2023-01-04T18:17:09.828 INFO:tasks.workunit.client.0.smithi050.stdout:4/655: rename d14/d1b/c38 to d14/d1b/d1f/d63/cd3 0 2023-01-04T18:17:09.829 INFO:tasks.workunit.client.0.smithi050.stdout:5/783: dwrite d13/d15/f73 [0,4194304] 0 2023-01-04T18:17:09.830 INFO:tasks.workunit.client.0.smithi050.stdout:5/784: dread - d13/d15/d66/db8/dd9/f10b zero size 2023-01-04T18:17:09.830 INFO:tasks.workunit.client.0.smithi050.stdout:5/785: truncate d13/d15/d66/db8/f4c 4805188 0 2023-01-04T18:17:09.832 INFO:tasks.workunit.client.0.smithi050.stdout:4/656: symlink d14/d1b/d1f/d22/d3e/d44/ld4 0 2023-01-04T18:17:09.832 INFO:tasks.workunit.client.0.smithi050.stdout:4/657: fdatasync d14/f18 0 2023-01-04T18:17:09.834 INFO:tasks.workunit.client.0.smithi050.stdout:5/786: write d13/d15/d66/db8/d1f/d35/d42/d4a/f64 [1003546,82869] 0 2023-01-04T18:17:09.838 INFO:tasks.workunit.client.0.smithi050.stdout:4/658: write f0 [938263,64420] 0 2023-01-04T18:17:09.838 INFO:tasks.workunit.client.0.smithi050.stdout:4/659: chown d14/d1b/d32/l82 272657 1 2023-01-04T18:17:09.838 INFO:tasks.workunit.client.0.smithi050.stdout:5/787: creat d13/d15/d66/db8/d27/d46/f11a x:0 0 0 2023-01-04T18:17:09.838 INFO:tasks.workunit.client.0.smithi050.stdout:4/660: write d14/d1b/d66/f9c [1115658,73818] 0 2023-01-04T18:17:09.838 INFO:tasks.workunit.client.0.smithi050.stdout:5/788: stat d13/d15/d66/db8/d27/d46/d4e/d4d/db1/dbc/l112 0 2023-01-04T18:17:09.839 INFO:tasks.workunit.client.0.smithi050.stdout:5/789: write d13/d28/d7c/f8d [1846224,78864] 0 2023-01-04T18:17:09.839 INFO:tasks.workunit.client.0.smithi050.stdout:8/729: dread d3/d2a/d27/d93/d7f/d96/d46/f4a [0,4194304] 0 2023-01-04T18:17:09.839 INFO:tasks.workunit.client.0.smithi050.stdout:4/661: symlink d14/d1b/d1f/d22/d3e/d44/d59/d5f/ld5 0 2023-01-04T18:17:09.840 INFO:tasks.workunit.client.0.smithi050.stdout:7/741: dwrite d6/db/d20/d55/f8e [0,4194304] 0 2023-01-04T18:17:09.840 INFO:tasks.workunit.client.0.smithi050.stdout:7/742: chown d6/d28/d99/dd7/d42/ffb 66311703 1 2023-01-04T18:17:09.841 INFO:tasks.workunit.client.0.smithi050.stdout:5/790: creat d13/d15/d66/db8/d27/d46/d4e/d4d/db1/f11b x:0 0 0 2023-01-04T18:17:09.844 INFO:tasks.workunit.client.0.smithi050.stdout:8/730: link d3/d2a/d30/d3b/d53/fdd d3/d2a/d60/d84/f101 0 2023-01-04T18:17:09.846 INFO:tasks.workunit.client.0.smithi050.stdout:2/626: dwrite d1/dd/d11/d14/d91/f9d [0,4194304] 0 2023-01-04T18:17:09.846 INFO:tasks.workunit.client.0.smithi050.stdout:1/652: dwrite d8/f89 [0,4194304] 0 2023-01-04T18:17:09.846 INFO:tasks.workunit.client.0.smithi050.stdout:3/659: dwrite d0/d1b/d2f/d56/d32/f48 [0,4194304] 0 2023-01-04T18:17:09.849 INFO:tasks.workunit.client.0.smithi050.stdout:7/743: creat d6/d28/ffd x:0 0 0 2023-01-04T18:17:09.855 INFO:tasks.workunit.client.0.smithi050.stdout:7/744: readlink d6/d6b/la0 0 2023-01-04T18:17:09.855 INFO:tasks.workunit.client.0.smithi050.stdout:5/791: getdents d13/d15/d66/db8/d27/d44/d47 0 2023-01-04T18:17:09.855 INFO:tasks.workunit.client.0.smithi050.stdout:8/731: symlink d3/d2a/d30/d3b/l102 0 2023-01-04T18:17:09.856 INFO:tasks.workunit.client.0.smithi050.stdout:2/627: dread d1/dd/d11/f26 [0,4194304] 0 2023-01-04T18:17:09.859 INFO:tasks.workunit.client.0.smithi050.stdout:4/662: dwrite d14/d1b/f52 [4194304,4194304] 0 2023-01-04T18:17:09.887 INFO:tasks.workunit.client.0.smithi050.stdout:1/653: link d8/d14/d1c/d28/d57/d6a/d92/fb7 d8/d14/d1c/d28/fc4 0 2023-01-04T18:17:09.887 INFO:tasks.workunit.client.0.smithi050.stdout:1/654: write d8/d48/d5c/d67/d91/fa3 [436390,53776] 0 2023-01-04T18:17:09.891 INFO:tasks.workunit.client.0.smithi050.stdout:4/663: dwrite d14/d1b/d1f/f46 [0,4194304] 0 2023-01-04T18:17:09.899 INFO:tasks.workunit.client.0.smithi050.stdout:3/660: creat d0/d1b/d2f/d56/d98/d9c/fe5 x:0 0 0 2023-01-04T18:17:09.899 INFO:tasks.workunit.client.0.smithi050.stdout:3/661: chown d0/d1b/d2f/d56/d6b/fcc 12 1 2023-01-04T18:17:09.899 INFO:tasks.workunit.client.0.smithi050.stdout:3/662: truncate d0/d1b/d2f/d56/d32/f73 4280590 0 2023-01-04T18:17:09.900 INFO:tasks.workunit.client.0.smithi050.stdout:3/663: write d0/d1b/d2f/d56/d6b/fe3 [77755,16442] 0 2023-01-04T18:17:09.900 INFO:tasks.workunit.client.0.smithi050.stdout:3/664: chown d0/d1b/d2f/d56/d98/d9c/fe5 36362 1 2023-01-04T18:17:09.901 INFO:tasks.workunit.client.0.smithi050.stdout:7/745: mknod d6/db/d15/d48/dc7/cfe 0 2023-01-04T18:17:09.904 INFO:tasks.workunit.client.0.smithi050.stdout:5/792: creat d13/d15/d66/db8/d27/d44/f11c x:0 0 0 2023-01-04T18:17:09.904 INFO:tasks.workunit.client.0.smithi050.stdout:5/793: readlink d13/d15/d66/db8/l85 0 2023-01-04T18:17:09.904 INFO:tasks.workunit.client.0.smithi050.stdout:5/794: chown d13/d15/d66/db8/d27/dc3/df9/cc4 3574 1 2023-01-04T18:17:09.904 INFO:tasks.workunit.client.0.smithi050.stdout:5/795: chown d13/d15/d66/db8/d1f/d35/d59/f95 1164405 1 2023-01-04T18:17:09.905 INFO:tasks.workunit.client.0.smithi050.stdout:2/628: getdents d1/dd/d11/d14/d91/d5a/d7f 0 2023-01-04T18:17:09.910 INFO:tasks.workunit.client.0.smithi050.stdout:1/655: creat d8/d48/d5c/d67/d3b/d84/fc5 x:0 0 0 2023-01-04T18:17:09.910 INFO:tasks.workunit.client.0.smithi050.stdout:1/656: fsync d8/f43 0 2023-01-04T18:17:09.911 INFO:tasks.workunit.client.0.smithi050.stdout:6/628: sync 2023-01-04T18:17:09.912 INFO:tasks.workunit.client.0.smithi050.stdout:6/629: fsync d0/d5c/db7/f8a 0 2023-01-04T18:17:09.917 INFO:tasks.workunit.client.0.smithi050.stdout:4/664: mkdir d14/d1b/d66/dc1/dd6 0 2023-01-04T18:17:09.918 INFO:tasks.workunit.client.0.smithi050.stdout:3/665: truncate d0/d8f/f93 2007164 0 2023-01-04T18:17:09.919 INFO:tasks.workunit.client.0.smithi050.stdout:6/630: dread d0/d9/d25/f9a [0,4194304] 0 2023-01-04T18:17:09.920 INFO:tasks.workunit.client.0.smithi050.stdout:0/569: sync 2023-01-04T18:17:09.921 INFO:tasks.workunit.client.0.smithi050.stdout:9/644: sync 2023-01-04T18:17:09.921 INFO:tasks.workunit.client.0.smithi050.stdout:0/570: chown d0/f53 1996275 1 2023-01-04T18:17:09.921 INFO:tasks.workunit.client.0.smithi050.stdout:9/645: chown d1/d3/l35 117 1 2023-01-04T18:17:09.922 INFO:tasks.workunit.client.0.smithi050.stdout:7/746: creat d6/d28/d32/d9d/fff x:0 0 0 2023-01-04T18:17:09.922 INFO:tasks.workunit.client.0.smithi050.stdout:7/747: write d6/fb4 [668066,51871] 0 2023-01-04T18:17:09.922 INFO:tasks.workunit.client.0.smithi050.stdout:7/748: chown d6/db/d3b/fe5 19205 1 2023-01-04T18:17:09.922 INFO:tasks.workunit.client.0.smithi050.stdout:7/749: fdatasync d6/db/d15/d48/dc7/dee/ffc 0 2023-01-04T18:17:09.923 INFO:tasks.workunit.client.0.smithi050.stdout:7/750: write d6/db/f60 [276663,97310] 0 2023-01-04T18:17:09.923 INFO:tasks.workunit.client.0.smithi050.stdout:5/796: creat d13/d15/d66/f11d x:0 0 0 2023-01-04T18:17:09.925 INFO:tasks.workunit.client.0.smithi050.stdout:2/629: creat d1/dd/d62/da1/d4b/fcf x:0 0 0 2023-01-04T18:17:09.925 INFO:tasks.workunit.client.0.smithi050.stdout:2/630: truncate d1/d41/f67 1876561 0 2023-01-04T18:17:09.925 INFO:tasks.workunit.client.0.smithi050.stdout:6/631: dread d0/d9/d38/d1c/f9b [0,4194304] 0 2023-01-04T18:17:09.932 INFO:tasks.workunit.client.0.smithi050.stdout:5/797: dread d13/d15/d66/db8/d1f/f56 [0,4194304] 0 2023-01-04T18:17:09.932 INFO:tasks.workunit.client.0.smithi050.stdout:5/798: dread - d13/d15/d66/db8/d27/d44/f11c zero size 2023-01-04T18:17:09.953 INFO:tasks.workunit.client.0.smithi050.stdout:1/657: rename d8/d48/fba to d8/d14/d1c/d28/d57/d6a/d92/fc6 0 2023-01-04T18:17:09.954 INFO:tasks.workunit.client.0.smithi050.stdout:4/665: mkdir d14/d1b/dd7 0 2023-01-04T18:17:09.960 INFO:tasks.workunit.client.0.smithi050.stdout:3/666: mkdir d0/dd/de6 0 2023-01-04T18:17:09.961 INFO:tasks.workunit.client.0.smithi050.stdout:9/646: getdents d1/d3/d24/d97 0 2023-01-04T18:17:09.962 INFO:tasks.workunit.client.0.smithi050.stdout:9/647: fdatasync d1/d3/d3b/d63/f3d 0 2023-01-04T18:17:09.962 INFO:tasks.workunit.client.0.smithi050.stdout:9/648: readlink d1/d12/d41/d60/d8e/lab 0 2023-01-04T18:17:09.963 INFO:tasks.workunit.client.0.smithi050.stdout:3/667: dread d0/d1b/d2f/d56/d6b/dcb/fd1 [0,4194304] 0 2023-01-04T18:17:09.963 INFO:tasks.workunit.client.0.smithi050.stdout:3/668: write d0/d10/f16 [4327794,16136] 0 2023-01-04T18:17:09.964 INFO:tasks.workunit.client.0.smithi050.stdout:3/669: stat d0/d8f/d46/d80/ccf 0 2023-01-04T18:17:09.964 INFO:tasks.workunit.client.0.smithi050.stdout:3/670: fsync d0/d1b/d2f/d56/f53 0 2023-01-04T18:17:09.964 INFO:tasks.workunit.client.0.smithi050.stdout:7/751: rmdir d6/db/d15/d48 39 2023-01-04T18:17:09.966 INFO:tasks.workunit.client.0.smithi050.stdout:2/631: truncate d1/dd/d28/d2c/f9a 453552 0 2023-01-04T18:17:09.966 INFO:tasks.workunit.client.0.smithi050.stdout:2/632: chown d1/dd/d11/d14/d91/d5a/d7f/f9f 901343 1 2023-01-04T18:17:09.968 INFO:tasks.workunit.client.0.smithi050.stdout:6/632: mkdir d0/d9/d38/d60/dc0 0 2023-01-04T18:17:09.969 INFO:tasks.workunit.client.0.smithi050.stdout:5/799: creat d13/d15/d66/f11e x:0 0 0 2023-01-04T18:17:09.972 INFO:tasks.workunit.client.0.smithi050.stdout:1/658: mkdir d8/d14/d1c/d28/dc7 0 2023-01-04T18:17:09.973 INFO:tasks.workunit.client.0.smithi050.stdout:2/633: dread d1/dd/d38/fb9 [0,4194304] 0 2023-01-04T18:17:09.975 INFO:tasks.workunit.client.0.smithi050.stdout:7/752: dread d6/db/d15/d1b/f46 [4194304,4194304] 0 2023-01-04T18:17:09.975 INFO:tasks.workunit.client.0.smithi050.stdout:7/753: stat d6/db/d3a/dd2 0 2023-01-04T18:17:09.976 INFO:tasks.workunit.client.0.smithi050.stdout:4/666: creat d14/d1b/d1f/d22/d3e/d44/d59/d5f/d80/fd8 x:0 0 0 2023-01-04T18:17:09.982 INFO:tasks.workunit.client.0.smithi050.stdout:9/649: creat d1/d3/d24/d97/da8/fc9 x:0 0 0 2023-01-04T18:17:09.982 INFO:tasks.workunit.client.0.smithi050.stdout:9/650: chown d1/d3/l7d 7 1 2023-01-04T18:17:09.983 INFO:tasks.workunit.client.0.smithi050.stdout:9/651: getdents d1/d3/d11/d1f 0 2023-01-04T18:17:09.983 INFO:tasks.workunit.client.0.smithi050.stdout:3/671: unlink d0/d1b/d2f/faf 0 2023-01-04T18:17:09.983 INFO:tasks.workunit.client.0.smithi050.stdout:3/672: write d0/d10/f65 [1902562,51304] 0 2023-01-04T18:17:10.021 INFO:tasks.workunit.client.0.smithi050.stdout:3/673: dread d0/d1b/d2f/d31/f3d [0,4194304] 0 2023-01-04T18:17:10.023 INFO:tasks.workunit.client.0.smithi050.stdout:2/634: dwrite d1/dd/d11/d14/d91/f5f [0,4194304] 0 2023-01-04T18:17:10.024 INFO:tasks.workunit.client.0.smithi050.stdout:1/659: dwrite d8/d14/d1c/d28/d57/d6a/d92/f99 [0,4194304] 0 2023-01-04T18:17:10.029 INFO:tasks.workunit.client.0.smithi050.stdout:6/633: creat d0/d9/d38/d16/d6b/fc1 x:0 0 0 2023-01-04T18:17:10.029 INFO:tasks.workunit.client.0.smithi050.stdout:6/634: write d0/d9/d38/d16/d6b/fb8 [4992910,28474] 0 2023-01-04T18:17:10.029 INFO:tasks.workunit.client.0.smithi050.stdout:6/635: chown d0/d9/l3c 1 1 2023-01-04T18:17:10.032 INFO:tasks.workunit.client.0.smithi050.stdout:5/800: mkdir d13/d15/d66/db8/d27/d46/d4e/d4d/db1/dbc/d11f 0 2023-01-04T18:17:10.032 INFO:tasks.workunit.client.0.smithi050.stdout:5/801: fdatasync d13/d15/d66/db8/d1f/d35/fa2 0 2023-01-04T18:17:10.034 INFO:tasks.workunit.client.0.smithi050.stdout:7/754: creat d6/db/d20/d4f/d6e/f100 x:0 0 0 2023-01-04T18:17:10.039 INFO:tasks.workunit.client.0.smithi050.stdout:9/652: unlink d1/d3/d13/d77/la7 0 2023-01-04T18:17:10.043 INFO:tasks.workunit.client.0.smithi050.stdout:3/674: rename d0/d8f/d46/cb6 to d0/ce7 0 2023-01-04T18:17:10.044 INFO:tasks.workunit.client.0.smithi050.stdout:2/635: mkdir d1/dd/d28/d2c/d2e/d36/dd0 0 2023-01-04T18:17:10.047 INFO:tasks.workunit.client.0.smithi050.stdout:6/636: dwrite d0/d9/d25/f27 [0,4194304] 0 2023-01-04T18:17:10.047 INFO:tasks.workunit.client.0.smithi050.stdout:6/637: write d0/d9/d25/f3a [717333,223] 0 2023-01-04T18:17:10.054 INFO:tasks.workunit.client.0.smithi050.stdout:1/660: symlink d8/d48/lc8 0 2023-01-04T18:17:10.054 INFO:tasks.workunit.client.0.smithi050.stdout:1/661: chown d8/d48/d5c/d67/d3a/f79 15459 1 2023-01-04T18:17:10.057 INFO:tasks.workunit.client.0.smithi050.stdout:1/662: dread d8/d48/d5c/d67/f1e [0,4194304] 0 2023-01-04T18:17:10.059 INFO:tasks.workunit.client.0.smithi050.stdout:5/802: rmdir d13/d15/d66/db8/d1f/d35/d59/d87/dd0 0 2023-01-04T18:17:10.059 INFO:tasks.workunit.client.0.smithi050.stdout:2/636: dread d1/dd/d11/d14/f33 [0,4194304] 0 2023-01-04T18:17:10.064 INFO:tasks.workunit.client.0.smithi050.stdout:9/653: unlink d1/d3/l35 0 2023-01-04T18:17:10.066 INFO:tasks.workunit.client.0.smithi050.stdout:6/638: dwrite d0/d5c/db7/fa6 [0,4194304] 0 2023-01-04T18:17:10.066 INFO:tasks.workunit.client.0.smithi050.stdout:6/639: dread - d0/d5c/fbf zero size 2023-01-04T18:17:10.066 INFO:tasks.workunit.client.0.smithi050.stdout:3/675: creat d0/dd/d45/fe8 x:0 0 0 2023-01-04T18:17:10.069 INFO:tasks.workunit.client.0.smithi050.stdout:7/755: dread d6/d28/f3d [0,4194304] 0 2023-01-04T18:17:10.069 INFO:tasks.workunit.client.0.smithi050.stdout:7/756: write d6/db/d15/d48/dc7/dee/ff7 [940613,23565] 0 2023-01-04T18:17:10.070 INFO:tasks.workunit.client.0.smithi050.stdout:1/663: mknod d8/d48/d5c/d67/d3a/cc9 0 2023-01-04T18:17:10.071 INFO:tasks.workunit.client.0.smithi050.stdout:6/640: dread d0/d9/d38/fd [0,4194304] 0 2023-01-04T18:17:10.071 INFO:tasks.workunit.client.0.smithi050.stdout:6/641: chown d0/d9/d38/d16/f37 322843033 1 2023-01-04T18:17:10.072 INFO:tasks.workunit.client.0.smithi050.stdout:9/654: dread d1/d3/d13/f15 [0,4194304] 0 2023-01-04T18:17:10.076 INFO:tasks.workunit.client.0.smithi050.stdout:2/637: rmdir d1/dd/d11/db5 39 2023-01-04T18:17:10.076 INFO:tasks.workunit.client.0.smithi050.stdout:5/803: link d13/d15/d66/db8/d1f/d35/d42/d4a/c55 d13/d15/d66/db8/d1f/d35/d42/dec/c120 0 2023-01-04T18:17:10.079 INFO:tasks.workunit.client.0.smithi050.stdout:3/676: dread d0/d1b/d2f/d56/d32/f49 [0,4194304] 0 2023-01-04T18:17:10.079 INFO:tasks.workunit.client.0.smithi050.stdout:3/677: chown d0/d8f/d46/d80/f82 3525830 1 2023-01-04T18:17:10.082 INFO:tasks.workunit.client.0.smithi050.stdout:8/732: sync 2023-01-04T18:17:10.083 INFO:tasks.workunit.client.0.smithi050.stdout:7/757: mkdir d6/db/d15/d2e/d66/d101 0 2023-01-04T18:17:10.083 INFO:tasks.workunit.client.0.smithi050.stdout:7/758: dread - d6/d28/ffd zero size 2023-01-04T18:17:10.084 INFO:tasks.workunit.client.0.smithi050.stdout:1/664: mkdir d8/d14/d1c/d28/dc7/dca 0 2023-01-04T18:17:10.086 INFO:tasks.workunit.client.0.smithi050.stdout:6/642: mknod d0/d9/d25/d40/d89/cc2 0 2023-01-04T18:17:10.086 INFO:tasks.workunit.client.0.smithi050.stdout:6/643: fsync d0/d9/d25/f27 0 2023-01-04T18:17:10.088 INFO:tasks.workunit.client.0.smithi050.stdout:9/655: dwrite d1/d6f/fb7 [0,4194304] 0 2023-01-04T18:17:10.121 INFO:tasks.workunit.client.0.smithi050.stdout:6/644: dwrite d0/d9/d38/d16/fac [0,4194304] 0 2023-01-04T18:17:10.122 INFO:tasks.workunit.client.0.smithi050.stdout:6/645: write d0/d9/df/f30 [5815483,77952] 0 2023-01-04T18:17:10.135 INFO:tasks.workunit.client.0.smithi050.stdout:2/638: symlink d1/dd/d28/d2c/d2e/dca/ld1 0 2023-01-04T18:17:10.136 INFO:tasks.workunit.client.0.smithi050.stdout:5/804: rename d13/d28/d7c/d83/lc9 to d13/d15/d66/db8/d1f/d62/l121 0 2023-01-04T18:17:10.138 INFO:tasks.workunit.client.0.smithi050.stdout:3/678: unlink d0/d1b/d2f/d56/d32/caa 0 2023-01-04T18:17:10.138 INFO:tasks.workunit.client.0.smithi050.stdout:3/679: chown d0/d8f/d46/fe0 3 1 2023-01-04T18:17:10.140 INFO:tasks.workunit.client.0.smithi050.stdout:7/759: mkdir d6/d90/de3/d6a/d102 0 2023-01-04T18:17:10.140 INFO:tasks.workunit.client.0.smithi050.stdout:7/760: read d6/db/f2a [3105756,66215] 0 2023-01-04T18:17:10.140 INFO:tasks.workunit.client.0.smithi050.stdout:7/761: stat d6/db/d3a/fb3 0 2023-01-04T18:17:10.146 INFO:tasks.workunit.client.0.smithi050.stdout:9/656: mknod d1/d3/d13/d77/cca 0 2023-01-04T18:17:10.147 INFO:tasks.workunit.client.0.smithi050.stdout:9/657: write d1/d12/d9f/fbb [773166,117871] 0 2023-01-04T18:17:10.147 INFO:tasks.workunit.client.0.smithi050.stdout:9/658: fdatasync d1/d3/d3b/d63/f3d 0 2023-01-04T18:17:10.147 INFO:tasks.workunit.client.0.smithi050.stdout:9/659: dread - d1/d3/d11/d1f/f73 zero size 2023-01-04T18:17:10.149 INFO:tasks.workunit.client.0.smithi050.stdout:6/646: creat d0/d9/d38/d16/d6b/fc3 x:0 0 0 2023-01-04T18:17:10.150 INFO:tasks.workunit.client.0.smithi050.stdout:6/647: fdatasync d0/d9/d38/d16/d6b/da4/fbb 0 2023-01-04T18:17:10.151 INFO:tasks.workunit.client.0.smithi050.stdout:2/639: creat d1/fd2 x:0 0 0 2023-01-04T18:17:10.156 INFO:tasks.workunit.client.0.smithi050.stdout:1/665: rename d8/d48/d5c/d67/d3a/l9f to d8/d48/d5c/d67/d3b/d84/lcb 0 2023-01-04T18:17:10.160 INFO:tasks.workunit.client.0.smithi050.stdout:5/805: rmdir d13/d15/d66/db8/d27/d44 39 2023-01-04T18:17:10.163 INFO:tasks.workunit.client.0.smithi050.stdout:3/680: truncate d0/dd/f90 1788198 0 2023-01-04T18:17:10.166 INFO:tasks.workunit.client.0.smithi050.stdout:7/762: truncate d6/d28/d32/f4e 1023606 0 2023-01-04T18:17:10.168 INFO:tasks.workunit.client.0.smithi050.stdout:9/660: creat d1/d12/d9f/fcb x:0 0 0 2023-01-04T18:17:10.170 INFO:tasks.workunit.client.0.smithi050.stdout:6/648: creat d0/d4a/d93/fc4 x:0 0 0 2023-01-04T18:17:10.170 INFO:tasks.workunit.client.0.smithi050.stdout:6/649: fsync d0/d9/df/f56 0 2023-01-04T18:17:10.171 INFO:tasks.workunit.client.0.smithi050.stdout:2/640: symlink d1/dd/d11/d14/d91/d5a/ld3 0 2023-01-04T18:17:10.176 INFO:tasks.workunit.client.0.smithi050.stdout:1/666: creat d8/d48/d5c/d67/d3b/fcc x:0 0 0 2023-01-04T18:17:10.176 INFO:tasks.workunit.client.0.smithi050.stdout:1/667: write d8/d48/fc0 [454771,15195] 0 2023-01-04T18:17:10.178 INFO:tasks.workunit.client.0.smithi050.stdout:5/806: rename d13/d15/d66/db8/lee to d13/d15/d66/db8/d27/dca/dd3/l122 0 2023-01-04T18:17:10.181 INFO:tasks.workunit.client.0.smithi050.stdout:3/681: getdents d0 0 2023-01-04T18:17:10.181 INFO:tasks.workunit.client.0.smithi050.stdout:3/682: chown d0/d1b/d2f/d56/d6b/d7f/fdf 2421326 1 2023-01-04T18:17:10.182 INFO:tasks.workunit.client.0.smithi050.stdout:2/641: mknod d1/dd/db0/cd4 0 2023-01-04T18:17:10.182 INFO:tasks.workunit.client.0.smithi050.stdout:2/642: chown d1/dd/d28/d2c/d2e/c32 257618 1 2023-01-04T18:17:10.182 INFO:tasks.workunit.client.0.smithi050.stdout:2/643: chown d1/dd/d28/d2c/d2e/d3f/da7/lb4 1585177 1 2023-01-04T18:17:10.182 INFO:tasks.workunit.client.0.smithi050.stdout:2/644: readlink d1/dd/d38/l71 0 2023-01-04T18:17:10.183 INFO:tasks.workunit.client.0.smithi050.stdout:1/668: mkdir d8/d14/d1c/d28/dcd 0 2023-01-04T18:17:10.184 INFO:tasks.workunit.client.0.smithi050.stdout:1/669: chown d8/d48/d8c/d72/fa4 335278 1 2023-01-04T18:17:10.184 INFO:tasks.workunit.client.0.smithi050.stdout:7/763: dwrite d6/db/d20/d4f/ffa [0,4194304] 0 2023-01-04T18:17:10.184 INFO:tasks.workunit.client.0.smithi050.stdout:1/670: write d8/d14/d1c/d28/d57/fa5 [775032,38986] 0 2023-01-04T18:17:10.206 INFO:tasks.workunit.client.0.smithi050.stdout:0/571: sync 2023-01-04T18:17:10.267 INFO:tasks.workunit.client.0.smithi050.stdout:9/661: rename d1/d3/d11/la9 to d1/lcc 0 2023-01-04T18:17:10.268 INFO:tasks.workunit.client.0.smithi050.stdout:9/662: write d1/d3/d11/d1f/f73 [394389,43525] 0 2023-01-04T18:17:10.268 INFO:tasks.workunit.client.0.smithi050.stdout:9/663: chown d1/d3/d3b/d63 2177976 1 2023-01-04T18:17:10.269 INFO:tasks.workunit.client.0.smithi050.stdout:5/807: creat d13/d15/d66/db8/d1f/d35/d42/dec/f123 x:0 0 0 2023-01-04T18:17:10.278 INFO:tasks.workunit.client.0.smithi050.stdout:7/764: rmdir d6/d1d/d81 39 2023-01-04T18:17:10.286 INFO:tasks.workunit.client.0.smithi050.stdout:0/572: rmdir d0/d6/d8/d51 39 2023-01-04T18:17:10.286 INFO:tasks.workunit.client.0.smithi050.stdout:0/573: write d0/d6/d28/d1a/d8a/d9e/fb2 [262515,3388] 0 2023-01-04T18:17:10.291 INFO:tasks.workunit.client.0.smithi050.stdout:6/650: rename d0/d9/d25/cb0 to d0/d9/d38/d16/cc5 0 2023-01-04T18:17:10.293 INFO:tasks.workunit.client.0.smithi050.stdout:9/664: mkdir d1/d3/d11/dcd 0 2023-01-04T18:17:10.302 INFO:tasks.workunit.client.0.smithi050.stdout:9/665: dread d1/d3/f19 [0,4194304] 0 2023-01-04T18:17:10.304 INFO:tasks.workunit.client.0.smithi050.stdout:7/765: link d6/db/d15/d1b/f8c d6/f103 0 2023-01-04T18:17:10.309 INFO:tasks.workunit.client.0.smithi050.stdout:0/574: creat d0/d6/d28/d1a/d8a/fb5 x:0 0 0 2023-01-04T18:17:10.310 INFO:tasks.workunit.client.0.smithi050.stdout:0/575: dread d0/d6/d8/d35/f66 [0,4194304] 0 2023-01-04T18:17:10.310 INFO:tasks.workunit.client.0.smithi050.stdout:0/576: chown d0/d6/d28/c6a 27 1 2023-01-04T18:17:10.311 INFO:tasks.workunit.client.0.smithi050.stdout:0/577: chown d0/d6/d8/d25/c63 8846 1 2023-01-04T18:17:10.312 INFO:tasks.workunit.client.0.smithi050.stdout:3/683: dread d0/d1b/d2f/d31/f62 [0,4194304] 0 2023-01-04T18:17:10.318 INFO:tasks.workunit.client.0.smithi050.stdout:1/671: rename d8/d48/d8c/d72 to d8/dce 0 2023-01-04T18:17:10.319 INFO:tasks.workunit.client.0.smithi050.stdout:1/672: write d8/d14/d1c/fb1 [11370,110500] 0 2023-01-04T18:17:10.320 INFO:tasks.workunit.client.0.smithi050.stdout:0/578: creat d0/d6/d28/d1a/d8a/fb6 x:0 0 0 2023-01-04T18:17:10.326 INFO:tasks.workunit.client.0.smithi050.stdout:5/808: rename d13/d15/d66/db8/d1f/d35 to d13/d15/d66/db8/d27/d44/d47/d124 0 2023-01-04T18:17:10.326 INFO:tasks.workunit.client.0.smithi050.stdout:5/809: readlink l10 0 2023-01-04T18:17:10.327 INFO:tasks.workunit.client.0.smithi050.stdout:1/673: unlink d8/d48/d5c/d67/d3a/d31/f64 0 2023-01-04T18:17:10.328 INFO:tasks.workunit.client.0.smithi050.stdout:1/674: fdatasync d8/d14/d1c/d28/f9d 0 2023-01-04T18:17:10.329 INFO:tasks.workunit.client.0.smithi050.stdout:4/667: sync 2023-01-04T18:17:10.330 INFO:tasks.workunit.client.0.smithi050.stdout:1/675: write d8/d14/d1c/f40 [729076,86116] 0 2023-01-04T18:17:10.331 INFO:tasks.workunit.client.0.smithi050.stdout:0/579: mknod d0/d9f/d84/cb7 0 2023-01-04T18:17:10.332 INFO:tasks.workunit.client.0.smithi050.stdout:6/651: rename d0/d9/l4c to d0/d9/d38/d1c/d54/lc6 0 2023-01-04T18:17:10.335 INFO:tasks.workunit.client.0.smithi050.stdout:9/666: dwrite d1/d3/d13/d77/f8c [0,4194304] 0 2023-01-04T18:17:10.337 INFO:tasks.workunit.client.0.smithi050.stdout:4/668: symlink d14/d1b/d1f/d22/d3e/d44/d59/d5d/d7f/ld9 0 2023-01-04T18:17:10.337 INFO:tasks.workunit.client.0.smithi050.stdout:4/669: fsync d14/d1b/d1f/d22/fae 0 2023-01-04T18:17:10.338 INFO:tasks.workunit.client.0.smithi050.stdout:7/766: dwrite d6/d6b/d8b/fb8 [0,4194304] 0 2023-01-04T18:17:10.339 INFO:tasks.workunit.client.0.smithi050.stdout:3/684: dwrite d0/d1b/f1c [0,4194304] 0 2023-01-04T18:17:10.340 INFO:tasks.workunit.client.0.smithi050.stdout:9/667: write d1/d3/d11/d1f/f4e [1728779,37897] 0 2023-01-04T18:17:10.340 INFO:tasks.workunit.client.0.smithi050.stdout:9/668: chown d1/d6f/l79 22787664 1 2023-01-04T18:17:10.341 INFO:tasks.workunit.client.0.smithi050.stdout:9/669: fsync d1/d3/d11/d42/fc7 0 2023-01-04T18:17:10.342 INFO:tasks.workunit.client.0.smithi050.stdout:0/580: creat d0/d9f/d84/fb8 x:0 0 0 2023-01-04T18:17:10.342 INFO:tasks.workunit.client.0.smithi050.stdout:0/581: chown d0/d73/d68/f7f 1 1 2023-01-04T18:17:10.343 INFO:tasks.workunit.client.0.smithi050.stdout:0/582: readlink d0/d6/l6c 0 2023-01-04T18:17:10.343 INFO:tasks.workunit.client.0.smithi050.stdout:6/652: link d0/c84 d0/d9/d38/d1c/cc7 0 2023-01-04T18:17:10.344 INFO:tasks.workunit.client.0.smithi050.stdout:6/653: chown d0/d9/d25/f27 953 1 2023-01-04T18:17:10.350 INFO:tasks.workunit.client.0.smithi050.stdout:4/670: rmdir d14/d1b/d1f/d22/d3e 39 2023-01-04T18:17:10.354 INFO:tasks.workunit.client.0.smithi050.stdout:7/767: getdents d6/db/d15/d1b/d5b/dda 0 2023-01-04T18:17:10.354 INFO:tasks.workunit.client.0.smithi050.stdout:7/768: write d6/d28/d99/d7a/f8d [242244,69576] 0 2023-01-04T18:17:10.358 INFO:tasks.workunit.client.0.smithi050.stdout:3/685: getdents d0/d1b/d2f/d56/d6b 0 2023-01-04T18:17:10.359 INFO:tasks.workunit.client.0.smithi050.stdout:5/810: dwrite d13/d15/d66/db8/d27/d46/d4e/d4d/da9/fe3 [4194304,4194304] 0 2023-01-04T18:17:10.359 INFO:tasks.workunit.client.0.smithi050.stdout:5/811: stat d13/d15/d66/db8/d27/d44 0 2023-01-04T18:17:10.360 INFO:tasks.workunit.client.0.smithi050.stdout:6/654: dwrite d0/d4a/fb3 [0,4194304] 0 2023-01-04T18:17:10.360 INFO:tasks.workunit.client.0.smithi050.stdout:6/655: fdatasync d0/f6f 0 2023-01-04T18:17:10.361 INFO:tasks.workunit.client.0.smithi050.stdout:1/676: dwrite d8/d14/d1c/d28/d57/d6a/f7d [0,4194304] 0 2023-01-04T18:17:10.361 INFO:tasks.workunit.client.0.smithi050.stdout:9/670: creat d1/d12/d2d/fce x:0 0 0 2023-01-04T18:17:10.362 INFO:tasks.workunit.client.0.smithi050.stdout:9/671: fdatasync d1/d12/d41/d60/d95/f99 0 2023-01-04T18:17:10.365 INFO:tasks.workunit.client.0.smithi050.stdout:0/583: creat d0/d6/d28/d9c/fb9 x:0 0 0 2023-01-04T18:17:10.367 INFO:tasks.workunit.client.0.smithi050.stdout:0/584: dread d0/d6/d8/d4f/f69 [0,4194304] 0 2023-01-04T18:17:10.368 INFO:tasks.workunit.client.0.smithi050.stdout:4/671: creat d14/d1b/d1f/d22/d3e/d8a/fda x:0 0 0 2023-01-04T18:17:10.369 INFO:tasks.workunit.client.0.smithi050.stdout:0/585: write d0/d6/fa [5343470,34166] 0 2023-01-04T18:17:10.370 INFO:tasks.workunit.client.0.smithi050.stdout:0/586: write d0/d6/f3c [8647571,38356] 0 2023-01-04T18:17:10.370 INFO:tasks.workunit.client.0.smithi050.stdout:7/769: creat d6/d28/dde/f104 x:0 0 0 2023-01-04T18:17:10.370 INFO:tasks.workunit.client.0.smithi050.stdout:7/770: truncate d6/d28/fd4 299326 0 2023-01-04T18:17:10.371 INFO:tasks.workunit.client.0.smithi050.stdout:0/587: dread d0/d73/d79/f88 [0,4194304] 0 2023-01-04T18:17:10.372 INFO:tasks.workunit.client.0.smithi050.stdout:7/771: dread d6/fb4 [0,4194304] 0 2023-01-04T18:17:10.372 INFO:tasks.workunit.client.0.smithi050.stdout:7/772: chown d6/db 15246 1 2023-01-04T18:17:10.380 INFO:tasks.workunit.client.0.smithi050.stdout:6/656: symlink d0/d9/df/lc8 0 2023-01-04T18:17:10.383 INFO:tasks.workunit.client.0.smithi050.stdout:3/686: dwrite d0/d1b/d2f/d56/d98/d9c/dcd/f84 [0,4194304] 0 2023-01-04T18:17:10.385 INFO:tasks.workunit.client.0.smithi050.stdout:5/812: dwrite d13/d15/d66/db8/d27/d46/d4e/d4d/da9/fcc [0,4194304] 0 2023-01-04T18:17:10.388 INFO:tasks.workunit.client.0.smithi050.stdout:9/672: symlink d1/d3/d11/d42/dbd/lcf 0 2023-01-04T18:17:10.391 INFO:tasks.workunit.client.0.smithi050.stdout:4/672: symlink d14/d1b/d1f/d22/d3e/d44/d59/ldb 0 2023-01-04T18:17:10.392 INFO:tasks.workunit.client.0.smithi050.stdout:0/588: symlink d0/d6/lba 0 2023-01-04T18:17:10.398 INFO:tasks.workunit.client.0.smithi050.stdout:7/773: rmdir d6/db/d15/d2e/d66/d101 0 2023-01-04T18:17:10.398 INFO:tasks.workunit.client.0.smithi050.stdout:7/774: write d6/d28/d99/dd7/d42/ffb [46994,98495] 0 2023-01-04T18:17:10.398 INFO:tasks.workunit.client.0.smithi050.stdout:7/775: readlink d6/d6b/lbc 0 2023-01-04T18:17:10.400 INFO:tasks.workunit.client.0.smithi050.stdout:6/657: unlink d0/c2c 0 2023-01-04T18:17:10.400 INFO:tasks.workunit.client.0.smithi050.stdout:6/658: write d0/d5c/fbc [892034,32923] 0 2023-01-04T18:17:10.400 INFO:tasks.workunit.client.0.smithi050.stdout:6/659: read - d0/d9/d25/d4d/f7c zero size 2023-01-04T18:17:10.404 INFO:tasks.workunit.client.0.smithi050.stdout:1/677: dwrite d8/d14/d1c/fb1 [0,4194304] 0 2023-01-04T18:17:10.404 INFO:tasks.workunit.client.0.smithi050.stdout:3/687: symlink d0/d1b/d2f/d56/d6b/le9 0 2023-01-04T18:17:10.405 INFO:tasks.workunit.client.0.smithi050.stdout:3/688: stat d0/d10/fbe 0 2023-01-04T18:17:10.412 INFO:tasks.workunit.client.0.smithi050.stdout:4/673: creat d14/d1b/d1f/d22/d3e/d44/d59/d5f/d80/fdc x:0 0 0 2023-01-04T18:17:10.413 INFO:tasks.workunit.client.0.smithi050.stdout:4/674: write d14/d1b/d1f/d63/f71 [2194945,27038] 0 2023-01-04T18:17:10.413 INFO:tasks.workunit.client.0.smithi050.stdout:4/675: truncate d14/d1b/d1f/d22/d3e/f91 1295371 0 2023-01-04T18:17:10.416 INFO:tasks.workunit.client.0.smithi050.stdout:7/776: mkdir d6/d90/de3/d6a/d102/d105 0 2023-01-04T18:17:10.418 INFO:tasks.workunit.client.0.smithi050.stdout:6/660: symlink d0/d9/d38/d60/dc0/lc9 0 2023-01-04T18:17:10.428 INFO:tasks.workunit.client.0.smithi050.stdout:1/678: symlink d8/d14/d1c/d28/d57/d6a/lcf 0 2023-01-04T18:17:10.429 INFO:tasks.workunit.client.0.smithi050.stdout:8/733: sync 2023-01-04T18:17:10.429 INFO:tasks.workunit.client.0.smithi050.stdout:2/645: sync 2023-01-04T18:17:10.430 INFO:tasks.workunit.client.0.smithi050.stdout:2/646: fdatasync d1/dd/d11/d14/d91/f8c 0 2023-01-04T18:17:10.431 INFO:tasks.workunit.client.0.smithi050.stdout:7/777: symlink d6/d90/de3/d6a/d102/d105/l106 0 2023-01-04T18:17:10.431 INFO:tasks.workunit.client.0.smithi050.stdout:7/778: chown d6/d6b/d8b/cc1 1 1 2023-01-04T18:17:10.431 INFO:tasks.workunit.client.0.smithi050.stdout:7/779: truncate d6/d28/fd4 905145 0 2023-01-04T18:17:10.431 INFO:tasks.workunit.client.0.smithi050.stdout:4/676: dwrite d14/d1b/d1f/d22/f67 [0,4194304] 0 2023-01-04T18:17:10.434 INFO:tasks.workunit.client.0.smithi050.stdout:4/677: write d14/d1b/d1f/d22/d3e/f5a [1355637,68841] 0 2023-01-04T18:17:10.436 INFO:tasks.workunit.client.0.smithi050.stdout:4/678: write d14/d1b/d1f/d22/d3e/d85/f94 [4687235,89557] 0 2023-01-04T18:17:10.436 INFO:tasks.workunit.client.0.smithi050.stdout:6/661: rename d0/d9/d38/d16 to d0/d9/df/dba/dca 0 2023-01-04T18:17:10.503 INFO:tasks.workunit.client.0.smithi050.stdout:5/813: dwrite d13/d15/d66/db8/d27/f76 [0,4194304] 0 2023-01-04T18:17:10.508 INFO:tasks.workunit.client.0.smithi050.stdout:9/673: dwrite d1/d3/d24/fa6 [0,4194304] 0 2023-01-04T18:17:10.510 INFO:tasks.workunit.client.0.smithi050.stdout:9/674: write d1/d12/d41/f71 [2489072,129664] 0 2023-01-04T18:17:10.511 INFO:tasks.workunit.client.0.smithi050.stdout:9/675: write d1/d12/d2d/d39/f4d [5035178,93995] 0 2023-01-04T18:17:10.511 INFO:tasks.workunit.client.0.smithi050.stdout:9/676: read - d1/d3/d24/d97/da8/fc9 zero size 2023-01-04T18:17:10.512 INFO:tasks.workunit.client.0.smithi050.stdout:8/734: dwrite d3/f8e [0,4194304] 0 2023-01-04T18:17:10.514 INFO:tasks.workunit.client.0.smithi050.stdout:9/677: fdatasync d1/d12/d2d/d39/f4d 0 2023-01-04T18:17:10.517 INFO:tasks.workunit.client.0.smithi050.stdout:1/679: symlink d8/d14/d1c/d28/dcd/ld0 0 2023-01-04T18:17:10.524 INFO:tasks.workunit.client.0.smithi050.stdout:2/647: link d1/dd/d28/cb2 d1/dd/d11/cd5 0 2023-01-04T18:17:10.524 INFO:tasks.workunit.client.0.smithi050.stdout:2/648: truncate d1/dd/d62/da1/d4b/fcf 212797 0 2023-01-04T18:17:10.525 INFO:tasks.workunit.client.0.smithi050.stdout:7/780: truncate d6/d90/de3/fc0 3335546 0 2023-01-04T18:17:10.533 INFO:tasks.workunit.client.0.smithi050.stdout:2/649: dread d1/dd/d28/d2c/d2e/d3f/f8e [0,4194304] 0 2023-01-04T18:17:10.534 INFO:tasks.workunit.client.0.smithi050.stdout:4/679: rename d14/d1b/d1f/d22/d3e/d44/f7d to d14/d1b/d66/dc1/dd6/fdd 0 2023-01-04T18:17:10.535 INFO:tasks.workunit.client.0.smithi050.stdout:4/680: dread - d14/d9e/fb4 zero size 2023-01-04T18:17:10.535 INFO:tasks.workunit.client.0.smithi050.stdout:4/681: stat d14/d1b/d1f/d22/d3e 0 2023-01-04T18:17:10.538 INFO:tasks.workunit.client.0.smithi050.stdout:1/680: dwrite d8/d14/d1c/d28/d57/f61 [4194304,4194304] 0 2023-01-04T18:17:10.557 INFO:tasks.workunit.client.0.smithi050.stdout:7/781: dwrite d6/db/d20/d55/fba [0,4194304] 0 2023-01-04T18:17:10.561 INFO:tasks.workunit.client.0.smithi050.stdout:4/682: dwrite f4 [0,4194304] 0 2023-01-04T18:17:10.561 INFO:tasks.workunit.client.0.smithi050.stdout:4/683: fdatasync d14/d1b/d1f/d22/d3e/f60 0 2023-01-04T18:17:10.561 INFO:tasks.workunit.client.0.smithi050.stdout:4/684: fdatasync d14/d1b/d1f/f57 0 2023-01-04T18:17:10.567 INFO:tasks.workunit.client.0.smithi050.stdout:6/662: mkdir d0/d9/d38/d60/d7a/dcb 0 2023-01-04T18:17:10.583 INFO:tasks.workunit.client.0.smithi050.stdout:8/735: rmdir d3/d2a/d2d/d86 39 2023-01-04T18:17:10.585 INFO:tasks.workunit.client.0.smithi050.stdout:9/678: unlink d1/d3/f5c 0 2023-01-04T18:17:10.595 INFO:tasks.workunit.client.0.smithi050.stdout:1/681: mkdir d8/d48/d5c/d67/d3a/dd1 0 2023-01-04T18:17:10.597 INFO:tasks.workunit.client.0.smithi050.stdout:7/782: unlink d6/d90/cc9 0 2023-01-04T18:17:10.597 INFO:tasks.workunit.client.0.smithi050.stdout:7/783: read - d6/d28/dde/f104 zero size 2023-01-04T18:17:10.597 INFO:tasks.workunit.client.0.smithi050.stdout:7/784: fdatasync d6/db/d3a/fa5 0 2023-01-04T18:17:10.599 INFO:tasks.workunit.client.0.smithi050.stdout:4/685: symlink d14/d1b/d1f/d63/da5/db6/lde 0 2023-01-04T18:17:10.600 INFO:tasks.workunit.client.0.smithi050.stdout:4/686: write d14/d1b/d32/fbc [3174299,11819] 0 2023-01-04T18:17:10.602 INFO:tasks.workunit.client.0.smithi050.stdout:8/736: dwrite d3/d2a/d30/d3b/d4d/d23/d55/d5f/d82/ff8 [0,4194304] 0 2023-01-04T18:17:10.602 INFO:tasks.workunit.client.0.smithi050.stdout:8/737: dread - d3/d2a/d30/d3b/d4d/d23/d55/d5f/d82/fa3 zero size 2023-01-04T18:17:10.605 INFO:tasks.workunit.client.0.smithi050.stdout:6/663: mknod d0/d9/d38/d1c/ccc 0 2023-01-04T18:17:10.605 INFO:tasks.workunit.client.0.smithi050.stdout:6/664: write d0/d4a/d93/fa8 [888055,72439] 0 2023-01-04T18:17:10.605 INFO:tasks.workunit.client.0.smithi050.stdout:6/665: write d0/d9/d38/d1c/f9b [4286461,28739] 0 2023-01-04T18:17:10.607 INFO:tasks.workunit.client.0.smithi050.stdout:9/679: creat d1/d6f/fd0 x:0 0 0 2023-01-04T18:17:10.609 INFO:tasks.workunit.client.0.smithi050.stdout:5/814: rename d13/f14 to d13/d15/d66/db8/d27/d46/d4e/d4d/f125 0 2023-01-04T18:17:10.610 INFO:tasks.workunit.client.0.smithi050.stdout:7/785: dread d6/db/d20/d4f/ffa [0,4194304] 0 2023-01-04T18:17:10.613 INFO:tasks.workunit.client.0.smithi050.stdout:7/786: write d6/db/d15/d48/dc7/dee/ff7 [507903,6602] 0 2023-01-04T18:17:10.613 INFO:tasks.workunit.client.0.smithi050.stdout:7/787: readlink d6/d28/d99/dd7/lb7 0 2023-01-04T18:17:10.615 INFO:tasks.workunit.client.0.smithi050.stdout:8/738: creat d3/d2a/d30/d3b/d4d/d23/d55/d5f/f103 x:0 0 0 2023-01-04T18:17:10.619 INFO:tasks.workunit.client.0.smithi050.stdout:9/680: link d1/d12/d41/d60/d8e/lab d1/d12/d9f/ld1 0 2023-01-04T18:17:10.619 INFO:tasks.workunit.client.0.smithi050.stdout:9/681: truncate d1/d12/d41/fa3 354935 0 2023-01-04T18:17:10.621 INFO:tasks.workunit.client.0.smithi050.stdout:1/682: rename d8/f6f to d8/d48/d5c/d67/d3b/d84/fd2 0 2023-01-04T18:17:10.625 INFO:tasks.workunit.client.0.smithi050.stdout:6/666: dwrite d0/f2f [0,4194304] 0 2023-01-04T18:17:10.626 INFO:tasks.workunit.client.0.smithi050.stdout:7/788: creat d6/d90/f107 x:0 0 0 2023-01-04T18:17:10.627 INFO:tasks.workunit.client.0.smithi050.stdout:9/682: unlink d1/d12/d3f/l61 0 2023-01-04T18:17:10.630 INFO:tasks.workunit.client.0.smithi050.stdout:7/789: read d6/db/d15/d1b/d22/f39 [187667,53229] 0 2023-01-04T18:17:10.630 INFO:tasks.workunit.client.0.smithi050.stdout:7/790: write d6/db/d15/d1b/d5b/dda/fe1 [823706,56309] 0 2023-01-04T18:17:10.630 INFO:tasks.workunit.client.0.smithi050.stdout:7/791: dread - d6/db/d20/d4f/d6e/fd0 zero size 2023-01-04T18:17:10.630 INFO:tasks.workunit.client.0.smithi050.stdout:7/792: write d6/db/f60 [3055807,49923] 0 2023-01-04T18:17:10.630 INFO:tasks.workunit.client.0.smithi050.stdout:7/793: fsync d6/db/d20/d55/fbb 0 2023-01-04T18:17:10.630 INFO:tasks.workunit.client.0.smithi050.stdout:7/794: fdatasync d6/db/d20/d4f/d6e/fd0 0 2023-01-04T18:17:10.630 INFO:tasks.workunit.client.0.smithi050.stdout:4/687: rename d14/d1b/d1f/d22/d6a/f6b to d14/d1b/d1f/d22/d3e/d85/fdf 0 2023-01-04T18:17:10.632 INFO:tasks.workunit.client.0.smithi050.stdout:8/739: dread d3/d2a/d2d/f70 [0,4194304] 0 2023-01-04T18:17:10.635 INFO:tasks.workunit.client.0.smithi050.stdout:9/683: rmdir d1/d12/d41/d60/d7c/db3 0 2023-01-04T18:17:10.636 INFO:tasks.workunit.client.0.smithi050.stdout:7/795: symlink d6/d90/l108 0 2023-01-04T18:17:10.638 INFO:tasks.workunit.client.0.smithi050.stdout:1/683: dwrite d8/d48/d5c/d67/d3b/d84/fc5 [0,4194304] 0 2023-01-04T18:17:10.641 INFO:tasks.workunit.client.0.smithi050.stdout:5/815: rename d13/d15/d66/db8/d27/d46/d4e/l57 to d13/d28/d7c/d83/l126 0 2023-01-04T18:17:10.641 INFO:tasks.workunit.client.0.smithi050.stdout:5/816: fdatasync d13/d28/f36 0 2023-01-04T18:17:10.642 INFO:tasks.workunit.client.0.smithi050.stdout:4/688: dread d14/d1b/d1f/d22/d3e/f8d [0,4194304] 0 2023-01-04T18:17:10.646 INFO:tasks.workunit.client.0.smithi050.stdout:8/740: symlink d3/d2a/d2d/l104 0 2023-01-04T18:17:10.651 INFO:tasks.workunit.client.0.smithi050.stdout:9/684: creat d1/d12/d2d/d39/fd2 x:0 0 0 2023-01-04T18:17:10.651 INFO:tasks.workunit.client.0.smithi050.stdout:7/796: dwrite d6/db/d3b/fe5 [0,4194304] 0 2023-01-04T18:17:10.654 INFO:tasks.workunit.client.0.smithi050.stdout:3/689: sync 2023-01-04T18:17:10.654 INFO:tasks.workunit.client.0.smithi050.stdout:2/650: sync 2023-01-04T18:17:10.654 INFO:tasks.workunit.client.0.smithi050.stdout:0/589: sync 2023-01-04T18:17:10.654 INFO:tasks.workunit.client.0.smithi050.stdout:0/590: fsync d0/d6/d8/d35/f37 0 2023-01-04T18:17:10.654 INFO:tasks.workunit.client.0.smithi050.stdout:3/690: truncate d0/d1b/d2f/d71/fda 753895 0 2023-01-04T18:17:10.655 INFO:tasks.workunit.client.0.smithi050.stdout:8/741: dread d3/d2a/d30/d3b/d4d/d23/d55/d5f/f8a [0,4194304] 0 2023-01-04T18:17:10.656 INFO:tasks.workunit.client.0.smithi050.stdout:1/684: symlink d8/d14/d1c/d28/ld3 0 2023-01-04T18:17:10.661 INFO:tasks.workunit.client.0.smithi050.stdout:6/667: rename d0/f6f to d0/d9/d25/d2d/fcd 0 2023-01-04T18:17:10.661 INFO:tasks.workunit.client.0.smithi050.stdout:6/668: truncate d0/d9/d38/f5b 4409485 0 2023-01-04T18:17:10.661 INFO:tasks.workunit.client.0.smithi050.stdout:6/669: chown d0/d9/df/dba/dca/d77 3 1 2023-01-04T18:17:10.662 INFO:tasks.workunit.client.0.smithi050.stdout:6/670: stat d0/d9/d25/d2d/c41 0 2023-01-04T18:17:10.662 INFO:tasks.workunit.client.0.smithi050.stdout:8/742: dread d3/d2a/d60/f40 [0,4194304] 0 2023-01-04T18:17:10.663 INFO:tasks.workunit.client.0.smithi050.stdout:5/817: unlink d13/d15/d66/db8/d1f/f56 0 2023-01-04T18:17:10.668 INFO:tasks.workunit.client.0.smithi050.stdout:4/689: stat d14/d1b/d1f/d22/d3e/c40 0 2023-01-04T18:17:10.671 INFO:tasks.workunit.client.0.smithi050.stdout:9/685: creat d1/d3/fd3 x:0 0 0 2023-01-04T18:17:10.672 INFO:tasks.workunit.client.0.smithi050.stdout:9/686: chown d1 7 1 2023-01-04T18:17:10.672 INFO:tasks.workunit.client.0.smithi050.stdout:9/687: write d1/d3/d24/d97/da8/fc9 [325939,63997] 0 2023-01-04T18:17:10.672 INFO:tasks.workunit.client.0.smithi050.stdout:9/688: write d1/d12/d41/d60/f64 [4678653,46569] 0 2023-01-04T18:17:10.672 INFO:tasks.workunit.client.0.smithi050.stdout:9/689: chown d1/d12/d2d 32806350 1 2023-01-04T18:17:10.672 INFO:tasks.workunit.client.0.smithi050.stdout:9/690: readlink d1/d3/d13/l87 0 2023-01-04T18:17:10.672 INFO:tasks.workunit.client.0.smithi050.stdout:1/685: dwrite d8/d48/dac/fbe [0,4194304] 0 2023-01-04T18:17:10.675 INFO:tasks.workunit.client.0.smithi050.stdout:7/797: unlink d6/db/f19 0 2023-01-04T18:17:10.681 INFO:tasks.workunit.client.0.smithi050.stdout:9/691: dread d1/d12/d2d/f85 [0,4194304] 0 2023-01-04T18:17:10.710 INFO:tasks.workunit.client.0.smithi050.stdout:2/651: symlink d1/dd/d11/db5/ld6 0 2023-01-04T18:17:10.710 INFO:tasks.workunit.client.0.smithi050.stdout:2/652: truncate d1/dd/d28/d2c/f2d 1469290 0 2023-01-04T18:17:10.713 INFO:tasks.workunit.client.0.smithi050.stdout:0/591: mknod d0/d6/d8/d4f/cbb 0 2023-01-04T18:17:10.713 INFO:tasks.workunit.client.0.smithi050.stdout:0/592: fdatasync d0/d6/d8/d51/f8d 0 2023-01-04T18:17:10.714 INFO:tasks.workunit.client.0.smithi050.stdout:3/691: creat d0/d8f/d46/d80/dca/fea x:0 0 0 2023-01-04T18:17:10.714 INFO:tasks.workunit.client.0.smithi050.stdout:3/692: chown d0/fb 1936563 1 2023-01-04T18:17:10.717 INFO:tasks.workunit.client.0.smithi050.stdout:6/671: unlink d0/d9/d25/d40/l43 0 2023-01-04T18:17:10.717 INFO:tasks.workunit.client.0.smithi050.stdout:6/672: readlink d0/d4a/d93/lbe 0 2023-01-04T18:17:10.718 INFO:tasks.workunit.client.0.smithi050.stdout:8/743: creat d3/d2a/dff/f105 x:0 0 0 2023-01-04T18:17:10.722 INFO:tasks.workunit.client.0.smithi050.stdout:5/818: creat d13/d15/d66/db8/d27/dca/dd3/df8/f127 x:0 0 0 2023-01-04T18:17:10.725 INFO:tasks.workunit.client.0.smithi050.stdout:1/686: symlink d8/d14/d1c/d28/dc7/dca/ld4 0 2023-01-04T18:17:10.729 INFO:tasks.workunit.client.0.smithi050.stdout:3/693: dwrite d0/d8f/d46/d80/f82 [0,4194304] 0 2023-01-04T18:17:10.730 INFO:tasks.workunit.client.0.smithi050.stdout:7/798: mknod d6/ded/c109 0 2023-01-04T18:17:10.730 INFO:tasks.workunit.client.0.smithi050.stdout:7/799: fdatasync d6/db/d20/d55/fd6 0 2023-01-04T18:17:10.824 INFO:tasks.workunit.client.0.smithi050.stdout:9/692: rename d1/d3/d24/d97 to d1/d3/dbf/dd4 0 2023-01-04T18:17:10.826 INFO:tasks.workunit.client.0.smithi050.stdout:2/653: creat d1/dd/d28/d2c/d2e/d3f/fd7 x:0 0 0 2023-01-04T18:17:10.834 INFO:tasks.workunit.client.0.smithi050.stdout:0/593: symlink d0/d73/d68/lbc 0 2023-01-04T18:17:10.836 INFO:tasks.workunit.client.0.smithi050.stdout:6/673: getdents d0/d9/d38/d60 0 2023-01-04T18:17:10.840 INFO:tasks.workunit.client.0.smithi050.stdout:8/744: mkdir d3/d2a/d30/d3b/d4d/d23/d106 0 2023-01-04T18:17:10.843 INFO:tasks.workunit.client.0.smithi050.stdout:9/693: dread d1/d3/d13/f8d [0,4194304] 0 2023-01-04T18:17:10.843 INFO:tasks.workunit.client.0.smithi050.stdout:9/694: chown d1/d3 7397161 1 2023-01-04T18:17:10.843 INFO:tasks.workunit.client.0.smithi050.stdout:9/695: truncate d1/d3/d11/d42/fc7 1004809 0 2023-01-04T18:17:10.844 INFO:tasks.workunit.client.0.smithi050.stdout:5/819: rmdir d13/d15/d66/db8/d27/dca/dd3/df8 39 2023-01-04T18:17:10.844 INFO:tasks.workunit.client.0.smithi050.stdout:6/674: dread d0/d4a/fb3 [0,4194304] 0 2023-01-04T18:17:10.846 INFO:tasks.workunit.client.0.smithi050.stdout:3/694: rmdir d0/d1b/d2f/d56/d98/d9c/dc9 39 2023-01-04T18:17:10.846 INFO:tasks.workunit.client.0.smithi050.stdout:3/695: fdatasync d0/dd/f6c 0 2023-01-04T18:17:10.848 INFO:tasks.workunit.client.0.smithi050.stdout:7/800: creat d6/d28/d99/d7a/f10a x:0 0 0 2023-01-04T18:17:10.851 INFO:tasks.workunit.client.0.smithi050.stdout:2/654: mknod d1/dd/d28/d2c/dce/cd8 0 2023-01-04T18:17:10.852 INFO:tasks.workunit.client.0.smithi050.stdout:0/594: mknod d0/d9f/da1/cbd 0 2023-01-04T18:17:10.853 INFO:tasks.workunit.client.0.smithi050.stdout:0/595: chown d0/d6/d8/d51/f50 1619 1 2023-01-04T18:17:10.853 INFO:tasks.workunit.client.0.smithi050.stdout:0/596: dread - d0/d6/d8/d35/fa8 zero size 2023-01-04T18:17:10.857 INFO:tasks.workunit.client.0.smithi050.stdout:8/745: creat d3/d2a/d27/d8b/d9f/f107 x:0 0 0 2023-01-04T18:17:10.858 INFO:tasks.workunit.client.0.smithi050.stdout:9/696: creat d1/d3/d24/fd5 x:0 0 0 2023-01-04T18:17:10.862 INFO:tasks.workunit.client.0.smithi050.stdout:5/820: rename d13/d15/d66/db8/d27/dca/dd3/fe1 to d13/d15/d66/db8/d27/d78/f128 0 2023-01-04T18:17:10.863 INFO:tasks.workunit.client.0.smithi050.stdout:6/675: mkdir d0/d4a/d93/db1/dce 0 2023-01-04T18:17:10.865 INFO:tasks.workunit.client.0.smithi050.stdout:7/801: creat d6/db/f10b x:0 0 0 2023-01-04T18:17:10.866 INFO:tasks.workunit.client.0.smithi050.stdout:2/655: symlink d1/dd/d11/d14/d91/d5a/d7f/ld9 0 2023-01-04T18:17:10.874 INFO:tasks.workunit.client.0.smithi050.stdout:0/597: getdents d0/d6/d8/d4f 0 2023-01-04T18:17:10.875 INFO:tasks.workunit.client.0.smithi050.stdout:9/697: creat d1/d6f/fd6 x:0 0 0 2023-01-04T18:17:10.877 INFO:tasks.workunit.client.0.smithi050.stdout:8/746: dwrite d3/d2a/d27/d93/f7d [0,4194304] 0 2023-01-04T18:17:10.878 INFO:tasks.workunit.client.0.smithi050.stdout:3/696: rename d0/d1b/d2f/d56/d6b to d0/d8f/deb 0 2023-01-04T18:17:10.879 INFO:tasks.workunit.client.0.smithi050.stdout:7/802: truncate d6/db/d20/d4f/d6e/fd0 1320509 0 2023-01-04T18:17:10.879 INFO:tasks.workunit.client.0.smithi050.stdout:3/697: write d0/d1b/d2f/d56/d32/f48 [980265,54839] 0 2023-01-04T18:17:10.880 INFO:tasks.workunit.client.0.smithi050.stdout:3/698: write d0/dd/f6c [728636,96455] 0 2023-01-04T18:17:10.880 INFO:tasks.workunit.client.0.smithi050.stdout:9/698: dread d1/d12/d9f/fbb [0,4194304] 0 2023-01-04T18:17:10.880 INFO:tasks.workunit.client.0.smithi050.stdout:9/699: fdatasync d1/d12/d2d/d39/f92 0 2023-01-04T18:17:10.881 INFO:tasks.workunit.client.0.smithi050.stdout:2/656: symlink d1/dd/d28/lda 0 2023-01-04T18:17:10.885 INFO:tasks.workunit.client.0.smithi050.stdout:9/700: dread d1/d3/f19 [0,4194304] 0 2023-01-04T18:17:10.888 INFO:tasks.workunit.client.0.smithi050.stdout:0/598: unlink d0/d6/c11 0 2023-01-04T18:17:10.888 INFO:tasks.workunit.client.0.smithi050.stdout:0/599: truncate d0/d6/d28/f77 689782 0 2023-01-04T18:17:10.888 INFO:tasks.workunit.client.0.smithi050.stdout:2/657: dread d1/dd/d62/da1/f20 [0,4194304] 0 2023-01-04T18:17:10.891 INFO:tasks.workunit.client.0.smithi050.stdout:8/747: rmdir d3/d2a/d27/d8b 39 2023-01-04T18:17:10.892 INFO:tasks.workunit.client.0.smithi050.stdout:8/748: chown d3/d2a/d30/d3b 16330 1 2023-01-04T18:17:10.895 INFO:tasks.workunit.client.0.smithi050.stdout:5/821: rename d13/d15/d66/db8/d27/d46/d4e/d4d/da9/fef to d13/d15/d66/db8/d27/d44/d47/d124/d42/d4a/d8e/f129 0 2023-01-04T18:17:10.897 INFO:tasks.workunit.client.0.smithi050.stdout:7/803: creat d6/d1d/d81/f10c x:0 0 0 2023-01-04T18:17:10.903 INFO:tasks.workunit.client.0.smithi050.stdout:9/701: dwrite d1/d3/fd3 [0,4194304] 0 2023-01-04T18:17:10.904 INFO:tasks.workunit.client.0.smithi050.stdout:3/699: truncate d0/dd/f11 621483 0 2023-01-04T18:17:10.906 INFO:tasks.workunit.client.0.smithi050.stdout:0/600: unlink d0/d6/d8/d25/d8e/c94 0 2023-01-04T18:17:10.911 INFO:tasks.workunit.client.0.smithi050.stdout:2/658: creat d1/dd/d11/d14/d44/fdb x:0 0 0 2023-01-04T18:17:10.911 INFO:tasks.workunit.client.0.smithi050.stdout:2/659: truncate d1/dd/d28/d2c/f9a 1270333 0 2023-01-04T18:17:10.913 INFO:tasks.workunit.client.0.smithi050.stdout:8/749: dwrite d3/d2a/d74/d92/d94/d9c/fbc [0,4194304] 0 2023-01-04T18:17:10.914 INFO:tasks.workunit.client.0.smithi050.stdout:4/690: sync 2023-01-04T18:17:10.916 INFO:tasks.workunit.client.0.smithi050.stdout:9/702: dread d1/d12/d41/f71 [0,4194304] 0 2023-01-04T18:17:10.919 INFO:tasks.workunit.client.0.smithi050.stdout:5/822: symlink d13/d15/d66/db8/d8f/l12a 0 2023-01-04T18:17:10.919 INFO:tasks.workunit.client.0.smithi050.stdout:5/823: chown d13/d15/d66/db8/d27/d44/d47/d124/d42/dec/f108 8987606 1 2023-01-04T18:17:10.920 INFO:tasks.workunit.client.0.smithi050.stdout:9/703: write d1/d3/f18 [4004576,95265] 0 2023-01-04T18:17:10.920 INFO:tasks.workunit.client.0.smithi050.stdout:9/704: chown d1/d12/d9f/fa0 1 1 2023-01-04T18:17:10.924 INFO:tasks.workunit.client.0.smithi050.stdout:7/804: mkdir d6/db/d15/d48/dc7/d10d 0 2023-01-04T18:17:10.929 INFO:tasks.workunit.client.0.smithi050.stdout:3/700: symlink d0/d8f/deb/d7f/lec 0 2023-01-04T18:17:10.929 INFO:tasks.workunit.client.0.smithi050.stdout:3/701: chown d0/d1b/c33 0 1 2023-01-04T18:17:10.930 INFO:tasks.workunit.client.0.smithi050.stdout:0/601: mkdir d0/d6/d8/d35/dbe 0 2023-01-04T18:17:10.936 INFO:tasks.workunit.client.0.smithi050.stdout:2/660: link d1/dd/d11/cd5 d1/dd/d62/da1/cdc 0 2023-01-04T18:17:10.944 INFO:tasks.workunit.client.0.smithi050.stdout:8/750: truncate d3/d2a/d27/d93/d7f/d96/d46/f4a 2047271 0 2023-01-04T18:17:10.944 INFO:tasks.workunit.client.0.smithi050.stdout:4/691: rmdir d14/d1b/d1f/d22/d3e/d44/d59/d5d/d7f 39 2023-01-04T18:17:10.945 INFO:tasks.workunit.client.0.smithi050.stdout:8/751: write d3/d2a/d27/d93/d7f/d96/d46/fbd [1809756,22394] 0 2023-01-04T18:17:10.949 INFO:tasks.workunit.client.0.smithi050.stdout:9/705: unlink d1/d3/d11/d42/c88 0 2023-01-04T18:17:10.953 INFO:tasks.workunit.client.0.smithi050.stdout:7/805: link d6/d1d/d1f/le8 d6/d1d/d1f/d80/l10e 0 2023-01-04T18:17:10.953 INFO:tasks.workunit.client.0.smithi050.stdout:7/806: truncate d6/d28/f2c 8752998 0 2023-01-04T18:17:10.986 INFO:tasks.workunit.client.0.smithi050.stdout:9/706: dwrite d1/d12/d9f/fcb [0,4194304] 0 2023-01-04T18:17:10.986 INFO:tasks.workunit.client.0.smithi050.stdout:9/707: chown d1/d3/d24/d7b/laf 1473293542 1 2023-01-04T18:17:11.007 INFO:tasks.workunit.client.0.smithi050.stdout:3/702: mkdir d0/d1b/d2f/d56/d98/dc7/ded 0 2023-01-04T18:17:11.009 INFO:tasks.workunit.client.0.smithi050.stdout:0/602: truncate d0/d9f/d84/fb8 417457 0 2023-01-04T18:17:11.011 INFO:tasks.workunit.client.0.smithi050.stdout:2/661: dread d1/dd/f74 [0,4194304] 0 2023-01-04T18:17:11.019 INFO:tasks.workunit.client.0.smithi050.stdout:4/692: mkdir d14/d1b/d1f/d22/d87/de0 0 2023-01-04T18:17:11.019 INFO:tasks.workunit.client.0.smithi050.stdout:4/693: dread - d14/d1b/d1f/d22/d3e/d85/fcf zero size 2023-01-04T18:17:11.021 INFO:tasks.workunit.client.0.smithi050.stdout:5/824: truncate d13/d15/d66/db8/d27/d46/d4e/d4d/f51 1332476 0 2023-01-04T18:17:11.021 INFO:tasks.workunit.client.0.smithi050.stdout:5/825: write d13/d15/d66/db8/d1f/fa3 [3029680,36194] 0 2023-01-04T18:17:11.023 INFO:tasks.workunit.client.0.smithi050.stdout:7/807: rename d6/d1d/d81 to d6/db/d3a/dd2/d10f 0 2023-01-04T18:17:11.026 INFO:tasks.workunit.client.0.smithi050.stdout:1/687: sync 2023-01-04T18:17:11.027 INFO:tasks.workunit.client.0.smithi050.stdout:1/688: read d8/d14/d1c/d28/d57/d6a/f95 [1518472,96349] 0 2023-01-04T18:17:11.028 INFO:tasks.workunit.client.0.smithi050.stdout:1/689: write d8/f44 [3252311,45427] 0 2023-01-04T18:17:11.035 INFO:tasks.workunit.client.0.smithi050.stdout:9/708: link d1/d3/d3b/lbc d1/d3/d3b/d63/dc3/ld7 0 2023-01-04T18:17:11.037 INFO:tasks.workunit.client.0.smithi050.stdout:3/703: getdents d0/d1b 0 2023-01-04T18:17:11.082 INFO:tasks.workunit.client.0.smithi050.stdout:4/694: mkdir d14/d1b/d1f/d22/d3e/d44/d59/d5d/d7f/de1 0 2023-01-04T18:17:11.083 INFO:tasks.workunit.client.0.smithi050.stdout:4/695: write d14/d1b/d1f/d22/d3e/d44/d59/d5d/fc7 [3999069,87667] 0 2023-01-04T18:17:11.087 INFO:tasks.workunit.client.0.smithi050.stdout:5/826: mkdir d13/d15/d66/db8/d27/d44/d47/d124/d42/dec/d12b 0 2023-01-04T18:17:11.089 INFO:tasks.workunit.client.0.smithi050.stdout:7/808: getdents d6/db/d3a 0 2023-01-04T18:17:11.092 INFO:tasks.workunit.client.0.smithi050.stdout:1/690: rename d8/d48/d5c/d67/d3a/d23/f3e to d8/d48/d5c/d67/d3a/d31/d7f/fd5 0 2023-01-04T18:17:11.094 INFO:tasks.workunit.client.0.smithi050.stdout:2/662: dwrite d1/d41/f67 [0,4194304] 0 2023-01-04T18:17:11.095 INFO:tasks.workunit.client.0.smithi050.stdout:2/663: write d1/dd/d62/d69/f84 [109760,70958] 0 2023-01-04T18:17:11.095 INFO:tasks.workunit.client.0.smithi050.stdout:1/691: write d8/f44 [2168522,69614] 0 2023-01-04T18:17:11.096 INFO:tasks.workunit.client.0.smithi050.stdout:3/704: mkdir d0/d8f/d46/d80/dca/dee 0 2023-01-04T18:17:11.099 INFO:tasks.workunit.client.0.smithi050.stdout:0/603: symlink d0/d6/d8/lbf 0 2023-01-04T18:17:11.102 INFO:tasks.workunit.client.0.smithi050.stdout:4/696: rmdir d14/d1b/d32 39 2023-01-04T18:17:11.102 INFO:tasks.workunit.client.0.smithi050.stdout:4/697: chown d14/d1b/d1f/d22/d3e/laa 1 1 2023-01-04T18:17:11.103 INFO:tasks.workunit.client.0.smithi050.stdout:2/664: dread d1/d41/f67 [0,4194304] 0 2023-01-04T18:17:11.103 INFO:tasks.workunit.client.0.smithi050.stdout:2/665: fdatasync d1/dd/d11/d14/d91/f90 0 2023-01-04T18:17:11.106 INFO:tasks.workunit.client.0.smithi050.stdout:5/827: creat d13/d15/d66/db8/d8f/f12c x:0 0 0 2023-01-04T18:17:11.108 INFO:tasks.workunit.client.0.smithi050.stdout:7/809: getdents d6/d6b 0 2023-01-04T18:17:11.116 INFO:tasks.workunit.client.0.smithi050.stdout:1/692: rename d8/d48/d5c/d67/d3a/d31/d7f to d8/d14/d1c/d28/dc7/dd6 0 2023-01-04T18:17:11.120 INFO:tasks.workunit.client.0.smithi050.stdout:3/705: unlink d0/d1b/l26 0 2023-01-04T18:17:11.120 INFO:tasks.workunit.client.0.smithi050.stdout:3/706: chown d0/d10/ca7 1220011 1 2023-01-04T18:17:11.120 INFO:tasks.workunit.client.0.smithi050.stdout:0/604: creat d0/d6/d8/d4f/fc0 x:0 0 0 2023-01-04T18:17:11.121 INFO:tasks.workunit.client.0.smithi050.stdout:0/605: chown d0/d6/d28/c6a 3357637 1 2023-01-04T18:17:11.122 INFO:tasks.workunit.client.0.smithi050.stdout:5/828: getdents d13/d15 0 2023-01-04T18:17:11.123 INFO:tasks.workunit.client.0.smithi050.stdout:7/810: creat d6/db/d15/d1b/d22/da6/f110 x:0 0 0 2023-01-04T18:17:11.125 INFO:tasks.workunit.client.0.smithi050.stdout:1/693: rename d8/d48/d5c/d67/l24 to d8/d48/d5c/d67/d3b/ld7 0 2023-01-04T18:17:11.125 INFO:tasks.workunit.client.0.smithi050.stdout:1/694: chown d8/d14/d1c/d28/d57/d6a/d92/fae 1018 1 2023-01-04T18:17:11.125 INFO:tasks.workunit.client.0.smithi050.stdout:1/695: chown d8/d14/d1c/d28/d57/d6a/d92/fae 38393 1 2023-01-04T18:17:11.125 INFO:tasks.workunit.client.0.smithi050.stdout:1/696: chown d8/d14/ca1 190264 1 2023-01-04T18:17:11.126 INFO:tasks.workunit.client.0.smithi050.stdout:3/707: symlink d0/d1b/d2f/d56/d98/dc7/lef 0 2023-01-04T18:17:11.127 INFO:tasks.workunit.client.0.smithi050.stdout:5/829: rename d13/d15/d63/l110 to d13/d15/d66/db8/d27/d44/d47/d124/d59/d87/dbe/l12d 0 2023-01-04T18:17:11.127 INFO:tasks.workunit.client.0.smithi050.stdout:5/830: chown d13/d15/d66/db8/d27/d44/d101 12574 1 2023-01-04T18:17:11.128 INFO:tasks.workunit.client.0.smithi050.stdout:1/697: rename d8/dce/fbf to d8/d14/d1c/d28/d57/d6a/fd8 0 2023-01-04T18:17:11.129 INFO:tasks.workunit.client.0.smithi050.stdout:5/831: mknod d13/d15/d66/db8/d27/d46/d4e/d4d/d115/c12e 0 2023-01-04T18:17:11.129 INFO:tasks.workunit.client.0.smithi050.stdout:5/832: dread - d13/d15/d66/db8/d27/d44/d101/f10e zero size 2023-01-04T18:17:11.131 INFO:tasks.workunit.client.0.smithi050.stdout:3/708: rename d0/d1b/d2f/d56/d98/fb4 to d0/dd/de6/ff0 0 2023-01-04T18:17:11.131 INFO:tasks.workunit.client.0.smithi050.stdout:1/698: symlink d8/d48/d5c/d67/d3a/ld9 0 2023-01-04T18:17:11.133 INFO:tasks.workunit.client.0.smithi050.stdout:3/709: creat d0/dd/ff1 x:0 0 0 2023-01-04T18:17:11.142 INFO:tasks.workunit.client.0.smithi050.stdout:6/676: sync 2023-01-04T18:17:11.144 INFO:tasks.workunit.client.0.smithi050.stdout:6/677: mkdir d0/d9/d25/d40/dcf 0 2023-01-04T18:17:11.145 INFO:tasks.workunit.client.0.smithi050.stdout:5/833: dread d13/d15/f34 [0,4194304] 0 2023-01-04T18:17:11.145 INFO:tasks.workunit.client.0.smithi050.stdout:2/666: dwrite d1/dd/d28/d2c/f9a [0,4194304] 0 2023-01-04T18:17:11.145 INFO:tasks.workunit.client.0.smithi050.stdout:7/811: dread d6/db/d15/d1b/d70/f85 [0,4194304] 0 2023-01-04T18:17:11.145 INFO:tasks.workunit.client.0.smithi050.stdout:2/667: chown d1/dd/d11/d14/lb8 4237568 1 2023-01-04T18:17:11.145 INFO:tasks.workunit.client.0.smithi050.stdout:5/834: dread d13/d28/f93 [0,4194304] 0 2023-01-04T18:17:11.146 INFO:tasks.workunit.client.0.smithi050.stdout:6/678: creat d0/d5c/d5d/fd0 x:0 0 0 2023-01-04T18:17:11.147 INFO:tasks.workunit.client.0.smithi050.stdout:4/698: dwrite d14/d1b/d1f/d22/d3e/f91 [0,4194304] 0 2023-01-04T18:17:11.147 INFO:tasks.workunit.client.0.smithi050.stdout:4/699: fsync d14/d1b/d1f/d22/d3e/d44/d59/d5f/d80/fd8 0 2023-01-04T18:17:11.150 INFO:tasks.workunit.client.0.smithi050.stdout:1/699: dread d8/d14/f74 [4194304,4194304] 0 2023-01-04T18:17:11.150 INFO:tasks.workunit.client.0.smithi050.stdout:0/606: dwrite d0/d6/d28/f77 [0,4194304] 0 2023-01-04T18:17:11.154 INFO:tasks.workunit.client.0.smithi050.stdout:2/668: symlink d1/dd/d62/d69/ldd 0 2023-01-04T18:17:11.155 INFO:tasks.workunit.client.0.smithi050.stdout:7/812: symlink d6/d6b/l111 0 2023-01-04T18:17:11.156 INFO:tasks.workunit.client.0.smithi050.stdout:5/835: dread d13/d15/d66/fac [0,4194304] 0 2023-01-04T18:17:11.157 INFO:tasks.workunit.client.0.smithi050.stdout:3/710: dwrite d0/f40 [0,4194304] 0 2023-01-04T18:17:11.161 INFO:tasks.workunit.client.0.smithi050.stdout:7/813: write d6/db/d15/d1b/f21 [1598782,95459] 0 2023-01-04T18:17:11.161 INFO:tasks.workunit.client.0.smithi050.stdout:7/814: read - d6/db/d20/d55/fbb zero size 2023-01-04T18:17:11.164 INFO:tasks.workunit.client.0.smithi050.stdout:7/815: write d6/db/d15/d1b/f46 [7108785,76723] 0 2023-01-04T18:17:11.164 INFO:tasks.workunit.client.0.smithi050.stdout:4/700: creat d14/d1b/d66/fe2 x:0 0 0 2023-01-04T18:17:11.165 INFO:tasks.workunit.client.0.smithi050.stdout:4/701: fdatasync d14/d1b/d1f/d22/d3e/f5a 0 2023-01-04T18:17:11.165 INFO:tasks.workunit.client.0.smithi050.stdout:6/679: dwrite d0/f65 [0,4194304] 0 2023-01-04T18:17:11.165 INFO:tasks.workunit.client.0.smithi050.stdout:6/680: chown d0/d9/df/dba/dca/d6b/fb8 628433251 1 2023-01-04T18:17:11.176 INFO:tasks.workunit.client.0.smithi050.stdout:1/700: rename d8/d48/d5c/d67/d3a/c55 to d8/d48/d5c/d67/d3a/cda 0 2023-01-04T18:17:11.180 INFO:tasks.workunit.client.0.smithi050.stdout:0/607: dread d0/f6d [0,4194304] 0 2023-01-04T18:17:11.181 INFO:tasks.workunit.client.0.smithi050.stdout:5/836: mknod d13/d28/c12f 0 2023-01-04T18:17:11.181 INFO:tasks.workunit.client.0.smithi050.stdout:5/837: chown d13/d15/d66/db8/d27/dca/ld4 0 1 2023-01-04T18:17:11.184 INFO:tasks.workunit.client.0.smithi050.stdout:7/816: symlink d6/d28/dde/de6/l112 0 2023-01-04T18:17:11.188 INFO:tasks.workunit.client.0.smithi050.stdout:3/711: dwrite d0/d8f/deb/f99 [0,4194304] 0 2023-01-04T18:17:11.188 INFO:tasks.workunit.client.0.smithi050.stdout:3/712: write d0/d8f/d46/d80/dca/fea [169304,77530] 0 2023-01-04T18:17:11.188 INFO:tasks.workunit.client.0.smithi050.stdout:3/713: dread - d0/d1b/d2f/d56/d32/fb2 zero size 2023-01-04T18:17:11.188 INFO:tasks.workunit.client.0.smithi050.stdout:1/701: dread d8/d48/d5c/d67/d3a/f70 [0,4194304] 0 2023-01-04T18:17:11.189 INFO:tasks.workunit.client.0.smithi050.stdout:1/702: write d8/f4d [6497368,67263] 0 2023-01-04T18:17:11.189 INFO:tasks.workunit.client.0.smithi050.stdout:4/702: dwrite d14/d1b/d1f/d22/d3e/d44/f68 [0,4194304] 0 2023-01-04T18:17:11.190 INFO:tasks.workunit.client.0.smithi050.stdout:1/703: read d8/d14/d1c/d28/d57/d6a/d92/f99 [2110173,8072] 0 2023-01-04T18:17:11.190 INFO:tasks.workunit.client.0.smithi050.stdout:1/704: readlink d8/d14/d1c/d28/dc7/dca/ld4 0 2023-01-04T18:17:11.192 INFO:tasks.workunit.client.0.smithi050.stdout:6/681: rename d0/c9e to d0/d4a/d93/cd1 0 2023-01-04T18:17:11.193 INFO:tasks.workunit.client.0.smithi050.stdout:6/682: dread - d0/d9/d25/d40/d89/f94 zero size 2023-01-04T18:17:11.199 INFO:tasks.workunit.client.0.smithi050.stdout:2/669: mknod d1/dd/cde 0 2023-01-04T18:17:11.200 INFO:tasks.workunit.client.0.smithi050.stdout:0/608: rmdir d0/d6/d8 39 2023-01-04T18:17:11.200 INFO:tasks.workunit.client.0.smithi050.stdout:0/609: fsync d0/d6/d8/d4f/fa6 0 2023-01-04T18:17:11.202 INFO:tasks.workunit.client.0.smithi050.stdout:5/838: mknod d13/d15/d66/db8/d27/d44/d47/d124/d42/d4a/c130 0 2023-01-04T18:17:11.205 INFO:tasks.workunit.client.0.smithi050.stdout:7/817: truncate d6/db/d15/d1b/d5b/fce 3916824 0 2023-01-04T18:17:11.208 INFO:tasks.workunit.client.0.smithi050.stdout:3/714: dwrite d0/d8f/f67 [0,4194304] 0 2023-01-04T18:17:11.221 INFO:tasks.workunit.client.0.smithi050.stdout:4/703: dwrite d14/d1b/d1f/d63/f71 [0,4194304] 0 2023-01-04T18:17:11.221 INFO:tasks.workunit.client.0.smithi050.stdout:4/704: fsync d14/f18 0 2023-01-04T18:17:11.221 INFO:tasks.workunit.client.0.smithi050.stdout:4/705: fsync d14/f1a 0 2023-01-04T18:17:11.251 INFO:tasks.workunit.client.0.smithi050.stdout:1/705: unlink d8/d48/d5c/d67/d3b/f68 0 2023-01-04T18:17:11.251 INFO:tasks.workunit.client.0.smithi050.stdout:1/706: fsync d8/d14/d1c/d28/fb5 0 2023-01-04T18:17:11.255 INFO:tasks.workunit.client.0.smithi050.stdout:6/683: symlink d0/db6/ld2 0 2023-01-04T18:17:11.261 INFO:tasks.workunit.client.0.smithi050.stdout:2/670: rename d1/dd/f3a to d1/dd/d28/d2c/d66/da2/fdf 0 2023-01-04T18:17:11.265 INFO:tasks.workunit.client.0.smithi050.stdout:1/707: dwrite d8/d14/d1c/f76 [0,4194304] 0 2023-01-04T18:17:11.266 INFO:tasks.workunit.client.0.smithi050.stdout:8/752: sync 2023-01-04T18:17:11.266 INFO:tasks.workunit.client.0.smithi050.stdout:8/753: dread - d3/d2a/d30/d3b/d53/fdd zero size 2023-01-04T18:17:11.266 INFO:tasks.workunit.client.0.smithi050.stdout:8/754: dread - d3/d2a/d74/d92/d94/fed zero size 2023-01-04T18:17:11.268 INFO:tasks.workunit.client.0.smithi050.stdout:5/839: link d13/d15/d66/db8/d27/d46/d4e/d4d/f51 d13/d15/d66/db8/d27/dca/f131 0 2023-01-04T18:17:11.269 INFO:tasks.workunit.client.0.smithi050.stdout:9/709: sync 2023-01-04T18:17:11.272 INFO:tasks.workunit.client.0.smithi050.stdout:4/706: truncate d14/d1b/f8f 2174490 0 2023-01-04T18:17:11.272 INFO:tasks.workunit.client.0.smithi050.stdout:4/707: write d14/d1b/d1f/d22/d3e/d44/d59/d5d/fb2 [326404,118965] 0 2023-01-04T18:17:11.276 INFO:tasks.workunit.client.0.smithi050.stdout:6/684: truncate d0/d9/d38/d1c/f26 2836650 0 2023-01-04T18:17:11.276 INFO:tasks.workunit.client.0.smithi050.stdout:2/671: creat d1/dd/d28/fe0 x:0 0 0 2023-01-04T18:17:11.280 INFO:tasks.workunit.client.0.smithi050.stdout:5/840: creat d13/d15/d66/db8/d27/d46/d4e/d4d/db1/dbc/d11f/f132 x:0 0 0 2023-01-04T18:17:11.283 INFO:tasks.workunit.client.0.smithi050.stdout:9/710: creat d1/d12/d9f/fd8 x:0 0 0 2023-01-04T18:17:11.283 INFO:tasks.workunit.client.0.smithi050.stdout:9/711: chown d1/d3/d24/fa6 88021886 1 2023-01-04T18:17:11.286 INFO:tasks.workunit.client.0.smithi050.stdout:8/755: dread d3/d2a/f9b [0,4194304] 0 2023-01-04T18:17:11.286 INFO:tasks.workunit.client.0.smithi050.stdout:8/756: write d3/d2a/d27/d8b/d9f/f107 [590317,3358] 0 2023-01-04T18:17:11.287 INFO:tasks.workunit.client.0.smithi050.stdout:0/610: dwrite d0/f7e [4194304,4194304] 0 2023-01-04T18:17:11.287 INFO:tasks.workunit.client.0.smithi050.stdout:4/708: creat d14/d1b/d1f/d22/d3e/d44/d59/d5d/d7f/de1/fe3 x:0 0 0 2023-01-04T18:17:11.287 INFO:tasks.workunit.client.0.smithi050.stdout:4/709: chown d14/d1b/d1f/d22/d3e 267477090 1 2023-01-04T18:17:11.288 INFO:tasks.workunit.client.0.smithi050.stdout:1/708: dwrite d8/f89 [0,4194304] 0 2023-01-04T18:17:11.289 INFO:tasks.workunit.client.0.smithi050.stdout:1/709: chown d8/d48/d5c/d67/d3a/d23/l2a 230344 1 2023-01-04T18:17:11.289 INFO:tasks.workunit.client.0.smithi050.stdout:2/672: mknod d1/dd/d28/d2c/d66/ce1 0 2023-01-04T18:17:11.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:09.922338+0000 mgr.smithi098.vhfzum (mgr.24455) 48 : cluster [DBG] pgmap v34: 65 pgs: 65 active+clean; 1.6 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 89 MiB/s rd, 197 MiB/s wr, 397 op/s 2023-01-04T18:17:11.297 INFO:tasks.workunit.client.0.smithi050.stdout:5/841: creat d13/d15/d66/db8/d27/d78/f133 x:0 0 0 2023-01-04T18:17:11.297 INFO:tasks.workunit.client.0.smithi050.stdout:9/712: getdents d1/d3/dbf 0 2023-01-04T18:17:11.297 INFO:tasks.workunit.client.0.smithi050.stdout:9/713: write d1/f47 [4023883,19824] 0 2023-01-04T18:17:11.300 INFO:tasks.workunit.client.0.smithi050.stdout:6/685: dwrite d0/d9/df/dba/dca/d6b/fb8 [0,4194304] 0 2023-01-04T18:17:11.301 INFO:tasks.workunit.client.0.smithi050.stdout:8/757: creat d3/d2a/d74/d92/d94/d9c/f108 x:0 0 0 2023-01-04T18:17:11.301 INFO:tasks.workunit.client.0.smithi050.stdout:8/758: stat d3/c8 0 2023-01-04T18:17:11.306 INFO:tasks.workunit.client.0.smithi050.stdout:1/710: dwrite d8/d14/d1c/d28/d57/d6a/d92/f99 [0,4194304] 0 2023-01-04T18:17:11.307 INFO:tasks.workunit.client.0.smithi050.stdout:1/711: chown d8/d48/d5c/cc1 7899 1 2023-01-04T18:17:11.307 INFO:tasks.workunit.client.0.smithi050.stdout:0/611: creat d0/d6/d8/d35/dbe/fc1 x:0 0 0 2023-01-04T18:17:11.309 INFO:tasks.workunit.client.0.smithi050.stdout:4/710: rmdir d14/d1b/d1f/d22/d3e/d44/d59/d5f/d6f 39 2023-01-04T18:17:11.312 INFO:tasks.workunit.client.0.smithi050.stdout:2/673: rmdir d1/dd/d28/d2c 39 2023-01-04T18:17:11.314 INFO:tasks.workunit.client.0.smithi050.stdout:5/842: symlink d13/d15/d66/db8/d27/d46/d4e/d4d/da9/l134 0 2023-01-04T18:17:11.322 INFO:tasks.workunit.client.0.smithi050.stdout:6/686: dwrite d0/d9/d25/f3a [0,4194304] 0 2023-01-04T18:17:11.322 INFO:tasks.workunit.client.0.smithi050.stdout:4/711: dread d14/d1b/d32/f45 [0,4194304] 0 2023-01-04T18:17:11.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:09.922338+0000 mgr.smithi098.vhfzum (mgr.24455) 48 : cluster [DBG] pgmap v34: 65 pgs: 65 active+clean; 1.6 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 89 MiB/s rd, 197 MiB/s wr, 397 op/s 2023-01-04T18:17:11.332 INFO:tasks.workunit.client.0.smithi050.stdout:9/714: dwrite d1/d12/d41/f71 [0,4194304] 0 2023-01-04T18:17:11.333 INFO:tasks.workunit.client.0.smithi050.stdout:9/715: chown d1/d12/d41/fa3 1852547 1 2023-01-04T18:17:11.335 INFO:tasks.workunit.client.0.smithi050.stdout:6/687: dread d0/d5c/db7/f87 [0,4194304] 0 2023-01-04T18:17:11.357 INFO:tasks.workunit.client.0.smithi050.stdout:8/759: creat d3/d2a/d73/f109 x:0 0 0 2023-01-04T18:17:11.358 INFO:tasks.workunit.client.0.smithi050.stdout:8/760: write d3/d2a/f6e [380861,85749] 0 2023-01-04T18:17:11.364 INFO:tasks.workunit.client.0.smithi050.stdout:2/674: mknod d1/dd/d62/da1/d83/ce2 0 2023-01-04T18:17:11.364 INFO:tasks.workunit.client.0.smithi050.stdout:2/675: chown d1/dd/d28/d2c/d2e/c32 707 1 2023-01-04T18:17:11.364 INFO:tasks.workunit.client.0.smithi050.stdout:2/676: write d1/f97 [2651297,94812] 0 2023-01-04T18:17:11.366 INFO:tasks.workunit.client.0.smithi050.stdout:5/843: creat d13/d15/d63/f135 x:0 0 0 2023-01-04T18:17:11.367 INFO:tasks.workunit.client.0.smithi050.stdout:5/844: chown d13/d15/d66/db8/d27/d46/d4e/d4d/db1/dbc/d11f 73 1 2023-01-04T18:17:11.367 INFO:tasks.workunit.client.0.smithi050.stdout:5/845: chown d13/d15/d66/db8/d27/cab 12340 1 2023-01-04T18:17:11.369 INFO:tasks.workunit.client.0.smithi050.stdout:4/712: mkdir d14/d1b/d66/dc1/de4 0 2023-01-04T18:17:11.370 INFO:tasks.workunit.client.0.smithi050.stdout:9/716: mkdir d1/d12/d2d/d39/dd9 0 2023-01-04T18:17:11.372 INFO:tasks.workunit.client.0.smithi050.stdout:6/688: creat d0/d9/d38/fd3 x:0 0 0 2023-01-04T18:17:11.372 INFO:tasks.workunit.client.0.smithi050.stdout:6/689: truncate d0/d9/f2b 897726 0 2023-01-04T18:17:11.372 INFO:tasks.workunit.client.0.smithi050.stdout:6/690: chown d0/c84 6 1 2023-01-04T18:17:11.378 INFO:tasks.workunit.client.0.smithi050.stdout:8/761: truncate d3/d2a/d2d/f50 117682 0 2023-01-04T18:17:11.380 INFO:tasks.workunit.client.0.smithi050.stdout:5/846: rename d13/d15/d66/db8/d27/d44/d47/d124/d49/fea to d13/d15/d63/f136 0 2023-01-04T18:17:11.380 INFO:tasks.workunit.client.0.smithi050.stdout:5/847: write d13/d15/d66/db8/d27/d44/f82 [319649,43782] 0 2023-01-04T18:17:11.381 INFO:tasks.workunit.client.0.smithi050.stdout:4/713: mknod d14/d1b/d1f/d22/d3e/d44/d59/d5d/d7f/de1/ce5 0 2023-01-04T18:17:11.391 INFO:tasks.workunit.client.0.smithi050.stdout:2/677: dwrite d1/dd/d62/da1/d83/fa6 [0,4194304] 0 2023-01-04T18:17:11.391 INFO:tasks.workunit.client.0.smithi050.stdout:2/678: readlink d1/dd/d11/d14/d91/d5a/d7f/l8a 0 2023-01-04T18:17:11.396 INFO:tasks.workunit.client.0.smithi050.stdout:2/679: dread d1/dd/d38/fb9 [0,4194304] 0 2023-01-04T18:17:11.400 INFO:tasks.workunit.client.0.smithi050.stdout:5/848: dwrite d13/d28/f93 [0,4194304] 0 2023-01-04T18:17:11.414 INFO:tasks.workunit.client.0.smithi050.stdout:9/717: mkdir d1/d3/dbf/dd4/da8/dda 0 2023-01-04T18:17:11.414 INFO:tasks.workunit.client.0.smithi050.stdout:9/718: chown d1/d3/d11/c28 46597 1 2023-01-04T18:17:11.417 INFO:tasks.workunit.client.0.smithi050.stdout:6/691: mkdir d0/d9/d25/dd4 0 2023-01-04T18:17:11.422 INFO:tasks.workunit.client.0.smithi050.stdout:4/714: creat d14/fe6 x:0 0 0 2023-01-04T18:17:11.427 INFO:tasks.workunit.client.0.smithi050.stdout:2/680: mknod d1/dd/d11/d14/ce3 0 2023-01-04T18:17:11.431 INFO:tasks.workunit.client.0.smithi050.stdout:5/849: truncate d13/d28/f3e 40338 0 2023-01-04T18:17:11.432 INFO:tasks.workunit.client.0.smithi050.stdout:5/850: chown d13/d15/f26 1 1 2023-01-04T18:17:11.432 INFO:tasks.workunit.client.0.smithi050.stdout:6/692: dwrite d0/d9/df/dba/dca/f37 [0,4194304] 0 2023-01-04T18:17:11.432 INFO:tasks.workunit.client.0.smithi050.stdout:6/693: write d0/d9/d38/d60/f80 [1556780,97871] 0 2023-01-04T18:17:11.433 INFO:tasks.workunit.client.0.smithi050.stdout:9/719: creat d1/d3/dbf/dd4/da8/fdb x:0 0 0 2023-01-04T18:17:11.434 INFO:tasks.workunit.client.0.smithi050.stdout:9/720: read d1/d12/d3f/f83 [1787611,53611] 0 2023-01-04T18:17:11.445 INFO:tasks.workunit.client.0.smithi050.stdout:4/715: creat d14/d1b/fe7 x:0 0 0 2023-01-04T18:17:11.446 INFO:tasks.workunit.client.0.smithi050.stdout:2/681: truncate d1/dd/d28/f43 3368285 0 2023-01-04T18:17:11.452 INFO:tasks.workunit.client.0.smithi050.stdout:2/682: dread d1/dd/d38/fb9 [0,4194304] 0 2023-01-04T18:17:11.452 INFO:tasks.workunit.client.0.smithi050.stdout:5/851: mkdir d13/d15/d66/db8/d137 0 2023-01-04T18:17:11.452 INFO:tasks.workunit.client.0.smithi050.stdout:5/852: chown d13/d15/d66/db8/d27/d44/d47/d124/d42/dec/f108 20410 1 2023-01-04T18:17:11.453 INFO:tasks.workunit.client.0.smithi050.stdout:5/853: dread - d13/d15/d66/db8/dd9/f10b zero size 2023-01-04T18:17:11.457 INFO:tasks.workunit.client.0.smithi050.stdout:6/694: rename d0/d9/d38/f15 to d0/d9/df/dba/fd5 0 2023-01-04T18:17:11.457 INFO:tasks.workunit.client.0.smithi050.stdout:6/695: chown d0/d9/df/dba/fd5 26654923 1 2023-01-04T18:17:11.457 INFO:tasks.workunit.client.0.smithi050.stdout:6/696: dread - d0/d9/d25/d40/d89/f94 zero size 2023-01-04T18:17:11.457 INFO:tasks.workunit.client.0.smithi050.stdout:6/697: chown d0/d4a/c76 0 1 2023-01-04T18:17:11.459 INFO:tasks.workunit.client.0.smithi050.stdout:9/721: mkdir d1/d3/ddc 0 2023-01-04T18:17:11.466 INFO:tasks.workunit.client.0.smithi050.stdout:4/716: getdents d14/d1b/d1f/d22/d3e/d44/d59/d5f 0 2023-01-04T18:17:11.472 INFO:tasks.workunit.client.0.smithi050.stdout:2/683: mkdir d1/dd/d28/d79/de4 0 2023-01-04T18:17:11.476 INFO:tasks.workunit.client.0.smithi050.stdout:6/698: dwrite d0/d5c/d5d/faf [0,4194304] 0 2023-01-04T18:17:11.483 INFO:tasks.workunit.client.0.smithi050.stdout:9/722: getdents d1/d12/d9f 0 2023-01-04T18:17:11.483 INFO:tasks.workunit.client.0.smithi050.stdout:9/723: truncate d1/d12/d2d/d39/fd2 589284 0 2023-01-04T18:17:11.485 INFO:tasks.workunit.client.0.smithi050.stdout:0/612: sync 2023-01-04T18:17:11.485 INFO:tasks.workunit.client.0.smithi050.stdout:1/712: sync 2023-01-04T18:17:11.485 INFO:tasks.workunit.client.0.smithi050.stdout:7/818: sync 2023-01-04T18:17:11.485 INFO:tasks.workunit.client.0.smithi050.stdout:3/715: sync 2023-01-04T18:17:11.485 INFO:tasks.workunit.client.0.smithi050.stdout:3/716: write d0/d8f/deb/fe3 [309638,49477] 0 2023-01-04T18:17:11.487 INFO:tasks.workunit.client.0.smithi050.stdout:4/717: creat d14/d1b/d1f/fe8 x:0 0 0 2023-01-04T18:17:11.489 INFO:tasks.workunit.client.0.smithi050.stdout:2/684: dwrite d1/dd/d38/fb9 [4194304,4194304] 0 2023-01-04T18:17:11.489 INFO:tasks.workunit.client.0.smithi050.stdout:2/685: fsync d1/dd/d11/d14/d44/fdb 0 2023-01-04T18:17:11.491 INFO:tasks.workunit.client.0.smithi050.stdout:6/699: creat d0/d9/df/dba/dca/d6b/fd6 x:0 0 0 2023-01-04T18:17:11.491 INFO:tasks.workunit.client.0.smithi050.stdout:9/724: dread d1/d12/d9f/fcb [0,4194304] 0 2023-01-04T18:17:11.495 INFO:tasks.workunit.client.0.smithi050.stdout:1/713: rmdir d8/d48 39 2023-01-04T18:17:11.497 INFO:tasks.workunit.client.0.smithi050.stdout:8/762: sync 2023-01-04T18:17:11.500 INFO:tasks.workunit.client.0.smithi050.stdout:7/819: symlink d6/db/d15/d48/dc7/dee/l113 0 2023-01-04T18:17:11.501 INFO:tasks.workunit.client.0.smithi050.stdout:3/717: truncate d0/d1b/d2f/d56/d32/fa6 1324421 0 2023-01-04T18:17:11.501 INFO:tasks.workunit.client.0.smithi050.stdout:3/718: chown d0/d10/f42 134 1 2023-01-04T18:17:11.501 INFO:tasks.workunit.client.0.smithi050.stdout:3/719: write d0/dd/f11 [1609039,14561] 0 2023-01-04T18:17:11.502 INFO:tasks.workunit.client.0.smithi050.stdout:7/820: write d6/db/d15/d48/dc7/dee/ff7 [815617,32866] 0 2023-01-04T18:17:11.502 INFO:tasks.workunit.client.0.smithi050.stdout:7/821: write d6/d6b/d8b/ff0 [195579,51052] 0 2023-01-04T18:17:11.502 INFO:tasks.workunit.client.0.smithi050.stdout:7/822: fsync d6/d28/d99/dd7/d42/ffb 0 2023-01-04T18:17:11.503 INFO:tasks.workunit.client.0.smithi050.stdout:4/718: link d14/d1b/c33 d14/d1b/d1f/d22/d3e/d44/d59/d5d/ce9 0 2023-01-04T18:17:11.503 INFO:tasks.workunit.client.0.smithi050.stdout:4/719: chown d14/d1b/d1f/d22/d3e/d44/d59/d5f/d6f 4002 1 2023-01-04T18:17:11.503 INFO:tasks.workunit.client.0.smithi050.stdout:4/720: readlink d14/d1b/d1f/d22/d3e/laa 0 2023-01-04T18:17:11.504 INFO:tasks.workunit.client.0.smithi050.stdout:5/854: dread d13/d15/d66/db8/d1f/d62/fb0 [0,4194304] 0 2023-01-04T18:17:11.504 INFO:tasks.workunit.client.0.smithi050.stdout:5/855: chown d13/d15/d66/db8/d27/fce 1 1 2023-01-04T18:17:11.507 INFO:tasks.workunit.client.0.smithi050.stdout:2/686: mknod d1/dd/d28/d2c/ce5 0 2023-01-04T18:17:11.507 INFO:tasks.workunit.client.0.smithi050.stdout:4/721: dread f7 [0,4194304] 0 2023-01-04T18:17:11.508 INFO:tasks.workunit.client.0.smithi050.stdout:6/700: truncate d0/f14 270840 0 2023-01-04T18:17:11.511 INFO:tasks.workunit.client.0.smithi050.stdout:1/714: unlink d8/d48/d5c/d67/d3b/d84/fd2 0 2023-01-04T18:17:11.513 INFO:tasks.workunit.client.0.smithi050.stdout:8/763: mknod d3/d2a/d27/c10a 0 2023-01-04T18:17:11.513 INFO:tasks.workunit.client.0.smithi050.stdout:8/764: chown d3/d2a/d30/d3b/d4d/d23 10918116 1 2023-01-04T18:17:11.514 INFO:tasks.workunit.client.0.smithi050.stdout:9/725: dwrite d1/d3/d11/f43 [0,4194304] 0 2023-01-04T18:17:11.515 INFO:tasks.workunit.client.0.smithi050.stdout:9/726: chown d1/d6f/faa 34450971 1 2023-01-04T18:17:11.516 INFO:tasks.workunit.client.0.smithi050.stdout:3/720: rename d0/d1b/f1c to d0/d8f/deb/ff2 0 2023-01-04T18:17:11.516 INFO:tasks.workunit.client.0.smithi050.stdout:0/613: dwrite d0/d73/d68/fa0 [0,4194304] 0 2023-01-04T18:17:11.516 INFO:tasks.workunit.client.0.smithi050.stdout:1/715: write d8/f44 [372853,81810] 0 2023-01-04T18:17:11.521 INFO:tasks.workunit.client.0.smithi050.stdout:7/823: dread d6/db/d3b/f61 [0,4194304] 0 2023-01-04T18:17:11.523 INFO:tasks.workunit.client.0.smithi050.stdout:5/856: symlink d13/d15/d66/db8/d27/d44/d47/d124/d59/d87/l138 0 2023-01-04T18:17:11.524 INFO:tasks.workunit.client.0.smithi050.stdout:6/701: dwrite d0/d9/d38/fd [0,4194304] 0 2023-01-04T18:17:11.528 INFO:tasks.workunit.client.0.smithi050.stdout:5/857: write d13/d15/d66/db8/d1f/fb7 [2661489,99472] 0 2023-01-04T18:17:11.528 INFO:tasks.workunit.client.0.smithi050.stdout:5/858: truncate d13/d15/d66/db8/d27/d78/f103 752047 0 2023-01-04T18:17:11.552 INFO:tasks.workunit.client.0.smithi050.stdout:7/824: dwrite d6/db/d15/d48/dc7/dee/ff7 [0,4194304] 0 2023-01-04T18:17:11.571 INFO:tasks.workunit.client.0.smithi050.stdout:2/687: getdents d1/dd/d62/da1/d4b 0 2023-01-04T18:17:11.577 INFO:tasks.workunit.client.0.smithi050.stdout:4/722: symlink d14/d1b/d1f/d22/d3e/d44/d59/d5f/lea 0 2023-01-04T18:17:11.581 INFO:tasks.workunit.client.0.smithi050.stdout:8/765: link d3/d2a/f24 d3/d2a/d30/d3b/d4d/d23/f10b 0 2023-01-04T18:17:11.584 INFO:tasks.workunit.client.0.smithi050.stdout:9/727: link d1/d6f/fd6 d1/d12/d41/fdd 0 2023-01-04T18:17:11.585 INFO:tasks.workunit.client.0.smithi050.stdout:3/721: creat d0/d8f/deb/ff3 x:0 0 0 2023-01-04T18:17:11.591 INFO:tasks.workunit.client.0.smithi050.stdout:6/702: symlink d0/d9/d38/d60/dc0/ld7 0 2023-01-04T18:17:11.594 INFO:tasks.workunit.client.0.smithi050.stdout:5/859: mknod d13/d15/d66/db8/d27/d46/d4e/d4d/db1/c139 0 2023-01-04T18:17:11.595 INFO:tasks.workunit.client.0.smithi050.stdout:5/860: stat d13/d15/d66/db8/d27/d44/d47/d124/d59/d87 0 2023-01-04T18:17:11.601 INFO:tasks.workunit.client.0.smithi050.stdout:2/688: mkdir d1/dd/d62/d69/de6 0 2023-01-04T18:17:11.601 INFO:tasks.workunit.client.0.smithi050.stdout:2/689: readlink d1/dd/d38/l71 0 2023-01-04T18:17:11.602 INFO:tasks.workunit.client.0.smithi050.stdout:4/723: creat d14/d1b/d66/feb x:0 0 0 2023-01-04T18:17:11.602 INFO:tasks.workunit.client.0.smithi050.stdout:4/724: fsync d14/d1b/d1f/d22/d3e/d44/d59/d5f/fb1 0 2023-01-04T18:17:11.603 INFO:tasks.workunit.client.0.smithi050.stdout:8/766: creat d3/d2a/d74/d92/d94/dc9/f10c x:0 0 0 2023-01-04T18:17:11.605 INFO:tasks.workunit.client.0.smithi050.stdout:9/728: symlink d1/d3/dbf/dd4/da8/dda/lde 0 2023-01-04T18:17:11.607 INFO:tasks.workunit.client.0.smithi050.stdout:3/722: creat d0/ff4 x:0 0 0 2023-01-04T18:17:11.610 INFO:tasks.workunit.client.0.smithi050.stdout:0/614: rename d0/l16 to d0/d9f/d84/lc2 0 2023-01-04T18:17:11.612 INFO:tasks.workunit.client.0.smithi050.stdout:5/861: link d13/d15/d66/db8/d27/d44/d47/d124/d59/d87/f89 d13/d15/d66/db8/d27/d44/d101/f13a 0 2023-01-04T18:17:11.612 INFO:tasks.workunit.client.0.smithi050.stdout:5/862: dread - d13/d15/d66/f11d zero size 2023-01-04T18:17:11.612 INFO:tasks.workunit.client.0.smithi050.stdout:5/863: readlink d13/d15/d66/db8/d27/d44/d47/d124/d59/d87/dbe/l12d 0 2023-01-04T18:17:11.613 INFO:tasks.workunit.client.0.smithi050.stdout:5/864: dread - d13/d28/d7c/d83/ff7 zero size 2023-01-04T18:17:11.613 INFO:tasks.workunit.client.0.smithi050.stdout:6/703: dwrite d0/d9/d25/d40/d89/f94 [0,4194304] 0 2023-01-04T18:17:11.614 INFO:tasks.workunit.client.0.smithi050.stdout:2/690: mknod d1/dd/d11/db5/ce7 0 2023-01-04T18:17:11.618 INFO:tasks.workunit.client.0.smithi050.stdout:4/725: symlink d14/d1b/dd7/lec 0 2023-01-04T18:17:11.624 INFO:tasks.workunit.client.0.smithi050.stdout:8/767: dwrite d3/d2a/d30/d3b/d4d/d23/d55/f57 [0,4194304] 0 2023-01-04T18:17:11.624 INFO:tasks.workunit.client.0.smithi050.stdout:8/768: write d3/d2a/d2d/f76 [502026,846] 0 2023-01-04T18:17:11.624 INFO:tasks.workunit.client.0.smithi050.stdout:8/769: truncate d3/d2a/d27/dc1/fd2 1105345 0 2023-01-04T18:17:11.624 INFO:tasks.workunit.client.0.smithi050.stdout:8/770: dread - d3/d2a/d74/d92/d94/dc9/fe8 zero size 2023-01-04T18:17:11.624 INFO:tasks.workunit.client.0.smithi050.stdout:8/771: write d3/d2a/d2d/f76 [1406030,108722] 0 2023-01-04T18:17:11.625 INFO:tasks.workunit.client.0.smithi050.stdout:9/729: symlink d1/d3/dbf/dd4/da8/ldf 0 2023-01-04T18:17:11.626 INFO:tasks.workunit.client.0.smithi050.stdout:9/730: write d1/d6f/fb7 [3264786,20974] 0 2023-01-04T18:17:11.626 INFO:tasks.workunit.client.0.smithi050.stdout:9/731: chown d1/d3/d11 872402 1 2023-01-04T18:17:11.628 INFO:tasks.workunit.client.0.smithi050.stdout:3/723: mknod d0/d1b/d2f/d56/d98/d9c/dcd/cf5 0 2023-01-04T18:17:11.628 INFO:tasks.workunit.client.0.smithi050.stdout:3/724: write d0/d8f/d46/d80/dca/fea [749438,90178] 0 2023-01-04T18:17:11.628 INFO:tasks.workunit.client.0.smithi050.stdout:3/725: chown d0/d1b/d2f/fb7 0 1 2023-01-04T18:17:11.628 INFO:tasks.workunit.client.0.smithi050.stdout:3/726: write d0/d1b/d2f/d31/f7e [946555,23438] 0 2023-01-04T18:17:11.631 INFO:tasks.workunit.client.0.smithi050.stdout:0/615: rename d0/d6/d8/d51/f86 to d0/d73/d79/fc3 0 2023-01-04T18:17:11.631 INFO:tasks.workunit.client.0.smithi050.stdout:0/616: chown d0/d6/c1d 758335 1 2023-01-04T18:17:11.633 INFO:tasks.workunit.client.0.smithi050.stdout:5/865: creat d13/d15/d66/db8/d27/d44/d47/d124/d42/f13b x:0 0 0 2023-01-04T18:17:11.636 INFO:tasks.workunit.client.0.smithi050.stdout:6/704: mkdir d0/d9/df/d74/dd8 0 2023-01-04T18:17:11.637 INFO:tasks.workunit.client.0.smithi050.stdout:6/705: write d0/d9/d25/d40/d89/f94 [2646451,110449] 0 2023-01-04T18:17:11.730 INFO:tasks.workunit.client.0.smithi050.stdout:2/691: creat d1/dd/d28/d79/fe8 x:0 0 0 2023-01-04T18:17:11.731 INFO:tasks.workunit.client.0.smithi050.stdout:2/692: write d1/dd/d28/d2c/fc0 [592629,121931] 0 2023-01-04T18:17:11.732 INFO:tasks.workunit.client.0.smithi050.stdout:2/693: write d1/dd/d28/d2c/d66/da2/fdf [1690338,46637] 0 2023-01-04T18:17:11.733 INFO:tasks.workunit.client.0.smithi050.stdout:2/694: write d1/dd/d62/d69/f84 [3692773,49700] 0 2023-01-04T18:17:11.735 INFO:tasks.workunit.client.0.smithi050.stdout:2/695: dread d1/dd/d11/d14/d91/f90 [0,4194304] 0 2023-01-04T18:17:11.735 INFO:tasks.workunit.client.0.smithi050.stdout:4/726: link d14/d1b/d32/l82 d14/d1b/d1f/d22/led 0 2023-01-04T18:17:11.735 INFO:tasks.workunit.client.0.smithi050.stdout:4/727: write d14/f18 [2466193,59276] 0 2023-01-04T18:17:11.738 INFO:tasks.workunit.client.0.smithi050.stdout:8/772: mkdir d3/d2a/d30/d3b/d4d/d23/d31/d10d 0 2023-01-04T18:17:11.744 INFO:tasks.workunit.client.0.smithi050.stdout:9/732: creat d1/d12/d41/d60/d95/fe0 x:0 0 0 2023-01-04T18:17:11.744 INFO:tasks.workunit.client.0.smithi050.stdout:9/733: read - d1/d12/d41/d60/d95/fe0 zero size 2023-01-04T18:17:11.746 INFO:tasks.workunit.client.0.smithi050.stdout:3/727: link d0/c8 d0/d1b/d2f/d56/d98/dc7/ded/cf6 0 2023-01-04T18:17:11.748 INFO:tasks.workunit.client.0.smithi050.stdout:5/866: mknod d13/d15/d66/db8/d27/c13c 0 2023-01-04T18:17:11.753 INFO:tasks.workunit.client.0.smithi050.stdout:6/706: rename d0/d9/d38/d60 to d0/d9/d25/d40/d89/dd9 0 2023-01-04T18:17:11.753 INFO:tasks.workunit.client.0.smithi050.stdout:6/707: fsync d0/d5c/db7/f87 0 2023-01-04T18:17:11.753 INFO:tasks.workunit.client.0.smithi050.stdout:6/708: truncate d0/d5c/db7/fa6 4324254 0 2023-01-04T18:17:11.756 INFO:tasks.workunit.client.0.smithi050.stdout:2/696: creat d1/dd/d62/da1/d4b/fe9 x:0 0 0 2023-01-04T18:17:11.759 INFO:tasks.workunit.client.0.smithi050.stdout:4/728: symlink d14/d1b/d1f/d22/d3e/d44/d59/dca/lee 0 2023-01-04T18:17:11.759 INFO:tasks.workunit.client.0.smithi050.stdout:4/729: chown f4 852558381 1 2023-01-04T18:17:11.759 INFO:tasks.workunit.client.0.smithi050.stdout:4/730: readlink d14/la7 0 2023-01-04T18:17:11.760 INFO:tasks.workunit.client.0.smithi050.stdout:4/731: write f13 [8961037,1310] 0 2023-01-04T18:17:11.760 INFO:tasks.workunit.client.0.smithi050.stdout:8/773: creat d3/d2a/d74/d92/d94/d9c/f10e x:0 0 0 2023-01-04T18:17:11.760 INFO:tasks.workunit.client.0.smithi050.stdout:8/774: dread - d3/d2a/d30/d3b/d4d/d23/d55/d5f/fbf zero size 2023-01-04T18:17:11.761 INFO:tasks.workunit.client.0.smithi050.stdout:3/728: dwrite d0/dd/d45/f95 [0,4194304] 0 2023-01-04T18:17:11.761 INFO:tasks.workunit.client.0.smithi050.stdout:3/729: readlink d0/d8f/deb/le9 0 2023-01-04T18:17:11.761 INFO:tasks.workunit.client.0.smithi050.stdout:8/775: write d3/d2a/d60/f71 [2846658,27616] 0 2023-01-04T18:17:11.761 INFO:tasks.workunit.client.0.smithi050.stdout:8/776: getdents d3/d2a/d2d/d86/dd1 0 2023-01-04T18:17:11.763 INFO:tasks.workunit.client.0.smithi050.stdout:9/734: mkdir d1/d12/d3f/de1 0 2023-01-04T18:17:11.768 INFO:tasks.workunit.client.0.smithi050.stdout:1/716: sync 2023-01-04T18:17:11.769 INFO:tasks.workunit.client.0.smithi050.stdout:5/867: symlink d13/d15/d66/db8/d27/d44/d47/d124/d42/dec/d12b/l13d 0 2023-01-04T18:17:11.771 INFO:tasks.workunit.client.0.smithi050.stdout:6/709: rename d0/d9/df/d74/fb9 to d0/d9/d25/fda 0 2023-01-04T18:17:11.772 INFO:tasks.workunit.client.0.smithi050.stdout:6/710: write d0/d4a/d93/fc4 [649178,27558] 0 2023-01-04T18:17:11.772 INFO:tasks.workunit.client.0.smithi050.stdout:6/711: truncate d0/d9/d25/fda 666418 0 2023-01-04T18:17:11.772 INFO:tasks.workunit.client.0.smithi050.stdout:2/697: mknod d1/dd/d11/d12/cea 0 2023-01-04T18:17:11.773 INFO:tasks.workunit.client.0.smithi050.stdout:2/698: chown d1/dd/d11/d14/d91/d5a 2113340338 1 2023-01-04T18:17:11.776 INFO:tasks.workunit.client.0.smithi050.stdout:3/730: mkdir d0/d8f/d46/df7 0 2023-01-04T18:17:11.777 INFO:tasks.workunit.client.0.smithi050.stdout:3/731: write d0/d1a/f24 [391881,87933] 0 2023-01-04T18:17:11.780 INFO:tasks.workunit.client.0.smithi050.stdout:8/777: mkdir d3/d2a/d2d/d86/dd1/d10f 0 2023-01-04T18:17:11.780 INFO:tasks.workunit.client.0.smithi050.stdout:8/778: truncate d3/d2a/d73/f109 882265 0 2023-01-04T18:17:11.780 INFO:tasks.workunit.client.0.smithi050.stdout:8/779: write d3/d2a/d30/d3b/d4d/d23/d55/d5f/d82/dcb/fe6 [5136856,82550] 0 2023-01-04T18:17:11.781 INFO:tasks.workunit.client.0.smithi050.stdout:8/780: write d3/d2a/d30/d3b/d53/fcd [225427,107957] 0 2023-01-04T18:17:11.784 INFO:tasks.workunit.client.0.smithi050.stdout:9/735: mkdir d1/d3/d3b/d63/dc3/de2 0 2023-01-04T18:17:11.785 INFO:tasks.workunit.client.0.smithi050.stdout:9/736: fsync d1/d3/d13/f15 0 2023-01-04T18:17:11.786 INFO:tasks.workunit.client.0.smithi050.stdout:4/732: rename c8 to d14/d1b/d1f/d22/d3e/d44/d59/d5d/cef 0 2023-01-04T18:17:11.787 INFO:tasks.workunit.client.0.smithi050.stdout:6/712: link d0/d9/df/dba/dca/d77/c86 d0/d9/d25/d40/d89/dd9/cdb 0 2023-01-04T18:17:11.788 INFO:tasks.workunit.client.0.smithi050.stdout:3/732: truncate d0/d1a/fc0 366240 0 2023-01-04T18:17:11.791 INFO:tasks.workunit.client.0.smithi050.stdout:8/781: mknod d3/d2a/d30/d3b/d4d/d23/d31/c110 0 2023-01-04T18:17:11.793 INFO:tasks.workunit.client.0.smithi050.stdout:2/699: dwrite d1/dd/d11/d14/d91/f8c [0,4194304] 0 2023-01-04T18:17:11.793 INFO:tasks.workunit.client.0.smithi050.stdout:5/868: dwrite d13/d15/d66/db8/d27/d46/d4e/f3c [0,4194304] 0 2023-01-04T18:17:11.793 INFO:tasks.workunit.client.0.smithi050.stdout:5/869: chown d13/d15/d66/db8/c5b 188 1 2023-01-04T18:17:11.797 INFO:tasks.workunit.client.0.smithi050.stdout:5/870: write d13/fa5 [3423106,54063] 0 2023-01-04T18:17:11.798 INFO:tasks.workunit.client.0.smithi050.stdout:1/717: rename d8/d48/d5c/d67/d3b/d84/f8d to d8/d48/d5c/d67/d91/fdb 0 2023-01-04T18:17:11.799 INFO:tasks.workunit.client.0.smithi050.stdout:4/733: truncate d14/f1a 221006 0 2023-01-04T18:17:11.799 INFO:tasks.workunit.client.0.smithi050.stdout:4/734: write d14/d1b/d1f/d22/d3e/d44/d59/d5d/d7f/de1/fe3 [15056,123829] 0 2023-01-04T18:17:11.799 INFO:tasks.workunit.client.0.smithi050.stdout:4/735: stat d14/d1b/cb3 0 2023-01-04T18:17:11.799 INFO:tasks.workunit.client.0.smithi050.stdout:4/736: chown d14/d1b/d1f/c43 663 1 2023-01-04T18:17:11.799 INFO:tasks.workunit.client.0.smithi050.stdout:4/737: chown d14/d1b/d1f/d63/da5/db6/cba 1031 1 2023-01-04T18:17:11.800 INFO:tasks.workunit.client.0.smithi050.stdout:8/782: getdents d3/d2a/d27/d93 0 2023-01-04T18:17:11.801 INFO:tasks.workunit.client.0.smithi050.stdout:8/783: fsync d3/d2a/d2d/fdc 0 2023-01-04T18:17:11.801 INFO:tasks.workunit.client.0.smithi050.stdout:8/784: readlink d3/d2a/d73/ld5 0 2023-01-04T18:17:11.802 INFO:tasks.workunit.client.0.smithi050.stdout:3/733: dwrite d0/d8f/f5c [0,4194304] 0 2023-01-04T18:17:11.810 INFO:tasks.workunit.client.0.smithi050.stdout:2/700: link d1/dd/d28/d2c/d2e/d3f/fd7 d1/d41/feb 0 2023-01-04T18:17:11.816 INFO:tasks.workunit.client.0.smithi050.stdout:5/871: dwrite d13/d15/d66/db8/d27/d78/f9a [0,4194304] 0 2023-01-04T18:17:11.817 INFO:tasks.workunit.client.0.smithi050.stdout:1/718: dwrite d8/d48/d8c/f7a [0,4194304] 0 2023-01-04T18:17:11.818 INFO:tasks.workunit.client.0.smithi050.stdout:1/719: dread - d8/d14/d1c/f85 zero size 2023-01-04T18:17:11.823 INFO:tasks.workunit.client.0.smithi050.stdout:6/713: rename d0/d9/d25/d40/d89/dd9/f80 to d0/d9/df/dba/dca/d6b/da4/fdc 0 2023-01-04T18:17:11.826 INFO:tasks.workunit.client.0.smithi050.stdout:4/738: mknod d14/d1b/d1f/d22/d3e/d44/d59/cf0 0 2023-01-04T18:17:11.828 INFO:tasks.workunit.client.0.smithi050.stdout:8/785: creat d3/d2a/d74/d92/dcc/f111 x:0 0 0 2023-01-04T18:17:11.828 INFO:tasks.workunit.client.0.smithi050.stdout:8/786: truncate d3/d2a/dff/f105 921910 0 2023-01-04T18:17:11.831 INFO:tasks.workunit.client.0.smithi050.stdout:5/872: dread d13/d15/d66/db8/d27/d78/f9a [0,4194304] 0 2023-01-04T18:17:11.832 INFO:tasks.workunit.client.0.smithi050.stdout:5/873: write d13/d28/d7c/f8d [748113,126421] 0 2023-01-04T18:17:11.832 INFO:tasks.workunit.client.0.smithi050.stdout:5/874: chown d13/d15/d63/dc0 27592750 1 2023-01-04T18:17:11.833 INFO:tasks.workunit.client.0.smithi050.stdout:5/875: truncate d13/d15/d66/db8/d27/d44/d47/d124/d59/fdd 657237 0 2023-01-04T18:17:11.833 INFO:tasks.workunit.client.0.smithi050.stdout:3/734: mknod d0/d1b/d2f/d56/cf8 0 2023-01-04T18:17:11.834 INFO:tasks.workunit.client.0.smithi050.stdout:6/714: dread d0/d9/d38/d1c/d54/f58 [0,4194304] 0 2023-01-04T18:17:11.834 INFO:tasks.workunit.client.0.smithi050.stdout:2/701: creat d1/dd/d28/d2c/d66/fec x:0 0 0 2023-01-04T18:17:11.840 INFO:tasks.workunit.client.0.smithi050.stdout:9/737: dwrite d1/d3/d24/f55 [0,4194304] 0 2023-01-04T18:17:11.840 INFO:tasks.workunit.client.0.smithi050.stdout:9/738: write d1/d6f/fb7 [4654166,97266] 0 2023-01-04T18:17:11.846 INFO:tasks.workunit.client.0.smithi050.stdout:2/702: dread d1/dd/f74 [0,4194304] 0 2023-01-04T18:17:11.854 INFO:tasks.workunit.client.0.smithi050.stdout:2/703: dread d1/dd/d38/fb9 [4194304,4194304] 0 2023-01-04T18:17:11.862 INFO:tasks.workunit.client.0.smithi050.stdout:1/720: mknod d8/d14/d1c/d28/d57/d6a/cdc 0 2023-01-04T18:17:11.863 INFO:tasks.workunit.client.0.smithi050.stdout:4/739: mknod d14/d1b/d1f/d22/d3e/d44/d59/d5d/d7f/cf1 0 2023-01-04T18:17:11.868 INFO:tasks.workunit.client.0.smithi050.stdout:8/787: mknod d3/d2a/d2d/dc3/c112 0 2023-01-04T18:17:11.868 INFO:tasks.workunit.client.0.smithi050.stdout:8/788: chown d3/d2a/d30/d3b/d4d/d23 242644124 1 2023-01-04T18:17:11.868 INFO:tasks.workunit.client.0.smithi050.stdout:8/789: chown d3/d2a/d74/d92/d94/d9c/f10e 40065307 1 2023-01-04T18:17:11.872 INFO:tasks.workunit.client.0.smithi050.stdout:5/876: link d13/d15/d66/c6b d13/d15/d66/db8/d27/d44/d47/d124/d42/c13e 0 2023-01-04T18:17:11.873 INFO:tasks.workunit.client.0.smithi050.stdout:3/735: truncate d0/d10/f3e 401368 0 2023-01-04T18:17:11.874 INFO:tasks.workunit.client.0.smithi050.stdout:6/715: rmdir d0/d9/d25/d40/d89 39 2023-01-04T18:17:11.878 INFO:tasks.workunit.client.0.smithi050.stdout:9/739: mknod d1/d12/d41/d60/d8e/ce3 0 2023-01-04T18:17:11.878 INFO:tasks.workunit.client.0.smithi050.stdout:9/740: chown d1/d12/d9f/fd8 338 1 2023-01-04T18:17:11.878 INFO:tasks.workunit.client.0.smithi050.stdout:9/741: readlink d1/d3/d3b/d63/dc3/ld7 0 2023-01-04T18:17:11.880 INFO:tasks.workunit.client.0.smithi050.stdout:7/825: sync 2023-01-04T18:17:11.885 INFO:tasks.workunit.client.0.smithi050.stdout:2/704: rename d1/dd/d11/db5/lc1 to d1/dd/d11/db5/led 0 2023-01-04T18:17:11.887 INFO:tasks.workunit.client.0.smithi050.stdout:1/721: creat d8/d14/d1c/d28/fdd x:0 0 0 2023-01-04T18:17:11.887 INFO:tasks.workunit.client.0.smithi050.stdout:1/722: chown d8/f44 7227 1 2023-01-04T18:17:11.887 INFO:tasks.workunit.client.0.smithi050.stdout:1/723: chown d8/d48/d5c/la6 3 1 2023-01-04T18:17:11.898 INFO:tasks.workunit.client.0.smithi050.stdout:8/790: dwrite d3/d2a/d2d/f70 [8388608,4194304] 0 2023-01-04T18:17:11.899 INFO:tasks.workunit.client.0.smithi050.stdout:6/716: dwrite d0/d9/df/dba/fd5 [0,4194304] 0 2023-01-04T18:17:11.899 INFO:tasks.workunit.client.0.smithi050.stdout:6/717: stat d0/d5c/db7/c79 0 2023-01-04T18:17:11.900 INFO:tasks.workunit.client.0.smithi050.stdout:6/718: fsync d0/f65 0 2023-01-04T18:17:11.903 INFO:tasks.workunit.client.0.smithi050.stdout:8/791: write d3/f25 [2413609,61262] 0 2023-01-04T18:17:11.903 INFO:tasks.workunit.client.0.smithi050.stdout:8/792: write d3/d2a/d27/d8b/fab [2238326,63317] 0 2023-01-04T18:17:11.904 INFO:tasks.workunit.client.0.smithi050.stdout:8/793: fdatasync d3/d2a/d30/d3b/d53/fdd 0 2023-01-04T18:17:11.998 INFO:tasks.workunit.client.0.smithi050.stdout:5/877: creat d13/d15/d66/db8/d27/d44/d47/d124/d42/d10d/f13f x:0 0 0 2023-01-04T18:17:11.998 INFO:tasks.workunit.client.0.smithi050.stdout:8/794: dwrite d3/d2a/d27/d93/d7f/d96/d46/fbd [4194304,4194304] 0 2023-01-04T18:17:11.998 INFO:tasks.workunit.client.0.smithi050.stdout:5/878: fdatasync d13/d15/d66/db8/d27/fce 0 2023-01-04T18:17:12.003 INFO:tasks.workunit.client.0.smithi050.stdout:3/736: creat d0/d1b/d2f/d56/d32/ff9 x:0 0 0 2023-01-04T18:17:12.004 INFO:tasks.workunit.client.0.smithi050.stdout:3/737: fsync d0/dd/de6/ff0 0 2023-01-04T18:17:12.005 INFO:tasks.workunit.client.0.smithi050.stdout:3/738: write d0/d1b/d2f/d31/f41 [1246364,112398] 0 2023-01-04T18:17:12.008 INFO:tasks.workunit.client.0.smithi050.stdout:7/826: creat d6/db/d15/d1b/d5b/f114 x:0 0 0 2023-01-04T18:17:12.008 INFO:tasks.workunit.client.0.smithi050.stdout:7/827: chown d6/d90/de3/d6a/cc3 1136504094 1 2023-01-04T18:17:12.008 INFO:tasks.workunit.client.0.smithi050.stdout:7/828: chown d6/d28/dde/de6/l112 655137 1 2023-01-04T18:17:12.011 INFO:tasks.workunit.client.0.smithi050.stdout:5/879: dwrite d13/fe4 [0,4194304] 0 2023-01-04T18:17:12.011 INFO:tasks.workunit.client.0.smithi050.stdout:5/880: readlink l9 0 2023-01-04T18:17:12.011 INFO:tasks.workunit.client.0.smithi050.stdout:2/705: link d1/dd/d28/d79/fe8 d1/dd/d38/fee 0 2023-01-04T18:17:12.014 INFO:tasks.workunit.client.0.smithi050.stdout:1/724: mkdir d8/d48/d5c/d67/d3b/db9/dde 0 2023-01-04T18:17:12.015 INFO:tasks.workunit.client.0.smithi050.stdout:4/740: truncate d14/f24 5898601 0 2023-01-04T18:17:12.017 INFO:tasks.workunit.client.0.smithi050.stdout:6/719: symlink d0/d9/df/dba/dca/ldd 0 2023-01-04T18:17:12.024 INFO:tasks.workunit.client.0.smithi050.stdout:8/795: creat d3/d2a/d30/d3b/d53/f113 x:0 0 0 2023-01-04T18:17:12.029 INFO:tasks.workunit.client.0.smithi050.stdout:3/739: symlink d0/dd/d45/lfa 0 2023-01-04T18:17:12.031 INFO:tasks.workunit.client.0.smithi050.stdout:7/829: dwrite d6/db/d20/d55/fba [4194304,4194304] 0 2023-01-04T18:17:12.031 INFO:tasks.workunit.client.0.smithi050.stdout:7/830: chown d6/d90/de3/d6a/cc3 375339 1 2023-01-04T18:17:12.034 INFO:tasks.workunit.client.0.smithi050.stdout:6/720: dwrite d0/d9/df/dba/dca/f37 [0,4194304] 0 2023-01-04T18:17:12.037 INFO:tasks.workunit.client.0.smithi050.stdout:1/725: dwrite d8/d48/d5c/d67/d91/fdb [0,4194304] 0 2023-01-04T18:17:12.037 INFO:tasks.workunit.client.0.smithi050.stdout:1/726: truncate d8/dce/fa4 467890 0 2023-01-04T18:17:12.037 INFO:tasks.workunit.client.0.smithi050.stdout:6/721: write d0/d9/f29 [2541315,32646] 0 2023-01-04T18:17:12.046 INFO:tasks.workunit.client.0.smithi050.stdout:2/706: symlink d1/dd/d28/d79/de4/lef 0 2023-01-04T18:17:12.051 INFO:tasks.workunit.client.0.smithi050.stdout:8/796: truncate d3/f20 2917895 0 2023-01-04T18:17:12.051 INFO:tasks.workunit.client.0.smithi050.stdout:8/797: write d3/d2a/d27/d93/fb0 [509215,128405] 0 2023-01-04T18:17:12.053 INFO:tasks.workunit.client.0.smithi050.stdout:3/740: creat d0/d8f/d46/d80/dca/dee/ffb x:0 0 0 2023-01-04T18:17:12.057 INFO:tasks.workunit.client.0.smithi050.stdout:7/831: mknod d6/d1d/d1f/c115 0 2023-01-04T18:17:12.058 INFO:tasks.workunit.client.0.smithi050.stdout:7/832: write d6/d28/d99/dd7/d42/f56 [977117,96078] 0 2023-01-04T18:17:12.058 INFO:tasks.workunit.client.0.smithi050.stdout:7/833: chown d6/db/d20/d55/d82/ff3 1817 1 2023-01-04T18:17:12.059 INFO:tasks.workunit.client.0.smithi050.stdout:7/834: readlink d6/db/d15/d48/dc7/l65 0 2023-01-04T18:17:12.059 INFO:tasks.workunit.client.0.smithi050.stdout:7/835: stat d6/d1d/d1f/fdb 0 2023-01-04T18:17:12.061 INFO:tasks.workunit.client.0.smithi050.stdout:1/727: mknod d8/d14/d1c/d28/dc7/dd6/cdf 0 2023-01-04T18:17:12.061 INFO:tasks.workunit.client.0.smithi050.stdout:1/728: stat d8/d48/d5c/d67/d91/fdb 0 2023-01-04T18:17:12.062 INFO:tasks.workunit.client.0.smithi050.stdout:6/722: mknod d0/d9/d25/d40/cde 0 2023-01-04T18:17:12.063 INFO:tasks.workunit.client.0.smithi050.stdout:2/707: dwrite d1/dd/d62/d69/f82 [0,4194304] 0 2023-01-04T18:17:12.063 INFO:tasks.workunit.client.0.smithi050.stdout:2/708: chown d1/dd/d28/d2c/d2e/c96 3600 1 2023-01-04T18:17:12.064 INFO:tasks.workunit.client.0.smithi050.stdout:5/881: rename d13/d15/d66/db8/d27/d44/d47/d124/d42/f9f to d13/d15/d66/db8/d27/d46/d4e/d4d/f140 0 2023-01-04T18:17:12.066 INFO:tasks.workunit.client.0.smithi050.stdout:0/617: sync 2023-01-04T18:17:12.072 INFO:tasks.workunit.client.0.smithi050.stdout:5/882: dread d13/f3b [0,4194304] 0 2023-01-04T18:17:12.073 INFO:tasks.workunit.client.0.smithi050.stdout:8/798: getdents d3/d2a/d27/deb 0 2023-01-04T18:17:12.077 INFO:tasks.workunit.client.0.smithi050.stdout:3/741: mknod d0/d8f/d46/df7/cfc 0 2023-01-04T18:17:12.077 INFO:tasks.workunit.client.0.smithi050.stdout:3/742: fsync d0/d8f/f5c 0 2023-01-04T18:17:12.080 INFO:tasks.workunit.client.0.smithi050.stdout:7/836: unlink d6/d1d/d1f/c115 0 2023-01-04T18:17:12.081 INFO:tasks.workunit.client.0.smithi050.stdout:1/729: creat d8/d48/d5c/d67/d3b/db9/dde/fe0 x:0 0 0 2023-01-04T18:17:12.081 INFO:tasks.workunit.client.0.smithi050.stdout:1/730: chown d8/d14/d1c/d28/d57/d6a/daf 171075 1 2023-01-04T18:17:12.083 INFO:tasks.workunit.client.0.smithi050.stdout:2/709: dwrite d1/dd/d11/d14/f33 [0,4194304] 0 2023-01-04T18:17:12.083 INFO:tasks.workunit.client.0.smithi050.stdout:2/710: write d1/dd/d11/d14/d91/f90 [470025,99935] 0 2023-01-04T18:17:12.088 INFO:tasks.workunit.client.0.smithi050.stdout:6/723: dread d0/f14 [0,4194304] 0 2023-01-04T18:17:12.091 INFO:tasks.workunit.client.0.smithi050.stdout:4/741: rename d14/d1b/d1f/d63/da5/db6/cba to d14/d1b/d1f/d22/d87/cf2 0 2023-01-04T18:17:12.092 INFO:tasks.workunit.client.0.smithi050.stdout:0/618: getdents d0/d73 0 2023-01-04T18:17:12.092 INFO:tasks.workunit.client.0.smithi050.stdout:0/619: dread - d0/d6/d8/d51/f7c zero size 2023-01-04T18:17:12.097 INFO:tasks.workunit.client.0.smithi050.stdout:5/883: link d13/d15/d66/db8/d27/d46/d4e/d4d/l92 d13/d15/d66/db8/d27/d44/d47/d124/d42/d4a/l141 0 2023-01-04T18:17:12.101 INFO:tasks.workunit.client.0.smithi050.stdout:8/799: creat d3/d2a/d60/d84/f114 x:0 0 0 2023-01-04T18:17:12.102 INFO:tasks.workunit.client.0.smithi050.stdout:8/800: truncate d3/d2a/d60/d2c/fe3 1857477 0 2023-01-04T18:17:12.103 INFO:tasks.workunit.client.0.smithi050.stdout:3/743: symlink d0/d1b/d2f/d71/lfd 0 2023-01-04T18:17:12.108 INFO:tasks.workunit.client.0.smithi050.stdout:2/711: creat d1/dd/d28/ff0 x:0 0 0 2023-01-04T18:17:12.110 INFO:tasks.workunit.client.0.smithi050.stdout:6/724: symlink d0/d9/d25/d40/d89/dd9/d7a/ldf 0 2023-01-04T18:17:12.112 INFO:tasks.workunit.client.0.smithi050.stdout:6/725: write d0/d9/df/dba/dca/d6b/fc3 [714046,41723] 0 2023-01-04T18:17:12.113 INFO:tasks.workunit.client.0.smithi050.stdout:7/837: rename d6/db/d20/d4f/d8a to d6/d90/de3/d116 0 2023-01-04T18:17:12.114 INFO:tasks.workunit.client.0.smithi050.stdout:6/726: write d0/d9/df/dba/dca/fac [640303,107428] 0 2023-01-04T18:17:12.114 INFO:tasks.workunit.client.0.smithi050.stdout:6/727: fdatasync d0/d9/d38/f5b 0 2023-01-04T18:17:12.114 INFO:tasks.workunit.client.0.smithi050.stdout:6/728: stat d0/d9/d25/d40/d89/l9d 0 2023-01-04T18:17:12.115 INFO:tasks.workunit.client.0.smithi050.stdout:4/742: getdents d14/d1b/d1f/d63 0 2023-01-04T18:17:12.118 INFO:tasks.workunit.client.0.smithi050.stdout:0/620: unlink d0/d6/d28/d1a/c4a 0 2023-01-04T18:17:12.119 INFO:tasks.workunit.client.0.smithi050.stdout:2/712: dread d1/dd/d62/d69/f84 [0,4194304] 0 2023-01-04T18:17:12.120 INFO:tasks.workunit.client.0.smithi050.stdout:8/801: creat d3/d2a/d30/f115 x:0 0 0 2023-01-04T18:17:12.121 INFO:tasks.workunit.client.0.smithi050.stdout:1/731: dread d8/dce/fa4 [0,4194304] 0 2023-01-04T18:17:12.122 INFO:tasks.workunit.client.0.smithi050.stdout:5/884: dwrite d13/d15/d66/db8/d27/d46/f94 [0,4194304] 0 2023-01-04T18:17:12.122 INFO:tasks.workunit.client.0.smithi050.stdout:7/838: creat d6/d90/de3/f117 x:0 0 0 2023-01-04T18:17:12.122 INFO:tasks.workunit.client.0.smithi050.stdout:7/839: fsync d6/db/d15/d1b/d5b/f114 0 2023-01-04T18:17:12.124 INFO:tasks.workunit.client.0.smithi050.stdout:3/744: dwrite d0/d8f/deb/fe3 [0,4194304] 0 2023-01-04T18:17:12.124 INFO:tasks.workunit.client.0.smithi050.stdout:3/745: fdatasync d0/d1a/fc0 0 2023-01-04T18:17:12.124 INFO:tasks.workunit.client.0.smithi050.stdout:3/746: stat d0/d8f/d46/d80/dca/fea 0 2023-01-04T18:17:12.125 INFO:tasks.workunit.client.0.smithi050.stdout:3/747: chown d0/d8f/d46/df7/cfc 4947366 1 2023-01-04T18:17:12.125 INFO:tasks.workunit.client.0.smithi050.stdout:3/748: fsync d0/d1b/d2f/d31/f62 0 2023-01-04T18:17:12.125 INFO:tasks.workunit.client.0.smithi050.stdout:6/729: creat d0/d4a/fe0 x:0 0 0 2023-01-04T18:17:12.126 INFO:tasks.workunit.client.0.smithi050.stdout:2/713: dread d1/dd/d11/d14/d91/f9d [0,4194304] 0 2023-01-04T18:17:12.127 INFO:tasks.workunit.client.0.smithi050.stdout:2/714: chown d1/dd/d62/da1/d6e/f80 1483169 1 2023-01-04T18:17:12.127 INFO:tasks.workunit.client.0.smithi050.stdout:7/840: dread d6/d1d/d1f/d80/f93 [0,4194304] 0 2023-01-04T18:17:12.128 INFO:tasks.workunit.client.0.smithi050.stdout:7/841: chown d6/d1d/l77 2877 1 2023-01-04T18:17:12.128 INFO:tasks.workunit.client.0.smithi050.stdout:7/842: write d6/d28/d99/f76 [1082022,89526] 0 2023-01-04T18:17:12.128 INFO:tasks.workunit.client.0.smithi050.stdout:7/843: fdatasync d6/db/d3b/f9e 0 2023-01-04T18:17:12.128 INFO:tasks.workunit.client.0.smithi050.stdout:6/730: dread d0/d9/df/dba/dca/d6b/da4/fdc [0,4194304] 0 2023-01-04T18:17:12.128 INFO:tasks.workunit.client.0.smithi050.stdout:6/731: fdatasync d0/d5c/db7/f87 0 2023-01-04T18:17:12.129 INFO:tasks.workunit.client.0.smithi050.stdout:4/743: creat d14/d1b/d1f/d22/d3e/d44/d59/d5f/d80/ff3 x:0 0 0 2023-01-04T18:17:12.131 INFO:tasks.workunit.client.0.smithi050.stdout:0/621: rmdir d0/d6/d28/d1a/daf 0 2023-01-04T18:17:12.135 INFO:tasks.workunit.client.0.smithi050.stdout:8/802: symlink d3/d2a/d30/d3b/d4d/d23/dfb/l116 0 2023-01-04T18:17:12.136 INFO:tasks.workunit.client.0.smithi050.stdout:1/732: creat d8/d48/d5c/d67/d3a/dd1/fe1 x:0 0 0 2023-01-04T18:17:12.137 INFO:tasks.workunit.client.0.smithi050.stdout:1/733: dread d8/d14/d1c/d28/f9d [0,4194304] 0 2023-01-04T18:17:12.140 INFO:tasks.workunit.client.0.smithi050.stdout:5/885: link d13/d15/d63/f136 d13/d15/d66/db8/d27/d46/d4e/d4d/d115/f142 0 2023-01-04T18:17:12.140 INFO:tasks.workunit.client.0.smithi050.stdout:5/886: fdatasync d13/d15/d66/db8/d1f/f97 0 2023-01-04T18:17:12.154 INFO:tasks.workunit.client.0.smithi050.stdout:3/749: link d0/d8f/d46/df7/cfc d0/d1b/d2f/d31/cfe 0 2023-01-04T18:17:12.155 INFO:tasks.workunit.client.0.smithi050.stdout:3/750: write d0/d8f/deb/d7f/fdf [1041353,122970] 0 2023-01-04T18:17:12.159 INFO:tasks.workunit.client.0.smithi050.stdout:2/715: creat d1/d41/ff1 x:0 0 0 2023-01-04T18:17:12.161 INFO:tasks.workunit.client.0.smithi050.stdout:7/844: symlink d6/db/d3a/dbd/l118 0 2023-01-04T18:17:12.162 INFO:tasks.workunit.client.0.smithi050.stdout:7/845: write d6/db/f43 [2004727,60279] 0 2023-01-04T18:17:12.162 INFO:tasks.workunit.client.0.smithi050.stdout:7/846: fdatasync d6/db/d20/d55/fba 0 2023-01-04T18:17:12.163 INFO:tasks.workunit.client.0.smithi050.stdout:6/732: symlink d0/d4a/le1 0 2023-01-04T18:17:12.166 INFO:tasks.workunit.client.0.smithi050.stdout:4/744: unlink d14/d1b/d1f/d22/d3e/d44/d59/d5f/c9a 0 2023-01-04T18:17:12.167 INFO:tasks.workunit.client.0.smithi050.stdout:0/622: creat d0/d73/d79/fc4 x:0 0 0 2023-01-04T18:17:12.168 INFO:tasks.workunit.client.0.smithi050.stdout:3/751: dread d0/d1a/f58 [0,4194304] 0 2023-01-04T18:17:12.170 INFO:tasks.workunit.client.0.smithi050.stdout:8/803: unlink d3/d2a/d2d/d86/cf7 0 2023-01-04T18:17:12.186 INFO:tasks.workunit.client.0.smithi050.stdout:1/734: rename d8/d14/d1c/d28/dc7/dd6/ca2 to d8/d48/d5c/d67/d3a/dd1/ce2 0 2023-01-04T18:17:12.187 INFO:tasks.workunit.client.0.smithi050.stdout:6/733: dwrite d0/d4a/d93/fc4 [0,4194304] 0 2023-01-04T18:17:12.191 INFO:tasks.workunit.client.0.smithi050.stdout:5/887: creat d13/d15/d63/dc0/f143 x:0 0 0 2023-01-04T18:17:12.194 INFO:tasks.workunit.client.0.smithi050.stdout:5/888: write d13/d15/d66/db8/d27/d44/d47/d124/d59/fb6 [1303258,64564] 0 2023-01-04T18:17:12.195 INFO:tasks.workunit.client.0.smithi050.stdout:2/716: creat d1/dd/d28/d2c/d2e/d36/dd0/ff2 x:0 0 0 2023-01-04T18:17:12.200 INFO:tasks.workunit.client.0.smithi050.stdout:6/734: dwrite d0/fb5 [0,4194304] 0 2023-01-04T18:17:12.200 INFO:tasks.workunit.client.0.smithi050.stdout:6/735: write d0/d9/df/dba/dca/d6b/da4/fbb [609954,81957] 0 2023-01-04T18:17:12.200 INFO:tasks.workunit.client.0.smithi050.stdout:6/736: truncate d0/d9/d38/d1c/d54/f58 4882589 0 2023-01-04T18:17:12.200 INFO:tasks.workunit.client.0.smithi050.stdout:6/737: write d0/d9/f3b [2846275,116629] 0 2023-01-04T18:17:12.201 INFO:tasks.workunit.client.0.smithi050.stdout:6/738: write d0/d9/d38/d1c/d54/f58 [4835443,8928] 0 2023-01-04T18:17:12.201 INFO:tasks.workunit.client.0.smithi050.stdout:6/739: chown d0/l32 494616 1 2023-01-04T18:17:12.204 INFO:tasks.workunit.client.0.smithi050.stdout:7/847: mknod d6/d28/d99/dd7/c119 0 2023-01-04T18:17:12.204 INFO:tasks.workunit.client.0.smithi050.stdout:7/848: dread - d6/d28/ff6 zero size 2023-01-04T18:17:12.207 INFO:tasks.workunit.client.0.smithi050.stdout:4/745: creat d14/d1b/d1f/d22/d3e/d44/d59/dca/ff4 x:0 0 0 2023-01-04T18:17:12.209 INFO:tasks.workunit.client.0.smithi050.stdout:7/849: dread d6/db/d15/d1b/d5b/dda/fe1 [0,4194304] 0 2023-01-04T18:17:12.210 INFO:tasks.workunit.client.0.smithi050.stdout:0/623: mknod d0/d6/d8/d25/cc5 0 2023-01-04T18:17:12.210 INFO:tasks.workunit.client.0.smithi050.stdout:0/624: dread - d0/d9f/fb4 zero size 2023-01-04T18:17:12.210 INFO:tasks.workunit.client.0.smithi050.stdout:9/742: sync 2023-01-04T18:17:12.211 INFO:tasks.workunit.client.0.smithi050.stdout:3/752: mknod d0/d8f/d46/d80/cff 0 2023-01-04T18:17:12.217 INFO:tasks.workunit.client.0.smithi050.stdout:2/717: dwrite d1/dd/d62/da1/f7d [0,4194304] 0 2023-01-04T18:17:12.220 INFO:tasks.workunit.client.0.smithi050.stdout:0/625: dread d0/f7e [0,4194304] 0 2023-01-04T18:17:12.220 INFO:tasks.workunit.client.0.smithi050.stdout:8/804: creat d3/d2a/d74/d92/d94/dc9/f117 x:0 0 0 2023-01-04T18:17:12.220 INFO:tasks.workunit.client.0.smithi050.stdout:1/735: creat d8/d14/d1c/d28/d57/d6a/d92/fe3 x:0 0 0 2023-01-04T18:17:12.220 INFO:tasks.workunit.client.0.smithi050.stdout:8/805: chown d3/d2a/d30/d3b/c99 8486565 1 2023-01-04T18:17:12.221 INFO:tasks.workunit.client.0.smithi050.stdout:0/626: write d0/d6/d8/d25/d8e/f98 [270309,34344] 0 2023-01-04T18:17:12.236 INFO:tasks.workunit.client.0.smithi050.stdout:1/736: dwrite d8/d14/d1c/fb1 [4194304,4194304] 0 2023-01-04T18:17:12.284 INFO:tasks.workunit.client.0.smithi050.stdout:5/889: mknod d13/d15/c144 0 2023-01-04T18:17:12.299 INFO:tasks.workunit.client.0.smithi050.stdout:6/740: mkdir d0/d9/df/dba/dca/da5/de2 0 2023-01-04T18:17:12.299 INFO:tasks.workunit.client.0.smithi050.stdout:6/741: getdents d0/d9/d25/d40/dcf 0 2023-01-04T18:17:12.299 INFO:tasks.workunit.client.0.smithi050.stdout:6/742: stat d0/d4a/c75 0 2023-01-04T18:17:12.299 INFO:tasks.workunit.client.0.smithi050.stdout:6/743: read d0/d9/df/dba/dca/f37 [903763,50866] 0 2023-01-04T18:17:12.300 INFO:tasks.workunit.client.0.smithi050.stdout:5/890: dwrite d13/d15/d66/db8/d27/d44/df2/fff [0,4194304] 0 2023-01-04T18:17:12.301 INFO:tasks.workunit.client.0.smithi050.stdout:4/746: unlink d14/d1b/d1f/d22/d3e/d8a/f89 0 2023-01-04T18:17:12.398 INFO:tasks.workunit.client.0.smithi050.stdout:7/850: mkdir d6/d28/d32/d11a 0 2023-01-04T18:17:12.399 INFO:tasks.workunit.client.0.smithi050.stdout:7/851: fdatasync d6/d28/f3d 0 2023-01-04T18:17:12.399 INFO:tasks.workunit.client.0.smithi050.stdout:7/852: chown d6/db/d20 685943441 1 2023-01-04T18:17:12.399 INFO:tasks.workunit.client.0.smithi050.stdout:9/743: truncate d1/d3/d3b/f9a 290061 0 2023-01-04T18:17:12.399 INFO:tasks.workunit.client.0.smithi050.stdout:9/744: read - d1/d3/d24/fb6 zero size 2023-01-04T18:17:12.408 INFO:tasks.workunit.client.0.smithi050.stdout:7/853: dread d6/db/d15/f16 [0,4194304] 0 2023-01-04T18:17:12.479 INFO:tasks.workunit.client.0.smithi050.stdout:2/718: creat d1/dd/d62/ff3 x:0 0 0 2023-01-04T18:17:12.482 INFO:tasks.workunit.client.0.smithi050.stdout:8/806: mkdir d3/d2a/d74/d118 0 2023-01-04T18:17:12.488 INFO:tasks.workunit.client.0.smithi050.stdout:0/627: getdents d0/d6/d8 0 2023-01-04T18:17:12.489 INFO:tasks.workunit.client.0.smithi050.stdout:0/628: write d0/d6/d8/d51/f7c [890724,99480] 0 2023-01-04T18:17:12.525 INFO:tasks.workunit.client.0.smithi050.stdout:1/737: mknod d8/d14/d1c/d28/d57/d6a/d92/ce4 0 2023-01-04T18:17:12.541 INFO:tasks.workunit.client.0.smithi050.stdout:4/747: creat d14/d1b/d1f/d22/d3e/d44/d59/d5d/d7f/de1/ff5 x:0 0 0 2023-01-04T18:17:12.541 INFO:tasks.workunit.client.0.smithi050.stdout:4/748: read - d14/d1b/d1f/d22/d3e/d44/d59/d5f/d80/fa3 zero size 2023-01-04T18:17:12.541 INFO:tasks.workunit.client.0.smithi050.stdout:4/749: chown d14/d1b/f41 0 1 2023-01-04T18:17:12.541 INFO:tasks.workunit.client.0.smithi050.stdout:5/891: mkdir d13/d15/d63/d145 0 2023-01-04T18:17:12.543 INFO:tasks.workunit.client.0.smithi050.stdout:9/745: unlink d1/d12/d9f/fa0 0 2023-01-04T18:17:12.555 INFO:tasks.workunit.client.0.smithi050.stdout:2/719: mkdir d1/dd/d28/df4 0 2023-01-04T18:17:12.555 INFO:tasks.workunit.client.0.smithi050.stdout:2/720: dread - d1/dd/d11/d14/d44/fdb zero size 2023-01-04T18:17:12.556 INFO:tasks.workunit.client.0.smithi050.stdout:7/854: creat d6/f11b x:0 0 0 2023-01-04T18:17:12.556 INFO:tasks.workunit.client.0.smithi050.stdout:7/855: readlink d6/db/d15/d1b/la8 0 2023-01-04T18:17:12.556 INFO:tasks.workunit.client.0.smithi050.stdout:7/856: write d6/d28/d99/d7a/f8d [1201828,38964] 0 2023-01-04T18:17:12.558 INFO:tasks.workunit.client.0.smithi050.stdout:8/807: creat d3/d2a/d27/dc1/f119 x:0 0 0 2023-01-04T18:17:12.558 INFO:tasks.workunit.client.0.smithi050.stdout:8/808: chown d3/d2a/d27/d93/d7f/ld6 43 1 2023-01-04T18:17:12.558 INFO:tasks.workunit.client.0.smithi050.stdout:8/809: write d3/d2a/d60/d84/f101 [403860,99873] 0 2023-01-04T18:17:12.560 INFO:tasks.workunit.client.0.smithi050.stdout:1/738: symlink d8/d14/d1c/d28/d57/d6a/le5 0 2023-01-04T18:17:12.562 INFO:tasks.workunit.client.0.smithi050.stdout:4/750: rename d14/fe6 to d14/ff6 0 2023-01-04T18:17:12.562 INFO:tasks.workunit.client.0.smithi050.stdout:4/751: readlink d14/d1b/d1f/l2d 0 2023-01-04T18:17:12.565 INFO:tasks.workunit.client.0.smithi050.stdout:3/753: sync 2023-01-04T18:17:12.566 INFO:tasks.workunit.client.0.smithi050.stdout:6/744: sync 2023-01-04T18:17:12.627 INFO:tasks.workunit.client.0.smithi050.stdout:7/857: dwrite d6/db/d15/d1b/d70/ff8 [0,4194304] 0 2023-01-04T18:17:12.627 INFO:tasks.workunit.client.0.smithi050.stdout:7/858: fdatasync d6/d90/de3/d116/fdc 0 2023-01-04T18:17:12.643 INFO:tasks.workunit.client.0.smithi050.stdout:5/892: creat d13/d15/d66/db8/d27/d78/f146 x:0 0 0 2023-01-04T18:17:12.645 INFO:tasks.workunit.client.0.smithi050.stdout:9/746: creat d1/d3/dbf/dd4/da8/fe4 x:0 0 0 2023-01-04T18:17:12.648 INFO:tasks.workunit.client.0.smithi050.stdout:2/721: mkdir d1/dd/d11/d14/d91/d5a/d7f/df5 0 2023-01-04T18:17:12.648 INFO:tasks.workunit.client.0.smithi050.stdout:2/722: write d1/d41/fc3 [690080,127563] 0 2023-01-04T18:17:12.648 INFO:tasks.workunit.client.0.smithi050.stdout:2/723: fsync d1/f86 0 2023-01-04T18:17:12.652 INFO:tasks.workunit.client.0.smithi050.stdout:8/810: mknod d3/d2a/d74/d118/c11a 0 2023-01-04T18:17:12.655 INFO:tasks.workunit.client.0.smithi050.stdout:4/752: creat d14/d1b/d1f/d22/d3e/d44/d59/d5f/ff7 x:0 0 0 2023-01-04T18:17:12.655 INFO:tasks.workunit.client.0.smithi050.stdout:4/753: chown d14/d1b/d32/c70 138477228 1 2023-01-04T18:17:12.657 INFO:tasks.workunit.client.0.smithi050.stdout:3/754: mkdir d0/d8f/d46/d80/dca/d100 0 2023-01-04T18:17:12.658 INFO:tasks.workunit.client.0.smithi050.stdout:6/745: stat d0/d9/d38/d1c/cc7 0 2023-01-04T18:17:12.666 INFO:tasks.workunit.client.0.smithi050.stdout:5/893: mknod d13/d15/d66/db8/d27/d44/d47/d124/d59/d87/de6/c147 0 2023-01-04T18:17:12.667 INFO:tasks.workunit.client.0.smithi050.stdout:5/894: read d13/d15/f73 [3323669,42802] 0 2023-01-04T18:17:12.670 INFO:tasks.workunit.client.0.smithi050.stdout:9/747: rename d1/d12/d2d/d39/dd9 to d1/d12/d3f/de1/de5 0 2023-01-04T18:17:12.671 INFO:tasks.workunit.client.0.smithi050.stdout:8/811: symlink d3/d2a/d30/d3b/d4d/d23/d55/d5f/l11b 0 2023-01-04T18:17:12.672 INFO:tasks.workunit.client.0.smithi050.stdout:8/812: truncate d3/fc6 941782 0 2023-01-04T18:17:12.673 INFO:tasks.workunit.client.0.smithi050.stdout:4/754: mknod d14/d1b/d1f/d22/d3e/d44/d59/d5d/cf8 0 2023-01-04T18:17:12.673 INFO:tasks.workunit.client.0.smithi050.stdout:4/755: truncate d14/d1b/d1f/d22/d3e/f5a 4180482 0 2023-01-04T18:17:12.673 INFO:tasks.workunit.client.0.smithi050.stdout:8/813: dread d3/d2a/d27/dc1/ff3 [0,4194304] 0 2023-01-04T18:17:12.674 INFO:tasks.workunit.client.0.smithi050.stdout:6/746: getdents d0/d4a/d93/db1 0 2023-01-04T18:17:12.677 INFO:tasks.workunit.client.0.smithi050.stdout:5/895: link d13/d15/d66/db8/c5b d13/d15/d66/db2/c148 0 2023-01-04T18:17:12.678 INFO:tasks.workunit.client.0.smithi050.stdout:9/748: symlink d1/d3/d3b/d63/dc3/de2/le6 0 2023-01-04T18:17:12.678 INFO:tasks.workunit.client.0.smithi050.stdout:9/749: stat d1/d12 0 2023-01-04T18:17:12.680 INFO:tasks.workunit.client.0.smithi050.stdout:4/756: rename d14/d1b/c33 to d14/d1b/d1f/d22/d3e/d44/d59/d5f/d80/cf9 0 2023-01-04T18:17:12.682 INFO:tasks.workunit.client.0.smithi050.stdout:6/747: mkdir d0/d9/d25/d40/d89/dd9/dc0/de3 0 2023-01-04T18:17:12.683 INFO:tasks.workunit.client.0.smithi050.stdout:5/896: creat d13/d15/d63/dc0/f149 x:0 0 0 2023-01-04T18:17:12.684 INFO:tasks.workunit.client.0.smithi050.stdout:8/814: dread d3/d2a/d73/f109 [0,4194304] 0 2023-01-04T18:17:12.685 INFO:tasks.workunit.client.0.smithi050.stdout:6/748: mknod d0/d4a/ce4 0 2023-01-04T18:17:12.687 INFO:tasks.workunit.client.0.smithi050.stdout:5/897: mknod d13/d15/d66/db8/c14a 0 2023-01-04T18:17:12.688 INFO:tasks.workunit.client.0.smithi050.stdout:6/749: write d0/d9/d25/d2d/f73 [2390543,41754] 0 2023-01-04T18:17:12.688 INFO:tasks.workunit.client.0.smithi050.stdout:5/898: read d13/d15/d63/fe5 [3662167,126132] 0 2023-01-04T18:17:12.689 INFO:tasks.workunit.client.0.smithi050.stdout:8/815: mkdir d3/d2a/d2d/d86/d11c 0 2023-01-04T18:17:12.691 INFO:tasks.workunit.client.0.smithi050.stdout:6/750: mkdir d0/d5c/db7/d83/de5 0 2023-01-04T18:17:12.693 INFO:tasks.workunit.client.0.smithi050.stdout:8/816: getdents d3/d2a/d30/d3b/d4d 0 2023-01-04T18:17:12.694 INFO:tasks.workunit.client.0.smithi050.stdout:8/817: chown d3/d2a/d74/d92/ff0 91183636 1 2023-01-04T18:17:12.695 INFO:tasks.workunit.client.0.smithi050.stdout:6/751: truncate d0/d9/d38/f5b 4126867 0 2023-01-04T18:17:12.695 INFO:tasks.workunit.client.0.smithi050.stdout:6/752: stat d0/d9/df/dba/dca/d77/la0 0 2023-01-04T18:17:12.696 INFO:tasks.workunit.client.0.smithi050.stdout:8/818: mknod d3/d2a/d30/d3b/d4d/d23/d31/d10d/c11d 0 2023-01-04T18:17:12.698 INFO:tasks.workunit.client.0.smithi050.stdout:4/757: dwrite f4 [0,4194304] 0 2023-01-04T18:17:12.699 INFO:tasks.workunit.client.0.smithi050.stdout:8/819: rmdir d3/d2a/d27/d93/d7a 39 2023-01-04T18:17:12.699 INFO:tasks.workunit.client.0.smithi050.stdout:8/820: stat d3/d2a/d2d/f66 0 2023-01-04T18:17:12.699 INFO:tasks.workunit.client.0.smithi050.stdout:8/821: fdatasync d3/d2a/f90 0 2023-01-04T18:17:12.701 INFO:tasks.workunit.client.0.smithi050.stdout:8/822: creat d3/f11e x:0 0 0 2023-01-04T18:17:12.702 INFO:tasks.workunit.client.0.smithi050.stdout:8/823: read - d3/d2a/d30/d3b/d4d/d23/d55/d5f/fbf zero size 2023-01-04T18:17:12.702 INFO:tasks.workunit.client.0.smithi050.stdout:8/824: write d3/d2a/d30/d3b/d4d/d23/d55/d5f/d82/fa3 [458694,119780] 0 2023-01-04T18:17:12.702 INFO:tasks.workunit.client.0.smithi050.stdout:8/825: chown d3/d2a/d30/d3b/d4d/l1e 63862789 1 2023-01-04T18:17:12.703 INFO:tasks.workunit.client.0.smithi050.stdout:8/826: unlink d3/d2a/d74/d92/ff0 0 2023-01-04T18:17:12.703 INFO:tasks.workunit.client.0.smithi050.stdout:8/827: chown d3/d2a/d30/d3b/d4d/d23/d55/d5f/d82/le4 84527 1 2023-01-04T18:17:12.705 INFO:tasks.workunit.client.0.smithi050.stdout:8/828: mknod d3/d2a/d30/d3b/d4d/d23/d55/d5f/c11f 0 2023-01-04T18:17:12.705 INFO:tasks.workunit.client.0.smithi050.stdout:8/829: write d3/d2a/d60/fa8 [4918643,122466] 0 2023-01-04T18:17:12.707 INFO:tasks.workunit.client.0.smithi050.stdout:8/830: mknod d3/d2a/d74/d92/d94/d9c/c120 0 2023-01-04T18:17:12.709 INFO:tasks.workunit.client.0.smithi050.stdout:8/831: rmdir d3/d2a/d27/d93/d7f 39 2023-01-04T18:17:12.709 INFO:tasks.workunit.client.0.smithi050.stdout:8/832: truncate d3/d2a/d74/d92/d94/dc9/f117 326850 0 2023-01-04T18:17:12.709 INFO:tasks.workunit.client.0.smithi050.stdout:8/833: write d3/d2a/d30/d3b/d53/f97 [846883,2019] 0 2023-01-04T18:17:12.709 INFO:tasks.workunit.client.0.smithi050.stdout:8/834: read d3/d2a/d30/d3b/d53/fca [54609,22814] 0 2023-01-04T18:17:12.711 INFO:tasks.workunit.client.0.smithi050.stdout:4/758: dread d14/d1b/d1f/d22/d3e/f91 [0,4194304] 0 2023-01-04T18:17:12.711 INFO:tasks.workunit.client.0.smithi050.stdout:4/759: chown d14/f24 132423061 1 2023-01-04T18:17:12.711 INFO:tasks.workunit.client.0.smithi050.stdout:4/760: chown d14/f84 250 1 2023-01-04T18:17:12.714 INFO:tasks.workunit.client.0.smithi050.stdout:4/761: rename d14/d1b/d1f/lcc to d14/d1b/d1f/d22/d3e/d44/d59/d5f/d80/d9d/lfa 0 2023-01-04T18:17:12.716 INFO:tasks.workunit.client.0.smithi050.stdout:4/762: creat d14/d1b/d1f/d22/d3e/d44/d59/d5f/d80/d9d/ffb x:0 0 0 2023-01-04T18:17:12.717 INFO:tasks.workunit.client.0.smithi050.stdout:4/763: mknod d14/d1b/d1f/d22/d3e/d44/d59/d5d/d7f/de1/cfc 0 2023-01-04T18:17:12.717 INFO:tasks.workunit.client.0.smithi050.stdout:4/764: chown d14/d1b/d1f/d22/d87/fc2 2 1 2023-01-04T18:17:12.743 INFO:tasks.workunit.client.0.smithi050.stdout:4/765: dwrite d14/d1b/d66/fe2 [0,4194304] 0 2023-01-04T18:17:12.752 INFO:tasks.workunit.client.0.smithi050.stdout:3/755: write d0/dd/f90 [763951,22177] 0 2023-01-04T18:17:12.752 INFO:tasks.workunit.client.0.smithi050.stdout:2/724: dwrite d1/dd/d11/d14/d91/f9d [0,4194304] 0 2023-01-04T18:17:12.756 INFO:tasks.workunit.client.0.smithi050.stdout:8/835: dwrite d3/d2a/d74/d92/d94/dc9/ffe [0,4194304] 0 2023-01-04T18:17:12.756 INFO:tasks.workunit.client.0.smithi050.stdout:8/836: chown d3/d2a/d74/d92/d94/d9c/fbc 11386969 1 2023-01-04T18:17:12.757 INFO:tasks.workunit.client.0.smithi050.stdout:6/753: dwrite d0/d5c/db7/f8a [4194304,4194304] 0 2023-01-04T18:17:12.788 INFO:tasks.workunit.client.0.smithi050.stdout:9/750: fsync d1/d3/dbf/dd4/da8/fe4 0 2023-01-04T18:17:12.806 INFO:tasks.workunit.client.0.smithi050.stdout:5/899: rmdir d13/d15/d63 39 2023-01-04T18:17:12.806 INFO:tasks.workunit.client.0.smithi050.stdout:4/766: dread d14/d1b/d1f/d22/d3e/f8d [0,4194304] 0 2023-01-04T18:17:12.809 INFO:tasks.workunit.client.0.smithi050.stdout:3/756: getdents d0/d1b/d2f/d56/d98/d9c 0 2023-01-04T18:17:12.819 INFO:tasks.workunit.client.0.smithi050.stdout:2/725: unlink d1/dd/d28/d2c/d2e/c96 0 2023-01-04T18:17:12.820 INFO:tasks.workunit.client.0.smithi050.stdout:2/726: write d1/dd/d62/da1/d6e/fad [6468691,110698] 0 2023-01-04T18:17:12.820 INFO:tasks.workunit.client.0.smithi050.stdout:2/727: read d1/dd/d62/da1/d6e/f80 [4034499,28416] 0 2023-01-04T18:17:12.822 INFO:tasks.workunit.client.0.smithi050.stdout:2/728: read d1/dd/d62/d69/f82 [1947629,43042] 0 2023-01-04T18:17:12.832 INFO:tasks.workunit.client.0.smithi050.stdout:8/837: link d3/d2a/d27/dc1/ff3 d3/d2a/d27/d8b/d9f/f121 0 2023-01-04T18:17:12.853 INFO:tasks.workunit.client.0.smithi050.stdout:6/754: rmdir d0/d9/df/dba/dca/da5/de2 0 2023-01-04T18:17:12.856 INFO:tasks.workunit.client.0.smithi050.stdout:0/629: sync 2023-01-04T18:17:12.857 INFO:tasks.workunit.client.0.smithi050.stdout:9/751: rename d1/d3/d11/l6d to d1/d3/d24/le7 0 2023-01-04T18:17:12.857 INFO:tasks.workunit.client.0.smithi050.stdout:9/752: fdatasync d1/d6f/fd0 0 2023-01-04T18:17:12.860 INFO:tasks.workunit.client.0.smithi050.stdout:4/767: symlink d14/d1b/d1f/d22/d3e/d8a/lfd 0 2023-01-04T18:17:12.861 INFO:tasks.workunit.client.0.smithi050.stdout:3/757: getdents d0/d1b 0 2023-01-04T18:17:12.865 INFO:tasks.workunit.client.0.smithi050.stdout:2/729: link d1/dd/db0/cd4 d1/dd/d28/d2c/d2e/d36/cf6 0 2023-01-04T18:17:12.870 INFO:tasks.workunit.client.0.smithi050.stdout:2/730: dread d1/dd/d11/f54 [0,4194304] 0 2023-01-04T18:17:12.872 INFO:tasks.workunit.client.0.smithi050.stdout:1/739: sync 2023-01-04T18:17:12.875 INFO:tasks.workunit.client.0.smithi050.stdout:8/838: unlink d3/d2a/d60/c4c 0 2023-01-04T18:17:12.877 INFO:tasks.workunit.client.0.smithi050.stdout:6/755: creat d0/d9/df/dba/fe6 x:0 0 0 2023-01-04T18:17:12.878 INFO:tasks.workunit.client.0.smithi050.stdout:9/753: dwrite d1/d12/d9f/fbb [0,4194304] 0 2023-01-04T18:17:12.879 INFO:tasks.workunit.client.0.smithi050.stdout:5/900: rename d13/d15/d66/db8/d27/d44/d47/d124/d59/ca1 to d13/d15/c14b 0 2023-01-04T18:17:12.881 INFO:tasks.workunit.client.0.smithi050.stdout:4/768: dread d14/d1b/d1f/d22/d3e/f8d [0,4194304] 0 2023-01-04T18:17:12.881 INFO:tasks.workunit.client.0.smithi050.stdout:4/769: chown d14/d9e/lb0 30138720 1 2023-01-04T18:17:12.881 INFO:tasks.workunit.client.0.smithi050.stdout:4/770: write d14/d1b/d1f/d22/d3e/d44/d59/d5f/d80/fd8 [202854,21495] 0 2023-01-04T18:17:12.897 INFO:tasks.workunit.client.0.smithi050.stdout:1/740: dwrite d8/f13 [0,4194304] 0 2023-01-04T18:17:12.897 INFO:tasks.workunit.client.0.smithi050.stdout:1/741: fsync d8/d14/d1c/d28/fc4 0 2023-01-04T18:17:12.897 INFO:tasks.workunit.client.0.smithi050.stdout:1/742: chown d8/d48/d5c/d67/d3b/db9/dde 623175212 1 2023-01-04T18:17:12.897 INFO:tasks.workunit.client.0.smithi050.stdout:1/743: dread - d8/d14/d1c/d28/fc4 zero size 2023-01-04T18:17:12.897 INFO:tasks.workunit.client.0.smithi050.stdout:1/744: chown d8/d48/d5c/d67/d3a/cda 175515 1 2023-01-04T18:17:12.897 INFO:tasks.workunit.client.0.smithi050.stdout:1/745: chown d8/d48/d5c/d67/d91/fa3 8416 1 2023-01-04T18:17:12.899 INFO:tasks.workunit.client.0.smithi050.stdout:4/771: dwrite d14/f1c [0,4194304] 0 2023-01-04T18:17:12.904 INFO:tasks.workunit.client.0.smithi050.stdout:3/758: mkdir d0/d10/d101 0 2023-01-04T18:17:12.905 INFO:tasks.workunit.client.0.smithi050.stdout:2/731: mkdir d1/dd/d62/da1/d83/df7 0 2023-01-04T18:17:12.907 INFO:tasks.workunit.client.0.smithi050.stdout:6/756: creat d0/d5c/db7/fe7 x:0 0 0 2023-01-04T18:17:12.908 INFO:tasks.workunit.client.0.smithi050.stdout:6/757: chown d0/d4a/d93/fc4 65 1 2023-01-04T18:17:12.908 INFO:tasks.workunit.client.0.smithi050.stdout:6/758: getdents d0/d9/d25/d40/d89/dd9/dc0/de3 0 2023-01-04T18:17:12.908 INFO:tasks.workunit.client.0.smithi050.stdout:6/759: stat d0/d4a/fb3 0 2023-01-04T18:17:12.908 INFO:tasks.workunit.client.0.smithi050.stdout:6/760: read d0/d9/d25/f27 [1638015,4497] 0 2023-01-04T18:17:12.911 INFO:tasks.workunit.client.0.smithi050.stdout:9/754: link d1/d3/d11/l3a d1/d6f/le8 0 2023-01-04T18:17:12.913 INFO:tasks.workunit.client.0.smithi050.stdout:7/859: sync 2023-01-04T18:17:12.918 INFO:tasks.workunit.client.0.smithi050.stdout:5/901: creat d13/d15/d66/db8/d27/d46/d4e/d4d/da9/f14c x:0 0 0 2023-01-04T18:17:12.921 INFO:tasks.workunit.client.0.smithi050.stdout:1/746: mkdir d8/d14/d1c/d28/d57/de6 0 2023-01-04T18:17:12.921 INFO:tasks.workunit.client.0.smithi050.stdout:1/747: chown d8/d48/d5c/d67/d91/cad 789 1 2023-01-04T18:17:12.921 INFO:tasks.workunit.client.0.smithi050.stdout:1/748: fdatasync d8/d14/d1c/f78 0 2023-01-04T18:17:12.921 INFO:tasks.workunit.client.0.smithi050.stdout:1/749: chown d8/d48/d5c/d67/d3a/d31/laa 2061101 1 2023-01-04T18:17:12.921 INFO:tasks.workunit.client.0.smithi050.stdout:1/750: fdatasync d8/d14/d1c/f76 0 2023-01-04T18:17:12.922 INFO:tasks.workunit.client.0.smithi050.stdout:3/759: creat d0/d1b/d2f/d56/d98/f102 x:0 0 0 2023-01-04T18:17:12.923 INFO:tasks.workunit.client.0.smithi050.stdout:6/761: creat d0/d5c/db7/d83/fe8 x:0 0 0 2023-01-04T18:17:12.926 INFO:tasks.workunit.client.0.smithi050.stdout:9/755: symlink d1/d3/d89/le9 0 2023-01-04T18:17:12.927 INFO:tasks.workunit.client.0.smithi050.stdout:9/756: readlink d1/d12/d2d/lc2 0 2023-01-04T18:17:12.927 INFO:tasks.workunit.client.0.smithi050.stdout:7/860: rmdir d6/d28/d99/dd7 39 2023-01-04T18:17:12.928 INFO:tasks.workunit.client.0.smithi050.stdout:7/861: truncate d6/db/d15/d1b/f8c 925267 0 2023-01-04T18:17:12.930 INFO:tasks.workunit.client.0.smithi050.stdout:0/630: rename d0/d6/d8/d35/l2f to d0/lc6 0 2023-01-04T18:17:12.931 INFO:tasks.workunit.client.0.smithi050.stdout:0/631: write d0/d6/d8/f89 [227187,31867] 0 2023-01-04T18:17:12.931 INFO:tasks.workunit.client.0.smithi050.stdout:3/760: dread d0/f4 [0,4194304] 0 2023-01-04T18:17:12.932 INFO:tasks.workunit.client.0.smithi050.stdout:0/632: chown d0/d6/d8/d25/d8e/f98 900 1 2023-01-04T18:17:12.932 INFO:tasks.workunit.client.0.smithi050.stdout:3/761: chown d0/d10/f42 23 1 2023-01-04T18:17:12.932 INFO:tasks.workunit.client.0.smithi050.stdout:0/633: write d0/d6/d28/d1a/f23 [1068946,13853] 0 2023-01-04T18:17:12.994 INFO:tasks.workunit.client.0.smithi050.stdout:5/902: unlink d13/d15/d66/db2/c148 0 2023-01-04T18:17:12.995 INFO:tasks.workunit.client.0.smithi050.stdout:5/903: read d13/d15/d66/db8/d27/d46/d4e/d4d/f125 [656589,82487] 0 2023-01-04T18:17:12.998 INFO:tasks.workunit.client.0.smithi050.stdout:1/751: mkdir d8/d14/d1c/d28/dc7/dca/de7 0 2023-01-04T18:17:12.998 INFO:tasks.workunit.client.0.smithi050.stdout:1/752: fsync d8/d14/d1c/d28/d57/f61 0 2023-01-04T18:17:13.001 INFO:tasks.workunit.client.0.smithi050.stdout:6/762: symlink d0/d9/d25/d40/d89/dd9/d7a/le9 0 2023-01-04T18:17:13.002 INFO:tasks.workunit.client.0.smithi050.stdout:9/757: stat d1/d3/d3b/lbc 0 2023-01-04T18:17:13.004 INFO:tasks.workunit.client.0.smithi050.stdout:4/772: rename d14/d1b/d1f/d63/cd3 to d14/d1b/dd7/cfe 0 2023-01-04T18:17:13.004 INFO:tasks.workunit.client.0.smithi050.stdout:4/773: fsync d14/d1b/d1f/d63/fad 0 2023-01-04T18:17:13.005 INFO:tasks.workunit.client.0.smithi050.stdout:3/762: unlink d0/d8f/d46/fe0 0 2023-01-04T18:17:13.006 INFO:tasks.workunit.client.0.smithi050.stdout:0/634: creat d0/d6/d28/d1a/d8a/fc7 x:0 0 0 2023-01-04T18:17:13.008 INFO:tasks.workunit.client.0.smithi050.stdout:5/904: creat d13/d15/d66/db8/d27/dca/dd3/df8/f14d x:0 0 0 2023-01-04T18:17:13.013 INFO:tasks.workunit.client.0.smithi050.stdout:1/753: mkdir d8/d14/d1c/d28/d57/d6a/de8 0 2023-01-04T18:17:13.017 INFO:tasks.workunit.client.0.smithi050.stdout:9/758: symlink d1/d12/d41/d60/d95/lea 0 2023-01-04T18:17:13.022 INFO:tasks.workunit.client.0.smithi050.stdout:2/732: rename d1/d41/d68 to d1/dd/d11/db5/df8 0 2023-01-04T18:17:13.024 INFO:tasks.workunit.client.0.smithi050.stdout:4/774: link d14/d1b/d1f/d22/d3e/l5e d14/d1b/d66/dc1/lff 0 2023-01-04T18:17:13.025 INFO:tasks.workunit.client.0.smithi050.stdout:6/763: dread d0/d9/d38/d1c/f26 [0,4194304] 0 2023-01-04T18:17:13.029 INFO:tasks.workunit.client.0.smithi050.stdout:5/905: dwrite d13/d15/d66/db8/d27/d44/d101/f114 [4194304,4194304] 0 2023-01-04T18:17:13.029 INFO:tasks.workunit.client.0.smithi050.stdout:5/906: dread - d13/d15/d66/db8/d27/d44/d47/d124/d42/d10d/f13f zero size 2023-01-04T18:17:13.037 INFO:tasks.workunit.client.0.smithi050.stdout:9/759: dwrite d1/d12/d41/d60/f64 [0,4194304] 0 2023-01-04T18:17:13.037 INFO:tasks.workunit.client.0.smithi050.stdout:1/754: creat d8/d14/d1c/d28/d57/de6/fe9 x:0 0 0 2023-01-04T18:17:13.038 INFO:tasks.workunit.client.0.smithi050.stdout:9/760: write d1/d12/d41/d60/f64 [4175446,60310] 0 2023-01-04T18:17:13.038 INFO:tasks.workunit.client.0.smithi050.stdout:9/761: fsync d1/d3/d11/d42/fc5 0 2023-01-04T18:17:13.039 INFO:tasks.workunit.client.0.smithi050.stdout:0/635: rename d0/d73/d79/f9a to d0/d9f/d84/fc8 0 2023-01-04T18:17:13.040 INFO:tasks.workunit.client.0.smithi050.stdout:2/733: creat d1/dd/d28/d2c/d66/ff9 x:0 0 0 2023-01-04T18:17:13.042 INFO:tasks.workunit.client.0.smithi050.stdout:3/763: link d0/c8 d0/d1b/d2f/d56/d98/c103 0 2023-01-04T18:17:13.051 INFO:tasks.workunit.client.0.smithi050.stdout:3/764: dread d0/d1a/f24 [0,4194304] 0 2023-01-04T18:17:13.051 INFO:tasks.workunit.client.0.smithi050.stdout:3/765: write d0/d1b/d2f/d71/fda [1433692,105833] 0 2023-01-04T18:17:13.066 INFO:tasks.workunit.client.0.smithi050.stdout:5/907: creat d13/d15/d66/db2/f14e x:0 0 0 2023-01-04T18:17:13.068 INFO:tasks.workunit.client.0.smithi050.stdout:1/755: creat d8/d14/d1c/d28/dc7/fea x:0 0 0 2023-01-04T18:17:13.161 INFO:tasks.workunit.client.0.smithi050.stdout:4/775: rename d14/d1b/d1f/c64 to d14/d1b/d1f/d22/d3e/d44/d59/d5f/d80/d9d/c100 0 2023-01-04T18:17:13.161 INFO:tasks.workunit.client.0.smithi050.stdout:4/776: write d14/d1b/d1f/d22/d3e/d85/fcf [126112,54888] 0 2023-01-04T18:17:13.162 INFO:tasks.workunit.client.0.smithi050.stdout:0/636: creat d0/d6/d28/d1a/d8a/fc9 x:0 0 0 2023-01-04T18:17:13.163 INFO:tasks.workunit.client.0.smithi050.stdout:2/734: mkdir d1/dd/d11/d14/d91/d5a/dfa 0 2023-01-04T18:17:13.164 INFO:tasks.workunit.client.0.smithi050.stdout:2/735: write d1/dd/d28/d2c/d66/f87 [1838726,119386] 0 2023-01-04T18:17:13.170 INFO:tasks.workunit.client.0.smithi050.stdout:1/756: creat d8/d48/d5c/feb x:0 0 0 2023-01-04T18:17:13.175 INFO:tasks.workunit.client.0.smithi050.stdout:6/764: rename d0/d9/d38/d1c to d0/d9/d25/d2d/dea 0 2023-01-04T18:17:13.176 INFO:tasks.workunit.client.0.smithi050.stdout:6/765: read d0/d4a/f7e [3361468,6617] 0 2023-01-04T18:17:13.181 INFO:tasks.workunit.client.0.smithi050.stdout:4/777: creat d14/d1b/d1f/d22/d3e/d44/d59/d5d/d7f/f101 x:0 0 0 2023-01-04T18:17:13.189 INFO:tasks.workunit.client.0.smithi050.stdout:2/736: rmdir d1/dd/d11/db5/d99 39 2023-01-04T18:17:13.193 INFO:tasks.workunit.client.0.smithi050.stdout:0/637: rename d0/d6/d28/d1a/f30 to d0/d6/d8/d25/fca 0 2023-01-04T18:17:13.195 INFO:tasks.workunit.client.0.smithi050.stdout:6/766: mknod d0/db6/ceb 0 2023-01-04T18:17:13.195 INFO:tasks.workunit.client.0.smithi050.stdout:6/767: getdents d0/d9/d25/d40/d89/dd9/d7a/dcb 0 2023-01-04T18:17:13.198 INFO:tasks.workunit.client.0.smithi050.stdout:6/768: write d0/d4a/d93/fc4 [2354894,107005] 0 2023-01-04T18:17:13.198 INFO:tasks.workunit.client.0.smithi050.stdout:4/778: dwrite d14/d1b/d1f/d22/d3e/d44/d59/d5f/fb1 [0,4194304] 0 2023-01-04T18:17:13.198 INFO:tasks.workunit.client.0.smithi050.stdout:4/779: readlink d14/la7 0 2023-01-04T18:17:13.199 INFO:tasks.workunit.client.0.smithi050.stdout:2/737: symlink d1/d10/lfb 0 2023-01-04T18:17:13.199 INFO:tasks.workunit.client.0.smithi050.stdout:2/738: truncate d1/dd/d11/d14/d91/f90 1472618 0 2023-01-04T18:17:13.204 INFO:tasks.workunit.client.0.smithi050.stdout:1/757: rename d8/d48/d8c to d8/d14/d1c/d28/d57/d6a/d92/dec 0 2023-01-04T18:17:13.205 INFO:tasks.workunit.client.0.smithi050.stdout:1/758: write d8/f4d [12344978,5103] 0 2023-01-04T18:17:13.206 INFO:tasks.workunit.client.0.smithi050.stdout:0/638: creat d0/d6/d8/d4f/fcb x:0 0 0 2023-01-04T18:17:13.206 INFO:tasks.workunit.client.0.smithi050.stdout:0/639: fsync d0/d6/d8/d35/f6f 0 2023-01-04T18:17:13.206 INFO:tasks.workunit.client.0.smithi050.stdout:0/640: write d0/d6/f55 [1092289,1836] 0 2023-01-04T18:17:13.207 INFO:tasks.workunit.client.0.smithi050.stdout:7/862: sync 2023-01-04T18:17:13.207 INFO:tasks.workunit.client.0.smithi050.stdout:8/839: sync 2023-01-04T18:17:13.209 INFO:tasks.workunit.client.0.smithi050.stdout:4/780: dread d14/d1b/d1f/f57 [0,4194304] 0 2023-01-04T18:17:13.209 INFO:tasks.workunit.client.0.smithi050.stdout:6/769: mkdir d0/d9/df/dba/dca/d6b/da4/dab/dec 0 2023-01-04T18:17:13.215 INFO:tasks.workunit.client.0.smithi050.stdout:1/759: dread d8/f60 [0,4194304] 0 2023-01-04T18:17:13.216 INFO:tasks.workunit.client.0.smithi050.stdout:1/760: chown d8/d14/d1c/d28/fdd 468 1 2023-01-04T18:17:13.216 INFO:tasks.workunit.client.0.smithi050.stdout:1/761: dread - d8/d48/d5c/d67/d3a/dd1/fe1 zero size 2023-01-04T18:17:13.225 INFO:tasks.workunit.client.0.smithi050.stdout:2/739: symlink d1/dd/d11/d14/d91/d5a/lfc 0 2023-01-04T18:17:13.225 INFO:tasks.workunit.client.0.smithi050.stdout:2/740: write d1/dd/d62/ff3 [602756,44964] 0 2023-01-04T18:17:13.225 INFO:tasks.workunit.client.0.smithi050.stdout:2/741: chown d1/dd/d11/d14/d91 188318 1 2023-01-04T18:17:13.225 INFO:tasks.workunit.client.0.smithi050.stdout:0/641: symlink d0/d9f/d84/lcc 0 2023-01-04T18:17:13.226 INFO:tasks.workunit.client.0.smithi050.stdout:0/642: truncate d0/d73/d68/f7f 670098 0 2023-01-04T18:17:13.226 INFO:tasks.workunit.client.0.smithi050.stdout:7/863: symlink d6/d90/de3/l11c 0 2023-01-04T18:17:13.227 INFO:tasks.workunit.client.0.smithi050.stdout:8/840: link d3/d2a/d30/d3b/l102 d3/d2a/l122 0 2023-01-04T18:17:13.227 INFO:tasks.workunit.client.0.smithi050.stdout:8/841: chown d3/d2a/d2d/l104 6401 1 2023-01-04T18:17:13.227 INFO:tasks.workunit.client.0.smithi050.stdout:8/842: truncate d3/d2a/d74/d92/d94/fb1 5062239 0 2023-01-04T18:17:13.227 INFO:tasks.workunit.client.0.smithi050.stdout:4/781: dwrite d14/d1b/f41 [0,4194304] 0 2023-01-04T18:17:13.230 INFO:tasks.workunit.client.0.smithi050.stdout:5/908: dwrite d13/d28/f3e [0,4194304] 0 2023-01-04T18:17:13.230 INFO:tasks.workunit.client.0.smithi050.stdout:6/770: truncate d0/d9/d38/f23 1431462 0 2023-01-04T18:17:13.233 INFO:tasks.workunit.client.0.smithi050.stdout:8/843: write d3/d2a/d2d/f66 [2796852,2734] 0 2023-01-04T18:17:13.235 INFO:tasks.workunit.client.0.smithi050.stdout:1/762: symlink d8/d14/led 0 2023-01-04T18:17:13.235 INFO:tasks.workunit.client.0.smithi050.stdout:1/763: chown d8/d48/d5c/d67/d3a/d23/c37 1110 1 2023-01-04T18:17:13.242 INFO:tasks.workunit.client.0.smithi050.stdout:2/742: rename d1/dd/f74 to d1/dd/d28/d2c/d2e/d3f/ffd 0 2023-01-04T18:17:13.245 INFO:tasks.workunit.client.0.smithi050.stdout:9/762: sync 2023-01-04T18:17:13.248 INFO:tasks.workunit.client.0.smithi050.stdout:0/643: link d0/d6/d28/d1a/f6b d0/d9f/fcd 0 2023-01-04T18:17:13.248 INFO:tasks.workunit.client.0.smithi050.stdout:0/644: stat d0/d6/d8/d25/fca 0 2023-01-04T18:17:13.252 INFO:tasks.workunit.client.0.smithi050.stdout:4/782: dwrite d14/d1b/d1f/d22/d3e/d44/d59/d5f/fb1 [0,4194304] 0 2023-01-04T18:17:13.252 INFO:tasks.workunit.client.0.smithi050.stdout:4/783: dread - d14/d1b/d1f/d22/d3e/d44/d59/d5f/d80/fa3 zero size 2023-01-04T18:17:13.253 INFO:tasks.workunit.client.0.smithi050.stdout:4/784: truncate d14/d1b/d1f/d63/fad 972000 0 2023-01-04T18:17:13.262 INFO:tasks.workunit.client.0.smithi050.stdout:6/771: symlink d0/d9/d25/d40/d89/led 0 2023-01-04T18:17:13.262 INFO:tasks.workunit.client.0.smithi050.stdout:6/772: write d0/d9/d25/f3a [3710856,106663] 0 2023-01-04T18:17:13.270 INFO:tasks.workunit.client.0.smithi050.stdout:1/764: rmdir d8/d14/d1c/d28/dc7 39 2023-01-04T18:17:13.270 INFO:tasks.workunit.client.0.smithi050.stdout:1/765: fsync d8/d48/d5c/f65 0 2023-01-04T18:17:13.271 INFO:tasks.workunit.client.0.smithi050.stdout:1/766: write d8/d14/d1c/fb1 [3703460,120139] 0 2023-01-04T18:17:13.271 INFO:tasks.workunit.client.0.smithi050.stdout:1/767: fdatasync d8/d14/d1c/d28/d57/de6/fe9 0 2023-01-04T18:17:13.272 INFO:tasks.workunit.client.0.smithi050.stdout:6/773: dread d0/d4a/f7e [0,4194304] 0 2023-01-04T18:17:13.285 INFO:tasks.workunit.client.0.smithi050.stdout:7/864: rename d6/d28/d32/f83 to d6/d90/de3/d6a/d102/d105/f11d 0 2023-01-04T18:17:13.285 INFO:tasks.workunit.client.0.smithi050.stdout:6/774: dwrite d0/d9/f2b [0,4194304] 0 2023-01-04T18:17:13.286 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:11.922703+0000 mgr.smithi098.vhfzum (mgr.24455) 49 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 1.6 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 63 MiB/s rd, 142 MiB/s wr, 265 op/s 2023-01-04T18:17:13.286 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:12.860054+0000 mon.smithi050 (mon.0) 602 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:17:13.286 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:12.863216+0000 mon.smithi098 (mon.1) 54 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:17:13.287 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:12.864584+0000 mon.smithi098 (mon.1) 55 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:17:13.287 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:12.865270+0000 mon.smithi098 (mon.1) 56 : audit [INF] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:17:13.287 INFO:tasks.workunit.client.0.smithi050.stdout:2/743: unlink d1/dd/d28/cb2 0 2023-01-04T18:17:13.288 INFO:tasks.workunit.client.0.smithi050.stdout:6/775: dread d0/d4a/f7e [0,4194304] 0 2023-01-04T18:17:13.291 INFO:tasks.workunit.client.0.smithi050.stdout:0/645: getdents d0/d6/d8/d35 0 2023-01-04T18:17:13.291 INFO:tasks.workunit.client.0.smithi050.stdout:0/646: stat d0/d6/d28/d1a/f23 0 2023-01-04T18:17:13.292 INFO:tasks.workunit.client.0.smithi050.stdout:6/776: dread d0/d4a/d93/fa8 [0,4194304] 0 2023-01-04T18:17:13.292 INFO:tasks.workunit.client.0.smithi050.stdout:6/777: fsync d0/d9/d38/fd3 0 2023-01-04T18:17:13.293 INFO:tasks.workunit.client.0.smithi050.stdout:0/647: write d0/d6/fa [7243023,55325] 0 2023-01-04T18:17:13.301 INFO:tasks.workunit.client.0.smithi050.stdout:2/744: dwrite d1/dd/d28/d2c/d2e/d36/f51 [0,4194304] 0 2023-01-04T18:17:13.304 INFO:tasks.workunit.client.0.smithi050.stdout:4/785: creat d14/d1b/d1f/d63/f102 x:0 0 0 2023-01-04T18:17:13.304 INFO:tasks.workunit.client.0.smithi050.stdout:4/786: read d14/d1b/d1f/f4a [1681271,55456] 0 2023-01-04T18:17:13.312 INFO:tasks.workunit.client.0.smithi050.stdout:3/766: sync 2023-01-04T18:17:13.312 INFO:tasks.workunit.client.0.smithi050.stdout:8/844: dread d3/d2a/d74/d92/d94/dc9/f117 [0,4194304] 0 2023-01-04T18:17:13.314 INFO:tasks.workunit.client.0.smithi050.stdout:1/768: creat d8/d14/d1c/d28/d57/de6/fee x:0 0 0 2023-01-04T18:17:13.325 INFO:tasks.workunit.client.0.smithi050.stdout:5/909: rename d13/d15/d66/db8/d27/d46/d4e/d4d/db1/dbc/ffc to d13/d15/d66/db8/d27/d44/f14f 0 2023-01-04T18:17:13.326 INFO:tasks.workunit.client.0.smithi050.stdout:3/767: dwrite d0/d1b/d2f/fb7 [0,4194304] 0 2023-01-04T18:17:13.326 INFO:tasks.workunit.client.0.smithi050.stdout:3/768: fsync d0/d1a/f24 0 2023-01-04T18:17:13.328 INFO:tasks.workunit.client.0.smithi050.stdout:7/865: unlink d6/db/d15/d2e/ccd 0 2023-01-04T18:17:13.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:11.922703+0000 mgr.smithi098.vhfzum (mgr.24455) 49 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 1.6 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 63 MiB/s rd, 142 MiB/s wr, 265 op/s 2023-01-04T18:17:13.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:12.860054+0000 mon.smithi050 (mon.0) 602 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:17:13.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:12.863216+0000 mon.smithi098 (mon.1) 54 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:17:13.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:12.864584+0000 mon.smithi098 (mon.1) 55 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:17:13.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:12.865270+0000 mon.smithi098 (mon.1) 56 : audit [INF] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:17:13.332 INFO:tasks.workunit.client.0.smithi050.stdout:6/778: truncate d0/d9/d25/f9a 3471750 0 2023-01-04T18:17:13.334 INFO:tasks.workunit.client.0.smithi050.stdout:0/648: creat d0/d6/d8/fce x:0 0 0 2023-01-04T18:17:13.339 INFO:tasks.workunit.client.0.smithi050.stdout:7/866: dread d6/db/d20/d55/f5e [0,4194304] 0 2023-01-04T18:17:13.339 INFO:tasks.workunit.client.0.smithi050.stdout:7/867: stat d6/db/d15/d1b/f21 0 2023-01-04T18:17:13.339 INFO:tasks.workunit.client.0.smithi050.stdout:7/868: chown d6/d1d/d1f/d80/f93 42824928 1 2023-01-04T18:17:13.339 INFO:tasks.workunit.client.0.smithi050.stdout:0/649: write d0/d6/d28/f49 [3461903,22190] 0 2023-01-04T18:17:13.341 INFO:tasks.workunit.client.0.smithi050.stdout:5/910: dwrite d13/d15/d66/db8/d27/d44/d47/d124/d42/d4a/f64 [0,4194304] 0 2023-01-04T18:17:13.342 INFO:tasks.workunit.client.0.smithi050.stdout:2/745: getdents d1/dd/d11/d14/d44 0 2023-01-04T18:17:13.373 INFO:tasks.workunit.client.0.smithi050.stdout:7/869: dwrite d6/db/d15/f16 [0,4194304] 0 2023-01-04T18:17:13.386 INFO:tasks.workunit.client.0.smithi050.stdout:7/870: dwrite d6/db/d3b/f9e [4194304,4194304] 0 2023-01-04T18:17:13.386 INFO:tasks.workunit.client.0.smithi050.stdout:7/871: fsync d6/db/d20/d4f/d6e/f100 0 2023-01-04T18:17:13.386 INFO:tasks.workunit.client.0.smithi050.stdout:7/872: chown d6/d28/d32/d9d 1556 1 2023-01-04T18:17:13.390 INFO:tasks.workunit.client.0.smithi050.stdout:4/787: creat d14/d1b/d1f/d22/d3e/d44/d59/d5d/d7f/f103 x:0 0 0 2023-01-04T18:17:13.524 INFO:tasks.workunit.client.0.smithi050.stdout:8/845: creat d3/d2a/d2d/d86/dd1/f123 x:0 0 0 2023-01-04T18:17:13.524 INFO:tasks.workunit.client.0.smithi050.stdout:8/846: write d3/d2a/d74/d92/d94/dc9/fe8 [829169,96241] 0 2023-01-04T18:17:13.545 INFO:tasks.workunit.client.0.smithi050.stdout:1/769: truncate d8/d14/d1c/d28/f3f 371900 0 2023-01-04T18:17:13.592 INFO:tasks.workunit.client.0.smithi050.stdout:3/769: creat d0/d1b/d2f/d56/d98/f104 x:0 0 0 2023-01-04T18:17:13.599 INFO:tasks.workunit.client.0.smithi050.stdout:6/779: creat d0/d9/d25/dd4/fee x:0 0 0 2023-01-04T18:17:13.604 INFO:tasks.workunit.client.0.smithi050.stdout:0/650: mknod d0/d9f/ccf 0 2023-01-04T18:17:13.643 INFO:tasks.workunit.client.0.smithi050.stdout:7/873: mkdir d6/ded/d11e 0 2023-01-04T18:17:13.643 INFO:tasks.workunit.client.0.smithi050.stdout:7/874: dread - d6/db/d20/d55/fd6 zero size 2023-01-04T18:17:13.644 INFO:tasks.workunit.client.0.smithi050.stdout:4/788: symlink d14/l104 0 2023-01-04T18:17:13.647 INFO:tasks.workunit.client.0.smithi050.stdout:8/847: unlink d3/d2a/d74/d92/d94/ca0 0 2023-01-04T18:17:13.652 INFO:tasks.workunit.client.0.smithi050.stdout:1/770: mknod d8/d14/d1c/d28/d57/de6/cef 0 2023-01-04T18:17:13.652 INFO:tasks.workunit.client.0.smithi050.stdout:1/771: chown d8/d14/d1c/d28/d57/d6a/lcf 0 1 2023-01-04T18:17:13.654 INFO:tasks.workunit.client.0.smithi050.stdout:3/770: unlink d0/d1b/d2f/d56/fa3 0 2023-01-04T18:17:13.659 INFO:tasks.workunit.client.0.smithi050.stdout:6/780: getdents d0 0 2023-01-04T18:17:13.659 INFO:tasks.workunit.client.0.smithi050.stdout:6/781: chown d0/d4a/d93/db1/lb4 3 1 2023-01-04T18:17:13.661 INFO:tasks.workunit.client.0.smithi050.stdout:2/746: mknod d1/dd/d11/cfe 0 2023-01-04T18:17:13.664 INFO:tasks.workunit.client.0.smithi050.stdout:7/875: rename d6/d28/dde/f104 to d6/d90/de3/d116/f11f 0 2023-01-04T18:17:13.667 INFO:tasks.workunit.client.0.smithi050.stdout:9/763: sync 2023-01-04T18:17:13.667 INFO:tasks.workunit.client.0.smithi050.stdout:5/911: sync 2023-01-04T18:17:13.669 INFO:tasks.workunit.client.0.smithi050.stdout:4/789: dread d14/d1b/d1f/d22/d3e/f8d [0,4194304] 0 2023-01-04T18:17:13.669 INFO:tasks.workunit.client.0.smithi050.stdout:4/790: write d14/d1b/d1f/fc6 [629116,90257] 0 2023-01-04T18:17:13.669 INFO:tasks.workunit.client.0.smithi050.stdout:4/791: truncate d14/d1b/d1f/d22/d3e/d44/d59/d5f/d80/d9d/ffb 99615 0 2023-01-04T18:17:13.673 INFO:tasks.workunit.client.0.smithi050.stdout:1/772: unlink d8/d48/d5c/d67/d3b/c90 0 2023-01-04T18:17:13.675 INFO:tasks.workunit.client.0.smithi050.stdout:3/771: mknod d0/d1b/d2f/d56/d98/d9c/dc9/c105 0 2023-01-04T18:17:13.678 INFO:tasks.workunit.client.0.smithi050.stdout:6/782: creat d0/d9/d25/fef x:0 0 0 2023-01-04T18:17:13.681 INFO:tasks.workunit.client.0.smithi050.stdout:2/747: write d1/dd/d11/d14/d91/d5a/d7f/f9f [280563,69643] 0 2023-01-04T18:17:13.683 INFO:tasks.workunit.client.0.smithi050.stdout:7/876: mknod d6/d90/de3/d6a/d102/d105/c120 0 2023-01-04T18:17:13.691 INFO:tasks.workunit.client.0.smithi050.stdout:8/848: dread d3/f20 [0,4194304] 0 2023-01-04T18:17:13.696 INFO:tasks.workunit.client.0.smithi050.stdout:6/783: dread d0/d9/fa [0,4194304] 0 2023-01-04T18:17:13.699 INFO:tasks.workunit.client.0.smithi050.stdout:5/912: unlink d13/d15/d66/db8/d27/d44/df2/fff 0 2023-01-04T18:17:13.699 INFO:tasks.workunit.client.0.smithi050.stdout:2/748: creat d1/dd/d11/fff x:0 0 0 2023-01-04T18:17:13.699 INFO:tasks.workunit.client.0.smithi050.stdout:5/913: write d13/d15/d66/db8/d27/d44/d47/d124/d42/dfd/f105 [773695,33762] 0 2023-01-04T18:17:13.699 INFO:tasks.workunit.client.0.smithi050.stdout:5/914: chown d13/d15/d66/db8/d1f/d62 13398 1 2023-01-04T18:17:13.702 INFO:tasks.workunit.client.0.smithi050.stdout:6/784: creat d0/d9/d25/d40/d89/dd9/d7a/ff0 x:0 0 0 2023-01-04T18:17:13.702 INFO:tasks.workunit.client.0.smithi050.stdout:3/772: dread d0/f5e [0,4194304] 0 2023-01-04T18:17:13.703 INFO:tasks.workunit.client.0.smithi050.stdout:3/773: chown d0/dd/c6f 5 1 2023-01-04T18:17:13.703 INFO:tasks.workunit.client.0.smithi050.stdout:1/773: dwrite d8/f43 [0,4194304] 0 2023-01-04T18:17:13.703 INFO:tasks.workunit.client.0.smithi050.stdout:1/774: fdatasync d8/d48/d5c/f5e 0 2023-01-04T18:17:13.703 INFO:tasks.workunit.client.0.smithi050.stdout:1/775: chown d8/d48/d5c/d67/l87 104322 1 2023-01-04T18:17:13.706 INFO:tasks.workunit.client.0.smithi050.stdout:2/749: rename d1/dd/d62/da1/d6e/c7a to d1/d10/c100 0 2023-01-04T18:17:13.706 INFO:tasks.workunit.client.0.smithi050.stdout:2/750: dread - d1/dd/d62/da1/d4b/fcb zero size 2023-01-04T18:17:13.706 INFO:tasks.workunit.client.0.smithi050.stdout:2/751: fdatasync d1/dd/d28/d2c/d2e/d36/f51 0 2023-01-04T18:17:13.706 INFO:tasks.workunit.client.0.smithi050.stdout:2/752: chown d1/dd/d28/d79/fe8 0 1 2023-01-04T18:17:13.706 INFO:tasks.workunit.client.0.smithi050.stdout:2/753: dread - d1/dd/d28/d2c/d2e/d36/dd0/ff2 zero size 2023-01-04T18:17:13.706 INFO:tasks.workunit.client.0.smithi050.stdout:2/754: chown d1/dd/d11/d14/d91/d5a/d7f/c98 11197316 1 2023-01-04T18:17:13.710 INFO:tasks.workunit.client.0.smithi050.stdout:5/915: creat d13/d15/d66/db2/f150 x:0 0 0 2023-01-04T18:17:13.710 INFO:tasks.workunit.client.0.smithi050.stdout:5/916: readlink d13/d15/d66/db8/d27/l32 0 2023-01-04T18:17:13.717 INFO:tasks.workunit.client.0.smithi050.stdout:9/764: write d1/d3/d24/d7b/f91 [484509,7190] 0 2023-01-04T18:17:13.717 INFO:tasks.workunit.client.0.smithi050.stdout:9/765: write d1/d12/d41/d60/d95/f96 [618270,6440] 0 2023-01-04T18:17:13.721 INFO:tasks.workunit.client.0.smithi050.stdout:6/785: creat d0/d9/df/ff1 x:0 0 0 2023-01-04T18:17:13.723 INFO:tasks.workunit.client.0.smithi050.stdout:7/877: dwrite d6/fb4 [0,4194304] 0 2023-01-04T18:17:13.724 INFO:tasks.workunit.client.0.smithi050.stdout:8/849: dwrite d3/d2a/d30/d3b/d53/f113 [0,4194304] 0 2023-01-04T18:17:13.726 INFO:tasks.workunit.client.0.smithi050.stdout:2/755: rename d1/dd/d28/d2c/d2e/d36/f51 to d1/dd/d28/d2c/d2e/d36/dd0/f101 0 2023-01-04T18:17:13.727 INFO:tasks.workunit.client.0.smithi050.stdout:4/792: dwrite d14/d1b/d1f/fe8 [0,4194304] 0 2023-01-04T18:17:13.729 INFO:tasks.workunit.client.0.smithi050.stdout:5/917: mkdir d13/d15/d66/db8/d27/d44/d47/d124/d42/dec/d12b/d151 0 2023-01-04T18:17:13.737 INFO:tasks.workunit.client.0.smithi050.stdout:3/774: dwrite d0/d1b/d2f/d56/fc4 [0,4194304] 0 2023-01-04T18:17:13.741 INFO:tasks.workunit.client.0.smithi050.stdout:7/878: creat d6/db/d3a/dbd/f121 x:0 0 0 2023-01-04T18:17:13.749 INFO:tasks.workunit.client.0.smithi050.stdout:1/776: dwrite d8/d14/f74 [4194304,4194304] 0 2023-01-04T18:17:13.749 INFO:tasks.workunit.client.0.smithi050.stdout:1/777: readlink d8/d14/d1c/d28/dc7/dca/ld4 0 2023-01-04T18:17:13.749 INFO:tasks.workunit.client.0.smithi050.stdout:1/778: chown d8/d14/d1c/d28/d57/d6a/d92/dec/c9e 3662 1 2023-01-04T18:17:13.753 INFO:tasks.workunit.client.0.smithi050.stdout:2/756: creat d1/dd/d11/d14/d91/d5a/f102 x:0 0 0 2023-01-04T18:17:13.757 INFO:tasks.workunit.client.0.smithi050.stdout:4/793: getdents d14/d1b/d1f/d22/d3e/d44/d59 0 2023-01-04T18:17:13.763 INFO:tasks.workunit.client.0.smithi050.stdout:3/775: mknod d0/d8f/d46/d80/dca/c106 0 2023-01-04T18:17:13.764 INFO:tasks.workunit.client.0.smithi050.stdout:7/879: truncate d6/db/f60 1293388 0 2023-01-04T18:17:13.764 INFO:tasks.workunit.client.0.smithi050.stdout:7/880: write d6/db/d3a/fb3 [1111664,117619] 0 2023-01-04T18:17:13.766 INFO:tasks.workunit.client.0.smithi050.stdout:2/757: mknod d1/dd/d28/d79/c103 0 2023-01-04T18:17:13.766 INFO:tasks.workunit.client.0.smithi050.stdout:2/758: truncate d1/dd/d62/da1/d83/fba 949949 0 2023-01-04T18:17:13.767 INFO:tasks.workunit.client.0.smithi050.stdout:2/759: write d1/dd/d28/d2c/fc0 [3148028,39976] 0 2023-01-04T18:17:13.768 INFO:tasks.workunit.client.0.smithi050.stdout:4/794: rename d14/d1b/d1f/d22/f4e to d14/d1b/d1f/d22/d3e/d44/d59/d5f/d6f/f105 0 2023-01-04T18:17:13.769 INFO:tasks.workunit.client.0.smithi050.stdout:4/795: dread d14/f1a [0,4194304] 0 2023-01-04T18:17:13.770 INFO:tasks.workunit.client.0.smithi050.stdout:7/881: creat d6/db/d20/f122 x:0 0 0 2023-01-04T18:17:13.773 INFO:tasks.workunit.client.0.smithi050.stdout:3/776: rename d0/d1b/d2f/d56/d32 to d0/d8f/d46/dc2/d107 0 2023-01-04T18:17:13.776 INFO:tasks.workunit.client.0.smithi050.stdout:4/796: creat d14/d1b/d1f/d22/d87/de0/f106 x:0 0 0 2023-01-04T18:17:13.776 INFO:tasks.workunit.client.0.smithi050.stdout:4/797: write d14/d1b/d1f/d22/d3e/d44/d59/dca/ff4 [155507,16346] 0 2023-01-04T18:17:13.778 INFO:tasks.workunit.client.0.smithi050.stdout:3/777: rename d0/d1b/d2f/f9e to d0/d8f/d46/dc2/f108 0 2023-01-04T18:17:13.778 INFO:tasks.workunit.client.0.smithi050.stdout:8/850: dwrite d3/d2a/f90 [0,4194304] 0 2023-01-04T18:17:13.780 INFO:tasks.workunit.client.0.smithi050.stdout:4/798: creat d14/d1b/d1f/f107 x:0 0 0 2023-01-04T18:17:13.780 INFO:tasks.workunit.client.0.smithi050.stdout:4/799: write d14/d1b/d1f/d22/d3e/d44/d59/d5d/d7f/f103 [16216,98197] 0 2023-01-04T18:17:13.781 INFO:tasks.workunit.client.0.smithi050.stdout:5/918: dwrite d13/d15/d63/f136 [0,4194304] 0 2023-01-04T18:17:13.781 INFO:tasks.workunit.client.0.smithi050.stdout:5/919: fsync d13/d15/d66/db8/d27/d44/d47/d124/d42/d4a/fbf 0 2023-01-04T18:17:13.783 INFO:tasks.workunit.client.0.smithi050.stdout:3/778: creat d0/d1b/d2f/d31/f109 x:0 0 0 2023-01-04T18:17:13.784 INFO:tasks.workunit.client.0.smithi050.stdout:1/779: dwrite d8/d48/d5c/d67/d3b/db9/dde/fe0 [0,4194304] 0 2023-01-04T18:17:13.789 INFO:tasks.workunit.client.0.smithi050.stdout:7/882: dread d6/d90/de3/fb1 [0,4194304] 0 2023-01-04T18:17:13.789 INFO:tasks.workunit.client.0.smithi050.stdout:9/766: dwrite d1/d12/d3f/f83 [0,4194304] 0 2023-01-04T18:17:13.789 INFO:tasks.workunit.client.0.smithi050.stdout:6/786: dwrite d0/d9/f29 [0,4194304] 0 2023-01-04T18:17:13.789 INFO:tasks.workunit.client.0.smithi050.stdout:7/883: write d6/f23 [4343507,130718] 0 2023-01-04T18:17:13.789 INFO:tasks.workunit.client.0.smithi050.stdout:7/884: write d6/d28/d32/f52 [563854,43126] 0 2023-01-04T18:17:13.789 INFO:tasks.workunit.client.0.smithi050.stdout:7/885: readlink d6/d90/de3/d6a/d102/d105/l106 0 2023-01-04T18:17:13.798 INFO:tasks.workunit.client.0.smithi050.stdout:5/920: rename d13/d15/d66/db8/d27/dc3/lc6 to d13/d15/d66/db8/d27/dc3/l152 0 2023-01-04T18:17:13.801 INFO:tasks.workunit.client.0.smithi050.stdout:8/851: dwrite d3/d2a/d2d/f66 [0,4194304] 0 2023-01-04T18:17:13.803 INFO:tasks.workunit.client.0.smithi050.stdout:4/800: rename d14/d1b/d1f/d22/d3e/d44/d59 to d14/d1b/d1f/d22/d87/de0/d108 0 2023-01-04T18:17:13.804 INFO:tasks.workunit.client.0.smithi050.stdout:3/779: mknod d0/d1b/d2f/d56/d98/d9c/dc9/c10a 0 2023-01-04T18:17:13.804 INFO:tasks.workunit.client.0.smithi050.stdout:3/780: write d0/d8f/d46/dc2/d107/fb2 [150240,66660] 0 2023-01-04T18:17:13.804 INFO:tasks.workunit.client.0.smithi050.stdout:3/781: chown d0/d1b/d2f/d56/d98/d9c/fe5 3391017 1 2023-01-04T18:17:13.810 INFO:tasks.workunit.client.0.smithi050.stdout:2/760: dwrite d1/dd/d11/d12/fb3 [0,4194304] 0 2023-01-04T18:17:13.815 INFO:tasks.workunit.client.0.smithi050.stdout:1/780: creat d8/d48/ff0 x:0 0 0 2023-01-04T18:17:13.815 INFO:tasks.workunit.client.0.smithi050.stdout:1/781: write d8/d14/d1c/d28/d57/de6/fee [871321,113369] 0 2023-01-04T18:17:13.816 INFO:tasks.workunit.client.0.smithi050.stdout:1/782: read d8/d14/f5b [3153954,74867] 0 2023-01-04T18:17:13.821 INFO:tasks.workunit.client.0.smithi050.stdout:9/767: symlink d1/d12/d3f/de1/leb 0 2023-01-04T18:17:13.821 INFO:tasks.workunit.client.0.smithi050.stdout:9/768: write d1/d12/d41/d60/d8e/fc1 [1016797,18226] 0 2023-01-04T18:17:13.826 INFO:tasks.workunit.client.0.smithi050.stdout:6/787: mknod d0/d9/d25/d40/d89/dd9/dc0/de3/cf2 0 2023-01-04T18:17:13.826 INFO:tasks.workunit.client.0.smithi050.stdout:6/788: chown d0/d5c/db7/c79 7 1 2023-01-04T18:17:13.830 INFO:tasks.workunit.client.0.smithi050.stdout:5/921: mkdir d13/d15/d66/db8/d27/dc3/d153 0 2023-01-04T18:17:13.830 INFO:tasks.workunit.client.0.smithi050.stdout:5/922: write d13/d15/d66/f11d [965213,74575] 0 2023-01-04T18:17:13.832 INFO:tasks.workunit.client.0.smithi050.stdout:7/886: mknod d6/db/d3a/dd2/c123 0 2023-01-04T18:17:13.834 INFO:tasks.workunit.client.0.smithi050.stdout:1/783: dwrite d8/d14/f7b [0,4194304] 0 2023-01-04T18:17:13.867 INFO:tasks.workunit.client.0.smithi050.stdout:8/852: creat d3/d2a/dff/f124 x:0 0 0 2023-01-04T18:17:13.869 INFO:tasks.workunit.client.0.smithi050.stdout:4/801: rename d14/d9e/fb4 to d14/d1b/d1f/d63/dcb/f109 0 2023-01-04T18:17:13.871 INFO:tasks.workunit.client.0.smithi050.stdout:9/769: dwrite d1/d12/d41/d60/d8e/fc1 [0,4194304] 0 2023-01-04T18:17:13.871 INFO:tasks.workunit.client.0.smithi050.stdout:3/782: getdents d0/d8f 0 2023-01-04T18:17:13.890 INFO:tasks.workunit.client.0.smithi050.stdout:3/783: dwrite d0/dd/de6/ff0 [8388608,4194304] 0 2023-01-04T18:17:13.890 INFO:tasks.workunit.client.0.smithi050.stdout:3/784: readlink d0/d8f/d46/dc2/d107/dbb/ld5 0 2023-01-04T18:17:13.905 INFO:tasks.workunit.client.0.smithi050.stdout:0/651: sync 2023-01-04T18:17:13.908 INFO:tasks.workunit.client.0.smithi050.stdout:5/923: getdents d13/d15 0 2023-01-04T18:17:13.910 INFO:tasks.workunit.client.0.smithi050.stdout:7/887: mkdir d6/db/d15/d48/dc7/d124 0 2023-01-04T18:17:13.910 INFO:tasks.workunit.client.0.smithi050.stdout:7/888: chown d6 870 1 2023-01-04T18:17:13.917 INFO:tasks.workunit.client.0.smithi050.stdout:1/784: mknod d8/d48/d5c/d67/d3a/d23/cf1 0 2023-01-04T18:17:13.918 INFO:tasks.workunit.client.0.smithi050.stdout:1/785: readlink d8/d14/d1c/d28/d57/d6a/daf/lc2 0 2023-01-04T18:17:13.919 INFO:tasks.workunit.client.0.smithi050.stdout:8/853: mkdir d3/d2a/d30/d3b/d4d/d23/d31/d10d/d125 0 2023-01-04T18:17:13.926 INFO:tasks.workunit.client.0.smithi050.stdout:4/802: rmdir d14/d1b/d1f/d22/d87/de0/d108/d5d 39 2023-01-04T18:17:13.930 INFO:tasks.workunit.client.0.smithi050.stdout:9/770: rename d1/d12/d41/d60/d7c to d1/d3/dec 0 2023-01-04T18:17:13.931 INFO:tasks.workunit.client.0.smithi050.stdout:3/785: symlink d0/d1b/d2f/d56/d98/dc7/l10b 0 2023-01-04T18:17:13.932 INFO:tasks.workunit.client.0.smithi050.stdout:0/652: dwrite d0/d6/d8/f2a [0,4194304] 0 2023-01-04T18:17:13.932 INFO:tasks.workunit.client.0.smithi050.stdout:0/653: chown d0/d6/d8/d51/f7c 2642 1 2023-01-04T18:17:13.934 INFO:tasks.workunit.client.0.smithi050.stdout:5/924: dwrite d13/d15/d66/db8/d27/d78/f103 [0,4194304] 0 2023-01-04T18:17:13.934 INFO:tasks.workunit.client.0.smithi050.stdout:2/761: creat d1/dd/d11/db5/f104 x:0 0 0 2023-01-04T18:17:13.939 INFO:tasks.workunit.client.0.smithi050.stdout:1/786: creat d8/d48/d5c/d67/d3a/d23/ff2 x:0 0 0 2023-01-04T18:17:13.940 INFO:tasks.workunit.client.0.smithi050.stdout:1/787: chown d8/f12 2114 1 2023-01-04T18:17:13.940 INFO:tasks.workunit.client.0.smithi050.stdout:1/788: readlink d8/d14/d1c/l25 0 2023-01-04T18:17:13.943 INFO:tasks.workunit.client.0.smithi050.stdout:8/854: creat d3/d2a/d2d/d85/f126 x:0 0 0 2023-01-04T18:17:13.944 INFO:tasks.workunit.client.0.smithi050.stdout:9/771: dwrite d1/d12/d41/f71 [4194304,4194304] 0 2023-01-04T18:17:13.947 INFO:tasks.workunit.client.0.smithi050.stdout:7/889: rename d6/db/d20/d55 to d6/db/d15/d48/dc7/d124/d125 0 2023-01-04T18:17:13.948 INFO:tasks.workunit.client.0.smithi050.stdout:7/890: truncate d6/db/f60 2292556 0 2023-01-04T18:17:13.952 INFO:tasks.workunit.client.0.smithi050.stdout:3/786: creat d0/d1b/d2f/d56/d98/d9c/dc9/f10c x:0 0 0 2023-01-04T18:17:13.952 INFO:tasks.workunit.client.0.smithi050.stdout:3/787: fdatasync d0/f40 0 2023-01-04T18:17:13.954 INFO:tasks.workunit.client.0.smithi050.stdout:0/654: getdents d0/d73/d68 0 2023-01-04T18:17:13.959 INFO:tasks.workunit.client.0.smithi050.stdout:9/772: dread d1/d12/f5f [0,4194304] 0 2023-01-04T18:17:13.964 INFO:tasks.workunit.client.0.smithi050.stdout:5/925: mkdir d13/d15/d66/db8/d27/d44/d47/d124/d59/d87/dbe/d154 0 2023-01-04T18:17:13.966 INFO:tasks.workunit.client.0.smithi050.stdout:1/789: mkdir d8/d14/d1c/d28/d57/d6a/d92/dec/df3 0 2023-01-04T18:17:13.969 INFO:tasks.workunit.client.0.smithi050.stdout:8/855: stat d3/d2a/d30/d3b/d4d/d23/d31/ca7 0 2023-01-04T18:17:13.970 INFO:tasks.workunit.client.0.smithi050.stdout:1/790: write d8/d48/d5c/f6c [3941237,104223] 0 2023-01-04T18:17:13.974 INFO:tasks.workunit.client.0.smithi050.stdout:3/788: dread d0/d8f/d46/dc2/d107/f49 [0,4194304] 0 2023-01-04T18:17:13.974 INFO:tasks.workunit.client.0.smithi050.stdout:3/789: write d0/d1b/d2f/d56/d98/d9c/dc9/f10c [1037800,72038] 0 2023-01-04T18:17:13.974 INFO:tasks.workunit.client.0.smithi050.stdout:3/790: chown d0/d8f/deb/d7f/c94 85723091 1 2023-01-04T18:17:13.974 INFO:tasks.workunit.client.0.smithi050.stdout:4/803: rename d14/d1b/f52 to d14/d1b/d1f/d22/d87/de0/d108/d5f/d80/d9d/f10a 0 2023-01-04T18:17:13.978 INFO:tasks.workunit.client.0.smithi050.stdout:6/789: sync 2023-01-04T18:17:13.978 INFO:tasks.workunit.client.0.smithi050.stdout:7/891: rmdir d6/db 39 2023-01-04T18:17:13.981 INFO:tasks.workunit.client.0.smithi050.stdout:0/655: creat d0/d6/d28/d1a/d8a/d9e/fd0 x:0 0 0 2023-01-04T18:17:13.982 INFO:tasks.workunit.client.0.smithi050.stdout:0/656: read - d0/d73/d79/fc4 zero size 2023-01-04T18:17:13.982 INFO:tasks.workunit.client.0.smithi050.stdout:9/773: dwrite d1/d12/d9f/fd8 [0,4194304] 0 2023-01-04T18:17:13.982 INFO:tasks.workunit.client.0.smithi050.stdout:9/774: chown d1/d12/d41/l6a 48101 1 2023-01-04T18:17:13.983 INFO:tasks.workunit.client.0.smithi050.stdout:9/775: fsync d1/d12/d41/d60/fa2 0 2023-01-04T18:17:13.984 INFO:tasks.workunit.client.0.smithi050.stdout:8/856: mkdir d3/d2a/d30/d3b/d4d/d23/d55/d5f/d82/dcb/d127 0 2023-01-04T18:17:13.985 INFO:tasks.workunit.client.0.smithi050.stdout:8/857: read d3/d2a/d60/f40 [1545966,76119] 0 2023-01-04T18:17:13.988 INFO:tasks.workunit.client.0.smithi050.stdout:1/791: symlink d8/d14/d1c/lf4 0 2023-01-04T18:17:13.988 INFO:tasks.workunit.client.0.smithi050.stdout:1/792: fsync d8/d48/d5c/d67/f33 0 2023-01-04T18:17:13.988 INFO:tasks.workunit.client.0.smithi050.stdout:1/793: chown f6 15 1 2023-01-04T18:17:13.992 INFO:tasks.workunit.client.0.smithi050.stdout:0/657: read d0/d73/f61 [7192212,60600] 0 2023-01-04T18:17:14.000 INFO:tasks.workunit.client.0.smithi050.stdout:5/926: dwrite d13/d15/d66/db8/d27/d44/d47/d124/d42/d4a/f5a [0,4194304] 0 2023-01-04T18:17:14.008 INFO:tasks.workunit.client.0.smithi050.stdout:7/892: dwrite d6/d90/de3/f6f [0,4194304] 0 2023-01-04T18:17:14.009 INFO:tasks.workunit.client.0.smithi050.stdout:6/790: dwrite d0/d9/d25/f9a [4194304,4194304] 0 2023-01-04T18:17:14.011 INFO:tasks.workunit.client.0.smithi050.stdout:1/794: dwrite d8/d14/d1c/d28/d57/de6/fee [0,4194304] 0 2023-01-04T18:17:14.012 INFO:tasks.workunit.client.0.smithi050.stdout:3/791: creat d0/d10/f10d x:0 0 0 2023-01-04T18:17:14.015 INFO:tasks.workunit.client.0.smithi050.stdout:2/762: rename d1/dd/d11/d14/f8b to d1/dd/d28/d2c/d66/f105 0 2023-01-04T18:17:14.015 INFO:tasks.workunit.client.0.smithi050.stdout:2/763: write d1/d41/fc3 [1007339,24060] 0 2023-01-04T18:17:14.017 INFO:tasks.workunit.client.0.smithi050.stdout:4/804: mkdir d14/d1b/d1f/d22/d87/de0/d108/d5f/d80/d10b 0 2023-01-04T18:17:14.017 INFO:tasks.workunit.client.0.smithi050.stdout:4/805: fsync d14/d1b/d66/feb 0 2023-01-04T18:17:14.020 INFO:tasks.workunit.client.0.smithi050.stdout:2/764: dread d1/d10/f4e [0,4194304] 0 2023-01-04T18:17:14.020 INFO:tasks.workunit.client.0.smithi050.stdout:8/858: symlink d3/d2a/d2d/d86/dd1/l128 0 2023-01-04T18:17:14.030 INFO:tasks.workunit.client.0.smithi050.stdout:6/791: dwrite d0/d9/f4b [4194304,4194304] 0 2023-01-04T18:17:14.031 INFO:tasks.workunit.client.0.smithi050.stdout:7/893: dwrite d6/db/d15/d1b/d70/f85 [0,4194304] 0 2023-01-04T18:17:14.042 INFO:tasks.workunit.client.0.smithi050.stdout:7/894: dread d6/db/d15/d1b/f21 [0,4194304] 0 2023-01-04T18:17:14.042 INFO:tasks.workunit.client.0.smithi050.stdout:7/895: write d6/d28/d32/f4e [1944097,92961] 0 2023-01-04T18:17:14.042 INFO:tasks.workunit.client.0.smithi050.stdout:7/896: write d6/f7c [4745,45296] 0 2023-01-04T18:17:14.042 INFO:tasks.workunit.client.0.smithi050.stdout:7/897: write d6/db/d20/d4f/d6e/fd0 [127290,130663] 0 2023-01-04T18:17:14.096 INFO:tasks.workunit.client.0.smithi050.stdout:0/658: creat d0/d9f/da1/fd1 x:0 0 0 2023-01-04T18:17:14.096 INFO:tasks.workunit.client.0.smithi050.stdout:0/659: chown d0/d73/lb3 9378 1 2023-01-04T18:17:14.112 INFO:tasks.workunit.client.0.smithi050.stdout:0/660: dwrite d0/d6/d28/d1a/f40 [0,4194304] 0 2023-01-04T18:17:14.112 INFO:tasks.workunit.client.0.smithi050.stdout:1/795: truncate d8/d14/d1c/fb1 4855055 0 2023-01-04T18:17:14.120 INFO:tasks.workunit.client.0.smithi050.stdout:1/796: dread d8/d14/d1c/d28/d57/de6/fee [0,4194304] 0 2023-01-04T18:17:14.129 INFO:tasks.workunit.client.0.smithi050.stdout:5/927: rename d13/d15/d66/db8/d27/d44/d47/d124/d59/fd8 to d13/d15/d66/db8/f155 0 2023-01-04T18:17:14.137 INFO:tasks.workunit.client.0.smithi050.stdout:8/859: truncate d3/d2a/d30/d3b/d4d/d23/d55/d5f/d82/dcb/fe6 1294556 0 2023-01-04T18:17:14.137 INFO:tasks.workunit.client.0.smithi050.stdout:8/860: dread - d3/d2a/d27/d93/d7f/d96/d46/ffa zero size 2023-01-04T18:17:14.137 INFO:tasks.workunit.client.0.smithi050.stdout:8/861: chown d3/d2a/d30/d3b/d4d/d23/d55/d5f/fbf 996 1 2023-01-04T18:17:14.137 INFO:tasks.workunit.client.0.smithi050.stdout:8/862: fsync d3/d2a/d30/d3b/d4d/d23/d55/d5f/fbf 0 2023-01-04T18:17:14.143 INFO:tasks.workunit.client.0.smithi050.stdout:6/792: symlink d0/d9/d25/d40/d89/dd9/d7a/lf3 0 2023-01-04T18:17:14.148 INFO:tasks.workunit.client.0.smithi050.stdout:5/928: dwrite d13/d15/d66/db8/d27/d44/d47/d124/d42/d4a/fd6 [0,4194304] 0 2023-01-04T18:17:14.149 INFO:tasks.workunit.client.0.smithi050.stdout:5/929: fdatasync d13/d15/d66/db8/d27/f2b 0 2023-01-04T18:17:14.157 INFO:tasks.workunit.client.0.smithi050.stdout:5/930: dread d13/d15/d63/f136 [0,4194304] 0 2023-01-04T18:17:14.158 INFO:tasks.workunit.client.0.smithi050.stdout:0/661: mkdir d0/d6/d8/d35/dd2 0 2023-01-04T18:17:14.160 INFO:tasks.workunit.client.0.smithi050.stdout:2/765: rename d1/dd/d11/d12/ccd to d1/dd/d11/d14/d91/d5a/d7f/df5/c106 0 2023-01-04T18:17:14.160 INFO:tasks.workunit.client.0.smithi050.stdout:2/766: chown d1/dd/d28/df4 18949802 1 2023-01-04T18:17:14.160 INFO:tasks.workunit.client.0.smithi050.stdout:2/767: dread - d1/dd/d62/da1/d4b/fe9 zero size 2023-01-04T18:17:14.164 INFO:tasks.workunit.client.0.smithi050.stdout:7/898: link d6/db/d15/d48/dc7/cfe d6/d28/c126 0 2023-01-04T18:17:14.164 INFO:tasks.workunit.client.0.smithi050.stdout:8/863: dwrite d3/d2a/d74/d92/d94/dc9/ffe [0,4194304] 0 2023-01-04T18:17:14.173 INFO:tasks.workunit.client.0.smithi050.stdout:5/931: dread d13/d15/d66/db8/d27/d46/f94 [0,4194304] 0 2023-01-04T18:17:14.173 INFO:tasks.workunit.client.0.smithi050.stdout:6/793: dwrite d0/d9/d25/fef [0,4194304] 0 2023-01-04T18:17:14.173 INFO:tasks.workunit.client.0.smithi050.stdout:5/932: chown d13/d15/d66/fac 130374 1 2023-01-04T18:17:14.178 INFO:tasks.workunit.client.0.smithi050.stdout:2/768: dwrite d1/dd/d38/fee [0,4194304] 0 2023-01-04T18:17:14.191 INFO:tasks.workunit.client.0.smithi050.stdout:1/797: rename d8/l3c to d8/d14/lf5 0 2023-01-04T18:17:14.198 INFO:tasks.workunit.client.0.smithi050.stdout:2/769: dwrite d1/dd/d28/fe0 [0,4194304] 0 2023-01-04T18:17:14.267 INFO:tasks.workunit.client.0.smithi050.stdout:1/798: dwrite d8/d14/f82 [0,4194304] 0 2023-01-04T18:17:14.270 INFO:tasks.workunit.client.0.smithi050.stdout:1/799: write d8/d14/d1c/f5d [1869612,6940] 0 2023-01-04T18:17:14.270 INFO:tasks.workunit.client.0.smithi050.stdout:1/800: readlink d8/d48/l75 0 2023-01-04T18:17:14.270 INFO:tasks.workunit.client.0.smithi050.stdout:7/899: mkdir d6/ded/d127 0 2023-01-04T18:17:14.272 INFO:tasks.workunit.client.0.smithi050.stdout:8/864: rmdir d3/d2a/d27/deb 39 2023-01-04T18:17:14.273 INFO:tasks.workunit.client.0.smithi050.stdout:2/770: dwrite d1/dd/d62/da1/f7d [0,4194304] 0 2023-01-04T18:17:14.273 INFO:tasks.workunit.client.0.smithi050.stdout:2/771: dread - d1/dd/d28/d2c/d66/f105 zero size 2023-01-04T18:17:14.274 INFO:tasks.workunit.client.0.smithi050.stdout:2/772: truncate d1/dd/f4a 3862078 0 2023-01-04T18:17:14.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:17:12.865894+0000 mgr.smithi098.vhfzum (mgr.24455) 50 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:17:14.322 INFO:tasks.workunit.client.0.smithi050.stdout:5/933: symlink d13/d15/d66/db8/d27/d44/d47/d124/d42/l156 0 2023-01-04T18:17:14.323 INFO:tasks.workunit.client.0.smithi050.stdout:5/934: read d13/d15/f26 [572681,47457] 0 2023-01-04T18:17:14.327 INFO:tasks.workunit.client.0.smithi050.stdout:3/792: sync 2023-01-04T18:17:14.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:17:12.865894+0000 mgr.smithi098.vhfzum (mgr.24455) 50 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:17:14.339 INFO:tasks.workunit.client.0.smithi050.stdout:9/776: sync 2023-01-04T18:17:14.346 INFO:tasks.workunit.client.0.smithi050.stdout:7/900: symlink d6/db/d3a/dd2/d10f/l128 0 2023-01-04T18:17:14.347 INFO:tasks.workunit.client.0.smithi050.stdout:7/901: write d6/db/d3a/fb3 [505855,90196] 0 2023-01-04T18:17:14.351 INFO:tasks.workunit.client.0.smithi050.stdout:7/902: write d6/d90/de3/fc0 [1442727,123340] 0 2023-01-04T18:17:14.352 INFO:tasks.workunit.client.0.smithi050.stdout:8/865: rename d3/d2a/d2d/d85 to d3/d2a/d74/d118/d129 0 2023-01-04T18:17:14.352 INFO:tasks.workunit.client.0.smithi050.stdout:8/866: stat d3/d2a/d2d/d86/d11c 0 2023-01-04T18:17:14.352 INFO:tasks.workunit.client.0.smithi050.stdout:8/867: dread - d3/d2a/d30/d3b/d4d/d23/d55/d5f/f103 zero size 2023-01-04T18:17:14.352 INFO:tasks.workunit.client.0.smithi050.stdout:8/868: write d3/d2a/d2d/f70 [12820756,19911] 0 2023-01-04T18:17:14.355 INFO:tasks.workunit.client.0.smithi050.stdout:2/773: rmdir d1/dd 39 2023-01-04T18:17:14.355 INFO:tasks.workunit.client.0.smithi050.stdout:2/774: fdatasync d1/dd/d11/d14/f30 0 2023-01-04T18:17:14.355 INFO:tasks.workunit.client.0.smithi050.stdout:7/903: dread d6/d28/f3d [0,4194304] 0 2023-01-04T18:17:14.365 INFO:tasks.workunit.client.0.smithi050.stdout:3/793: mkdir d0/d1b/d2f/d56/d98/d9c/dcd/d10e 0 2023-01-04T18:17:14.366 INFO:tasks.workunit.client.0.smithi050.stdout:3/794: chown d0/d1a/c2b 5147110 1 2023-01-04T18:17:14.367 INFO:tasks.workunit.client.0.smithi050.stdout:9/777: mknod d1/d12/d2d/d39/ced 0 2023-01-04T18:17:14.373 INFO:tasks.workunit.client.0.smithi050.stdout:5/935: dwrite d13/d28/f93 [0,4194304] 0 2023-01-04T18:17:14.376 INFO:tasks.workunit.client.0.smithi050.stdout:8/869: rmdir d3/d2a/d30/d3b/d4d/d23/d31/d10d/d125 0 2023-01-04T18:17:14.378 INFO:tasks.workunit.client.0.smithi050.stdout:2/775: creat d1/dd/d11/db5/df8/f107 x:0 0 0 2023-01-04T18:17:14.380 INFO:tasks.workunit.client.0.smithi050.stdout:9/778: mknod d1/d3/cee 0 2023-01-04T18:17:14.381 INFO:tasks.workunit.client.0.smithi050.stdout:3/795: dread d0/d1b/d2f/fb7 [0,4194304] 0 2023-01-04T18:17:14.382 INFO:tasks.workunit.client.0.smithi050.stdout:4/806: sync 2023-01-04T18:17:14.382 INFO:tasks.workunit.client.0.smithi050.stdout:4/807: readlink d14/d1b/d1f/l2d 0 2023-01-04T18:17:14.382 INFO:tasks.workunit.client.0.smithi050.stdout:7/904: dwrite d6/db/d15/d48/dc7/d124/d125/f5e [0,4194304] 0 2023-01-04T18:17:14.387 INFO:tasks.workunit.client.0.smithi050.stdout:5/936: dread d13/d15/d63/fe5 [0,4194304] 0 2023-01-04T18:17:14.387 INFO:tasks.workunit.client.0.smithi050.stdout:5/937: chown d13/d28/f36 187801 1 2023-01-04T18:17:14.387 INFO:tasks.workunit.client.0.smithi050.stdout:5/938: chown d13/d15/c14b 290 1 2023-01-04T18:17:14.387 INFO:tasks.workunit.client.0.smithi050.stdout:5/939: dread - d13/d15/d66/db8/d27/d46/f11a zero size 2023-01-04T18:17:14.387 INFO:tasks.workunit.client.0.smithi050.stdout:5/940: write d13/d15/f26 [739091,9935] 0 2023-01-04T18:17:14.412 INFO:tasks.workunit.client.0.smithi050.stdout:8/870: link d3/d2a/d27/d93/d7f/d96/d46/f4a d3/d2a/d27/d8b/d9f/f12a 0 2023-01-04T18:17:14.412 INFO:tasks.workunit.client.0.smithi050.stdout:8/871: write d3/d2a/d74/d92/d94/fed [655572,31955] 0 2023-01-04T18:17:14.414 INFO:tasks.workunit.client.0.smithi050.stdout:9/779: rmdir d1/d3/d13/d77 39 2023-01-04T18:17:14.414 INFO:tasks.workunit.client.0.smithi050.stdout:9/780: stat d1/d12/d41/d60/c6b 0 2023-01-04T18:17:14.417 INFO:tasks.workunit.client.0.smithi050.stdout:3/796: unlink d0/d8f/deb/d7f/cc8 0 2023-01-04T18:17:14.533 INFO:tasks.workunit.client.0.smithi050.stdout:4/808: truncate d14/d1b/f2f 2288501 0 2023-01-04T18:17:14.533 INFO:tasks.workunit.client.0.smithi050.stdout:4/809: readlink d14/la7 0 2023-01-04T18:17:14.540 INFO:tasks.workunit.client.0.smithi050.stdout:7/905: rename d6/db/d20/l6d to d6/db/d3a/dbd/l129 0 2023-01-04T18:17:14.541 INFO:tasks.workunit.client.0.smithi050.stdout:5/941: truncate d13/d15/d66/db8/d27/d44/d47/d124/d42/d4a/fd6 1452848 0 2023-01-04T18:17:14.548 INFO:tasks.workunit.client.0.smithi050.stdout:3/797: mkdir d0/d8f/d46/dc2/d10f 0 2023-01-04T18:17:14.552 INFO:tasks.workunit.client.0.smithi050.stdout:7/906: creat d6/db/d15/d2e/d66/f12a x:0 0 0 2023-01-04T18:17:14.553 INFO:tasks.workunit.client.0.smithi050.stdout:4/810: dwrite d14/d1b/d32/fd1 [0,4194304] 0 2023-01-04T18:17:14.563 INFO:tasks.workunit.client.0.smithi050.stdout:5/942: symlink d13/d15/d66/db8/d27/d44/d47/d124/d42/dec/l157 0 2023-01-04T18:17:14.565 INFO:tasks.workunit.client.0.smithi050.stdout:9/781: dread d1/d12/d2d/d39/f66 [0,4194304] 0 2023-01-04T18:17:14.566 INFO:tasks.workunit.client.0.smithi050.stdout:3/798: mknod d0/d8f/d46/dc2/c110 0 2023-01-04T18:17:14.568 INFO:tasks.workunit.client.0.smithi050.stdout:7/907: mkdir d6/db/d3b/d12b 0 2023-01-04T18:17:14.570 INFO:tasks.workunit.client.0.smithi050.stdout:3/799: read d0/d1b/d2f/d31/f41 [3176444,76357] 0 2023-01-04T18:17:14.577 INFO:tasks.workunit.client.0.smithi050.stdout:4/811: rmdir d14/d1b/d1f/d63/da5/db6 39 2023-01-04T18:17:14.579 INFO:tasks.workunit.client.0.smithi050.stdout:5/943: dwrite d13/d15/d66/db8/d27/f109 [0,4194304] 0 2023-01-04T18:17:14.580 INFO:tasks.workunit.client.0.smithi050.stdout:9/782: creat d1/d12/d2d/d39/fef x:0 0 0 2023-01-04T18:17:14.581 INFO:tasks.workunit.client.0.smithi050.stdout:1/801: sync 2023-01-04T18:17:14.581 INFO:tasks.workunit.client.0.smithi050.stdout:0/662: sync 2023-01-04T18:17:14.581 INFO:tasks.workunit.client.0.smithi050.stdout:6/794: sync 2023-01-04T18:17:14.590 INFO:tasks.workunit.client.0.smithi050.stdout:7/908: rename d6/db/d15/d1b/d70/ff8 to d6/db/d3a/dd2/f12c 0 2023-01-04T18:17:14.591 INFO:tasks.workunit.client.0.smithi050.stdout:3/800: dwrite d0/d10/f42 [0,4194304] 0 2023-01-04T18:17:14.592 INFO:tasks.workunit.client.0.smithi050.stdout:7/909: write d6/db/f2a [3569694,64455] 0 2023-01-04T18:17:14.595 INFO:tasks.workunit.client.0.smithi050.stdout:0/663: dwrite d0/d73/d68/fab [0,4194304] 0 2023-01-04T18:17:14.595 INFO:tasks.workunit.client.0.smithi050.stdout:5/944: chown d13/d15/d66/db8/d27/d46/d4e/d4d/ld1 20215402 1 2023-01-04T18:17:14.598 INFO:tasks.workunit.client.0.smithi050.stdout:9/783: symlink d1/d12/d41/d60/d95/lf0 0 2023-01-04T18:17:14.598 INFO:tasks.workunit.client.0.smithi050.stdout:9/784: truncate d1/d12/d2d/f85 4860765 0 2023-01-04T18:17:14.598 INFO:tasks.workunit.client.0.smithi050.stdout:9/785: getdents d1/d3/ddc 0 2023-01-04T18:17:14.606 INFO:tasks.workunit.client.0.smithi050.stdout:1/802: creat d8/d48/d5c/d67/d3a/dd1/ff6 x:0 0 0 2023-01-04T18:17:14.607 INFO:tasks.workunit.client.0.smithi050.stdout:6/795: rename d0/d9/d25/d40/d89/cc2 to d0/d9/df/dba/dca/d77/cf4 0 2023-01-04T18:17:14.607 INFO:tasks.workunit.client.0.smithi050.stdout:6/796: write d0/d4a/d93/faa [616806,74964] 0 2023-01-04T18:17:14.607 INFO:tasks.workunit.client.0.smithi050.stdout:6/797: fdatasync d0/d9/d25/d4d/f6e 0 2023-01-04T18:17:14.607 INFO:tasks.workunit.client.0.smithi050.stdout:6/798: chown d0/d5c/db7/d83 123215 1 2023-01-04T18:17:14.610 INFO:tasks.workunit.client.0.smithi050.stdout:4/812: dread d14/d1b/d1f/d22/d87/de0/d108/d5f/d80/d9d/ffb [0,4194304] 0 2023-01-04T18:17:14.610 INFO:tasks.workunit.client.0.smithi050.stdout:4/813: chown d14/d1b/d1f/d22/d87/de0/d108/d5f/d80/fdc 29 1 2023-01-04T18:17:14.615 INFO:tasks.workunit.client.0.smithi050.stdout:5/945: dwrite d13/d15/d66/db8/d27/d46/f11a [0,4194304] 0 2023-01-04T18:17:14.615 INFO:tasks.workunit.client.0.smithi050.stdout:5/946: chown d13/d15/d66/db8/d27/d44/d101/f13a 7159039 1 2023-01-04T18:17:14.615 INFO:tasks.workunit.client.0.smithi050.stdout:5/947: truncate d13/d15/d66/db8/d27/d78/f9a 4870154 0 2023-01-04T18:17:14.615 INFO:tasks.workunit.client.0.smithi050.stdout:7/910: mknod d6/db/d15/d1b/c12d 0 2023-01-04T18:17:14.619 INFO:tasks.workunit.client.0.smithi050.stdout:3/801: dwrite d0/d10/f16 [4194304,4194304] 0 2023-01-04T18:17:14.621 INFO:tasks.workunit.client.0.smithi050.stdout:0/664: unlink d0/lc6 0 2023-01-04T18:17:14.622 INFO:tasks.workunit.client.0.smithi050.stdout:1/803: dwrite d8/d14/d1c/d28/d57/d6a/d92/fae [4194304,4194304] 0 2023-01-04T18:17:14.622 INFO:tasks.workunit.client.0.smithi050.stdout:1/804: readlink d8/d14/d1c/d28/d57/d6a/lcf 0 2023-01-04T18:17:14.623 INFO:tasks.workunit.client.0.smithi050.stdout:9/786: creat d1/d12/d41/d60/d95/ff1 x:0 0 0 2023-01-04T18:17:14.623 INFO:tasks.workunit.client.0.smithi050.stdout:1/805: dread d8/d48/d5c/d67/d91/fa3 [0,4194304] 0 2023-01-04T18:17:14.624 INFO:tasks.workunit.client.0.smithi050.stdout:6/799: rmdir d0/d9/df/dba/dca/d6b 39 2023-01-04T18:17:14.627 INFO:tasks.workunit.client.0.smithi050.stdout:4/814: unlink d14/d1b/d1f/d22/d87/de0/d108/d5f/ff7 0 2023-01-04T18:17:14.637 INFO:tasks.workunit.client.0.smithi050.stdout:5/948: symlink d13/d15/d66/db8/d1f/d62/l158 0 2023-01-04T18:17:14.642 INFO:tasks.workunit.client.0.smithi050.stdout:7/911: mkdir d6/db/d15/d1b/d70/d12e 0 2023-01-04T18:17:14.649 INFO:tasks.workunit.client.0.smithi050.stdout:3/802: getdents d0/d1a/dc3 0 2023-01-04T18:17:14.657 INFO:tasks.workunit.client.0.smithi050.stdout:2/776: sync 2023-01-04T18:17:14.660 INFO:tasks.workunit.client.0.smithi050.stdout:9/787: rename d1/d12/d41/d60/c6b to d1/d12/d9f/cf2 0 2023-01-04T18:17:14.661 INFO:tasks.workunit.client.0.smithi050.stdout:8/872: sync 2023-01-04T18:17:14.663 INFO:tasks.workunit.client.0.smithi050.stdout:1/806: mknod d8/d14/d1c/d28/d57/cf7 0 2023-01-04T18:17:14.665 INFO:tasks.workunit.client.0.smithi050.stdout:6/800: creat d0/d5c/ff5 x:0 0 0 2023-01-04T18:17:14.667 INFO:tasks.workunit.client.0.smithi050.stdout:4/815: creat d14/d1b/d1f/d22/d87/de0/d108/d5f/d80/f10c x:0 0 0 2023-01-04T18:17:14.669 INFO:tasks.workunit.client.0.smithi050.stdout:5/949: mkdir d13/d15/d63/dc0/d159 0 2023-01-04T18:17:14.671 INFO:tasks.workunit.client.0.smithi050.stdout:7/912: creat d6/db/f12f x:0 0 0 2023-01-04T18:17:14.671 INFO:tasks.workunit.client.0.smithi050.stdout:7/913: chown d6/db/d15/d48/dc7/d124/d125/f5e 44 1 2023-01-04T18:17:14.671 INFO:tasks.workunit.client.0.smithi050.stdout:7/914: write d6/d6b/d8b/fd9 [819226,14803] 0 2023-01-04T18:17:14.672 INFO:tasks.workunit.client.0.smithi050.stdout:7/915: write d6/f7c [297888,59468] 0 2023-01-04T18:17:14.673 INFO:tasks.workunit.client.0.smithi050.stdout:3/803: mkdir d0/d1b/d2f/d56/d98/d9c/dcd/d111 0 2023-01-04T18:17:14.675 INFO:tasks.workunit.client.0.smithi050.stdout:0/665: dread d0/d9f/d84/fb8 [0,4194304] 0 2023-01-04T18:17:14.678 INFO:tasks.workunit.client.0.smithi050.stdout:2/777: link d1/dd/d28/d2c/d2e/d36/lc2 d1/l108 0 2023-01-04T18:17:14.678 INFO:tasks.workunit.client.0.smithi050.stdout:2/778: fsync d1/fd2 0 2023-01-04T18:17:14.678 INFO:tasks.workunit.client.0.smithi050.stdout:2/779: fdatasync d1/dd/d62/f77 0 2023-01-04T18:17:14.681 INFO:tasks.workunit.client.0.smithi050.stdout:9/788: mkdir d1/d3/df3 0 2023-01-04T18:17:14.686 INFO:tasks.workunit.client.0.smithi050.stdout:1/807: link d8/d14/d1c/f73 d8/d48/d5c/d67/d3b/d84/ff8 0 2023-01-04T18:17:14.688 INFO:tasks.workunit.client.0.smithi050.stdout:4/816: creat d14/d1b/d1f/d22/d3e/d8a/f10d x:0 0 0 2023-01-04T18:17:14.691 INFO:tasks.workunit.client.0.smithi050.stdout:5/950: mkdir d13/d15/d66/db8/d27/d44/d47/d15a 0 2023-01-04T18:17:14.691 INFO:tasks.workunit.client.0.smithi050.stdout:5/951: truncate d13/d15/d66/db8/d27/d78/f146 365062 0 2023-01-04T18:17:14.691 INFO:tasks.workunit.client.0.smithi050.stdout:5/952: fsync d13/d15/d66/db8/d27/d44/d47/d124/d42/d4a/d8e/f129 0 2023-01-04T18:17:14.691 INFO:tasks.workunit.client.0.smithi050.stdout:5/953: truncate d13/d15/d66/db8/d27/d78/f128 949640 0 2023-01-04T18:17:14.691 INFO:tasks.workunit.client.0.smithi050.stdout:5/954: stat d13/d15/d66/db8/d27/d44/f82 0 2023-01-04T18:17:14.692 INFO:tasks.workunit.client.0.smithi050.stdout:5/955: write d13/d15/d66/db8/d27/d44/d47/d124/d42/d4a/f5a [3521340,60697] 0 2023-01-04T18:17:14.693 INFO:tasks.workunit.client.0.smithi050.stdout:8/873: dwrite d3/d2a/d27/dc1/ff3 [0,4194304] 0 2023-01-04T18:17:14.693 INFO:tasks.workunit.client.0.smithi050.stdout:7/916: creat d6/db/d3a/dd2/d10f/f130 x:0 0 0 2023-01-04T18:17:14.696 INFO:tasks.workunit.client.0.smithi050.stdout:3/804: mkdir d0/d1b/d2f/d56/d98/d9c/dcd/d10e/d112 0 2023-01-04T18:17:14.697 INFO:tasks.workunit.client.0.smithi050.stdout:3/805: chown d0/d10 653775 1 2023-01-04T18:17:14.697 INFO:tasks.workunit.client.0.smithi050.stdout:0/666: getdents d0/d6/d28/d1a 0 2023-01-04T18:17:14.699 INFO:tasks.workunit.client.0.smithi050.stdout:6/801: dwrite d0/d9/d25/d40/d89/dd9/d7a/ff0 [0,4194304] 0 2023-01-04T18:17:14.701 INFO:tasks.workunit.client.0.smithi050.stdout:9/789: dwrite d1/d3/d24/d7b/f91 [0,4194304] 0 2023-01-04T18:17:14.701 INFO:tasks.workunit.client.0.smithi050.stdout:9/790: readlink d1/d3/d24/d7b/laf 0 2023-01-04T18:17:14.701 INFO:tasks.workunit.client.0.smithi050.stdout:9/791: fdatasync d1/d3/d13/f8d 0 2023-01-04T18:17:14.728 INFO:tasks.workunit.client.0.smithi050.stdout:2/780: dwrite d1/dd/d11/f9c [0,4194304] 0 2023-01-04T18:17:14.731 INFO:tasks.workunit.client.0.smithi050.stdout:9/792: dwrite d1/d3/f18 [0,4194304] 0 2023-01-04T18:17:14.743 INFO:tasks.workunit.client.0.smithi050.stdout:1/808: getdents d8/d14/d1c/d28/dc7/dd6 0 2023-01-04T18:17:14.745 INFO:tasks.workunit.client.0.smithi050.stdout:4/817: creat d14/d1b/d1f/d22/d87/de0/d108/d5f/f10e x:0 0 0 2023-01-04T18:17:14.752 INFO:tasks.workunit.client.0.smithi050.stdout:5/956: link d13/d15/d66/db8/d27/d44/cfa d13/d15/d66/db8/d27/d44/d47/d124/d42/dec/d12b/c15b 0 2023-01-04T18:17:14.752 INFO:tasks.workunit.client.0.smithi050.stdout:5/957: chown d13/d15/d66/db8/l48 22612909 1 2023-01-04T18:17:14.757 INFO:tasks.workunit.client.0.smithi050.stdout:8/874: symlink d3/d2a/d74/d118/l12b 0 2023-01-04T18:17:14.758 INFO:tasks.workunit.client.0.smithi050.stdout:8/875: write d3/d2a/d27/d8b/fab [1743005,46701] 0 2023-01-04T18:17:14.763 INFO:tasks.workunit.client.0.smithi050.stdout:3/806: unlink d0/d8f/d46/dc2/lce 0 2023-01-04T18:17:14.763 INFO:tasks.workunit.client.0.smithi050.stdout:3/807: read - d0/d1b/d2f/d56/d98/d9c/fe5 zero size 2023-01-04T18:17:14.763 INFO:tasks.workunit.client.0.smithi050.stdout:3/808: getdents d0/d8f/deb/dcb 0 2023-01-04T18:17:14.776 INFO:tasks.workunit.client.0.smithi050.stdout:6/802: mkdir d0/d9/df/dba/dca/d6b/da4/dab/dec/df6 0 2023-01-04T18:17:14.792 INFO:tasks.workunit.client.0.smithi050.stdout:6/803: dwrite d0/d5c/db7/f8a [4194304,4194304] 0 2023-01-04T18:17:14.792 INFO:tasks.workunit.client.0.smithi050.stdout:2/781: symlink d1/dd/d28/d2c/d66/l109 0 2023-01-04T18:17:14.793 INFO:tasks.workunit.client.0.smithi050.stdout:2/782: write d1/dd/d11/d14/d44/fb7 [964150,84408] 0 2023-01-04T18:17:14.793 INFO:tasks.workunit.client.0.smithi050.stdout:2/783: fsync d1/dd/d28/d2c/d2e/d3f/f64 0 2023-01-04T18:17:14.798 INFO:tasks.workunit.client.0.smithi050.stdout:9/793: creat d1/d3/d13/d77/ff4 x:0 0 0 2023-01-04T18:17:14.798 INFO:tasks.workunit.client.0.smithi050.stdout:9/794: truncate d1/d3/d11/d1f/f4e 4494571 0 2023-01-04T18:17:14.798 INFO:tasks.workunit.client.0.smithi050.stdout:9/795: dread - d1/d12/d2d/fce zero size 2023-01-04T18:17:14.800 INFO:tasks.workunit.client.0.smithi050.stdout:1/809: unlink d8/f89 0 2023-01-04T18:17:14.802 INFO:tasks.workunit.client.0.smithi050.stdout:4/818: truncate d14/d1b/d1f/d63/f71 3771484 0 2023-01-04T18:17:14.828 INFO:tasks.workunit.client.0.smithi050.stdout:5/958: write d13/d15/d66/db8/d27/d46/d4e/d4d/faf [867504,94071] 0 2023-01-04T18:17:14.862 INFO:tasks.workunit.client.0.smithi050.stdout:8/876: mkdir d3/d2a/d2d/d86/d12c 0 2023-01-04T18:17:14.863 INFO:tasks.workunit.client.0.smithi050.stdout:3/809: symlink d0/d10/d101/l113 0 2023-01-04T18:17:14.865 INFO:tasks.workunit.client.0.smithi050.stdout:0/667: link d0/d6/d28/d1a/l83 d0/ld3 0 2023-01-04T18:17:14.868 INFO:tasks.workunit.client.0.smithi050.stdout:6/804: link d0/d9/df/dba/dca/d77/l91 d0/d9/df/d74/lf7 0 2023-01-04T18:17:14.871 INFO:tasks.workunit.client.0.smithi050.stdout:2/784: rename d1/d10/c5d to d1/dd/d11/d14/d91/c10a 0 2023-01-04T18:17:14.873 INFO:tasks.workunit.client.0.smithi050.stdout:4/819: mknod d14/d1b/d66/dc1/dd6/c10f 0 2023-01-04T18:17:14.874 INFO:tasks.workunit.client.0.smithi050.stdout:8/877: symlink d3/d2a/d60/d2c/l12d 0 2023-01-04T18:17:14.875 INFO:tasks.workunit.client.0.smithi050.stdout:8/878: chown d3/d2a/d27/d93/d7f/d96/db6/de5 8831 1 2023-01-04T18:17:14.877 INFO:tasks.workunit.client.0.smithi050.stdout:6/805: dread d0/d9/df/dba/dca/f37 [0,4194304] 0 2023-01-04T18:17:14.890 INFO:tasks.workunit.client.0.smithi050.stdout:4/820: dwrite d14/ff6 [0,4194304] 0 2023-01-04T18:17:14.926 INFO:tasks.workunit.client.0.smithi050.stdout:0/668: creat d0/d73/d68/fd4 x:0 0 0 2023-01-04T18:17:14.932 INFO:tasks.workunit.client.0.smithi050.stdout:1/810: rename d8/d14/d1c/d28/dc7/dca/de7 to d8/d14/d1c/d28/d57/df9 0 2023-01-04T18:17:14.935 INFO:tasks.workunit.client.0.smithi050.stdout:2/785: creat d1/dd/d11/d14/d91/d5a/d7f/f10b x:0 0 0 2023-01-04T18:17:14.939 INFO:tasks.workunit.client.0.smithi050.stdout:8/879: creat d3/d2a/d2d/dc3/f12e x:0 0 0 2023-01-04T18:17:14.940 INFO:tasks.workunit.client.0.smithi050.stdout:6/806: mkdir d0/d9/d38/df8 0 2023-01-04T18:17:14.941 INFO:tasks.workunit.client.0.smithi050.stdout:1/811: dread d8/fd [4194304,4194304] 0 2023-01-04T18:17:14.941 INFO:tasks.workunit.client.0.smithi050.stdout:1/812: chown d8/d14/d1c/d28/d57/cf7 58162533 1 2023-01-04T18:17:14.941 INFO:tasks.workunit.client.0.smithi050.stdout:0/669: dwrite d0/d73/f71 [0,4194304] 0 2023-01-04T18:17:14.941 INFO:tasks.workunit.client.0.smithi050.stdout:0/670: truncate d0/d6/d8/d25/d8e/f98 503291 0 2023-01-04T18:17:14.948 INFO:tasks.workunit.client.0.smithi050.stdout:4/821: mknod d14/d9e/c110 0 2023-01-04T18:17:14.956 INFO:tasks.workunit.client.0.smithi050.stdout:6/807: dwrite d0/fb5 [0,4194304] 0 2023-01-04T18:17:14.962 INFO:tasks.workunit.client.0.smithi050.stdout:5/959: rename d13/d15/d66/db8/l85 to d13/d15/d66/db8/d27/d44/d101/l15c 0 2023-01-04T18:17:14.966 INFO:tasks.workunit.client.0.smithi050.stdout:5/960: write d13/d15/d66/db8/d27/d46/d4e/d4d/db1/fc1 [1787615,12221] 0 2023-01-04T18:17:14.966 INFO:tasks.workunit.client.0.smithi050.stdout:2/786: creat d1/dd/d28/d2c/d2e/d36/dd0/f10c x:0 0 0 2023-01-04T18:17:14.969 INFO:tasks.workunit.client.0.smithi050.stdout:8/880: creat d3/d2a/d74/d118/f12f x:0 0 0 2023-01-04T18:17:14.969 INFO:tasks.workunit.client.0.smithi050.stdout:6/808: dwrite d0/d9/df/dba/dca/d6b/fd6 [0,4194304] 0 2023-01-04T18:17:14.972 INFO:tasks.workunit.client.0.smithi050.stdout:1/813: creat d8/d14/d1c/d28/dcd/ffa x:0 0 0 2023-01-04T18:17:14.978 INFO:tasks.workunit.client.0.smithi050.stdout:4/822: creat d14/d1b/d1f/d22/d87/de0/d108/d5f/d6f/f111 x:0 0 0 2023-01-04T18:17:14.986 INFO:tasks.workunit.client.0.smithi050.stdout:5/961: creat d13/d15/d66/db8/d27/d44/d47/d124/d42/dfd/f15d x:0 0 0 2023-01-04T18:17:14.988 INFO:tasks.workunit.client.0.smithi050.stdout:2/787: symlink d1/dd/d28/d2c/d2e/d3f/da7/l10d 0 2023-01-04T18:17:14.989 INFO:tasks.workunit.client.0.smithi050.stdout:0/671: dwrite d0/f53 [0,4194304] 0 2023-01-04T18:17:14.990 INFO:tasks.workunit.client.0.smithi050.stdout:8/881: truncate d3/d2a/d27/d8b/d9f/f121 2811273 0 2023-01-04T18:17:14.993 INFO:tasks.workunit.client.0.smithi050.stdout:6/809: truncate d0/d9/df/f56 560254 0 2023-01-04T18:17:14.993 INFO:tasks.workunit.client.0.smithi050.stdout:6/810: dread - d0/d9/df/dba/dca/d6b/fc1 zero size 2023-01-04T18:17:14.994 INFO:tasks.workunit.client.0.smithi050.stdout:6/811: read d0/d9/df/dba/dca/d6b/fb8 [2443940,26253] 0 2023-01-04T18:17:14.994 INFO:tasks.workunit.client.0.smithi050.stdout:6/812: chown d0/d9/df/dba/dca/d6b/fc3 32568920 1 2023-01-04T18:17:14.995 INFO:tasks.workunit.client.0.smithi050.stdout:1/814: creat d8/d14/d1c/d28/d57/de6/ffb x:0 0 0 2023-01-04T18:17:14.995 INFO:tasks.workunit.client.0.smithi050.stdout:1/815: fdatasync d8/d48/d5c/d67/d91/fa3 0 2023-01-04T18:17:14.995 INFO:tasks.workunit.client.0.smithi050.stdout:1/816: write d8/d48/d5c/d67/d3a/f69 [990508,71034] 0 2023-01-04T18:17:14.996 INFO:tasks.workunit.client.0.smithi050.stdout:1/817: chown d8/d48/d5c/d67/d3a/d23/c45 86157601 1 2023-01-04T18:17:14.997 INFO:tasks.workunit.client.0.smithi050.stdout:4/823: creat d14/d1b/d1f/d22/d87/de0/d108/f112 x:0 0 0 2023-01-04T18:17:15.001 INFO:tasks.workunit.client.0.smithi050.stdout:5/962: rename d13/d15/d63/dc0/f10c to d13/d28/d7c/d83/f15e 0 2023-01-04T18:17:15.003 INFO:tasks.workunit.client.0.smithi050.stdout:2/788: truncate d1/dd/d62/da1/f25 2447953 0 2023-01-04T18:17:15.003 INFO:tasks.workunit.client.0.smithi050.stdout:2/789: readlink d1/dd/d11/db5/l5e 0 2023-01-04T18:17:15.003 INFO:tasks.workunit.client.0.smithi050.stdout:2/790: dread - d1/dd/d11/d14/d44/fdb zero size 2023-01-04T18:17:15.004 INFO:tasks.workunit.client.0.smithi050.stdout:2/791: chown d1/dd/d28/d79/fe8 95240 1 2023-01-04T18:17:15.013 INFO:tasks.workunit.client.0.smithi050.stdout:0/672: mkdir d0/d73/d79/dd5 0 2023-01-04T18:17:15.016 INFO:tasks.workunit.client.0.smithi050.stdout:8/882: symlink d3/d2a/d30/d3b/d4d/d23/d106/l130 0 2023-01-04T18:17:15.019 INFO:tasks.workunit.client.0.smithi050.stdout:4/824: dwrite d14/d1b/d1f/f27 [4194304,4194304] 0 2023-01-04T18:17:15.019 INFO:tasks.workunit.client.0.smithi050.stdout:4/825: chown d14/d1b/d32/c70 554 1 2023-01-04T18:17:15.021 INFO:tasks.workunit.client.0.smithi050.stdout:1/818: creat d8/d48/d5c/d67/d3b/ffc x:0 0 0 2023-01-04T18:17:15.021 INFO:tasks.workunit.client.0.smithi050.stdout:1/819: fdatasync d8/d48/d5c/d67/d91/fa3 0 2023-01-04T18:17:15.029 INFO:tasks.workunit.client.0.smithi050.stdout:1/820: dread d8/d14/d1c/d28/d57/d6a/d92/fae [4194304,4194304] 0 2023-01-04T18:17:15.030 INFO:tasks.workunit.client.0.smithi050.stdout:5/963: symlink d13/d15/d66/l15f 0 2023-01-04T18:17:15.030 INFO:tasks.workunit.client.0.smithi050.stdout:0/673: dwrite d0/d6/d28/d1a/f23 [0,4194304] 0 2023-01-04T18:17:15.037 INFO:tasks.workunit.client.0.smithi050.stdout:8/883: truncate d3/d2a/d60/f39 486893 0 2023-01-04T18:17:15.039 INFO:tasks.workunit.client.0.smithi050.stdout:6/813: truncate d0/d9/df/dba/dca/d6b/fd6 3963525 0 2023-01-04T18:17:15.041 INFO:tasks.workunit.client.0.smithi050.stdout:6/814: dread d0/d4a/d93/fa8 [0,4194304] 0 2023-01-04T18:17:15.041 INFO:tasks.workunit.client.0.smithi050.stdout:6/815: dread - d0/d9/df/dba/dca/d6b/fc1 zero size 2023-01-04T18:17:15.042 INFO:tasks.workunit.client.0.smithi050.stdout:6/816: write d0/d9/df/dba/dca/d6b/da4/fdc [260223,84365] 0 2023-01-04T18:17:15.046 INFO:tasks.workunit.client.0.smithi050.stdout:2/792: write d1/dd/d11/db5/d99/fa5 [4046453,31812] 0 2023-01-04T18:17:15.047 INFO:tasks.workunit.client.0.smithi050.stdout:1/821: dread d8/d14/d1c/f5d [0,4194304] 0 2023-01-04T18:17:15.049 INFO:tasks.workunit.client.0.smithi050.stdout:4/826: creat d14/d1b/d1f/d22/d3e/d44/f113 x:0 0 0 2023-01-04T18:17:15.049 INFO:tasks.workunit.client.0.smithi050.stdout:4/827: fsync f4 0 2023-01-04T18:17:15.049 INFO:tasks.workunit.client.0.smithi050.stdout:4/828: chown d14/d1b/d1f/d22/d87/de0/d108/c83 4 1 2023-01-04T18:17:15.055 INFO:tasks.workunit.client.0.smithi050.stdout:8/884: truncate d3/d2a/d27/d93/d7f/d96/d46/f4a 2468 0 2023-01-04T18:17:15.056 INFO:tasks.workunit.client.0.smithi050.stdout:5/964: dread d13/d15/d63/fe5 [0,4194304] 0 2023-01-04T18:17:15.056 INFO:tasks.workunit.client.0.smithi050.stdout:5/965: write d13/d15/d66/db8/d27/d46/d4e/d4d/f51 [2327560,107068] 0 2023-01-04T18:17:15.057 INFO:tasks.workunit.client.0.smithi050.stdout:6/817: getdents d0/d9/df/dba 0 2023-01-04T18:17:15.058 INFO:tasks.workunit.client.0.smithi050.stdout:6/818: write d0/d9/df/dba/dca/fac [4255213,81408] 0 2023-01-04T18:17:15.060 INFO:tasks.workunit.client.0.smithi050.stdout:2/793: creat d1/dd/d28/d2c/d2e/d36/f10e x:0 0 0 2023-01-04T18:17:15.060 INFO:tasks.workunit.client.0.smithi050.stdout:2/794: dread - d1/dd/d11/db5/df8/f107 zero size 2023-01-04T18:17:15.060 INFO:tasks.workunit.client.0.smithi050.stdout:2/795: chown d1/dd/d28/l2f 554121 1 2023-01-04T18:17:15.060 INFO:tasks.workunit.client.0.smithi050.stdout:2/796: chown d1/dd/d62/d69 12903429 1 2023-01-04T18:17:15.063 INFO:tasks.workunit.client.0.smithi050.stdout:1/822: link d8/d48/d5c/d67/d3a/d23/c6b d8/d14/d1c/cfd 0 2023-01-04T18:17:15.064 INFO:tasks.workunit.client.0.smithi050.stdout:7/917: sync 2023-01-04T18:17:15.065 INFO:tasks.workunit.client.0.smithi050.stdout:9/796: sync 2023-01-04T18:17:15.065 INFO:tasks.workunit.client.0.smithi050.stdout:3/810: sync 2023-01-04T18:17:15.065 INFO:tasks.workunit.client.0.smithi050.stdout:3/811: fsync d0/d1b/d2f/d31/f50 0 2023-01-04T18:17:15.065 INFO:tasks.workunit.client.0.smithi050.stdout:4/829: creat d14/d1b/d1f/d22/d87/f114 x:0 0 0 2023-01-04T18:17:15.066 INFO:tasks.workunit.client.0.smithi050.stdout:4/830: readlink d14/d1b/l75 0 2023-01-04T18:17:15.070 INFO:tasks.workunit.client.0.smithi050.stdout:8/885: rename d3/d2a/d30/d3b/d4d/d23/d55/laa to d3/d2a/d2d/d86/d11c/l131 0 2023-01-04T18:17:15.070 INFO:tasks.workunit.client.0.smithi050.stdout:8/886: write d3/d2a/d30/f3f [3390448,88765] 0 2023-01-04T18:17:15.072 INFO:tasks.workunit.client.0.smithi050.stdout:5/966: dwrite d13/d15/d66/db8/d27/d46/d4e/d4d/db1/fc1 [0,4194304] 0 2023-01-04T18:17:15.072 INFO:tasks.workunit.client.0.smithi050.stdout:8/887: dread d3/d2a/d30/d3b/d4d/d23/d55/f5a [0,4194304] 0 2023-01-04T18:17:15.212 INFO:tasks.workunit.client.0.smithi050.stdout:6/819: mknod d0/d9/df/dba/cf9 0 2023-01-04T18:17:15.216 INFO:tasks.workunit.client.0.smithi050.stdout:2/797: mknod d1/dd/d62/c10f 0 2023-01-04T18:17:15.216 INFO:tasks.workunit.client.0.smithi050.stdout:2/798: chown d1/dd/d28/d2c/dce 63 1 2023-01-04T18:17:15.221 INFO:tasks.workunit.client.0.smithi050.stdout:1/823: symlink d8/d14/d1c/d28/dc7/lfe 0 2023-01-04T18:17:15.222 INFO:tasks.workunit.client.0.smithi050.stdout:9/797: unlink d1/d12/d41/d60/c78 0 2023-01-04T18:17:15.225 INFO:tasks.workunit.client.0.smithi050.stdout:7/918: mkdir d6/d90/d131 0 2023-01-04T18:17:15.225 INFO:tasks.workunit.client.0.smithi050.stdout:7/919: dread - d6/db/d20/f122 zero size 2023-01-04T18:17:15.227 INFO:tasks.workunit.client.0.smithi050.stdout:3/812: getdents d0/d8f/d46/dc2/d107 0 2023-01-04T18:17:15.232 INFO:tasks.workunit.client.0.smithi050.stdout:4/831: creat d14/d1b/d1f/f115 x:0 0 0 2023-01-04T18:17:15.232 INFO:tasks.workunit.client.0.smithi050.stdout:8/888: rename d3/d2a/d60/lf2 to d3/d2a/d27/d93/d7f/l132 0 2023-01-04T18:17:15.234 INFO:tasks.workunit.client.0.smithi050.stdout:5/967: creat d13/d15/d66/db8/d27/d44/d47/d124/d42/dfd/f160 x:0 0 0 2023-01-04T18:17:15.240 INFO:tasks.workunit.client.0.smithi050.stdout:2/799: getdents d1/dd/d11/d14 0 2023-01-04T18:17:15.244 INFO:tasks.workunit.client.0.smithi050.stdout:1/824: unlink d8/d14/d1c/f5d 0 2023-01-04T18:17:15.246 INFO:tasks.workunit.client.0.smithi050.stdout:9/798: mknod d1/d12/d41/d60/d8e/cf5 0 2023-01-04T18:17:15.253 INFO:tasks.workunit.client.0.smithi050.stdout:7/920: symlink d6/db/d15/d1b/d5b/dda/l132 0 2023-01-04T18:17:15.253 INFO:tasks.workunit.client.0.smithi050.stdout:7/921: chown d6/d28/d99/dd7 3 1 2023-01-04T18:17:15.253 INFO:tasks.workunit.client.0.smithi050.stdout:7/922: readlink d6/db/d15/d1b/l3e 0 2023-01-04T18:17:15.255 INFO:tasks.workunit.client.0.smithi050.stdout:9/799: dread d1/d3/fd3 [0,4194304] 0 2023-01-04T18:17:15.256 INFO:tasks.workunit.client.0.smithi050.stdout:9/800: stat d1/d12/d41/d60/f90 0 2023-01-04T18:17:15.256 INFO:tasks.workunit.client.0.smithi050.stdout:7/923: write d6/db/d3a/f84 [856193,29667] 0 2023-01-04T18:17:15.264 INFO:tasks.workunit.client.0.smithi050.stdout:3/813: link d0/d1b/d2f/d56/d98/d9c/dc9/c105 d0/d8f/deb/c114 0 2023-01-04T18:17:15.265 INFO:tasks.workunit.client.0.smithi050.stdout:4/832: truncate d14/d1b/d66/dc1/dd6/fdd 2872143 0 2023-01-04T18:17:15.268 INFO:tasks.workunit.client.0.smithi050.stdout:8/889: mkdir d3/d2a/d74/d118/d129/daf/dd8/d133 0 2023-01-04T18:17:15.271 INFO:tasks.workunit.client.0.smithi050.stdout:5/968: rmdir d13/d15/d66/db8/d27/dca/dd3/df8 39 2023-01-04T18:17:15.271 INFO:tasks.workunit.client.0.smithi050.stdout:5/969: dread - d13/d15/d66/db8/d27/d44/d47/d124/d42/f13b zero size 2023-01-04T18:17:15.271 INFO:tasks.workunit.client.0.smithi050.stdout:3/814: dread d0/d8f/d46/dc2/d107/f73 [0,4194304] 0 2023-01-04T18:17:15.271 INFO:tasks.workunit.client.0.smithi050.stdout:3/815: truncate d0/d8f/d46/fad 172156 0 2023-01-04T18:17:15.272 INFO:tasks.workunit.client.0.smithi050.stdout:6/820: getdents d0/d9/df/dba/dca/d6b/da4 0 2023-01-04T18:17:15.276 INFO:tasks.workunit.client.0.smithi050.stdout:2/800: creat d1/dd/d28/d79/de4/f110 x:0 0 0 2023-01-04T18:17:15.277 INFO:tasks.workunit.client.0.smithi050.stdout:2/801: fsync d1/dd/d38/fb9 0 2023-01-04T18:17:15.277 INFO:tasks.workunit.client.0.smithi050.stdout:2/802: write d1/dd/d11/d14/d44/fdb [21407,50748] 0 2023-01-04T18:17:15.278 INFO:tasks.workunit.client.0.smithi050.stdout:9/801: dwrite d1/d12/d41/fdd [0,4194304] 0 2023-01-04T18:17:15.278 INFO:tasks.workunit.client.0.smithi050.stdout:1/825: creat d8/d48/d5c/d67/d3a/fff x:0 0 0 2023-01-04T18:17:15.280 INFO:tasks.workunit.client.0.smithi050.stdout:7/924: getdents d6/d90/de3/d6a 0 2023-01-04T18:17:15.286 INFO:tasks.workunit.client.0.smithi050.stdout:3/816: read d0/d1a/f8a [3744825,109209] 0 2023-01-04T18:17:15.286 INFO:tasks.workunit.client.0.smithi050.stdout:3/817: stat d0/f40 0 2023-01-04T18:17:15.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:13.923044+0000 mgr.smithi098.vhfzum (mgr.24455) 51 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 1.7 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 70 MiB/s rd, 155 MiB/s wr, 286 op/s 2023-01-04T18:17:15.293 INFO:tasks.workunit.client.0.smithi050.stdout:8/890: link d3/d2a/d27/c10a d3/d2a/d2d/d86/dd1/d10f/c134 0 2023-01-04T18:17:15.294 INFO:tasks.workunit.client.0.smithi050.stdout:5/970: symlink d13/d15/d66/db2/l161 0 2023-01-04T18:17:15.300 INFO:tasks.workunit.client.0.smithi050.stdout:6/821: dwrite d0/d9/f2b [0,4194304] 0 2023-01-04T18:17:15.302 INFO:tasks.workunit.client.0.smithi050.stdout:7/925: dwrite d6/db/d15/d48/dc7/d124/d125/fd6 [0,4194304] 0 2023-01-04T18:17:15.302 INFO:tasks.workunit.client.0.smithi050.stdout:5/971: dread d13/d15/d66/db8/d27/d46/d4e/d4d/f125 [4194304,4194304] 0 2023-01-04T18:17:15.303 INFO:tasks.workunit.client.0.smithi050.stdout:2/803: getdents d1/dd/d28/d2c 0 2023-01-04T18:17:15.315 INFO:tasks.workunit.client.0.smithi050.stdout:9/802: creat d1/d12/d2d/ff6 x:0 0 0 2023-01-04T18:17:15.315 INFO:tasks.workunit.client.0.smithi050.stdout:9/803: chown d1/d3/cee 5117556 1 2023-01-04T18:17:15.315 INFO:tasks.workunit.client.0.smithi050.stdout:9/804: truncate d1/d12/d2d/d39/fd2 1149581 0 2023-01-04T18:17:15.316 INFO:tasks.workunit.client.0.smithi050.stdout:1/826: mknod d8/d14/d1c/d28/d57/c100 0 2023-01-04T18:17:15.316 INFO:tasks.workunit.client.0.smithi050.stdout:1/827: dread - d8/d14/d1c/d28/d57/d6a/d92/fe3 zero size 2023-01-04T18:17:15.316 INFO:tasks.workunit.client.0.smithi050.stdout:1/828: chown d8/d14/d1c/d28/d57/d6a/d92/dec 60229121 1 2023-01-04T18:17:15.317 INFO:tasks.workunit.client.0.smithi050.stdout:1/829: write d8/d14/d1c/d28/d57/fa5 [1598775,69577] 0 2023-01-04T18:17:15.317 INFO:tasks.workunit.client.0.smithi050.stdout:1/830: dread - d8/d48/d5c/d67/d3a/d31/fb4 zero size 2023-01-04T18:17:15.323 INFO:tasks.workunit.client.0.smithi050.stdout:4/833: unlink d14/d1b/d66/l69 0 2023-01-04T18:17:15.326 INFO:tasks.workunit.client.0.smithi050.stdout:6/822: dwrite d0/d4a/fe0 [0,4194304] 0 2023-01-04T18:17:15.326 INFO:tasks.workunit.client.0.smithi050.stdout:6/823: stat d0/d9/d25/dd4 0 2023-01-04T18:17:15.326 INFO:tasks.workunit.client.0.smithi050.stdout:3/818: mkdir d0/d8f/d46/d80/dca/d100/d115 0 2023-01-04T18:17:15.327 INFO:tasks.workunit.client.0.smithi050.stdout:4/834: write d14/d1b/d1f/d22/f67 [1843814,56401] 0 2023-01-04T18:17:15.327 INFO:tasks.workunit.client.0.smithi050.stdout:2/804: dwrite d1/dd/d28/d2c/d2e/dca/fc9 [0,4194304] 0 2023-01-04T18:17:15.328 INFO:tasks.workunit.client.0.smithi050.stdout:8/891: creat d3/d2a/d74/d118/d129/daf/f135 x:0 0 0 2023-01-04T18:17:15.328 INFO:tasks.workunit.client.0.smithi050.stdout:8/892: read - d3/d2a/d27/d93/d7a/fe0 zero size 2023-01-04T18:17:15.328 INFO:tasks.workunit.client.0.smithi050.stdout:8/893: fsync d3/d2a/d30/d3b/d53/fca 0 2023-01-04T18:17:15.328 INFO:tasks.workunit.client.0.smithi050.stdout:8/894: write d3/d2a/d74/d92/d94/d9c/f10e [197804,60045] 0 2023-01-04T18:17:15.328 INFO:tasks.workunit.client.0.smithi050.stdout:8/895: chown d3/d2a/d73/ld5 421389330 1 2023-01-04T18:17:15.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:13.923044+0000 mgr.smithi098.vhfzum (mgr.24455) 51 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 1.7 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 70 MiB/s rd, 155 MiB/s wr, 286 op/s 2023-01-04T18:17:15.342 INFO:tasks.workunit.client.0.smithi050.stdout:4/835: dwrite f4 [8388608,4194304] 0 2023-01-04T18:17:15.370 INFO:tasks.workunit.client.0.smithi050.stdout:0/674: sync 2023-01-04T18:17:15.374 INFO:tasks.workunit.client.0.smithi050.stdout:5/972: rename d13/d15/d66/db8/d27/d44/d47/d124/d42/d4a to d13/d15/d66/db8/d27/d46/d4e/d4d/db1/dbc/d162 0 2023-01-04T18:17:15.377 INFO:tasks.workunit.client.0.smithi050.stdout:9/805: symlink d1/d12/d41/d60/d95/lf7 0 2023-01-04T18:17:15.379 INFO:tasks.workunit.client.0.smithi050.stdout:1/831: unlink d8/d14/f82 0 2023-01-04T18:17:15.382 INFO:tasks.workunit.client.0.smithi050.stdout:5/973: dread d13/d15/d66/db8/d27/f109 [0,4194304] 0 2023-01-04T18:17:15.385 INFO:tasks.workunit.client.0.smithi050.stdout:6/824: unlink d0/d9/d25/d2d/fa2 0 2023-01-04T18:17:15.387 INFO:tasks.workunit.client.0.smithi050.stdout:3/819: mkdir d0/dd/d45/d116 0 2023-01-04T18:17:15.390 INFO:tasks.workunit.client.0.smithi050.stdout:1/832: dread d8/d14/f35 [0,4194304] 0 2023-01-04T18:17:15.404 INFO:tasks.workunit.client.0.smithi050.stdout:0/675: truncate d0/d6/f3c 1869256 0 2023-01-04T18:17:15.409 INFO:tasks.workunit.client.0.smithi050.stdout:7/926: mkdir d6/d28/d133 0 2023-01-04T18:17:15.412 INFO:tasks.workunit.client.0.smithi050.stdout:8/896: rename d3/d2a/d30/d3b/d4d/d23/d55/f57 to d3/d2a/d74/d92/f136 0 2023-01-04T18:17:15.417 INFO:tasks.workunit.client.0.smithi050.stdout:9/806: mknod d1/d3/d89/cf8 0 2023-01-04T18:17:15.417 INFO:tasks.workunit.client.0.smithi050.stdout:9/807: readlink d1/d12/d2d/l9c 0 2023-01-04T18:17:15.417 INFO:tasks.workunit.client.0.smithi050.stdout:9/808: fdatasync d1/d12/d41/d60/d8e/fc1 0 2023-01-04T18:17:15.417 INFO:tasks.workunit.client.0.smithi050.stdout:9/809: chown d1/d3/d11/d42/fc7 1 1 2023-01-04T18:17:15.417 INFO:tasks.workunit.client.0.smithi050.stdout:9/810: stat d1/d3/d11/d1f/f21 0 2023-01-04T18:17:15.422 INFO:tasks.workunit.client.0.smithi050.stdout:5/974: creat d13/d15/d66/db8/d27/d44/d47/d124/d59/d87/dbe/f163 x:0 0 0 2023-01-04T18:17:15.424 INFO:tasks.workunit.client.0.smithi050.stdout:3/820: mkdir d0/d8f/d46/dc2/d10f/d117 0 2023-01-04T18:17:15.426 INFO:tasks.workunit.client.0.smithi050.stdout:1/833: creat d8/d48/d5c/d67/d3a/f101 x:0 0 0 2023-01-04T18:17:15.431 INFO:tasks.workunit.client.0.smithi050.stdout:0/676: mknod d0/d73/d79/cd6 0 2023-01-04T18:17:15.432 INFO:tasks.workunit.client.0.smithi050.stdout:0/677: fsync d0/d73/fa2 0 2023-01-04T18:17:15.433 INFO:tasks.workunit.client.0.smithi050.stdout:6/825: rename d0/d9/d25/fda to d0/d9/d25/d4d/ffa 0 2023-01-04T18:17:15.436 INFO:tasks.workunit.client.0.smithi050.stdout:7/927: dwrite d6/db/f60 [0,4194304] 0 2023-01-04T18:17:15.453 INFO:tasks.workunit.client.0.smithi050.stdout:5/975: dwrite d13/d15/d66/db2/f10f [0,4194304] 0 2023-01-04T18:17:15.453 INFO:tasks.workunit.client.0.smithi050.stdout:5/976: chown d13/d15/d66/db8/d27/d44/d47/d124/d42 12 1 2023-01-04T18:17:15.453 INFO:tasks.workunit.client.0.smithi050.stdout:5/977: truncate d13/d15/d66/f11e 323920 0 2023-01-04T18:17:15.456 INFO:tasks.workunit.client.0.smithi050.stdout:9/811: dwrite d1/d12/d41/d60/d95/f96 [0,4194304] 0 2023-01-04T18:17:15.456 INFO:tasks.workunit.client.0.smithi050.stdout:9/812: readlink d1/d3/lf 0 2023-01-04T18:17:15.471 INFO:tasks.workunit.client.0.smithi050.stdout:8/897: unlink d3/d2a/d30/d3b/d4d/d23/d55/c62 0 2023-01-04T18:17:15.471 INFO:tasks.workunit.client.0.smithi050.stdout:8/898: truncate d3/d2a/d74/d92/fde 463217 0 2023-01-04T18:17:15.475 INFO:tasks.workunit.client.0.smithi050.stdout:1/834: creat d8/d48/d5c/d67/d3a/d23/f102 x:0 0 0 2023-01-04T18:17:15.476 INFO:tasks.workunit.client.0.smithi050.stdout:1/835: stat d8/d48/d5c/f7c 0 2023-01-04T18:17:15.476 INFO:tasks.workunit.client.0.smithi050.stdout:1/836: stat d8/d48/d5c/d67/d3b/db9/dde 0 2023-01-04T18:17:15.477 INFO:tasks.workunit.client.0.smithi050.stdout:0/678: creat d0/d6/d28/d1a/d8a/fd7 x:0 0 0 2023-01-04T18:17:15.478 INFO:tasks.workunit.client.0.smithi050.stdout:8/899: dread d3/d2a/d30/d3b/d4d/d23/d55/d5f/f8a [0,4194304] 0 2023-01-04T18:17:15.480 INFO:tasks.workunit.client.0.smithi050.stdout:6/826: mknod d0/d9/d25/d2d/cfb 0 2023-01-04T18:17:15.484 INFO:tasks.workunit.client.0.smithi050.stdout:7/928: creat d6/d90/de3/d116/de2/f134 x:0 0 0 2023-01-04T18:17:15.484 INFO:tasks.workunit.client.0.smithi050.stdout:7/929: fsync d6/f7c 0 2023-01-04T18:17:15.484 INFO:tasks.workunit.client.0.smithi050.stdout:7/930: fsync d6/d90/de3/fc0 0 2023-01-04T18:17:15.485 INFO:tasks.workunit.client.0.smithi050.stdout:7/931: fdatasync d6/db/d15/d48/dc7/d124/d125/f8e 0 2023-01-04T18:17:15.493 INFO:tasks.workunit.client.0.smithi050.stdout:9/813: mknod d1/d12/d41/cf9 0 2023-01-04T18:17:15.493 INFO:tasks.workunit.client.0.smithi050.stdout:9/814: chown d1/d12/d9f/lc8 3 1 2023-01-04T18:17:15.498 INFO:tasks.workunit.client.0.smithi050.stdout:6/827: creat d0/d9/d25/d40/d89/ffc x:0 0 0 2023-01-04T18:17:15.500 INFO:tasks.workunit.client.0.smithi050.stdout:5/978: rename d13/d15/d66/db8/d27/d46/d4e/d4d/db1/fc1 to d13/d15/d66/db8/d1f/f164 0 2023-01-04T18:17:15.501 INFO:tasks.workunit.client.0.smithi050.stdout:5/979: write d13/d15/d66/db8/d1f/d62/fb4 [49419,29957] 0 2023-01-04T18:17:15.501 INFO:tasks.workunit.client.0.smithi050.stdout:9/815: mknod d1/d3/d24/cfa 0 2023-01-04T18:17:15.502 INFO:tasks.workunit.client.0.smithi050.stdout:9/816: read - d1/d6f/faa zero size 2023-01-04T18:17:15.502 INFO:tasks.workunit.client.0.smithi050.stdout:9/817: fdatasync d1/d3/d11/d42/fc7 0 2023-01-04T18:17:15.502 INFO:tasks.workunit.client.0.smithi050.stdout:9/818: readlink d1/d3/dbf/dd4/da8/ldf 0 2023-01-04T18:17:15.503 INFO:tasks.workunit.client.0.smithi050.stdout:6/828: creat d0/d9/df/d74/ffd x:0 0 0 2023-01-04T18:17:15.514 INFO:tasks.workunit.client.0.smithi050.stdout:1/837: rename d8/d14/d1c/d28/d57/d6a/de8 to d8/d48/d103 0 2023-01-04T18:17:15.514 INFO:tasks.workunit.client.0.smithi050.stdout:1/838: truncate d8/d14/d1c/d28/f3f 912825 0 2023-01-04T18:17:15.515 INFO:tasks.workunit.client.0.smithi050.stdout:8/900: dwrite d3/d2a/d74/d92/d94/dc9/ffe [0,4194304] 0 2023-01-04T18:17:15.515 INFO:tasks.workunit.client.0.smithi050.stdout:8/901: fsync d3/d2a/d74/d118/f12f 0 2023-01-04T18:17:15.515 INFO:tasks.workunit.client.0.smithi050.stdout:5/980: getdents d13/d15/d66/db8/d27/d44/d47/d124/d42/dec/d12b 0 2023-01-04T18:17:15.516 INFO:tasks.workunit.client.0.smithi050.stdout:9/819: dread d1/d12/d41/d60/fbe [0,4194304] 0 2023-01-04T18:17:15.518 INFO:tasks.workunit.client.0.smithi050.stdout:6/829: getdents d0/d4a 0 2023-01-04T18:17:15.523 INFO:tasks.workunit.client.0.smithi050.stdout:0/679: dwrite d0/d6/d8/d35/fa4 [0,4194304] 0 2023-01-04T18:17:15.523 INFO:tasks.workunit.client.0.smithi050.stdout:7/932: dwrite d6/db/d3a/dd2/d10f/f130 [0,4194304] 0 2023-01-04T18:17:15.524 INFO:tasks.workunit.client.0.smithi050.stdout:1/839: stat d8/d48/d5c/d67/d3a/d23/c6b 0 2023-01-04T18:17:15.525 INFO:tasks.workunit.client.0.smithi050.stdout:1/840: write d8/fd [5788449,21651] 0 2023-01-04T18:17:15.527 INFO:tasks.workunit.client.0.smithi050.stdout:5/981: creat d13/d15/d66/db8/d27/d44/d47/d124/f165 x:0 0 0 2023-01-04T18:17:15.529 INFO:tasks.workunit.client.0.smithi050.stdout:9/820: dread d1/d12/d41/d60/d95/f96 [0,4194304] 0 2023-01-04T18:17:15.530 INFO:tasks.workunit.client.0.smithi050.stdout:8/902: dwrite d3/d2a/d2d/f50 [0,4194304] 0 2023-01-04T18:17:15.545 INFO:tasks.workunit.client.0.smithi050.stdout:6/830: rename d0/d9/d25/d2d/dea/f9b to d0/d5c/d5d/ffe 0 2023-01-04T18:17:15.545 INFO:tasks.workunit.client.0.smithi050.stdout:6/831: write d0/d9/fa [5985047,2022] 0 2023-01-04T18:17:15.545 INFO:tasks.workunit.client.0.smithi050.stdout:6/832: fdatasync d0/d4a/fb3 0 2023-01-04T18:17:15.550 INFO:tasks.workunit.client.0.smithi050.stdout:1/841: dwrite d8/f43 [4194304,4194304] 0 2023-01-04T18:17:15.566 INFO:tasks.workunit.client.0.smithi050.stdout:4/836: sync 2023-01-04T18:17:15.566 INFO:tasks.workunit.client.0.smithi050.stdout:2/805: sync 2023-01-04T18:17:15.566 INFO:tasks.workunit.client.0.smithi050.stdout:7/933: rmdir d6/d90/de3/d116 39 2023-01-04T18:17:15.567 INFO:tasks.workunit.client.0.smithi050.stdout:7/934: write d6/db/d15/d1b/d5b/dda/fe1 [1174781,23468] 0 2023-01-04T18:17:15.567 INFO:tasks.workunit.client.0.smithi050.stdout:7/935: write d6/db/d15/d48/dc7/d124/d125/fd6 [855113,83707] 0 2023-01-04T18:17:15.571 INFO:tasks.workunit.client.0.smithi050.stdout:5/982: creat d13/d15/d66/db8/d27/d46/d4e/d4d/db1/f166 x:0 0 0 2023-01-04T18:17:15.573 INFO:tasks.workunit.client.0.smithi050.stdout:9/821: link d1/d12/d41/d60/d95/f99 d1/d3/d89/ffb 0 2023-01-04T18:17:15.573 INFO:tasks.workunit.client.0.smithi050.stdout:9/822: dread - d1/d12/d41/d60/d95/fe0 zero size 2023-01-04T18:17:15.579 INFO:tasks.workunit.client.0.smithi050.stdout:8/903: link d3/d2a/d74/d92/f136 d3/d2a/d2d/d86/f137 0 2023-01-04T18:17:15.584 INFO:tasks.workunit.client.0.smithi050.stdout:6/833: link d0/d9/d25/d2d/dea/d54/f58 d0/d9/df/dba/dca/fff 0 2023-01-04T18:17:15.584 INFO:tasks.workunit.client.0.smithi050.stdout:6/834: chown d0/d9/df/dba/dca/c8d 8152 1 2023-01-04T18:17:15.586 INFO:tasks.workunit.client.0.smithi050.stdout:3/821: sync 2023-01-04T18:17:15.591 INFO:tasks.workunit.client.0.smithi050.stdout:1/842: rename d8/d48/d5c/d67/c20 to d8/d48/d5c/d67/d3b/d84/c104 0 2023-01-04T18:17:15.591 INFO:tasks.workunit.client.0.smithi050.stdout:1/843: chown d8/d48 0 1 2023-01-04T18:17:15.591 INFO:tasks.workunit.client.0.smithi050.stdout:1/844: truncate d8/d48/d5c/d67/d3b/fb6 443224 0 2023-01-04T18:17:15.595 INFO:tasks.workunit.client.0.smithi050.stdout:2/806: getdents d1/dd/d38 0 2023-01-04T18:17:15.597 INFO:tasks.workunit.client.0.smithi050.stdout:7/936: dwrite d6/d6b/d8b/f91 [0,4194304] 0 2023-01-04T18:17:15.600 INFO:tasks.workunit.client.0.smithi050.stdout:1/845: dread d8/d48/d5c/f5e [4194304,4194304] 0 2023-01-04T18:17:15.601 INFO:tasks.workunit.client.0.smithi050.stdout:1/846: dread d8/d14/d1c/d28/f9d [0,4194304] 0 2023-01-04T18:17:15.606 INFO:tasks.workunit.client.0.smithi050.stdout:9/823: getdents d1/d12/d41 0 2023-01-04T18:17:15.608 INFO:tasks.workunit.client.0.smithi050.stdout:8/904: creat d3/d2a/d27/deb/f138 x:0 0 0 2023-01-04T18:17:15.611 INFO:tasks.workunit.client.0.smithi050.stdout:6/835: link d0/d9/df/dba/dca/d6b/fc3 d0/d9/df/dba/dca/d6b/da4/f100 0 2023-01-04T18:17:15.611 INFO:tasks.workunit.client.0.smithi050.stdout:8/905: dread d3/d2a/d30/d3b/f79 [0,4194304] 0 2023-01-04T18:17:15.612 INFO:tasks.workunit.client.0.smithi050.stdout:3/822: symlink d0/d1b/d2f/d56/d98/dc7/l118 0 2023-01-04T18:17:15.612 INFO:tasks.workunit.client.0.smithi050.stdout:7/937: dread d6/d6b/ff2 [0,4194304] 0 2023-01-04T18:17:15.614 INFO:tasks.workunit.client.0.smithi050.stdout:4/837: link d14/d1b/dd7/lec d14/d1b/d1f/d22/d87/de0/d108/d5f/d80/d10b/l116 0 2023-01-04T18:17:15.618 INFO:tasks.workunit.client.0.smithi050.stdout:1/847: getdents d8/d48/d5c/d67 0 2023-01-04T18:17:15.618 INFO:tasks.workunit.client.0.smithi050.stdout:1/848: fsync d8/d14/f74 0 2023-01-04T18:17:15.619 INFO:tasks.workunit.client.0.smithi050.stdout:8/906: dread d3/d2a/d27/d93/d7a/f80 [0,4194304] 0 2023-01-04T18:17:15.619 INFO:tasks.workunit.client.0.smithi050.stdout:8/907: chown d3/d2a/d30/d3b/d4d/ldf 11164 1 2023-01-04T18:17:15.620 INFO:tasks.workunit.client.0.smithi050.stdout:9/824: creat d1/d3/dbf/dd4/da8/ffc x:0 0 0 2023-01-04T18:17:15.622 INFO:tasks.workunit.client.0.smithi050.stdout:8/908: write d3/d2a/d30/f3f [1941445,68401] 0 2023-01-04T18:17:15.623 INFO:tasks.workunit.client.0.smithi050.stdout:6/836: creat d0/d9/df/dba/dca/d6b/f101 x:0 0 0 2023-01-04T18:17:15.625 INFO:tasks.workunit.client.0.smithi050.stdout:3/823: creat d0/d1b/d2f/d56/d98/d9c/f119 x:0 0 0 2023-01-04T18:17:15.627 INFO:tasks.workunit.client.0.smithi050.stdout:7/938: mkdir d6/d6b/d135 0 2023-01-04T18:17:15.628 INFO:tasks.workunit.client.0.smithi050.stdout:7/939: readlink d6/d28/dde/de6/l112 0 2023-01-04T18:17:15.628 INFO:tasks.workunit.client.0.smithi050.stdout:2/807: dwrite d1/dd/d11/db5/d99/fa5 [0,4194304] 0 2023-01-04T18:17:15.628 INFO:tasks.workunit.client.0.smithi050.stdout:2/808: truncate d1/dd/d28/d2c/d2e/d36/dd0/ff2 36462 0 2023-01-04T18:17:15.628 INFO:tasks.workunit.client.0.smithi050.stdout:2/809: read - d1/dd/d28/d2c/d2e/d36/dd0/f10c zero size 2023-01-04T18:17:15.628 INFO:tasks.workunit.client.0.smithi050.stdout:2/810: truncate d1/dd/d62/d69/f82 4386409 0 2023-01-04T18:17:15.632 INFO:tasks.workunit.client.0.smithi050.stdout:9/825: creat d1/d12/d41/d60/d8e/ffd x:0 0 0 2023-01-04T18:17:15.632 INFO:tasks.workunit.client.0.smithi050.stdout:9/826: write d1/d3/d24/fa6 [8711945,24783] 0 2023-01-04T18:17:15.633 INFO:tasks.workunit.client.0.smithi050.stdout:1/849: dwrite d8/d14/d1c/d28/d57/de6/fee [0,4194304] 0 2023-01-04T18:17:15.634 INFO:tasks.workunit.client.0.smithi050.stdout:1/850: fsync d8/f12 0 2023-01-04T18:17:15.634 INFO:tasks.workunit.client.0.smithi050.stdout:1/851: chown d8/d14/d1c/d28/dc7/dd6/c8f 59 1 2023-01-04T18:17:15.635 INFO:tasks.workunit.client.0.smithi050.stdout:8/909: rmdir d3/d2a/d27/deb 39 2023-01-04T18:17:15.640 INFO:tasks.workunit.client.0.smithi050.stdout:6/837: truncate d0/d9/d25/d40/d89/dd9/f82 3004305 0 2023-01-04T18:17:15.649 INFO:tasks.workunit.client.0.smithi050.stdout:3/824: rename d0/d1b to d0/d8f/d46/df7/d11a 0 2023-01-04T18:17:15.656 INFO:tasks.workunit.client.0.smithi050.stdout:2/811: link d1/dd/d11/d14/d91/d5a/d7f/f93 d1/f111 0 2023-01-04T18:17:15.658 INFO:tasks.workunit.client.0.smithi050.stdout:4/838: mkdir d14/d1b/d1f/d63/dcb/d117 0 2023-01-04T18:17:15.658 INFO:tasks.workunit.client.0.smithi050.stdout:4/839: chown d14/d1b/d1f/d22/d3e/d85/da6/cb7 4 1 2023-01-04T18:17:15.659 INFO:tasks.workunit.client.0.smithi050.stdout:7/940: truncate d6/d28/d99/dd7/f96 2303728 0 2023-01-04T18:17:15.659 INFO:tasks.workunit.client.0.smithi050.stdout:9/827: mknod d1/d3/ddc/cfe 0 2023-01-04T18:17:15.663 INFO:tasks.workunit.client.0.smithi050.stdout:8/910: unlink d3/d2a/d30/d3b/d4d/c5b 0 2023-01-04T18:17:15.665 INFO:tasks.workunit.client.0.smithi050.stdout:8/911: dread d3/d2a/f6e [0,4194304] 0 2023-01-04T18:17:15.666 INFO:tasks.workunit.client.0.smithi050.stdout:6/838: creat d0/d9/df/d74/f102 x:0 0 0 2023-01-04T18:17:15.667 INFO:tasks.workunit.client.0.smithi050.stdout:1/852: rename d8/d48/d5c/cc1 to d8/d48/d5c/d67/d3a/d23/c105 0 2023-01-04T18:17:15.667 INFO:tasks.workunit.client.0.smithi050.stdout:1/853: chown d8/d48/d5c/d67/d3a/d23/c45 235253 1 2023-01-04T18:17:15.668 INFO:tasks.workunit.client.0.smithi050.stdout:3/825: readlink d0/d1a/l59 0 2023-01-04T18:17:15.668 INFO:tasks.workunit.client.0.smithi050.stdout:3/826: chown d0/d8f/d46/df7/d11a/d2f/d71/lfd 1042 1 2023-01-04T18:17:15.673 INFO:tasks.workunit.client.0.smithi050.stdout:7/941: symlink d6/db/d3b/d12b/l136 0 2023-01-04T18:17:15.674 INFO:tasks.workunit.client.0.smithi050.stdout:9/828: rmdir d1/d3/d3b/d63/dc3 39 2023-01-04T18:17:15.675 INFO:tasks.workunit.client.0.smithi050.stdout:8/912: creat d3/d2a/d30/f139 x:0 0 0 2023-01-04T18:17:15.676 INFO:tasks.workunit.client.0.smithi050.stdout:6/839: creat d0/d5c/d5d/f103 x:0 0 0 2023-01-04T18:17:15.679 INFO:tasks.workunit.client.0.smithi050.stdout:2/812: rename d1/dd/d62/da1/d6e/fad to d1/dd/d28/d79/de4/f112 0 2023-01-04T18:17:15.679 INFO:tasks.workunit.client.0.smithi050.stdout:2/813: fsync d1/dd/d11/d14/f30 0 2023-01-04T18:17:15.679 INFO:tasks.workunit.client.0.smithi050.stdout:2/814: chown d1/dd/d28/d2c/d66/ce1 3178105 1 2023-01-04T18:17:15.681 INFO:tasks.workunit.client.0.smithi050.stdout:1/854: mknod d8/d48/d5c/c106 0 2023-01-04T18:17:15.681 INFO:tasks.workunit.client.0.smithi050.stdout:9/829: dread d1/d3/d24/d7b/f91 [0,4194304] 0 2023-01-04T18:17:15.682 INFO:tasks.workunit.client.0.smithi050.stdout:3/827: mknod d0/d8f/d46/df7/d11a/d2f/c11b 0 2023-01-04T18:17:15.684 INFO:tasks.workunit.client.0.smithi050.stdout:3/828: dread d0/d8f/d46/df7/d11a/d2f/fbc [0,4194304] 0 2023-01-04T18:17:15.685 INFO:tasks.workunit.client.0.smithi050.stdout:7/942: symlink d6/db/d3a/dbd/l137 0 2023-01-04T18:17:15.686 INFO:tasks.workunit.client.0.smithi050.stdout:7/943: dread - d6/d90/f107 zero size 2023-01-04T18:17:15.686 INFO:tasks.workunit.client.0.smithi050.stdout:7/944: chown d6/db/f60 6 1 2023-01-04T18:17:15.689 INFO:tasks.workunit.client.0.smithi050.stdout:8/913: link d3/d2a/d30/d3b/d4d/d23/d55/d5f/d82/dcb/fe6 d3/d2a/d74/d92/dcc/f13a 0 2023-01-04T18:17:15.690 INFO:tasks.workunit.client.0.smithi050.stdout:6/840: creat d0/d9/df/f104 x:0 0 0 2023-01-04T18:17:15.692 INFO:tasks.workunit.client.0.smithi050.stdout:3/829: creat d0/d1a/f11c x:0 0 0 2023-01-04T18:17:15.696 INFO:tasks.workunit.client.0.smithi050.stdout:9/830: dread d1/d12/d41/d60/d95/f99 [0,4194304] 0 2023-01-04T18:17:15.698 INFO:tasks.workunit.client.0.smithi050.stdout:4/840: dwrite d14/d1b/d1f/d22/d87/de0/d108/d5d/d7f/de1/fe3 [0,4194304] 0 2023-01-04T18:17:15.698 INFO:tasks.workunit.client.0.smithi050.stdout:2/815: dread d1/dd/d62/da1/f7d [0,4194304] 0 2023-01-04T18:17:15.698 INFO:tasks.workunit.client.0.smithi050.stdout:2/816: read - d1/dd/d11/db5/df8/f107 zero size 2023-01-04T18:17:15.698 INFO:tasks.workunit.client.0.smithi050.stdout:1/855: dwrite d8/d14/d1c/d28/d57/de6/fee [0,4194304] 0 2023-01-04T18:17:15.699 INFO:tasks.workunit.client.0.smithi050.stdout:9/831: dread d1/d3/d24/d7b/f91 [0,4194304] 0 2023-01-04T18:17:15.720 INFO:tasks.workunit.client.0.smithi050.stdout:6/841: symlink d0/d9/df/dba/dca/d6b/da4/l105 0 2023-01-04T18:17:15.720 INFO:tasks.workunit.client.0.smithi050.stdout:6/842: chown d0/d5c/fbc 70657458 1 2023-01-04T18:17:15.721 INFO:tasks.workunit.client.0.smithi050.stdout:3/830: creat d0/d8f/f11d x:0 0 0 2023-01-04T18:17:15.731 INFO:tasks.workunit.client.0.smithi050.stdout:2/817: creat d1/dd/d28/d2c/d2e/f113 x:0 0 0 2023-01-04T18:17:15.731 INFO:tasks.workunit.client.0.smithi050.stdout:2/818: chown d1/dd/d28/d79/de4/f112 2865 1 2023-01-04T18:17:15.731 INFO:tasks.workunit.client.0.smithi050.stdout:6/843: dread d0/d9/df/dba/dca/d6b/fb8 [0,4194304] 0 2023-01-04T18:17:15.731 INFO:tasks.workunit.client.0.smithi050.stdout:2/819: write d1/dd/d11/f9c [2168812,73034] 0 2023-01-04T18:17:15.735 INFO:tasks.workunit.client.0.smithi050.stdout:1/856: link d8/d48/d5c/d67/d91/cad d8/d14/d1c/d28/dc7/c107 0 2023-01-04T18:17:15.736 INFO:tasks.workunit.client.0.smithi050.stdout:1/857: write d8/d14/d1c/f76 [3463342,5695] 0 2023-01-04T18:17:15.743 INFO:tasks.workunit.client.0.smithi050.stdout:9/832: dread d1/d3/d11/d1f/f21 [4194304,4194304] 0 2023-01-04T18:17:15.750 INFO:tasks.workunit.client.0.smithi050.stdout:6/844: rmdir d0/d4a/d93 39 2023-01-04T18:17:15.750 INFO:tasks.workunit.client.0.smithi050.stdout:6/845: chown d0/d9/df/dba/cf9 271 1 2023-01-04T18:17:15.754 INFO:tasks.workunit.client.0.smithi050.stdout:3/831: rmdir d0/d1a 39 2023-01-04T18:17:15.757 INFO:tasks.workunit.client.0.smithi050.stdout:0/680: sync 2023-01-04T18:17:15.759 INFO:tasks.workunit.client.0.smithi050.stdout:2/820: creat d1/dd/d28/f114 x:0 0 0 2023-01-04T18:17:15.768 INFO:tasks.workunit.client.0.smithi050.stdout:1/858: rmdir d8/d14/d1c/d28/dc7/dca 39 2023-01-04T18:17:15.770 INFO:tasks.workunit.client.0.smithi050.stdout:9/833: link d1/d3/dec/c93 d1/d3/d11/d1f/cff 0 2023-01-04T18:17:15.772 INFO:tasks.workunit.client.0.smithi050.stdout:3/832: link d0/d8f/d46/df7/d11a/d2f/d56/la9 d0/d8f/deb/l11e 0 2023-01-04T18:17:15.773 INFO:tasks.workunit.client.0.smithi050.stdout:9/834: rename d1/d3/d24/d7b/laf to d1/d12/d2d/l100 0 2023-01-04T18:17:15.780 INFO:tasks.workunit.client.0.smithi050.stdout:3/833: unlink d0/dd/d45/l7c 0 2023-01-04T18:17:15.780 INFO:tasks.workunit.client.0.smithi050.stdout:9/835: stat d1/d12/d2d/l100 0 2023-01-04T18:17:15.780 INFO:tasks.workunit.client.0.smithi050.stdout:9/836: creat d1/d3/d11/d1f/f101 x:0 0 0 2023-01-04T18:17:15.783 INFO:tasks.workunit.client.0.smithi050.stdout:9/837: symlink d1/d3/dbf/dd4/l102 0 2023-01-04T18:17:15.784 INFO:tasks.workunit.client.0.smithi050.stdout:1/859: dread d8/f13 [0,4194304] 0 2023-01-04T18:17:15.784 INFO:tasks.workunit.client.0.smithi050.stdout:1/860: chown d8/d14/d1c/d28/dc7/dd6/fd5 83442859 1 2023-01-04T18:17:15.785 INFO:tasks.workunit.client.0.smithi050.stdout:3/834: dread d0/d8f/d46/df7/d11a/d2f/d31/f3d [0,4194304] 0 2023-01-04T18:17:15.786 INFO:tasks.workunit.client.0.smithi050.stdout:1/861: rename d8/d48/d5c/d67/d91/fa3 to d8/d14/d1c/d28/f108 0 2023-01-04T18:17:15.787 INFO:tasks.workunit.client.0.smithi050.stdout:3/835: mkdir d0/d8f/d11f 0 2023-01-04T18:17:15.787 INFO:tasks.workunit.client.0.smithi050.stdout:3/836: write d0/d10/f65 [751411,109253] 0 2023-01-04T18:17:15.788 INFO:tasks.workunit.client.0.smithi050.stdout:1/862: creat d8/d48/d5c/d67/d3b/db9/dde/f109 x:0 0 0 2023-01-04T18:17:15.791 INFO:tasks.workunit.client.0.smithi050.stdout:6/846: dwrite d0/d5c/d5d/f103 [0,4194304] 0 2023-01-04T18:17:15.792 INFO:tasks.workunit.client.0.smithi050.stdout:2/821: dwrite d1/dd/d11/d14/d91/d5a/f102 [0,4194304] 0 2023-01-04T18:17:15.792 INFO:tasks.workunit.client.0.smithi050.stdout:0/681: dwrite d0/d6/d28/d1a/d8a/d9e/fd0 [0,4194304] 0 2023-01-04T18:17:15.819 INFO:tasks.workunit.client.0.smithi050.stdout:3/837: creat d0/d8f/d46/df7/d11a/d2f/d56/d98/d9c/dcd/f120 x:0 0 0 2023-01-04T18:17:15.819 INFO:tasks.workunit.client.0.smithi050.stdout:3/838: chown d0/d1a/f4e 16339 1 2023-01-04T18:17:15.820 INFO:tasks.workunit.client.0.smithi050.stdout:1/863: symlink d8/d14/d1c/d28/dc7/dca/l10a 0 2023-01-04T18:17:15.826 INFO:tasks.workunit.client.0.smithi050.stdout:2/822: rmdir d1/dd/d28/d2c/dce 39 2023-01-04T18:17:15.835 INFO:tasks.workunit.client.0.smithi050.stdout:0/682: rmdir d0 39 2023-01-04T18:17:15.836 INFO:tasks.workunit.client.0.smithi050.stdout:1/864: dread d8/d48/dac/fbe [0,4194304] 0 2023-01-04T18:17:15.839 INFO:tasks.workunit.client.0.smithi050.stdout:6/847: dwrite d0/d9/df/f47 [0,4194304] 0 2023-01-04T18:17:15.843 INFO:tasks.workunit.client.0.smithi050.stdout:3/839: dwrite d0/dd/d45/fe8 [0,4194304] 0 2023-01-04T18:17:15.844 INFO:tasks.workunit.client.0.smithi050.stdout:0/683: dread d0/d6/d8/d51/f7d [0,4194304] 0 2023-01-04T18:17:15.844 INFO:tasks.workunit.client.0.smithi050.stdout:0/684: write d0/d6/d28/fad [816252,22492] 0 2023-01-04T18:17:15.847 INFO:tasks.workunit.client.0.smithi050.stdout:2/823: dwrite d1/dd/d62/da1/d6e/f9e [0,4194304] 0 2023-01-04T18:17:15.847 INFO:tasks.workunit.client.0.smithi050.stdout:2/824: chown d1/dd/d28/d2c/cc7 33321836 1 2023-01-04T18:17:15.848 INFO:tasks.workunit.client.0.smithi050.stdout:2/825: stat d1/dd/d11/d12/lc8 0 2023-01-04T18:17:15.848 INFO:tasks.workunit.client.0.smithi050.stdout:2/826: fsync d1/dd/d28/d2c/d66/f87 0 2023-01-04T18:17:15.856 INFO:tasks.workunit.client.0.smithi050.stdout:3/840: truncate d0/f5e 2940114 0 2023-01-04T18:17:15.856 INFO:tasks.workunit.client.0.smithi050.stdout:3/841: write d0/d8f/d46/fb5 [4377819,88486] 0 2023-01-04T18:17:15.857 INFO:tasks.workunit.client.0.smithi050.stdout:3/842: readlink d0/d8f/d46/dc2/d107/dbb/ld3 0 2023-01-04T18:17:15.863 INFO:tasks.workunit.client.0.smithi050.stdout:0/685: dread d0/f7e [4194304,4194304] 0 2023-01-04T18:17:15.863 INFO:tasks.workunit.client.0.smithi050.stdout:2/827: mknod d1/dd/d62/d69/c115 0 2023-01-04T18:17:15.864 INFO:tasks.workunit.client.0.smithi050.stdout:1/865: dwrite d8/d14/d1c/fb1 [4194304,4194304] 0 2023-01-04T18:17:15.866 INFO:tasks.workunit.client.0.smithi050.stdout:5/983: sync 2023-01-04T18:17:15.867 INFO:tasks.workunit.client.0.smithi050.stdout:5/984: chown d13/d15/d66/db8/c38 26217034 1 2023-01-04T18:17:15.867 INFO:tasks.workunit.client.0.smithi050.stdout:5/985: stat d13/d15/d66/db8/d27/d44/d47/d124/d59/fcf 0 2023-01-04T18:17:15.871 INFO:tasks.workunit.client.0.smithi050.stdout:3/843: truncate d0/d8f/f27 1994508 0 2023-01-04T18:17:15.871 INFO:tasks.workunit.client.0.smithi050.stdout:6/848: dwrite d0/d9/df/dba/dca/f9c [0,4194304] 0 2023-01-04T18:17:15.871 INFO:tasks.workunit.client.0.smithi050.stdout:6/849: write d0/d9/df/f56 [1244778,14895] 0 2023-01-04T18:17:15.873 INFO:tasks.workunit.client.0.smithi050.stdout:0/686: mkdir d0/d9f/d84/dd8 0 2023-01-04T18:17:15.875 INFO:tasks.workunit.client.0.smithi050.stdout:0/687: dread d0/d6/d8/f89 [0,4194304] 0 2023-01-04T18:17:15.877 INFO:tasks.workunit.client.0.smithi050.stdout:2/828: creat d1/dd/d28/d2c/d66/da2/f116 x:0 0 0 2023-01-04T18:17:15.878 INFO:tasks.workunit.client.0.smithi050.stdout:2/829: readlink d1/dd/d11/d14/d91/d5a/lfc 0 2023-01-04T18:17:15.878 INFO:tasks.workunit.client.0.smithi050.stdout:2/830: fdatasync d1/dd/d62/da1/d6e/f9e 0 2023-01-04T18:17:15.878 INFO:tasks.workunit.client.0.smithi050.stdout:2/831: write d1/dd/d11/d14/f33 [2741846,94922] 0 2023-01-04T18:17:15.880 INFO:tasks.workunit.client.0.smithi050.stdout:2/832: dread d1/f111 [0,4194304] 0 2023-01-04T18:17:15.882 INFO:tasks.workunit.client.0.smithi050.stdout:1/866: mkdir d8/d14/d1c/d28/dc7/dca/d10b 0 2023-01-04T18:17:15.882 INFO:tasks.workunit.client.0.smithi050.stdout:1/867: fdatasync d8/d14/d1c/d28/fc4 0 2023-01-04T18:17:15.882 INFO:tasks.workunit.client.0.smithi050.stdout:1/868: write d8/dce/f80 [1001686,59542] 0 2023-01-04T18:17:15.882 INFO:tasks.workunit.client.0.smithi050.stdout:1/869: write d8/d14/fb2 [601964,73528] 0 2023-01-04T18:17:15.883 INFO:tasks.workunit.client.0.smithi050.stdout:1/870: read d8/d48/d5c/d67/d3a/f79 [2954402,79969] 0 2023-01-04T18:17:15.883 INFO:tasks.workunit.client.0.smithi050.stdout:1/871: readlink d8/d48/d5c/d67/d3b/l98 0 2023-01-04T18:17:15.883 INFO:tasks.workunit.client.0.smithi050.stdout:5/986: mknod d13/d15/d66/db8/d27/d46/d4e/d4d/da9/c167 0 2023-01-04T18:17:15.884 INFO:tasks.workunit.client.0.smithi050.stdout:5/987: write d13/d15/f26 [169484,97794] 0 2023-01-04T18:17:15.897 INFO:tasks.workunit.client.0.smithi050.stdout:6/850: mknod d0/d9/d25/d2d/c106 0 2023-01-04T18:17:15.898 INFO:tasks.workunit.client.0.smithi050.stdout:5/988: dwrite d13/d15/d66/db8/d27/d78/f103 [0,4194304] 0 2023-01-04T18:17:15.901 INFO:tasks.workunit.client.0.smithi050.stdout:3/844: rmdir d0 39 2023-01-04T18:17:15.906 INFO:tasks.workunit.client.0.smithi050.stdout:0/688: mkdir d0/d6/d8/d51/dd9 0 2023-01-04T18:17:15.910 INFO:tasks.workunit.client.0.smithi050.stdout:1/872: mknod d8/d48/d5c/d67/d3a/dd1/c10c 0 2023-01-04T18:17:15.911 INFO:tasks.workunit.client.0.smithi050.stdout:1/873: chown d8/d48/dac/fbe 505941746 1 2023-01-04T18:17:15.914 INFO:tasks.workunit.client.0.smithi050.stdout:5/989: dwrite d13/d15/d66/db8/d27/d44/d47/d124/d42/f79 [0,4194304] 0 2023-01-04T18:17:15.914 INFO:tasks.workunit.client.0.smithi050.stdout:5/990: chown d13/d15/d66/db2 0 1 2023-01-04T18:17:15.916 INFO:tasks.workunit.client.0.smithi050.stdout:6/851: creat d0/d9/df/dba/dca/d6b/da4/dab/f107 x:0 0 0 2023-01-04T18:17:15.916 INFO:tasks.workunit.client.0.smithi050.stdout:6/852: chown d0/d9/d38/cad 4870216 1 2023-01-04T18:17:15.919 INFO:tasks.workunit.client.0.smithi050.stdout:2/833: dread d1/dd/f4a [0,4194304] 0 2023-01-04T18:17:15.919 INFO:tasks.workunit.client.0.smithi050.stdout:2/834: readlink d1/dd/d11/d14/l46 0 2023-01-04T18:17:15.919 INFO:tasks.workunit.client.0.smithi050.stdout:2/835: truncate d1/dd/d11/d14/d91/d5a/d7f/f10b 1038582 0 2023-01-04T18:17:15.919 INFO:tasks.workunit.client.0.smithi050.stdout:2/836: chown d1/dd/d11/d14/d91/d5a/d7f/f93 1 1 2023-01-04T18:17:15.924 INFO:tasks.workunit.client.0.smithi050.stdout:3/845: symlink d0/d8f/d46/d80/dca/l121 0 2023-01-04T18:17:15.928 INFO:tasks.workunit.client.0.smithi050.stdout:6/853: symlink d0/l108 0 2023-01-04T18:17:15.928 INFO:tasks.workunit.client.0.smithi050.stdout:0/689: dread d0/d6/f58 [0,4194304] 0 2023-01-04T18:17:15.930 INFO:tasks.workunit.client.0.smithi050.stdout:3/846: rename d0/d8f/deb/ff3 to d0/d8f/deb/f122 0 2023-01-04T18:17:15.932 INFO:tasks.workunit.client.0.smithi050.stdout:0/690: creat d0/d6/fda x:0 0 0 2023-01-04T18:17:15.934 INFO:tasks.workunit.client.0.smithi050.stdout:3/847: symlink d0/d10/l123 0 2023-01-04T18:17:15.935 INFO:tasks.workunit.client.0.smithi050.stdout:6/854: truncate d0/d9/d38/f23 77112 0 2023-01-04T18:17:15.936 INFO:tasks.workunit.client.0.smithi050.stdout:0/691: mknod d0/d9f/d84/dd8/cdb 0 2023-01-04T18:17:15.938 INFO:tasks.workunit.client.0.smithi050.stdout:3/848: creat d0/d8f/d46/df7/d11a/d2f/d56/d98/dc7/ded/f124 x:0 0 0 2023-01-04T18:17:15.938 INFO:tasks.workunit.client.0.smithi050.stdout:3/849: chown d0/d10/f42 1305502094 1 2023-01-04T18:17:15.939 INFO:tasks.workunit.client.0.smithi050.stdout:6/855: rmdir d0/d9/d25/d4d 39 2023-01-04T18:17:15.945 INFO:tasks.workunit.client.0.smithi050.stdout:0/692: rename d0/d6/f21 to d0/d9f/d84/dd8/fdc 0 2023-01-04T18:17:15.948 INFO:tasks.workunit.client.0.smithi050.stdout:5/991: dwrite d13/d28/f36 [0,4194304] 0 2023-01-04T18:17:15.949 INFO:tasks.workunit.client.0.smithi050.stdout:3/850: mkdir d0/d8f/d46/d80/d125 0 2023-01-04T18:17:15.949 INFO:tasks.workunit.client.0.smithi050.stdout:3/851: read - d0/d8f/deb/fdb zero size 2023-01-04T18:17:15.950 INFO:tasks.workunit.client.0.smithi050.stdout:1/874: dwrite d8/d48/d5c/d67/fa9 [0,4194304] 0 2023-01-04T18:17:15.950 INFO:tasks.workunit.client.0.smithi050.stdout:2/837: dwrite d1/dd/d62/d69/f84 [4194304,4194304] 0 2023-01-04T18:17:15.950 INFO:tasks.workunit.client.0.smithi050.stdout:2/838: fdatasync d1/dd/d28/d2c/fc0 0 2023-01-04T18:17:15.959 INFO:tasks.workunit.client.0.smithi050.stdout:5/992: mkdir d13/d15/d66/db8/d137/d168 0 2023-01-04T18:17:15.959 INFO:tasks.workunit.client.0.smithi050.stdout:5/993: chown d13/d15/d66/db8/d27/d46/d4e/d4d/d115/f142 2 1 2023-01-04T18:17:15.960 INFO:tasks.workunit.client.0.smithi050.stdout:5/994: write d13/d15/f34 [1359109,5863] 0 2023-01-04T18:17:15.960 INFO:tasks.workunit.client.0.smithi050.stdout:5/995: chown d13/fe4 382443075 1 2023-01-04T18:17:15.964 INFO:tasks.workunit.client.0.smithi050.stdout:3/852: link d0/d8f/cd9 d0/d8f/d46/d80/c126 0 2023-01-04T18:17:15.970 INFO:tasks.workunit.client.0.smithi050.stdout:6/856: dwrite d0/d9/d25/d4d/f66 [0,4194304] 0 2023-01-04T18:17:15.970 INFO:tasks.workunit.client.0.smithi050.stdout:6/857: chown d0/d9/df/dba/dca/f37 2141567 1 2023-01-04T18:17:15.970 INFO:tasks.workunit.client.0.smithi050.stdout:6/858: dread - d0/d9/df/dba/dca/d6b/fc1 zero size 2023-01-04T18:17:15.972 INFO:tasks.workunit.client.0.smithi050.stdout:1/875: creat d8/d48/d5c/d67/d3b/f10d x:0 0 0 2023-01-04T18:17:15.981 INFO:tasks.workunit.client.0.smithi050.stdout:0/693: dwrite d0/d6/d28/d1a/d8a/d9e/fb2 [0,4194304] 0 2023-01-04T18:17:15.985 INFO:tasks.workunit.client.0.smithi050.stdout:2/839: dwrite d1/dd/d11/d14/d91/d5a/d7f/f8f [0,4194304] 0 2023-01-04T18:17:15.985 INFO:tasks.workunit.client.0.smithi050.stdout:2/840: dread - d1/dd/d28/d2c/d2e/d36/f10e zero size 2023-01-04T18:17:15.985 INFO:tasks.workunit.client.0.smithi050.stdout:5/996: dwrite d13/d15/d66/db8/d27/d46/d4e/d4d/d115/f142 [0,4194304] 0 2023-01-04T18:17:15.993 INFO:tasks.workunit.client.0.smithi050.stdout:2/841: dread d1/dd/d28/d2c/d66/da2/fdf [0,4194304] 0 2023-01-04T18:17:15.993 INFO:tasks.workunit.client.0.smithi050.stdout:2/842: read - d1/dd/d28/d2c/d2e/d3f/fd7 zero size 2023-01-04T18:17:15.994 INFO:tasks.workunit.client.0.smithi050.stdout:1/876: dread d8/dce/f80 [0,4194304] 0 2023-01-04T18:17:15.999 INFO:tasks.workunit.client.0.smithi050.stdout:7/945: sync 2023-01-04T18:17:16.001 INFO:tasks.workunit.client.0.smithi050.stdout:3/853: mknod d0/d8f/d46/df7/d11a/d2f/d56/d98/dc7/ded/c127 0 2023-01-04T18:17:16.005 INFO:tasks.workunit.client.0.smithi050.stdout:6/859: rename d0/d4a/d93/fa8 to d0/d9/d25/d40/d89/dd9/d7a/f109 0 2023-01-04T18:17:16.007 INFO:tasks.workunit.client.0.smithi050.stdout:0/694: truncate d0/d73/f61 7063516 0 2023-01-04T18:17:16.008 INFO:tasks.workunit.client.0.smithi050.stdout:0/695: getdents d0/d6/d8/d51/dd9 0 2023-01-04T18:17:16.008 INFO:tasks.workunit.client.0.smithi050.stdout:0/696: fsync d0/d9f/fb4 0 2023-01-04T18:17:16.011 INFO:tasks.workunit.client.0.smithi050.stdout:5/997: dread - d13/d15/d66/db8/d27/d46/d4e/d4d/fcd zero size 2023-01-04T18:17:16.017 INFO:tasks.workunit.client.0.smithi050.stdout:6/860: dread d0/d5c/db7/fa6 [0,4194304] 0 2023-01-04T18:17:16.018 INFO:tasks.workunit.client.0.smithi050.stdout:2/843: mkdir d1/dd/d62/d69/d117 0 2023-01-04T18:17:16.021 INFO:tasks.workunit.client.0.smithi050.stdout:1/877: mkdir d8/d48/d5c/d67/d10e 0 2023-01-04T18:17:16.022 INFO:tasks.workunit.client.0.smithi050.stdout:8/914: sync 2023-01-04T18:17:16.022 INFO:tasks.workunit.client.0.smithi050.stdout:4/841: sync 2023-01-04T18:17:16.023 INFO:tasks.workunit.client.0.smithi050.stdout:9/838: sync 2023-01-04T18:17:16.023 INFO:tasks.workunit.client.0.smithi050.stdout:8/915: truncate d3/d2a/d30/d3b/d4d/d23/d55/d5f/f103 746727 0 2023-01-04T18:17:16.023 INFO:tasks.workunit.client.0.smithi050.stdout:9/839: write d1/d3/dbf/dd4/da8/fc9 [667593,1624] 0 2023-01-04T18:17:16.027 INFO:tasks.workunit.client.0.smithi050.stdout:3/854: rename d0/d8f/d46/df7/d11a/d2f/d56/d98/d9c/dcd/l43 to d0/d8f/l128 0 2023-01-04T18:17:16.027 INFO:tasks.workunit.client.0.smithi050.stdout:1/878: rename d8/d14 to d8/d14/d1c/d28/d57/d6a/daf/d10f 22 2023-01-04T18:17:16.028 INFO:tasks.workunit.client.0.smithi050.stdout:0/697: mknod d0/d6/cdd 0 2023-01-04T18:17:16.029 INFO:tasks.workunit.client.0.smithi050.stdout:0/698: getdents d0/d6/d8/d51/dd9 0 2023-01-04T18:17:16.029 INFO:tasks.workunit.client.0.smithi050.stdout:0/699: read d0/d6/d28/d1a/d8a/d9e/fd0 [3000057,92853] 0 2023-01-04T18:17:16.030 INFO:tasks.workunit.client.0.smithi050.stdout:5/998: mkdir d13/d15/d66/db8/d27/d44/df2/d169 0 2023-01-04T18:17:16.031 INFO:tasks.workunit.client.0.smithi050.stdout:5/999: fdatasync d13/d15/d66/db8/d27/d46/d4e/d4d/fcd 0 2023-01-04T18:17:16.032 INFO:tasks.workunit.client.0.smithi050.stdout:7/946: write d6/db/d15/d1b/f8c [1039550,43238] 0 2023-01-04T18:17:16.034 INFO:tasks.workunit.client.0.smithi050.stdout:6/861: mkdir d0/d9/df/dba/dca/d6b/da4/dab/dec/df6/d10a 0 2023-01-04T18:17:16.036 INFO:tasks.workunit.client.0.smithi050.stdout:4/842: unlink d14/f51 0 2023-01-04T18:17:16.036 INFO:tasks.workunit.client.0.smithi050.stdout:4/843: truncate d14/d1b/d1f/d22/d87/de0/d108/d5f/d80/fdc 380884 0 2023-01-04T18:17:16.037 INFO:tasks.workunit.client.0.smithi050.stdout:4/844: stat d14/d1b/d1f/d22/d3e/d85/da6/fbb 0 2023-01-04T18:17:16.037 INFO:tasks.workunit.client.0.smithi050.stdout:4/845: write d14/d1b/d1f/d22/d87/de0/d108/d5f/d80/f10c [1034705,98185] 0 2023-01-04T18:17:16.038 INFO:tasks.workunit.client.0.smithi050.stdout:9/840: unlink d1/lcc 0 2023-01-04T18:17:16.040 INFO:tasks.workunit.client.0.smithi050.stdout:8/916: creat d3/d2a/d27/d93/d7f/d96/db6/f13b x:0 0 0 2023-01-04T18:17:16.040 INFO:tasks.workunit.client.0.smithi050.stdout:8/917: fsync d3/d2a/f9b 0 2023-01-04T18:17:16.041 INFO:tasks.workunit.client.0.smithi050.stdout:8/918: truncate d3/d2a/d27/d93/d7a/fe0 527331 0 2023-01-04T18:17:16.042 INFO:tasks.workunit.client.0.smithi050.stdout:3/855: truncate d0/d8f/f25 73815 0 2023-01-04T18:17:16.042 INFO:tasks.workunit.client.0.smithi050.stdout:3/856: truncate d0/d8f/d46/df7/d11a/d2f/d31/f7e 1382454 0 2023-01-04T18:17:16.043 INFO:tasks.workunit.client.0.smithi050.stdout:1/879: symlink d8/d14/d1c/d28/d57/de6/l110 0 2023-01-04T18:17:16.044 INFO:tasks.workunit.client.0.smithi050.stdout:1/880: write d8/d14/fb2 [479549,94727] 0 2023-01-04T18:17:16.044 INFO:tasks.workunit.client.0.smithi050.stdout:8/919: write d3/d2a/d30/d3b/d4d/d23/f10b [6084881,25582] 0 2023-01-04T18:17:16.045 INFO:tasks.workunit.client.0.smithi050.stdout:0/700: creat d0/d73/d79/fde x:0 0 0 2023-01-04T18:17:16.046 INFO:tasks.workunit.client.0.smithi050.stdout:0/701: read d0/f53 [2324031,52265] 0 2023-01-04T18:17:16.048 INFO:tasks.workunit.client.0.smithi050.stdout:6/862: symlink d0/d5c/db7/d83/de5/l10b 0 2023-01-04T18:17:16.049 INFO:tasks.workunit.client.0.smithi050.stdout:2/844: truncate d1/dd/d62/da1/f25 2436418 0 2023-01-04T18:17:16.050 INFO:tasks.workunit.client.0.smithi050.stdout:4/846: mkdir d14/d1b/d1f/d22/d3e/d85/d118 0 2023-01-04T18:17:16.050 INFO:tasks.workunit.client.0.smithi050.stdout:4/847: read - d14/d1b/d1f/d63/da5/db6/fc0 zero size 2023-01-04T18:17:16.052 INFO:tasks.workunit.client.0.smithi050.stdout:9/841: creat d1/d3/d24/d7b/f103 x:0 0 0 2023-01-04T18:17:16.053 INFO:tasks.workunit.client.0.smithi050.stdout:3/857: truncate d0/d10/f16 741142 0 2023-01-04T18:17:16.056 INFO:tasks.workunit.client.0.smithi050.stdout:1/881: rmdir d8/d14/d1c/d28/d57/df9 0 2023-01-04T18:17:16.056 INFO:tasks.workunit.client.0.smithi050.stdout:1/882: fsync d8/d48/d5c/d67/d3a/fff 0 2023-01-04T18:17:16.057 INFO:tasks.workunit.client.0.smithi050.stdout:1/883: chown d8/d48/d5c/d67/d3a/cda 2145315046 1 2023-01-04T18:17:16.057 INFO:tasks.workunit.client.0.smithi050.stdout:1/884: readlink d8/d14/d1c/d28/d57/d6a/le5 0 2023-01-04T18:17:16.057 INFO:tasks.workunit.client.0.smithi050.stdout:1/885: fdatasync d8/d14/d1c/d28/d57/de6/fe9 0 2023-01-04T18:17:16.058 INFO:tasks.workunit.client.0.smithi050.stdout:7/947: dwrite d6/f27 [4194304,4194304] 0 2023-01-04T18:17:16.058 INFO:tasks.workunit.client.0.smithi050.stdout:1/886: write d8/d48/fc0 [3937,20383] 0 2023-01-04T18:17:16.058 INFO:tasks.workunit.client.0.smithi050.stdout:8/920: creat d3/d2a/d30/d3b/d4d/d23/d55/d5f/f13c x:0 0 0 2023-01-04T18:17:16.058 INFO:tasks.workunit.client.0.smithi050.stdout:8/921: dread - d3/d2a/d2d/fdc zero size 2023-01-04T18:17:16.058 INFO:tasks.workunit.client.0.smithi050.stdout:8/922: fdatasync d3/d2a/d30/d3b/d4d/d23/d55/d5f/fbf 0 2023-01-04T18:17:16.059 INFO:tasks.workunit.client.0.smithi050.stdout:0/702: creat d0/d6/d28/fdf x:0 0 0 2023-01-04T18:17:16.059 INFO:tasks.workunit.client.0.smithi050.stdout:0/703: stat d0/d73/d68/l87 0 2023-01-04T18:17:16.059 INFO:tasks.workunit.client.0.smithi050.stdout:0/704: stat d0/d6/d8/d25/l4b 0 2023-01-04T18:17:16.060 INFO:tasks.workunit.client.0.smithi050.stdout:0/705: write d0/d6/f55 [1939498,100499] 0 2023-01-04T18:17:16.062 INFO:tasks.workunit.client.0.smithi050.stdout:6/863: creat d0/d4a/d93/db1/dce/f10c x:0 0 0 2023-01-04T18:17:16.077 INFO:tasks.workunit.client.0.smithi050.stdout:2/845: creat d1/dd/d11/d14/d91/d5a/d7f/df5/f118 x:0 0 0 2023-01-04T18:17:16.077 INFO:tasks.workunit.client.0.smithi050.stdout:2/846: fsync d1/dd/d11/d14/d91/d5a/fb6 0 2023-01-04T18:17:16.079 INFO:tasks.workunit.client.0.smithi050.stdout:7/948: dwrite d6/db/d15/d1b/d22/da6/fa7 [0,4194304] 0 2023-01-04T18:17:16.079 INFO:tasks.workunit.client.0.smithi050.stdout:7/949: write d6/db/d3a/dd2/d10f/f10c [799897,84804] 0 2023-01-04T18:17:16.079 INFO:tasks.workunit.client.0.smithi050.stdout:7/950: truncate d6/db/d15/d1b/f8c 1979770 0 2023-01-04T18:17:16.079 INFO:tasks.workunit.client.0.smithi050.stdout:7/951: chown d6/db/d15/d1b/d22/da6/fa7 92347524 1 2023-01-04T18:17:16.079 INFO:tasks.workunit.client.0.smithi050.stdout:4/848: mknod d14/d1b/d66/dc1/c119 0 2023-01-04T18:17:16.081 INFO:tasks.workunit.client.0.smithi050.stdout:7/952: write d6/d6b/d8b/f91 [3152601,92939] 0 2023-01-04T18:17:16.081 INFO:tasks.workunit.client.0.smithi050.stdout:7/953: write d6/fbf [4498584,82748] 0 2023-01-04T18:17:16.081 INFO:tasks.workunit.client.0.smithi050.stdout:9/842: dread d1/d12/d2d/d39/fae [0,4194304] 0 2023-01-04T18:17:16.083 INFO:tasks.workunit.client.0.smithi050.stdout:3/858: getdents d0/d10 0 2023-01-04T18:17:16.085 INFO:tasks.workunit.client.0.smithi050.stdout:7/954: dread d6/d28/d32/f52 [0,4194304] 0 2023-01-04T18:17:16.085 INFO:tasks.workunit.client.0.smithi050.stdout:7/955: chown d6/db/d15/c7e 1192816049 1 2023-01-04T18:17:16.092 INFO:tasks.workunit.client.0.smithi050.stdout:1/887: symlink d8/d48/d5c/d67/d91/l111 0 2023-01-04T18:17:16.095 INFO:tasks.workunit.client.0.smithi050.stdout:8/923: link d3/d2a/d30/d3b/d4d/d23/d31/ca7 d3/d2a/d30/d3b/d4d/d23/d55/c13d 0 2023-01-04T18:17:16.097 INFO:tasks.workunit.client.0.smithi050.stdout:0/706: creat d0/d6/d8/d51/dd9/fe0 x:0 0 0 2023-01-04T18:17:16.100 INFO:tasks.workunit.client.0.smithi050.stdout:6/864: rmdir d0/d9/df/d74 39 2023-01-04T18:17:16.101 INFO:tasks.workunit.client.0.smithi050.stdout:6/865: read d0/d9/d25/f3a [960036,69627] 0 2023-01-04T18:17:16.105 INFO:tasks.workunit.client.0.smithi050.stdout:2/847: read d1/dd/d11/f65 [1814816,45644] 0 2023-01-04T18:17:16.107 INFO:tasks.workunit.client.0.smithi050.stdout:1/888: dread d8/f12 [0,4194304] 0 2023-01-04T18:17:16.107 INFO:tasks.workunit.client.0.smithi050.stdout:1/889: truncate d8/d14/d1c/d28/f3f 1241379 0 2023-01-04T18:17:16.108 INFO:tasks.workunit.client.0.smithi050.stdout:2/848: read d1/dd/d62/da1/d83/fa6 [3297657,21699] 0 2023-01-04T18:17:16.110 INFO:tasks.workunit.client.0.smithi050.stdout:6/866: dread d0/d9/df/f47 [0,4194304] 0 2023-01-04T18:17:16.111 INFO:tasks.workunit.client.0.smithi050.stdout:4/849: mknod d14/d1b/d1f/d22/d3e/d85/da6/c11a 0 2023-01-04T18:17:16.113 INFO:tasks.workunit.client.0.smithi050.stdout:9/843: symlink d1/d12/d3f/de1/de5/l104 0 2023-01-04T18:17:16.115 INFO:tasks.workunit.client.0.smithi050.stdout:3/859: creat d0/d8f/d46/df7/d11a/d2f/f129 x:0 0 0 2023-01-04T18:17:16.115 INFO:tasks.workunit.client.0.smithi050.stdout:3/860: fdatasync d0/d10/f16 0 2023-01-04T18:17:16.118 INFO:tasks.workunit.client.0.smithi050.stdout:0/707: dwrite d0/d6/d28/d1a/d8a/fb6 [0,4194304] 0 2023-01-04T18:17:16.121 INFO:tasks.workunit.client.0.smithi050.stdout:7/956: mkdir d6/db/d15/d1b/d70/d12e/d138 0 2023-01-04T18:17:16.122 INFO:tasks.workunit.client.0.smithi050.stdout:7/957: chown d6/d90/de3/d116/fdc 449 1 2023-01-04T18:17:16.122 INFO:tasks.workunit.client.0.smithi050.stdout:8/924: rename d3/d2a/d74/d92/c98 to d3/c13e 0 2023-01-04T18:17:16.195 INFO:tasks.workunit.client.0.smithi050.stdout:1/890: getdents d8/d48/d5c 0 2023-01-04T18:17:16.197 INFO:tasks.workunit.client.0.smithi050.stdout:2/849: symlink d1/dd/d62/da1/l119 0 2023-01-04T18:17:16.198 INFO:tasks.workunit.client.0.smithi050.stdout:6/867: symlink d0/d5c/l10d 0 2023-01-04T18:17:16.200 INFO:tasks.workunit.client.0.smithi050.stdout:4/850: mknod d14/d1b/d1f/d22/d87/de0/d108/d5d/d7f/c11b 0 2023-01-04T18:17:16.202 INFO:tasks.workunit.client.0.smithi050.stdout:4/851: read d14/d1b/f50 [901176,123165] 0 2023-01-04T18:17:16.202 INFO:tasks.workunit.client.0.smithi050.stdout:4/852: read f7 [789208,87991] 0 2023-01-04T18:17:16.217 INFO:tasks.workunit.client.0.smithi050.stdout:2/850: dwrite d1/dd/d11/db5/f104 [0,4194304] 0 2023-01-04T18:17:16.217 INFO:tasks.workunit.client.0.smithi050.stdout:2/851: chown d1/f97 2395087 1 2023-01-04T18:17:16.222 INFO:tasks.workunit.client.0.smithi050.stdout:4/853: dwrite d14/d1b/d1f/d22/d6a/f92 [0,4194304] 0 2023-01-04T18:17:16.223 INFO:tasks.workunit.client.0.smithi050.stdout:4/854: chown d14/d1b/d1f/d22/d87/f114 288216788 1 2023-01-04T18:17:16.223 INFO:tasks.workunit.client.0.smithi050.stdout:4/855: fsync d14/d1b/d32/fab 0 2023-01-04T18:17:16.262 INFO:tasks.workunit.client.0.smithi050.stdout:9/844: mkdir d1/d3/d11/d105 0 2023-01-04T18:17:16.306 INFO:tasks.workunit.client.0.smithi050.stdout:0/708: creat d0/d6/d8/d51/fe1 x:0 0 0 2023-01-04T18:17:16.306 INFO:tasks.workunit.client.0.smithi050.stdout:0/709: chown d0/d6/d28/d1a/d8a/fc9 2714 1 2023-01-04T18:17:16.310 INFO:tasks.workunit.client.0.smithi050.stdout:8/925: link d3/d2a/d30/d3b/d4d/d23/d55/d5f/c64 d3/d2a/d2d/d86/dd1/c13f 0 2023-01-04T18:17:16.310 INFO:tasks.workunit.client.0.smithi050.stdout:8/926: dread - d3/d2a/d27/dc1/f119 zero size 2023-01-04T18:17:16.314 INFO:tasks.workunit.client.0.smithi050.stdout:7/958: rename d6/d28/fd4 to d6/db/d15/d48/dc7/d124/d125/d82/f139 0 2023-01-04T18:17:16.323 INFO:tasks.workunit.client.0.smithi050.stdout:7/959: dread d6/d6b/d8b/fb8 [0,4194304] 0 2023-01-04T18:17:16.326 INFO:tasks.workunit.client.0.smithi050.stdout:8/927: dwrite d3/d2a/d30/f115 [0,4194304] 0 2023-01-04T18:17:16.327 INFO:tasks.workunit.client.0.smithi050.stdout:6/868: symlink d0/d9/d38/l10e 0 2023-01-04T18:17:16.335 INFO:tasks.workunit.client.0.smithi050.stdout:4/856: mkdir d14/d1b/d1f/d22/d3e/d85/d118/d11c 0 2023-01-04T18:17:16.340 INFO:tasks.workunit.client.0.smithi050.stdout:6/869: dread d0/d9/d25/d2d/f73 [0,4194304] 0 2023-01-04T18:17:16.340 INFO:tasks.workunit.client.0.smithi050.stdout:6/870: write d0/d9/df/dba/dca/d6b/da4/dab/f107 [409121,125343] 0 2023-01-04T18:17:16.343 INFO:tasks.workunit.client.0.smithi050.stdout:8/928: dwrite d3/d2a/d74/d92/d94/d9c/f108 [0,4194304] 0 2023-01-04T18:17:16.356 INFO:tasks.workunit.client.0.smithi050.stdout:9/845: mknod d1/d3/d11/c106 0 2023-01-04T18:17:16.360 INFO:tasks.workunit.client.0.smithi050.stdout:0/710: creat d0/d6/d8/d25/d8e/fe2 x:0 0 0 2023-01-04T18:17:16.360 INFO:tasks.workunit.client.0.smithi050.stdout:0/711: fdatasync d0/d9f/d84/fb8 0 2023-01-04T18:17:16.360 INFO:tasks.workunit.client.0.smithi050.stdout:0/712: fsync d0/d6/d8/d51/f8d 0 2023-01-04T18:17:16.360 INFO:tasks.workunit.client.0.smithi050.stdout:0/713: dread - d0/d6/d8/d51/fe1 zero size 2023-01-04T18:17:16.360 INFO:tasks.workunit.client.0.smithi050.stdout:0/714: fsync d0/d6/d8/d35/f66 0 2023-01-04T18:17:16.364 INFO:tasks.workunit.client.0.smithi050.stdout:1/891: rename d8/d48/d5c/d67/d3a/d23/l2a to d8/d14/l112 0 2023-01-04T18:17:16.366 INFO:tasks.workunit.client.0.smithi050.stdout:7/960: link d6/db/d15/d48/dc7/d124/d125/d82/ff3 d6/db/d15/d1b/d70/f13a 0 2023-01-04T18:17:16.366 INFO:tasks.workunit.client.0.smithi050.stdout:0/715: dread d0/d6/d8/f18 [4194304,4194304] 0 2023-01-04T18:17:16.366 INFO:tasks.workunit.client.0.smithi050.stdout:0/716: fdatasync d0/d6/d8/d35/fa4 0 2023-01-04T18:17:16.367 INFO:tasks.workunit.client.0.smithi050.stdout:0/717: write d0/d6/d8/d25/fca [2927395,45034] 0 2023-01-04T18:17:16.410 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:15.923446+0000 mgr.smithi098.vhfzum (mgr.24455) 52 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 1.9 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 89 MiB/s rd, 192 MiB/s wr, 380 op/s 2023-01-04T18:17:16.436 INFO:tasks.workunit.client.0.smithi050.stdout:4/857: symlink d14/d1b/d1f/d22/d87/de0/d108/d5f/d80/d9d/l11d 0 2023-01-04T18:17:16.441 INFO:tasks.workunit.client.0.smithi050.stdout:6/871: truncate d0/d9/df/dba/dca/d6b/fc3 341543 0 2023-01-04T18:17:16.441 INFO:tasks.workunit.client.0.smithi050.stdout:6/872: fdatasync d0/f14 0 2023-01-04T18:17:16.441 INFO:tasks.workunit.client.0.smithi050.stdout:6/873: write d0/d9/df/dba/dca/d6b/f101 [769040,120220] 0 2023-01-04T18:17:16.442 INFO:tasks.workunit.client.0.smithi050.stdout:6/874: fdatasync d0/d5c/db7/f8a 0 2023-01-04T18:17:16.442 INFO:tasks.workunit.client.0.smithi050.stdout:6/875: write d0/d9/f2b [1112458,75675] 0 2023-01-04T18:17:16.452 INFO:tasks.workunit.client.0.smithi050.stdout:9/846: mknod d1/d3/d24/c107 0 2023-01-04T18:17:16.452 INFO:tasks.workunit.client.0.smithi050.stdout:9/847: fsync d1/d3/d24/d7b/f91 0 2023-01-04T18:17:16.452 INFO:tasks.workunit.client.0.smithi050.stdout:9/848: fsync d1/d3/dbf/dd4/da8/ffc 0 2023-01-04T18:17:16.452 INFO:tasks.workunit.client.0.smithi050.stdout:9/849: truncate d1/d12/d2d/d39/fae 788893 0 2023-01-04T18:17:16.452 INFO:tasks.workunit.client.0.smithi050.stdout:3/861: sync 2023-01-04T18:17:16.454 INFO:tasks.workunit.client.0.smithi050.stdout:2/852: rename d1/dd/d62/da1/caa to d1/dd/d11/d14/c11a 0 2023-01-04T18:17:16.456 INFO:tasks.workunit.client.0.smithi050.stdout:1/892: creat d8/d48/d5c/d67/d3b/db9/f113 x:0 0 0 2023-01-04T18:17:16.457 INFO:tasks.workunit.client.0.smithi050.stdout:1/893: write d8/d14/d1c/f40 [2904445,52305] 0 2023-01-04T18:17:16.458 INFO:tasks.workunit.client.0.smithi050.stdout:7/961: link d6/db/d15/d2e/d66/f12a d6/ded/f13b 0 2023-01-04T18:17:16.459 INFO:tasks.workunit.client.0.smithi050.stdout:7/962: truncate d6/d28/d32/f52 887810 0 2023-01-04T18:17:16.459 INFO:tasks.workunit.client.0.smithi050.stdout:7/963: write d6/d6b/d8b/fb8 [4277305,101611] 0 2023-01-04T18:17:16.464 INFO:tasks.workunit.client.0.smithi050.stdout:0/718: getdents d0/d6/d8/d35/dbe 0 2023-01-04T18:17:16.464 INFO:tasks.workunit.client.0.smithi050.stdout:0/719: fsync d0/d6/d28/f49 0 2023-01-04T18:17:16.464 INFO:tasks.workunit.client.0.smithi050.stdout:0/720: fsync d0/d6/d8/d51/f7b 0 2023-01-04T18:17:16.465 INFO:tasks.workunit.client.0.smithi050.stdout:4/858: mknod d14/d1b/d1f/d22/d87/de0/d108/d5d/c11e 0 2023-01-04T18:17:16.470 INFO:tasks.workunit.client.0.smithi050.stdout:6/876: mkdir d0/db6/d10f 0 2023-01-04T18:17:16.472 INFO:tasks.workunit.client.0.smithi050.stdout:3/862: creat d0/d8f/d46/dc2/d107/dbb/f12a x:0 0 0 2023-01-04T18:17:16.472 INFO:tasks.workunit.client.0.smithi050.stdout:3/863: truncate d0/d8f/f11d 1012299 0 2023-01-04T18:17:16.475 INFO:tasks.workunit.client.0.smithi050.stdout:9/850: rename d1/d3/d89/cf8 to d1/d3/d11/dcd/c108 0 2023-01-04T18:17:16.475 INFO:tasks.workunit.client.0.smithi050.stdout:9/851: chown d1/d3/d3b/d63 521 1 2023-01-04T18:17:16.478 INFO:tasks.workunit.client.0.smithi050.stdout:3/864: read d0/d1a/f58 [2888920,48517] 0 2023-01-04T18:17:16.479 INFO:tasks.workunit.client.0.smithi050.stdout:1/894: symlink d8/d14/d1c/d28/d57/l114 0 2023-01-04T18:17:16.482 INFO:tasks.workunit.client.0.smithi050.stdout:0/721: mknod d0/d6/d8/d51/dd9/ce3 0 2023-01-04T18:17:16.482 INFO:tasks.workunit.client.0.smithi050.stdout:0/722: write d0/d6/d8/f13 [4465901,40480] 0 2023-01-04T18:17:16.484 INFO:tasks.workunit.client.0.smithi050.stdout:4/859: symlink d14/d1b/d1f/d22/d3e/d44/l11f 0 2023-01-04T18:17:16.484 INFO:tasks.workunit.client.0.smithi050.stdout:4/860: chown d14/d1b/d1f/d63/da5/cd0 3189383 1 2023-01-04T18:17:16.486 INFO:tasks.workunit.client.0.smithi050.stdout:2/853: rename d1/dd/d28/fe0 to d1/dd/d11/d12/f11b 0 2023-01-04T18:17:16.486 INFO:tasks.workunit.client.0.smithi050.stdout:2/854: read - d1/dd/d28/d2c/d2e/d36/f10e zero size 2023-01-04T18:17:16.486 INFO:tasks.workunit.client.0.smithi050.stdout:2/855: readlink d1/dd/d11/db5/df8/l6b 0 2023-01-04T18:17:16.486 INFO:tasks.workunit.client.0.smithi050.stdout:2/856: chown d1/f86 7691 1 2023-01-04T18:17:16.487 INFO:tasks.workunit.client.0.smithi050.stdout:6/877: dwrite d0/d9/df/dba/dca/d6b/da4/dab/f107 [0,4194304] 0 2023-01-04T18:17:16.489 INFO:tasks.workunit.client.0.smithi050.stdout:9/852: unlink d1/d12/d2d/l100 0 2023-01-04T18:17:16.490 INFO:tasks.workunit.client.0.smithi050.stdout:3/865: creat d0/dd/d45/f12b x:0 0 0 2023-01-04T18:17:16.494 INFO:tasks.workunit.client.0.smithi050.stdout:1/895: creat d8/d14/d1c/d28/d57/d6a/d92/dec/f115 x:0 0 0 2023-01-04T18:17:16.494 INFO:tasks.workunit.client.0.smithi050.stdout:1/896: read - d8/d14/d1c/d28/d57/de6/ffb zero size 2023-01-04T18:17:16.502 INFO:tasks.workunit.client.0.smithi050.stdout:7/964: link d6/db/d3b/fcc d6/db/d20/d4f/d6e/dc2/f13c 0 2023-01-04T18:17:16.503 INFO:tasks.workunit.client.0.smithi050.stdout:0/723: mknod d0/d6/d8/d51/ce4 0 2023-01-04T18:17:16.506 INFO:tasks.workunit.client.0.smithi050.stdout:0/724: read d0/f6d [235906,72820] 0 2023-01-04T18:17:16.506 INFO:tasks.workunit.client.0.smithi050.stdout:0/725: read d0/d73/d79/f88 [370402,43794] 0 2023-01-04T18:17:16.506 INFO:tasks.workunit.client.0.smithi050.stdout:2/857: creat d1/dd/d11/db5/df8/f11c x:0 0 0 2023-01-04T18:17:16.511 INFO:tasks.workunit.client.0.smithi050.stdout:3/866: unlink d0/d8f/deb/f99 0 2023-01-04T18:17:16.511 INFO:tasks.workunit.client.0.smithi050.stdout:3/867: read - d0/d8f/d46/df7/d11a/d2f/d71/f7b zero size 2023-01-04T18:17:16.511 INFO:tasks.workunit.client.0.smithi050.stdout:9/853: dwrite d1/d3/d11/f5d [0,4194304] 0 2023-01-04T18:17:16.512 INFO:tasks.workunit.client.0.smithi050.stdout:1/897: dwrite d8/d48/d5c/d67/d3a/d23/f102 [0,4194304] 0 2023-01-04T18:17:16.512 INFO:tasks.workunit.client.0.smithi050.stdout:1/898: chown d8/d14/ca1 532277960 1 2023-01-04T18:17:16.512 INFO:tasks.workunit.client.0.smithi050.stdout:1/899: chown d8/d14/d1c/d28/dc7/lfe 103665402 1 2023-01-04T18:17:16.512 INFO:tasks.workunit.client.0.smithi050.stdout:1/900: stat d8/d48/d5c/d67/d3b/db9 0 2023-01-04T18:17:16.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:15.923446+0000 mgr.smithi098.vhfzum (mgr.24455) 52 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 1.9 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 89 MiB/s rd, 192 MiB/s wr, 380 op/s 2023-01-04T18:17:16.584 INFO:tasks.workunit.client.0.smithi050.stdout:7/965: getdents d6/d28/d32 0 2023-01-04T18:17:16.584 INFO:tasks.workunit.client.0.smithi050.stdout:7/966: truncate d6/db/d3a/dd2/d10f/f10c 1057155 0 2023-01-04T18:17:16.585 INFO:tasks.workunit.client.0.smithi050.stdout:4/861: truncate d14/d1b/f2f 3333326 0 2023-01-04T18:17:16.587 INFO:tasks.workunit.client.0.smithi050.stdout:0/726: unlink d0/d6/d28/d1a/d8a/fb5 0 2023-01-04T18:17:16.588 INFO:tasks.workunit.client.0.smithi050.stdout:2/858: mknod d1/dd/d28/d2c/d66/c11d 0 2023-01-04T18:17:16.589 INFO:tasks.workunit.client.0.smithi050.stdout:3/868: truncate d0/d8f/deb/ff2 2644 0 2023-01-04T18:17:16.592 INFO:tasks.workunit.client.0.smithi050.stdout:9/854: mkdir d1/d3/d109 0 2023-01-04T18:17:16.596 INFO:tasks.workunit.client.0.smithi050.stdout:1/901: mkdir d8/d48/d5c/d67/d3b/d116 0 2023-01-04T18:17:16.596 INFO:tasks.workunit.client.0.smithi050.stdout:1/902: chown d8/d14/ca1 7493 1 2023-01-04T18:17:16.603 INFO:tasks.workunit.client.0.smithi050.stdout:1/903: dread d8/d14/f7b [0,4194304] 0 2023-01-04T18:17:16.607 INFO:tasks.workunit.client.0.smithi050.stdout:3/869: dwrite d0/d8f/d46/df7/d11a/d2f/d56/d98/dc7/ded/f124 [0,4194304] 0 2023-01-04T18:17:16.607 INFO:tasks.workunit.client.0.smithi050.stdout:3/870: chown d0/d8f/d46/d80/dca/dee/ffb 628483700 1 2023-01-04T18:17:16.608 INFO:tasks.workunit.client.0.smithi050.stdout:7/967: mknod d6/db/d3a/dbd/c13d 0 2023-01-04T18:17:16.613 INFO:tasks.workunit.client.0.smithi050.stdout:4/862: creat d14/d1b/d66/dc1/f120 x:0 0 0 2023-01-04T18:17:16.617 INFO:tasks.workunit.client.0.smithi050.stdout:0/727: symlink d0/d6/d28/d1a/le5 0 2023-01-04T18:17:16.617 INFO:tasks.workunit.client.0.smithi050.stdout:0/728: dread - d0/d6/d8/d51/fe1 zero size 2023-01-04T18:17:16.618 INFO:tasks.workunit.client.0.smithi050.stdout:0/729: truncate d0/d6/d28/d1a/d8a/fd7 366640 0 2023-01-04T18:17:16.619 INFO:tasks.workunit.client.0.smithi050.stdout:2/859: mknod d1/d41/c11e 0 2023-01-04T18:17:16.619 INFO:tasks.workunit.client.0.smithi050.stdout:2/860: stat d1/dd/d11/d12/cea 0 2023-01-04T18:17:16.620 INFO:tasks.workunit.client.0.smithi050.stdout:3/871: dread d0/d8f/f93 [0,4194304] 0 2023-01-04T18:17:16.622 INFO:tasks.workunit.client.0.smithi050.stdout:9/855: mknod d1/d3/dbf/dd4/c10a 0 2023-01-04T18:17:16.630 INFO:tasks.workunit.client.0.smithi050.stdout:1/904: dread d8/d14/f74 [4194304,4194304] 0 2023-01-04T18:17:16.649 INFO:tasks.workunit.client.0.smithi050.stdout:3/872: dwrite d0/d8f/d46/dc2/d107/dbb/f12a [0,4194304] 0 2023-01-04T18:17:16.649 INFO:tasks.workunit.client.0.smithi050.stdout:3/873: write d0/d8f/d46/dc2/d107/fb2 [204648,16300] 0 2023-01-04T18:17:16.651 INFO:tasks.workunit.client.0.smithi050.stdout:2/861: dwrite d1/dd/d11/d14/f33 [0,4194304] 0 2023-01-04T18:17:16.665 INFO:tasks.workunit.client.0.smithi050.stdout:3/874: dwrite d0/d8f/d46/df7/d11a/d2f/d31/f8e [0,4194304] 0 2023-01-04T18:17:16.667 INFO:tasks.workunit.client.0.smithi050.stdout:7/968: creat d6/db/d15/d1b/d70/f13e x:0 0 0 2023-01-04T18:17:16.667 INFO:tasks.workunit.client.0.smithi050.stdout:7/969: readlink d6/db/d15/d1b/d70/la1 0 2023-01-04T18:17:16.669 INFO:tasks.workunit.client.0.smithi050.stdout:8/929: sync 2023-01-04T18:17:16.672 INFO:tasks.workunit.client.0.smithi050.stdout:4/863: rename d14/c17 to d14/d9e/c121 0 2023-01-04T18:17:16.673 INFO:tasks.workunit.client.0.smithi050.stdout:9/856: mkdir d1/d12/d3f/d10b 0 2023-01-04T18:17:16.675 INFO:tasks.workunit.client.0.smithi050.stdout:1/905: unlink d8/d48/d5c/d67/d3a/f6d 0 2023-01-04T18:17:16.676 INFO:tasks.workunit.client.0.smithi050.stdout:1/906: write d8/d14/f35 [2169057,39924] 0 2023-01-04T18:17:16.676 INFO:tasks.workunit.client.0.smithi050.stdout:1/907: chown d8/f13 250530789 1 2023-01-04T18:17:16.677 INFO:tasks.workunit.client.0.smithi050.stdout:1/908: fsync d8/f44 0 2023-01-04T18:17:16.677 INFO:tasks.workunit.client.0.smithi050.stdout:1/909: write d8/d14/d1c/d28/d57/d6a/d92/dec/f7a [3308012,100442] 0 2023-01-04T18:17:16.677 INFO:tasks.workunit.client.0.smithi050.stdout:1/910: chown d8/d14/d1c/d28/fb5 11431 1 2023-01-04T18:17:16.685 INFO:tasks.workunit.client.0.smithi050.stdout:2/862: getdents d1/dd/d28/d2c/d2e/d36 0 2023-01-04T18:17:16.692 INFO:tasks.workunit.client.0.smithi050.stdout:7/970: unlink d6/db/d20/d4f/lef 0 2023-01-04T18:17:16.694 INFO:tasks.workunit.client.0.smithi050.stdout:6/878: sync 2023-01-04T18:17:16.694 INFO:tasks.workunit.client.0.smithi050.stdout:6/879: dread - d0/d9/d25/dd4/fee zero size 2023-01-04T18:17:16.694 INFO:tasks.workunit.client.0.smithi050.stdout:6/880: dread - d0/d9/df/d74/ffd zero size 2023-01-04T18:17:16.695 INFO:tasks.workunit.client.0.smithi050.stdout:8/930: creat d3/d2a/d30/d3b/f140 x:0 0 0 2023-01-04T18:17:16.695 INFO:tasks.workunit.client.0.smithi050.stdout:8/931: fsync d3/d2a/d27/dc1/f119 0 2023-01-04T18:17:16.698 INFO:tasks.workunit.client.0.smithi050.stdout:3/875: rename d0/d8f/cd9 to d0/d8f/d46/df7/d11a/c12c 0 2023-01-04T18:17:16.699 INFO:tasks.workunit.client.0.smithi050.stdout:3/876: write d0/d8f/d46/df7/d11a/d2f/fb7 [3832540,15513] 0 2023-01-04T18:17:16.699 INFO:tasks.workunit.client.0.smithi050.stdout:3/877: truncate d0/d8f/d46/df7/d11a/d2f/f129 916347 0 2023-01-04T18:17:16.702 INFO:tasks.workunit.client.0.smithi050.stdout:4/864: creat d14/d1b/d1f/d22/d87/de0/d108/d5d/d7f/f122 x:0 0 0 2023-01-04T18:17:16.703 INFO:tasks.workunit.client.0.smithi050.stdout:9/857: mknod d1/d3/dbf/dd4/da8/dda/c10c 0 2023-01-04T18:17:16.704 INFO:tasks.workunit.client.0.smithi050.stdout:1/911: creat d8/d14/d1c/d28/dcd/f117 x:0 0 0 2023-01-04T18:17:16.706 INFO:tasks.workunit.client.0.smithi050.stdout:1/912: write d8/f4d [1191513,17131] 0 2023-01-04T18:17:16.706 INFO:tasks.workunit.client.0.smithi050.stdout:1/913: fdatasync d8/d48/dac/fbe 0 2023-01-04T18:17:16.706 INFO:tasks.workunit.client.0.smithi050.stdout:2/863: getdents d1/dd/d62 0 2023-01-04T18:17:16.706 INFO:tasks.workunit.client.0.smithi050.stdout:2/864: write d1/dd/d28/ff0 [927722,38172] 0 2023-01-04T18:17:16.713 INFO:tasks.workunit.client.0.smithi050.stdout:3/878: dwrite d0/d8f/d46/df7/d11a/d2f/d31/f3d [0,4194304] 0 2023-01-04T18:17:16.713 INFO:tasks.workunit.client.0.smithi050.stdout:7/971: link d6/db/d20/c92 d6/d28/d99/dd7/c13f 0 2023-01-04T18:17:16.713 INFO:tasks.workunit.client.0.smithi050.stdout:7/972: truncate d6/db/d15/d1b/d5b/f114 545273 0 2023-01-04T18:17:16.716 INFO:tasks.workunit.client.0.smithi050.stdout:6/881: mknod d0/d9/d38/c110 0 2023-01-04T18:17:16.722 INFO:tasks.workunit.client.0.smithi050.stdout:8/932: symlink d3/d2a/d27/l141 0 2023-01-04T18:17:16.725 INFO:tasks.workunit.client.0.smithi050.stdout:4/865: mknod d14/d1b/d1f/d63/c123 0 2023-01-04T18:17:16.727 INFO:tasks.workunit.client.0.smithi050.stdout:9/858: creat d1/f10d x:0 0 0 2023-01-04T18:17:16.731 INFO:tasks.workunit.client.0.smithi050.stdout:1/914: creat d8/d48/d5c/d67/d3b/db9/dde/f118 x:0 0 0 2023-01-04T18:17:16.733 INFO:tasks.workunit.client.0.smithi050.stdout:2/865: creat d1/dd/d28/d2c/d66/da2/f11f x:0 0 0 2023-01-04T18:17:16.735 INFO:tasks.workunit.client.0.smithi050.stdout:9/859: dread d1/d12/d9f/fd8 [0,4194304] 0 2023-01-04T18:17:16.737 INFO:tasks.workunit.client.0.smithi050.stdout:3/879: unlink d0/d8f/d46/df7/d11a/d2f/d56/cd4 0 2023-01-04T18:17:16.738 INFO:tasks.workunit.client.0.smithi050.stdout:7/973: link d6/db/f60 d6/db/d15/d48/f140 0 2023-01-04T18:17:16.738 INFO:tasks.workunit.client.0.smithi050.stdout:7/974: read d6/db/d20/d4f/d6e/dc2/f13c [1689444,97575] 0 2023-01-04T18:17:16.739 INFO:tasks.workunit.client.0.smithi050.stdout:6/882: symlink d0/d9/df/d74/l111 0 2023-01-04T18:17:16.739 INFO:tasks.workunit.client.0.smithi050.stdout:6/883: fsync d0/d9/df/ff1 0 2023-01-04T18:17:16.741 INFO:tasks.workunit.client.0.smithi050.stdout:8/933: link d3/d2a/fd7 d3/d2a/d30/d3b/d4d/d23/d31/f142 0 2023-01-04T18:17:16.742 INFO:tasks.workunit.client.0.smithi050.stdout:4/866: symlink d14/d1b/d1f/d63/dcb/l124 0 2023-01-04T18:17:16.743 INFO:tasks.workunit.client.0.smithi050.stdout:1/915: write d8/d14/d1c/d28/fb5 [261320,101602] 0 2023-01-04T18:17:16.745 INFO:tasks.workunit.client.0.smithi050.stdout:4/867: write d14/d1b/d1f/d22/d3e/d85/f94 [1806415,61723] 0 2023-01-04T18:17:16.746 INFO:tasks.workunit.client.0.smithi050.stdout:2/866: creat d1/dd/d11/d14/d91/d5a/dfa/f120 x:0 0 0 2023-01-04T18:17:16.747 INFO:tasks.workunit.client.0.smithi050.stdout:3/880: dread d0/d8f/d46/df7/d11a/d2f/fb7 [0,4194304] 0 2023-01-04T18:17:16.748 INFO:tasks.workunit.client.0.smithi050.stdout:7/975: creat d6/db/d15/f141 x:0 0 0 2023-01-04T18:17:16.753 INFO:tasks.workunit.client.0.smithi050.stdout:7/976: write d6/db/d3b/fe5 [580690,95522] 0 2023-01-04T18:17:16.756 INFO:tasks.workunit.client.0.smithi050.stdout:9/860: dwrite d1/d12/d2d/d39/f66 [0,4194304] 0 2023-01-04T18:17:16.765 INFO:tasks.workunit.client.0.smithi050.stdout:8/934: rmdir d3/d2a/d74/d92 39 2023-01-04T18:17:16.767 INFO:tasks.workunit.client.0.smithi050.stdout:6/884: rename d0/d9 to d0/d5c/d5d/d112 0 2023-01-04T18:17:16.771 INFO:tasks.workunit.client.0.smithi050.stdout:4/868: dwrite d14/d1b/d1f/d22/d87/de0/d108/d5f/d80/fa3 [0,4194304] 0 2023-01-04T18:17:16.773 INFO:tasks.workunit.client.0.smithi050.stdout:1/916: dwrite d8/d14/d1c/d28/fb5 [0,4194304] 0 2023-01-04T18:17:16.777 INFO:tasks.workunit.client.0.smithi050.stdout:2/867: mkdir d1/dd/d28/d121 0 2023-01-04T18:17:16.779 INFO:tasks.workunit.client.0.smithi050.stdout:2/868: dread d1/dd/d11/d14/d44/fb7 [0,4194304] 0 2023-01-04T18:17:16.780 INFO:tasks.workunit.client.0.smithi050.stdout:3/881: rmdir d0/d1a 39 2023-01-04T18:17:16.780 INFO:tasks.workunit.client.0.smithi050.stdout:3/882: chown d0/d8f/deb/ff2 11640 1 2023-01-04T18:17:16.780 INFO:tasks.workunit.client.0.smithi050.stdout:3/883: chown d0/d10/l69 9086 1 2023-01-04T18:17:16.783 INFO:tasks.workunit.client.0.smithi050.stdout:7/977: mknod d6/d6b/d135/c142 0 2023-01-04T18:17:16.788 INFO:tasks.workunit.client.0.smithi050.stdout:8/935: getdents d3/d2a/d30/d3b/d4d/d23/d55/d5f/d82 0 2023-01-04T18:17:16.791 INFO:tasks.workunit.client.0.smithi050.stdout:9/861: rename d1/d3/d3b/f27 to d1/d3/d11/d42/f10e 0 2023-01-04T18:17:16.796 INFO:tasks.workunit.client.0.smithi050.stdout:1/917: dwrite d8/d48/fc0 [0,4194304] 0 2023-01-04T18:17:16.798 INFO:tasks.workunit.client.0.smithi050.stdout:4/869: dwrite d14/d1b/d1f/d22/d87/de0/d108/d5d/d7f/de1/ff5 [0,4194304] 0 2023-01-04T18:17:16.800 INFO:tasks.workunit.client.0.smithi050.stdout:3/884: creat d0/d8f/d46/df7/d11a/d2f/f12d x:0 0 0 2023-01-04T18:17:16.800 INFO:tasks.workunit.client.0.smithi050.stdout:8/936: creat d3/d2a/d27/d93/d7f/d96/d46/f143 x:0 0 0 2023-01-04T18:17:16.801 INFO:tasks.workunit.client.0.smithi050.stdout:7/978: dwrite d6/d28/ffd [0,4194304] 0 2023-01-04T18:17:16.814 INFO:tasks.workunit.client.0.smithi050.stdout:2/869: mknod d1/dd/d11/dcc/c122 0 2023-01-04T18:17:16.814 INFO:tasks.workunit.client.0.smithi050.stdout:2/870: truncate d1/f111 2087059 0 2023-01-04T18:17:16.822 INFO:tasks.workunit.client.0.smithi050.stdout:8/937: dwrite d3/d2a/d74/d118/f12f [0,4194304] 0 2023-01-04T18:17:16.824 INFO:tasks.workunit.client.0.smithi050.stdout:4/870: symlink d14/d1b/d1f/d22/d87/de0/d108/d5d/l125 0 2023-01-04T18:17:16.830 INFO:tasks.workunit.client.0.smithi050.stdout:3/885: rmdir d0/d8f/d46/d80/d125 0 2023-01-04T18:17:16.830 INFO:tasks.workunit.client.0.smithi050.stdout:3/886: fsync d0/d8f/d46/df7/d11a/d2f/f44 0 2023-01-04T18:17:16.843 INFO:tasks.workunit.client.0.smithi050.stdout:7/979: rmdir d6/d28/d99 39 2023-01-04T18:17:16.848 INFO:tasks.workunit.client.0.smithi050.stdout:0/730: sync 2023-01-04T18:17:16.848 INFO:tasks.workunit.client.0.smithi050.stdout:0/731: chown d0/d6/d28/d1a/d8a/d9e/fb2 132 1 2023-01-04T18:17:16.849 INFO:tasks.workunit.client.0.smithi050.stdout:6/885: rename d0/d5c/d5d/d112/df/dba/dca/d6b/da4/dab/dec/df6 to d0/d5c/d5d/d112/df/dba/d113 0 2023-01-04T18:17:16.850 INFO:tasks.workunit.client.0.smithi050.stdout:6/886: read d0/d4a/d93/faa [101416,106565] 0 2023-01-04T18:17:16.850 INFO:tasks.workunit.client.0.smithi050.stdout:6/887: fsync d0/fb5 0 2023-01-04T18:17:16.851 INFO:tasks.workunit.client.0.smithi050.stdout:2/871: fsync d1/dd/d11/f54 0 2023-01-04T18:17:16.853 INFO:tasks.workunit.client.0.smithi050.stdout:1/918: creat d8/d14/d1c/d28/dcd/f119 x:0 0 0 2023-01-04T18:17:16.860 INFO:tasks.workunit.client.0.smithi050.stdout:6/888: dread d0/d5c/d5d/d112/d38/f5b [4194304,4194304] 0 2023-01-04T18:17:16.862 INFO:tasks.workunit.client.0.smithi050.stdout:4/871: creat d14/d1b/d1f/d22/d3e/d85/d118/d11c/f126 x:0 0 0 2023-01-04T18:17:16.864 INFO:tasks.workunit.client.0.smithi050.stdout:3/887: truncate d0/d8f/d46/df7/d11a/d2f/d31/f97 4753398 0 2023-01-04T18:17:16.866 INFO:tasks.workunit.client.0.smithi050.stdout:7/980: unlink d6/db/d15/d2e/d66/f12a 0 2023-01-04T18:17:16.867 INFO:tasks.workunit.client.0.smithi050.stdout:0/732: mkdir d0/d6/d28/d1a/de6 0 2023-01-04T18:17:16.869 INFO:tasks.workunit.client.0.smithi050.stdout:9/862: rename d1/d3/d13/d77/f8c to d1/d3/dbf/f10f 0 2023-01-04T18:17:16.870 INFO:tasks.workunit.client.0.smithi050.stdout:9/863: write d1/d12/d9f/fd8 [1294330,43910] 0 2023-01-04T18:17:16.870 INFO:tasks.workunit.client.0.smithi050.stdout:2/872: creat d1/dd/db0/f123 x:0 0 0 2023-01-04T18:17:16.874 INFO:tasks.workunit.client.0.smithi050.stdout:6/889: rmdir d0/d5c 39 2023-01-04T18:17:16.876 INFO:tasks.workunit.client.0.smithi050.stdout:9/864: dread d1/d12/f22 [0,4194304] 0 2023-01-04T18:17:16.876 INFO:tasks.workunit.client.0.smithi050.stdout:9/865: fdatasync d1/d12/d41/d60/d8e/ffd 0 2023-01-04T18:17:16.877 INFO:tasks.workunit.client.0.smithi050.stdout:3/888: mkdir d0/d1a/dc3/d12e 0 2023-01-04T18:17:16.877 INFO:tasks.workunit.client.0.smithi050.stdout:3/889: chown d0/d10/f3e 852 1 2023-01-04T18:17:16.882 INFO:tasks.workunit.client.0.smithi050.stdout:7/981: rmdir d6/db/d15/d1b 39 2023-01-04T18:17:16.886 INFO:tasks.workunit.client.0.smithi050.stdout:0/733: link d0/d73/d79/f88 d0/d6/d28/fe7 0 2023-01-04T18:17:16.886 INFO:tasks.workunit.client.0.smithi050.stdout:0/734: stat d0/d9f/da1 0 2023-01-04T18:17:16.888 INFO:tasks.workunit.client.0.smithi050.stdout:8/938: rename d3/d2a/d27/d93/fce to d3/d2a/d30/f144 0 2023-01-04T18:17:16.954 INFO:tasks.workunit.client.0.smithi050.stdout:2/873: unlink d1/dd/d28/d2c/d2e/d36/dd0/ff2 0 2023-01-04T18:17:16.955 INFO:tasks.workunit.client.0.smithi050.stdout:1/919: symlink d8/d14/d1c/d28/dc7/dd6/l11a 0 2023-01-04T18:17:16.957 INFO:tasks.workunit.client.0.smithi050.stdout:6/890: mknod d0/d5c/d5d/d112/d25/d40/dcf/c114 0 2023-01-04T18:17:16.958 INFO:tasks.workunit.client.0.smithi050.stdout:9/866: mknod d1/d3/d89/c110 0 2023-01-04T18:17:16.958 INFO:tasks.workunit.client.0.smithi050.stdout:9/867: chown d1/d12/d2d/d39/fd2 32 1 2023-01-04T18:17:16.961 INFO:tasks.workunit.client.0.smithi050.stdout:3/890: symlink d0/d8f/d46/dc2/d107/dbb/l12f 0 2023-01-04T18:17:16.966 INFO:tasks.workunit.client.0.smithi050.stdout:7/982: creat d6/db/d3a/dd2/f143 x:0 0 0 2023-01-04T18:17:17.038 INFO:tasks.workunit.client.0.smithi050.stdout:8/939: rename d3/d2a/d74/d92/d94/dc9/le1 to d3/d2a/d27/dc1/l145 0 2023-01-04T18:17:17.040 INFO:tasks.workunit.client.0.smithi050.stdout:2/874: mknod d1/d10/c124 0 2023-01-04T18:17:17.040 INFO:tasks.workunit.client.0.smithi050.stdout:2/875: chown d1/dd/d11/d14/d91/d5a/lfc 0 1 2023-01-04T18:17:17.052 INFO:tasks.workunit.client.0.smithi050.stdout:1/920: write d8/d14/fb3 [1783206,23325] 0 2023-01-04T18:17:17.052 INFO:tasks.workunit.client.0.smithi050.stdout:9/868: read d1/d12/d41/fa3 [24036,87784] 0 2023-01-04T18:17:17.055 INFO:tasks.workunit.client.0.smithi050.stdout:4/872: rename d14/d1b/d1f/d22/d87/de0/d108/d5f/d6f/cb9 to d14/d1b/d1f/d22/d87/de0/d108/d5f/d80/c127 0 2023-01-04T18:17:17.057 INFO:tasks.workunit.client.0.smithi050.stdout:2/876: mkdir d1/dd/d11/d14/d91/d5a/d7f/df5/d125 0 2023-01-04T18:17:17.059 INFO:tasks.workunit.client.0.smithi050.stdout:1/921: rmdir d8/d48/d5c/d67/d91 39 2023-01-04T18:17:17.061 INFO:tasks.workunit.client.0.smithi050.stdout:6/891: rename d0/d5c/d5d/d112/f4b to d0/d5c/db7/f115 0 2023-01-04T18:17:17.063 INFO:tasks.workunit.client.0.smithi050.stdout:9/869: dread d1/d3/d11/f16 [0,4194304] 0 2023-01-04T18:17:17.063 INFO:tasks.workunit.client.0.smithi050.stdout:9/870: chown d1/d12/d2d/d39/fae 13768683 1 2023-01-04T18:17:17.065 INFO:tasks.workunit.client.0.smithi050.stdout:2/877: dread d1/dd/d11/d12/f11b [0,4194304] 0 2023-01-04T18:17:17.065 INFO:tasks.workunit.client.0.smithi050.stdout:2/878: fsync d1/dd/d62/f77 0 2023-01-04T18:17:17.065 INFO:tasks.workunit.client.0.smithi050.stdout:2/879: truncate d1/dd/d28/d2c/d66/da2/fdf 4903699 0 2023-01-04T18:17:17.065 INFO:tasks.workunit.client.0.smithi050.stdout:2/880: stat d1/dd/d11/d14/d91/d5a/d7f/f9f 0 2023-01-04T18:17:17.068 INFO:tasks.workunit.client.0.smithi050.stdout:7/983: rename d6/db/d3b/fcc to d6/d28/d32/d9d/f144 0 2023-01-04T18:17:17.074 INFO:tasks.workunit.client.0.smithi050.stdout:2/881: write d1/dd/d11/d12/f59 [3153866,83954] 0 2023-01-04T18:17:17.074 INFO:tasks.workunit.client.0.smithi050.stdout:6/892: creat d0/d5c/f116 x:0 0 0 2023-01-04T18:17:17.074 INFO:tasks.workunit.client.0.smithi050.stdout:4/873: dread d14/d1b/d1f/f46 [0,4194304] 0 2023-01-04T18:17:17.074 INFO:tasks.workunit.client.0.smithi050.stdout:1/922: symlink d8/d14/d1c/d28/d57/d6a/d92/l11b 0 2023-01-04T18:17:17.081 INFO:tasks.workunit.client.0.smithi050.stdout:9/871: dwrite d1/d6f/fd0 [0,4194304] 0 2023-01-04T18:17:17.091 INFO:tasks.workunit.client.0.smithi050.stdout:8/940: rename d3/d2a/d30/d3b/d4d to d3/d2a/dff/d146 0 2023-01-04T18:17:17.091 INFO:tasks.workunit.client.0.smithi050.stdout:8/941: write d3/d2a/d74/d118/d129/f126 [974519,104553] 0 2023-01-04T18:17:17.147 INFO:tasks.workunit.client.0.smithi050.stdout:2/882: symlink d1/dd/d11/d14/d91/d5a/d7f/l126 0 2023-01-04T18:17:17.147 INFO:tasks.workunit.client.0.smithi050.stdout:2/883: readlink d1/dd/d11/db5/l5e 0 2023-01-04T18:17:17.147 INFO:tasks.workunit.client.0.smithi050.stdout:2/884: chown d1/dd/d28/d2c/d2e/d36/dd0/f101 876437481 1 2023-01-04T18:17:17.150 INFO:tasks.workunit.client.0.smithi050.stdout:4/874: rmdir d14/d1b/d1f/d22/d87/de0/d108 39 2023-01-04T18:17:17.151 INFO:tasks.workunit.client.0.smithi050.stdout:1/923: creat d8/d14/d1c/d28/d57/de6/f11c x:0 0 0 2023-01-04T18:17:17.159 INFO:tasks.workunit.client.0.smithi050.stdout:1/924: dread d8/d48/d5c/d67/fa9 [0,4194304] 0 2023-01-04T18:17:17.160 INFO:tasks.workunit.client.0.smithi050.stdout:9/872: mknod d1/d12/d41/d60/c111 0 2023-01-04T18:17:17.166 INFO:tasks.workunit.client.0.smithi050.stdout:8/942: rename d3/d2a/l1a to d3/d2a/d74/d118/d129/daf/dd8/l147 0 2023-01-04T18:17:17.176 INFO:tasks.workunit.client.0.smithi050.stdout:1/925: unlink d8/d48/d5c/d67/f1e 0 2023-01-04T18:17:17.177 INFO:tasks.workunit.client.0.smithi050.stdout:9/873: unlink d1/d12/d2d/d39/ced 0 2023-01-04T18:17:17.178 INFO:tasks.workunit.client.0.smithi050.stdout:9/874: read d1/d12/f5f [1039042,1515] 0 2023-01-04T18:17:17.178 INFO:tasks.workunit.client.0.smithi050.stdout:8/943: creat d3/d2a/d30/f148 x:0 0 0 2023-01-04T18:17:17.180 INFO:tasks.workunit.client.0.smithi050.stdout:2/885: dread d1/dd/d62/da1/d4b/fcf [0,4194304] 0 2023-01-04T18:17:17.180 INFO:tasks.workunit.client.0.smithi050.stdout:2/886: readlink d1/dd/d62/d69/ldd 0 2023-01-04T18:17:17.180 INFO:tasks.workunit.client.0.smithi050.stdout:2/887: readlink d1/dd/d28/d2c/d2e/d36/lc2 0 2023-01-04T18:17:17.183 INFO:tasks.workunit.client.0.smithi050.stdout:1/926: truncate d8/d48/d5c/d67/d3b/d84/fc5 3485410 0 2023-01-04T18:17:17.183 INFO:tasks.workunit.client.0.smithi050.stdout:1/927: write d8/d48/d5c/d67/d3b/d84/ff8 [4894766,104920] 0 2023-01-04T18:17:17.183 INFO:tasks.workunit.client.0.smithi050.stdout:8/944: dread d3/d2a/d2d/f76 [0,4194304] 0 2023-01-04T18:17:17.191 INFO:tasks.workunit.client.0.smithi050.stdout:2/888: dread d1/dd/d11/d12/fb3 [0,4194304] 0 2023-01-04T18:17:17.192 INFO:tasks.workunit.client.0.smithi050.stdout:0/735: sync 2023-01-04T18:17:17.192 INFO:tasks.workunit.client.0.smithi050.stdout:0/736: write d0/d73/fa2 [538290,113157] 0 2023-01-04T18:17:17.193 INFO:tasks.workunit.client.0.smithi050.stdout:3/891: sync 2023-01-04T18:17:17.194 INFO:tasks.workunit.client.0.smithi050.stdout:2/889: rename d1/dd/d28/d2c/c6a to d1/dd/d28/d79/de4/c127 0 2023-01-04T18:17:17.194 INFO:tasks.workunit.client.0.smithi050.stdout:2/890: readlink d1/dd/d11/db5/df8/l6b 0 2023-01-04T18:17:17.194 INFO:tasks.workunit.client.0.smithi050.stdout:2/891: write d1/dd/d28/d2c/d2e/d3f/f8e [4792257,83529] 0 2023-01-04T18:17:17.194 INFO:tasks.workunit.client.0.smithi050.stdout:2/892: dread - d1/d41/feb zero size 2023-01-04T18:17:17.195 INFO:tasks.workunit.client.0.smithi050.stdout:0/737: unlink d0/d6/d8/c27 0 2023-01-04T18:17:17.196 INFO:tasks.workunit.client.0.smithi050.stdout:0/738: write d0/d6/d8/d35/f66 [1263347,33098] 0 2023-01-04T18:17:17.202 INFO:tasks.workunit.client.0.smithi050.stdout:1/928: dread d8/d14/d1c/d28/d57/f61 [0,4194304] 0 2023-01-04T18:17:17.202 INFO:tasks.workunit.client.0.smithi050.stdout:1/929: chown d8/d14/d1c/d28/d57/de6/ffb 207 1 2023-01-04T18:17:17.210 INFO:tasks.workunit.client.0.smithi050.stdout:1/930: write d8/d14/d1c/f73 [2654964,72798] 0 2023-01-04T18:17:17.210 INFO:tasks.workunit.client.0.smithi050.stdout:1/931: write d8/d48/d5c/d67/fa9 [4044904,109692] 0 2023-01-04T18:17:17.216 INFO:tasks.workunit.client.0.smithi050.stdout:9/875: dwrite d1/d12/d2d/d39/f4d [0,4194304] 0 2023-01-04T18:17:17.217 INFO:tasks.workunit.client.0.smithi050.stdout:8/945: dwrite d3/d2a/dff/d146/d23/d55/d5f/d82/dcb/fe6 [0,4194304] 0 2023-01-04T18:17:17.233 INFO:tasks.workunit.client.0.smithi050.stdout:2/893: unlink d1/dd/d38/f75 0 2023-01-04T18:17:17.234 INFO:tasks.workunit.client.0.smithi050.stdout:2/894: stat d1/dd/d11/db5/d99/fa5 0 2023-01-04T18:17:17.234 INFO:tasks.workunit.client.0.smithi050.stdout:3/892: write d0/d8f/d46/df7/d11a/d2f/d31/f4b [2503798,69704] 0 2023-01-04T18:17:17.235 INFO:tasks.workunit.client.0.smithi050.stdout:0/739: creat d0/d73/d79/dd5/fe8 x:0 0 0 2023-01-04T18:17:17.236 INFO:tasks.workunit.client.0.smithi050.stdout:1/932: mknod d8/d14/d1c/d28/d57/de6/c11d 0 2023-01-04T18:17:17.236 INFO:tasks.workunit.client.0.smithi050.stdout:1/933: truncate d8/d48/d5c/d67/d3b/db9/dde/f109 453508 0 2023-01-04T18:17:17.237 INFO:tasks.workunit.client.0.smithi050.stdout:1/934: write d8/d14/d1c/fb1 [2015116,54524] 0 2023-01-04T18:17:17.239 INFO:tasks.workunit.client.0.smithi050.stdout:9/876: mkdir d1/d3/d3b/d112 0 2023-01-04T18:17:17.239 INFO:tasks.workunit.client.0.smithi050.stdout:9/877: write d1/d12/d41/d60/d95/ff1 [78380,130365] 0 2023-01-04T18:17:17.241 INFO:tasks.workunit.client.0.smithi050.stdout:8/946: rmdir d3/d2a/d30/d3b/d53 39 2023-01-04T18:17:17.244 INFO:tasks.workunit.client.0.smithi050.stdout:2/895: link d1/dd/d11/f54 d1/dd/d11/d14/d91/d5a/dfa/f128 0 2023-01-04T18:17:17.245 INFO:tasks.workunit.client.0.smithi050.stdout:2/896: write d1/dd/d28/d2c/d2e/d3f/f81 [3978460,75567] 0 2023-01-04T18:17:17.247 INFO:tasks.workunit.client.0.smithi050.stdout:3/893: creat d0/d8f/d46/df7/d11a/f130 x:0 0 0 2023-01-04T18:17:17.250 INFO:tasks.workunit.client.0.smithi050.stdout:9/878: link d1/d3/dbf/dd4/da8/fc9 d1/d6f/f113 0 2023-01-04T18:17:17.255 INFO:tasks.workunit.client.0.smithi050.stdout:8/947: creat d3/d2a/d2d/d86/d12c/f149 x:0 0 0 2023-01-04T18:17:17.257 INFO:tasks.workunit.client.0.smithi050.stdout:2/897: creat d1/dd/d11/d12/f129 x:0 0 0 2023-01-04T18:17:17.261 INFO:tasks.workunit.client.0.smithi050.stdout:9/879: rename d1/d3/d24/d7b to d1/d3/d89/d114 0 2023-01-04T18:17:17.262 INFO:tasks.workunit.client.0.smithi050.stdout:9/880: read d1/f47 [1303718,46376] 0 2023-01-04T18:17:17.264 INFO:tasks.workunit.client.0.smithi050.stdout:0/740: dwrite d0/d6/d8/d51/f50 [0,4194304] 0 2023-01-04T18:17:17.268 INFO:tasks.workunit.client.0.smithi050.stdout:8/948: symlink d3/d2a/dff/d146/d23/d55/d5f/d82/dcb/d127/l14a 0 2023-01-04T18:17:17.272 INFO:tasks.workunit.client.0.smithi050.stdout:3/894: dwrite d0/d8f/d46/df7/d11a/d2f/d31/f83 [0,4194304] 0 2023-01-04T18:17:17.276 INFO:tasks.workunit.client.0.smithi050.stdout:1/935: dwrite d8/d48/d5c/d67/d91/fdb [0,4194304] 0 2023-01-04T18:17:17.277 INFO:tasks.workunit.client.0.smithi050.stdout:2/898: rmdir d1/dd/d28/d2c/dce 39 2023-01-04T18:17:17.278 INFO:tasks.workunit.client.0.smithi050.stdout:9/881: creat d1/d3/d89/d114/f115 x:0 0 0 2023-01-04T18:17:17.292 INFO:tasks.workunit.client.0.smithi050.stdout:9/882: dread d1/d3/d11/d42/fc7 [0,4194304] 0 2023-01-04T18:17:17.292 INFO:tasks.workunit.client.0.smithi050.stdout:8/949: dwrite d3/d2a/d27/d8b/d9f/f107 [0,4194304] 0 2023-01-04T18:17:17.293 INFO:tasks.workunit.client.0.smithi050.stdout:1/936: dwrite d8/d14/d1c/d28/dcd/ffa [0,4194304] 0 2023-01-04T18:17:17.296 INFO:tasks.workunit.client.0.smithi050.stdout:3/895: rmdir d0/d8f/d46/df7/d11a/d2f/d56/d98/d9c/dc9 39 2023-01-04T18:17:17.296 INFO:tasks.workunit.client.0.smithi050.stdout:3/896: fdatasync d0/d8f/d46/f85 0 2023-01-04T18:17:17.301 INFO:tasks.workunit.client.0.smithi050.stdout:1/937: dread d8/d14/f74 [4194304,4194304] 0 2023-01-04T18:17:17.328 INFO:tasks.workunit.client.0.smithi050.stdout:2/899: creat d1/dd/d11/f12a x:0 0 0 2023-01-04T18:17:17.328 INFO:tasks.workunit.client.0.smithi050.stdout:2/900: readlink d1/dd/d11/d14/d91/d5a/ld3 0 2023-01-04T18:17:17.330 INFO:tasks.workunit.client.0.smithi050.stdout:0/741: mknod d0/ce9 0 2023-01-04T18:17:17.330 INFO:tasks.workunit.client.0.smithi050.stdout:0/742: getdents d0/d73 0 2023-01-04T18:17:17.332 INFO:tasks.workunit.client.0.smithi050.stdout:0/743: write d0/d6/d8/d51/f8d [2251990,75397] 0 2023-01-04T18:17:17.337 INFO:tasks.workunit.client.0.smithi050.stdout:9/883: creat d1/d3/d3b/d63/f116 x:0 0 0 2023-01-04T18:17:17.352 INFO:tasks.workunit.client.0.smithi050.stdout:8/950: creat d3/d2a/d2d/d86/d12c/f14b x:0 0 0 2023-01-04T18:17:17.352 INFO:tasks.workunit.client.0.smithi050.stdout:8/951: chown d3/d2a/d30/d3b/d53/lfd 38 1 2023-01-04T18:17:17.352 INFO:tasks.workunit.client.0.smithi050.stdout:8/952: write d3/d2a/dff/d146/d23/d31/f142 [863274,69619] 0 2023-01-04T18:17:17.352 INFO:tasks.workunit.client.0.smithi050.stdout:2/901: dwrite d1/dd/d28/f43 [0,4194304] 0 2023-01-04T18:17:17.357 INFO:tasks.workunit.client.0.smithi050.stdout:1/938: truncate d8/d48/fc0 1690200 0 2023-01-04T18:17:17.357 INFO:tasks.workunit.client.0.smithi050.stdout:1/939: chown d8/d14/d1c/d28/dc7/c107 89 1 2023-01-04T18:17:17.360 INFO:tasks.workunit.client.0.smithi050.stdout:0/744: rename d0/d73/d79/fc3 to d0/d9f/fea 0 2023-01-04T18:17:17.362 INFO:tasks.workunit.client.0.smithi050.stdout:9/884: mkdir d1/d12/d41/d60/d117 0 2023-01-04T18:17:17.367 INFO:tasks.workunit.client.0.smithi050.stdout:8/953: unlink d3/d2a/d30/d3b/f79 0 2023-01-04T18:17:17.367 INFO:tasks.workunit.client.0.smithi050.stdout:8/954: fsync d3/d2a/d27/d8b/d9f/f107 0 2023-01-04T18:17:17.369 INFO:tasks.workunit.client.0.smithi050.stdout:8/955: write d3/d2a/dff/d146/d23/d55/d5f/f8a [2738399,111562] 0 2023-01-04T18:17:17.370 INFO:tasks.workunit.client.0.smithi050.stdout:9/885: mkdir d1/d3/d11/d42/d118 0 2023-01-04T18:17:17.372 INFO:tasks.workunit.client.0.smithi050.stdout:0/745: dread d0/d6/d8/d51/f7b [0,4194304] 0 2023-01-04T18:17:17.374 INFO:tasks.workunit.client.0.smithi050.stdout:8/956: creat d3/d2a/d60/f14c x:0 0 0 2023-01-04T18:17:17.374 INFO:tasks.workunit.client.0.smithi050.stdout:8/957: stat d3/d2a/d60/d2c/f5e 0 2023-01-04T18:17:17.374 INFO:tasks.workunit.client.0.smithi050.stdout:8/958: fdatasync d3/d2a/d27/d8b/d9f/f107 0 2023-01-04T18:17:17.374 INFO:tasks.workunit.client.0.smithi050.stdout:8/959: chown d3/d2a/d74/d92/d94 10123 1 2023-01-04T18:17:17.375 INFO:tasks.workunit.client.0.smithi050.stdout:8/960: dread - d3/d2a/d27/d93/d7f/d96/db6/f13b zero size 2023-01-04T18:17:17.375 INFO:tasks.workunit.client.0.smithi050.stdout:1/940: dwrite d8/d14/d1c/d28/d57/d6a/d92/fe3 [0,4194304] 0 2023-01-04T18:17:17.375 INFO:tasks.workunit.client.0.smithi050.stdout:9/886: truncate d1/d6f/fd6 1690315 0 2023-01-04T18:17:17.376 INFO:tasks.workunit.client.0.smithi050.stdout:2/902: dread d1/dd/d62/da1/d83/fba [0,4194304] 0 2023-01-04T18:17:17.378 INFO:tasks.workunit.client.0.smithi050.stdout:0/746: creat d0/d9f/feb x:0 0 0 2023-01-04T18:17:17.380 INFO:tasks.workunit.client.0.smithi050.stdout:8/961: creat d3/d2a/d74/d92/d94/f14d x:0 0 0 2023-01-04T18:17:17.381 INFO:tasks.workunit.client.0.smithi050.stdout:8/962: read d3/d2a/d60/f71 [3901322,118391] 0 2023-01-04T18:17:17.381 INFO:tasks.workunit.client.0.smithi050.stdout:8/963: chown d3/d2a/d27/d8b/fab 188008 1 2023-01-04T18:17:17.389 INFO:tasks.workunit.client.0.smithi050.stdout:1/941: mkdir d8/d48/d5c/d67/d3b/d84/d11e 0 2023-01-04T18:17:17.389 INFO:tasks.workunit.client.0.smithi050.stdout:1/942: chown d8/d48/lc8 1 1 2023-01-04T18:17:17.391 INFO:tasks.workunit.client.0.smithi050.stdout:9/887: getdents d1/d12/d41/d60/d95 0 2023-01-04T18:17:17.392 INFO:tasks.workunit.client.0.smithi050.stdout:9/888: readlink d1/d3/d13/l9d 0 2023-01-04T18:17:17.392 INFO:tasks.workunit.client.0.smithi050.stdout:2/903: dwrite d1/dd/d11/d14/d91/d5a/d7f/df5/f118 [0,4194304] 0 2023-01-04T18:17:17.394 INFO:tasks.workunit.client.0.smithi050.stdout:0/747: mknod d0/d6/d28/d9c/cec 0 2023-01-04T18:17:17.398 INFO:tasks.workunit.client.0.smithi050.stdout:2/904: dread d1/dd/d62/da1/f20 [0,4194304] 0 2023-01-04T18:17:17.398 INFO:tasks.workunit.client.0.smithi050.stdout:2/905: stat d1/dd/d11/d14/f30 0 2023-01-04T18:17:17.398 INFO:tasks.workunit.client.0.smithi050.stdout:2/906: readlink d1/dd/d28/d2c/d2e/d36/lac 0 2023-01-04T18:17:17.398 INFO:tasks.workunit.client.0.smithi050.stdout:2/907: chown d1/dd/d28/d2c 7 1 2023-01-04T18:17:17.399 INFO:tasks.workunit.client.0.smithi050.stdout:8/964: creat d3/d2a/d74/d92/f14e x:0 0 0 2023-01-04T18:17:17.399 INFO:tasks.workunit.client.0.smithi050.stdout:1/943: getdents d8/d14/d1c/d28/dcd 0 2023-01-04T18:17:17.405 INFO:tasks.workunit.client.0.smithi050.stdout:9/889: mkdir d1/d3/d89/d114/d119 0 2023-01-04T18:17:17.414 INFO:tasks.workunit.client.0.smithi050.stdout:9/890: dread d1/d3/d3b/d63/f1c [0,4194304] 0 2023-01-04T18:17:17.417 INFO:tasks.workunit.client.0.smithi050.stdout:0/748: rmdir d0/d6/d28/d1a/de6 0 2023-01-04T18:17:17.417 INFO:tasks.workunit.client.0.smithi050.stdout:0/749: fdatasync d0/d6/d8/d35/f6f 0 2023-01-04T18:17:17.419 INFO:tasks.workunit.client.0.smithi050.stdout:8/965: truncate d3/d2a/f89 1632205 0 2023-01-04T18:17:17.423 INFO:tasks.workunit.client.0.smithi050.stdout:1/944: symlink d8/d14/d1c/d28/dc7/dca/l11f 0 2023-01-04T18:17:17.423 INFO:tasks.workunit.client.0.smithi050.stdout:1/945: stat d8/d48/d5c 0 2023-01-04T18:17:17.424 INFO:tasks.workunit.client.0.smithi050.stdout:9/891: unlink d1/d3/d11/d1f/c5e 0 2023-01-04T18:17:17.424 INFO:tasks.workunit.client.0.smithi050.stdout:4/875: sync 2023-01-04T18:17:17.424 INFO:tasks.workunit.client.0.smithi050.stdout:6/893: sync 2023-01-04T18:17:17.425 INFO:tasks.workunit.client.0.smithi050.stdout:7/984: sync 2023-01-04T18:17:17.425 INFO:tasks.workunit.client.0.smithi050.stdout:4/876: chown d14/d1b/d1f/d22/d87/de0/d108/d5d/d7f/de1 20951 1 2023-01-04T18:17:17.425 INFO:tasks.workunit.client.0.smithi050.stdout:0/750: symlink d0/d73/d79/dd5/led 0 2023-01-04T18:17:17.427 INFO:tasks.workunit.client.0.smithi050.stdout:1/946: truncate d8/d14/f5b 3891661 0 2023-01-04T18:17:17.429 INFO:tasks.workunit.client.0.smithi050.stdout:9/892: mknod d1/d3/d11/d42/d118/c11a 0 2023-01-04T18:17:17.431 INFO:tasks.workunit.client.0.smithi050.stdout:1/947: dread d8/d14/f7b [0,4194304] 0 2023-01-04T18:17:17.432 INFO:tasks.workunit.client.0.smithi050.stdout:7/985: mknod d6/db/d15/d48/dc7/d124/c145 0 2023-01-04T18:17:17.436 INFO:tasks.workunit.client.0.smithi050.stdout:4/877: fdatasync d14/d1b/d1f/f107 0 2023-01-04T18:17:17.436 INFO:tasks.workunit.client.0.smithi050.stdout:4/878: stat f4 0 2023-01-04T18:17:17.436 INFO:tasks.workunit.client.0.smithi050.stdout:8/966: dread d3/d2a/d2d/fb5 [0,4194304] 0 2023-01-04T18:17:17.436 INFO:tasks.workunit.client.0.smithi050.stdout:8/967: write d3/f8e [4322287,127452] 0 2023-01-04T18:17:17.437 INFO:tasks.workunit.client.0.smithi050.stdout:3/897: sync 2023-01-04T18:17:17.437 INFO:tasks.workunit.client.0.smithi050.stdout:4/879: write d14/d1b/d1f/d63/f71 [413207,89908] 0 2023-01-04T18:17:17.439 INFO:tasks.workunit.client.0.smithi050.stdout:6/894: dread d0/d5c/d5d/d112/f29 [0,4194304] 0 2023-01-04T18:17:17.440 INFO:tasks.workunit.client.0.smithi050.stdout:6/895: write d0/d5c/d5d/d112/f29 [2218925,55202] 0 2023-01-04T18:17:17.440 INFO:tasks.workunit.client.0.smithi050.stdout:6/896: write d0/d5c/d5d/d112/d25/d2d/dea/d54/f63 [2897127,107044] 0 2023-01-04T18:17:17.442 INFO:tasks.workunit.client.0.smithi050.stdout:0/751: mknod d0/d9f/d84/cee 0 2023-01-04T18:17:17.443 INFO:tasks.workunit.client.0.smithi050.stdout:4/880: write d14/d1b/d32/fbc [1061808,118664] 0 2023-01-04T18:17:17.443 INFO:tasks.workunit.client.0.smithi050.stdout:4/881: dread - d14/d1b/d1f/d22/d87/f114 zero size 2023-01-04T18:17:17.443 INFO:tasks.workunit.client.0.smithi050.stdout:4/882: write d14/d1b/d1f/d22/d87/de0/d108/d5d/d7f/f122 [950545,46429] 0 2023-01-04T18:17:17.446 INFO:tasks.workunit.client.0.smithi050.stdout:3/898: dread d0/f2c [0,4194304] 0 2023-01-04T18:17:17.449 INFO:tasks.workunit.client.0.smithi050.stdout:9/893: unlink d1/d12/d41/d60/d95/lf0 0 2023-01-04T18:17:17.455 INFO:tasks.workunit.client.0.smithi050.stdout:1/948: mknod d8/d14/d1c/d28/d57/d6a/d92/dec/c120 0 2023-01-04T18:17:17.459 INFO:tasks.workunit.client.0.smithi050.stdout:7/986: rename d6/db/d15/d1b/f21 to d6/d1d/d1f/f146 0 2023-01-04T18:17:17.459 INFO:tasks.workunit.client.0.smithi050.stdout:7/987: fdatasync d6/db/d15/d48/dc7/d124/d125/fbb 0 2023-01-04T18:17:17.461 INFO:tasks.workunit.client.0.smithi050.stdout:8/968: truncate d3/d2a/d74/d92/d94/d9c/fbc 2914052 0 2023-01-04T18:17:17.461 INFO:tasks.workunit.client.0.smithi050.stdout:8/969: chown d3/d2a/dff/d146/d23/c8c 13494 1 2023-01-04T18:17:17.461 INFO:tasks.workunit.client.0.smithi050.stdout:8/970: stat d3/d2a/dff/d146/d23/d55/d5f/f103 0 2023-01-04T18:17:17.465 INFO:tasks.workunit.client.0.smithi050.stdout:6/897: mkdir d0/d5c/db7/d117 0 2023-01-04T18:17:17.465 INFO:tasks.workunit.client.0.smithi050.stdout:6/898: truncate d0/d5c/d5d/d112/d25/d2d/dea/d54/f58 5199315 0 2023-01-04T18:17:17.466 INFO:tasks.workunit.client.0.smithi050.stdout:0/752: truncate d0/f3b 4884670 0 2023-01-04T18:17:17.466 INFO:tasks.workunit.client.0.smithi050.stdout:0/753: readlink d0/d6/d8/d4f/l57 0 2023-01-04T18:17:17.466 INFO:tasks.workunit.client.0.smithi050.stdout:0/754: write d0/d6/d8/d51/f7c [1605668,20512] 0 2023-01-04T18:17:17.467 INFO:tasks.workunit.client.0.smithi050.stdout:9/894: dwrite d1/d12/f22 [4194304,4194304] 0 2023-01-04T18:17:17.467 INFO:tasks.workunit.client.0.smithi050.stdout:9/895: write d1/d12/d41/fa3 [794132,115592] 0 2023-01-04T18:17:17.467 INFO:tasks.workunit.client.0.smithi050.stdout:9/896: dread - d1/d3/d89/d114/f103 zero size 2023-01-04T18:17:17.540 INFO:tasks.workunit.client.0.smithi050.stdout:0/755: dwrite d0/d6/d8/d25/fb1 [0,4194304] 0 2023-01-04T18:17:17.541 INFO:tasks.workunit.client.0.smithi050.stdout:0/756: write d0/d73/d79/f88 [340129,121534] 0 2023-01-04T18:17:17.541 INFO:tasks.workunit.client.0.smithi050.stdout:0/757: truncate d0/d6/d8/f13 5244499 0 2023-01-04T18:17:17.541 INFO:tasks.workunit.client.0.smithi050.stdout:0/758: stat d0/d73/d79/cd6 0 2023-01-04T18:17:17.557 INFO:tasks.workunit.client.0.smithi050.stdout:4/883: mkdir d14/d1b/d32/d128 0 2023-01-04T18:17:17.558 INFO:tasks.workunit.client.0.smithi050.stdout:1/949: creat d8/d14/d1c/d28/d57/de6/f121 x:0 0 0 2023-01-04T18:17:17.561 INFO:tasks.workunit.client.0.smithi050.stdout:3/899: rename d0/d8f/d46/d80/cae to d0/d8f/d46/df7/d11a/d2f/d56/d98/dc7/ded/c131 0 2023-01-04T18:17:17.563 INFO:tasks.workunit.client.0.smithi050.stdout:6/899: symlink d0/d5c/d5d/d112/d25/d40/d89/dd9/dc0/l118 0 2023-01-04T18:17:17.564 INFO:tasks.workunit.client.0.smithi050.stdout:9/897: creat d1/d12/d41/d60/d8e/f11b x:0 0 0 2023-01-04T18:17:17.572 INFO:tasks.workunit.client.0.smithi050.stdout:0/759: rmdir d0/d73/d68 39 2023-01-04T18:17:17.573 INFO:tasks.workunit.client.0.smithi050.stdout:0/760: chown d0/d6/d28/d1a 0 1 2023-01-04T18:17:17.574 INFO:tasks.workunit.client.0.smithi050.stdout:4/884: getdents d14/d1b/d1f/d22/d6a 0 2023-01-04T18:17:17.577 INFO:tasks.workunit.client.0.smithi050.stdout:1/950: mkdir d8/d14/d1c/d28/d57/de6/d122 0 2023-01-04T18:17:17.577 INFO:tasks.workunit.client.0.smithi050.stdout:1/951: chown d8/d14/d1c/d28/dc7/lfe 69261 1 2023-01-04T18:17:17.586 INFO:tasks.workunit.client.0.smithi050.stdout:9/898: dwrite d1/d3/dbf/dd4/da8/fdb [0,4194304] 0 2023-01-04T18:17:17.586 INFO:tasks.workunit.client.0.smithi050.stdout:9/899: readlink d1/d3/dbf/dd4/da8/dda/lde 0 2023-01-04T18:17:17.596 INFO:tasks.workunit.client.0.smithi050.stdout:7/988: rename d6/d28/d99/dd7/lb7 to d6/db/d3a/dbd/l147 0 2023-01-04T18:17:17.600 INFO:tasks.workunit.client.0.smithi050.stdout:3/900: creat d0/f132 x:0 0 0 2023-01-04T18:17:17.604 INFO:tasks.workunit.client.0.smithi050.stdout:6/900: getdents d0/d5c/d5d/d112/df 0 2023-01-04T18:17:17.604 INFO:tasks.workunit.client.0.smithi050.stdout:6/901: fdatasync d0/d5c/fbf 0 2023-01-04T18:17:17.606 INFO:tasks.workunit.client.0.smithi050.stdout:0/761: creat d0/d6/d8/d4f/fef x:0 0 0 2023-01-04T18:17:17.611 INFO:tasks.workunit.client.0.smithi050.stdout:4/885: unlink d14/d1b/d1f/d22/f67 0 2023-01-04T18:17:17.613 INFO:tasks.workunit.client.0.smithi050.stdout:7/989: dwrite d6/db/d3a/dd2/d10f/f10c [0,4194304] 0 2023-01-04T18:17:17.614 INFO:tasks.workunit.client.0.smithi050.stdout:7/990: write d6/db/d20/d4f/d6e/fd0 [1430377,89336] 0 2023-01-04T18:17:17.614 INFO:tasks.workunit.client.0.smithi050.stdout:7/991: fdatasync d6/fb4 0 2023-01-04T18:17:17.614 INFO:tasks.workunit.client.0.smithi050.stdout:7/992: chown d6/db/d15/d1b/d70/d12e 845 1 2023-01-04T18:17:17.614 INFO:tasks.workunit.client.0.smithi050.stdout:1/952: mknod d8/d14/d1c/d28/d57/de6/c123 0 2023-01-04T18:17:17.618 INFO:tasks.workunit.client.0.smithi050.stdout:9/900: rename d1/d3/d13/d77/cca to d1/d12/c11c 0 2023-01-04T18:17:17.627 INFO:tasks.workunit.client.0.smithi050.stdout:0/762: mkdir d0/d6/d8/d51/dd9/df0 0 2023-01-04T18:17:17.634 INFO:tasks.workunit.client.0.smithi050.stdout:7/993: mkdir d6/d90/d148 0 2023-01-04T18:17:17.634 INFO:tasks.workunit.client.0.smithi050.stdout:7/994: dread - d6/db/d15/d48/dc7/d124/d125/fbb zero size 2023-01-04T18:17:17.635 INFO:tasks.workunit.client.0.smithi050.stdout:0/763: dread d0/d6/d8/d25/fb1 [0,4194304] 0 2023-01-04T18:17:17.636 INFO:tasks.workunit.client.0.smithi050.stdout:0/764: read - d0/d6/d8/d4f/fcb zero size 2023-01-04T18:17:17.636 INFO:tasks.workunit.client.0.smithi050.stdout:7/995: dread d6/d6b/d8b/ff0 [0,4194304] 0 2023-01-04T18:17:17.636 INFO:tasks.workunit.client.0.smithi050.stdout:7/996: chown d6/d28/d99/dd7/f96 8326978 1 2023-01-04T18:17:17.638 INFO:tasks.workunit.client.0.smithi050.stdout:1/953: symlink d8/dce/l124 0 2023-01-04T18:17:17.638 INFO:tasks.workunit.client.0.smithi050.stdout:1/954: dread - d8/d14/d1c/d28/d57/de6/ffb zero size 2023-01-04T18:17:17.642 INFO:tasks.workunit.client.0.smithi050.stdout:9/901: mknod d1/d3/dbf/dd4/da8/dda/c11d 0 2023-01-04T18:17:17.646 INFO:tasks.workunit.client.0.smithi050.stdout:6/902: write d0/d5c/d5d/d112/d25/d40/d89/dd9/f82 [986797,107608] 0 2023-01-04T18:17:17.651 INFO:tasks.workunit.client.0.smithi050.stdout:3/901: mkdir d0/d8f/d46/df7/d11a/d2f/d56/d98/d133 0 2023-01-04T18:17:17.651 INFO:tasks.workunit.client.0.smithi050.stdout:3/902: truncate d0/d8f/d46/df7/d11a/d2f/d31/f3d 4854429 0 2023-01-04T18:17:17.651 INFO:tasks.workunit.client.0.smithi050.stdout:3/903: chown d0/d10/l3c 2568 1 2023-01-04T18:17:17.651 INFO:tasks.workunit.client.0.smithi050.stdout:3/904: fsync d0/d10/f8c 0 2023-01-04T18:17:17.651 INFO:tasks.workunit.client.0.smithi050.stdout:2/908: sync 2023-01-04T18:17:17.654 INFO:tasks.workunit.client.0.smithi050.stdout:8/971: sync 2023-01-04T18:17:17.658 INFO:tasks.workunit.client.0.smithi050.stdout:2/909: write d1/dd/d11/d12/fb3 [4137184,47156] 0 2023-01-04T18:17:17.660 INFO:tasks.workunit.client.0.smithi050.stdout:6/903: dread d0/d5c/db7/f87 [0,4194304] 0 2023-01-04T18:17:17.661 INFO:tasks.workunit.client.0.smithi050.stdout:0/765: creat d0/d73/d79/dd5/ff1 x:0 0 0 2023-01-04T18:17:17.664 INFO:tasks.workunit.client.0.smithi050.stdout:7/997: creat d6/d90/de3/d6a/d102/f149 x:0 0 0 2023-01-04T18:17:17.664 INFO:tasks.workunit.client.0.smithi050.stdout:8/972: creat d3/d2a/d27/d93/d7f/d96/db6/f14f x:0 0 0 2023-01-04T18:17:17.665 INFO:tasks.workunit.client.0.smithi050.stdout:1/955: symlink d8/d48/d5c/d67/d3b/db9/l125 0 2023-01-04T18:17:17.670 INFO:tasks.workunit.client.0.smithi050.stdout:2/910: symlink d1/dd/d28/d2c/d2e/d3f/da7/l12b 0 2023-01-04T18:17:17.670 INFO:tasks.workunit.client.0.smithi050.stdout:2/911: chown d1/dd/d28/d79/c103 469885827 1 2023-01-04T18:17:17.670 INFO:tasks.workunit.client.0.smithi050.stdout:2/912: fdatasync d1/dd/d28/f114 0 2023-01-04T18:17:17.675 INFO:tasks.workunit.client.0.smithi050.stdout:2/913: write d1/dd/d62/da1/d83/fa6 [1249970,114391] 0 2023-01-04T18:17:17.676 INFO:tasks.workunit.client.0.smithi050.stdout:6/904: link d0/d5c/d5d/d112/d25/d40/d89/dd9/d7a/lf3 d0/d4a/d93/db1/dce/l119 0 2023-01-04T18:17:17.676 INFO:tasks.workunit.client.0.smithi050.stdout:0/766: symlink d0/d6/d8/d35/dd2/lf2 0 2023-01-04T18:17:17.676 INFO:tasks.workunit.client.0.smithi050.stdout:0/767: fsync d0/d6/d28/d9c/f9d 0 2023-01-04T18:17:17.676 INFO:tasks.workunit.client.0.smithi050.stdout:0/768: chown d0/d6/d28/fad 50705220 1 2023-01-04T18:17:17.677 INFO:tasks.workunit.client.0.smithi050.stdout:0/769: dread - d0/d9f/d84/fc8 zero size 2023-01-04T18:17:17.677 INFO:tasks.workunit.client.0.smithi050.stdout:9/902: dwrite d1/d12/d41/d60/fa2 [0,4194304] 0 2023-01-04T18:17:17.678 INFO:tasks.workunit.client.0.smithi050.stdout:7/998: write d6/ded/f13b [181310,130501] 0 2023-01-04T18:17:17.678 INFO:tasks.workunit.client.0.smithi050.stdout:3/905: dwrite d0/d8f/f11d [0,4194304] 0 2023-01-04T18:17:17.678 INFO:tasks.workunit.client.0.smithi050.stdout:3/906: dread - d0/d8f/d46/df7/d11a/d2f/f12d zero size 2023-01-04T18:17:17.682 INFO:tasks.workunit.client.0.smithi050.stdout:6/905: creat d0/d5c/d5d/d112/d38/df8/f11a x:0 0 0 2023-01-04T18:17:17.683 INFO:tasks.workunit.client.0.smithi050.stdout:0/770: link d0/d6/d28/d1a/f70 d0/d73/d68/ff3 0 2023-01-04T18:17:17.685 INFO:tasks.workunit.client.0.smithi050.stdout:4/886: dwrite d14/d1b/d1f/d22/d87/de0/d108/d5f/d80/fdc [0,4194304] 0 2023-01-04T18:17:17.688 INFO:tasks.workunit.client.0.smithi050.stdout:1/956: dread d8/d14/d1c/d28/f9d [0,4194304] 0 2023-01-04T18:17:17.689 INFO:tasks.workunit.client.0.smithi050.stdout:8/973: dwrite d3/d2a/d74/d118/d129/daf/f135 [0,4194304] 0 2023-01-04T18:17:17.690 INFO:tasks.workunit.client.0.smithi050.stdout:9/903: mkdir d1/d3/d11/dcd/d11e 0 2023-01-04T18:17:17.690 INFO:tasks.workunit.client.0.smithi050.stdout:9/904: getdents d1/d12/d41 0 2023-01-04T18:17:17.691 INFO:tasks.workunit.client.0.smithi050.stdout:7/999: creat d6/d28/d99/dd7/d42/f14a x:0 0 0 2023-01-04T18:17:17.696 INFO:tasks.workunit.client.0.smithi050.stdout:6/906: rename d0/d5c/d5d/d112/df/dba/d113 to d0/d5c/d5d/d112/df/dba/dca/d6b/da4/dab/d11b 0 2023-01-04T18:17:17.696 INFO:tasks.workunit.client.0.smithi050.stdout:6/907: write d0/d5c/d5d/d112/d25/d4d/f66 [4812454,105995] 0 2023-01-04T18:17:17.698 INFO:tasks.workunit.client.0.smithi050.stdout:0/771: mkdir d0/d6/d8/d4f/df4 0 2023-01-04T18:17:17.698 INFO:tasks.workunit.client.0.smithi050.stdout:0/772: readlink d0/d73/l65 0 2023-01-04T18:17:17.701 INFO:tasks.workunit.client.0.smithi050.stdout:1/957: creat d8/d48/d5c/d67/d3b/d84/d11e/f126 x:0 0 0 2023-01-04T18:17:17.703 INFO:tasks.workunit.client.0.smithi050.stdout:2/914: dwrite d1/dd/d62/da1/d4b/fe9 [0,4194304] 0 2023-01-04T18:17:17.703 INFO:tasks.workunit.client.0.smithi050.stdout:2/915: readlink d1/dd/d11/d14/lb8 0 2023-01-04T18:17:17.704 INFO:tasks.workunit.client.0.smithi050.stdout:3/907: dwrite d0/d1a/dc3/fd8 [0,4194304] 0 2023-01-04T18:17:17.704 INFO:tasks.workunit.client.0.smithi050.stdout:2/916: read - d1/dd/d11/d14/d91/d5a/dfa/f120 zero size 2023-01-04T18:17:17.704 INFO:tasks.workunit.client.0.smithi050.stdout:2/917: write d1/dd/d28/d2c/d66/fec [440346,76545] 0 2023-01-04T18:17:17.704 INFO:tasks.workunit.client.0.smithi050.stdout:2/918: read d1/dd/d62/ff3 [445251,32434] 0 2023-01-04T18:17:17.712 INFO:tasks.workunit.client.0.smithi050.stdout:8/974: creat d3/d2a/d27/deb/f150 x:0 0 0 2023-01-04T18:17:17.719 INFO:tasks.workunit.client.0.smithi050.stdout:9/905: link d1/d12/d41/d60/lc0 d1/d3/d3b/d63/dc3/l11f 0 2023-01-04T18:17:17.726 INFO:tasks.workunit.client.0.smithi050.stdout:6/908: rmdir d0/d5c/d5d/d112/df/d74 39 2023-01-04T18:17:17.726 INFO:tasks.workunit.client.0.smithi050.stdout:6/909: write d0/d5c/d5d/d112/d38/df8/f11a [597080,50157] 0 2023-01-04T18:17:17.731 INFO:tasks.workunit.client.0.smithi050.stdout:1/958: truncate d8/d14/d1c/d28/fb5 534980 0 2023-01-04T18:17:17.731 INFO:tasks.workunit.client.0.smithi050.stdout:1/959: dread - d8/d48/d5c/d67/d3b/f10d zero size 2023-01-04T18:17:17.734 INFO:tasks.workunit.client.0.smithi050.stdout:1/960: write f6 [1094770,58295] 0 2023-01-04T18:17:17.734 INFO:tasks.workunit.client.0.smithi050.stdout:1/961: readlink d8/l1a 0 2023-01-04T18:17:17.741 INFO:tasks.workunit.client.0.smithi050.stdout:6/910: dread d0/d5c/d5d/d112/d25/d4d/f66 [0,4194304] 0 2023-01-04T18:17:17.751 INFO:tasks.workunit.client.0.smithi050.stdout:3/908: mknod d0/d8f/d46/df7/d11a/d2f/d56/d98/d9c/dc9/c134 0 2023-01-04T18:17:17.754 INFO:tasks.workunit.client.0.smithi050.stdout:1/962: dwrite d8/d14/d1c/fb1 [4194304,4194304] 0 2023-01-04T18:17:17.754 INFO:tasks.workunit.client.0.smithi050.stdout:2/919: rmdir d1/dd/d11/d14/d91/d5a/d7f/df5 39 2023-01-04T18:17:17.757 INFO:tasks.workunit.client.0.smithi050.stdout:8/975: rmdir d3/d2a/d2d/d86/dd1/d10f 39 2023-01-04T18:17:17.759 INFO:tasks.workunit.client.0.smithi050.stdout:9/906: mknod d1/d3/d11/c120 0 2023-01-04T18:17:17.764 INFO:tasks.workunit.client.0.smithi050.stdout:4/887: rename d14/d1b/d1f/c43 to d14/d1b/d32/d128/c129 0 2023-01-04T18:17:17.767 INFO:tasks.workunit.client.0.smithi050.stdout:6/911: mknod d0/d5c/db7/d83/de5/c11c 0 2023-01-04T18:17:17.768 INFO:tasks.workunit.client.0.smithi050.stdout:1/963: mkdir d8/d48/d127 0 2023-01-04T18:17:17.770 INFO:tasks.workunit.client.0.smithi050.stdout:2/920: mknod d1/dd/d28/d121/c12c 0 2023-01-04T18:17:17.771 INFO:tasks.workunit.client.0.smithi050.stdout:3/909: dwrite d0/d8f/d46/df7/d11a/d2f/d56/fb0 [0,4194304] 0 2023-01-04T18:17:17.773 INFO:tasks.workunit.client.0.smithi050.stdout:8/976: truncate d3/d2a/d2d/d86/f137 2467866 0 2023-01-04T18:17:17.773 INFO:tasks.workunit.client.0.smithi050.stdout:2/921: write d1/dd/d11/db5/f104 [3468981,22910] 0 2023-01-04T18:17:17.773 INFO:tasks.workunit.client.0.smithi050.stdout:2/922: fdatasync d1/dd/d11/d14/f30 0 2023-01-04T18:17:17.775 INFO:tasks.workunit.client.0.smithi050.stdout:9/907: creat d1/d6f/f121 x:0 0 0 2023-01-04T18:17:17.777 INFO:tasks.workunit.client.0.smithi050.stdout:0/773: rename d0/d6/d28/d1a/d8a/fb6 to d0/d6/d8/d51/dd9/df0/ff5 0 2023-01-04T18:17:17.781 INFO:tasks.workunit.client.0.smithi050.stdout:6/912: unlink d0/d5c/d5d/d112/d25/f39 0 2023-01-04T18:17:17.781 INFO:tasks.workunit.client.0.smithi050.stdout:6/913: fdatasync d0/d5c/d5d/d112/df/dba/dca/d6b/fb8 0 2023-01-04T18:17:17.786 INFO:tasks.workunit.client.0.smithi050.stdout:3/910: truncate d0/dd/f6c 497918 0 2023-01-04T18:17:17.786 INFO:tasks.workunit.client.0.smithi050.stdout:3/911: stat d0/d1a 0 2023-01-04T18:17:17.786 INFO:tasks.workunit.client.0.smithi050.stdout:3/912: write d0/d8f/d46/d80/dca/dee/ffb [325143,124321] 0 2023-01-04T18:17:17.789 INFO:tasks.workunit.client.0.smithi050.stdout:8/977: creat d3/d2a/dff/d146/d23/d55/d5f/d82/f151 x:0 0 0 2023-01-04T18:17:17.790 INFO:tasks.workunit.client.0.smithi050.stdout:4/888: dwrite d14/d1b/d1f/d22/d6a/f9b [0,4194304] 0 2023-01-04T18:17:17.791 INFO:tasks.workunit.client.0.smithi050.stdout:1/964: dwrite d8/dce/f80 [0,4194304] 0 2023-01-04T18:17:17.792 INFO:tasks.workunit.client.0.smithi050.stdout:2/923: getdents d1/dd/d11/db5/df8 0 2023-01-04T18:17:17.794 INFO:tasks.workunit.client.0.smithi050.stdout:9/908: mkdir d1/d3/d11/d42/d118/d122 0 2023-01-04T18:17:17.799 INFO:tasks.workunit.client.0.smithi050.stdout:0/774: symlink d0/d6/d8/d51/dd9/lf6 0 2023-01-04T18:17:17.806 INFO:tasks.workunit.client.0.smithi050.stdout:3/913: dwrite d0/d8f/d46/df7/d11a/d2f/d56/fc4 [0,4194304] 0 2023-01-04T18:17:17.806 INFO:tasks.workunit.client.0.smithi050.stdout:3/914: chown d0/d8f/f5c 701 1 2023-01-04T18:17:17.813 INFO:tasks.workunit.client.0.smithi050.stdout:8/978: creat d3/d2a/dff/d146/d23/dfb/f152 x:0 0 0 2023-01-04T18:17:17.814 INFO:tasks.workunit.client.0.smithi050.stdout:8/979: stat d3/d2a/d2d/f70 0 2023-01-04T18:17:17.816 INFO:tasks.workunit.client.0.smithi050.stdout:8/980: dread d3/d2a/d60/d2c/fe3 [0,4194304] 0 2023-01-04T18:17:17.819 INFO:tasks.workunit.client.0.smithi050.stdout:4/889: mkdir d14/d1b/d1f/d22/d87/de0/d108/d5d/d12a 0 2023-01-04T18:17:17.821 INFO:tasks.workunit.client.0.smithi050.stdout:3/915: dwrite d0/dd/f1e [0,4194304] 0 2023-01-04T18:17:17.823 INFO:tasks.workunit.client.0.smithi050.stdout:8/981: dread d3/d2a/d60/d2c/f5e [0,4194304] 0 2023-01-04T18:17:17.823 INFO:tasks.workunit.client.0.smithi050.stdout:1/965: creat d8/d14/d1c/d28/dcd/f128 x:0 0 0 2023-01-04T18:17:17.825 INFO:tasks.workunit.client.0.smithi050.stdout:2/924: rmdir d1/dd/d11/d14/d91/d5a/d7f/df5/d125 0 2023-01-04T18:17:17.827 INFO:tasks.workunit.client.0.smithi050.stdout:9/909: rmdir d1/d3/df3 0 2023-01-04T18:17:17.832 INFO:tasks.workunit.client.0.smithi050.stdout:6/914: link d0/d5c/d5d/d112/d38/l10e d0/d5c/d5d/d112/df/dba/l11d 0 2023-01-04T18:17:17.833 INFO:tasks.workunit.client.0.smithi050.stdout:6/915: read d0/d5c/d5d/d112/f2b [4059257,109976] 0 2023-01-04T18:17:17.833 INFO:tasks.workunit.client.0.smithi050.stdout:6/916: fdatasync d0/d5c/d5d/d112/d25/f3a 0 2023-01-04T18:17:17.838 INFO:tasks.workunit.client.0.smithi050.stdout:0/775: dread d0/f4d [0,4194304] 0 2023-01-04T18:17:17.838 INFO:tasks.workunit.client.0.smithi050.stdout:0/776: write d0/d6/d8/d4f/f69 [759844,126127] 0 2023-01-04T18:17:17.840 INFO:tasks.workunit.client.0.smithi050.stdout:4/890: getdents d14/d1b/d1f/d22/d3e/d8a 0 2023-01-04T18:17:17.840 INFO:tasks.workunit.client.0.smithi050.stdout:4/891: readlink d14/d1b/d1f/d22/d87/de0/d108/d5d/l97 0 2023-01-04T18:17:17.843 INFO:tasks.workunit.client.0.smithi050.stdout:8/982: symlink d3/d2a/d2d/d86/dd1/d10f/l153 0 2023-01-04T18:17:17.845 INFO:tasks.workunit.client.0.smithi050.stdout:4/892: write d14/d1b/d1f/d22/d87/de0/d108/d5f/d80/fdc [3995818,116802] 0 2023-01-04T18:17:17.845 INFO:tasks.workunit.client.0.smithi050.stdout:3/916: dread d0/d8f/f27 [0,4194304] 0 2023-01-04T18:17:17.852 INFO:tasks.workunit.client.0.smithi050.stdout:1/966: creat d8/dce/f129 x:0 0 0 2023-01-04T18:17:17.853 INFO:tasks.workunit.client.0.smithi050.stdout:1/967: truncate d8/d14/d1c/d28/d57/de6/f11c 326880 0 2023-01-04T18:17:17.854 INFO:tasks.workunit.client.0.smithi050.stdout:2/925: link d1/dd/d62/da1/d83/lc4 d1/dd/d62/da1/d83/df7/l12d 0 2023-01-04T18:17:17.855 INFO:tasks.workunit.client.0.smithi050.stdout:2/926: write d1/dd/d28/d79/fe8 [1382071,25812] 0 2023-01-04T18:17:17.855 INFO:tasks.workunit.client.0.smithi050.stdout:9/910: link d1/d3/c57 d1/d3/dbf/c123 0 2023-01-04T18:17:17.856 INFO:tasks.workunit.client.0.smithi050.stdout:6/917: symlink d0/d5c/d5d/d112/df/l11e 0 2023-01-04T18:17:17.857 INFO:tasks.workunit.client.0.smithi050.stdout:0/777: read d0/d6/d28/d1a/f6b [273827,2400] 0 2023-01-04T18:17:17.858 INFO:tasks.workunit.client.0.smithi050.stdout:8/983: getdents d3/d2a/dff/d146/d23/d55/d5f 0 2023-01-04T18:17:17.861 INFO:tasks.workunit.client.0.smithi050.stdout:4/893: rename d14/d1b/d1f/d22/d87/de0/d108/d5d/d7f/de1/fe3 to d14/d1b/d1f/d63/dcb/d117/f12b 0 2023-01-04T18:17:17.863 INFO:tasks.workunit.client.0.smithi050.stdout:3/917: creat d0/d8f/d46/d80/dca/d100/f135 x:0 0 0 2023-01-04T18:17:17.867 INFO:tasks.workunit.client.0.smithi050.stdout:2/927: mkdir d1/dd/d11/d14/d12e 0 2023-01-04T18:17:17.869 INFO:tasks.workunit.client.0.smithi050.stdout:6/918: getdents d0/d5c/d5d/d112/d25/d40/d89 0 2023-01-04T18:17:17.869 INFO:tasks.workunit.client.0.smithi050.stdout:6/919: stat d0/d5c/d5d/d112/d25/d40/d89/l90 0 2023-01-04T18:17:17.870 INFO:tasks.workunit.client.0.smithi050.stdout:0/778: truncate d0/d6/f55 1781346 0 2023-01-04T18:17:17.873 INFO:tasks.workunit.client.0.smithi050.stdout:1/968: rename d8/d14/d1c/d28/dc7/dca/ld4 to d8/d14/d1c/d28/dc7/dca/d10b/l12a 0 2023-01-04T18:17:17.879 INFO:tasks.workunit.client.0.smithi050.stdout:3/918: mknod d0/d8f/c136 0 2023-01-04T18:17:17.882 INFO:tasks.workunit.client.0.smithi050.stdout:4/894: creat d14/d1b/d1f/d22/d3e/d8a/f12c x:0 0 0 2023-01-04T18:17:17.883 INFO:tasks.workunit.client.0.smithi050.stdout:8/984: dwrite d3/d2a/d27/d93/d7f/d96/f9a [0,4194304] 0 2023-01-04T18:17:17.883 INFO:tasks.workunit.client.0.smithi050.stdout:8/985: dread - d3/f11e zero size 2023-01-04T18:17:17.884 INFO:tasks.workunit.client.0.smithi050.stdout:9/911: dwrite d1/d3/d89/f80 [0,4194304] 0 2023-01-04T18:17:17.884 INFO:tasks.workunit.client.0.smithi050.stdout:6/920: creat d0/d5c/d5d/d112/df/d74/dd8/f11f x:0 0 0 2023-01-04T18:17:17.884 INFO:tasks.workunit.client.0.smithi050.stdout:6/921: stat d0/d5c/d5d/d112/f2b 0 2023-01-04T18:17:17.894 INFO:tasks.workunit.client.0.smithi050.stdout:8/986: dread d3/d2a/d27/dc1/fe7 [0,4194304] 0 2023-01-04T18:17:17.895 INFO:tasks.workunit.client.0.smithi050.stdout:8/987: chown d3/d2a/d27/d93/d7f/d96/l6b 78 1 2023-01-04T18:17:17.895 INFO:tasks.workunit.client.0.smithi050.stdout:8/988: stat d3/d2a/d2d/d86/d11c 0 2023-01-04T18:17:17.895 INFO:tasks.workunit.client.0.smithi050.stdout:8/989: fsync d3/d2a/d30/f148 0 2023-01-04T18:17:17.897 INFO:tasks.workunit.client.0.smithi050.stdout:3/919: dwrite d0/f40 [0,4194304] 0 2023-01-04T18:17:17.920 INFO:tasks.workunit.client.0.smithi050.stdout:3/920: dwrite d0/f132 [0,4194304] 0 2023-01-04T18:17:17.920 INFO:tasks.workunit.client.0.smithi050.stdout:3/921: fdatasync d0/d8f/d46/df7/d11a/d2f/d56/fb0 0 2023-01-04T18:17:17.922 INFO:tasks.workunit.client.0.smithi050.stdout:3/922: dread d0/d8f/deb/d7f/fdf [0,4194304] 0 2023-01-04T18:17:17.972 INFO:tasks.workunit.client.0.smithi050.stdout:4/895: unlink d14/d1b/d1f/d22/d87/de0/d108/d5d/d7f/f101 0 2023-01-04T18:17:17.988 INFO:tasks.workunit.client.0.smithi050.stdout:9/912: mkdir d1/d3/d89/d124 0 2023-01-04T18:17:17.994 INFO:tasks.workunit.client.0.smithi050.stdout:2/928: rename d1/dd/d28/d2c/d66/da2/f116 to d1/dd/f12f 0 2023-01-04T18:17:17.995 INFO:tasks.workunit.client.0.smithi050.stdout:2/929: chown d1/dd/d11/d12/lab 0 1 2023-01-04T18:17:18.009 INFO:tasks.workunit.client.0.smithi050.stdout:6/922: dwrite d0/d5c/d5d/d112/d38/f23 [0,4194304] 0 2023-01-04T18:17:18.011 INFO:tasks.workunit.client.0.smithi050.stdout:8/990: mknod d3/d2a/d74/c154 0 2023-01-04T18:17:18.011 INFO:tasks.workunit.client.0.smithi050.stdout:8/991: fsync d3/d2a/d74/d92/d94/d9c/f10e 0 2023-01-04T18:17:18.011 INFO:tasks.workunit.client.0.smithi050.stdout:8/992: chown d3/d2a/dff/d146/d23/d55/d5f/f8a 8893708 1 2023-01-04T18:17:18.018 INFO:tasks.workunit.client.0.smithi050.stdout:3/923: creat d0/d8f/d46/df7/d11a/d2f/d56/d98/d9c/dcd/d10e/f137 x:0 0 0 2023-01-04T18:17:18.036 INFO:tasks.workunit.client.0.smithi050.stdout:4/896: mkdir d14/d1b/d1f/d22/d87/de0/d108/db5/d12d 0 2023-01-04T18:17:18.036 INFO:tasks.workunit.client.0.smithi050.stdout:4/897: write d14/d1b/d32/f3f [1693886,64860] 0 2023-01-04T18:17:18.040 INFO:tasks.workunit.client.0.smithi050.stdout:9/913: rmdir d1/d3/d13/d77 39 2023-01-04T18:17:18.040 INFO:tasks.workunit.client.0.smithi050.stdout:9/914: chown d1/d3/d11/l3a 955 1 2023-01-04T18:17:18.042 INFO:tasks.workunit.client.0.smithi050.stdout:0/779: rename d0/d6/d8/d25/fb1 to d0/d6/d8/d35/dd2/ff7 0 2023-01-04T18:17:18.044 INFO:tasks.workunit.client.0.smithi050.stdout:2/930: mkdir d1/dd/d28/d2c/d2e/d3f/d130 0 2023-01-04T18:17:18.044 INFO:tasks.workunit.client.0.smithi050.stdout:2/931: fsync d1/dd/d62/da1/d83/fa6 0 2023-01-04T18:17:18.047 INFO:tasks.workunit.client.0.smithi050.stdout:0/780: write d0/d6/d8/d35/f37 [1427155,102684] 0 2023-01-04T18:17:18.049 INFO:tasks.workunit.client.0.smithi050.stdout:3/924: dwrite d0/d8f/d46/df7/d11a/d2f/d56/d98/d9c/fe5 [0,4194304] 0 2023-01-04T18:17:18.049 INFO:tasks.workunit.client.0.smithi050.stdout:4/898: dread d14/d1b/d1f/d22/d3e/f91 [0,4194304] 0 2023-01-04T18:17:18.055 INFO:tasks.workunit.client.0.smithi050.stdout:9/915: dwrite d1/d3/d13/f8d [4194304,4194304] 0 2023-01-04T18:17:18.055 INFO:tasks.workunit.client.0.smithi050.stdout:9/916: write d1/d12/f74 [1045380,45284] 0 2023-01-04T18:17:18.056 INFO:tasks.workunit.client.0.smithi050.stdout:9/917: fdatasync d1/d3/d24/f55 0 2023-01-04T18:17:18.056 INFO:tasks.workunit.client.0.smithi050.stdout:9/918: write d1/d12/d2d/d39/fd2 [335085,96870] 0 2023-01-04T18:17:18.057 INFO:tasks.workunit.client.0.smithi050.stdout:6/923: creat d0/f120 x:0 0 0 2023-01-04T18:17:18.057 INFO:tasks.workunit.client.0.smithi050.stdout:6/924: fdatasync d0/d5c/d5d/d112/df/dba/dca/d6b/fd6 0 2023-01-04T18:17:18.057 INFO:tasks.workunit.client.0.smithi050.stdout:6/925: dread - d0/d5c/d5d/d112/df/f104 zero size 2023-01-04T18:17:18.058 INFO:tasks.workunit.client.0.smithi050.stdout:0/781: dread d0/d6/d28/d1a/f40 [0,4194304] 0 2023-01-04T18:17:18.058 INFO:tasks.workunit.client.0.smithi050.stdout:9/919: read d1/d12/d9f/fbb [1033407,130493] 0 2023-01-04T18:17:18.059 INFO:tasks.workunit.client.0.smithi050.stdout:8/993: truncate d3/d2a/d60/f40 1641984 0 2023-01-04T18:17:18.065 INFO:tasks.workunit.client.0.smithi050.stdout:2/932: truncate d1/dd/d11/d12/f59 920770 0 2023-01-04T18:17:18.097 INFO:tasks.workunit.client.0.smithi050.stdout:3/925: getdents d0/d8f/d46/df7/d11a/d2f/d56 0 2023-01-04T18:17:18.098 INFO:tasks.workunit.client.0.smithi050.stdout:3/926: write d0/d8f/d46/df7/d11a/d2f/d56/fb0 [520811,39130] 0 2023-01-04T18:17:18.099 INFO:tasks.workunit.client.0.smithi050.stdout:4/899: mknod d14/d1b/d66/dc1/dd6/c12e 0 2023-01-04T18:17:18.106 INFO:tasks.workunit.client.0.smithi050.stdout:3/927: dread d0/d8f/d46/df7/d11a/f23 [0,4194304] 0 2023-01-04T18:17:18.107 INFO:tasks.workunit.client.0.smithi050.stdout:6/926: mknod d0/d5c/d5d/d112/df/d74/c121 0 2023-01-04T18:17:18.108 INFO:tasks.workunit.client.0.smithi050.stdout:0/782: creat d0/d9f/d84/dd8/ff8 x:0 0 0 2023-01-04T18:17:18.110 INFO:tasks.workunit.client.0.smithi050.stdout:0/783: write d0/f4d [625127,109450] 0 2023-01-04T18:17:18.110 INFO:tasks.workunit.client.0.smithi050.stdout:0/784: chown d0/d73/l78 126540956 1 2023-01-04T18:17:18.110 INFO:tasks.workunit.client.0.smithi050.stdout:0/785: fdatasync d0/d9f/f96 0 2023-01-04T18:17:18.110 INFO:tasks.workunit.client.0.smithi050.stdout:0/786: fdatasync d0/d9f/fcd 0 2023-01-04T18:17:18.110 INFO:tasks.workunit.client.0.smithi050.stdout:0/787: fsync d0/d6/d8/f89 0 2023-01-04T18:17:18.110 INFO:tasks.workunit.client.0.smithi050.stdout:9/920: rmdir d1/d3/dec 39 2023-01-04T18:17:18.114 INFO:tasks.workunit.client.0.smithi050.stdout:2/933: symlink d1/l131 0 2023-01-04T18:17:18.117 INFO:tasks.workunit.client.0.smithi050.stdout:0/788: dread d0/d6/d8/f2a [0,4194304] 0 2023-01-04T18:17:18.119 INFO:tasks.workunit.client.0.smithi050.stdout:0/789: write d0/d6/d8/d35/f37 [2052604,50169] 0 2023-01-04T18:17:18.121 INFO:tasks.workunit.client.0.smithi050.stdout:1/969: sync 2023-01-04T18:17:18.126 INFO:tasks.workunit.client.0.smithi050.stdout:4/900: rmdir d14/d1b/d1f/d63/dcb 39 2023-01-04T18:17:18.126 INFO:tasks.workunit.client.0.smithi050.stdout:4/901: write d14/d1b/d1f/d22/d87/de0/d108/d5f/d80/fd8 [1196717,84241] 0 2023-01-04T18:17:18.131 INFO:tasks.workunit.client.0.smithi050.stdout:3/928: mknod d0/d10/d101/c138 0 2023-01-04T18:17:18.131 INFO:tasks.workunit.client.0.smithi050.stdout:3/929: read d0/f132 [721021,107170] 0 2023-01-04T18:17:18.134 INFO:tasks.workunit.client.0.smithi050.stdout:6/927: creat d0/d5c/d5d/f122 x:0 0 0 2023-01-04T18:17:18.134 INFO:tasks.workunit.client.0.smithi050.stdout:6/928: stat d0/d5c/d5d/d112/df/dba/dca/d6b/da4/dab/dec 0 2023-01-04T18:17:18.135 INFO:tasks.workunit.client.0.smithi050.stdout:9/921: dwrite d1/d3/d11/d42/fc7 [0,4194304] 0 2023-01-04T18:17:18.139 INFO:tasks.workunit.client.0.smithi050.stdout:3/930: dread d0/f2c [0,4194304] 0 2023-01-04T18:17:18.139 INFO:tasks.workunit.client.0.smithi050.stdout:3/931: read d0/d8f/d46/df7/d11a/d2f/d71/fda [1526989,12798] 0 2023-01-04T18:17:18.141 INFO:tasks.workunit.client.0.smithi050.stdout:0/790: link d0/d9f/da1/fd1 d0/d6/d8/d4f/ff9 0 2023-01-04T18:17:18.144 INFO:tasks.workunit.client.0.smithi050.stdout:4/902: dwrite d14/d1b/d1f/d22/d3e/d8a/fda [0,4194304] 0 2023-01-04T18:17:18.144 INFO:tasks.workunit.client.0.smithi050.stdout:1/970: creat d8/d48/d5c/d67/f12b x:0 0 0 2023-01-04T18:17:18.144 INFO:tasks.workunit.client.0.smithi050.stdout:1/971: write d8/d14/d1c/d28/d57/d6a/d92/fc6 [290503,121375] 0 2023-01-04T18:17:18.145 INFO:tasks.workunit.client.0.smithi050.stdout:6/929: creat d0/d5c/d5d/d112/d38/f123 x:0 0 0 2023-01-04T18:17:18.146 INFO:tasks.workunit.client.0.smithi050.stdout:2/934: link d1/d10/c100 d1/dd/c132 0 2023-01-04T18:17:18.149 INFO:tasks.workunit.client.0.smithi050.stdout:0/791: mkdir d0/d9f/d84/dfa 0 2023-01-04T18:17:18.154 INFO:tasks.workunit.client.0.smithi050.stdout:4/903: stat d14/d1b/d66/dc1/lff 0 2023-01-04T18:17:18.155 INFO:tasks.workunit.client.0.smithi050.stdout:4/904: write d14/d1b/f50 [2795915,98216] 0 2023-01-04T18:17:18.157 INFO:tasks.workunit.client.0.smithi050.stdout:1/972: getdents d8/dce 0 2023-01-04T18:17:18.161 INFO:tasks.workunit.client.0.smithi050.stdout:6/930: rename d0/d5c/d5d/d112/df/dba/dca/fff to d0/d5c/d5d/d112/d25/d2d/dea/d54/f124 0 2023-01-04T18:17:18.161 INFO:tasks.workunit.client.0.smithi050.stdout:6/931: stat d0/d5c/d5d/d112/d25/d2d/dea/l1f 0 2023-01-04T18:17:18.161 INFO:tasks.workunit.client.0.smithi050.stdout:9/922: dwrite d1/d3/d11/d1f/f4e [0,4194304] 0 2023-01-04T18:17:18.163 INFO:tasks.workunit.client.0.smithi050.stdout:0/792: creat d0/d6/d28/d1a/d8a/d9e/ffb x:0 0 0 2023-01-04T18:17:18.163 INFO:tasks.workunit.client.0.smithi050.stdout:3/932: dwrite d0/d8f/d46/dc2/d107/f48 [0,4194304] 0 2023-01-04T18:17:18.164 INFO:tasks.workunit.client.0.smithi050.stdout:3/933: write d0/fe [5492404,9864] 0 2023-01-04T18:17:18.166 INFO:tasks.workunit.client.0.smithi050.stdout:4/905: creat d14/d1b/d1f/d22/d3e/d85/da6/f12f x:0 0 0 2023-01-04T18:17:18.166 INFO:tasks.workunit.client.0.smithi050.stdout:4/906: chown d14/d1b/d1f/d63 132357853 1 2023-01-04T18:17:18.174 INFO:tasks.workunit.client.0.smithi050.stdout:1/973: creat d8/d48/d5c/d67/d3b/f12c x:0 0 0 2023-01-04T18:17:18.177 INFO:tasks.workunit.client.0.smithi050.stdout:3/934: dread d0/d8f/d46/df7/d11a/d2f/d31/f83 [0,4194304] 0 2023-01-04T18:17:18.178 INFO:tasks.workunit.client.0.smithi050.stdout:2/935: rename d1/dd/d28/d79/de4/f112 to d1/dd/d28/d2c/d2e/d3f/da7/f133 0 2023-01-04T18:17:18.178 INFO:tasks.workunit.client.0.smithi050.stdout:2/936: readlink d1/dd/d11/d14/d91/l1f 0 2023-01-04T18:17:18.178 INFO:tasks.workunit.client.0.smithi050.stdout:2/937: dread - d1/d41/ff1 zero size 2023-01-04T18:17:18.180 INFO:tasks.workunit.client.0.smithi050.stdout:6/932: creat d0/d5c/f125 x:0 0 0 2023-01-04T18:17:18.180 INFO:tasks.workunit.client.0.smithi050.stdout:6/933: chown d0/d4a/la9 389144992 1 2023-01-04T18:17:18.181 INFO:tasks.workunit.client.0.smithi050.stdout:6/934: chown d0/d5c/d5d/d112/d25/d40/d89/dd9/d7a/lf3 34684487 1 2023-01-04T18:17:18.181 INFO:tasks.workunit.client.0.smithi050.stdout:6/935: stat d0/d5c/d5d/d112/d25/d40/d89/dd9/d7a/ff0 0 2023-01-04T18:17:18.182 INFO:tasks.workunit.client.0.smithi050.stdout:9/923: creat d1/d3/d13/d77/f125 x:0 0 0 2023-01-04T18:17:18.186 INFO:tasks.workunit.client.0.smithi050.stdout:0/793: mkdir d0/d6/d8/d51/dd9/dfc 0 2023-01-04T18:17:18.187 INFO:tasks.workunit.client.0.smithi050.stdout:2/938: dread d1/dd/d62/d69/f84 [4194304,4194304] 0 2023-01-04T18:17:18.188 INFO:tasks.workunit.client.0.smithi050.stdout:4/907: symlink d14/d1b/d1f/d22/d87/de0/d108/d5d/l130 0 2023-01-04T18:17:18.188 INFO:tasks.workunit.client.0.smithi050.stdout:4/908: write d14/d1b/d1f/d22/d3e/f5a [4876330,63924] 0 2023-01-04T18:17:18.188 INFO:tasks.workunit.client.0.smithi050.stdout:4/909: dread - d14/d1b/d1f/d22/d87/de0/f106 zero size 2023-01-04T18:17:18.189 INFO:tasks.workunit.client.0.smithi050.stdout:0/794: read d0/d6/d28/fad [384634,67635] 0 2023-01-04T18:17:18.191 INFO:tasks.workunit.client.0.smithi050.stdout:0/795: write d0/d6/d28/fe7 [556952,91223] 0 2023-01-04T18:17:18.191 INFO:tasks.workunit.client.0.smithi050.stdout:0/796: dread - d0/d6/d28/fdf zero size 2023-01-04T18:17:18.192 INFO:tasks.workunit.client.0.smithi050.stdout:6/936: mknod d0/d5c/d5d/d112/df/dba/dca/d77/c126 0 2023-01-04T18:17:18.196 INFO:tasks.workunit.client.0.smithi050.stdout:9/924: truncate d1/d12/d2d/f85 989175 0 2023-01-04T18:17:18.196 INFO:tasks.workunit.client.0.smithi050.stdout:9/925: readlink d1/d3/d13/l87 0 2023-01-04T18:17:18.196 INFO:tasks.workunit.client.0.smithi050.stdout:9/926: chown d1/d6f/faa 14184 1 2023-01-04T18:17:18.197 INFO:tasks.workunit.client.0.smithi050.stdout:2/939: unlink d1/dd/d62/c10f 0 2023-01-04T18:17:18.199 INFO:tasks.workunit.client.0.smithi050.stdout:4/910: mkdir d14/d1b/d1f/d22/d87/de0/d131 0 2023-01-04T18:17:18.200 INFO:tasks.workunit.client.0.smithi050.stdout:0/797: rmdir d0 39 2023-01-04T18:17:18.203 INFO:tasks.workunit.client.0.smithi050.stdout:6/937: creat d0/d5c/d5d/d112/d25/d40/d89/dd9/d7a/f127 x:0 0 0 2023-01-04T18:17:18.206 INFO:tasks.workunit.client.0.smithi050.stdout:9/927: mkdir d1/d3/dbf/dd4/da8/dda/d126 0 2023-01-04T18:17:18.208 INFO:tasks.workunit.client.0.smithi050.stdout:2/940: rmdir d1/dd/d11/d14 39 2023-01-04T18:17:18.210 INFO:tasks.workunit.client.0.smithi050.stdout:4/911: rmdir d14/d1b/d1f/d22/d6a 39 2023-01-04T18:17:18.212 INFO:tasks.workunit.client.0.smithi050.stdout:0/798: symlink d0/d9f/d84/lfd 0 2023-01-04T18:17:18.215 INFO:tasks.workunit.client.0.smithi050.stdout:9/928: rename d1/d12/d2d/d39/c50 to d1/d3/d89/d114/d119/c127 0 2023-01-04T18:17:18.216 INFO:tasks.workunit.client.0.smithi050.stdout:2/941: dread d1/dd/d62/f77 [0,4194304] 0 2023-01-04T18:17:18.217 INFO:tasks.workunit.client.0.smithi050.stdout:4/912: dread d14/d1b/d1f/d22/d87/de0/d108/d5f/d80/d9d/ffb [0,4194304] 0 2023-01-04T18:17:18.219 INFO:tasks.workunit.client.0.smithi050.stdout:0/799: getdents d0/d73/d79/dd5 0 2023-01-04T18:17:18.221 INFO:tasks.workunit.client.0.smithi050.stdout:9/929: mkdir d1/d3/d11/dcd/d11e/d128 0 2023-01-04T18:17:18.221 INFO:tasks.workunit.client.0.smithi050.stdout:9/930: chown d1/d6f 48 1 2023-01-04T18:17:18.225 INFO:tasks.workunit.client.0.smithi050.stdout:2/942: symlink d1/dd/d62/d69/d117/l134 0 2023-01-04T18:17:18.225 INFO:tasks.workunit.client.0.smithi050.stdout:4/913: creat d14/d1b/d1f/d22/d3e/d8a/f132 x:0 0 0 2023-01-04T18:17:18.225 INFO:tasks.workunit.client.0.smithi050.stdout:2/943: fsync d1/dd/d11/db5/f104 0 2023-01-04T18:17:18.226 INFO:tasks.workunit.client.0.smithi050.stdout:2/944: chown d1/dd/d28 447 1 2023-01-04T18:17:18.227 INFO:tasks.workunit.client.0.smithi050.stdout:1/974: dwrite d8/d48/d5c/d67/d3a/f70 [4194304,4194304] 0 2023-01-04T18:17:18.227 INFO:tasks.workunit.client.0.smithi050.stdout:1/975: dread - d8/d48/d5c/d67/d3b/f12c zero size 2023-01-04T18:17:18.227 INFO:tasks.workunit.client.0.smithi050.stdout:0/800: creat d0/d6/d8/d4f/df4/ffe x:0 0 0 2023-01-04T18:17:18.230 INFO:tasks.workunit.client.0.smithi050.stdout:9/931: creat d1/d12/d9f/f129 x:0 0 0 2023-01-04T18:17:18.231 INFO:tasks.workunit.client.0.smithi050.stdout:9/932: truncate d1/d3/d3b/f9a 478093 0 2023-01-04T18:17:18.232 INFO:tasks.workunit.client.0.smithi050.stdout:3/935: dwrite d0/d8f/d46/df7/d11a/d2f/d56/d98/d9c/dcd/f120 [0,4194304] 0 2023-01-04T18:17:18.236 INFO:tasks.workunit.client.0.smithi050.stdout:6/938: dwrite d0/d5c/d5d/d112/d25/f27 [0,4194304] 0 2023-01-04T18:17:18.239 INFO:tasks.workunit.client.0.smithi050.stdout:4/914: unlink d14/d1b/f50 0 2023-01-04T18:17:18.240 INFO:tasks.workunit.client.0.smithi050.stdout:2/945: mkdir d1/dd/d28/df4/d135 0 2023-01-04T18:17:18.260 INFO:tasks.workunit.client.0.smithi050.stdout:1/976: mknod d8/d14/d1c/d28/d57/d6a/d92/dec/c12d 0 2023-01-04T18:17:18.261 INFO:tasks.workunit.client.0.smithi050.stdout:1/977: write d8/dce/fa4 [207235,93565] 0 2023-01-04T18:17:18.261 INFO:tasks.workunit.client.0.smithi050.stdout:1/978: stat d8/d48/d5c/f6c 0 2023-01-04T18:17:18.264 INFO:tasks.workunit.client.0.smithi050.stdout:0/801: rmdir d0/d73/d79 39 2023-01-04T18:17:18.268 INFO:tasks.workunit.client.0.smithi050.stdout:9/933: rmdir d1/d3/d3b/d63/dc6 0 2023-01-04T18:17:18.268 INFO:tasks.workunit.client.0.smithi050.stdout:9/934: stat d1/d12/d2d/ff6 0 2023-01-04T18:17:18.320 INFO:tasks.workunit.client.0.smithi050.stdout:6/939: write d0/d5c/d5d/d112/df/dba/fd5 [1116087,126970] 0 2023-01-04T18:17:18.321 INFO:tasks.workunit.client.0.smithi050.stdout:4/915: mknod d14/d1b/dd7/c133 0 2023-01-04T18:17:18.322 INFO:tasks.workunit.client.0.smithi050.stdout:2/946: mkdir d1/dd/d38/d136 0 2023-01-04T18:17:18.324 INFO:tasks.workunit.client.0.smithi050.stdout:2/947: write d1/dd/d11/d12/f4d [1306246,13877] 0 2023-01-04T18:17:18.327 INFO:tasks.workunit.client.0.smithi050.stdout:1/979: mkdir d8/d14/d1c/d28/d57/d6a/d92/d12e 0 2023-01-04T18:17:18.328 INFO:tasks.workunit.client.0.smithi050.stdout:0/802: truncate d0/f7e 322722 0 2023-01-04T18:17:18.328 INFO:tasks.workunit.client.0.smithi050.stdout:0/803: chown d0/d6/d8/d35/f97 3246 1 2023-01-04T18:17:18.333 INFO:tasks.workunit.client.0.smithi050.stdout:9/935: creat d1/d3/d11/dcd/d11e/f12a x:0 0 0 2023-01-04T18:17:18.338 INFO:tasks.workunit.client.0.smithi050.stdout:8/994: sync 2023-01-04T18:17:18.339 INFO:tasks.workunit.client.0.smithi050.stdout:6/940: creat d0/d5c/d5d/d112/d25/d40/f128 x:0 0 0 2023-01-04T18:17:18.339 INFO:tasks.workunit.client.0.smithi050.stdout:6/941: stat d0/l108 0 2023-01-04T18:17:18.349 INFO:tasks.workunit.client.0.smithi050.stdout:4/916: link f0 d14/d1b/d1f/d22/d3e/d85/da6/f134 0 2023-01-04T18:17:18.349 INFO:tasks.workunit.client.0.smithi050.stdout:4/917: read d14/d1b/d1f/d22/d3e/d44/f68 [104197,23301] 0 2023-01-04T18:17:18.353 INFO:tasks.workunit.client.0.smithi050.stdout:2/948: link d1/dd/d11/d14/d91/f9d d1/dd/d28/d2c/d2e/f137 0 2023-01-04T18:17:18.354 INFO:tasks.workunit.client.0.smithi050.stdout:3/936: sync 2023-01-04T18:17:18.357 INFO:tasks.workunit.client.0.smithi050.stdout:4/918: dread d14/d1b/d1f/d22/d87/de0/d108/d5f/d80/fa3 [0,4194304] 0 2023-01-04T18:17:18.358 INFO:tasks.workunit.client.0.smithi050.stdout:1/980: creat d8/d48/d103/f12f x:0 0 0 2023-01-04T18:17:18.358 INFO:tasks.workunit.client.0.smithi050.stdout:1/981: rename d8/d14/d1c/d28/d57/d6a/d92 to d8/d14/d1c/d28/d57/d6a/d92/d130 22 2023-01-04T18:17:18.358 INFO:tasks.workunit.client.0.smithi050.stdout:1/982: readlink d8/d48/d5c/d67/d3b/l98 0 2023-01-04T18:17:18.359 INFO:tasks.workunit.client.0.smithi050.stdout:0/804: mknod d0/d6/d8/d35/dd2/cff 0 2023-01-04T18:17:18.360 INFO:tasks.workunit.client.0.smithi050.stdout:9/936: creat d1/d12/d3f/f12b x:0 0 0 2023-01-04T18:17:18.360 INFO:tasks.workunit.client.0.smithi050.stdout:9/937: write d1/d3/d11/d42/fc5 [959185,128402] 0 2023-01-04T18:17:18.362 INFO:tasks.workunit.client.0.smithi050.stdout:3/937: dread d0/f4 [0,4194304] 0 2023-01-04T18:17:18.364 INFO:tasks.workunit.client.0.smithi050.stdout:8/995: rmdir d3/d2a/d27/d93/d7f/d96 39 2023-01-04T18:17:18.366 INFO:tasks.workunit.client.0.smithi050.stdout:6/942: getdents d0/d5c/d5d/d112/d25/d2d 0 2023-01-04T18:17:18.373 INFO:tasks.workunit.client.0.smithi050.stdout:2/949: mkdir d1/dd/d28/d2c/d66/d138 0 2023-01-04T18:17:18.376 INFO:tasks.workunit.client.0.smithi050.stdout:4/919: creat d14/d1b/d1f/d22/d87/de0/d108/d5d/f135 x:0 0 0 2023-01-04T18:17:18.381 INFO:tasks.workunit.client.0.smithi050.stdout:1/983: link d8/d48/fc0 d8/d48/d5c/d67/d3b/db9/dde/f131 0 2023-01-04T18:17:18.381 INFO:tasks.workunit.client.0.smithi050.stdout:1/984: readlink d8/d14/d1c/d28/d57/de6/l110 0 2023-01-04T18:17:18.381 INFO:tasks.workunit.client.0.smithi050.stdout:1/985: truncate d8/d48/d5c/d67/d3b/d84/d11e/f126 75436 0 2023-01-04T18:17:18.383 INFO:tasks.workunit.client.0.smithi050.stdout:0/805: symlink d0/d6/d8/d51/dd9/dfc/l100 0 2023-01-04T18:17:18.384 INFO:tasks.workunit.client.0.smithi050.stdout:9/938: dwrite d1/d3/d13/d77/fba [0,4194304] 0 2023-01-04T18:17:18.385 INFO:tasks.workunit.client.0.smithi050.stdout:9/939: chown d1/d12/d2d/d39/fd2 349397 1 2023-01-04T18:17:18.385 INFO:tasks.workunit.client.0.smithi050.stdout:9/940: fdatasync d1/d6f/faa 0 2023-01-04T18:17:18.385 INFO:tasks.workunit.client.0.smithi050.stdout:3/938: creat d0/f139 x:0 0 0 2023-01-04T18:17:18.388 INFO:tasks.workunit.client.0.smithi050.stdout:6/943: mkdir d0/d5c/d5d/d112/d25/d40/d89/d129 0 2023-01-04T18:17:18.388 INFO:tasks.workunit.client.0.smithi050.stdout:6/944: truncate d0/d5c/d5d/d112/d25/d40/f128 988838 0 2023-01-04T18:17:18.390 INFO:tasks.workunit.client.0.smithi050.stdout:8/996: dwrite d3/d2a/d2d/f66 [0,4194304] 0 2023-01-04T18:17:18.391 INFO:tasks.workunit.client.0.smithi050.stdout:6/945: write d0/d5c/fbc [43938,104620] 0 2023-01-04T18:17:18.392 INFO:tasks.workunit.client.0.smithi050.stdout:2/950: rename d1/dd/d28/d2c/dce to d1/dd/d62/da1/d83/d139 0 2023-01-04T18:17:18.392 INFO:tasks.workunit.client.0.smithi050.stdout:2/951: truncate d1/dd/d11/d14/f33 4485722 0 2023-01-04T18:17:18.402 INFO:tasks.workunit.client.0.smithi050.stdout:1/986: dwrite d8/fb8 [0,4194304] 0 2023-01-04T18:17:18.404 INFO:tasks.workunit.client.0.smithi050.stdout:3/939: dwrite d0/d8f/deb/fcc [0,4194304] 0 2023-01-04T18:17:18.404 INFO:tasks.workunit.client.0.smithi050.stdout:3/940: chown d0/dd/d45/la4 14647302 1 2023-01-04T18:17:18.404 INFO:tasks.workunit.client.0.smithi050.stdout:1/987: write d8/d14/f30 [3824379,43220] 0 2023-01-04T18:17:18.405 INFO:tasks.workunit.client.0.smithi050.stdout:1/988: truncate d8/d14/d1c/d28/d57/d6a/d92/fc6 568220 0 2023-01-04T18:17:18.412 INFO:tasks.workunit.client.0.smithi050.stdout:6/946: write d0/d5c/d5d/d112/f17 [1730505,39526] 0 2023-01-04T18:17:18.412 INFO:tasks.workunit.client.0.smithi050.stdout:1/989: dread d8/fd [4194304,4194304] 0 2023-01-04T18:17:18.412 INFO:tasks.workunit.client.0.smithi050.stdout:1/990: chown d8/d48/d5c 852421 1 2023-01-04T18:17:18.442 INFO:tasks.workunit.client.0.smithi050.stdout:4/920: truncate d14/d1b/d1f/d22/f4d 83142 0 2023-01-04T18:17:18.560 INFO:tasks.workunit.client.0.smithi050.stdout:9/941: unlink d1/d3/d24/f55 0 2023-01-04T18:17:18.575 INFO:tasks.workunit.client.0.smithi050.stdout:8/997: mkdir d3/d2a/d74/d92/d94/dc9/d155 0 2023-01-04T18:17:18.578 INFO:tasks.workunit.client.0.smithi050.stdout:8/998: dread d3/d2a/d27/dc1/fc2 [0,4194304] 0 2023-01-04T18:17:18.578 INFO:tasks.workunit.client.0.smithi050.stdout:8/999: write d3/d2a/d27/d93/d7f/d96/db6/f14f [886959,101796] 0 2023-01-04T18:17:18.580 INFO:tasks.workunit.client.0.smithi050.stdout:0/806: rmdir d0/d73 39 2023-01-04T18:17:18.580 INFO:tasks.workunit.client.0.smithi050.stdout:0/807: write d0/d73/d79/fde [2398,96718] 0 2023-01-04T18:17:18.593 INFO:tasks.workunit.client.0.smithi050.stdout:2/952: symlink d1/dd/db0/l13a 0 2023-01-04T18:17:18.595 INFO:tasks.workunit.client.0.smithi050.stdout:2/953: dread d1/dd/d62/ff3 [0,4194304] 0 2023-01-04T18:17:18.601 INFO:tasks.workunit.client.0.smithi050.stdout:3/941: symlink d0/d8f/d46/df7/d11a/d2f/d71/l13a 0 2023-01-04T18:17:18.605 INFO:tasks.workunit.client.0.smithi050.stdout:6/947: creat d0/d5c/d5d/d112/d25/d40/d89/dd9/dc0/de3/f12a x:0 0 0 2023-01-04T18:17:18.606 INFO:tasks.workunit.client.0.smithi050.stdout:1/991: creat d8/d48/d5c/d67/d3a/dd1/f132 x:0 0 0 2023-01-04T18:17:18.608 INFO:tasks.workunit.client.0.smithi050.stdout:4/921: creat d14/d1b/d1f/d22/f136 x:0 0 0 2023-01-04T18:17:18.611 INFO:tasks.workunit.client.0.smithi050.stdout:9/942: creat d1/d3/d89/d114/f12c x:0 0 0 2023-01-04T18:17:18.611 INFO:tasks.workunit.client.0.smithi050.stdout:9/943: write d1/f47 [5132958,130882] 0 2023-01-04T18:17:18.612 INFO:tasks.workunit.client.0.smithi050.stdout:0/808: mknod d0/d9f/da1/c101 0 2023-01-04T18:17:18.612 INFO:tasks.workunit.client.0.smithi050.stdout:0/809: stat d0/d9f/d84/cee 0 2023-01-04T18:17:18.614 INFO:tasks.workunit.client.0.smithi050.stdout:2/954: rmdir d1/dd/d28/d2c/d66/d138 0 2023-01-04T18:17:18.615 INFO:tasks.workunit.client.0.smithi050.stdout:2/955: dread d1/dd/d62/d69/f82 [4194304,4194304] 0 2023-01-04T18:17:18.617 INFO:tasks.workunit.client.0.smithi050.stdout:3/942: rename d0/d1a/l59 to d0/d8f/d46/d80/dca/l13b 0 2023-01-04T18:17:18.621 INFO:tasks.workunit.client.0.smithi050.stdout:1/992: creat d8/d48/d5c/d67/d3b/f133 x:0 0 0 2023-01-04T18:17:18.621 INFO:tasks.workunit.client.0.smithi050.stdout:1/993: fdatasync d8/d14/d1c/d28/d57/d6a/f95 0 2023-01-04T18:17:18.621 INFO:tasks.workunit.client.0.smithi050.stdout:1/994: chown d8/d14/led 241 1 2023-01-04T18:17:18.621 INFO:tasks.workunit.client.0.smithi050.stdout:1/995: dread - d8/d48/d5c/d67/d3b/f12c zero size 2023-01-04T18:17:18.622 INFO:tasks.workunit.client.0.smithi050.stdout:4/922: creat d14/d1b/d1f/d22/d87/de0/f137 x:0 0 0 2023-01-04T18:17:18.624 INFO:tasks.workunit.client.0.smithi050.stdout:9/944: write d1/d3/d89/f80 [2681835,123607] 0 2023-01-04T18:17:18.624 INFO:tasks.workunit.client.0.smithi050.stdout:9/945: truncate d1/d12/d41/d60/fa2 4433356 0 2023-01-04T18:17:18.627 INFO:tasks.workunit.client.0.smithi050.stdout:6/948: dwrite d0/d4a/d93/faa [0,4194304] 0 2023-01-04T18:17:18.627 INFO:tasks.workunit.client.0.smithi050.stdout:6/949: dread - d0/d5c/d5d/d112/d25/d40/d89/ffc zero size 2023-01-04T18:17:18.627 INFO:tasks.workunit.client.0.smithi050.stdout:6/950: fsync d0/d5c/d5d/d112/df/dba/dca/d6b/da4/f100 0 2023-01-04T18:17:18.627 INFO:tasks.workunit.client.0.smithi050.stdout:0/810: unlink d0/d6/d28/d1a/d8a/fc7 0 2023-01-04T18:17:18.630 INFO:tasks.workunit.client.0.smithi050.stdout:2/956: mkdir d1/dd/d28/d79/de4/d13b 0 2023-01-04T18:17:18.634 INFO:tasks.workunit.client.0.smithi050.stdout:9/946: creat d1/d3/d89/f12d x:0 0 0 2023-01-04T18:17:18.638 INFO:tasks.workunit.client.0.smithi050.stdout:4/923: read d14/d1b/d1f/fe8 [3204009,43946] 0 2023-01-04T18:17:18.639 INFO:tasks.workunit.client.0.smithi050.stdout:3/943: dwrite d0/d8f/d46/df7/d11a/d2f/f129 [0,4194304] 0 2023-01-04T18:17:18.639 INFO:tasks.workunit.client.0.smithi050.stdout:3/944: chown d0/d8f/d46/dc2/d107/dbb/l12f 1793595 1 2023-01-04T18:17:18.648 INFO:tasks.workunit.client.0.smithi050.stdout:1/996: dwrite d8/d48/d5c/d67/d3b/d84/f8b [0,4194304] 0 2023-01-04T18:17:18.648 INFO:tasks.workunit.client.0.smithi050.stdout:1/997: truncate d8/d48/d5c/d67/f56 1246910 0 2023-01-04T18:17:18.648 INFO:tasks.workunit.client.0.smithi050.stdout:1/998: chown d8/d48/d5c/d67/d3b/d84/fc5 213 1 2023-01-04T18:17:18.648 INFO:tasks.workunit.client.0.smithi050.stdout:1/999: fdatasync d8/fd 0 2023-01-04T18:17:18.649 INFO:tasks.workunit.client.0.smithi050.stdout:6/951: mknod d0/d5c/d5d/d112/df/dba/dca/d6b/da4/c12b 0 2023-01-04T18:17:18.649 INFO:tasks.workunit.client.0.smithi050.stdout:6/952: chown d0/d5c/db7/d83 0 1 2023-01-04T18:17:18.649 INFO:tasks.workunit.client.0.smithi050.stdout:9/947: creat d1/d12/d41/f12e x:0 0 0 2023-01-04T18:17:18.649 INFO:tasks.workunit.client.0.smithi050.stdout:0/811: dwrite d0/d6/d8/d35/fa8 [0,4194304] 0 2023-01-04T18:17:18.651 INFO:tasks.workunit.client.0.smithi050.stdout:6/953: write d0/d5c/d5d/f103 [4053017,28966] 0 2023-01-04T18:17:18.712 INFO:tasks.workunit.client.0.smithi050.stdout:4/924: rename d14/d1b/d1f/d22/d3e/d85/f94 to d14/d1b/d66/dc1/dd6/f138 0 2023-01-04T18:17:18.729 INFO:tasks.workunit.client.0.smithi050.stdout:3/945: symlink d0/d8f/deb/l13c 0 2023-01-04T18:17:18.730 INFO:tasks.workunit.client.0.smithi050.stdout:3/946: stat d0/d1a 0 2023-01-04T18:17:18.730 INFO:tasks.workunit.client.0.smithi050.stdout:3/947: truncate d0/d8f/d46/df7/d11a/d2f/d56/d98/f104 599264 0 2023-01-04T18:17:18.730 INFO:tasks.workunit.client.0.smithi050.stdout:3/948: chown d0/d10 1009875 1 2023-01-04T18:17:18.730 INFO:tasks.workunit.client.0.smithi050.stdout:3/949: fdatasync d0/d8f/d46/df7/d11a/d2f/d56/d98/dc7/ded/f124 0 2023-01-04T18:17:18.731 INFO:tasks.workunit.client.0.smithi050.stdout:3/950: dread d0/d8f/d46/dc2/d107/fb2 [0,4194304] 0 2023-01-04T18:17:18.731 INFO:tasks.workunit.client.0.smithi050.stdout:3/951: fsync d0/d8f/d46/df7/d11a/d2f/fb7 0 2023-01-04T18:17:18.747 INFO:tasks.workunit.client.0.smithi050.stdout:6/954: creat d0/d5c/d5d/d112/d25/d40/d89/dd9/d7a/dcb/f12c x:0 0 0 2023-01-04T18:17:18.749 INFO:tasks.workunit.client.0.smithi050.stdout:9/948: rename d1/d12/d41/f71 to d1/d12/d3f/de1/f12f 0 2023-01-04T18:17:18.750 INFO:tasks.workunit.client.0.smithi050.stdout:4/925: creat d14/d1b/d1f/d22/d87/f139 x:0 0 0 2023-01-04T18:17:18.750 INFO:tasks.workunit.client.0.smithi050.stdout:4/926: stat d14/d1b/d66/dc1/dd6 0 2023-01-04T18:17:18.750 INFO:tasks.workunit.client.0.smithi050.stdout:4/927: dread - d14/d1b/d1f/d22/d3e/fa4 zero size 2023-01-04T18:17:18.752 INFO:tasks.workunit.client.0.smithi050.stdout:4/928: mkdir d14/d1b/d1f/d22/d87/de0/d108/d5d/d7f/d13a 0 2023-01-04T18:17:18.753 INFO:tasks.workunit.client.0.smithi050.stdout:6/955: dread d0/d5c/d5d/d112/d25/d4d/ffa [0,4194304] 0 2023-01-04T18:17:18.754 INFO:tasks.workunit.client.0.smithi050.stdout:6/956: truncate d0/d5c/db7/fe7 524548 0 2023-01-04T18:17:18.754 INFO:tasks.workunit.client.0.smithi050.stdout:4/929: getdents d14/d1b/d1f/d22/d87/de0/d108/d5f/d80 0 2023-01-04T18:17:18.754 INFO:tasks.workunit.client.0.smithi050.stdout:4/930: write d14/d1b/d1f/d22/d87/de0/d108/d5f/f10e [722551,27252] 0 2023-01-04T18:17:18.755 INFO:tasks.workunit.client.0.smithi050.stdout:6/957: getdents d0/d5c/d5d/d112/df/d74 0 2023-01-04T18:17:18.756 INFO:tasks.workunit.client.0.smithi050.stdout:4/931: mkdir d14/d1b/d1f/d22/d87/de0/d13b 0 2023-01-04T18:17:18.758 INFO:tasks.workunit.client.0.smithi050.stdout:6/958: mkdir d0/d5c/d5d/d112/d25/d40/d89/dd9/dc0/d12d 0 2023-01-04T18:17:18.761 INFO:tasks.workunit.client.0.smithi050.stdout:6/959: rmdir d0/d5c/d5d/d112/df/dba/dca/d6b 39 2023-01-04T18:17:18.761 INFO:tasks.workunit.client.0.smithi050.stdout:6/960: chown d0/d5c/d5d/d112/d25/d40/d89/dd9/d7a 20268522 1 2023-01-04T18:17:18.774 INFO:tasks.workunit.client.0.smithi050.stdout:4/932: dread d14/d1b/d1f/d22/d3e/d85/da6/fbb [0,4194304] 0 2023-01-04T18:17:18.774 INFO:tasks.workunit.client.0.smithi050.stdout:9/949: dwrite d1/d12/d41/d60/d8e/ffd [0,4194304] 0 2023-01-04T18:17:18.774 INFO:tasks.workunit.client.0.smithi050.stdout:9/950: chown d1/d12/f22 4 1 2023-01-04T18:17:18.774 INFO:tasks.workunit.client.0.smithi050.stdout:4/933: readlink d14/d1b/d1f/d22/d87/de0/d108/d5d/d7f/ld9 0 2023-01-04T18:17:18.774 INFO:tasks.workunit.client.0.smithi050.stdout:4/934: write d14/d1b/d32/f3f [766447,58855] 0 2023-01-04T18:17:18.775 INFO:tasks.workunit.client.0.smithi050.stdout:4/935: fdatasync d14/d1b/d1f/d63/f102 0 2023-01-04T18:17:18.775 INFO:tasks.workunit.client.0.smithi050.stdout:4/936: fdatasync d14/d1b/d1f/d22/d87/de0/f137 0 2023-01-04T18:17:18.776 INFO:tasks.workunit.client.0.smithi050.stdout:6/961: dwrite d0/d5c/d5d/d112/d25/d4d/f66 [0,4194304] 0 2023-01-04T18:17:18.793 INFO:tasks.workunit.client.0.smithi050.stdout:6/962: dwrite d0/d5c/fbf [0,4194304] 0 2023-01-04T18:17:18.793 INFO:tasks.workunit.client.0.smithi050.stdout:6/963: fsync d0/d5c/db7/f8a 0 2023-01-04T18:17:18.872 INFO:tasks.workunit.client.0.smithi050.stdout:6/964: dwrite d0/d5c/d5d/d112/d25/f3a [0,4194304] 0 2023-01-04T18:17:18.882 INFO:tasks.workunit.client.0.smithi050.stdout:9/951: creat d1/d12/d3f/f130 x:0 0 0 2023-01-04T18:17:18.896 INFO:tasks.workunit.client.0.smithi050.stdout:4/937: rename d14/d1b/d1f/d22/d87/de0/d108/d5d/d7f to d14/d1b/d66/dc1/d13c 0 2023-01-04T18:17:18.896 INFO:tasks.workunit.client.0.smithi050.stdout:4/938: truncate f5 5669817 0 2023-01-04T18:17:18.896 INFO:tasks.workunit.client.0.smithi050.stdout:4/939: chown d14/d1b/d66/dc1/d13c/de1/ce5 1 1 2023-01-04T18:17:18.903 INFO:tasks.workunit.client.0.smithi050.stdout:9/952: dwrite d1/d3/dbf/dd4/da8/fb0 [0,4194304] 0 2023-01-04T18:17:18.918 INFO:tasks.workunit.client.0.smithi050.stdout:6/965: mknod d0/c12e 0 2023-01-04T18:17:18.918 INFO:tasks.workunit.client.0.smithi050.stdout:6/966: readlink d0/l8b 0 2023-01-04T18:17:18.922 INFO:tasks.workunit.client.0.smithi050.stdout:4/940: dwrite d14/d1b/d1f/f107 [0,4194304] 0 2023-01-04T18:17:18.933 INFO:tasks.workunit.client.0.smithi050.stdout:9/953: mknod d1/d3/d11/d42/d118/c131 0 2023-01-04T18:17:18.941 INFO:tasks.workunit.client.0.smithi050.stdout:9/954: creat d1/d12/d41/d60/d117/f132 x:0 0 0 2023-01-04T18:17:18.942 INFO:tasks.workunit.client.0.smithi050.stdout:6/967: dwrite d0/d5c/d5d/d112/df/f30 [4194304,4194304] 0 2023-01-04T18:17:18.944 INFO:tasks.workunit.client.0.smithi050.stdout:9/955: creat d1/d3/d11/d105/f133 x:0 0 0 2023-01-04T18:17:18.945 INFO:tasks.workunit.client.0.smithi050.stdout:4/941: dwrite d14/d1b/d1f/d22/d87/f139 [0,4194304] 0 2023-01-04T18:17:18.945 INFO:tasks.workunit.client.0.smithi050.stdout:4/942: fdatasync d14/d1b/d1f/d22/d3e/d8a/f132 0 2023-01-04T18:17:18.945 INFO:tasks.workunit.client.0.smithi050.stdout:4/943: readlink d14/d1b/d32/l53 0 2023-01-04T18:17:18.946 INFO:tasks.workunit.client.0.smithi050.stdout:6/968: mkdir d0/d5c/d5d/d112/d25/d2d/d12f 0 2023-01-04T18:17:18.949 INFO:tasks.workunit.client.0.smithi050.stdout:9/956: mknod d1/d3/d11/dcd/d11e/c134 0 2023-01-04T18:17:18.954 INFO:tasks.workunit.client.0.smithi050.stdout:4/944: link d14/d1b/d1f/d22/d3e/d44/l76 d14/l13d 0 2023-01-04T18:17:18.954 INFO:tasks.workunit.client.0.smithi050.stdout:4/945: fdatasync d14/d1b/d66/dc1/d13c/de1/ff5 0 2023-01-04T18:17:18.956 INFO:tasks.workunit.client.0.smithi050.stdout:6/969: symlink d0/d5c/d5d/d112/d25/d2d/l130 0 2023-01-04T18:17:18.958 INFO:tasks.workunit.client.0.smithi050.stdout:9/957: creat d1/d3/d11/d105/f135 x:0 0 0 2023-01-04T18:17:18.959 INFO:tasks.workunit.client.0.smithi050.stdout:9/958: chown d1/d12/d41/lac 11349 1 2023-01-04T18:17:18.959 INFO:tasks.workunit.client.0.smithi050.stdout:9/959: readlink d1/d3/d11/l7f 0 2023-01-04T18:17:18.964 INFO:tasks.workunit.client.0.smithi050.stdout:4/946: creat d14/d1b/d1f/d22/d87/de0/d108/d5d/f13e x:0 0 0 2023-01-04T18:17:18.969 INFO:tasks.workunit.client.0.smithi050.stdout:6/970: creat d0/d5c/d5d/d112/d38/df8/f131 x:0 0 0 2023-01-04T18:17:18.971 INFO:tasks.workunit.client.0.smithi050.stdout:4/947: mkdir d14/d1b/dd7/d13f 0 2023-01-04T18:17:18.974 INFO:tasks.workunit.client.0.smithi050.stdout:6/971: creat d0/d5c/d5d/d112/df/dba/dca/d6b/da4/dab/dec/f132 x:0 0 0 2023-01-04T18:17:18.975 INFO:tasks.workunit.client.0.smithi050.stdout:4/948: mknod d14/d1b/d1f/d22/d3e/d85/da6/c140 0 2023-01-04T18:17:18.975 INFO:tasks.workunit.client.0.smithi050.stdout:9/960: dwrite d1/d3/fd3 [0,4194304] 0 2023-01-04T18:17:18.977 INFO:tasks.workunit.client.0.smithi050.stdout:6/972: symlink d0/d5c/d5d/d112/d25/d40/l133 0 2023-01-04T18:17:18.978 INFO:tasks.workunit.client.0.smithi050.stdout:4/949: mkdir d14/d1b/d1f/d63/dcb/d141 0 2023-01-04T18:17:18.978 INFO:tasks.workunit.client.0.smithi050.stdout:4/950: chown d14/d1b/d1f/d22/d3e/d85/da6/cb7 236 1 2023-01-04T18:17:18.980 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:17.923976+0000 mgr.smithi098.vhfzum (mgr.24455) 53 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 1.9 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 56 MiB/s rd, 117 MiB/s wr, 239 op/s 2023-01-04T18:17:18.980 INFO:tasks.workunit.client.0.smithi050.stdout:9/961: mknod d1/d3/d24/c136 0 2023-01-04T18:17:18.983 INFO:tasks.workunit.client.0.smithi050.stdout:2/957: sync 2023-01-04T18:17:18.983 INFO:tasks.workunit.client.0.smithi050.stdout:2/958: chown d1/dd/d11/d12/lc8 480421 1 2023-01-04T18:17:18.984 INFO:tasks.workunit.client.0.smithi050.stdout:4/951: dread d14/d1b/d1f/d22/f4d [0,4194304] 0 2023-01-04T18:17:18.986 INFO:tasks.workunit.client.0.smithi050.stdout:2/959: link d1/dd/d28/d2c/d2e/f137 d1/dd/d28/d2c/d2e/f13c 0 2023-01-04T18:17:18.987 INFO:tasks.workunit.client.0.smithi050.stdout:4/952: mknod d14/d1b/dd7/c142 0 2023-01-04T18:17:18.988 INFO:tasks.workunit.client.0.smithi050.stdout:4/953: write d14/d1b/d1f/d22/d87/de0/d108/d5f/d80/fa3 [737870,85666] 0 2023-01-04T18:17:18.991 INFO:tasks.workunit.client.0.smithi050.stdout:2/960: creat d1/dd/d11/d14/d91/d5a/dfa/f13d x:0 0 0 2023-01-04T18:17:18.991 INFO:tasks.workunit.client.0.smithi050.stdout:9/962: dread d1/d12/f22 [4194304,4194304] 0 2023-01-04T18:17:18.992 INFO:tasks.workunit.client.0.smithi050.stdout:4/954: readlink d14/d1b/d1f/l98 0 2023-01-04T18:17:18.998 INFO:tasks.workunit.client.0.smithi050.stdout:4/955: dread d14/f84 [0,4194304] 0 2023-01-04T18:17:18.998 INFO:tasks.workunit.client.0.smithi050.stdout:4/956: write d14/d1b/d1f/d22/f42 [3796385,107387] 0 2023-01-04T18:17:18.999 INFO:tasks.workunit.client.0.smithi050.stdout:6/973: dwrite d0/d4a/f7e [0,4194304] 0 2023-01-04T18:17:19.002 INFO:tasks.workunit.client.0.smithi050.stdout:4/957: link d14/l28 d14/d1b/d66/dc1/d13c/l143 0 2023-01-04T18:17:19.008 INFO:tasks.workunit.client.0.smithi050.stdout:6/974: creat d0/d5c/d5d/d112/df/dba/dca/d77/f134 x:0 0 0 2023-01-04T18:17:19.008 INFO:tasks.workunit.client.0.smithi050.stdout:4/958: link d14/d1b/l75 d14/d1b/d1f/d22/d87/de0/l144 0 2023-01-04T18:17:19.014 INFO:tasks.workunit.client.0.smithi050.stdout:9/963: dwrite d1/d12/d41/d60/d117/f132 [0,4194304] 0 2023-01-04T18:17:19.014 INFO:tasks.workunit.client.0.smithi050.stdout:9/964: chown d1/d3/dbf/dd4/da8/fb0 3892 1 2023-01-04T18:17:19.016 INFO:tasks.workunit.client.0.smithi050.stdout:2/961: dwrite d1/dd/d62/da1/d4b/fe9 [0,4194304] 0 2023-01-04T18:17:19.017 INFO:tasks.workunit.client.0.smithi050.stdout:6/975: creat d0/d5c/d5d/d112/d25/d40/dcf/f135 x:0 0 0 2023-01-04T18:17:19.017 INFO:tasks.workunit.client.0.smithi050.stdout:6/976: write d0/f120 [731070,72828] 0 2023-01-04T18:17:19.020 INFO:tasks.workunit.client.0.smithi050.stdout:4/959: creat d14/d1b/d1f/d63/da5/f145 x:0 0 0 2023-01-04T18:17:19.028 INFO:tasks.workunit.client.0.smithi050.stdout:3/952: sync 2023-01-04T18:17:19.028 INFO:tasks.workunit.client.0.smithi050.stdout:3/953: dread - d0/f139 zero size 2023-01-04T18:17:19.028 INFO:tasks.workunit.client.0.smithi050.stdout:0/812: sync 2023-01-04T18:17:19.029 INFO:tasks.workunit.client.0.smithi050.stdout:4/960: dread d14/d1b/d1f/d22/d6a/f92 [0,4194304] 0 2023-01-04T18:17:19.030 INFO:tasks.workunit.client.0.smithi050.stdout:9/965: creat d1/d12/d3f/de1/f137 x:0 0 0 2023-01-04T18:17:19.031 INFO:tasks.workunit.client.0.smithi050.stdout:2/962: mkdir d1/dd/d62/d69/d117/d13e 0 2023-01-04T18:17:19.035 INFO:tasks.workunit.client.0.smithi050.stdout:0/813: rename d0/d6/d28/l29 to d0/d9f/d84/dfa/l102 0 2023-01-04T18:17:19.036 INFO:tasks.workunit.client.0.smithi050.stdout:6/977: dwrite d0/d5c/d5d/d112/d25/d40/dcf/f135 [0,4194304] 0 2023-01-04T18:17:19.036 INFO:tasks.workunit.client.0.smithi050.stdout:4/961: creat d14/d1b/d1f/d22/d87/de0/d13b/f146 x:0 0 0 2023-01-04T18:17:19.037 INFO:tasks.workunit.client.0.smithi050.stdout:6/978: read d0/d5c/d5d/d112/d25/d40/dcf/f135 [1787236,50597] 0 2023-01-04T18:17:19.037 INFO:tasks.workunit.client.0.smithi050.stdout:6/979: truncate d0/d5c/d5d/d112/d25/d40/d89/dd9/d7a/dcb/f12c 719879 0 2023-01-04T18:17:19.038 INFO:tasks.workunit.client.0.smithi050.stdout:6/980: fsync d0/d5c/d5d/d112/f2b 0 2023-01-04T18:17:19.042 INFO:tasks.workunit.client.0.smithi050.stdout:3/954: dread d0/d1a/f8a [0,4194304] 0 2023-01-04T18:17:19.043 INFO:tasks.workunit.client.0.smithi050.stdout:9/966: unlink d1/d12/d9f/fbb 0 2023-01-04T18:17:19.045 INFO:tasks.workunit.client.0.smithi050.stdout:2/963: getdents d1/dd/d62/da1/d4b 0 2023-01-04T18:17:19.045 INFO:tasks.workunit.client.0.smithi050.stdout:2/964: chown d1/dd/d28/d2c/d2e/dca/fc9 6750900 1 2023-01-04T18:17:19.045 INFO:tasks.workunit.client.0.smithi050.stdout:2/965: chown d1/dd/d11/d14/d91/d5a/d7f/df5/f118 97804 1 2023-01-04T18:17:19.045 INFO:tasks.workunit.client.0.smithi050.stdout:2/966: readlink d1/dd/d11/d12/lab 0 2023-01-04T18:17:19.054 INFO:tasks.workunit.client.0.smithi050.stdout:4/962: creat d14/d1b/d1f/d22/d3e/d85/f147 x:0 0 0 2023-01-04T18:17:19.055 INFO:tasks.workunit.client.0.smithi050.stdout:6/981: dwrite d0/d5c/db7/fa6 [0,4194304] 0 2023-01-04T18:17:19.056 INFO:tasks.workunit.client.0.smithi050.stdout:3/955: mkdir d0/d8f/deb/dcb/d13d 0 2023-01-04T18:17:19.057 INFO:tasks.workunit.client.0.smithi050.stdout:3/956: write d0/d1a/f8a [1661492,58896] 0 2023-01-04T18:17:19.058 INFO:tasks.workunit.client.0.smithi050.stdout:3/957: write d0/d1a/fc0 [1001734,124904] 0 2023-01-04T18:17:19.059 INFO:tasks.workunit.client.0.smithi050.stdout:9/967: link d1/d12/d9f/ld1 d1/d12/d41/d60/d117/l138 0 2023-01-04T18:17:19.064 INFO:tasks.workunit.client.0.smithi050.stdout:9/968: write d1/d12/f22 [3814289,38636] 0 2023-01-04T18:17:19.069 INFO:tasks.workunit.client.0.smithi050.stdout:2/967: mkdir d1/dd/d28/d2c/d2e/dca/d13f 0 2023-01-04T18:17:19.070 INFO:tasks.workunit.client.0.smithi050.stdout:4/963: mknod d14/d1b/d1f/d22/d3e/d85/da6/c148 0 2023-01-04T18:17:19.072 INFO:tasks.workunit.client.0.smithi050.stdout:6/982: mknod d0/d5c/d5d/d112/df/dba/dca/d6b/da4/dab/d11b/c136 0 2023-01-04T18:17:19.074 INFO:tasks.workunit.client.0.smithi050.stdout:0/814: dwrite d0/f59 [0,4194304] 0 2023-01-04T18:17:19.074 INFO:tasks.workunit.client.0.smithi050.stdout:3/958: dwrite d0/d8f/d46/df7/d11a/d2f/f12d [0,4194304] 0 2023-01-04T18:17:19.076 INFO:tasks.workunit.client.0.smithi050.stdout:9/969: link d1/d12/d2d/l3e d1/d3/d11/d42/d118/l139 0 2023-01-04T18:17:19.077 INFO:tasks.workunit.client.0.smithi050.stdout:9/970: chown d1/d3/d3b/d63/dc3/de2 320939 1 2023-01-04T18:17:19.079 INFO:tasks.workunit.client.0.smithi050.stdout:2/968: creat d1/dd/d28/d79/f140 x:0 0 0 2023-01-04T18:17:19.081 INFO:tasks.workunit.client.0.smithi050.stdout:3/959: dread d0/d10/f70 [0,4194304] 0 2023-01-04T18:17:19.082 INFO:tasks.workunit.client.0.smithi050.stdout:3/960: read d0/d8f/f5c [3002016,45724] 0 2023-01-04T18:17:19.083 INFO:tasks.workunit.client.0.smithi050.stdout:4/964: link d14/d1b/d1f/d22/d6a/c93 d14/d1b/d1f/d22/d3e/d85/d118/c149 0 2023-01-04T18:17:19.083 INFO:tasks.workunit.client.0.smithi050.stdout:3/961: dread d0/d8f/d46/df7/d11a/d2f/d71/fda [0,4194304] 0 2023-01-04T18:17:19.084 INFO:tasks.workunit.client.0.smithi050.stdout:6/983: rmdir d0/d5c/d5d/d112/d25/d4d 39 2023-01-04T18:17:19.089 INFO:tasks.workunit.client.0.smithi050.stdout:6/984: fdatasync d0/f120 0 2023-01-04T18:17:19.101 INFO:tasks.workunit.client.0.smithi050.stdout:0/815: truncate d0/d73/d68/ff3 655923 0 2023-01-04T18:17:19.103 INFO:tasks.workunit.client.0.smithi050.stdout:9/971: creat d1/d12/d2d/f13a x:0 0 0 2023-01-04T18:17:19.105 INFO:tasks.workunit.client.0.smithi050.stdout:2/969: symlink d1/dd/d62/da1/l141 0 2023-01-04T18:17:19.105 INFO:tasks.workunit.client.0.smithi050.stdout:2/970: write d1/dd/d11/d14/d91/d5a/d7f/f9f [914967,114205] 0 2023-01-04T18:17:19.105 INFO:tasks.workunit.client.0.smithi050.stdout:2/971: chown d1/dd/d28/d2c/d2e/dca/ld1 3 1 2023-01-04T18:17:19.108 INFO:tasks.workunit.client.0.smithi050.stdout:4/965: rmdir d14/d1b/d1f/d63/da5 39 2023-01-04T18:17:19.110 INFO:tasks.workunit.client.0.smithi050.stdout:3/962: stat d0/d8f/d46/df7/d11a/d2f/d56/d98/c103 0 2023-01-04T18:17:19.110 INFO:tasks.workunit.client.0.smithi050.stdout:3/963: readlink d0/d10/l123 0 2023-01-04T18:17:19.115 INFO:tasks.workunit.client.0.smithi050.stdout:6/985: rmdir d0/d4a/d93/db1/dce 39 2023-01-04T18:17:19.119 INFO:tasks.workunit.client.0.smithi050.stdout:0/816: getdents d0/d73/d79 0 2023-01-04T18:17:19.119 INFO:tasks.workunit.client.0.smithi050.stdout:0/817: chown d0/d9f/d84/lcc 567815011 1 2023-01-04T18:17:19.121 INFO:tasks.workunit.client.0.smithi050.stdout:9/972: mkdir d1/d3/d11/d105/d13b 0 2023-01-04T18:17:19.127 INFO:tasks.workunit.client.0.smithi050.stdout:4/966: dwrite d14/d1b/d1f/d22/fae [0,4194304] 0 2023-01-04T18:17:19.127 INFO:tasks.workunit.client.0.smithi050.stdout:4/967: write d14/d1b/d1f/d22/d3e/d85/da6/f134 [5034799,32615] 0 2023-01-04T18:17:19.127 INFO:tasks.workunit.client.0.smithi050.stdout:4/968: chown d14/d1b/fe7 154617 1 2023-01-04T18:17:19.127 INFO:tasks.workunit.client.0.smithi050.stdout:4/969: write d14/d1b/d1f/d22/d3e/d8a/f10d [930148,128857] 0 2023-01-04T18:17:19.130 INFO:tasks.workunit.client.0.smithi050.stdout:3/964: link d0/d8f/d46/c6a d0/d8f/d11f/c13e 0 2023-01-04T18:17:19.131 INFO:tasks.workunit.client.0.smithi050.stdout:6/986: mknod d0/d5c/d5d/d112/d25/d2d/dea/d54/c137 0 2023-01-04T18:17:19.135 INFO:tasks.workunit.client.0.smithi050.stdout:0/818: truncate d0/d73/f61 2999987 0 2023-01-04T18:17:19.135 INFO:tasks.workunit.client.0.smithi050.stdout:0/819: write d0/d6/d28/d9c/f9d [495625,68173] 0 2023-01-04T18:17:19.142 INFO:tasks.workunit.client.0.smithi050.stdout:9/973: dwrite d1/d6f/faa [0,4194304] 0 2023-01-04T18:17:19.144 INFO:tasks.workunit.client.0.smithi050.stdout:4/970: mkdir d14/d1b/d1f/d22/d3e/d85/d14a 0 2023-01-04T18:17:19.145 INFO:tasks.workunit.client.0.smithi050.stdout:4/971: read d14/d1b/d1f/d22/d87/de0/d108/dca/ff4 [24073,20698] 0 2023-01-04T18:17:19.147 INFO:tasks.workunit.client.0.smithi050.stdout:3/965: truncate d0/f2c 2136026 0 2023-01-04T18:17:19.149 INFO:tasks.workunit.client.0.smithi050.stdout:3/966: write d0/f40 [3873873,64290] 0 2023-01-04T18:17:19.150 INFO:tasks.workunit.client.0.smithi050.stdout:2/972: dwrite d1/dd/f4a [0,4194304] 0 2023-01-04T18:17:19.151 INFO:tasks.workunit.client.0.smithi050.stdout:6/987: symlink d0/db6/d10f/l138 0 2023-01-04T18:17:19.154 INFO:tasks.workunit.client.0.smithi050.stdout:2/973: write d1/dd/d11/f9c [340549,91997] 0 2023-01-04T18:17:19.158 INFO:tasks.workunit.client.0.smithi050.stdout:0/820: creat d0/d9f/d84/f103 x:0 0 0 2023-01-04T18:17:19.164 INFO:tasks.workunit.client.0.smithi050.stdout:9/974: symlink d1/d3/d89/d114/l13c 0 2023-01-04T18:17:19.168 INFO:tasks.workunit.client.0.smithi050.stdout:4/972: unlink d14/d1b/f8f 0 2023-01-04T18:17:19.177 INFO:tasks.workunit.client.0.smithi050.stdout:2/974: dwrite d1/dd/d11/d12/fb3 [0,4194304] 0 2023-01-04T18:17:19.177 INFO:tasks.workunit.client.0.smithi050.stdout:2/975: chown d1/dd/d28/df4/d135 1861 1 2023-01-04T18:17:19.177 INFO:tasks.workunit.client.0.smithi050.stdout:3/967: rename d0/fe to d0/d8f/d46/dc2/f13f 0 2023-01-04T18:17:19.179 INFO:tasks.workunit.client.0.smithi050.stdout:2/976: write d1/dd/d11/d14/d91/f90 [912685,65501] 0 2023-01-04T18:17:19.182 INFO:tasks.workunit.client.0.smithi050.stdout:2/977: read d1/dd/d11/d14/d91/d5a/d7f/f8f [3527099,123991] 0 2023-01-04T18:17:19.182 INFO:tasks.workunit.client.0.smithi050.stdout:9/975: mknod d1/d3/d89/d114/d119/c13d 0 2023-01-04T18:17:19.183 INFO:tasks.workunit.client.0.smithi050.stdout:2/978: write d1/dd/d62/f77 [2693967,34179] 0 2023-01-04T18:17:19.183 INFO:tasks.workunit.client.0.smithi050.stdout:2/979: write d1/d10/f4e [969458,93106] 0 2023-01-04T18:17:19.184 INFO:tasks.workunit.client.0.smithi050.stdout:0/821: dwrite d0/f59 [0,4194304] 0 2023-01-04T18:17:19.184 INFO:tasks.workunit.client.0.smithi050.stdout:4/973: mknod d14/d1b/d1f/d22/d3e/d85/c14b 0 2023-01-04T18:17:19.188 INFO:tasks.workunit.client.0.smithi050.stdout:6/988: rename d0/d5c/d5d/d112/f3b to d0/d5c/d5d/d112/df/dba/dca/f139 0 2023-01-04T18:17:19.188 INFO:tasks.workunit.client.0.smithi050.stdout:6/989: chown d0/d5c/d5d/d112/l36 19 1 2023-01-04T18:17:19.191 INFO:tasks.workunit.client.0.smithi050.stdout:3/968: creat d0/d8f/d46/df7/d11a/d2f/d56/d98/f140 x:0 0 0 2023-01-04T18:17:19.191 INFO:tasks.workunit.client.0.smithi050.stdout:3/969: dread - d0/dd/d45/f12b zero size 2023-01-04T18:17:19.191 INFO:tasks.workunit.client.0.smithi050.stdout:3/970: stat d0/d8f/d46/dc2/c110 0 2023-01-04T18:17:19.192 INFO:tasks.workunit.client.0.smithi050.stdout:3/971: read d0/d8f/f67 [1550,44107] 0 2023-01-04T18:17:19.195 INFO:tasks.workunit.client.0.smithi050.stdout:9/976: mkdir d1/d6f/d13e 0 2023-01-04T18:17:19.197 INFO:tasks.workunit.client.0.smithi050.stdout:0/822: dread d0/d6/d8/f1c [0,4194304] 0 2023-01-04T18:17:19.197 INFO:tasks.workunit.client.0.smithi050.stdout:0/823: fdatasync d0/d6/d8/d25/d8e/fe2 0 2023-01-04T18:17:19.198 INFO:tasks.workunit.client.0.smithi050.stdout:2/980: creat d1/dd/d28/f142 x:0 0 0 2023-01-04T18:17:19.198 INFO:tasks.workunit.client.0.smithi050.stdout:2/981: fsync d1/f15 0 2023-01-04T18:17:19.199 INFO:tasks.workunit.client.0.smithi050.stdout:2/982: readlink d1/dd/d62/da1/l119 0 2023-01-04T18:17:19.201 INFO:tasks.workunit.client.0.smithi050.stdout:6/990: symlink d0/d5c/d5d/d112/df/d74/l13a 0 2023-01-04T18:17:19.201 INFO:tasks.workunit.client.0.smithi050.stdout:6/991: getdents d0/d5c/d5d/d112/d25/d40/d89/d129 0 2023-01-04T18:17:19.203 INFO:tasks.workunit.client.0.smithi050.stdout:3/972: mkdir d0/d8f/d46/df7/d11a/d2f/d56/d98/d9c/dcd/d111/d141 0 2023-01-04T18:17:19.203 INFO:tasks.workunit.client.0.smithi050.stdout:0/824: dread d0/d6/d28/d9c/f9d [0,4194304] 0 2023-01-04T18:17:19.205 INFO:tasks.workunit.client.0.smithi050.stdout:4/974: dwrite d14/d1b/d1f/d22/d3e/d44/f113 [0,4194304] 0 2023-01-04T18:17:19.205 INFO:tasks.workunit.client.0.smithi050.stdout:4/975: chown d14/d1b/d1f/d22/d3e/fa4 59954 1 2023-01-04T18:17:19.206 INFO:tasks.workunit.client.0.smithi050.stdout:9/977: rmdir d1/d3/d24 39 2023-01-04T18:17:19.209 INFO:tasks.workunit.client.0.smithi050.stdout:9/978: write d1/d3/d89/fb9 [1909945,68204] 0 2023-01-04T18:17:19.209 INFO:tasks.workunit.client.0.smithi050.stdout:9/979: chown d1/d3/d3b/c65 0 1 2023-01-04T18:17:19.210 INFO:tasks.workunit.client.0.smithi050.stdout:9/980: truncate d1/d3/d11/d42/fc7 4478173 0 2023-01-04T18:17:19.210 INFO:tasks.workunit.client.0.smithi050.stdout:9/981: chown d1/d12/d3f/de1/leb 339893 1 2023-01-04T18:17:19.210 INFO:tasks.workunit.client.0.smithi050.stdout:2/983: unlink d1/dd/d28/lda 0 2023-01-04T18:17:19.211 INFO:tasks.workunit.client.0.smithi050.stdout:6/992: rmdir d0/d5c/d5d/d112/df/dba/dca/d6b/da4 39 2023-01-04T18:17:19.214 INFO:tasks.workunit.client.0.smithi050.stdout:3/973: mknod d0/d8f/d46/df7/d11a/c142 0 2023-01-04T18:17:19.225 INFO:tasks.workunit.client.0.smithi050.stdout:0/825: dwrite d0/d6/d8/d4f/fc0 [0,4194304] 0 2023-01-04T18:17:19.227 INFO:tasks.workunit.client.0.smithi050.stdout:9/982: getdents d1/d3/d24 0 2023-01-04T18:17:19.227 INFO:tasks.workunit.client.0.smithi050.stdout:4/976: dwrite d14/d1b/d1f/f107 [0,4194304] 0 2023-01-04T18:17:19.227 INFO:tasks.workunit.client.0.smithi050.stdout:4/977: fsync d14/d1b/d66/dc1/d13c/f103 0 2023-01-04T18:17:19.228 INFO:tasks.workunit.client.0.smithi050.stdout:2/984: mknod d1/dd/d28/d2c/d66/c143 0 2023-01-04T18:17:19.234 INFO:tasks.workunit.client.0.smithi050.stdout:6/993: mkdir d0/d5c/d5d/d112/d25/d40/dcf/d13b 0 2023-01-04T18:17:19.234 INFO:tasks.workunit.client.0.smithi050.stdout:6/994: write d0/d5c/d5d/d112/df/dba/dca/d6b/fc1 [632359,72743] 0 2023-01-04T18:17:19.235 INFO:tasks.workunit.client.0.smithi050.stdout:3/974: creat d0/d8f/d46/dc2/d107/dbb/f143 x:0 0 0 2023-01-04T18:17:19.240 INFO:tasks.workunit.client.0.smithi050.stdout:9/983: mkdir d1/d3/d13f 0 2023-01-04T18:17:19.242 INFO:tasks.workunit.client.0.smithi050.stdout:2/985: rmdir d1/dd/d11/db5/d99 39 2023-01-04T18:17:19.242 INFO:tasks.workunit.client.0.smithi050.stdout:2/986: fdatasync d1/f55 0 2023-01-04T18:17:19.242 INFO:tasks.workunit.client.0.smithi050.stdout:3/975: dread d0/d1a/f4e [0,4194304] 0 2023-01-04T18:17:19.250 INFO:tasks.workunit.client.0.smithi050.stdout:6/995: mkdir d0/d5c/d5d/d112/df/dba/dca/d6b/da4/dab/d13c 0 2023-01-04T18:17:19.251 INFO:tasks.workunit.client.0.smithi050.stdout:3/976: dread d0/fb [4194304,4194304] 0 2023-01-04T18:17:19.252 INFO:tasks.workunit.client.0.smithi050.stdout:6/996: write d0/d5c/d5d/d112/d25/d40/d89/f94 [3098913,77447] 0 2023-01-04T18:17:19.252 INFO:tasks.workunit.client.0.smithi050.stdout:6/997: dread - d0/d5c/d5d/d112/df/d74/f102 zero size 2023-01-04T18:17:19.267 INFO:tasks.workunit.client.0.smithi050.stdout:9/984: mkdir d1/d3/d11/d105/d140 0 2023-01-04T18:17:19.269 INFO:tasks.workunit.client.0.smithi050.stdout:2/987: symlink d1/dd/d62/da1/d83/df7/l144 0 2023-01-04T18:17:19.270 INFO:tasks.workunit.client.0.smithi050.stdout:0/826: dwrite d0/d6/f58 [0,4194304] 0 2023-01-04T18:17:19.270 INFO:tasks.workunit.client.0.smithi050.stdout:0/827: truncate d0/d6/d28/d1a/d8a/d9e/ffb 640055 0 2023-01-04T18:17:19.270 INFO:tasks.workunit.client.0.smithi050.stdout:0/828: chown d0/d6/d8/d51/l5d 1 1 2023-01-04T18:17:19.271 INFO:tasks.workunit.client.0.smithi050.stdout:9/985: write d1/d3/d89/ffb [2923439,117948] 0 2023-01-04T18:17:19.274 INFO:tasks.workunit.client.0.smithi050.stdout:6/998: rename d0/d5c/d5d/d112/d25/d40/d89/dd9/cdb to d0/d5c/d5d/d112/d25/d40/dcf/c13d 0 2023-01-04T18:17:19.281 INFO:tasks.workunit.client.0.smithi050.stdout:0/829: dread d0/d6/d8/d4f/fa6 [0,4194304] 0 2023-01-04T18:17:19.281 INFO:tasks.workunit.client.0.smithi050.stdout:0/830: chown d0/d6/d8/d25 4094 1 2023-01-04T18:17:19.281 INFO:tasks.workunit.client.0.smithi050.stdout:0/831: dread - d0/d9f/d84/f103 zero size 2023-01-04T18:17:19.287 INFO:tasks.workunit.client.0.smithi050.stdout:3/977: mkdir d0/d1a/d144 0 2023-01-04T18:17:19.287 INFO:tasks.workunit.client.0.smithi050.stdout:3/978: write d0/d8f/d46/df7/d11a/d2f/d56/fb0 [4204582,129022] 0 2023-01-04T18:17:19.292 INFO:tasks.workunit.client.0.smithi050.stdout:9/986: truncate d1/d3/dbf/dd4/da8/fb0 894777 0 2023-01-04T18:17:19.295 INFO:tasks.workunit.client.0.smithi050.stdout:6/999: symlink d0/d5c/d5d/d112/d25/d4d/l13e 0 2023-01-04T18:17:19.307 INFO:tasks.workunit.client.0.smithi050.stdout:9/987: dread d1/d3/d3b/d63/f3d [4194304,4194304] 0 2023-01-04T18:17:19.307 INFO:tasks.workunit.client.0.smithi050.stdout:9/988: chown d1/d3/d11/l7f 1008050 1 2023-01-04T18:17:19.310 INFO:tasks.workunit.client.0.smithi050.stdout:9/989: rmdir d1/d3/d89/d114 39 2023-01-04T18:17:19.310 INFO:tasks.workunit.client.0.smithi050.stdout:9/990: truncate d1/d12/d3f/f12b 459400 0 2023-01-04T18:17:19.310 INFO:tasks.workunit.client.0.smithi050.stdout:9/991: chown d1/d3/d11/d42/d118/l139 0 1 2023-01-04T18:17:19.311 INFO:tasks.workunit.client.0.smithi050.stdout:3/979: dwrite d0/f40 [0,4194304] 0 2023-01-04T18:17:19.311 INFO:tasks.workunit.client.0.smithi050.stdout:3/980: chown d0/d1a/f57 0 1 2023-01-04T18:17:19.312 INFO:tasks.workunit.client.0.smithi050.stdout:0/832: dwrite d0/d6/d8/d25/fca [0,4194304] 0 2023-01-04T18:17:19.312 INFO:tasks.workunit.client.0.smithi050.stdout:0/833: chown d0/d73/d68/c8f 42863 1 2023-01-04T18:17:19.312 INFO:tasks.workunit.client.0.smithi050.stdout:9/992: creat d1/d3/d11/d42/f141 x:0 0 0 2023-01-04T18:17:19.313 INFO:tasks.workunit.client.0.smithi050.stdout:3/981: mknod d0/d8f/d46/df7/d11a/d2f/d56/d98/d9c/c145 0 2023-01-04T18:17:19.314 INFO:tasks.workunit.client.0.smithi050.stdout:0/834: symlink d0/d73/l104 0 2023-01-04T18:17:19.319 INFO:tasks.workunit.client.0.smithi050.stdout:9/993: mkdir d1/d3/dec/d142 0 2023-01-04T18:17:19.321 INFO:tasks.workunit.client.0.smithi050.stdout:3/982: creat d0/d8f/d46/d80/dca/dee/f146 x:0 0 0 2023-01-04T18:17:19.327 INFO:tasks.workunit.client.0.smithi050.stdout:9/994: dread d1/d12/d9f/fcb [0,4194304] 0 2023-01-04T18:17:19.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:17.923976+0000 mgr.smithi098.vhfzum (mgr.24455) 53 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 1.9 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 56 MiB/s rd, 117 MiB/s wr, 239 op/s 2023-01-04T18:17:19.330 INFO:tasks.workunit.client.0.smithi050.stdout:9/995: symlink d1/d3/d89/d114/l143 0 2023-01-04T18:17:19.331 INFO:tasks.workunit.client.0.smithi050.stdout:3/983: dread d0/dd/f6c [0,4194304] 0 2023-01-04T18:17:19.331 INFO:tasks.workunit.client.0.smithi050.stdout:0/835: dwrite d0/d6/d8/d35/f6f [4194304,4194304] 0 2023-01-04T18:17:19.331 INFO:tasks.workunit.client.0.smithi050.stdout:9/996: write d1/d6f/fb7 [3463872,273] 0 2023-01-04T18:17:19.331 INFO:tasks.workunit.client.0.smithi050.stdout:9/997: stat d1/d3/dbf/dd4 0 2023-01-04T18:17:19.347 INFO:tasks.workunit.client.0.smithi050.stdout:3/984: dwrite d0/d8f/d46/d80/dca/dee/f146 [0,4194304] 0 2023-01-04T18:17:19.347 INFO:tasks.workunit.client.0.smithi050.stdout:3/985: truncate d0/d8f/d46/d80/dca/dee/ffb 1436274 0 2023-01-04T18:17:19.363 INFO:tasks.workunit.client.0.smithi050.stdout:3/986: dwrite d0/dd/d45/f12b [0,4194304] 0 2023-01-04T18:17:19.380 INFO:tasks.workunit.client.0.smithi050.stdout:3/987: dwrite d0/d8f/deb/fe3 [4194304,4194304] 0 2023-01-04T18:17:19.393 INFO:tasks.workunit.client.0.smithi050.stdout:0/836: mkdir d0/d73/d105 0 2023-01-04T18:17:19.395 INFO:tasks.workunit.client.0.smithi050.stdout:9/998: mknod d1/d12/d41/d60/d117/c144 0 2023-01-04T18:17:19.404 INFO:tasks.workunit.client.0.smithi050.stdout:3/988: mknod d0/d1a/dc3/d12e/c147 0 2023-01-04T18:17:19.407 INFO:tasks.workunit.client.0.smithi050.stdout:0/837: unlink d0/d6/d28/c8b 0 2023-01-04T18:17:19.424 INFO:tasks.workunit.client.0.smithi050.stdout:0/838: dwrite d0/d6/d8/d51/dd9/df0/ff5 [0,4194304] 0 2023-01-04T18:17:19.445 INFO:tasks.workunit.client.0.smithi050.stdout:9/999: creat d1/f145 x:0 0 0 2023-01-04T18:17:19.447 INFO:tasks.workunit.client.0.smithi050.stdout:3/989: link d0/dd/f6c d0/dd/d45/d116/f148 0 2023-01-04T18:17:19.447 INFO:tasks.workunit.client.0.smithi050.stdout:3/990: readlink d0/d8f/l128 0 2023-01-04T18:17:19.453 INFO:tasks.workunit.client.0.smithi050.stdout:3/991: truncate d0/f132 1107974 0 2023-01-04T18:17:19.455 INFO:tasks.workunit.client.0.smithi050.stdout:0/839: link d0/c44 d0/d6/d8/d35/dbe/c106 0 2023-01-04T18:17:19.456 INFO:tasks.workunit.client.0.smithi050.stdout:3/992: truncate d0/d8f/d46/dc2/d107/f48 1906068 0 2023-01-04T18:17:19.460 INFO:tasks.workunit.client.0.smithi050.stdout:0/840: stat d0/lf 0 2023-01-04T18:17:19.465 INFO:tasks.workunit.client.0.smithi050.stdout:3/993: creat d0/dd/de6/f149 x:0 0 0 2023-01-04T18:17:19.465 INFO:tasks.workunit.client.0.smithi050.stdout:3/994: fdatasync d0/d8f/d46/fad 0 2023-01-04T18:17:19.465 INFO:tasks.workunit.client.0.smithi050.stdout:3/995: readlink d0/d10/l123 0 2023-01-04T18:17:19.471 INFO:tasks.workunit.client.0.smithi050.stdout:3/996: truncate d0/d8f/deb/ff2 248056 0 2023-01-04T18:17:19.474 INFO:tasks.workunit.client.0.smithi050.stdout:3/997: creat d0/d8f/d46/d80/dca/d100/f14a x:0 0 0 2023-01-04T18:17:19.475 INFO:tasks.workunit.client.0.smithi050.stdout:3/998: getdents d0/d8f/deb/dcb/d13d 0 2023-01-04T18:17:19.477 INFO:tasks.workunit.client.0.smithi050.stdout:3/999: mknod d0/d1a/dc3/dd0/c14b 0 2023-01-04T18:17:19.478 INFO:tasks.workunit.client.0.smithi050.stdout:0/841: dwrite d0/d6/d8/d51/dd9/df0/ff5 [0,4194304] 0 2023-01-04T18:17:19.490 INFO:tasks.workunit.client.0.smithi050.stdout:0/842: dread d0/d9f/fea [0,4194304] 0 2023-01-04T18:17:19.503 INFO:tasks.workunit.client.0.smithi050.stdout:0/843: write d0/d73/d68/ff3 [1625254,11250] 0 2023-01-04T18:17:19.505 INFO:tasks.workunit.client.0.smithi050.stdout:0/844: creat d0/d6/d28/f107 x:0 0 0 2023-01-04T18:17:19.514 INFO:tasks.workunit.client.0.smithi050.stdout:0/845: dread d0/d6/d8/d51/dd9/df0/ff5 [0,4194304] 0 2023-01-04T18:17:19.516 INFO:tasks.workunit.client.0.smithi050.stdout:4/978: sync 2023-01-04T18:17:19.516 INFO:tasks.workunit.client.0.smithi050.stdout:2/988: sync 2023-01-04T18:17:19.516 INFO:tasks.workunit.client.0.smithi050.stdout:4/979: read - d14/d1b/d66/f90 zero size 2023-01-04T18:17:19.516 INFO:tasks.workunit.client.0.smithi050.stdout:0/846: rename d0/d6/d8/d25/d8e/l9b to d0/d9f/d84/l108 0 2023-01-04T18:17:19.517 INFO:tasks.workunit.client.0.smithi050.stdout:4/980: mknod d14/d1b/d1f/d22/d3e/d85/d14a/c14c 0 2023-01-04T18:17:19.519 INFO:tasks.workunit.client.0.smithi050.stdout:2/989: dread d1/dd/d11/d12/f11b [0,4194304] 0 2023-01-04T18:17:19.521 INFO:tasks.workunit.client.0.smithi050.stdout:0/847: rename d0/d6/d8/d51/ce4 to d0/c109 0 2023-01-04T18:17:19.522 INFO:tasks.workunit.client.0.smithi050.stdout:2/990: creat d1/dd/d11/d14/d91/d5a/d7f/df5/f145 x:0 0 0 2023-01-04T18:17:19.522 INFO:tasks.workunit.client.0.smithi050.stdout:2/991: readlink d1/dd/d28/d2c/d2e/d3f/da7/l10d 0 2023-01-04T18:17:19.524 INFO:tasks.workunit.client.0.smithi050.stdout:0/848: rename d0/d73/d68/l87 to d0/d6/d8/d25/l10a 0 2023-01-04T18:17:19.525 INFO:tasks.workunit.client.0.smithi050.stdout:2/992: symlink d1/dd/d28/d2c/d2e/l146 0 2023-01-04T18:17:19.527 INFO:tasks.workunit.client.0.smithi050.stdout:4/981: dread d14/d1b/d1f/d22/d87/de0/d108/d5d/fc7 [0,4194304] 0 2023-01-04T18:17:19.527 INFO:tasks.workunit.client.0.smithi050.stdout:0/849: rename d0/d9f/f96 to d0/d9f/d84/f10b 0 2023-01-04T18:17:19.528 INFO:tasks.workunit.client.0.smithi050.stdout:2/993: truncate d1/dd/d28/d2c/d2e/d3f/da7/f133 191967 0 2023-01-04T18:17:19.530 INFO:tasks.workunit.client.0.smithi050.stdout:0/850: rename d0/d9f/d84/cb7 to d0/d9f/c10c 0 2023-01-04T18:17:19.532 INFO:tasks.workunit.client.0.smithi050.stdout:0/851: mkdir d0/d6/d8/d25/d8e/d10d 0 2023-01-04T18:17:19.533 INFO:tasks.workunit.client.0.smithi050.stdout:0/852: getdents d0/d6/d8/d4f/df4 0 2023-01-04T18:17:19.535 INFO:tasks.workunit.client.0.smithi050.stdout:4/982: dread d14/d1b/d1f/d22/d87/de0/d108/d5f/fb1 [0,4194304] 0 2023-01-04T18:17:19.575 INFO:tasks.workunit.client.0.smithi050.stdout:0/853: mknod d0/d6/d28/d9c/c10e 0 2023-01-04T18:17:19.671 INFO:tasks.workunit.client.0.smithi050.stdout:0/854: chown d0/f59 0 1 2023-01-04T18:17:19.673 INFO:tasks.workunit.client.0.smithi050.stdout:4/983: creat d14/d1b/d66/f14d x:0 0 0 2023-01-04T18:17:19.674 INFO:tasks.workunit.client.0.smithi050.stdout:0/855: mkdir d0/d73/d68/d10f 0 2023-01-04T18:17:19.674 INFO:tasks.workunit.client.0.smithi050.stdout:0/856: readlink d0/d6/d8/lbf 0 2023-01-04T18:17:19.674 INFO:tasks.workunit.client.0.smithi050.stdout:0/857: chown d0/d6/d8/f2a 6681 1 2023-01-04T18:17:19.674 INFO:tasks.workunit.client.0.smithi050.stdout:4/984: symlink d14/d1b/d1f/d22/d3e/d85/da6/l14e 0 2023-01-04T18:17:19.675 INFO:tasks.workunit.client.0.smithi050.stdout:4/985: truncate d14/d1b/d1f/d22/d87/de0/d108/d5f/d80/d9d/ffb 832575 0 2023-01-04T18:17:19.675 INFO:tasks.workunit.client.0.smithi050.stdout:0/858: symlink d0/d73/d68/l110 0 2023-01-04T18:17:19.675 INFO:tasks.workunit.client.0.smithi050.stdout:4/986: creat d14/d1b/d66/dc1/f14f x:0 0 0 2023-01-04T18:17:19.675 INFO:tasks.workunit.client.0.smithi050.stdout:0/859: symlink d0/d73/d68/l111 0 2023-01-04T18:17:19.675 INFO:tasks.workunit.client.0.smithi050.stdout:0/860: truncate d0/d73/d79/dd5/ff1 795311 0 2023-01-04T18:17:19.675 INFO:tasks.workunit.client.0.smithi050.stdout:4/987: rmdir d14/d1b/d1f/d22/d87/de0/d13b 39 2023-01-04T18:17:19.675 INFO:tasks.workunit.client.0.smithi050.stdout:4/988: getdents d14/d1b/d1f/d22/d87/de0/d108/d5f/d6f 0 2023-01-04T18:17:19.675 INFO:tasks.workunit.client.0.smithi050.stdout:4/989: link d14/d1b/d32/d128/c129 d14/d1b/d66/dc1/c150 0 2023-01-04T18:17:19.675 INFO:tasks.workunit.client.0.smithi050.stdout:0/861: getdents d0/d73/d68 0 2023-01-04T18:17:19.675 INFO:tasks.workunit.client.0.smithi050.stdout:4/990: creat d14/d1b/d1f/d22/d87/de0/d108/f151 x:0 0 0 2023-01-04T18:17:19.675 INFO:tasks.workunit.client.0.smithi050.stdout:0/862: rename d0/f59 to d0/d6/d28/d1a/d8a/f112 0 2023-01-04T18:17:19.676 INFO:tasks.workunit.client.0.smithi050.stdout:4/991: symlink d14/d1b/d1f/d22/d6a/l152 0 2023-01-04T18:17:19.676 INFO:tasks.workunit.client.0.smithi050.stdout:0/863: creat d0/d73/f113 x:0 0 0 2023-01-04T18:17:19.676 INFO:tasks.workunit.client.0.smithi050.stdout:0/864: creat d0/d6/d8/d51/f114 x:0 0 0 2023-01-04T18:17:19.681 INFO:tasks.workunit.client.0.smithi050.stdout:0/865: creat d0/d6/d28/d1a/f115 x:0 0 0 2023-01-04T18:17:19.682 INFO:tasks.workunit.client.0.smithi050.stdout:0/866: fsync d0/d9f/fcd 0 2023-01-04T18:17:19.682 INFO:tasks.workunit.client.0.smithi050.stdout:0/867: write d0/d73/d79/dd5/fe8 [437622,85378] 0 2023-01-04T18:17:19.683 INFO:tasks.workunit.client.0.smithi050.stdout:0/868: rmdir d0/d73/d68 39 2023-01-04T18:17:19.683 INFO:tasks.workunit.client.0.smithi050.stdout:0/869: stat d0/d6/d28 0 2023-01-04T18:17:19.687 INFO:tasks.workunit.client.0.smithi050.stdout:0/870: mknod d0/d9f/d84/dd8/c116 0 2023-01-04T18:17:19.687 INFO:tasks.workunit.client.0.smithi050.stdout:0/871: write d0/d6/d8/d4f/fa6 [616127,10310] 0 2023-01-04T18:17:19.692 INFO:tasks.workunit.client.0.smithi050.stdout:0/872: rename d0/d9f/d84/dd8/c116 to d0/d6/d8/d35/dbe/c117 0 2023-01-04T18:17:19.692 INFO:tasks.workunit.client.0.smithi050.stdout:0/873: write d0/d9f/feb [135385,27062] 0 2023-01-04T18:17:19.696 INFO:tasks.workunit.client.0.smithi050.stdout:0/874: getdents d0/d6/d8/d51/dd9 0 2023-01-04T18:17:19.697 INFO:tasks.workunit.client.0.smithi050.stdout:0/875: fdatasync d0/d6/f3c 0 2023-01-04T18:17:19.720 INFO:tasks.workunit.client.0.smithi050.stdout:0/876: dread d0/d9f/fea [0,4194304] 0 2023-01-04T18:17:19.720 INFO:tasks.workunit.client.0.smithi050.stdout:0/877: chown d0/d9f/d84/dd8/fdc 1653 1 2023-01-04T18:17:19.725 INFO:tasks.workunit.client.0.smithi050.stdout:0/878: getdents d0/d6/d8 0 2023-01-04T18:17:19.730 INFO:tasks.workunit.client.0.smithi050.stdout:2/994: sync 2023-01-04T18:17:19.738 INFO:tasks.workunit.client.0.smithi050.stdout:0/879: rename d0/d73/f61 to d0/d9f/d84/dd8/f118 0 2023-01-04T18:17:19.739 INFO:tasks.workunit.client.0.smithi050.stdout:0/880: readlink d0/d6/lc 0 2023-01-04T18:17:19.739 INFO:tasks.workunit.client.0.smithi050.stdout:0/881: write d0/d6/d28/d1a/d8a/fc9 [73648,103915] 0 2023-01-04T18:17:19.739 INFO:tasks.workunit.client.0.smithi050.stdout:2/995: mknod d1/dd/d28/d2c/d66/c147 0 2023-01-04T18:17:19.739 INFO:tasks.workunit.client.0.smithi050.stdout:0/882: creat d0/d73/d79/f119 x:0 0 0 2023-01-04T18:17:19.739 INFO:tasks.workunit.client.0.smithi050.stdout:2/996: mkdir d1/dd/d11/d14/d91/d5a/dfa/d148 0 2023-01-04T18:17:19.752 INFO:tasks.workunit.client.0.smithi050.stdout:2/997: dwrite d1/dd/d62/ff3 [0,4194304] 0 2023-01-04T18:17:19.758 INFO:tasks.workunit.client.0.smithi050.stdout:4/992: sync 2023-01-04T18:17:19.759 INFO:tasks.workunit.client.0.smithi050.stdout:4/993: chown d14/d1b/d1f/d22/d87/de0/d108/d5d/cef 30 1 2023-01-04T18:17:19.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.753+0000 7fb0bb2d6700 1 -- 172.21.15.50:0/2184799171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0b40f7d20 msgr2=0x7fb0b40f8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:19.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.753+0000 7fb0bb2d6700 1 --2- 172.21.15.50:0/2184799171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0b40f7d20 0x7fb0b40f8140 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fb0b0004660 tx=0x7fb0b0009b30).stop 2023-01-04T18:17:19.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.753+0000 7fb0bb2d6700 1 -- 172.21.15.50:0/2184799171 shutdown_connections 2023-01-04T18:17:19.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.753+0000 7fb0bb2d6700 1 --2- 172.21.15.50:0/2184799171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0b40f86c0 0x7fb0b40f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:19.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.753+0000 7fb0bb2d6700 1 --2- 172.21.15.50:0/2184799171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0b40f7d20 0x7fb0b40f8140 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:19.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.753+0000 7fb0bb2d6700 1 -- 172.21.15.50:0/2184799171 >> 172.21.15.50:0/2184799171 conn(0x7fb0b40f04c0 msgr2=0x7fb0b40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:19.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.753+0000 7fb0bb2d6700 1 -- 172.21.15.50:0/2184799171 shutdown_connections 2023-01-04T18:17:19.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.753+0000 7fb0bb2d6700 1 -- 172.21.15.50:0/2184799171 wait complete. 2023-01-04T18:17:19.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.753+0000 7fb0bb2d6700 1 Processor -- start 2023-01-04T18:17:19.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.753+0000 7fb0bb2d6700 1 -- start start 2023-01-04T18:17:19.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.754+0000 7fb0bb2d6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0b40f7d20 0x7fb0b4106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:19.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.754+0000 7fb0bb2d6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0b40f86c0 0x7fb0b4107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:19.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.754+0000 7fb0bb2d6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b41079d0 con 0x7fb0b40f86c0 2023-01-04T18:17:19.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.754+0000 7fb0bb2d6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b4107b10 con 0x7fb0b40f7d20 2023-01-04T18:17:19.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.754+0000 7fb0b8871700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0b40f86c0 0x7fb0b4107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:19.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.754+0000 7fb0b8871700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0b40f86c0 0x7fb0b4107420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35870/0 (socket says 172.21.15.50:35870) 2023-01-04T18:17:19.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.754+0000 7fb0b8871700 1 -- 172.21.15.50:0/575698560 learned_addr learned my addr 172.21.15.50:0/575698560 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:17:19.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.754+0000 7fb0b9072700 1 --2- 172.21.15.50:0/575698560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0b40f7d20 0x7fb0b4106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:19.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.754+0000 7fb0b8871700 1 -- 172.21.15.50:0/575698560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0b40f7d20 msgr2=0x7fb0b4106f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:19.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.754+0000 7fb0b8871700 1 --2- 172.21.15.50:0/575698560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0b40f7d20 0x7fb0b4106f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:19.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.754+0000 7fb0b8871700 1 -- 172.21.15.50:0/575698560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b0005040 con 0x7fb0b40f86c0 2023-01-04T18:17:19.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.754+0000 7fb0b9072700 1 --2- 172.21.15.50:0/575698560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0b40f7d20 0x7fb0b4106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-01-04T18:17:19.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.754+0000 7fb0b8871700 1 --2- 172.21.15.50:0/575698560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0b40f86c0 0x7fb0b4107420 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fb0a400e7f0 tx=0x7fb0a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:19.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.754+0000 7fb0a9ffb700 1 -- 172.21.15.50:0/575698560 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0a40092e0 con 0x7fb0b40f86c0 2023-01-04T18:17:19.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.754+0000 7fb0a9ffb700 1 -- 172.21.15.50:0/575698560 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb0a400f040 con 0x7fb0b40f86c0 2023-01-04T18:17:19.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.754+0000 7fb0bb2d6700 1 -- 172.21.15.50:0/575698560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b41084b0 con 0x7fb0b40f86c0 2023-01-04T18:17:19.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.754+0000 7fb0a9ffb700 1 -- 172.21.15.50:0/575698560 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0a40147e0 con 0x7fb0b40f86c0 2023-01-04T18:17:19.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.755+0000 7fb0bb2d6700 1 -- 172.21.15.50:0/575698560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b41089f0 con 0x7fb0b40f86c0 2023-01-04T18:17:19.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.756+0000 7fb0bb2d6700 1 -- 172.21.15.50:0/575698560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b4045ad0 con 0x7fb0b40f86c0 2023-01-04T18:17:19.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.756+0000 7fb0a9ffb700 1 -- 172.21.15.50:0/575698560 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 23) v1 ==== 74625+0+0 (secure 0 0 0) 0x7fb0a401b030 con 0x7fb0b40f86c0 2023-01-04T18:17:19.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.757+0000 7fb0a9ffb700 1 --2- 172.21.15.50:0/575698560 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fb0a005e7c0 0x7fb0a0060c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:19.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.757+0000 7fb0a9ffb700 1 -- 172.21.15.50:0/575698560 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fb0a4078bf0 con 0x7fb0b40f86c0 2023-01-04T18:17:19.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.757+0000 7fb0b9072700 1 --2- 172.21.15.50:0/575698560 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fb0a005e7c0 0x7fb0a0060c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:19.763 INFO:tasks.workunit.client.0.smithi050.stdout:4/994: write d14/d1b/d1f/d22/d87/de0/d108/d5d/fc7 [138994,93637] 0 2023-01-04T18:17:19.763 INFO:tasks.workunit.client.0.smithi050.stdout:4/995: chown d14/d1b/d1f/d63/da5/db6/lde 8831 1 2023-01-04T18:17:19.763 INFO:tasks.workunit.client.0.smithi050.stdout:4/996: chown d14/d1b/d32/f3f 18173691 1 2023-01-04T18:17:19.763 INFO:tasks.workunit.client.0.smithi050.stdout:4/997: chown d14/d1b/d1f/d22/d3e/d85/la8 1418598226 1 2023-01-04T18:17:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.758+0000 7fb0b9072700 1 --2- 172.21.15.50:0/575698560 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fb0a005e7c0 0x7fb0a0060c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fb0b0009720 tx=0x7fb0b0016040).ready entity=mgr.24455 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:19.764 INFO:tasks.workunit.client.0.smithi050.stdout:2/998: unlink d1/dd/d11/db5/d99/ca4 0 2023-01-04T18:17:19.766 INFO:tasks.workunit.client.0.smithi050.stdout:4/998: symlink d14/d1b/d1f/d22/d3e/d85/d118/l153 0 2023-01-04T18:17:19.767 INFO:tasks.workunit.client.0.smithi050.stdout:4/999: read d14/d1b/d32/f3f [374763,52546] 0 2023-01-04T18:17:19.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.765+0000 7fb0a9ffb700 1 -- 172.21.15.50:0/575698560 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161783 (secure 0 0 0) 0x7fb0a404cdc0 con 0x7fb0b40f86c0 2023-01-04T18:17:19.768 INFO:tasks.workunit.client.0.smithi050.stdout:2/999: rmdir d1/dd 39 2023-01-04T18:17:19.887 INFO:tasks.workunit.client.0.smithi050.stdout:0/883: sync 2023-01-04T18:17:19.889 INFO:tasks.workunit.client.0.smithi050.stdout:0/884: unlink d0/d6/d28/d1a/f40 0 2023-01-04T18:17:19.889 INFO:tasks.workunit.client.0.smithi050.stdout:0/885: fsync d0/d6/d28/d1a/f6b 0 2023-01-04T18:17:19.889 INFO:tasks.workunit.client.0.smithi050.stdout:0/886: chown d0/d6/d28/d9c/fb9 4545493 1 2023-01-04T18:17:19.911 INFO:tasks.workunit.client.0.smithi050.stdout:0/887: dwrite d0/d6/d28/d1a/d8a/d9e/ffb [0,4194304] 0 2023-01-04T18:17:19.916 INFO:tasks.workunit.client.0.smithi050.stdout:0/888: creat d0/d6/d8/d51/f11a x:0 0 0 2023-01-04T18:17:19.931 INFO:tasks.workunit.client.0.smithi050.stdout:0/889: dwrite d0/d6/d8/f18 [4194304,4194304] 0 2023-01-04T18:17:19.938 INFO:tasks.workunit.client.0.smithi050.stdout:0/890: mkdir d0/d73/d79/dd5/d11b 0 2023-01-04T18:17:19.939 INFO:tasks.workunit.client.0.smithi050.stdout:0/891: chown d0/l17 587692968 1 2023-01-04T18:17:19.941 INFO:tasks.workunit.client.0.smithi050.stdout:0/892: creat d0/d6/d8/d35/dbe/f11c x:0 0 0 2023-01-04T18:17:19.954 INFO:tasks.workunit.client.0.smithi050.stdout:0/893: rename d0/d6/d8/d35/dbe to d0/d9f/d84/d11d 0 2023-01-04T18:17:19.959 INFO:tasks.workunit.client.0.smithi050.stdout:0/894: mknod d0/d9f/d84/d11d/c11e 0 2023-01-04T18:17:19.959 INFO:tasks.workunit.client.0.smithi050.stdout:0/895: write d0/d6/d28/fdf [89979,334] 0 2023-01-04T18:17:19.959 INFO:tasks.workunit.client.0.smithi050.stdout:0/896: getdents d0/d6/d8/d35/dd2 0 2023-01-04T18:17:19.964 INFO:tasks.workunit.client.0.smithi050.stdout:0/897: dread d0/d6/d28/d1a/f23 [0,4194304] 0 2023-01-04T18:17:19.979 INFO:tasks.workunit.client.0.smithi050.stdout:0/898: dwrite d0/d9f/fb4 [0,4194304] 0 2023-01-04T18:17:19.996 INFO:tasks.workunit.client.0.smithi050.stdout:0/899: dwrite d0/d73/f71 [0,4194304] 0 2023-01-04T18:17:19.997 INFO:tasks.workunit.client.0.smithi050.stdout:0/900: chown d0/d73/d68/l111 47527 1 2023-01-04T18:17:19.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:19.994+0000 7fb0a9ffb700 1 -- 172.21.15.50:0/575698560 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 24) v1 ==== 77020+0+0 (secure 0 0 0) 0x7fb0a40a7810 con 0x7fb0b40f86c0 2023-01-04T18:17:20.001 INFO:tasks.workunit.client.0.smithi050.stdout:0/901: symlink d0/d9f/d84/dfa/l11f 0 2023-01-04T18:17:20.001 INFO:tasks.workunit.client.0.smithi050.stdout:0/902: chown d0/d6/d8/cb0 5 1 2023-01-04T18:17:20.011 INFO:tasks.workunit.client.0.smithi050.stdout:0/903: symlink d0/d73/d68/l120 0 2023-01-04T18:17:20.011 INFO:tasks.workunit.client.0.smithi050.stdout:0/904: dread - d0/d6/fda zero size 2023-01-04T18:17:20.011 INFO:tasks.workunit.client.0.smithi050.stdout:0/905: chown d0/d73/d79/cd6 11940 1 2023-01-04T18:17:20.012 INFO:tasks.workunit.client.0.smithi050.stdout:0/906: mknod d0/d6/d8/d51/c121 0 2023-01-04T18:17:20.014 INFO:tasks.workunit.client.0.smithi050.stdout:0/907: mknod d0/d6/d8/d51/dd9/c122 0 2023-01-04T18:17:20.016 INFO:tasks.workunit.client.0.smithi050.stdout:0/908: creat d0/d6/d28/d1a/d8a/d9e/f123 x:0 0 0 2023-01-04T18:17:20.016 INFO:tasks.workunit.client.0.smithi050.stdout:0/909: write d0/d6/d8/d35/f37 [5275939,109372] 0 2023-01-04T18:17:20.017 INFO:tasks.workunit.client.0.smithi050.stdout:0/910: rename d0/d6/d8/d4f/fc0 to d0/d6/d8/f124 0 2023-01-04T18:17:20.018 INFO:tasks.workunit.client.0.smithi050.stdout:0/911: write d0/d6/d28/d9c/fb9 [29993,93961] 0 2023-01-04T18:17:20.018 INFO:tasks.workunit.client.0.smithi050.stdout:0/912: write d0/d6/d8/d51/f50 [219344,76479] 0 2023-01-04T18:17:20.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.049+0000 7fb0bb2d6700 1 -- 172.21.15.50:0/575698560 --> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0b4108c10 con 0x7fb0a005e7c0 2023-01-04T18:17:20.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.050+0000 7fb0a9ffb700 1 -- 172.21.15.50:0/575698560 <== mgr.24455 v2:172.21.15.98:6828/3052541756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fb0b4108c10 con 0x7fb0a005e7c0 2023-01-04T18:17:20.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.052+0000 7fb0bb2d6700 1 -- 172.21.15.50:0/575698560 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fb0a005e7c0 msgr2=0x7fb0a0060c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:20.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.052+0000 7fb0bb2d6700 1 --2- 172.21.15.50:0/575698560 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fb0a005e7c0 0x7fb0a0060c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fb0b0009720 tx=0x7fb0b0016040).stop 2023-01-04T18:17:20.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.052+0000 7fb0bb2d6700 1 -- 172.21.15.50:0/575698560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0b40f86c0 msgr2=0x7fb0b4107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:20.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.052+0000 7fb0bb2d6700 1 --2- 172.21.15.50:0/575698560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0b40f86c0 0x7fb0b4107420 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fb0a400e7f0 tx=0x7fb0a400b040).stop 2023-01-04T18:17:20.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.052+0000 7fb0bb2d6700 1 -- 172.21.15.50:0/575698560 shutdown_connections 2023-01-04T18:17:20.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.052+0000 7fb0bb2d6700 1 --2- 172.21.15.50:0/575698560 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7fb0a005e7c0 0x7fb0a0060c80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:20.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.052+0000 7fb0bb2d6700 1 --2- 172.21.15.50:0/575698560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0b40f7d20 0x7fb0b4106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:20.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.052+0000 7fb0bb2d6700 1 --2- 172.21.15.50:0/575698560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0b40f86c0 0x7fb0b4107420 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:20.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.052+0000 7fb0bb2d6700 1 -- 172.21.15.50:0/575698560 >> 172.21.15.50:0/575698560 conn(0x7fb0b40f04c0 msgr2=0x7fb0b40fb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:20.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.053+0000 7fb0bb2d6700 1 -- 172.21.15.50:0/575698560 shutdown_connections 2023-01-04T18:17:20.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.053+0000 7fb0bb2d6700 1 -- 172.21.15.50:0/575698560 wait complete. 2023-01-04T18:17:20.072 INFO:teuthology.orchestra.run.smithi050.stdout:true 2023-01-04T18:17:20.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.162+0000 7f24901b2700 1 -- 172.21.15.50:0/1329310493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24880f55c0 msgr2=0x7f24880f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:20.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.162+0000 7f24901b2700 1 --2- 172.21.15.50:0/1329310493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24880f55c0 0x7f24880f59e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f2484004660 tx=0x7f2484009b30).stop 2023-01-04T18:17:20.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.162+0000 7f24901b2700 1 -- 172.21.15.50:0/1329310493 shutdown_connections 2023-01-04T18:17:20.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.162+0000 7f24901b2700 1 --2- 172.21.15.50:0/1329310493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24880f6860 0x7f24880f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-01-04T18:17:20.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.162+0000 7f24901b2700 1 --2- 172.21.15.50:0/1329310493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24880f55c0 0x7f24880f59e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:20.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.162+0000 7f24901b2700 1 -- 172.21.15.50:0/1329310493 >> 172.21.15.50:0/1329310493 conn(0x7f24880f0d40 msgr2=0x7f24880f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:20.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.162+0000 7f24901b2700 1 -- 172.21.15.50:0/1329310493 shutdown_connections 2023-01-04T18:17:20.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.162+0000 7f24901b2700 1 -- 172.21.15.50:0/1329310493 wait complete. 2023-01-04T18:17:20.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.162+0000 7f24901b2700 1 Processor -- start 2023-01-04T18:17:20.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.162+0000 7f24901b2700 1 -- start start 2023-01-04T18:17:20.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.163+0000 7f24901b2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24880f55c0 0x7f2488106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:20.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.163+0000 7f24901b2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24880f6860 0x7f24881074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:20.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.163+0000 7f24901b2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2488107ae0 con 0x7f24880f6860 2023-01-04T18:17:20.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.163+0000 7f24901b2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2488108390 con 0x7f24880f55c0 2023-01-04T18:17:20.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.163+0000 7f248d74d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24880f6860 0x7f24881074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:20.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.163+0000 7f248d74d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24880f6860 0x7f24881074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35884/0 (socket says 172.21.15.50:35884) 2023-01-04T18:17:20.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.163+0000 7f248d74d700 1 -- 172.21.15.50:0/761889670 learned_addr learned my addr 172.21.15.50:0/761889670 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:17:20.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.163+0000 7f248d74d700 1 -- 172.21.15.50:0/761889670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24880f55c0 msgr2=0x7f2488106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:20.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.163+0000 7f248d74d700 1 --2- 172.21.15.50:0/761889670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24880f55c0 0x7f2488106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-01-04T18:17:20.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.163+0000 7f248d74d700 1 -- 172.21.15.50:0/761889670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2484005040 con 0x7f24880f6860 2023-01-04T18:17:20.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.163+0000 7f248d74d700 1 --2- 172.21.15.50:0/761889670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24880f6860 0x7f24881074a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f247c00b410 tx=0x7f247c006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:20.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.163+0000 7f247a7fc700 1 -- 172.21.15.50:0/761889670 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f247c0125f0 con 0x7f24880f6860 2023-01-04T18:17:20.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.163+0000 7f247a7fc700 1 -- 172.21.15.50:0/761889670 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f247c012c10 con 0x7f24880f6860 2023-01-04T18:17:20.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.163+0000 7f24901b2700 1 -- 172.21.15.50:0/761889670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2488108670 con 0x7f24880f6860 2023-01-04T18:17:20.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.163+0000 7f247a7fc700 1 -- 172.21.15.50:0/761889670 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f247c002b00 con 0x7f24880f6860 2023-01-04T18:17:20.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.163+0000 7f24901b2700 1 -- 172.21.15.50:0/761889670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2488108c30 con 0x7f24880f6860 2023-01-04T18:17:20.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.164+0000 7f24901b2700 1 -- 172.21.15.50:0/761889670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24880f49b0 con 0x7f24880f6860 2023-01-04T18:17:20.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.165+0000 7f247a7fc700 1 -- 172.21.15.50:0/761889670 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 77020+0+0 (secure 0 0 0) 0x7f247c00f030 con 0x7f24880f6860 2023-01-04T18:17:20.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.165+0000 7f247a7fc700 1 --2- 172.21.15.50:0/761889670 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f2474060c70 0x7f2474063130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:20.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.165+0000 7f247a7fc700 1 -- 172.21.15.50:0/761889670 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f247c07c0d0 con 0x7f24880f6860 2023-01-04T18:17:20.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.165+0000 7f248df4e700 1 --2- 172.21.15.50:0/761889670 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f2474060c70 0x7f2474063130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:20.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.165+0000 7f248df4e700 1 --2- 172.21.15.50:0/761889670 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f2474060c70 0x7f2474063130 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f2484009f50 tx=0x7f2484009b30).ready entity=mgr.24455 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:20.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.169+0000 7f247a7fc700 1 -- 172.21.15.50:0/761889670 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161783 (secure 0 0 0) 0x7f247c050210 con 0x7f24880f6860 2023-01-04T18:17:20.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:19.909171+0000 mon.smithi050 (mon.0) 603 : cluster [DBG] Standby manager daemon smithi050.emnywo restarted 2023-01-04T18:17:20.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:19.909280+0000 mon.smithi050 (mon.0) 604 : cluster [DBG] Standby manager daemon smithi050.emnywo started 2023-01-04T18:17:20.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:19.910883+0000 mon.smithi098 (mon.1) 57 : audit [DBG] from='mgr.? 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi050.emnywo/crt"}]: dispatch 2023-01-04T18:17:20.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:19.911423+0000 mon.smithi098 (mon.1) 58 : audit [DBG] from='mgr.? 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-01-04T18:17:20.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:19.913814+0000 mon.smithi098 (mon.1) 59 : audit [DBG] from='mgr.? 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi050.emnywo/key"}]: dispatch 2023-01-04T18:17:20.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:19.915250+0000 mon.smithi098 (mon.1) 60 : audit [DBG] from='mgr.? 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-01-04T18:17:20.293 INFO:tasks.workunit.client.0.smithi050.stdout:0/913: sync 2023-01-04T18:17:20.293 INFO:tasks.workunit.client.0.smithi050.stdout:0/914: chown d0/d6/d28/f77 1153837007 1 2023-01-04T18:17:20.293 INFO:tasks.workunit.client.0.smithi050.stdout:0/915: fdatasync d0/d9f/d84/f10b 0 2023-01-04T18:17:20.293 INFO:tasks.workunit.client.0.smithi050.stdout:0/916: chown d0/d73/d79 0 1 2023-01-04T18:17:20.293 INFO:tasks.workunit.client.0.smithi050.stdout:0/917: chown d0/d6/d28/d9c/fb9 20 1 2023-01-04T18:17:20.294 INFO:tasks.workunit.client.0.smithi050.stdout:0/918: creat d0/d6/d8/d25/d8e/f125 x:0 0 0 2023-01-04T18:17:20.296 INFO:tasks.workunit.client.0.smithi050.stdout:0/919: dread d0/d6/d28/fe7 [0,4194304] 0 2023-01-04T18:17:20.296 INFO:tasks.workunit.client.0.smithi050.stdout:0/920: write d0/d9f/d84/d11d/f11c [665094,38424] 0 2023-01-04T18:17:20.298 INFO:tasks.workunit.client.0.smithi050.stdout:0/921: symlink d0/d9f/d84/dd8/l126 0 2023-01-04T18:17:20.299 INFO:tasks.workunit.client.0.smithi050.stdout:0/922: read d0/d6/d28/fad [335127,128549] 0 2023-01-04T18:17:20.300 INFO:tasks.workunit.client.0.smithi050.stdout:0/923: dread d0/d9f/d84/fb8 [0,4194304] 0 2023-01-04T18:17:20.302 INFO:tasks.workunit.client.0.smithi050.stdout:0/924: rename d0/d6/d8/d25/d8e/d10d to d0/d6/d28/d1a/d8a/d127 0 2023-01-04T18:17:20.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:19.909171+0000 mon.smithi050 (mon.0) 603 : cluster [DBG] Standby manager daemon smithi050.emnywo restarted 2023-01-04T18:17:20.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:19.909280+0000 mon.smithi050 (mon.0) 604 : cluster [DBG] Standby manager daemon smithi050.emnywo started 2023-01-04T18:17:20.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:19.910883+0000 mon.smithi098 (mon.1) 57 : audit [DBG] from='mgr.? 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi050.emnywo/crt"}]: dispatch 2023-01-04T18:17:20.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:19.911423+0000 mon.smithi098 (mon.1) 58 : audit [DBG] from='mgr.? 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-01-04T18:17:20.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:19.913814+0000 mon.smithi098 (mon.1) 59 : audit [DBG] from='mgr.? 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi050.emnywo/key"}]: dispatch 2023-01-04T18:17:20.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:19.915250+0000 mon.smithi098 (mon.1) 60 : audit [DBG] from='mgr.? 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-01-04T18:17:20.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.377+0000 7f24901b2700 1 -- 172.21.15.50:0/761889670 --> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f248805fd30 con 0x7f2474060c70 2023-01-04T18:17:20.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.378+0000 7f247a7fc700 1 -- 172.21.15.50:0/761889670 <== mgr.24455 v2:172.21.15.98:6828/3052541756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f248805fd30 con 0x7f2474060c70 2023-01-04T18:17:20.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.380+0000 7f24901b2700 1 -- 172.21.15.50:0/761889670 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f2474060c70 msgr2=0x7f2474063130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:20.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.380+0000 7f24901b2700 1 --2- 172.21.15.50:0/761889670 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f2474060c70 0x7f2474063130 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f2484009f50 tx=0x7f2484009b30).stop 2023-01-04T18:17:20.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.380+0000 7f24901b2700 1 -- 172.21.15.50:0/761889670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24880f6860 msgr2=0x7f24881074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:20.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.380+0000 7f24901b2700 1 --2- 172.21.15.50:0/761889670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24880f6860 0x7f24881074a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f247c00b410 tx=0x7f247c006ef0).stop 2023-01-04T18:17:20.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.381+0000 7f24901b2700 1 -- 172.21.15.50:0/761889670 shutdown_connections 2023-01-04T18:17:20.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.381+0000 7f24901b2700 1 --2- 172.21.15.50:0/761889670 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f2474060c70 0x7f2474063130 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:20.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.381+0000 7f24901b2700 1 --2- 172.21.15.50:0/761889670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24880f55c0 0x7f2488106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-01-04T18:17:20.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.381+0000 7f24901b2700 1 --2- 172.21.15.50:0/761889670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24880f6860 0x7f24881074a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:20.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.381+0000 7f24901b2700 1 -- 172.21.15.50:0/761889670 >> 172.21.15.50:0/761889670 conn(0x7f24880f0d40 msgr2=0x7f248805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:20.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.381+0000 7f24901b2700 1 -- 172.21.15.50:0/761889670 shutdown_connections 2023-01-04T18:17:20.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.381+0000 7f24901b2700 1 -- 172.21.15.50:0/761889670 wait complete. 2023-01-04T18:17:20.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.514+0000 7f7886fa6700 1 -- 172.21.15.50:0/440431437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7880060270 msgr2=0x7f78800f91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:20.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.514+0000 7f7886fa6700 1 --2- 172.21.15.50:0/440431437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7880060270 0x7f78800f91b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f787c004660 tx=0x7f787c009b30).stop 2023-01-04T18:17:20.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.514+0000 7f7886fa6700 1 -- 172.21.15.50:0/440431437 shutdown_connections 2023-01-04T18:17:20.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.514+0000 7f7886fa6700 1 --2- 172.21.15.50:0/440431437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78800f96a0 0x7f78800fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:20.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.514+0000 7f7886fa6700 1 --2- 172.21.15.50:0/440431437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7880060270 0x7f78800f91b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:20.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.514+0000 7f7886fa6700 1 -- 172.21.15.50:0/440431437 >> 172.21.15.50:0/440431437 conn(0x7f78800f0b90 msgr2=0x7f78800f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:20.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.515+0000 7f7886fa6700 1 -- 172.21.15.50:0/440431437 shutdown_connections 2023-01-04T18:17:20.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.515+0000 7f7886fa6700 1 -- 172.21.15.50:0/440431437 wait complete. 2023-01-04T18:17:20.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.515+0000 7f7886fa6700 1 Processor -- start 2023-01-04T18:17:20.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.515+0000 7f7886fa6700 1 -- start start 2023-01-04T18:17:20.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.515+0000 7f7886fa6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7880060270 0x7f78800f6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:20.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.515+0000 7f7886fa6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78800f96a0 0x7f78800f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:20.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.515+0000 7f7886fa6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78800f5610 con 0x7f7880060270 2023-01-04T18:17:20.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.515+0000 7f7886fa6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78800f5750 con 0x7f78800f96a0 2023-01-04T18:17:20.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.515+0000 7f7885fa4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7880060270 0x7f78800f6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:20.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.516+0000 7f7885fa4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7880060270 0x7f78800f6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35906/0 (socket says 172.21.15.50:35906) 2023-01-04T18:17:20.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.516+0000 7f7885fa4700 1 -- 172.21.15.50:0/1175850238 learned_addr learned my addr 172.21.15.50:0/1175850238 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:17:20.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.516+0000 7f78857a3700 1 --2- 172.21.15.50:0/1175850238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78800f96a0 0x7f78800f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:20.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.516+0000 7f7885fa4700 1 -- 172.21.15.50:0/1175850238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78800f96a0 msgr2=0x7f78800f50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:20.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.516+0000 7f7885fa4700 1 --2- 172.21.15.50:0/1175850238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78800f96a0 0x7f78800f50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:20.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.516+0000 7f7885fa4700 1 -- 172.21.15.50:0/1175850238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c005040 con 0x7f7880060270 2023-01-04T18:17:20.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.516+0000 7f7885fa4700 1 --2- 172.21.15.50:0/1175850238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7880060270 0x7f78800f6c30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f787c009f50 tx=0x7f787c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:20.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.516+0000 7f78767fc700 1 -- 172.21.15.50:0/1175850238 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f787c018070 con 0x7f7880060270 2023-01-04T18:17:20.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.516+0000 7f78767fc700 1 -- 172.21.15.50:0/1175850238 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f787c009630 con 0x7f7880060270 2023-01-04T18:17:20.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.516+0000 7f78767fc700 1 -- 172.21.15.50:0/1175850238 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f787c01c3c0 con 0x7f7880060270 2023-01-04T18:17:20.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.516+0000 7f7886fa6700 1 -- 172.21.15.50:0/1175850238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78800f59d0 con 0x7f7880060270 2023-01-04T18:17:20.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.516+0000 7f7886fa6700 1 -- 172.21.15.50:0/1175850238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78800f5f30 con 0x7f7880060270 2023-01-04T18:17:20.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.517+0000 7f7886fa6700 1 -- 172.21.15.50:0/1175850238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7880045ad0 con 0x7f7880060270 2023-01-04T18:17:20.521 INFO:tasks.workunit.client.0.smithi050.stdout:0/925: sync 2023-01-04T18:17:20.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.518+0000 7f78767fc700 1 -- 172.21.15.50:0/1175850238 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 77020+0+0 (secure 0 0 0) 0x7f787c01d970 con 0x7f7880060270 2023-01-04T18:17:20.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.519+0000 7f78767fc700 1 --2- 172.21.15.50:0/1175850238 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f786c060cc0 0x7f786c063180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:20.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.519+0000 7f78767fc700 1 -- 172.21.15.50:0/1175850238 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f787c07d8d0 con 0x7f7880060270 2023-01-04T18:17:20.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.519+0000 7f78857a3700 1 --2- 172.21.15.50:0/1175850238 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f786c060cc0 0x7f786c063180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:20.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.519+0000 7f78857a3700 1 --2- 172.21.15.50:0/1175850238 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f786c060cc0 0x7f786c063180 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7880060040 tx=0x7f787000b040).ready entity=mgr.24455 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:20.527 INFO:tasks.workunit.client.0.smithi050.stdout:0/926: dread d0/d6/d8/f18 [4194304,4194304] 0 2023-01-04T18:17:20.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.525+0000 7f78767fc700 1 -- 172.21.15.50:0/1175850238 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161783 (secure 0 0 0) 0x7f787c04dfe0 con 0x7f7880060270 2023-01-04T18:17:20.529 INFO:tasks.workunit.client.0.smithi050.stdout:0/927: creat d0/d9f/d84/dd8/f128 x:0 0 0 2023-01-04T18:17:20.529 INFO:tasks.workunit.client.0.smithi050.stdout:0/928: chown d0/d6/d28/d1a/c31 8776118 1 2023-01-04T18:17:20.587 INFO:tasks.workunit.client.0.smithi050.stdout:0/929: rename d0/d9f to d0/d129 0 2023-01-04T18:17:20.587 INFO:tasks.workunit.client.0.smithi050.stdout:0/930: fdatasync d0/d6/d8/d35/fa4 0 2023-01-04T18:17:20.587 INFO:tasks.workunit.client.0.smithi050.stdout:0/931: read - d0/d6/d8/d25/d8e/fe2 zero size 2023-01-04T18:17:20.588 INFO:tasks.workunit.client.0.smithi050.stdout:0/932: mkdir d0/d73/d79/dd5/d11b/d12a 0 2023-01-04T18:17:20.590 INFO:tasks.workunit.client.0.smithi050.stdout:0/933: creat d0/d6/d8/d51/dd9/dfc/f12b x:0 0 0 2023-01-04T18:17:20.592 INFO:tasks.workunit.client.0.smithi050.stdout:0/934: rename d0/d6/d8/d35/f34 to d0/d6/d28/d9c/f12c 0 2023-01-04T18:17:20.594 INFO:tasks.workunit.client.0.smithi050.stdout:0/935: mknod d0/d73/d105/c12d 0 2023-01-04T18:17:20.595 INFO:tasks.workunit.client.0.smithi050.stdout:0/936: creat d0/d73/d68/d10f/f12e x:0 0 0 2023-01-04T18:17:20.597 INFO:tasks.workunit.client.0.smithi050.stdout:0/937: dread d0/d129/fcd [0,4194304] 0 2023-01-04T18:17:20.597 INFO:tasks.workunit.client.0.smithi050.stdout:0/938: chown d0/d6/lba 0 1 2023-01-04T18:17:20.597 INFO:tasks.workunit.client.0.smithi050.stdout:0/939: chown d0/d73/d105/c12d 0 1 2023-01-04T18:17:20.615 INFO:tasks.workunit.client.0.smithi050.stdout:0/940: dwrite d0/d129/d84/fc8 [0,4194304] 0 2023-01-04T18:17:20.615 INFO:tasks.workunit.client.0.smithi050.stdout:0/941: fsync d0/d6/f55 0 2023-01-04T18:17:20.618 INFO:tasks.workunit.client.0.smithi050.stdout:0/942: mknod d0/d129/d84/d11d/c12f 0 2023-01-04T18:17:20.619 INFO:tasks.workunit.client.0.smithi050.stdout:0/943: dread - d0/d6/fda zero size 2023-01-04T18:17:20.620 INFO:tasks.workunit.client.0.smithi050.stdout:0/944: mkdir d0/d6/d28/d1a/d8a/d9e/d130 0 2023-01-04T18:17:20.620 INFO:tasks.workunit.client.0.smithi050.stdout:0/945: write d0/d129/d84/d11d/fc1 [476943,79319] 0 2023-01-04T18:17:20.622 INFO:tasks.workunit.client.0.smithi050.stdout:0/946: dread d0/d73/d79/fde [0,4194304] 0 2023-01-04T18:17:20.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.742+0000 7f7886fa6700 1 -- 172.21.15.50:0/1175850238 --> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7880057f10 con 0x7f786c060cc0 2023-01-04T18:17:20.776 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-01-04T18:17:20.776 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager.smithi050 smithi050 *:9093,9094 running (5m) 63s ago 6m 18.1M - 0.20.0 0881eb8f169f b5d3e2678a23 2023-01-04T18:17:20.776 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi050 smithi050 running (6m) 63s ago 6m 7037k - 16.2.4 8d91d370c2b8 cfe6f2d72ef5 2023-01-04T18:17:20.777 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi098 smithi098 running (6m) 52s ago 6m 7151k - 16.2.4 8d91d370c2b8 2928008d526c 2023-01-04T18:17:20.777 INFO:teuthology.orchestra.run.smithi050.stdout:grafana.smithi050 smithi050 *:3000 running (5m) 63s ago 6m 36.6M - 6.7.4 557c83e11646 7e5dccbafe78 2023-01-04T18:17:20.777 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.ezoiwl smithi050 running (2m) 63s ago 2m 1861M - 16.2.4 8d91d370c2b8 6c5c5f2be8b9 2023-01-04T18:17:20.777 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.kefmuy smithi050 running (2m) 63s ago 2m 16.5M - 16.2.4 8d91d370c2b8 58cace913b55 2023-01-04T18:17:20.777 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.laynsk smithi098 running (2m) 52s ago 2m 14.2M - 16.2.4 8d91d370c2b8 8ff8af70b989 2023-01-04T18:17:20.777 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.memais smithi098 running (2m) 52s ago 2m 291M - 16.2.4 8d91d370c2b8 d59d9b4dbf7d 2023-01-04T18:17:20.777 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi050.emnywo smithi050 *:8443,9283 starting - - - - 2023-01-04T18:17:20.777 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi098.vhfzum smithi098 *:8443,9283 running (80s) 52s ago 6m 426M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 5ec7d7719033 2023-01-04T18:17:20.778 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi050 smithi050 running (8m) 63s ago 8m 107M 2048M 16.2.4 8d91d370c2b8 7ef171ad1e93 2023-01-04T18:17:20.778 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi098 smithi098 running (6m) 52s ago 6m 109M 2048M 16.2.4 8d91d370c2b8 e6b6833279a4 2023-01-04T18:17:20.778 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi050 smithi050 *:9100 running (6m) 63s ago 6m 18.3M - 0.18.1 e5a616e4b9cf 88892b2e5e5a 2023-01-04T18:17:20.778 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi098 smithi098 *:9100 running (5m) 52s ago 5m 18.3M - 0.18.1 e5a616e4b9cf 49bcde8331b6 2023-01-04T18:17:20.778 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (5m) 63s ago 5m 258M 4096M 16.2.4 8d91d370c2b8 b46676195180 2023-01-04T18:17:20.778 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi050 running (5m) 63s ago 5m 283M 4096M 16.2.4 8d91d370c2b8 e4928bcfd146 2023-01-04T18:17:20.778 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi050 running (4m) 63s ago 4m 222M 4096M 16.2.4 8d91d370c2b8 babab394b338 2023-01-04T18:17:20.778 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi098 running (4m) 52s ago 4m 304M 4096M 16.2.4 8d91d370c2b8 b02df8e3cb23 2023-01-04T18:17:20.778 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi098 running (4m) 52s ago 4m 241M 4096M 16.2.4 8d91d370c2b8 92273135ca82 2023-01-04T18:17:20.778 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi098 running (4m) 52s ago 4m 274M 4096M 16.2.4 8d91d370c2b8 366d0bfff809 2023-01-04T18:17:20.779 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus.smithi050 smithi050 *:9095 starting - - - - 2023-01-04T18:17:20.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.751+0000 7f78767fc700 1 -- 172.21.15.50:0/1175850238 <== mgr.24455 v2:172.21.15.98:6828/3052541756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f7880057f10 con 0x7f786c060cc0 2023-01-04T18:17:20.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.752+0000 7f7886fa6700 1 -- 172.21.15.50:0/1175850238 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f786c060cc0 msgr2=0x7f786c063180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:20.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.752+0000 7f7886fa6700 1 --2- 172.21.15.50:0/1175850238 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f786c060cc0 0x7f786c063180 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7880060040 tx=0x7f787000b040).stop 2023-01-04T18:17:20.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.752+0000 7f7886fa6700 1 -- 172.21.15.50:0/1175850238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7880060270 msgr2=0x7f78800f6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:20.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.752+0000 7f7886fa6700 1 --2- 172.21.15.50:0/1175850238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7880060270 0x7f78800f6c30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f787c009f50 tx=0x7f787c009b30).stop 2023-01-04T18:17:20.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.753+0000 7f7886fa6700 1 -- 172.21.15.50:0/1175850238 shutdown_connections 2023-01-04T18:17:20.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.753+0000 7f7886fa6700 1 --2- 172.21.15.50:0/1175850238 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f786c060cc0 0x7f786c063180 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:20.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.753+0000 7f7886fa6700 1 --2- 172.21.15.50:0/1175850238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7880060270 0x7f78800f6c30 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:20.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.753+0000 7f7886fa6700 1 --2- 172.21.15.50:0/1175850238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78800f96a0 0x7f78800f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:20.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.753+0000 7f7886fa6700 1 -- 172.21.15.50:0/1175850238 >> 172.21.15.50:0/1175850238 conn(0x7f78800f0b90 msgr2=0x7f78800f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:20.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.753+0000 7f7886fa6700 1 -- 172.21.15.50:0/1175850238 shutdown_connections 2023-01-04T18:17:20.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.753+0000 7f7886fa6700 1 -- 172.21.15.50:0/1175850238 wait complete. 2023-01-04T18:17:20.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.864+0000 7f46d5ba2700 1 -- 172.21.15.50:0/1441496573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46d00f51a0 msgr2=0x7f46d00f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:20.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.864+0000 7f46d5ba2700 1 --2- 172.21.15.50:0/1441496573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46d00f51a0 0x7f46d00f7920 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f46bc004660 tx=0x7f46bc009b30).stop 2023-01-04T18:17:20.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.864+0000 7f46d5ba2700 1 -- 172.21.15.50:0/1441496573 shutdown_connections 2023-01-04T18:17:20.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.864+0000 7f46d5ba2700 1 --2- 172.21.15.50:0/1441496573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46d00f51a0 0x7f46d00f7920 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:20.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.864+0000 7f46d5ba2700 1 --2- 172.21.15.50:0/1441496573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46d00f4800 0x7f46d00f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:20.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.864+0000 7f46d5ba2700 1 -- 172.21.15.50:0/1441496573 >> 172.21.15.50:0/1441496573 conn(0x7f46d00f0320 msgr2=0x7f46d00f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:20.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.864+0000 7f46d5ba2700 1 -- 172.21.15.50:0/1441496573 shutdown_connections 2023-01-04T18:17:20.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.864+0000 7f46d5ba2700 1 -- 172.21.15.50:0/1441496573 wait complete. 2023-01-04T18:17:20.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.865+0000 7f46d5ba2700 1 Processor -- start 2023-01-04T18:17:20.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.865+0000 7f46d5ba2700 1 -- start start 2023-01-04T18:17:20.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.865+0000 7f46d5ba2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46d00f4800 0x7f46d0106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:20.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.865+0000 7f46d5ba2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46d00f51a0 0x7f46d01072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:20.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.865+0000 7f46d5ba2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d01078f0 con 0x7f46d00f51a0 2023-01-04T18:17:20.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.865+0000 7f46d5ba2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d0108100 con 0x7f46d00f4800 2023-01-04T18:17:20.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.866+0000 7f46cffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46d00f51a0 0x7f46d01072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:20.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.866+0000 7f46cffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46d00f51a0 0x7f46d01072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35930/0 (socket says 172.21.15.50:35930) 2023-01-04T18:17:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.866+0000 7f46cffff700 1 -- 172.21.15.50:0/3665055853 learned_addr learned my addr 172.21.15.50:0/3665055853 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:17:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.866+0000 7f46d4ba0700 1 --2- 172.21.15.50:0/3665055853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46d00f4800 0x7f46d0106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.866+0000 7f46cffff700 1 -- 172.21.15.50:0/3665055853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46d00f4800 msgr2=0x7f46d0106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.866+0000 7f46cffff700 1 --2- 172.21.15.50:0/3665055853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46d00f4800 0x7f46d0106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.866+0000 7f46cffff700 1 -- 172.21.15.50:0/3665055853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc005040 con 0x7f46d00f51a0 2023-01-04T18:17:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.866+0000 7f46cffff700 1 --2- 172.21.15.50:0/3665055853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46d00f51a0 0x7f46d01072f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f46bc009f50 tx=0x7f46bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.866+0000 7f46cd7fa700 1 -- 172.21.15.50:0/3665055853 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46bc018070 con 0x7f46d00f51a0 2023-01-04T18:17:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.866+0000 7f46d5ba2700 1 -- 172.21.15.50:0/3665055853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d0108320 con 0x7f46d00f51a0 2023-01-04T18:17:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.866+0000 7f46cd7fa700 1 -- 172.21.15.50:0/3665055853 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f46bc01d8e0 con 0x7f46d00f51a0 2023-01-04T18:17:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.866+0000 7f46cd7fa700 1 -- 172.21.15.50:0/3665055853 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46bc01c440 con 0x7f46d00f51a0 2023-01-04T18:17:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.866+0000 7f46d5ba2700 1 -- 172.21.15.50:0/3665055853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d0108880 con 0x7f46d00f51a0 2023-01-04T18:17:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.867+0000 7f46d5ba2700 1 -- 172.21.15.50:0/3665055853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d0059100 con 0x7f46d00f51a0 2023-01-04T18:17:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.869+0000 7f46cd7fa700 1 -- 172.21.15.50:0/3665055853 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 77020+0+0 (secure 0 0 0) 0x7f46bc01da50 con 0x7f46d00f51a0 2023-01-04T18:17:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.869+0000 7f46cd7fa700 1 --2- 172.21.15.50:0/3665055853 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f46c0060cc0 0x7f46c0063180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.870+0000 7f46cd7fa700 1 -- 172.21.15.50:0/3665055853 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f46bc07e0c0 con 0x7f46d00f51a0 2023-01-04T18:17:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.870+0000 7f46d4ba0700 1 --2- 172.21.15.50:0/3665055853 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f46c0060cc0 0x7f46c0063180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.870+0000 7f46d4ba0700 1 --2- 172.21.15.50:0/3665055853 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f46c0060cc0 0x7f46c0063180 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f46d0106b70 tx=0x7f46c4009040).ready entity=mgr.24455 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:20.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:20.875+0000 7f46cd7fa700 1 -- 172.21.15.50:0/3665055853 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161783 (secure 0 0 0) 0x7f46bc04e7d0 con 0x7f46d00f51a0 2023-01-04T18:17:20.885 INFO:tasks.workunit.client.0.smithi050.stdout:0/947: sync 2023-01-04T18:17:20.887 INFO:tasks.workunit.client.0.smithi050.stdout:0/948: creat d0/d6/d8/d51/dd9/f131 x:0 0 0 2023-01-04T18:17:20.887 INFO:tasks.workunit.client.0.smithi050.stdout:0/949: write d0/d129/d84/d11d/f11c [748482,37295] 0 2023-01-04T18:17:20.888 INFO:tasks.workunit.client.0.smithi050.stdout:0/950: write d0/f4d [400309,66637] 0 2023-01-04T18:17:20.909 INFO:tasks.workunit.client.0.smithi050.stdout:0/951: dwrite d0/d6/f55 [0,4194304] 0 2023-01-04T18:17:20.910 INFO:tasks.workunit.client.0.smithi050.stdout:0/952: stat d0/d6/d8/d35/dd2/cff 0 2023-01-04T18:17:20.918 INFO:tasks.workunit.client.0.smithi050.stdout:0/953: dread d0/d6/d28/d1a/d8a/d9e/ffb [0,4194304] 0 2023-01-04T18:17:20.920 INFO:tasks.workunit.client.0.smithi050.stdout:0/954: getdents d0/d6/d8/d25/d8e 0 2023-01-04T18:17:20.921 INFO:tasks.workunit.client.0.smithi050.stdout:0/955: read d0/d6/f55 [3409157,89509] 0 2023-01-04T18:17:20.940 INFO:tasks.workunit.client.0.smithi050.stdout:0/956: dread d0/d6/d8/d35/f37 [0,4194304] 0 2023-01-04T18:17:20.950 INFO:tasks.workunit.client.0.smithi050.stdout:0/957: dread d0/d129/feb [0,4194304] 0 2023-01-04T18:17:20.959 INFO:tasks.workunit.client.0.smithi050.stdout:0/958: rename d0/d6/d8/d51/fe1 to d0/d6/d8/d4f/df4/f132 0 2023-01-04T18:17:20.988 INFO:tasks.workunit.client.0.smithi050.stdout:0/959: mknod d0/d6/d8/d25/c133 0 2023-01-04T18:17:20.989 INFO:tasks.workunit.client.0.smithi050.stdout:0/960: write d0/d6/d8/d51/f50 [317994,101996] 0 2023-01-04T18:17:21.008 INFO:tasks.workunit.client.0.smithi050.stdout:0/961: dwrite d0/d6/d8/d35/fa8 [4194304,4194304] 0 2023-01-04T18:17:21.021 INFO:tasks.workunit.client.0.smithi050.stdout:0/962: creat d0/d6/d8/d51/f134 x:0 0 0 2023-01-04T18:17:21.025 INFO:tasks.workunit.client.0.smithi050.stdout:0/963: mknod d0/d6/d8/d51/dd9/dfc/c135 0 2023-01-04T18:17:21.027 INFO:tasks.workunit.client.0.smithi050.stdout:0/964: unlink d0/d6/d28/d1a/f6b 0 2023-01-04T18:17:21.033 INFO:tasks.workunit.client.0.smithi050.stdout:0/965: dread d0/d6/f55 [0,4194304] 0 2023-01-04T18:17:21.039 INFO:tasks.workunit.client.0.smithi050.stdout:0/966: dread d0/d129/d84/d11d/f11c [0,4194304] 0 2023-01-04T18:17:21.041 INFO:tasks.workunit.client.0.smithi050.stdout:0/967: unlink d0/d6/d8/d35/f6f 0 2023-01-04T18:17:21.041 INFO:tasks.workunit.client.0.smithi050.stdout:0/968: write d0/d6/d8/d35/f66 [2112316,84287] 0 2023-01-04T18:17:21.041 INFO:tasks.workunit.client.0.smithi050.stdout:0/969: stat d0/d6/d28/d1a/l45 0 2023-01-04T18:17:21.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.179+0000 7f46d5ba2700 1 -- 172.21.15.50:0/3665055853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f46d00fecf0 con 0x7f46d00f51a0 2023-01-04T18:17:21.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.179+0000 7f46cd7fa700 1 -- 172.21.15.50:0/3665055853 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+699 (secure 0 0 0) 0x7f46bc051df0 con 0x7f46d00f51a0 2023-01-04T18:17:21.182 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:17:21.182 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": { 2023-01-04T18:17:21.182 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-01-04T18:17:21.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:17:21.182 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": { 2023-01-04T18:17:21.183 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:17:21.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:17:21.183 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": { 2023-01-04T18:17:21.183 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2023-01-04T18:17:21.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:17:21.183 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2023-01-04T18:17:21.183 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-01-04T18:17:21.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:17:21.183 INFO:teuthology.orchestra.run.smithi050.stdout: "overall": { 2023-01-04T18:17:21.183 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2, 2023-01-04T18:17:21.184 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 12 2023-01-04T18:17:21.184 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-01-04T18:17:21.184 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:17:21.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.182+0000 7f46d5ba2700 1 -- 172.21.15.50:0/3665055853 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f46c0060cc0 msgr2=0x7f46c0063180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:21.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.182+0000 7f46d5ba2700 1 --2- 172.21.15.50:0/3665055853 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f46c0060cc0 0x7f46c0063180 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f46d0106b70 tx=0x7f46c4009040).stop 2023-01-04T18:17:21.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.182+0000 7f46d5ba2700 1 -- 172.21.15.50:0/3665055853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46d00f51a0 msgr2=0x7f46d01072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:21.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.182+0000 7f46d5ba2700 1 --2- 172.21.15.50:0/3665055853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46d00f51a0 0x7f46d01072f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f46bc009f50 tx=0x7f46bc009b30).stop 2023-01-04T18:17:21.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.182+0000 7f46d5ba2700 1 -- 172.21.15.50:0/3665055853 shutdown_connections 2023-01-04T18:17:21.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.183+0000 7f46d5ba2700 1 --2- 172.21.15.50:0/3665055853 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f46c0060cc0 0x7f46c0063180 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:21.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.183+0000 7f46d5ba2700 1 --2- 172.21.15.50:0/3665055853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46d00f4800 0x7f46d0106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:21.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.183+0000 7f46d5ba2700 1 --2- 172.21.15.50:0/3665055853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46d00f51a0 0x7f46d01072f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:21.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.183+0000 7f46d5ba2700 1 -- 172.21.15.50:0/3665055853 >> 172.21.15.50:0/3665055853 conn(0x7f46d00f0320 msgr2=0x7f46d00fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:21.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.183+0000 7f46d5ba2700 1 -- 172.21.15.50:0/3665055853 shutdown_connections 2023-01-04T18:17:21.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.183+0000 7f46d5ba2700 1 -- 172.21.15.50:0/3665055853 wait complete. 2023-01-04T18:17:21.253 INFO:tasks.workunit.client.0.smithi050.stdout:0/970: sync 2023-01-04T18:17:21.253 INFO:tasks.workunit.client.0.smithi050.stdout:0/971: chown d0/d6/d8/d51/dd9/f131 48225012 1 2023-01-04T18:17:21.255 INFO:tasks.workunit.client.0.smithi050.stdout:0/972: symlink d0/d6/l136 0 2023-01-04T18:17:21.255 INFO:tasks.workunit.client.0.smithi050.stdout:0/973: stat d0/d6/d8/d51/dd9/lf6 0 2023-01-04T18:17:21.272 INFO:tasks.workunit.client.0.smithi050.stdout:0/974: dwrite d0/d6/d28/d1a/d8a/d9e/fd0 [0,4194304] 0 2023-01-04T18:17:21.273 INFO:tasks.workunit.client.0.smithi050.stdout:0/975: write d0/d6/f3c [2682812,98365] 0 2023-01-04T18:17:21.276 INFO:tasks.workunit.client.0.smithi050.stdout:0/976: mknod d0/d6/d28/d1a/d8a/c137 0 2023-01-04T18:17:21.279 INFO:tasks.workunit.client.0.smithi050.stdout:0/977: link d0/d73/l104 d0/d73/d105/l138 0 2023-01-04T18:17:21.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:19.924394+0000 mgr.smithi098.vhfzum (mgr.24455) 54 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 2.2 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 85 MiB/s rd, 169 MiB/s wr, 331 op/s 2023-01-04T18:17:21.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:19.992439+0000 mon.smithi050 (mon.0) 605 : cluster [DBG] mgrmap e24: smithi098.vhfzum(active, since 72s), standbys: smithi050.emnywo 2023-01-04T18:17:21.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:20.050850+0000 mgr.smithi098.vhfzum (mgr.24455) 55 : audit [DBG] from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:17:21.297 INFO:tasks.workunit.client.0.smithi050.stdout:0/978: dwrite d0/d73/d79/f119 [0,4194304] 0 2023-01-04T18:17:21.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.315+0000 7ff450a4c700 1 -- 172.21.15.50:0/221761211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff44c0f8520 msgr2=0x7ff44c0f46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:21.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.315+0000 7ff450a4c700 1 --2- 172.21.15.50:0/221761211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff44c0f8520 0x7ff44c0f46a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7ff440004660 tx=0x7ff440009b30).stop 2023-01-04T18:17:21.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.315+0000 7ff450a4c700 1 -- 172.21.15.50:0/221761211 shutdown_connections 2023-01-04T18:17:21.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.315+0000 7ff450a4c700 1 --2- 172.21.15.50:0/221761211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff44c0f8520 0x7ff44c0f46a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:21.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.315+0000 7ff450a4c700 1 --2- 172.21.15.50:0/221761211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff44c0f7b80 0x7ff44c0f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:21.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.315+0000 7ff450a4c700 1 -- 172.21.15.50:0/221761211 >> 172.21.15.50:0/221761211 conn(0x7ff44c0f0320 msgr2=0x7ff44c0f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:21.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.315+0000 7ff450a4c700 1 -- 172.21.15.50:0/221761211 shutdown_connections 2023-01-04T18:17:21.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.315+0000 7ff450a4c700 1 -- 172.21.15.50:0/221761211 wait complete. 2023-01-04T18:17:21.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.315+0000 7ff450a4c700 1 Processor -- start 2023-01-04T18:17:21.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.316+0000 7ff450a4c700 1 -- start start 2023-01-04T18:17:21.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.316+0000 7ff450a4c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff44c0f7b80 0x7ff44c0f7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:21.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.316+0000 7ff450a4c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff44c0f8520 0x7ff44c0f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:21.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.316+0000 7ff450a4c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c0f5e30 con 0x7ff44c0f7b80 2023-01-04T18:17:21.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.316+0000 7ff450a4c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c0f5f70 con 0x7ff44c0f8520 2023-01-04T18:17:21.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.316+0000 7ff44b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff44c0f7b80 0x7ff44c0f7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:21.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.316+0000 7ff44affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff44c0f8520 0x7ff44c0f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:21.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.316+0000 7ff44b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff44c0f7b80 0x7ff44c0f7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35938/0 (socket says 172.21.15.50:35938) 2023-01-04T18:17:21.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.316+0000 7ff44b7fe700 1 -- 172.21.15.50:0/1143342687 learned_addr learned my addr 172.21.15.50:0/1143342687 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:17:21.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.316+0000 7ff44b7fe700 1 -- 172.21.15.50:0/1143342687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff44c0f8520 msgr2=0x7ff44c0f58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:21.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.316+0000 7ff44b7fe700 1 --2- 172.21.15.50:0/1143342687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff44c0f8520 0x7ff44c0f58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:21.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.316+0000 7ff44b7fe700 1 -- 172.21.15.50:0/1143342687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff440005040 con 0x7ff44c0f7b80 2023-01-04T18:17:21.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.316+0000 7ff44b7fe700 1 --2- 172.21.15.50:0/1143342687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff44c0f7b80 0x7ff44c0f7450 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7ff43c00e7c0 tx=0x7ff43c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:21.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.317+0000 7ff433fff700 1 -- 172.21.15.50:0/1143342687 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff43c0092e0 con 0x7ff44c0f7b80 2023-01-04T18:17:21.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.317+0000 7ff450a4c700 1 -- 172.21.15.50:0/1143342687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44c0f6250 con 0x7ff44c0f7b80 2023-01-04T18:17:21.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.317+0000 7ff450a4c700 1 -- 172.21.15.50:0/1143342687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44c10ecf0 con 0x7ff44c0f7b80 2023-01-04T18:17:21.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.317+0000 7ff433fff700 1 -- 172.21.15.50:0/1143342687 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff43c00f040 con 0x7ff44c0f7b80 2023-01-04T18:17:21.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.317+0000 7ff433fff700 1 -- 172.21.15.50:0/1143342687 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff43c014810 con 0x7ff44c0f7b80 2023-01-04T18:17:21.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.318+0000 7ff450a4c700 1 -- 172.21.15.50:0/1143342687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff42c004fa0 con 0x7ff44c0f7b80 2023-01-04T18:17:21.322 INFO:tasks.workunit.client.0.smithi050.stdout:0/979: creat d0/d6/d28/d1a/d8a/d9e/f139 x:0 0 0 2023-01-04T18:17:21.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.319+0000 7ff433fff700 1 -- 172.21.15.50:0/1143342687 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 77020+0+0 (secure 0 0 0) 0x7ff43c01b030 con 0x7ff44c0f7b80 2023-01-04T18:17:21.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.319+0000 7ff433fff700 1 --2- 172.21.15.50:0/1143342687 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7ff434060cc0 0x7ff434063180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:21.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.319+0000 7ff433fff700 1 -- 172.21.15.50:0/1143342687 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff43c07b8b0 con 0x7ff44c0f7b80 2023-01-04T18:17:21.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.320+0000 7ff44affd700 1 --2- 172.21.15.50:0/1143342687 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7ff434060cc0 0x7ff434063180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:21.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.320+0000 7ff44affd700 1 --2- 172.21.15.50:0/1143342687 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7ff434060cc0 0x7ff434063180 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ff440009720 tx=0x7ff440016040).ready entity=mgr.24455 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.325+0000 7ff433fff700 1 -- 172.21.15.50:0/1143342687 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161783 (secure 0 0 0) 0x7ff43c04bff0 con 0x7ff44c0f7b80 2023-01-04T18:17:21.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:19.924394+0000 mgr.smithi098.vhfzum (mgr.24455) 54 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 2.2 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 85 MiB/s rd, 169 MiB/s wr, 331 op/s 2023-01-04T18:17:21.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:19.992439+0000 mon.smithi050 (mon.0) 605 : cluster [DBG] mgrmap e24: smithi098.vhfzum(active, since 72s), standbys: smithi050.emnywo 2023-01-04T18:17:21.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:20.050850+0000 mgr.smithi098.vhfzum (mgr.24455) 55 : audit [DBG] from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:17:21.331 INFO:tasks.workunit.client.0.smithi050.stdout:0/980: dread d0/d6/d8/f48 [0,4194304] 0 2023-01-04T18:17:21.334 INFO:tasks.workunit.client.0.smithi050.stdout:0/981: mkdir d0/d73/d79/dd5/d13a 0 2023-01-04T18:17:21.335 INFO:tasks.workunit.client.0.smithi050.stdout:0/982: dread d0/d6/d8/f89 [0,4194304] 0 2023-01-04T18:17:21.356 INFO:tasks.workunit.client.0.smithi050.stdout:0/983: dwrite d0/d6/d8/d4f/df4/f132 [0,4194304] 0 2023-01-04T18:17:21.364 INFO:tasks.workunit.client.0.smithi050.stdout:0/984: mknod d0/c13b 0 2023-01-04T18:17:21.364 INFO:tasks.workunit.client.0.smithi050.stdout:0/985: chown d0/d6/d8/d51/dd9/lf6 159761 1 2023-01-04T18:17:21.369 INFO:tasks.workunit.client.0.smithi050.stdout:0/986: read d0/d6/d28/d1a/d8a/fd7 [145835,111846] 0 2023-01-04T18:17:21.371 INFO:tasks.workunit.client.0.smithi050.stdout:0/987: creat d0/d6/d8/d4f/df4/f13c x:0 0 0 2023-01-04T18:17:21.373 INFO:tasks.workunit.client.0.smithi050.stdout:0/988: mknod d0/d6/d8/d25/c13d 0 2023-01-04T18:17:21.373 INFO:tasks.workunit.client.0.smithi050.stdout:0/989: fsync d0/d6/d28/d9c/fb9 0 2023-01-04T18:17:21.375 INFO:tasks.workunit.client.0.smithi050.stdout:0/990: mkdir d0/d129/da1/d13e 0 2023-01-04T18:17:21.377 INFO:tasks.workunit.client.0.smithi050.stdout:0/991: mknod d0/d73/d79/dd5/d11b/d12a/c13f 0 2023-01-04T18:17:21.379 INFO:tasks.workunit.client.0.smithi050.stdout:0/992: mkdir d0/d6/d140 0 2023-01-04T18:17:21.379 INFO:tasks.workunit.client.0.smithi050.stdout:0/993: write d0/d6/d28/d1a/d8a/d9e/fb2 [4244385,112211] 0 2023-01-04T18:17:21.381 INFO:tasks.workunit.client.0.smithi050.stdout:0/994: symlink d0/d6/d8/d35/dd2/l141 0 2023-01-04T18:17:21.404 INFO:tasks.workunit.client.0.smithi050.stdout:0/995: dwrite d0/d73/d79/fc4 [0,4194304] 0 2023-01-04T18:17:21.408 INFO:tasks.workunit.client.0.smithi050.stdout:0/996: dread d0/d6/f55 [0,4194304] 0 2023-01-04T18:17:21.417 INFO:tasks.workunit.client.0.smithi050.stdout:0/997: dread d0/d6/d8/f124 [0,4194304] 0 2023-01-04T18:17:21.435 INFO:tasks.workunit.client.0.smithi050.stdout:0/998: dwrite d0/d6/d8/d4f/ff9 [0,4194304] 0 2023-01-04T18:17:21.435 INFO:tasks.workunit.client.0.smithi050.stdout:0/999: stat d0/d73 0 2023-01-04T18:17:21.438 INFO:tasks.workunit.client.0.smithi050.stderr:+ rm -rf -- ./tmp.xOX7L42WvC 2023-01-04T18:17:21.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.699+0000 7ff450a4c700 1 -- 172.21.15.50:0/1143342687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff42c005e80 con 0x7ff44c0f7b80 2023-01-04T18:17:21.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.699+0000 7ff433fff700 1 -- 172.21.15.50:0/1143342687 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1669 (secure 0 0 0) 0x7ff43c019070 con 0x7ff44c0f7b80 2023-01-04T18:17:21.702 INFO:teuthology.orchestra.run.smithi050.stdout:e13 2023-01-04T18:17:21.702 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:17:21.702 INFO:teuthology.orchestra.run.smithi050.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:17:21.702 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-01-04T18:17:21.702 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:17:21.703 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-01-04T18:17:21.703 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-01-04T18:17:21.703 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 10 2023-01-04T18:17:21.703 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 2023-01-04T18:17:21.703 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:17:21.703 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-01-04T18:14:43.958806+0000 2023-01-04T18:17:21.703 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-01-04T18:17:21.703 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-01-04T18:17:21.703 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 60 2023-01-04T18:17:21.703 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-01-04T18:17:21.703 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-01-04T18:17:21.704 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-01-04T18:17:21.704 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-01-04T18:17:21.704 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 0 2023-01-04T18:17:21.704 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:17:21.704 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 1 2023-01-04T18:17:21.704 INFO:teuthology.orchestra.run.smithi050.stdout:in 0 2023-01-04T18:17:21.704 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=14430} 2023-01-04T18:17:21.704 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-01-04T18:17:21.704 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-01-04T18:17:21.704 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-01-04T18:17:21.704 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-01-04T18:17:21.705 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-01-04T18:17:21.705 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data enabled 2023-01-04T18:17:21.705 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-01-04T18:17:21.705 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 1 2023-01-04T18:17:21.705 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.ezoiwl{0:14430} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541]] 2023-01-04T18:17:21.705 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.memais{0:24291} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.98:6824/1196398070,v1:172.21.15.98:6825/1196398070]] 2023-01-04T18:17:21.705 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:17:21.705 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:17:21.706 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2023-01-04T18:17:21.706 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:17:21.706 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.kefmuy{-1:14440} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592]] 2023-01-04T18:17:21.706 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.laynsk{-1:24297} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263]] 2023-01-04T18:17:21.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.703+0000 7ff450a4c700 1 -- 172.21.15.50:0/1143342687 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7ff434060cc0 msgr2=0x7ff434063180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:21.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.703+0000 7ff450a4c700 1 --2- 172.21.15.50:0/1143342687 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7ff434060cc0 0x7ff434063180 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ff440009720 tx=0x7ff440016040).stop 2023-01-04T18:17:21.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.703+0000 7ff450a4c700 1 -- 172.21.15.50:0/1143342687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff44c0f7b80 msgr2=0x7ff44c0f7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:21.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.703+0000 7ff450a4c700 1 --2- 172.21.15.50:0/1143342687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff44c0f7b80 0x7ff44c0f7450 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7ff43c00e7c0 tx=0x7ff43c00b040).stop 2023-01-04T18:17:21.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.703+0000 7ff450a4c700 1 -- 172.21.15.50:0/1143342687 shutdown_connections 2023-01-04T18:17:21.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.703+0000 7ff450a4c700 1 --2- 172.21.15.50:0/1143342687 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7ff434060cc0 0x7ff434063180 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:21.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.703+0000 7ff450a4c700 1 --2- 172.21.15.50:0/1143342687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff44c0f7b80 0x7ff44c0f7450 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:21.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.703+0000 7ff450a4c700 1 --2- 172.21.15.50:0/1143342687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff44c0f8520 0x7ff44c0f58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:21.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.703+0000 7ff450a4c700 1 -- 172.21.15.50:0/1143342687 >> 172.21.15.50:0/1143342687 conn(0x7ff44c0f0320 msgr2=0x7ff44c0fb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:21.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.703+0000 7ff450a4c700 1 -- 172.21.15.50:0/1143342687 shutdown_connections 2023-01-04T18:17:21.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.703+0000 7ff450a4c700 1 -- 172.21.15.50:0/1143342687 wait complete. 2023-01-04T18:17:21.708 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2023-01-04T18:17:21.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.834+0000 7f07e980f700 1 -- 172.21.15.50:0/2031075356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e40f6a40 msgr2=0x7f07e40f6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:21.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.834+0000 7f07e980f700 1 --2- 172.21.15.50:0/2031075356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e40f6a40 0x7f07e40f6e60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f07d8004660 tx=0x7f07d8009b30).stop 2023-01-04T18:17:21.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.834+0000 7f07e980f700 1 -- 172.21.15.50:0/2031075356 shutdown_connections 2023-01-04T18:17:21.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.834+0000 7f07e980f700 1 --2- 172.21.15.50:0/2031075356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07e40f5790 0x7f07e40f5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:21.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.834+0000 7f07e980f700 1 --2- 172.21.15.50:0/2031075356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e40f6a40 0x7f07e40f6e60 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:21.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.834+0000 7f07e980f700 1 -- 172.21.15.50:0/2031075356 >> 172.21.15.50:0/2031075356 conn(0x7f07e40f0320 msgr2=0x7f07e40f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:21.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.834+0000 7f07e980f700 1 -- 172.21.15.50:0/2031075356 shutdown_connections 2023-01-04T18:17:21.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.834+0000 7f07e980f700 1 -- 172.21.15.50:0/2031075356 wait complete. 2023-01-04T18:17:21.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.835+0000 7f07e980f700 1 Processor -- start 2023-01-04T18:17:21.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.835+0000 7f07e980f700 1 -- start start 2023-01-04T18:17:21.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.835+0000 7f07e980f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07e40f5790 0x7f07e4105d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:21.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.835+0000 7f07e980f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e40f6a40 0x7f07e4106230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:21.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.835+0000 7f07e980f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e4106830 con 0x7f07e40f6a40 2023-01-04T18:17:21.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.835+0000 7f07e980f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e4107040 con 0x7f07e40f5790 2023-01-04T18:17:21.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.835+0000 7f07e3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e40f6a40 0x7f07e4106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:21.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.835+0000 7f07e3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e40f6a40 0x7f07e4106230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35952/0 (socket says 172.21.15.50:35952) 2023-01-04T18:17:21.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.835+0000 7f07e3fff700 1 -- 172.21.15.50:0/3234015565 learned_addr learned my addr 172.21.15.50:0/3234015565 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:17:21.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.835+0000 7f07e880d700 1 --2- 172.21.15.50:0/3234015565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07e40f5790 0x7f07e4105d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:21.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.836+0000 7f07e3fff700 1 -- 172.21.15.50:0/3234015565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07e40f5790 msgr2=0x7f07e4105d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:21.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.836+0000 7f07e3fff700 1 --2- 172.21.15.50:0/3234015565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07e40f5790 0x7f07e4105d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:21.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.836+0000 7f07e3fff700 1 -- 172.21.15.50:0/3234015565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d8005040 con 0x7f07e40f6a40 2023-01-04T18:17:21.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.836+0000 7f07e3fff700 1 --2- 172.21.15.50:0/3234015565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e40f6a40 0x7f07e4106230 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f07d000e9a0 tx=0x7f07d0007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:21.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.836+0000 7f07e17fa700 1 -- 172.21.15.50:0/3234015565 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07d000c980 con 0x7f07e40f6a40 2023-01-04T18:17:21.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.836+0000 7f07e17fa700 1 -- 172.21.15.50:0/3234015565 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f07d0011470 con 0x7f07e40f6a40 2023-01-04T18:17:21.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.836+0000 7f07e980f700 1 -- 172.21.15.50:0/3234015565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e4107260 con 0x7f07e40f6a40 2023-01-04T18:17:21.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.836+0000 7f07e17fa700 1 -- 172.21.15.50:0/3234015565 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07d00105f0 con 0x7f07e40f6a40 2023-01-04T18:17:21.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.836+0000 7f07e980f700 1 -- 172.21.15.50:0/3234015565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e41077f0 con 0x7f07e40f6a40 2023-01-04T18:17:21.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.837+0000 7f07e980f700 1 -- 172.21.15.50:0/3234015565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e4059100 con 0x7f07e40f6a40 2023-01-04T18:17:21.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.838+0000 7f07e17fa700 1 -- 172.21.15.50:0/3234015565 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 77020+0+0 (secure 0 0 0) 0x7f07d00115e0 con 0x7f07e40f6a40 2023-01-04T18:17:21.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.838+0000 7f07e17fa700 1 --2- 172.21.15.50:0/3234015565 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f07d4060cc0 0x7f07d4063180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:21.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.838+0000 7f07e17fa700 1 -- 172.21.15.50:0/3234015565 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f07d007eb00 con 0x7f07e40f6a40 2023-01-04T18:17:21.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.838+0000 7f07e880d700 1 --2- 172.21.15.50:0/3234015565 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f07d4060cc0 0x7f07d4063180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:21.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.839+0000 7f07e880d700 1 --2- 172.21.15.50:0/3234015565 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f07d4060cc0 0x7f07d4063180 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f07e4105ab0 tx=0x7f07d8009b30).ready entity=mgr.24455 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:21.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:21.846+0000 7f07e17fa700 1 -- 172.21.15.50:0/3234015565 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161783 (secure 0 0 0) 0x7f07d004f1b0 con 0x7f07e40f6a40 2023-01-04T18:17:22.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:22.104+0000 7f07e980f700 1 -- 172.21.15.50:0/3234015565 --> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07e40ff730 con 0x7f07d4060cc0 2023-01-04T18:17:22.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:22.105+0000 7f07e17fa700 1 -- 172.21.15.50:0/3234015565 <== mgr.24455 v2:172.21.15.98:6828/3052541756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f07e40ff730 con 0x7f07d4060cc0 2023-01-04T18:17:22.107 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:17:22.107 INFO:teuthology.orchestra.run.smithi050.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308", 2023-01-04T18:17:22.107 INFO:teuthology.orchestra.run.smithi050.stdout: "in_progress": true, 2023-01-04T18:17:22.108 INFO:teuthology.orchestra.run.smithi050.stdout: "which": "Upgrading all daemon types on all hosts", 2023-01-04T18:17:22.108 INFO:teuthology.orchestra.run.smithi050.stdout: "services_complete": [], 2023-01-04T18:17:22.108 INFO:teuthology.orchestra.run.smithi050.stdout: "progress": "", 2023-01-04T18:17:22.108 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "Currently upgrading mgr daemons", 2023-01-04T18:17:22.108 INFO:teuthology.orchestra.run.smithi050.stdout: "is_paused": false 2023-01-04T18:17:22.108 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:17:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:22.108+0000 7f07e980f700 1 -- 172.21.15.50:0/3234015565 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f07d4060cc0 msgr2=0x7f07d4063180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:22.108+0000 7f07e980f700 1 --2- 172.21.15.50:0/3234015565 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f07d4060cc0 0x7f07d4063180 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f07e4105ab0 tx=0x7f07d8009b30).stop 2023-01-04T18:17:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:22.108+0000 7f07e980f700 1 -- 172.21.15.50:0/3234015565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e40f6a40 msgr2=0x7f07e4106230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:22.108+0000 7f07e980f700 1 --2- 172.21.15.50:0/3234015565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e40f6a40 0x7f07e4106230 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f07d000e9a0 tx=0x7f07d0007e20).stop 2023-01-04T18:17:22.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:22.108+0000 7f07e980f700 1 -- 172.21.15.50:0/3234015565 shutdown_connections 2023-01-04T18:17:22.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:22.108+0000 7f07e980f700 1 --2- 172.21.15.50:0/3234015565 >> [v2:172.21.15.98:6828/3052541756,v1:172.21.15.98:6829/3052541756] conn(0x7f07d4060cc0 0x7f07d4063180 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:22.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:22.108+0000 7f07e980f700 1 --2- 172.21.15.50:0/3234015565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07e40f5790 0x7f07e4105d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:22.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:22.108+0000 7f07e980f700 1 --2- 172.21.15.50:0/3234015565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e40f6a40 0x7f07e4106230 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:22.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:22.108+0000 7f07e980f700 1 -- 172.21.15.50:0/3234015565 >> 172.21.15.50:0/3234015565 conn(0x7f07e40f0320 msgr2=0x7f07e40fa1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:22.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:22.108+0000 7f07e980f700 1 -- 172.21.15.50:0/3234015565 shutdown_connections 2023-01-04T18:17:22.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:22.108+0000 7f07e980f700 1 -- 172.21.15.50:0/3234015565 wait complete. 2023-01-04T18:17:22.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:20.378401+0000 mgr.smithi098.vhfzum (mgr.24455) 56 : audit [DBG] from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:17:22.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:20.743384+0000 mgr.smithi098.vhfzum (mgr.24455) 57 : audit [DBG] from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:17:22.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:21.180019+0000 mon.smithi050 (mon.0) 606 : audit [DBG] from='client.? 172.21.15.50:0/3665055853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:17:22.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:21.700018+0000 mon.smithi050 (mon.0) 607 : audit [DBG] from='client.? 172.21.15.50:0/1143342687' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:17:22.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:20.378401+0000 mgr.smithi098.vhfzum (mgr.24455) 56 : audit [DBG] from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:17:22.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:20.743384+0000 mgr.smithi098.vhfzum (mgr.24455) 57 : audit [DBG] from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:17:22.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:21.180019+0000 mon.smithi050 (mon.0) 606 : audit [DBG] from='client.? 172.21.15.50:0/3665055853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:17:22.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:21.700018+0000 mon.smithi050 (mon.0) 607 : audit [DBG] from='client.? 172.21.15.50:0/1143342687' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:17:23.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:21.924735+0000 mgr.smithi098.vhfzum (mgr.24455) 58 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 2.2 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 55 MiB/s rd, 103 MiB/s wr, 206 op/s 2023-01-04T18:17:23.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:22.105140+0000 mgr.smithi098.vhfzum (mgr.24455) 59 : audit [DBG] from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:17:23.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:21.924735+0000 mgr.smithi098.vhfzum (mgr.24455) 58 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 2.2 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 55 MiB/s rd, 103 MiB/s wr, 206 op/s 2023-01-04T18:17:23.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:22.105140+0000 mgr.smithi098.vhfzum (mgr.24455) 59 : audit [DBG] from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:17:24.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:23.197926+0000 mon.smithi050 (mon.0) 608 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:17:24.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:23.568868+0000 mon.smithi050 (mon.0) 609 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:17:24.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:23.579617+0000 mon.smithi098 (mon.1) 61 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:17:24.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:17:23.583294+0000 mgr.smithi098.vhfzum (mgr.24455) 60 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi098.vhfzum) 2023-01-04T18:17:24.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:17:23.583915+0000 mgr.smithi098.vhfzum (mgr.24455) 61 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi098.vhfzum) 2023-01-04T18:17:24.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:17:23.587162+0000 mgr.smithi098.vhfzum (mgr.24455) 62 : cephadm [INF] Failing over to other MGR 2023-01-04T18:17:24.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:23.587610+0000 mon.smithi098 (mon.1) 62 : audit [INF] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mgr fail", "who": "smithi098.vhfzum"}]: dispatch 2023-01-04T18:17:24.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:23.589488+0000 mon.smithi050 (mon.0) 610 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mgr fail", "who": "smithi098.vhfzum"}]: dispatch 2023-01-04T18:17:24.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:23.595366+0000 mon.smithi050 (mon.0) 611 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2023-01-04T18:17:24.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:23.597785+0000 mon.smithi098 (mon.1) 63 : audit [INF] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-01-04T18:17:24.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:23.598554+0000 mon.smithi050 (mon.0) 612 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-01-04T18:17:24.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:23.601188+0000 mon.smithi098 (mon.1) 64 : audit [INF] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-01-04T18:17:24.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:23.602068+0000 mon.smithi050 (mon.0) 613 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-01-04T18:17:24.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:23.925268+0000 mgr.smithi098.vhfzum (mgr.24455) 63 : cluster [DBG] pgmap v42: 65 pgs: 65 active+clean; 2.2 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 62 MiB/s rd, 114 MiB/s wr, 262 op/s 2023-01-04T18:17:24.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:24.163273+0000 mon.smithi050 (mon.0) 614 : cluster [DBG] Standby manager daemon smithi098.vhfzum started 2023-01-04T18:17:24.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:23.197926+0000 mon.smithi050 (mon.0) 608 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:17:24.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:23.568868+0000 mon.smithi050 (mon.0) 609 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' 2023-01-04T18:17:24.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:23.579617+0000 mon.smithi098 (mon.1) 61 : audit [DBG] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:17:24.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:17:23.583294+0000 mgr.smithi098.vhfzum (mgr.24455) 60 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi098.vhfzum) 2023-01-04T18:17:24.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:17:23.583915+0000 mgr.smithi098.vhfzum (mgr.24455) 61 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi098.vhfzum) 2023-01-04T18:17:24.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:17:23.587162+0000 mgr.smithi098.vhfzum (mgr.24455) 62 : cephadm [INF] Failing over to other MGR 2023-01-04T18:17:24.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:23.587610+0000 mon.smithi098 (mon.1) 62 : audit [INF] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mgr fail", "who": "smithi098.vhfzum"}]: dispatch 2023-01-04T18:17:24.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:23.589488+0000 mon.smithi050 (mon.0) 610 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "mgr fail", "who": "smithi098.vhfzum"}]: dispatch 2023-01-04T18:17:24.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:23.595366+0000 mon.smithi050 (mon.0) 611 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2023-01-04T18:17:24.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:23.597785+0000 mon.smithi098 (mon.1) 63 : audit [INF] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-01-04T18:17:24.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:23.598554+0000 mon.smithi050 (mon.0) 612 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-01-04T18:17:24.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:23.601188+0000 mon.smithi098 (mon.1) 64 : audit [INF] from='mgr.24455 172.21.15.98:0/4031943686' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-01-04T18:17:24.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:23.602068+0000 mon.smithi050 (mon.0) 613 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-01-04T18:17:24.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:23.925268+0000 mgr.smithi098.vhfzum (mgr.24455) 63 : cluster [DBG] pgmap v42: 65 pgs: 65 active+clean; 2.2 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 62 MiB/s rd, 114 MiB/s wr, 262 op/s 2023-01-04T18:17:24.583 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:24.163273+0000 mon.smithi050 (mon.0) 614 : cluster [DBG] Standby manager daemon smithi098.vhfzum started 2023-01-04T18:17:25.584 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.576356+0000 mon.smithi050 (mon.0) 615 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' cmd='[{"prefix": "mgr fail", "who": "smithi098.vhfzum"}]': finished 2023-01-04T18:17:25.586 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:24.576443+0000 mon.smithi050 (mon.0) 616 : cluster [DBG] mgrmap e25: smithi050.emnywo(active, starting, since 0.985748s), standbys: smithi098.vhfzum 2023-01-04T18:17:25.587 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.584498+0000 mon.smithi050 (mon.0) 617 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi050"}]: dispatch 2023-01-04T18:17:25.587 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.584638+0000 mon.smithi050 (mon.0) 618 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2023-01-04T18:17:25.587 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.585956+0000 mon.smithi050 (mon.0) 619 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi050.ezoiwl"}]: dispatch 2023-01-04T18:17:25.587 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.586212+0000 mon.smithi050 (mon.0) 620 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi050.kefmuy"}]: dispatch 2023-01-04T18:17:25.587 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.586420+0000 mon.smithi050 (mon.0) 621 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.memais"}]: dispatch 2023-01-04T18:17:25.587 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.586607+0000 mon.smithi050 (mon.0) 622 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.laynsk"}]: dispatch 2023-01-04T18:17:25.587 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.587068+0000 mon.smithi050 (mon.0) 623 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mgr metadata", "who": "smithi050.emnywo", "id": "smithi050.emnywo"}]: dispatch 2023-01-04T18:17:25.587 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.587263+0000 mon.smithi050 (mon.0) 624 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mgr metadata", "who": "smithi098.vhfzum", "id": "smithi098.vhfzum"}]: dispatch 2023-01-04T18:17:25.587 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.588980+0000 mon.smithi050 (mon.0) 625 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-01-04T18:17:25.587 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.589236+0000 mon.smithi050 (mon.0) 626 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-01-04T18:17:25.588 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.589449+0000 mon.smithi050 (mon.0) 627 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-01-04T18:17:25.588 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.589626+0000 mon.smithi050 (mon.0) 628 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:17:25.588 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.589756+0000 mon.smithi050 (mon.0) 629 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-01-04T18:17:25.588 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.589963+0000 mon.smithi050 (mon.0) 630 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-01-04T18:17:25.588 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.590823+0000 mon.smithi050 (mon.0) 631 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-01-04T18:17:25.588 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.591238+0000 mon.smithi050 (mon.0) 632 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-01-04T18:17:25.588 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.591722+0000 mon.smithi050 (mon.0) 633 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-01-04T18:17:25.588 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.601651+0000 mon.smithi050 (mon.0) 634 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2023-01-04T18:17:25.588 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:24.601728+0000 mon.smithi050 (mon.0) 635 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2023-01-04T18:17:25.588 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:24.627044+0000 mon.smithi050 (mon.0) 636 : cluster [INF] Manager daemon smithi050.emnywo is now available 2023-01-04T18:17:25.588 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:17:24.643131+0000 mgr.smithi050.emnywo (mgr.24517) 1 : cephadm [INF] inventory: adjusted host smithi098 addr 'smithi098' -> '172.21.15.98' 2023-01-04T18:17:25.589 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.653243+0000 mon.smithi050 (mon.0) 637 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:25.589 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.808978+0000 mon.smithi050 (mon.0) 638 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:17:25.589 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.811855+0000 mon.smithi050 (mon.0) 639 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:17:25.589 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.815179+0000 mon.smithi050 (mon.0) 640 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:17:25.589 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.817055+0000 mon.smithi050 (mon.0) 641 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:17:25.589 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:17:24.818453+0000 mgr.smithi050.emnywo (mgr.24517) 2 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:17:25.589 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.865000+0000 mon.smithi050 (mon.0) 642 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:17:25.589 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:24.877176+0000 mon.smithi050 (mon.0) 643 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:17:26.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.576356+0000 mon.smithi050 (mon.0) 615 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' cmd='[{"prefix": "mgr fail", "who": "smithi098.vhfzum"}]': finished 2023-01-04T18:17:26.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:24.576443+0000 mon.smithi050 (mon.0) 616 : cluster [DBG] mgrmap e25: smithi050.emnywo(active, starting, since 0.985748s), standbys: smithi098.vhfzum 2023-01-04T18:17:26.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.584498+0000 mon.smithi050 (mon.0) 617 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi050"}]: dispatch 2023-01-04T18:17:26.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.584638+0000 mon.smithi050 (mon.0) 618 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2023-01-04T18:17:26.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.585956+0000 mon.smithi050 (mon.0) 619 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi050.ezoiwl"}]: dispatch 2023-01-04T18:17:26.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.586212+0000 mon.smithi050 (mon.0) 620 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi050.kefmuy"}]: dispatch 2023-01-04T18:17:26.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.586420+0000 mon.smithi050 (mon.0) 621 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.memais"}]: dispatch 2023-01-04T18:17:26.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.586607+0000 mon.smithi050 (mon.0) 622 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.laynsk"}]: dispatch 2023-01-04T18:17:26.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.587068+0000 mon.smithi050 (mon.0) 623 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mgr metadata", "who": "smithi050.emnywo", "id": "smithi050.emnywo"}]: dispatch 2023-01-04T18:17:26.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.587263+0000 mon.smithi050 (mon.0) 624 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mgr metadata", "who": "smithi098.vhfzum", "id": "smithi098.vhfzum"}]: dispatch 2023-01-04T18:17:26.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.588980+0000 mon.smithi050 (mon.0) 625 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-01-04T18:17:26.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.589236+0000 mon.smithi050 (mon.0) 626 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-01-04T18:17:26.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.589449+0000 mon.smithi050 (mon.0) 627 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-01-04T18:17:26.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.589626+0000 mon.smithi050 (mon.0) 628 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:17:26.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.589756+0000 mon.smithi050 (mon.0) 629 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-01-04T18:17:26.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.589963+0000 mon.smithi050 (mon.0) 630 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-01-04T18:17:26.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.590823+0000 mon.smithi050 (mon.0) 631 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-01-04T18:17:26.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.591238+0000 mon.smithi050 (mon.0) 632 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-01-04T18:17:26.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.591722+0000 mon.smithi050 (mon.0) 633 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-01-04T18:17:26.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.601651+0000 mon.smithi050 (mon.0) 634 : audit [INF] from='mgr.24455 ' entity='mgr.smithi098.vhfzum' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2023-01-04T18:17:26.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:24.601728+0000 mon.smithi050 (mon.0) 635 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2023-01-04T18:17:26.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:24.627044+0000 mon.smithi050 (mon.0) 636 : cluster [INF] Manager daemon smithi050.emnywo is now available 2023-01-04T18:17:26.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:17:24.643131+0000 mgr.smithi050.emnywo (mgr.24517) 1 : cephadm [INF] inventory: adjusted host smithi098 addr 'smithi098' -> '172.21.15.98' 2023-01-04T18:17:26.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.653243+0000 mon.smithi050 (mon.0) 637 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:26.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.808978+0000 mon.smithi050 (mon.0) 638 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:17:26.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.811855+0000 mon.smithi050 (mon.0) 639 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:17:26.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.815179+0000 mon.smithi050 (mon.0) 640 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:17:26.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.817055+0000 mon.smithi050 (mon.0) 641 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:17:26.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:17:24.818453+0000 mgr.smithi050.emnywo (mgr.24517) 2 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:17:26.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.865000+0000 mon.smithi050 (mon.0) 642 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:17:26.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:24.877176+0000 mon.smithi050 (mon.0) 643 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:17:26.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:25.611493+0000 mon.smithi050 (mon.0) 644 : cluster [DBG] mgrmap e26: smithi050.emnywo(active, since 2s), standbys: smithi098.vhfzum 2023-01-04T18:17:26.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:25.639073+0000 mgr.smithi050.emnywo (mgr.24517) 3 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 1.9 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail 2023-01-04T18:17:27.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:25.611493+0000 mon.smithi050 (mon.0) 644 : cluster [DBG] mgrmap e26: smithi050.emnywo(active, since 2s), standbys: smithi098.vhfzum 2023-01-04T18:17:27.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:25.639073+0000 mgr.smithi050.emnywo (mgr.24517) 3 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 1.9 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail 2023-01-04T18:17:27.961 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:26.589762+0000 mgr.smithi050.emnywo (mgr.24517) 4 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 1.9 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail 2023-01-04T18:17:27.961 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:26.614293+0000 mon.smithi050 (mon.0) 645 : cluster [DBG] mgrmap e27: smithi050.emnywo(active, since 3s), standbys: smithi098.vhfzum 2023-01-04T18:17:28.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:26.589762+0000 mgr.smithi050.emnywo (mgr.24517) 4 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 1.9 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail 2023-01-04T18:17:28.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:26.614293+0000 mon.smithi050 (mon.0) 645 : cluster [DBG] mgrmap e27: smithi050.emnywo(active, since 3s), standbys: smithi098.vhfzum 2023-01-04T18:17:29.950 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:28.590083+0000 mgr.smithi050.emnywo (mgr.24517) 5 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 1.9 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail 2023-01-04T18:17:30.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:28.590083+0000 mgr.smithi050.emnywo (mgr.24517) 5 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 1.9 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail 2023-01-04T18:17:31.040 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:29.846621+0000 mon.smithi050 (mon.0) 646 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:31.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:29.846621+0000 mon.smithi050 (mon.0) 646 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:32.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:30.590451+0000 mgr.smithi050.emnywo (mgr.24517) 6 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 1.9 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail 2023-01-04T18:17:32.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:31.147781+0000 mon.smithi050 (mon.0) 647 : cluster [DBG] Standby manager daemon smithi098.vhfzum restarted 2023-01-04T18:17:32.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:31.147861+0000 mon.smithi050 (mon.0) 648 : cluster [DBG] Standby manager daemon smithi098.vhfzum started 2023-01-04T18:17:32.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:31.150059+0000 mon.smithi050 (mon.0) 649 : audit [DBG] from='mgr.? 172.21.15.98:0/743383373' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.vhfzum/crt"}]: dispatch 2023-01-04T18:17:32.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:31.151264+0000 mon.smithi050 (mon.0) 650 : audit [DBG] from='mgr.? 172.21.15.98:0/743383373' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-01-04T18:17:32.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:31.153614+0000 mon.smithi050 (mon.0) 651 : audit [DBG] from='mgr.? 172.21.15.98:0/743383373' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.vhfzum/key"}]: dispatch 2023-01-04T18:17:32.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:31.154074+0000 mon.smithi050 (mon.0) 652 : audit [DBG] from='mgr.? 172.21.15.98:0/743383373' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-01-04T18:17:32.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:30.590451+0000 mgr.smithi050.emnywo (mgr.24517) 6 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 1.9 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail 2023-01-04T18:17:32.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:31.147781+0000 mon.smithi050 (mon.0) 647 : cluster [DBG] Standby manager daemon smithi098.vhfzum restarted 2023-01-04T18:17:32.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:31.147861+0000 mon.smithi050 (mon.0) 648 : cluster [DBG] Standby manager daemon smithi098.vhfzum started 2023-01-04T18:17:32.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:31.150059+0000 mon.smithi050 (mon.0) 649 : audit [DBG] from='mgr.? 172.21.15.98:0/743383373' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.vhfzum/crt"}]: dispatch 2023-01-04T18:17:32.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:31.151264+0000 mon.smithi050 (mon.0) 650 : audit [DBG] from='mgr.? 172.21.15.98:0/743383373' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-01-04T18:17:32.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:31.153614+0000 mon.smithi050 (mon.0) 651 : audit [DBG] from='mgr.? 172.21.15.98:0/743383373' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.vhfzum/key"}]: dispatch 2023-01-04T18:17:32.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:31.154074+0000 mon.smithi050 (mon.0) 652 : audit [DBG] from='mgr.? 172.21.15.98:0/743383373' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-01-04T18:17:33.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:31.860316+0000 mon.smithi050 (mon.0) 653 : cluster [DBG] mgrmap e28: smithi050.emnywo(active, since 8s), standbys: smithi098.vhfzum 2023-01-04T18:17:33.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:32.371719+0000 mon.smithi050 (mon.0) 654 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:33.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:31.860316+0000 mon.smithi050 (mon.0) 653 : cluster [DBG] mgrmap e28: smithi050.emnywo(active, since 8s), standbys: smithi098.vhfzum 2023-01-04T18:17:33.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:32.371719+0000 mon.smithi050 (mon.0) 654 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:33.939 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:33 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:32.590929+0000 mgr.smithi050.emnywo (mgr.24517) 7 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 1.5 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 985 KiB/s rd, 1.2 MiB/s wr, 173 op/s 2023-01-04T18:17:33.940 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:33 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:32.929159+0000 mon.smithi050 (mon.0) 655 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:33.940 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:33 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:32.937921+0000 mon.smithi050 (mon.0) 656 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:17:34.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:33 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:32.590929+0000 mgr.smithi050.emnywo (mgr.24517) 7 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 1.5 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 985 KiB/s rd, 1.2 MiB/s wr, 173 op/s 2023-01-04T18:17:34.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:33 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:32.929159+0000 mon.smithi050 (mon.0) 655 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:34.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:33 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:32.937921+0000 mon.smithi050 (mon.0) 656 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:17:35.193 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:17:34.430444+0000 mgr.smithi050.emnywo (mgr.24517) 8 : cephadm [INF] Upgrade: Updating mgr.smithi098.vhfzum 2023-01-04T18:17:35.193 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:34.430803+0000 mon.smithi050 (mon.0) 657 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.vhfzum", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-01-04T18:17:35.193 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:34.431716+0000 mon.smithi050 (mon.0) 658 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-01-04T18:17:35.193 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:34.432672+0000 mon.smithi050 (mon.0) 659 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:17:35.193 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:17:34.433467+0000 mgr.smithi050.emnywo (mgr.24517) 9 : cephadm [INF] Deploying daemon mgr.smithi098.vhfzum on smithi098 2023-01-04T18:17:35.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:17:34.430444+0000 mgr.smithi050.emnywo (mgr.24517) 8 : cephadm [INF] Upgrade: Updating mgr.smithi098.vhfzum 2023-01-04T18:17:35.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:34.430803+0000 mon.smithi050 (mon.0) 657 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.vhfzum", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-01-04T18:17:35.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:34.431716+0000 mon.smithi050 (mon.0) 658 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-01-04T18:17:35.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:34.432672+0000 mon.smithi050 (mon.0) 659 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:17:35.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:17:34.433467+0000 mgr.smithi050.emnywo (mgr.24517) 9 : cephadm [INF] Deploying daemon mgr.smithi098.vhfzum on smithi098 2023-01-04T18:17:36.536 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:34.591309+0000 mgr.smithi050.emnywo (mgr.24517) 10 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 1.5 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 765 KiB/s rd, 924 KiB/s wr, 134 op/s 2023-01-04T18:17:36.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:34.591309+0000 mgr.smithi050.emnywo (mgr.24517) 10 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 1.5 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 765 KiB/s rd, 924 KiB/s wr, 134 op/s 2023-01-04T18:17:38.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:36.591761+0000 mgr.smithi050.emnywo (mgr.24517) 11 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 243 op/s 2023-01-04T18:17:38.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:37.915796+0000 mon.smithi050 (mon.0) 660 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:38.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:37.917364+0000 mon.smithi050 (mon.0) 661 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:17:38.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:37.919024+0000 mon.smithi050 (mon.0) 662 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:17:38.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:37.919952+0000 mon.smithi050 (mon.0) 663 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:17:38.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:36.591761+0000 mgr.smithi050.emnywo (mgr.24517) 11 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 243 op/s 2023-01-04T18:17:38.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:37.915796+0000 mon.smithi050 (mon.0) 660 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:38.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:37.917364+0000 mon.smithi050 (mon.0) 661 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:17:38.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:37.919024+0000 mon.smithi050 (mon.0) 662 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:17:38.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:37.919952+0000 mon.smithi050 (mon.0) 663 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:17:39.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:39 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:17:37.920865+0000 mgr.smithi050.emnywo (mgr.24517) 12 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:17:39.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:39 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:17:37.920865+0000 mgr.smithi050.emnywo (mgr.24517) 12 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:17:40.236 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-01-04T18:17:40.236 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-01-04T18:17:40.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:38.592091+0000 mgr.smithi050.emnywo (mgr.24517) 13 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 221 op/s 2023-01-04T18:17:40.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:38.592091+0000 mgr.smithi050.emnywo (mgr.24517) 13 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 221 op/s 2023-01-04T18:17:42.279 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:40.592407+0000 mgr.smithi050.emnywo (mgr.24517) 14 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 221 op/s 2023-01-04T18:17:42.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:40.592407+0000 mgr.smithi050.emnywo (mgr.24517) 14 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 221 op/s 2023-01-04T18:17:43.693 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:42.592828+0000 mgr.smithi050.emnywo (mgr.24517) 15 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 442 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 352 op/s 2023-01-04T18:17:43.693 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:42.661153+0000 mon.smithi050 (mon.0) 664 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:43.694 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:42.664311+0000 mon.smithi050 (mon.0) 665 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:43.694 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:42.669001+0000 mon.smithi050 (mon.0) 666 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:17:43.694 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:42.671147+0000 mon.smithi050 (mon.0) 667 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:17:43.694 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:17:42.671786+0000 mgr.smithi050.emnywo (mgr.24517) 16 : cephadm [INF] Upgrade: Setting container_image for all mgr 2023-01-04T18:17:43.694 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:42.675465+0000 mon.smithi050 (mon.0) 668 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:43.694 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:42.676208+0000 mon.smithi050 (mon.0) 669 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi050.emnywo"}]: dispatch 2023-01-04T18:17:43.694 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:42.679054+0000 mon.smithi050 (mon.0) 670 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi050.emnywo"}]': finished 2023-01-04T18:17:43.694 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:42.679748+0000 mon.smithi050 (mon.0) 671 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi098.vhfzum"}]: dispatch 2023-01-04T18:17:43.694 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:42.682541+0000 mon.smithi050 (mon.0) 672 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi098.vhfzum"}]': finished 2023-01-04T18:17:43.695 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:42.683807+0000 mon.smithi050 (mon.0) 673 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-01-04T18:17:43.895 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:42.592828+0000 mgr.smithi050.emnywo (mgr.24517) 15 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 442 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 352 op/s 2023-01-04T18:17:43.895 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:42.661153+0000 mon.smithi050 (mon.0) 664 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:43.895 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:42.664311+0000 mon.smithi050 (mon.0) 665 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:43.895 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:42.669001+0000 mon.smithi050 (mon.0) 666 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:17:43.896 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:42.671147+0000 mon.smithi050 (mon.0) 667 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:17:43.896 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:17:42.671786+0000 mgr.smithi050.emnywo (mgr.24517) 16 : cephadm [INF] Upgrade: Setting container_image for all mgr 2023-01-04T18:17:43.896 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:42.675465+0000 mon.smithi050 (mon.0) 668 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:43.896 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:42.676208+0000 mon.smithi050 (mon.0) 669 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi050.emnywo"}]: dispatch 2023-01-04T18:17:43.896 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:42.679054+0000 mon.smithi050 (mon.0) 670 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi050.emnywo"}]': finished 2023-01-04T18:17:43.896 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:42.679748+0000 mon.smithi050 (mon.0) 671 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi098.vhfzum"}]: dispatch 2023-01-04T18:17:43.896 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:42.682541+0000 mon.smithi050 (mon.0) 672 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi098.vhfzum"}]': finished 2023-01-04T18:17:43.896 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:42.683807+0000 mon.smithi050 (mon.0) 673 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-01-04T18:17:45.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:17:44.150701+0000 mgr.smithi050.emnywo (mgr.24517) 17 : cephadm [INF] Upgrade: Updating mon.smithi050 2023-01-04T18:17:45.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:44.154825+0000 mon.smithi050 (mon.0) 674 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:45.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:44.155601+0000 mon.smithi050 (mon.0) 675 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-01-04T18:17:45.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:44.156223+0000 mon.smithi050 (mon.0) 676 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-01-04T18:17:45.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:44.156868+0000 mon.smithi050 (mon.0) 677 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:17:45.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cephadm 2023-01-04T18:17:44.157488+0000 mgr.smithi050.emnywo (mgr.24517) 18 : cephadm [INF] Deploying daemon mon.smithi050 on smithi050 2023-01-04T18:17:45.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:44.181552+0000 mon.smithi050 (mon.0) 678 : cluster [DBG] Standby manager daemon smithi098.vhfzum restarted 2023-01-04T18:17:45.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: cluster 2023-01-04T18:17:44.181684+0000 mon.smithi050 (mon.0) 679 : cluster [DBG] Standby manager daemon smithi098.vhfzum started 2023-01-04T18:17:45.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:44.182873+0000 mon.smithi098 (mon.1) 65 : audit [DBG] from='mgr.? 172.21.15.98:0/2458382467' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.vhfzum/crt"}]: dispatch 2023-01-04T18:17:45.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:44.183405+0000 mon.smithi098 (mon.1) 66 : audit [DBG] from='mgr.? 172.21.15.98:0/2458382467' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-01-04T18:17:45.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:44.185353+0000 mon.smithi098 (mon.1) 67 : audit [DBG] from='mgr.? 172.21.15.98:0/2458382467' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.vhfzum/key"}]: dispatch 2023-01-04T18:17:45.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: audit 2023-01-04T18:17:44.186284+0000 mon.smithi098 (mon.1) 68 : audit [DBG] from='mgr.? 172.21.15.98:0/2458382467' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-01-04T18:17:45.469 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:17:44.150701+0000 mgr.smithi050.emnywo (mgr.24517) 17 : cephadm [INF] Upgrade: Updating mon.smithi050 2023-01-04T18:17:45.469 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:44.154825+0000 mon.smithi050 (mon.0) 674 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:45.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:44.155601+0000 mon.smithi050 (mon.0) 675 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-01-04T18:17:45.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:44.156223+0000 mon.smithi050 (mon.0) 676 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-01-04T18:17:45.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:44.156868+0000 mon.smithi050 (mon.0) 677 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:17:45.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:17:44.157488+0000 mgr.smithi050.emnywo (mgr.24517) 18 : cephadm [INF] Deploying daemon mon.smithi050 on smithi050 2023-01-04T18:17:45.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:44.181552+0000 mon.smithi050 (mon.0) 678 : cluster [DBG] Standby manager daemon smithi098.vhfzum restarted 2023-01-04T18:17:45.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:44.181684+0000 mon.smithi050 (mon.0) 679 : cluster [DBG] Standby manager daemon smithi098.vhfzum started 2023-01-04T18:17:45.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:44.182873+0000 mon.smithi098 (mon.1) 65 : audit [DBG] from='mgr.? 172.21.15.98:0/2458382467' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.vhfzum/crt"}]: dispatch 2023-01-04T18:17:45.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:44.183405+0000 mon.smithi098 (mon.1) 66 : audit [DBG] from='mgr.? 172.21.15.98:0/2458382467' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-01-04T18:17:45.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:44.185353+0000 mon.smithi098 (mon.1) 67 : audit [DBG] from='mgr.? 172.21.15.98:0/2458382467' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.vhfzum/key"}]: dispatch 2023-01-04T18:17:45.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:44.186284+0000 mon.smithi098 (mon.1) 68 : audit [DBG] from='mgr.? 172.21.15.98:0/2458382467' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-01-04T18:17:45.575 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:45 smithi050 systemd[1]: Stopping Ceph mon.smithi050 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:17:45.575 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:17:45.449+0000 7fd80242b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi050 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2023-01-04T18:17:45.575 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050[132084]: debug 2023-01-04T18:17:45.449+0000 7fd80242b700 -1 mon.smithi050@0(leader) e2 *** Got Signal Terminated *** 2023-01-04T18:17:45.849 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:45 smithi050 bash[172988]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050 2023-01-04T18:17:45.849 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:45 smithi050 bash[173040]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050" found: no such container 2023-01-04T18:17:46.130 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:45 smithi050 bash[173052]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050" found: no such container 2023-01-04T18:17:46.130 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:45 smithi050 systemd[1]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mon.smithi050.service: Succeeded. 2023-01-04T18:17:46.130 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:45 smithi050 systemd[1]: Stopped Ceph mon.smithi050 for d98671da-8c5a-11ed-821a-001a4aab830c. 2023-01-04T18:17:46.130 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:46 smithi050 systemd[1]: Starting Ceph mon.smithi050 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:17:47.124 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:46 smithi050 podman[173145]: 2023-01-04T18:17:47.124 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.041+0000 7f3468b2f880 0 set uid:gid to 167:167 (ceph:ceph) 2023-01-04T18:17:47.124 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.041+0000 7f3468b2f880 0 ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable), process ceph-mon, pid 7 2023-01-04T18:17:47.124 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.041+0000 7f3468b2f880 0 pidfile_write: ignore empty --pid-file 2023-01-04T18:17:47.125 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.048+0000 7f3468b2f880 0 load: jerasure load: lrc load: isa 2023-01-04T18:17:47.125 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: RocksDB version: 6.8.1 2023-01-04T18:17:47.125 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.125 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 bash[173145]: 0423819cbaa7a388cdeb32f30de71455f52ffc26f0dd756d1dfe794e54d5266e 2023-01-04T18:17:47.125 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-01-04T18:17:47.125 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Compile date Dec 29 2022 2023-01-04T18:17:47.125 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: DB SUMMARY 2023-01-04T18:17:47.125 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.125 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: CURRENT file: CURRENT 2023-01-04T18:17:47.125 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.125 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: IDENTITY file: IDENTITY 2023-01-04T18:17:47.126 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.126 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: MANIFEST file: MANIFEST-000008 size: 392 Bytes 2023-01-04T18:17:47.126 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.126 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi050/store.db dir, Total Num: 1, files: 000014.sst 2023-01-04T18:17:47.126 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.126 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi050/store.db: 000012.log size: 6155873 ; 2023-01-04T18:17:47.126 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.126 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.error_if_exists: 0 2023-01-04T18:17:47.126 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.create_if_missing: 0 2023-01-04T18:17:47.126 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.paranoid_checks: 1 2023-01-04T18:17:47.128 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.env: 0x56470b1c7000 2023-01-04T18:17:47.128 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.fs: Posix File System 2023-01-04T18:17:47.128 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.info_log: 0x56470cc08520 2023-01-04T18:17:47.128 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.max_file_opening_threads: 16 2023-01-04T18:17:47.128 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.statistics: (nil) 2023-01-04T18:17:47.128 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.use_fsync: 0 2023-01-04T18:17:47.128 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.max_log_file_size: 0 2023-01-04T18:17:47.128 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-01-04T18:17:47.128 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.log_file_time_to_roll: 0 2023-01-04T18:17:47.129 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.keep_log_file_num: 1000 2023-01-04T18:17:47.129 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.recycle_log_file_num: 0 2023-01-04T18:17:47.129 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.allow_fallocate: 1 2023-01-04T18:17:47.129 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.allow_mmap_reads: 0 2023-01-04T18:17:47.129 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.allow_mmap_writes: 0 2023-01-04T18:17:47.129 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.use_direct_reads: 0 2023-01-04T18:17:47.129 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-01-04T18:17:47.129 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.create_missing_column_families: 0 2023-01-04T18:17:47.129 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.db_log_dir: 2023-01-04T18:17:47.129 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi050/store.db 2023-01-04T18:17:47.129 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.table_cache_numshardbits: 6 2023-01-04T18:17:47.130 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.max_subcompactions: 1 2023-01-04T18:17:47.130 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.max_background_flushes: -1 2023-01-04T18:17:47.130 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-01-04T18:17:47.130 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-01-04T18:17:47.130 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-01-04T18:17:47.130 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-01-04T18:17:47.130 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-01-04T18:17:47.130 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.advise_random_on_open: 1 2023-01-04T18:17:47.130 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.db_write_buffer_size: 0 2023-01-04T18:17:47.130 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.write_buffer_manager: 0x56470d8f8150 2023-01-04T18:17:47.130 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-01-04T18:17:47.131 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-01-04T18:17:47.131 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-01-04T18:17:47.131 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.use_adaptive_mutex: 0 2023-01-04T18:17:47.131 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.rate_limiter: (nil) 2023-01-04T18:17:47.131 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-01-04T18:17:47.131 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.wal_recovery_mode: 2 2023-01-04T18:17:47.131 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.enable_thread_tracking: 0 2023-01-04T18:17:47.131 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.enable_pipelined_write: 0 2023-01-04T18:17:47.131 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.unordered_write: 0 2023-01-04T18:17:47.131 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-01-04T18:17:47.131 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-01-04T18:17:47.132 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-01-04T18:17:47.132 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-01-04T18:17:47.132 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.row_cache: None 2023-01-04T18:17:47.132 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.wal_filter: None 2023-01-04T18:17:47.132 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-01-04T18:17:47.132 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.allow_ingest_behind: 0 2023-01-04T18:17:47.132 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.preserve_deletes: 0 2023-01-04T18:17:47.132 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.two_write_queues: 0 2023-01-04T18:17:47.132 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.manual_wal_flush: 0 2023-01-04T18:17:47.132 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.atomic_flush: 0 2023-01-04T18:17:47.132 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-01-04T18:17:47.132 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.persist_stats_to_disk: 0 2023-01-04T18:17:47.133 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.write_dbid_to_manifest: 0 2023-01-04T18:17:47.133 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.log_readahead_size: 0 2023-01-04T18:17:47.133 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2023-01-04T18:17:47.133 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.max_background_jobs: 2 2023-01-04T18:17:47.133 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.max_background_compactions: -1 2023-01-04T18:17:47.133 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-01-04T18:17:47.133 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-01-04T18:17:47.133 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.delayed_write_rate : 16777216 2023-01-04T18:17:47.133 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.max_total_wal_size: 0 2023-01-04T18:17:47.133 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-01-04T18:17:47.133 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.stats_dump_period_sec: 600 2023-01-04T18:17:47.134 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.stats_persist_period_sec: 600 2023-01-04T18:17:47.134 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-01-04T18:17:47.134 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.max_open_files: -1 2023-01-04T18:17:47.134 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.bytes_per_sync: 0 2023-01-04T18:17:47.134 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-01-04T18:17:47.134 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.strict_bytes_per_sync: 0 2023-01-04T18:17:47.134 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Options.compaction_readahead_size: 0 2023-01-04T18:17:47.134 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Compression algorithms supported: 2023-01-04T18:17:47.134 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-01-04T18:17:47.134 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: kZSTD supported: 0 2023-01-04T18:17:47.134 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: kXpressCompression supported: 0 2023-01-04T18:17:47.134 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: kLZ4HCCompression supported: 1 2023-01-04T18:17:47.135 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: kLZ4Compression supported: 1 2023-01-04T18:17:47.135 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: kBZip2Compression supported: 0 2023-01-04T18:17:47.135 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: kZlibCompression supported: 1 2023-01-04T18:17:47.135 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: kSnappyCompression supported: 1 2023-01-04T18:17:47.135 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.049+0000 7f3468b2f880 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-01-04T18:17:47.135 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi050/store.db/MANIFEST-000008 2023-01-04T18:17:47.135 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.135 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2023-01-04T18:17:47.135 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.135 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-01-04T18:17:47.135 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.merge_operator: 2023-01-04T18:17:47.136 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.compaction_filter: None 2023-01-04T18:17:47.136 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.compaction_filter_factory: None 2023-01-04T18:17:47.136 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-01-04T18:17:47.136 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.table_factory: BlockBasedTable 2023-01-04T18:17:47.136 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56470cba7d10) 2023-01-04T18:17:47.136 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cache_index_and_filter_blocks: 1 2023-01-04T18:17:47.136 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cache_index_and_filter_blocks_with_high_priority: 0 2023-01-04T18:17:47.136 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: pin_l0_filter_and_index_blocks_in_cache: 0 2023-01-04T18:17:47.136 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: pin_top_level_index_and_filter: 1 2023-01-04T18:17:47.136 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: index_type: 0 2023-01-04T18:17:47.137 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: data_block_index_type: 0 2023-01-04T18:17:47.137 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: index_shortening: 1 2023-01-04T18:17:47.137 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: data_block_hash_table_util_ratio: 0.750000 2023-01-04T18:17:47.137 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: hash_index_allow_collision: 1 2023-01-04T18:17:47.137 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: checksum: 1 2023-01-04T18:17:47.137 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: no_block_cache: 0 2023-01-04T18:17:47.137 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: block_cache: 0x56470cbe0f10 2023-01-04T18:17:47.137 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: block_cache_name: BinnedLRUCache 2023-01-04T18:17:47.137 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: block_cache_options: 2023-01-04T18:17:47.137 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: capacity : 536870912 2023-01-04T18:17:47.137 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: num_shard_bits : 4 2023-01-04T18:17:47.138 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: strict_capacity_limit : 0 2023-01-04T18:17:47.138 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: high_pri_pool_ratio: 0.000 2023-01-04T18:17:47.138 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: block_cache_compressed: (nil) 2023-01-04T18:17:47.138 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: persistent_cache: (nil) 2023-01-04T18:17:47.138 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: block_size: 4096 2023-01-04T18:17:47.138 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: block_size_deviation: 10 2023-01-04T18:17:47.138 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: block_restart_interval: 16 2023-01-04T18:17:47.138 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: index_block_restart_interval: 1 2023-01-04T18:17:47.138 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: metadata_block_size: 4096 2023-01-04T18:17:47.138 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: partition_filters: 0 2023-01-04T18:17:47.138 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: use_delta_encoding: 1 2023-01-04T18:17:47.139 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: filter_policy: rocksdb.BuiltinBloomFilter 2023-01-04T18:17:47.139 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: whole_key_filtering: 1 2023-01-04T18:17:47.139 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: verify_compression: 0 2023-01-04T18:17:47.139 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: read_amp_bytes_per_bit: 0 2023-01-04T18:17:47.139 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: format_version: 2 2023-01-04T18:17:47.139 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: enable_index_compression: 1 2023-01-04T18:17:47.139 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: block_align: 0 2023-01-04T18:17:47.139 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.139 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.write_buffer_size: 33554432 2023-01-04T18:17:47.139 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.max_write_buffer_number: 2 2023-01-04T18:17:47.139 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.compression: NoCompression 2023-01-04T18:17:47.139 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.bottommost_compression: Disabled 2023-01-04T18:17:47.140 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.prefix_extractor: nullptr 2023-01-04T18:17:47.140 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-01-04T18:17:47.140 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.num_levels: 7 2023-01-04T18:17:47.140 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-01-04T18:17:47.140 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-01-04T18:17:47.140 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-01-04T18:17:47.140 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-01-04T18:17:47.140 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-01-04T18:17:47.140 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-01-04T18:17:47.140 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-01-04T18:17:47.141 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-01-04T18:17:47.141 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-01-04T18:17:47.141 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.compression_opts.window_bits: -14 2023-01-04T18:17:47.141 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.compression_opts.level: 32767 2023-01-04T18:17:47.141 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.compression_opts.strategy: 0 2023-01-04T18:17:47.141 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-01-04T18:17:47.141 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-01-04T18:17:47.141 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.compression_opts.enabled: false 2023-01-04T18:17:47.141 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-01-04T18:17:47.141 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-01-04T18:17:47.141 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-01-04T18:17:47.141 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.target_file_size_base: 67108864 2023-01-04T18:17:47.142 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.target_file_size_multiplier: 1 2023-01-04T18:17:47.142 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-01-04T18:17:47.142 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-01-04T18:17:47.142 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-01-04T18:17:47.142 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-01-04T18:17:47.142 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-01-04T18:17:47.142 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-01-04T18:17:47.142 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-01-04T18:17:47.142 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-01-04T18:17:47.142 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-01-04T18:17:47.142 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-01-04T18:17:47.142 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-01-04T18:17:47.142 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-01-04T18:17:47.143 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.arena_block_size: 4194304 2023-01-04T18:17:47.143 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-01-04T18:17:47.143 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-01-04T18:17:47.143 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-01-04T18:17:47.143 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.disable_auto_compactions: 0 2023-01-04T18:17:47.143 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-01-04T18:17:47.143 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-01-04T18:17:47.143 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-01-04T18:17:47.143 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-01-04T18:17:47.143 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-01-04T18:17:47.144 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-01-04T18:17:47.144 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-01-04T18:17:47.144 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-01-04T18:17:47.144 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-01-04T18:17:47.144 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-01-04T18:17:47.144 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.table_properties_collectors: 2023-01-04T18:17:47.144 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.inplace_update_support: 0 2023-01-04T18:17:47.144 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-01-04T18:17:47.144 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-01-04T18:17:47.144 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-01-04T18:17:47.145 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.memtable_huge_page_size: 0 2023-01-04T18:17:47.145 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.bloom_locality: 0 2023-01-04T18:17:47.145 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.max_successive_merges: 0 2023-01-04T18:17:47.145 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-01-04T18:17:47.145 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.paranoid_file_checks: 0 2023-01-04T18:17:47.145 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.force_consistency_checks: 0 2023-01-04T18:17:47.145 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.report_bg_io_stats: 0 2023-01-04T18:17:47.145 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.ttl: 2592000 2023-01-04T18:17:47.145 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: Options.periodic_compaction_seconds: 0 2023-01-04T18:17:47.145 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: [version_set.cc:3291] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-01-04T18:17:47.145 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi050/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 16, last_sequence is 6552, log_number is 12,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-01-04T18:17:47.145 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.146 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.050+0000 7f3468b2f880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 12 2023-01-04T18:17:47.146 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.146 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.051+0000 7f3468b2f880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1672856267052409, "job": 1, "event": "recovery_started", "log_files": [12]} 2023-01-04T18:17:47.146 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.051+0000 7f3468b2f880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #12 mode 2 2023-01-04T18:17:47.146 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.058+0000 7f3468b2f880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-01-04T18:17:47.146 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.065+0000 7f3468b2f880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1672856267067228, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 16, "file_size": 6051821, "table_properties": {"data_size": 6041978, "index_size": 7931, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 1093, "raw_key_size": 9033, "raw_average_key_size": 21, "raw_value_size": 6029714, "raw_average_value_size": 14459, "num_data_blocks": 252, "num_entries": 417, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1672856267, "oldest_key_time": 3, "file_creation_time": 0}} 2023-01-04T18:17:47.146 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.065+0000 7f3468b2f880 4 rocksdb: [version_set.cc:3826] Creating manifest 17 2023-01-04T18:17:47.146 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.146 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.066+0000 7f3468b2f880 4 rocksdb: [version_set.cc:3291] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-01-04T18:17:47.146 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.066+0000 7f3468b2f880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1672856267067852, "job": 1, "event": "recovery_finished"} 2023-01-04T18:17:47.146 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.068+0000 7f3468b2f880 4 rocksdb: DB pointer 0x56470ccab800 2023-01-04T18:17:47.147 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.068+0000 7f344f93f700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2023-01-04T18:17:47.147 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.068+0000 7f344f93f700 4 rocksdb: [db_impl/db_impl.cc:851] 2023-01-04T18:17:47.147 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: ** DB Stats ** 2023-01-04T18:17:47.147 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Uptime(secs): 0.0 total, 0.0 interval 2023-01-04T18:17:47.147 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-01-04T18:17:47.147 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-01-04T18:17:47.147 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-01-04T18:17:47.147 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-01-04T18:17:47.147 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-01-04T18:17:47.147 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-01-04T18:17:47.148 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.148 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: ** Compaction Stats [default] ** 2023-01-04T18:17:47.148 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-04T18:17:47.148 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-04T18:17:47.148 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: L0 1/0 5.77 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 765.1 0.01 0.00 1 0.008 0 0 2023-01-04T18:17:47.148 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: L6 1/0 18.03 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-01-04T18:17:47.148 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Sum 2/0 23.80 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 765.1 0.01 0.00 1 0.008 0 0 2023-01-04T18:17:47.148 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 765.1 0.01 0.00 1 0.008 0 0 2023-01-04T18:17:47.148 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.148 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: ** Compaction Stats [default] ** 2023-01-04T18:17:47.148 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-04T18:17:47.149 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-04T18:17:47.149 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 765.1 0.01 0.00 1 0.008 0 0 2023-01-04T18:17:47.149 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Uptime(secs): 0.0 total, 0.0 interval 2023-01-04T18:17:47.149 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Flush(GB): cumulative 0.006, interval 0.006 2023-01-04T18:17:47.149 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: AddFile(GB): cumulative 0.000, interval 0.000 2023-01-04T18:17:47.149 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: AddFile(Total Files): cumulative 0, interval 0 2023-01-04T18:17:47.149 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: AddFile(L0 Files): cumulative 0, interval 0 2023-01-04T18:17:47.149 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: AddFile(Keys): cumulative 0, interval 0 2023-01-04T18:17:47.149 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Cumulative compaction: 0.01 GB write, 314.85 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-04T18:17:47.149 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Interval compaction: 0.01 GB write, 314.85 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-04T18:17:47.149 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-01-04T18:17:47.150 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.150 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: ** File Read Latency Histogram By Level [default] ** 2023-01-04T18:17:47.150 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.150 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: ** Compaction Stats [default] ** 2023-01-04T18:17:47.150 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-04T18:17:47.150 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-04T18:17:47.150 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: L0 1/0 5.77 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 765.1 0.01 0.00 1 0.008 0 0 2023-01-04T18:17:47.150 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: L6 1/0 18.03 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-01-04T18:17:47.150 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Sum 2/0 23.80 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 765.1 0.01 0.00 1 0.008 0 0 2023-01-04T18:17:47.150 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-01-04T18:17:47.150 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.151 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: ** Compaction Stats [default] ** 2023-01-04T18:17:47.151 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-04T18:17:47.151 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-04T18:17:47.151 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 765.1 0.01 0.00 1 0.008 0 0 2023-01-04T18:17:47.151 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Uptime(secs): 0.0 total, 0.0 interval 2023-01-04T18:17:47.151 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Flush(GB): cumulative 0.006, interval 0.000 2023-01-04T18:17:47.151 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: AddFile(GB): cumulative 0.000, interval 0.000 2023-01-04T18:17:47.151 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: AddFile(Total Files): cumulative 0, interval 0 2023-01-04T18:17:47.151 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: AddFile(L0 Files): cumulative 0, interval 0 2023-01-04T18:17:47.151 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: AddFile(Keys): cumulative 0, interval 0 2023-01-04T18:17:47.151 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Cumulative compaction: 0.01 GB write, 313.91 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-04T18:17:47.152 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-04T18:17:47.152 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-01-04T18:17:47.152 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.152 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: ** File Read Latency Histogram By Level [default] ** 2023-01-04T18:17:47.152 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.152 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.069+0000 7f3468b2f880 0 starting mon.smithi050 rank 0 at public addrs [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] at bind addrs [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi050 fsid d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:17:47.152 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.070+0000 7f3468b2f880 1 mon.smithi050@-1(???) e2 preinit fsid d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:17:47.152 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.071+0000 7f3468b2f880 0 mon.smithi050@-1(???).mds e13 new map 2023-01-04T18:17:47.152 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.071+0000 7f3468b2f880 0 mon.smithi050@-1(???).mds e13 print_map 2023-01-04T18:17:47.152 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: e13 2023-01-04T18:17:47.153 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:17:47.153 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:17:47.153 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: legacy client fscid: 1 2023-01-04T18:17:47.153 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.153 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Filesystem 'cephfs' (1) 2023-01-04T18:17:47.153 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: fs_name cephfs 2023-01-04T18:17:47.153 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: epoch 10 2023-01-04T18:17:47.153 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: flags 32 2023-01-04T18:17:47.153 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:17:47.153 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: modified 2023-01-04T18:14:43.958806+0000 2023-01-04T18:17:47.153 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: tableserver 0 2023-01-04T18:17:47.153 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: root 0 2023-01-04T18:17:47.154 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: session_timeout 60 2023-01-04T18:17:47.154 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: session_autoclose 300 2023-01-04T18:17:47.154 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: max_file_size 1099511627776 2023-01-04T18:17:47.154 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: required_client_features {} 2023-01-04T18:17:47.154 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: last_failure 0 2023-01-04T18:17:47.154 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: last_failure_osd_epoch 0 2023-01-04T18:17:47.154 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:17:47.154 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: max_mds 1 2023-01-04T18:17:47.154 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: in 0 2023-01-04T18:17:47.154 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: up {0=14430} 2023-01-04T18:17:47.154 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: failed 2023-01-04T18:17:47.155 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: damaged 2023-01-04T18:17:47.155 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: stopped 2023-01-04T18:17:47.155 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: data_pools [3] 2023-01-04T18:17:47.155 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: metadata_pool 2 2023-01-04T18:17:47.155 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: inline_data enabled 2023-01-04T18:17:47.155 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: balancer 2023-01-04T18:17:47.155 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: standby_count_wanted 1 2023-01-04T18:17:47.155 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: [mds.cephfs.smithi050.ezoiwl{0:14430} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:17:47.155 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: [mds.cephfs.smithi098.memais{0:24291} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.98:6824/1196398070,v1:172.21.15.98:6825/1196398070] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:17:47.155 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.155 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.156 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: Standby daemons: 2023-01-04T18:17:47.156 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.156 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: [mds.cephfs.smithi050.kefmuy{-1:14440} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:17:47.156 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: [mds.cephfs.smithi098.laynsk{-1:24297} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:17:47.156 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: 2023-01-04T18:17:47.156 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.071+0000 7f3468b2f880 0 mon.smithi050@-1(???).osd e45 crush map has features 3314933000852226048, adjusting msgr requires 2023-01-04T18:17:47.156 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.071+0000 7f3468b2f880 0 mon.smithi050@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2023-01-04T18:17:47.156 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.071+0000 7f3468b2f880 0 mon.smithi050@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2023-01-04T18:17:47.156 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.071+0000 7f3468b2f880 0 mon.smithi050@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2023-01-04T18:17:47.156 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:17:44.150701+0000 mgr.smithi050.emnywo (mgr.24517) 17 : cephadm [INF] Upgrade: Updating mon.smithi050 2023-01-04T18:17:47.156 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:44.154825+0000 mon.smithi050 (mon.0) 674 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:47.157 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:44.155601+0000 mon.smithi050 (mon.0) 675 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-01-04T18:17:47.157 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:44.156223+0000 mon.smithi050 (mon.0) 676 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-01-04T18:17:47.157 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:44.156868+0000 mon.smithi050 (mon.0) 677 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:17:47.157 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:17:44.157488+0000 mgr.smithi050.emnywo (mgr.24517) 18 : cephadm [INF] Deploying daemon mon.smithi050 on smithi050 2023-01-04T18:17:47.157 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:17:44.181552+0000 mon.smithi050 (mon.0) 678 : cluster [DBG] Standby manager daemon smithi098.vhfzum restarted 2023-01-04T18:17:47.157 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:17:44.181684+0000 mon.smithi050 (mon.0) 679 : cluster [DBG] Standby manager daemon smithi098.vhfzum started 2023-01-04T18:17:47.157 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:44.182873+0000 mon.smithi098 (mon.1) 65 : audit [DBG] from='mgr.? 172.21.15.98:0/2458382467' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.vhfzum/crt"}]: dispatch 2023-01-04T18:17:47.157 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:44.183405+0000 mon.smithi098 (mon.1) 66 : audit [DBG] from='mgr.? 172.21.15.98:0/2458382467' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-01-04T18:17:47.157 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:44.185353+0000 mon.smithi098 (mon.1) 67 : audit [DBG] from='mgr.? 172.21.15.98:0/2458382467' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.vhfzum/key"}]: dispatch 2023-01-04T18:17:47.157 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:44.186284+0000 mon.smithi098 (mon.1) 68 : audit [DBG] from='mgr.? 172.21.15.98:0/2458382467' entity='mgr.smithi098.vhfzum' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-01-04T18:17:47.157 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:17:47.072+0000 7f3468b2f880 1 mon.smithi050@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2023-01-04T18:17:47.158 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:47 smithi050 systemd[1]: Started Ceph mon.smithi050 for d98671da-8c5a-11ed-821a-001a4aab830c. 2023-01-04T18:17:48.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:45.455265+0000 mon.smithi098 (mon.1) 69 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi050"}]: dispatch 2023-01-04T18:17:48.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:45.455459+0000 mon.smithi098 (mon.1) 70 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2023-01-04T18:17:48.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:46.593568+0000 mgr.smithi050.emnywo (mgr.24517) 20 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 362 op/s 2023-01-04T18:17:48.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:48.486471+0000 mon.smithi050 (mon.0) 1 : cluster [INF] mon.smithi050 calling monitor election 2023-01-04T18:17:48.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:48.488783+0000 mon.smithi050 (mon.0) 2 : cluster [INF] mon.smithi050 is new leader, mons smithi050,smithi098 in quorum (ranks 0,1) 2023-01-04T18:17:48.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:48.493859+0000 mon.smithi050 (mon.0) 3 : cluster [DBG] monmap e2: 2 mons at {smithi050=[v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0],smithi098=[v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0]} 2023-01-04T18:17:48.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:48.494604+0000 mon.smithi050 (mon.0) 4 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 1 up:standby-replay 2 up:standby 2023-01-04T18:17:48.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:48.494660+0000 mon.smithi050 (mon.0) 5 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2023-01-04T18:17:48.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:48.496038+0000 mon.smithi050 (mon.0) 6 : cluster [DBG] mgrmap e29: smithi050.emnywo(active, since 24s), standbys: smithi098.vhfzum 2023-01-04T18:17:48.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:48.503070+0000 mon.smithi050 (mon.0) 7 : cluster [WRN] Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-01-04T18:17:48.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:48.503097+0000 mon.smithi050 (mon.0) 8 : cluster [WRN] [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-01-04T18:17:48.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:48.503114+0000 mon.smithi050 (mon.0) 9 : cluster [WRN] fs cephfs has deprecated feature inline_data enabled. 2023-01-04T18:17:48.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:48.505429+0000 mon.smithi050 (mon.0) 10 : audit [INF] from='mgr.24517 ' entity='' 2023-01-04T18:17:48.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:48.507320+0000 mon.smithi098 (mon.1) 71 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:17:48.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:48.508546+0000 mon.smithi098 (mon.1) 72 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:17:48.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:48.509907+0000 mon.smithi098 (mon.1) 73 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:17:49.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:45.455265+0000 mon.smithi098 (mon.1) 69 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi050"}]: dispatch 2023-01-04T18:17:49.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:45.455459+0000 mon.smithi098 (mon.1) 70 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2023-01-04T18:17:49.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:17:46.593568+0000 mgr.smithi050.emnywo (mgr.24517) 20 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 362 op/s 2023-01-04T18:17:49.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:17:48.486471+0000 mon.smithi050 (mon.0) 1 : cluster [INF] mon.smithi050 calling monitor election 2023-01-04T18:17:49.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:17:48.488783+0000 mon.smithi050 (mon.0) 2 : cluster [INF] mon.smithi050 is new leader, mons smithi050,smithi098 in quorum (ranks 0,1) 2023-01-04T18:17:49.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:17:48.493859+0000 mon.smithi050 (mon.0) 3 : cluster [DBG] monmap e2: 2 mons at {smithi050=[v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0],smithi098=[v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0]} 2023-01-04T18:17:49.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:17:48.494604+0000 mon.smithi050 (mon.0) 4 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 1 up:standby-replay 2 up:standby 2023-01-04T18:17:49.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:17:48.494660+0000 mon.smithi050 (mon.0) 5 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2023-01-04T18:17:49.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:17:48.496038+0000 mon.smithi050 (mon.0) 6 : cluster [DBG] mgrmap e29: smithi050.emnywo(active, since 24s), standbys: smithi098.vhfzum 2023-01-04T18:17:49.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:17:48.503070+0000 mon.smithi050 (mon.0) 7 : cluster [WRN] Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-01-04T18:17:49.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:17:48.503097+0000 mon.smithi050 (mon.0) 8 : cluster [WRN] [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-01-04T18:17:49.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:17:48.503114+0000 mon.smithi050 (mon.0) 9 : cluster [WRN] fs cephfs has deprecated feature inline_data enabled. 2023-01-04T18:17:49.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:48.505429+0000 mon.smithi050 (mon.0) 10 : audit [INF] from='mgr.24517 ' entity='' 2023-01-04T18:17:49.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:48.507320+0000 mon.smithi098 (mon.1) 71 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:17:49.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:48.508546+0000 mon.smithi098 (mon.1) 72 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:17:49.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:48.509907+0000 mon.smithi098 (mon.1) 73 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:17:49.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:49 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cephadm 2023-01-04T18:17:48.510607+0000 mgr.smithi050.emnywo (mgr.24517) 21 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:17:49.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:49 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:48.593935+0000 mgr.smithi050.emnywo (mgr.24517) 22 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 241 op/s 2023-01-04T18:17:50.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:49 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:17:48.510607+0000 mgr.smithi050.emnywo (mgr.24517) 21 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:17:50.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:49 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:17:48.593935+0000 mgr.smithi050.emnywo (mgr.24517) 22 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 241 op/s 2023-01-04T18:17:52.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:17:50.594265+0000 mgr.smithi050.emnywo (mgr.24517) 23 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 241 op/s 2023-01-04T18:17:52.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:51 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:50.594265+0000 mgr.smithi050.emnywo (mgr.24517) 23 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 241 op/s 2023-01-04T18:17:52.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.257+0000 7f94757e2700 1 -- 172.21.15.50:0/1784228920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94700f6a40 msgr2=0x7f94700f6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:52.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.257+0000 7f94757e2700 1 --2- 172.21.15.50:0/1784228920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94700f6a40 0x7f94700f6e60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f9460004660 tx=0x7f9460009b30).stop 2023-01-04T18:17:52.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.257+0000 7f94757e2700 1 -- 172.21.15.50:0/1784228920 shutdown_connections 2023-01-04T18:17:52.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.257+0000 7f94757e2700 1 --2- 172.21.15.50:0/1784228920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94700f5790 0x7f94700f5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:52.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.257+0000 7f94757e2700 1 --2- 172.21.15.50:0/1784228920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94700f6a40 0x7f94700f6e60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:52.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.257+0000 7f94757e2700 1 -- 172.21.15.50:0/1784228920 >> 172.21.15.50:0/1784228920 conn(0x7f94700f0320 msgr2=0x7f94700f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:52.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.257+0000 7f94757e2700 1 -- 172.21.15.50:0/1784228920 shutdown_connections 2023-01-04T18:17:52.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.257+0000 7f94757e2700 1 -- 172.21.15.50:0/1784228920 wait complete. 2023-01-04T18:17:52.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.258+0000 7f94757e2700 1 Processor -- start 2023-01-04T18:17:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.258+0000 7f94757e2700 1 -- start start 2023-01-04T18:17:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.259+0000 7f94757e2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94700f5790 0x7f94700fe330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.259+0000 7f94757e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94700f6a40 0x7f94700fc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.259+0000 7f94757e2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94700fcd10 con 0x7f94700f6a40 2023-01-04T18:17:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.259+0000 7f94757e2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94700fce50 con 0x7f94700f5790 2023-01-04T18:17:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.259+0000 7f946f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94700f6a40 0x7f94700fc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:52.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.259+0000 7f946ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94700f5790 0x7f94700fe330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:52.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.259+0000 7f946f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94700f6a40 0x7f94700fc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35368/0 (socket says 172.21.15.50:35368) 2023-01-04T18:17:52.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.259+0000 7f946f7fe700 1 -- 172.21.15.50:0/1453972938 learned_addr learned my addr 172.21.15.50:0/1453972938 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:17:52.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.259+0000 7f946ffff700 1 -- 172.21.15.50:0/1453972938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94700f6a40 msgr2=0x7f94700fc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:52.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.259+0000 7f946ffff700 1 --2- 172.21.15.50:0/1453972938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94700f6a40 0x7f94700fc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:52.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.259+0000 7f946ffff700 1 -- 172.21.15.50:0/1453972938 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9460005040 con 0x7f94700f5790 2023-01-04T18:17:52.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.259+0000 7f946ffff700 1 --2- 172.21.15.50:0/1453972938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94700f5790 0x7f94700fe330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f947005eba0 tx=0x7f946000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:52.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.260+0000 7f946cff9700 1 -- 172.21.15.50:0/1453972938 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9460019070 con 0x7f94700f5790 2023-01-04T18:17:52.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.260+0000 7f946cff9700 1 -- 172.21.15.50:0/1453972938 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9460013e70 con 0x7f94700f5790 2023-01-04T18:17:52.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.260+0000 7f94757e2700 1 -- 172.21.15.50:0/1453972938 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94700fd0d0 con 0x7f94700f5790 2023-01-04T18:17:52.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.260+0000 7f946cff9700 1 -- 172.21.15.50:0/1453972938 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9460014d00 con 0x7f94700f5790 2023-01-04T18:17:52.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.260+0000 7f94757e2700 1 -- 172.21.15.50:0/1453972938 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94700fd5b0 con 0x7f94700f5790 2023-01-04T18:17:52.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.261+0000 7f94757e2700 1 -- 172.21.15.50:0/1453972938 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9470045ad0 con 0x7f94700f5790 2023-01-04T18:17:52.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.261+0000 7f946cff9700 1 -- 172.21.15.50:0/1453972938 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 29) v1 ==== 77020+0+0 (secure 0 0 0) 0x7f94600079c0 con 0x7f94700f5790 2023-01-04T18:17:52.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.262+0000 7f946cff9700 1 --2- 172.21.15.50:0/1453972938 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f9458060cc0 0x7f9458063180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:52.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.262+0000 7f946cff9700 1 -- 172.21.15.50:0/1453972938 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f946007d280 con 0x7f94700f5790 2023-01-04T18:17:52.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.262+0000 7f946f7fe700 1 --2- 172.21.15.50:0/1453972938 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f9458060cc0 0x7f9458063180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:52.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.262+0000 7f946f7fe700 1 --2- 172.21.15.50:0/1453972938 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f9458060cc0 0x7f9458063180 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f94640041d0 tx=0x7f946400b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:52.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.266+0000 7f946cff9700 1 -- 172.21.15.50:0/1453972938 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f946004d7d0 con 0x7f94700f5790 2023-01-04T18:17:52.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.532+0000 7f94757e2700 1 -- 172.21.15.50:0/1453972938 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9470057f10 con 0x7f9458060cc0 2023-01-04T18:17:52.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.534+0000 7f946cff9700 1 -- 172.21.15.50:0/1453972938 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f9470057f10 con 0x7f9458060cc0 2023-01-04T18:17:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.536+0000 7f94757e2700 1 -- 172.21.15.50:0/1453972938 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f9458060cc0 msgr2=0x7f9458063180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:52.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.536+0000 7f94757e2700 1 --2- 172.21.15.50:0/1453972938 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f9458060cc0 0x7f9458063180 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f94640041d0 tx=0x7f946400b040).stop 2023-01-04T18:17:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.536+0000 7f94757e2700 1 -- 172.21.15.50:0/1453972938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94700f5790 msgr2=0x7f94700fe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.536+0000 7f94757e2700 1 --2- 172.21.15.50:0/1453972938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94700f5790 0x7f94700fe330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f947005eba0 tx=0x7f946000b040).stop 2023-01-04T18:17:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.536+0000 7f94757e2700 1 -- 172.21.15.50:0/1453972938 shutdown_connections 2023-01-04T18:17:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.536+0000 7f94757e2700 1 --2- 172.21.15.50:0/1453972938 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f9458060cc0 0x7f9458063180 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.536+0000 7f94757e2700 1 --2- 172.21.15.50:0/1453972938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94700f5790 0x7f94700fe330 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.536+0000 7f94757e2700 1 --2- 172.21.15.50:0/1453972938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94700f6a40 0x7f94700fc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.536+0000 7f94757e2700 1 -- 172.21.15.50:0/1453972938 >> 172.21.15.50:0/1453972938 conn(0x7f94700f0320 msgr2=0x7f94700fa1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.536+0000 7f94757e2700 1 -- 172.21.15.50:0/1453972938 shutdown_connections 2023-01-04T18:17:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.536+0000 7f94757e2700 1 -- 172.21.15.50:0/1453972938 wait complete. 2023-01-04T18:17:52.555 INFO:teuthology.orchestra.run.smithi050.stdout:true 2023-01-04T18:17:52.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.673+0000 7fd12c56f700 1 -- 172.21.15.50:0/3955063205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1240f5f60 msgr2=0x7fd1240f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:52.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.673+0000 7fd12c56f700 1 --2- 172.21.15.50:0/3955063205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1240f5f60 0x7fd1240f63e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fd114004660 tx=0x7fd114009b30).stop 2023-01-04T18:17:52.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.673+0000 7fd12c56f700 1 -- 172.21.15.50:0/3955063205 shutdown_connections 2023-01-04T18:17:52.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.673+0000 7fd12c56f700 1 --2- 172.21.15.50:0/3955063205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1240f5f60 0x7fd1240f63e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:52.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.673+0000 7fd12c56f700 1 --2- 172.21.15.50:0/3955063205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1240f4d60 0x7fd1240f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-01-04T18:17:52.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.673+0000 7fd12c56f700 1 -- 172.21.15.50:0/3955063205 >> 172.21.15.50:0/3955063205 conn(0x7fd1240f04c0 msgr2=0x7fd1240f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:52.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.673+0000 7fd12c56f700 1 -- 172.21.15.50:0/3955063205 shutdown_connections 2023-01-04T18:17:52.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.673+0000 7fd12c56f700 1 -- 172.21.15.50:0/3955063205 wait complete. 2023-01-04T18:17:52.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.674+0000 7fd12c56f700 1 Processor -- start 2023-01-04T18:17:52.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.674+0000 7fd12c56f700 1 -- start start 2023-01-04T18:17:52.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.674+0000 7fd12c56f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1240f4d60 0x7fd124106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:52.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.674+0000 7fd12c56f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1240f5f60 0x7fd124107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:52.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.674+0000 7fd12c56f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd124107a60 con 0x7fd1240f5f60 2023-01-04T18:17:52.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.674+0000 7fd12c56f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd124108310 con 0x7fd1240f4d60 2023-01-04T18:17:52.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.674+0000 7fd12a30b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1240f4d60 0x7fd124106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:52.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.674+0000 7fd129b0a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1240f5f60 0x7fd124107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:52.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.674+0000 7fd12a30b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1240f4d60 0x7fd124106f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.50:55622/0 (socket says 172.21.15.50:55622) 2023-01-04T18:17:52.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.674+0000 7fd12a30b700 1 -- 172.21.15.50:0/1694362979 learned_addr learned my addr 172.21.15.50:0/1694362979 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:17:52.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.675+0000 7fd12a30b700 1 -- 172.21.15.50:0/1694362979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1240f5f60 msgr2=0x7fd124107420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:52.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.675+0000 7fd12a30b700 1 --2- 172.21.15.50:0/1694362979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1240f5f60 0x7fd124107420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:52.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.675+0000 7fd12a30b700 1 -- 172.21.15.50:0/1694362979 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd114005040 con 0x7fd1240f4d60 2023-01-04T18:17:52.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.675+0000 7fd129b0a700 1 --2- 172.21.15.50:0/1694362979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1240f5f60 0x7fd124107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-01-04T18:17:52.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.675+0000 7fd12a30b700 1 --2- 172.21.15.50:0/1694362979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1240f4d60 0x7fd124106f30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fd12000b410 tx=0x7fd120006ef0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:52.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.675+0000 7fd11affd700 1 -- 172.21.15.50:0/1694362979 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1200125f0 con 0x7fd1240f4d60 2023-01-04T18:17:52.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.675+0000 7fd11affd700 1 -- 172.21.15.50:0/1694362979 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd12000be30 con 0x7fd1240f4d60 2023-01-04T18:17:52.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.675+0000 7fd11affd700 1 -- 172.21.15.50:0/1694362979 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd120002a60 con 0x7fd1240f4d60 2023-01-04T18:17:52.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.675+0000 7fd12c56f700 1 -- 172.21.15.50:0/1694362979 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1241085f0 con 0x7fd1240f4d60 2023-01-04T18:17:52.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.675+0000 7fd12c56f700 1 -- 172.21.15.50:0/1694362979 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd124108bb0 con 0x7fd1240f4d60 2023-01-04T18:17:52.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.677+0000 7fd12c56f700 1 -- 172.21.15.50:0/1694362979 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1240f4150 con 0x7fd1240f4d60 2023-01-04T18:17:52.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.677+0000 7fd11affd700 1 -- 172.21.15.50:0/1694362979 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 29) v1 ==== 77020+0+0 (secure 0 0 0) 0x7fd12000f030 con 0x7fd1240f4d60 2023-01-04T18:17:52.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.677+0000 7fd11affd700 1 --2- 172.21.15.50:0/1694362979 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd110060c70 0x7fd110063130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:52.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.677+0000 7fd11affd700 1 -- 172.21.15.50:0/1694362979 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fd12007c120 con 0x7fd1240f4d60 2023-01-04T18:17:52.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.677+0000 7fd129b0a700 1 --2- 172.21.15.50:0/1694362979 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd110060c70 0x7fd110063130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:52.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.678+0000 7fd129b0a700 1 --2- 172.21.15.50:0/1694362979 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd110060c70 0x7fd110063130 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fd114004630 tx=0x7fd114009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:52.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.682+0000 7fd11affd700 1 -- 172.21.15.50:0/1694362979 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fd120050160 con 0x7fd1240f4d60 2023-01-04T18:17:52.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.974+0000 7fd12c56f700 1 -- 172.21.15.50:0/1694362979 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1240f7920 con 0x7fd110060c70 2023-01-04T18:17:52.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.976+0000 7fd11affd700 1 -- 172.21.15.50:0/1694362979 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fd1240f7920 con 0x7fd110060c70 2023-01-04T18:17:52.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.983+0000 7fd12c56f700 1 -- 172.21.15.50:0/1694362979 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd110060c70 msgr2=0x7fd110063130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:52.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.983+0000 7fd12c56f700 1 --2- 172.21.15.50:0/1694362979 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd110060c70 0x7fd110063130 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fd114004630 tx=0x7fd114009b30).stop 2023-01-04T18:17:52.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.983+0000 7fd12c56f700 1 -- 172.21.15.50:0/1694362979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1240f4d60 msgr2=0x7fd124106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:52.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.983+0000 7fd12c56f700 1 --2- 172.21.15.50:0/1694362979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1240f4d60 0x7fd124106f30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fd12000b410 tx=0x7fd120006ef0).stop 2023-01-04T18:17:52.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.983+0000 7fd12c56f700 1 -- 172.21.15.50:0/1694362979 shutdown_connections 2023-01-04T18:17:52.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.983+0000 7fd12c56f700 1 --2- 172.21.15.50:0/1694362979 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd110060c70 0x7fd110063130 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:52.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.983+0000 7fd12c56f700 1 --2- 172.21.15.50:0/1694362979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1240f4d60 0x7fd124106f30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:52.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.983+0000 7fd12c56f700 1 --2- 172.21.15.50:0/1694362979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1240f5f60 0x7fd124107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:52.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.983+0000 7fd12c56f700 1 -- 172.21.15.50:0/1694362979 >> 172.21.15.50:0/1694362979 conn(0x7fd1240f04c0 msgr2=0x7fd1240f7210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:52.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.984+0000 7fd12c56f700 1 -- 172.21.15.50:0/1694362979 shutdown_connections 2023-01-04T18:17:52.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:52.984+0000 7fd12c56f700 1 -- 172.21.15.50:0/1694362979 wait complete. 2023-01-04T18:17:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.153+0000 7f3306ad6700 1 -- 172.21.15.50:0/131670472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33000f9b80 msgr2=0x7f33000f9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.153+0000 7f3306ad6700 1 --2- 172.21.15.50:0/131670472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33000f9b80 0x7f33000f9fe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f32e8004660 tx=0x7f32e8009b30).stop 2023-01-04T18:17:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.153+0000 7f3306ad6700 1 -- 172.21.15.50:0/131670472 shutdown_connections 2023-01-04T18:17:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.153+0000 7f3306ad6700 1 --2- 172.21.15.50:0/131670472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33000f9b80 0x7f33000f9fe0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.153+0000 7f3306ad6700 1 --2- 172.21.15.50:0/131670472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33000f88e0 0x7f33000f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.153+0000 7f3306ad6700 1 -- 172.21.15.50:0/131670472 >> 172.21.15.50:0/131670472 conn(0x7f33000f40e0 msgr2=0x7f33000f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.153+0000 7f3306ad6700 1 -- 172.21.15.50:0/131670472 shutdown_connections 2023-01-04T18:17:53.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.153+0000 7f3306ad6700 1 -- 172.21.15.50:0/131670472 wait complete. 2023-01-04T18:17:53.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.154+0000 7f3306ad6700 1 Processor -- start 2023-01-04T18:17:53.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.154+0000 7f3306ad6700 1 -- start start 2023-01-04T18:17:53.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.154+0000 7f3306ad6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33000f88e0 0x7f3300109110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:53.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.154+0000 7f3306ad6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33000f9b80 0x7f3300109600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:53.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.154+0000 7f3306ad6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3300109bb0 con 0x7f33000f9b80 2023-01-04T18:17:53.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.154+0000 7f3306ad6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3300109cf0 con 0x7f33000f88e0 2023-01-04T18:17:53.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.155+0000 7f32fffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33000f9b80 0x7f3300109600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:53.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.155+0000 7f32fffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33000f9b80 0x7f3300109600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35392/0 (socket says 172.21.15.50:35392) 2023-01-04T18:17:53.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.155+0000 7f32fffff700 1 -- 172.21.15.50:0/1853447782 learned_addr learned my addr 172.21.15.50:0/1853447782 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:17:53.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.155+0000 7f3304872700 1 --2- 172.21.15.50:0/1853447782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33000f88e0 0x7f3300109110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:53.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.155+0000 7f32fffff700 1 -- 172.21.15.50:0/1853447782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33000f88e0 msgr2=0x7f3300109110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:53.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.155+0000 7f32fffff700 1 --2- 172.21.15.50:0/1853447782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33000f88e0 0x7f3300109110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:53.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.155+0000 7f32fffff700 1 -- 172.21.15.50:0/1853447782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e8005040 con 0x7f33000f9b80 2023-01-04T18:17:53.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.155+0000 7f32fffff700 1 --2- 172.21.15.50:0/1853447782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33000f9b80 0x7f3300109600 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f32e8009f50 tx=0x7f32e8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:53.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.155+0000 7f32fd7fa700 1 -- 172.21.15.50:0/1853447782 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32e8018070 con 0x7f33000f9b80 2023-01-04T18:17:53.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.155+0000 7f32fd7fa700 1 -- 172.21.15.50:0/1853447782 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f32e8009630 con 0x7f33000f9b80 2023-01-04T18:17:53.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.155+0000 7f32fd7fa700 1 -- 172.21.15.50:0/1853447782 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32e801c3c0 con 0x7f33000f9b80 2023-01-04T18:17:53.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.156+0000 7f3306ad6700 1 -- 172.21.15.50:0/1853447782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330010a630 con 0x7f33000f9b80 2023-01-04T18:17:53.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.156+0000 7f3306ad6700 1 -- 172.21.15.50:0/1853447782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330010ab90 con 0x7f33000f9b80 2023-01-04T18:17:53.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.157+0000 7f3306ad6700 1 -- 172.21.15.50:0/1853447782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3300045ad0 con 0x7f33000f9b80 2023-01-04T18:17:53.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.158+0000 7f32fd7fa700 1 -- 172.21.15.50:0/1853447782 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 77020+0+0 (secure 0 0 0) 0x7f32e801d420 con 0x7f33000f9b80 2023-01-04T18:17:53.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.158+0000 7f32fd7fa700 1 --2- 172.21.15.50:0/1853447782 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f32ec060c70 0x7f32ec063130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:53.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.158+0000 7f32fd7fa700 1 -- 172.21.15.50:0/1853447782 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f32e807d9c0 con 0x7f33000f9b80 2023-01-04T18:17:53.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.158+0000 7f3304872700 1 --2- 172.21.15.50:0/1853447782 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f32ec060c70 0x7f32ec063130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:53.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.159+0000 7f3304872700 1 --2- 172.21.15.50:0/1853447782 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f32ec060c70 0x7f32ec063130 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f33000f99e0 tx=0x7f32f000b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:53.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.165+0000 7f32fd7fa700 1 -- 172.21.15.50:0/1853447782 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f32e8051980 con 0x7f33000f9b80 2023-01-04T18:17:53.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:52.534819+0000 mgr.smithi050.emnywo (mgr.24517) 24 : audit [DBG] from='client.24557 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:17:53.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.405+0000 7f3306ad6700 1 -- 172.21.15.50:0/1853447782 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3300101180 con 0x7f32ec060c70 2023-01-04T18:17:53.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.427+0000 7f32fd7fa700 1 -- 172.21.15.50:0/1853447782 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f3300101180 con 0x7f32ec060c70 2023-01-04T18:17:53.430 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-01-04T18:17:53.431 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager.smithi050 smithi050 *:9093,9094 running (6m) 21s ago 7m 18.1M - 0.20.0 0881eb8f169f b5d3e2678a23 2023-01-04T18:17:53.431 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi050 smithi050 running (7m) 21s ago 7m 7037k - 16.2.4 8d91d370c2b8 cfe6f2d72ef5 2023-01-04T18:17:53.431 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi098 smithi098 running (6m) 10s ago 6m 7151k - 16.2.4 8d91d370c2b8 2928008d526c 2023-01-04T18:17:53.431 INFO:teuthology.orchestra.run.smithi050.stdout:grafana.smithi050 smithi050 *:3000 running (6m) 21s ago 7m 36.9M - 6.7.4 557c83e11646 7e5dccbafe78 2023-01-04T18:17:53.431 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.ezoiwl smithi050 running (3m) 21s ago 3m 5489M - 16.2.4 8d91d370c2b8 6c5c5f2be8b9 2023-01-04T18:17:53.431 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.kefmuy smithi050 running (3m) 21s ago 3m 17.4M - 16.2.4 8d91d370c2b8 58cace913b55 2023-01-04T18:17:53.431 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.laynsk smithi098 running (3m) 10s ago 3m 15.0M - 16.2.4 8d91d370c2b8 8ff8af70b989 2023-01-04T18:17:53.431 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.memais smithi098 running (3m) 10s ago 3m 774M - 16.2.4 8d91d370c2b8 d59d9b4dbf7d 2023-01-04T18:17:53.431 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi050.emnywo smithi050 *:8443,9283 running (41s) 21s ago 8m 418M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d ee677216e754 2023-01-04T18:17:53.431 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi098.vhfzum smithi098 *:8443,9283 running (16s) 10s ago 6m 52.3M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d f3d98bf0cf66 2023-01-04T18:17:53.431 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi050 smithi050 starting - - - 2048M 2023-01-04T18:17:53.432 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi098 smithi098 running (6m) 10s ago 6m 88.7M 2048M 16.2.4 8d91d370c2b8 e6b6833279a4 2023-01-04T18:17:53.432 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi050 smithi050 *:9100 running (7m) 21s ago 7m 18.3M - 0.18.1 e5a616e4b9cf 88892b2e5e5a 2023-01-04T18:17:53.432 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi098 smithi098 *:9100 running (6m) 10s ago 6m 18.4M - 0.18.1 e5a616e4b9cf 49bcde8331b6 2023-01-04T18:17:53.432 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (6m) 21s ago 6m 690M 4096M 16.2.4 8d91d370c2b8 b46676195180 2023-01-04T18:17:53.432 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi050 running (5m) 21s ago 5m 698M 4096M 16.2.4 8d91d370c2b8 e4928bcfd146 2023-01-04T18:17:53.432 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi050 running (5m) 21s ago 5m 574M 4096M 16.2.4 8d91d370c2b8 babab394b338 2023-01-04T18:17:53.432 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi098 running (5m) 10s ago 5m 894M 4096M 16.2.4 8d91d370c2b8 b02df8e3cb23 2023-01-04T18:17:53.432 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi098 running (4m) 10s ago 4m 726M 4096M 16.2.4 8d91d370c2b8 92273135ca82 2023-01-04T18:17:53.432 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi098 running (4m) 10s ago 4m 750M 4096M 16.2.4 8d91d370c2b8 366d0bfff809 2023-01-04T18:17:53.432 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus.smithi050 smithi050 *:9095 running (52s) 21s ago 7m 49.7M - 2.18.1 de242295e225 7bdcf7a45d34 2023-01-04T18:17:53.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.431+0000 7f3306ad6700 1 -- 172.21.15.50:0/1853447782 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f32ec060c70 msgr2=0x7f32ec063130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:53.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.431+0000 7f3306ad6700 1 --2- 172.21.15.50:0/1853447782 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f32ec060c70 0x7f32ec063130 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f33000f99e0 tx=0x7f32f000b040).stop 2023-01-04T18:17:53.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.431+0000 7f3306ad6700 1 -- 172.21.15.50:0/1853447782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33000f9b80 msgr2=0x7f3300109600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:53.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.431+0000 7f3306ad6700 1 --2- 172.21.15.50:0/1853447782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33000f9b80 0x7f3300109600 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f32e8009f50 tx=0x7f32e8009b30).stop 2023-01-04T18:17:53.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.431+0000 7f3306ad6700 1 -- 172.21.15.50:0/1853447782 shutdown_connections 2023-01-04T18:17:53.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.431+0000 7f3306ad6700 1 --2- 172.21.15.50:0/1853447782 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f32ec060c70 0x7f32ec063130 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:53.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.431+0000 7f3306ad6700 1 --2- 172.21.15.50:0/1853447782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33000f88e0 0x7f3300109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:53.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.431+0000 7f3306ad6700 1 --2- 172.21.15.50:0/1853447782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33000f9b80 0x7f3300109600 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:53.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.431+0000 7f3306ad6700 1 -- 172.21.15.50:0/1853447782 >> 172.21.15.50:0/1853447782 conn(0x7f33000f40e0 msgr2=0x7f33000fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:53.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.432+0000 7f3306ad6700 1 -- 172.21.15.50:0/1853447782 shutdown_connections 2023-01-04T18:17:53.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.432+0000 7f3306ad6700 1 -- 172.21.15.50:0/1853447782 wait complete. 2023-01-04T18:17:53.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:52.534819+0000 mgr.smithi050.emnywo (mgr.24517) 24 : audit [DBG] from='client.24557 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:17:53.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.592+0000 7f4317d39700 1 -- 172.21.15.50:0/1856363117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43100f55c0 msgr2=0x7f43100f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:53.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.592+0000 7f4317d39700 1 --2- 172.21.15.50:0/1856363117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43100f55c0 0x7f43100f59e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f430c004660 tx=0x7f430c009b30).stop 2023-01-04T18:17:53.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.592+0000 7f4317d39700 1 -- 172.21.15.50:0/1856363117 shutdown_connections 2023-01-04T18:17:53.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.592+0000 7f4317d39700 1 --2- 172.21.15.50:0/1856363117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43100f6860 0x7f43100f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:53.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.592+0000 7f4317d39700 1 --2- 172.21.15.50:0/1856363117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43100f55c0 0x7f43100f59e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:53.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.592+0000 7f4317d39700 1 -- 172.21.15.50:0/1856363117 >> 172.21.15.50:0/1856363117 conn(0x7f43100f0d40 msgr2=0x7f43100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:53.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.592+0000 7f4317d39700 1 -- 172.21.15.50:0/1856363117 shutdown_connections 2023-01-04T18:17:53.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.592+0000 7f4317d39700 1 -- 172.21.15.50:0/1856363117 wait complete. 2023-01-04T18:17:53.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.593+0000 7f4317d39700 1 Processor -- start 2023-01-04T18:17:53.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.593+0000 7f4317d39700 1 -- start start 2023-01-04T18:17:53.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.593+0000 7f4317d39700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43100f55c0 0x7f43101091d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:53.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.593+0000 7f4317d39700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43100f6860 0x7f43101096c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:53.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.593+0000 7f4317d39700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4310109c70 con 0x7f43100f6860 2023-01-04T18:17:53.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.593+0000 7f4317d39700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4310109db0 con 0x7f43100f55c0 2023-01-04T18:17:53.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.594+0000 7f4315ad5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43100f55c0 0x7f43101091d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:53.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.594+0000 7f4315ad5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43100f55c0 0x7f43101091d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.50:55672/0 (socket says 172.21.15.50:55672) 2023-01-04T18:17:53.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.594+0000 7f4315ad5700 1 -- 172.21.15.50:0/3480105746 learned_addr learned my addr 172.21.15.50:0/3480105746 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:17:53.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.594+0000 7f4315ad5700 1 -- 172.21.15.50:0/3480105746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43100f6860 msgr2=0x7f43101096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:53.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.595+0000 7f4315ad5700 1 --2- 172.21.15.50:0/3480105746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43100f6860 0x7f43101096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-01-04T18:17:53.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.595+0000 7f4315ad5700 1 -- 172.21.15.50:0/3480105746 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c005040 con 0x7f43100f55c0 2023-01-04T18:17:53.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.595+0000 7f4315ad5700 1 --2- 172.21.15.50:0/3480105746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43100f55c0 0x7f43101091d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f430c004e30 tx=0x7f430c009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:53.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.595+0000 7f43067fc700 1 -- 172.21.15.50:0/3480105746 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f430c018070 con 0x7f43100f55c0 2023-01-04T18:17:53.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.595+0000 7f4317d39700 1 -- 172.21.15.50:0/3480105746 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f431010a6f0 con 0x7f43100f55c0 2023-01-04T18:17:53.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.595+0000 7f43067fc700 1 -- 172.21.15.50:0/3480105746 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f430c009630 con 0x7f43100f55c0 2023-01-04T18:17:53.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.595+0000 7f43067fc700 1 -- 172.21.15.50:0/3480105746 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f430c01c3c0 con 0x7f43100f55c0 2023-01-04T18:17:53.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.595+0000 7f4317d39700 1 -- 172.21.15.50:0/3480105746 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431010ac50 con 0x7f43100f55c0 2023-01-04T18:17:53.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.596+0000 7f4317d39700 1 -- 172.21.15.50:0/3480105746 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4310045ad0 con 0x7f43100f55c0 2023-01-04T18:17:53.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.597+0000 7f43067fc700 1 -- 172.21.15.50:0/3480105746 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 29) v1 ==== 77020+0+0 (secure 0 0 0) 0x7f430c01c5f0 con 0x7f43100f55c0 2023-01-04T18:17:53.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.597+0000 7f43067fc700 1 --2- 172.21.15.50:0/3480105746 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f42fc060c70 0x7f42fc063130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:53.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.597+0000 7f43067fc700 1 -- 172.21.15.50:0/3480105746 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f430c07da30 con 0x7f43100f55c0 2023-01-04T18:17:53.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.597+0000 7f43152d4700 1 --2- 172.21.15.50:0/3480105746 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f42fc060c70 0x7f42fc063130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:53.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.598+0000 7f43152d4700 1 --2- 172.21.15.50:0/3480105746 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f42fc060c70 0x7f42fc063130 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f4300004a10 tx=0x7f43000099e0).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:53.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.601+0000 7f43067fc700 1 -- 172.21.15.50:0/3480105746 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f430c0519f0 con 0x7f43100f55c0 2023-01-04T18:17:53.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.992+0000 7f4317d39700 1 -- 172.21.15.50:0/3480105746 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f431010f7f0 con 0x7f43100f55c0 2023-01-04T18:17:53.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.993+0000 7f43067fc700 1 -- 172.21.15.50:0/3480105746 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+809 (secure 0 0 0) 0x7f430c0515e0 con 0x7f43100f55c0 2023-01-04T18:17:53.996 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:17:53.996 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": { 2023-01-04T18:17:53.996 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 1, 2023-01-04T18:17:53.996 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 1 2023-01-04T18:17:53.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:17:53.997 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": { 2023-01-04T18:17:53.997 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:17:53.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:17:53.997 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": { 2023-01-04T18:17:53.997 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2023-01-04T18:17:53.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:17:53.997 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2023-01-04T18:17:53.997 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-01-04T18:17:53.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:17:53.997 INFO:teuthology.orchestra.run.smithi050.stdout: "overall": { 2023-01-04T18:17:53.997 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 3, 2023-01-04T18:17:53.998 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 11 2023-01-04T18:17:53.998 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-01-04T18:17:53.998 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:17:53.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.996+0000 7f4317d39700 1 -- 172.21.15.50:0/3480105746 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f42fc060c70 msgr2=0x7f42fc063130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:53.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.996+0000 7f4317d39700 1 --2- 172.21.15.50:0/3480105746 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f42fc060c70 0x7f42fc063130 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f4300004a10 tx=0x7f43000099e0).stop 2023-01-04T18:17:53.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.996+0000 7f4317d39700 1 -- 172.21.15.50:0/3480105746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43100f55c0 msgr2=0x7f43101091d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:53.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.996+0000 7f4317d39700 1 --2- 172.21.15.50:0/3480105746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43100f55c0 0x7f43101091d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f430c004e30 tx=0x7f430c009b30).stop 2023-01-04T18:17:53.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.996+0000 7f4317d39700 1 -- 172.21.15.50:0/3480105746 shutdown_connections 2023-01-04T18:17:53.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.996+0000 7f4317d39700 1 --2- 172.21.15.50:0/3480105746 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f42fc060c70 0x7f42fc063130 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:54.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.996+0000 7f4317d39700 1 --2- 172.21.15.50:0/3480105746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43100f55c0 0x7f43101091d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:54.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.996+0000 7f4317d39700 1 --2- 172.21.15.50:0/3480105746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43100f6860 0x7f43101096c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-01-04T18:17:54.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.996+0000 7f4317d39700 1 -- 172.21.15.50:0/3480105746 >> 172.21.15.50:0/3480105746 conn(0x7f43100f0d40 msgr2=0x7f431005fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:54.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.996+0000 7f4317d39700 1 -- 172.21.15.50:0/3480105746 shutdown_connections 2023-01-04T18:17:54.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:53.996+0000 7f4317d39700 1 -- 172.21.15.50:0/3480105746 wait complete. 2023-01-04T18:17:54.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.135+0000 7fdbb72b3700 1 -- 172.21.15.50:0/4041512482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbb00f66e0 msgr2=0x7fdbb00f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:54.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.135+0000 7fdbb72b3700 1 --2- 172.21.15.50:0/4041512482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbb00f66e0 0x7fdbb00f6b40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fdba0004660 tx=0x7fdba0009b30).stop 2023-01-04T18:17:54.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.135+0000 7fdbb72b3700 1 -- 172.21.15.50:0/4041512482 shutdown_connections 2023-01-04T18:17:54.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.135+0000 7fdbb72b3700 1 --2- 172.21.15.50:0/4041512482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbb00f66e0 0x7fdbb00f6b40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:54.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.135+0000 7fdbb72b3700 1 --2- 172.21.15.50:0/4041512482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbb00f5440 0x7fdbb00f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:54.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.135+0000 7fdbb72b3700 1 -- 172.21.15.50:0/4041512482 >> 172.21.15.50:0/4041512482 conn(0x7fdbb00f0ba0 msgr2=0x7fdbb00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:54.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.135+0000 7fdbb72b3700 1 -- 172.21.15.50:0/4041512482 shutdown_connections 2023-01-04T18:17:54.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.135+0000 7fdbb72b3700 1 -- 172.21.15.50:0/4041512482 wait complete. 2023-01-04T18:17:54.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.136+0000 7fdbb72b3700 1 Processor -- start 2023-01-04T18:17:54.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.136+0000 7fdbb72b3700 1 -- start start 2023-01-04T18:17:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.136+0000 7fdbb72b3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbb00f5440 0x7fdbb010bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.136+0000 7fdbb72b3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbb00f66e0 0x7fdbb010e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.136+0000 7fdbb72b3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb00602b0 con 0x7fdbb00f5440 2023-01-04T18:17:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.136+0000 7fdbb72b3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb00603f0 con 0x7fdbb00f66e0 2023-01-04T18:17:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.136+0000 7fdbb62b1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbb00f5440 0x7fdbb010bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.136+0000 7fdbb62b1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbb00f5440 0x7fdbb010bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35408/0 (socket says 172.21.15.50:35408) 2023-01-04T18:17:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.136+0000 7fdbb62b1700 1 -- 172.21.15.50:0/3448102362 learned_addr learned my addr 172.21.15.50:0/3448102362 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:17:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.136+0000 7fdbb5ab0700 1 --2- 172.21.15.50:0/3448102362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbb00f66e0 0x7fdbb010e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.137+0000 7fdbb62b1700 1 -- 172.21.15.50:0/3448102362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbb00f66e0 msgr2=0x7fdbb010e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.137+0000 7fdbb62b1700 1 --2- 172.21.15.50:0/3448102362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbb00f66e0 0x7fdbb010e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:54.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.137+0000 7fdbb62b1700 1 -- 172.21.15.50:0/3448102362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba0005040 con 0x7fdbb00f5440 2023-01-04T18:17:54.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.137+0000 7fdbb62b1700 1 --2- 172.21.15.50:0/3448102362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbb00f5440 0x7fdbb010bdc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fdbac00e7c0 tx=0x7fdbac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:54.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.137+0000 7fdba6ffd700 1 -- 172.21.15.50:0/3448102362 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbac0092e0 con 0x7fdbb00f5440 2023-01-04T18:17:54.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.137+0000 7fdbb72b3700 1 -- 172.21.15.50:0/3448102362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb010e7b0 con 0x7fdbb00f5440 2023-01-04T18:17:54.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.137+0000 7fdbb72b3700 1 -- 172.21.15.50:0/3448102362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb010ebb0 con 0x7fdbb00f5440 2023-01-04T18:17:54.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.137+0000 7fdba6ffd700 1 -- 172.21.15.50:0/3448102362 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdbac00f040 con 0x7fdbb00f5440 2023-01-04T18:17:54.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.137+0000 7fdba6ffd700 1 -- 172.21.15.50:0/3448102362 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbac014810 con 0x7fdbb00f5440 2023-01-04T18:17:54.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.138+0000 7fdbb72b3700 1 -- 172.21.15.50:0/3448102362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb98004fa0 con 0x7fdbb00f5440 2023-01-04T18:17:54.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.138+0000 7fdba6ffd700 1 -- 172.21.15.50:0/3448102362 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 77020+0+0 (secure 0 0 0) 0x7fdbac01b030 con 0x7fdbb00f5440 2023-01-04T18:17:54.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.139+0000 7fdba6ffd700 1 --2- 172.21.15.50:0/3448102362 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fdb9c060cc0 0x7fdb9c063180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:54.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.139+0000 7fdba6ffd700 1 -- 172.21.15.50:0/3448102362 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fdbac07b9c0 con 0x7fdbb00f5440 2023-01-04T18:17:54.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.139+0000 7fdbb5ab0700 1 --2- 172.21.15.50:0/3448102362 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fdb9c060cc0 0x7fdb9c063180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:54.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.139+0000 7fdbb5ab0700 1 --2- 172.21.15.50:0/3448102362 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fdb9c060cc0 0x7fdb9c063180 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fdba0009720 tx=0x7fdba0016040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:54.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.143+0000 7fdba6ffd700 1 -- 172.21.15.50:0/3448102362 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fdbac04c000 con 0x7fdbb00f5440 2023-01-04T18:17:54.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.452+0000 7fdbb72b3700 1 -- 172.21.15.50:0/3448102362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdb98005e80 con 0x7fdbb00f5440 2023-01-04T18:17:54.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.452+0000 7fdba6ffd700 1 -- 172.21.15.50:0/3448102362 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1793 (secure 0 0 0) 0x7fdbac019070 con 0x7fdbb00f5440 2023-01-04T18:17:54.456 INFO:teuthology.orchestra.run.smithi050.stdout:e13 2023-01-04T18:17:54.456 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:17:54.456 INFO:teuthology.orchestra.run.smithi050.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:17:54.456 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-01-04T18:17:54.456 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:17:54.456 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-01-04T18:17:54.456 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-01-04T18:17:54.457 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 10 2023-01-04T18:17:54.457 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 2023-01-04T18:17:54.457 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:17:54.457 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-01-04T18:14:43.958806+0000 2023-01-04T18:17:54.457 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-01-04T18:17:54.457 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-01-04T18:17:54.457 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 60 2023-01-04T18:17:54.457 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-01-04T18:17:54.457 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-01-04T18:17:54.457 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-01-04T18:17:54.457 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-01-04T18:17:54.457 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 0 2023-01-04T18:17:54.458 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:17:54.458 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 1 2023-01-04T18:17:54.458 INFO:teuthology.orchestra.run.smithi050.stdout:in 0 2023-01-04T18:17:54.458 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=14430} 2023-01-04T18:17:54.458 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-01-04T18:17:54.458 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-01-04T18:17:54.458 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-01-04T18:17:54.458 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-01-04T18:17:54.458 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-01-04T18:17:54.458 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data enabled 2023-01-04T18:17:54.458 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-01-04T18:17:54.459 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 1 2023-01-04T18:17:54.459 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.ezoiwl{0:14430} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:17:54.459 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.memais{0:24291} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.98:6824/1196398070,v1:172.21.15.98:6825/1196398070] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:17:54.459 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:17:54.459 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:17:54.459 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2023-01-04T18:17:54.459 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:17:54.459 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.kefmuy{-1:14440} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:17:54.459 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.laynsk{-1:24297} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:17:54.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.454+0000 7fdbb72b3700 1 -- 172.21.15.50:0/3448102362 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fdb9c060cc0 msgr2=0x7fdb9c063180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:54.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.454+0000 7fdbb72b3700 1 --2- 172.21.15.50:0/3448102362 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fdb9c060cc0 0x7fdb9c063180 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fdba0009720 tx=0x7fdba0016040).stop 2023-01-04T18:17:54.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.454+0000 7fdbb72b3700 1 -- 172.21.15.50:0/3448102362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbb00f5440 msgr2=0x7fdbb010bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:54.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.454+0000 7fdbb72b3700 1 --2- 172.21.15.50:0/3448102362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbb00f5440 0x7fdbb010bdc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fdbac00e7c0 tx=0x7fdbac00b040).stop 2023-01-04T18:17:54.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.455+0000 7fdbb72b3700 1 -- 172.21.15.50:0/3448102362 shutdown_connections 2023-01-04T18:17:54.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.455+0000 7fdbb72b3700 1 --2- 172.21.15.50:0/3448102362 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fdb9c060cc0 0x7fdb9c063180 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:54.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.455+0000 7fdbb72b3700 1 --2- 172.21.15.50:0/3448102362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbb00f5440 0x7fdbb010bdc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:54.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.455+0000 7fdbb72b3700 1 --2- 172.21.15.50:0/3448102362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbb00f66e0 0x7fdbb010e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:54.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.455+0000 7fdbb72b3700 1 -- 172.21.15.50:0/3448102362 >> 172.21.15.50:0/3448102362 conn(0x7fdbb00f0ba0 msgr2=0x7fdbb00fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:54.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.455+0000 7fdbb72b3700 1 -- 172.21.15.50:0/3448102362 shutdown_connections 2023-01-04T18:17:54.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.455+0000 7fdbb72b3700 1 -- 172.21.15.50:0/3448102362 wait complete. 2023-01-04T18:17:54.461 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2023-01-04T18:17:54.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:17:52.594820+0000 mgr.smithi050.emnywo (mgr.24517) 25 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 342 op/s 2023-01-04T18:17:54.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:52.976711+0000 mgr.smithi050.emnywo (mgr.24517) 26 : audit [DBG] from='client.24561 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:17:54.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:53.408075+0000 mgr.smithi050.emnywo (mgr.24517) 27 : audit [DBG] from='client.34106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:17:54.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:53.994240+0000 mon.smithi098 (mon.1) 74 : audit [DBG] from='client.? 172.21.15.50:0/3480105746' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:17:54.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:52.594820+0000 mgr.smithi050.emnywo (mgr.24517) 25 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 342 op/s 2023-01-04T18:17:54.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:52.976711+0000 mgr.smithi050.emnywo (mgr.24517) 26 : audit [DBG] from='client.24561 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:17:54.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:53.408075+0000 mgr.smithi050.emnywo (mgr.24517) 27 : audit [DBG] from='client.34106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:17:54.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:53.994240+0000 mon.smithi098 (mon.1) 74 : audit [DBG] from='client.? 172.21.15.50:0/3480105746' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:17:54.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.588+0000 7fa488ae4700 1 -- 172.21.15.50:0/3045561867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4840fcce0 msgr2=0x7fa4840fd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:54.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.588+0000 7fa488ae4700 1 --2- 172.21.15.50:0/3045561867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4840fcce0 0x7fa4840fd100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fa474004660 tx=0x7fa474009b30).stop 2023-01-04T18:17:54.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.588+0000 7fa488ae4700 1 -- 172.21.15.50:0/3045561867 shutdown_connections 2023-01-04T18:17:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.588+0000 7fa488ae4700 1 --2- 172.21.15.50:0/3045561867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4840fdf80 0x7fa4840fe3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.588+0000 7fa488ae4700 1 --2- 172.21.15.50:0/3045561867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4840fcce0 0x7fa4840fd100 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.588+0000 7fa488ae4700 1 -- 172.21.15.50:0/3045561867 >> 172.21.15.50:0/3045561867 conn(0x7fa48406be70 msgr2=0x7fa48406e290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.588+0000 7fa488ae4700 1 -- 172.21.15.50:0/3045561867 shutdown_connections 2023-01-04T18:17:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.588+0000 7fa488ae4700 1 -- 172.21.15.50:0/3045561867 wait complete. 2023-01-04T18:17:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.589+0000 7fa488ae4700 1 Processor -- start 2023-01-04T18:17:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.589+0000 7fa488ae4700 1 -- start start 2023-01-04T18:17:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.589+0000 7fa488ae4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4840fcce0 0x7fa48410d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.589+0000 7fa488ae4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4840fdf80 0x7fa48410da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.589+0000 7fa488ae4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48410dfe0 con 0x7fa4840fdf80 2023-01-04T18:17:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.589+0000 7fa488ae4700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48410e120 con 0x7fa4840fcce0 2023-01-04T18:17:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.589+0000 7fa481d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4840fdf80 0x7fa48410da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.589+0000 7fa481d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4840fdf80 0x7fa48410da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35428/0 (socket says 172.21.15.50:35428) 2023-01-04T18:17:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.589+0000 7fa481d9b700 1 -- 172.21.15.50:0/1116836848 learned_addr learned my addr 172.21.15.50:0/1116836848 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:17:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.590+0000 7fa48259c700 1 --2- 172.21.15.50:0/1116836848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4840fcce0 0x7fa48410d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.590+0000 7fa481d9b700 1 -- 172.21.15.50:0/1116836848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4840fcce0 msgr2=0x7fa48410d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:54.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.590+0000 7fa481d9b700 1 --2- 172.21.15.50:0/1116836848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4840fcce0 0x7fa48410d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:54.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.590+0000 7fa481d9b700 1 -- 172.21.15.50:0/1116836848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa474005040 con 0x7fa4840fdf80 2023-01-04T18:17:54.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.590+0000 7fa48259c700 1 --2- 172.21.15.50:0/1116836848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4840fcce0 0x7fa48410d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-01-04T18:17:54.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.590+0000 7fa481d9b700 1 --2- 172.21.15.50:0/1116836848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4840fdf80 0x7fa48410da30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fa47800e7f0 tx=0x7fa47800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:54.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.590+0000 7fa472ffd700 1 -- 172.21.15.50:0/1116836848 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4780092e0 con 0x7fa4840fdf80 2023-01-04T18:17:54.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.590+0000 7fa472ffd700 1 -- 172.21.15.50:0/1116836848 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa47800f040 con 0x7fa4840fdf80 2023-01-04T18:17:54.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.590+0000 7fa488ae4700 1 -- 172.21.15.50:0/1116836848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48410eac0 con 0x7fa4840fdf80 2023-01-04T18:17:54.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.590+0000 7fa472ffd700 1 -- 172.21.15.50:0/1116836848 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4780147e0 con 0x7fa4840fdf80 2023-01-04T18:17:54.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.591+0000 7fa488ae4700 1 -- 172.21.15.50:0/1116836848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48410f000 con 0x7fa4840fdf80 2023-01-04T18:17:54.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.592+0000 7fa488ae4700 1 -- 172.21.15.50:0/1116836848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa484045ad0 con 0x7fa4840fdf80 2023-01-04T18:17:54.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.592+0000 7fa472ffd700 1 -- 172.21.15.50:0/1116836848 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 77020+0+0 (secure 0 0 0) 0x7fa47801b030 con 0x7fa4840fdf80 2023-01-04T18:17:54.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.593+0000 7fa472ffd700 1 --2- 172.21.15.50:0/1116836848 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa46c060c70 0x7fa46c063130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:17:54.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.593+0000 7fa472ffd700 1 -- 172.21.15.50:0/1116836848 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fa47807bc10 con 0x7fa4840fdf80 2023-01-04T18:17:54.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.593+0000 7fa48259c700 1 --2- 172.21.15.50:0/1116836848 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa46c060c70 0x7fa46c063130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:17:54.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.593+0000 7fa48259c700 1 --2- 172.21.15.50:0/1116836848 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa46c060c70 0x7fa46c063130 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa474009720 tx=0x7fa474016040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:17:54.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.598+0000 7fa472ffd700 1 -- 172.21.15.50:0/1116836848 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fa47804fe40 con 0x7fa4840fdf80 2023-01-04T18:17:54.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.876+0000 7fa488ae4700 1 -- 172.21.15.50:0/1116836848 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa48410f220 con 0x7fa46c060c70 2023-01-04T18:17:54.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.878+0000 7fa472ffd700 1 -- 172.21.15.50:0/1116836848 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fa48410f220 con 0x7fa46c060c70 2023-01-04T18:17:54.881 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:17:54.881 INFO:teuthology.orchestra.run.smithi050.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308", 2023-01-04T18:17:54.881 INFO:teuthology.orchestra.run.smithi050.stdout: "in_progress": true, 2023-01-04T18:17:54.881 INFO:teuthology.orchestra.run.smithi050.stdout: "which": "Upgrading all daemon types on all hosts", 2023-01-04T18:17:54.881 INFO:teuthology.orchestra.run.smithi050.stdout: "services_complete": [ 2023-01-04T18:17:54.882 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr" 2023-01-04T18:17:54.882 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-01-04T18:17:54.882 INFO:teuthology.orchestra.run.smithi050.stdout: "progress": "2/21 daemons upgraded", 2023-01-04T18:17:54.882 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "Currently upgrading mon daemons", 2023-01-04T18:17:54.882 INFO:teuthology.orchestra.run.smithi050.stdout: "is_paused": false 2023-01-04T18:17:54.882 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:17:54.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.880+0000 7fa488ae4700 1 -- 172.21.15.50:0/1116836848 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa46c060c70 msgr2=0x7fa46c063130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:54.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.880+0000 7fa488ae4700 1 --2- 172.21.15.50:0/1116836848 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa46c060c70 0x7fa46c063130 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa474009720 tx=0x7fa474016040).stop 2023-01-04T18:17:54.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.880+0000 7fa488ae4700 1 -- 172.21.15.50:0/1116836848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4840fdf80 msgr2=0x7fa48410da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:17:54.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.880+0000 7fa488ae4700 1 --2- 172.21.15.50:0/1116836848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4840fdf80 0x7fa48410da30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fa47800e7f0 tx=0x7fa47800b040).stop 2023-01-04T18:17:54.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.880+0000 7fa488ae4700 1 -- 172.21.15.50:0/1116836848 shutdown_connections 2023-01-04T18:17:54.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.880+0000 7fa488ae4700 1 --2- 172.21.15.50:0/1116836848 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa46c060c70 0x7fa46c063130 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:54.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.880+0000 7fa488ae4700 1 --2- 172.21.15.50:0/1116836848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4840fcce0 0x7fa48410d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:54.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.880+0000 7fa488ae4700 1 --2- 172.21.15.50:0/1116836848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4840fdf80 0x7fa48410da30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:17:54.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.880+0000 7fa488ae4700 1 -- 172.21.15.50:0/1116836848 >> 172.21.15.50:0/1116836848 conn(0x7fa48406be70 msgr2=0x7fa4841019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:17:54.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.880+0000 7fa488ae4700 1 -- 172.21.15.50:0/1116836848 shutdown_connections 2023-01-04T18:17:54.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:17:54.880+0000 7fa488ae4700 1 -- 172.21.15.50:0/1116836848 wait complete. 2023-01-04T18:17:55.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:54.454023+0000 mon.smithi050 (mon.0) 11 : audit [DBG] from='client.? 172.21.15.50:0/3448102362' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:17:55.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:54.454023+0000 mon.smithi050 (mon.0) 11 : audit [DBG] from='client.? 172.21.15.50:0/3448102362' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:17:56.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:17:54.595198+0000 mgr.smithi050.emnywo (mgr.24517) 28 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 211 op/s 2023-01-04T18:17:56.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:54.878954+0000 mgr.smithi050.emnywo (mgr.24517) 29 : audit [DBG] from='client.34116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:17:56.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:54.595198+0000 mgr.smithi050.emnywo (mgr.24517) 28 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 211 op/s 2023-01-04T18:17:56.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:54.878954+0000 mgr.smithi050.emnywo (mgr.24517) 29 : audit [DBG] from='client.34116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:17:57.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:56.524562+0000 mon.smithi050 (mon.0) 12 : audit [INF] from='mgr.24517 ' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:57.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:56.529160+0000 mon.smithi050 (mon.0) 13 : audit [INF] from='mgr.24517 ' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:57.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:56.534332+0000 mon.smithi098 (mon.1) 75 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:17:57.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:56.537299+0000 mon.smithi098 (mon.1) 76 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:17:57.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:56.538310+0000 mon.smithi098 (mon.1) 77 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-01-04T18:17:57.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:56.524562+0000 mon.smithi050 (mon.0) 12 : audit [INF] from='mgr.24517 ' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:57.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:56.529160+0000 mon.smithi050 (mon.0) 13 : audit [INF] from='mgr.24517 ' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:57.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:56.534332+0000 mon.smithi098 (mon.1) 75 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:17:57.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:56.537299+0000 mon.smithi098 (mon.1) 76 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:17:57.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:56.538310+0000 mon.smithi098 (mon.1) 77 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-01-04T18:17:58.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:17:56.595608+0000 mgr.smithi050.emnywo (mgr.24517) 30 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 303 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 339 op/s 2023-01-04T18:17:58.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:57.944048+0000 mon.smithi050 (mon.0) 14 : audit [INF] from='mgr.24517 ' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:58.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:57.945791+0000 mon.smithi098 (mon.1) 78 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-01-04T18:17:58.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:57.946464+0000 mon.smithi098 (mon.1) 79 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-01-04T18:17:58.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:17:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:57.947058+0000 mon.smithi098 (mon.1) 80 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:17:58.797 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: cluster 2023-01-04T18:17:56.595608+0000 mgr.smithi050.emnywo (mgr.24517) 30 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 303 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 339 op/s 2023-01-04T18:17:58.798 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:57.944048+0000 mon.smithi050 (mon.0) 14 : audit [INF] from='mgr.24517 ' entity='mgr.smithi050.emnywo' 2023-01-04T18:17:58.798 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:57.945791+0000 mon.smithi098 (mon.1) 78 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-01-04T18:17:58.798 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:57.946464+0000 mon.smithi098 (mon.1) 79 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-01-04T18:17:58.798 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: audit 2023-01-04T18:17:57.947058+0000 mon.smithi098 (mon.1) 80 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:17:59.533 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:59 smithi098 systemd[1]: Stopping Ceph mon.smithi098 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:17:59.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:17:59.529+0000 7f142fd9b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi098 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2023-01-04T18:17:59.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:17:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098[104710]: debug 2023-01-04T18:17:59.529+0000 7f142fd9b700 -1 mon.smithi098@1(peon) e2 *** Got Signal Terminated *** 2023-01-04T18:18:00.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:00 smithi098 bash[123844]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098 2023-01-04T18:18:00.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:00 smithi098 bash[123891]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098" found: no such container 2023-01-04T18:18:00.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:00 smithi098 bash[123901]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098" found: no such container 2023-01-04T18:18:00.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:00 smithi098 systemd[1]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mon.smithi098.service: Succeeded. 2023-01-04T18:18:00.420 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:00 smithi098 systemd[1]: Stopped Ceph mon.smithi098 for d98671da-8c5a-11ed-821a-001a4aab830c. 2023-01-04T18:18:00.420 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:00 smithi098 systemd[1]: Starting Ceph mon.smithi098 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:18:01.388 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 podman[123998]: 2023-01-04T18:18:01.388 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.329+0000 7f62198d0880 0 set uid:gid to 167:167 (ceph:ceph) 2023-01-04T18:18:01.388 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.329+0000 7f62198d0880 0 ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable), process ceph-mon, pid 7 2023-01-04T18:18:01.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.330+0000 7f62198d0880 0 pidfile_write: ignore empty --pid-file 2023-01-04T18:18:01.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 bash[123998]: 12094818aefc49999ce4add1b2813907401741c069e397837212a855faace9ce 2023-01-04T18:18:01.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.334+0000 7f62198d0880 0 load: jerasure load: lrc load: isa 2023-01-04T18:18:01.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: RocksDB version: 6.8.1 2023-01-04T18:18:01.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-01-04T18:18:01.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Compile date Dec 29 2022 2023-01-04T18:18:01.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: DB SUMMARY 2023-01-04T18:18:01.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: CURRENT file: CURRENT 2023-01-04T18:18:01.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: IDENTITY file: IDENTITY 2023-01-04T18:18:01.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 316 Bytes 2023-01-04T18:18:01.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi098/store.db dir, Total Num: 1, files: 000011.sst 2023-01-04T18:18:01.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi098/store.db: 000009.log size: 10470652 ; 2023-01-04T18:18:01.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.error_if_exists: 0 2023-01-04T18:18:01.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.create_if_missing: 0 2023-01-04T18:18:01.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.paranoid_checks: 1 2023-01-04T18:18:01.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.env: 0x56183c4c2000 2023-01-04T18:18:01.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.fs: Posix File System 2023-01-04T18:18:01.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.info_log: 0x56183e0e0520 2023-01-04T18:18:01.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_file_opening_threads: 16 2023-01-04T18:18:01.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.statistics: (nil) 2023-01-04T18:18:01.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.use_fsync: 0 2023-01-04T18:18:01.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_log_file_size: 0 2023-01-04T18:18:01.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-01-04T18:18:01.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.log_file_time_to_roll: 0 2023-01-04T18:18:01.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.keep_log_file_num: 1000 2023-01-04T18:18:01.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.recycle_log_file_num: 0 2023-01-04T18:18:01.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.allow_fallocate: 1 2023-01-04T18:18:01.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.allow_mmap_reads: 0 2023-01-04T18:18:01.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.allow_mmap_writes: 0 2023-01-04T18:18:01.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.use_direct_reads: 0 2023-01-04T18:18:01.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-01-04T18:18:01.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.create_missing_column_families: 0 2023-01-04T18:18:01.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.db_log_dir: 2023-01-04T18:18:01.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi098/store.db 2023-01-04T18:18:01.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.table_cache_numshardbits: 6 2023-01-04T18:18:01.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_subcompactions: 1 2023-01-04T18:18:01.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_background_flushes: -1 2023-01-04T18:18:01.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-01-04T18:18:01.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-01-04T18:18:01.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-01-04T18:18:01.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-01-04T18:18:01.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-01-04T18:18:01.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.advise_random_on_open: 1 2023-01-04T18:18:01.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.db_write_buffer_size: 0 2023-01-04T18:18:01.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.write_buffer_manager: 0x56183edd0150 2023-01-04T18:18:01.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-01-04T18:18:01.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-01-04T18:18:01.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-01-04T18:18:01.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.use_adaptive_mutex: 0 2023-01-04T18:18:01.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.rate_limiter: (nil) 2023-01-04T18:18:01.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-01-04T18:18:01.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.wal_recovery_mode: 2 2023-01-04T18:18:01.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.enable_thread_tracking: 0 2023-01-04T18:18:01.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.enable_pipelined_write: 0 2023-01-04T18:18:01.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.unordered_write: 0 2023-01-04T18:18:01.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-01-04T18:18:01.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-01-04T18:18:01.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-01-04T18:18:01.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-01-04T18:18:01.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.row_cache: None 2023-01-04T18:18:01.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.wal_filter: None 2023-01-04T18:18:01.395 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-01-04T18:18:01.395 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.allow_ingest_behind: 0 2023-01-04T18:18:01.395 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.preserve_deletes: 0 2023-01-04T18:18:01.395 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.two_write_queues: 0 2023-01-04T18:18:01.395 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.manual_wal_flush: 0 2023-01-04T18:18:01.395 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.atomic_flush: 0 2023-01-04T18:18:01.395 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-01-04T18:18:01.395 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.persist_stats_to_disk: 0 2023-01-04T18:18:01.395 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.write_dbid_to_manifest: 0 2023-01-04T18:18:01.395 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.log_readahead_size: 0 2023-01-04T18:18:01.395 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2023-01-04T18:18:01.395 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_background_jobs: 2 2023-01-04T18:18:01.396 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_background_compactions: -1 2023-01-04T18:18:01.396 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-01-04T18:18:01.396 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-01-04T18:18:01.396 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.delayed_write_rate : 16777216 2023-01-04T18:18:01.396 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_total_wal_size: 0 2023-01-04T18:18:01.396 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-01-04T18:18:01.396 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.stats_dump_period_sec: 600 2023-01-04T18:18:01.396 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.stats_persist_period_sec: 600 2023-01-04T18:18:01.396 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-01-04T18:18:01.396 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_open_files: -1 2023-01-04T18:18:01.397 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.bytes_per_sync: 0 2023-01-04T18:18:01.397 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-01-04T18:18:01.397 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.strict_bytes_per_sync: 0 2023-01-04T18:18:01.397 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.compaction_readahead_size: 0 2023-01-04T18:18:01.397 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Compression algorithms supported: 2023-01-04T18:18:01.397 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-01-04T18:18:01.397 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: kZSTD supported: 0 2023-01-04T18:18:01.397 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: kXpressCompression supported: 0 2023-01-04T18:18:01.397 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: kLZ4HCCompression supported: 1 2023-01-04T18:18:01.397 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: kLZ4Compression supported: 1 2023-01-04T18:18:01.397 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: kBZip2Compression supported: 0 2023-01-04T18:18:01.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: kZlibCompression supported: 1 2023-01-04T18:18:01.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: kSnappyCompression supported: 1 2023-01-04T18:18:01.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-01-04T18:18:01.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi098/store.db/MANIFEST-000005 2023-01-04T18:18:01.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2023-01-04T18:18:01.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-01-04T18:18:01.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.merge_operator: 2023-01-04T18:18:01.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.compaction_filter: None 2023-01-04T18:18:01.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.compaction_filter_factory: None 2023-01-04T18:18:01.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-01-04T18:18:01.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.table_factory: BlockBasedTable 2023-01-04T18:18:01.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56183e07fd10) 2023-01-04T18:18:01.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cache_index_and_filter_blocks: 1 2023-01-04T18:18:01.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cache_index_and_filter_blocks_with_high_priority: 0 2023-01-04T18:18:01.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: pin_l0_filter_and_index_blocks_in_cache: 0 2023-01-04T18:18:01.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: pin_top_level_index_and_filter: 1 2023-01-04T18:18:01.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: index_type: 0 2023-01-04T18:18:01.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: data_block_index_type: 0 2023-01-04T18:18:01.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: index_shortening: 1 2023-01-04T18:18:01.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: data_block_hash_table_util_ratio: 0.750000 2023-01-04T18:18:01.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: hash_index_allow_collision: 1 2023-01-04T18:18:01.400 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: checksum: 1 2023-01-04T18:18:01.400 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: no_block_cache: 0 2023-01-04T18:18:01.400 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: block_cache: 0x56183e0b8f10 2023-01-04T18:18:01.400 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: block_cache_name: BinnedLRUCache 2023-01-04T18:18:01.400 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: block_cache_options: 2023-01-04T18:18:01.400 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: capacity : 536870912 2023-01-04T18:18:01.400 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: num_shard_bits : 4 2023-01-04T18:18:01.401 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: strict_capacity_limit : 0 2023-01-04T18:18:01.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: high_pri_pool_ratio: 0.000 2023-01-04T18:18:01.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: block_cache_compressed: (nil) 2023-01-04T18:18:01.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: persistent_cache: (nil) 2023-01-04T18:18:01.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: block_size: 4096 2023-01-04T18:18:01.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: block_size_deviation: 10 2023-01-04T18:18:01.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: block_restart_interval: 16 2023-01-04T18:18:01.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: index_block_restart_interval: 1 2023-01-04T18:18:01.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: metadata_block_size: 4096 2023-01-04T18:18:01.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: partition_filters: 0 2023-01-04T18:18:01.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: use_delta_encoding: 1 2023-01-04T18:18:01.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: filter_policy: rocksdb.BuiltinBloomFilter 2023-01-04T18:18:01.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: whole_key_filtering: 1 2023-01-04T18:18:01.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: verify_compression: 0 2023-01-04T18:18:01.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: read_amp_bytes_per_bit: 0 2023-01-04T18:18:01.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: format_version: 2 2023-01-04T18:18:01.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: enable_index_compression: 1 2023-01-04T18:18:01.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: block_align: 0 2023-01-04T18:18:01.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.write_buffer_size: 33554432 2023-01-04T18:18:01.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_write_buffer_number: 2 2023-01-04T18:18:01.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.compression: NoCompression 2023-01-04T18:18:01.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.bottommost_compression: Disabled 2023-01-04T18:18:01.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.prefix_extractor: nullptr 2023-01-04T18:18:01.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-01-04T18:18:01.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.num_levels: 7 2023-01-04T18:18:01.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-01-04T18:18:01.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-01-04T18:18:01.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-01-04T18:18:01.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-01-04T18:18:01.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-01-04T18:18:01.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-01-04T18:18:01.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-01-04T18:18:01.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-01-04T18:18:01.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-01-04T18:18:01.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.compression_opts.window_bits: -14 2023-01-04T18:18:01.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.compression_opts.level: 32767 2023-01-04T18:18:01.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.compression_opts.strategy: 0 2023-01-04T18:18:01.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-01-04T18:18:01.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-01-04T18:18:01.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.compression_opts.enabled: false 2023-01-04T18:18:01.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-01-04T18:18:01.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-01-04T18:18:01.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-01-04T18:18:01.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.target_file_size_base: 67108864 2023-01-04T18:18:01.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.target_file_size_multiplier: 1 2023-01-04T18:18:01.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-01-04T18:18:01.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-01-04T18:18:01.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-01-04T18:18:01.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-01-04T18:18:01.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-01-04T18:18:01.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-01-04T18:18:01.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-01-04T18:18:01.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-01-04T18:18:01.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-01-04T18:18:01.407 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-01-04T18:18:01.407 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-01-04T18:18:01.407 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-01-04T18:18:01.407 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.arena_block_size: 4194304 2023-01-04T18:18:01.407 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-01-04T18:18:01.407 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-01-04T18:18:01.407 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-01-04T18:18:01.407 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.disable_auto_compactions: 0 2023-01-04T18:18:01.407 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-01-04T18:18:01.407 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-01-04T18:18:01.407 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-01-04T18:18:01.408 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-01-04T18:18:01.408 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-01-04T18:18:01.408 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-01-04T18:18:01.408 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-01-04T18:18:01.408 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-01-04T18:18:01.408 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-01-04T18:18:01.408 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-01-04T18:18:01.408 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.table_properties_collectors: 2023-01-04T18:18:01.408 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.inplace_update_support: 0 2023-01-04T18:18:01.408 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-01-04T18:18:01.409 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-01-04T18:18:01.409 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-01-04T18:18:01.409 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.memtable_huge_page_size: 0 2023-01-04T18:18:01.409 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.bloom_locality: 0 2023-01-04T18:18:01.409 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.max_successive_merges: 0 2023-01-04T18:18:01.409 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-01-04T18:18:01.409 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.paranoid_file_checks: 0 2023-01-04T18:18:01.409 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.force_consistency_checks: 0 2023-01-04T18:18:01.409 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.report_bg_io_stats: 0 2023-01-04T18:18:01.409 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.ttl: 2592000 2023-01-04T18:18:01.409 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: Options.periodic_compaction_seconds: 0 2023-01-04T18:18:01.410 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: [version_set.cc:3291] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-01-04T18:18:01.410 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi098/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 13, last_sequence is 6517, log_number is 9,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-01-04T18:18:01.410 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.410 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.335+0000 7f62198d0880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 9 2023-01-04T18:18:01.410 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.410 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.336+0000 7f62198d0880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1672856281336893, "job": 1, "event": "recovery_started", "log_files": [9]} 2023-01-04T18:18:01.410 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.336+0000 7f62198d0880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #9 mode 2 2023-01-04T18:18:01.410 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.345+0000 7f62198d0880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-01-04T18:18:01.410 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.353+0000 7f62198d0880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1672856281354119, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 6849261, "table_properties": {"data_size": 6838067, "index_size": 9154, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 1221, "raw_key_size": 10264, "raw_average_key_size": 21, "raw_value_size": 6824028, "raw_average_value_size": 14276, "num_data_blocks": 291, "num_entries": 478, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1672856281, "oldest_key_time": 3, "file_creation_time": 0}} 2023-01-04T18:18:01.410 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.353+0000 7f62198d0880 4 rocksdb: [version_set.cc:3826] Creating manifest 14 2023-01-04T18:18:01.410 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.411 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.353+0000 7f62198d0880 4 rocksdb: [version_set.cc:3291] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-01-04T18:18:01.411 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.356+0000 7f62198d0880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1672856281356964, "job": 1, "event": "recovery_finished"} 2023-01-04T18:18:01.411 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.357+0000 7f62198d0880 4 rocksdb: DB pointer 0x56183e183800 2023-01-04T18:18:01.411 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.357+0000 7f62006e0700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2023-01-04T18:18:01.411 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.357+0000 7f62006e0700 4 rocksdb: [db_impl/db_impl.cc:851] 2023-01-04T18:18:01.411 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: ** DB Stats ** 2023-01-04T18:18:01.411 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Uptime(secs): 0.0 total, 0.0 interval 2023-01-04T18:18:01.411 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-01-04T18:18:01.411 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-01-04T18:18:01.411 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-01-04T18:18:01.411 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-01-04T18:18:01.411 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-01-04T18:18:01.412 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-01-04T18:18:01.412 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.412 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: ** Compaction Stats [default] ** 2023-01-04T18:18:01.412 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-04T18:18:01.412 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-04T18:18:01.412 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: L0 1/0 6.53 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 785.3 0.01 0.00 1 0.008 0 0 2023-01-04T18:18:01.412 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: L6 1/0 18.03 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-01-04T18:18:01.412 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Sum 2/0 24.56 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 785.3 0.01 0.00 1 0.008 0 0 2023-01-04T18:18:01.412 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 785.3 0.01 0.00 1 0.008 0 0 2023-01-04T18:18:01.412 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.412 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: ** Compaction Stats [default] ** 2023-01-04T18:18:01.413 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-04T18:18:01.413 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-04T18:18:01.413 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 785.3 0.01 0.00 1 0.008 0 0 2023-01-04T18:18:01.413 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Uptime(secs): 0.0 total, 0.0 interval 2023-01-04T18:18:01.413 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Flush(GB): cumulative 0.006, interval 0.006 2023-01-04T18:18:01.413 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: AddFile(GB): cumulative 0.000, interval 0.000 2023-01-04T18:18:01.413 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: AddFile(Total Files): cumulative 0, interval 0 2023-01-04T18:18:01.413 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: AddFile(L0 Files): cumulative 0, interval 0 2023-01-04T18:18:01.413 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: AddFile(Keys): cumulative 0, interval 0 2023-01-04T18:18:01.413 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Cumulative compaction: 0.01 GB write, 291.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-04T18:18:01.413 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Interval compaction: 0.01 GB write, 291.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-04T18:18:01.414 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-01-04T18:18:01.414 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.414 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: ** File Read Latency Histogram By Level [default] ** 2023-01-04T18:18:01.414 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.414 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: ** Compaction Stats [default] ** 2023-01-04T18:18:01.414 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-04T18:18:01.414 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-04T18:18:01.414 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: L0 1/0 6.53 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 785.3 0.01 0.00 1 0.008 0 0 2023-01-04T18:18:01.414 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: L6 1/0 18.03 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-01-04T18:18:01.414 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Sum 2/0 24.56 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 785.3 0.01 0.00 1 0.008 0 0 2023-01-04T18:18:01.414 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-01-04T18:18:01.415 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.415 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: ** Compaction Stats [default] ** 2023-01-04T18:18:01.415 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-01-04T18:18:01.415 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-01-04T18:18:01.415 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 785.3 0.01 0.00 1 0.008 0 0 2023-01-04T18:18:01.415 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Uptime(secs): 0.0 total, 0.0 interval 2023-01-04T18:18:01.415 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Flush(GB): cumulative 0.006, interval 0.000 2023-01-04T18:18:01.415 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: AddFile(GB): cumulative 0.000, interval 0.000 2023-01-04T18:18:01.415 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: AddFile(Total Files): cumulative 0, interval 0 2023-01-04T18:18:01.415 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: AddFile(L0 Files): cumulative 0, interval 0 2023-01-04T18:18:01.415 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: AddFile(Keys): cumulative 0, interval 0 2023-01-04T18:18:01.416 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Cumulative compaction: 0.01 GB write, 290.85 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-04T18:18:01.416 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-01-04T18:18:01.416 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-01-04T18:18:01.416 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.416 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: ** File Read Latency Histogram By Level [default] ** 2023-01-04T18:18:01.416 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.416 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.358+0000 7f62198d0880 0 starting mon.smithi098 rank 1 at public addrs [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] at bind addrs [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi098 fsid d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:18:01.416 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.359+0000 7f62198d0880 1 mon.smithi098@-1(???) e2 preinit fsid d98671da-8c5a-11ed-821a-001a4aab830c 2023-01-04T18:18:01.416 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.359+0000 7f62198d0880 0 mon.smithi098@-1(???).mds e13 new map 2023-01-04T18:18:01.416 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.359+0000 7f62198d0880 0 mon.smithi098@-1(???).mds e13 print_map 2023-01-04T18:18:01.416 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: e13 2023-01-04T18:18:01.417 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:18:01.417 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:18:01.417 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: legacy client fscid: 1 2023-01-04T18:18:01.417 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.417 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Filesystem 'cephfs' (1) 2023-01-04T18:18:01.417 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: fs_name cephfs 2023-01-04T18:18:01.417 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: epoch 10 2023-01-04T18:18:01.417 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: flags 32 2023-01-04T18:18:01.417 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:18:01.417 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: modified 2023-01-04T18:14:43.958806+0000 2023-01-04T18:18:01.418 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: tableserver 0 2023-01-04T18:18:01.418 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: root 0 2023-01-04T18:18:01.418 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: session_timeout 60 2023-01-04T18:18:01.418 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: session_autoclose 300 2023-01-04T18:18:01.418 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: max_file_size 1099511627776 2023-01-04T18:18:01.418 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: required_client_features {} 2023-01-04T18:18:01.418 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: last_failure 0 2023-01-04T18:18:01.418 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: last_failure_osd_epoch 0 2023-01-04T18:18:01.418 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:18:01.418 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: max_mds 1 2023-01-04T18:18:01.418 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: in 0 2023-01-04T18:18:01.418 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: up {0=14430} 2023-01-04T18:18:01.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: failed 2023-01-04T18:18:01.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: damaged 2023-01-04T18:18:01.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: stopped 2023-01-04T18:18:01.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: data_pools [3] 2023-01-04T18:18:01.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: metadata_pool 2 2023-01-04T18:18:01.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: inline_data enabled 2023-01-04T18:18:01.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: balancer 2023-01-04T18:18:01.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: standby_count_wanted 1 2023-01-04T18:18:01.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: [mds.cephfs.smithi050.ezoiwl{0:14430} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:18:01.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: [mds.cephfs.smithi098.memais{0:24291} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.98:6824/1196398070,v1:172.21.15.98:6825/1196398070] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:18:01.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.419 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.420 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: Standby daemons: 2023-01-04T18:18:01.420 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.420 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: [mds.cephfs.smithi050.kefmuy{-1:14440} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:18:01.420 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: [mds.cephfs.smithi098.laynsk{-1:24297} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:18:01.420 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: 2023-01-04T18:18:01.420 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.359+0000 7f62198d0880 0 mon.smithi098@-1(???).osd e45 crush map has features 3314933000852226048, adjusting msgr requires 2023-01-04T18:18:01.420 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.359+0000 7f62198d0880 0 mon.smithi098@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2023-01-04T18:18:01.420 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.359+0000 7f62198d0880 0 mon.smithi098@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2023-01-04T18:18:01.420 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.359+0000 7f62198d0880 0 mon.smithi098@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2023-01-04T18:18:01.420 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:17:56.595608+0000 mgr.smithi050.emnywo (mgr.24517) 30 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 303 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 339 op/s 2023-01-04T18:18:01.420 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:17:57.944048+0000 mon.smithi050 (mon.0) 14 : audit [INF] from='mgr.24517 ' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:01.421 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:17:57.945791+0000 mon.smithi098 (mon.1) 78 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-01-04T18:18:01.421 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:17:57.946464+0000 mon.smithi098 (mon.1) 79 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-01-04T18:18:01.421 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:17:57.947058+0000 mon.smithi098 (mon.1) 80 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:18:01.421 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:18:01.360+0000 7f62198d0880 1 mon.smithi098@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2023-01-04T18:18:01.421 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:01 smithi098 systemd[1]: Started Ceph mon.smithi098 for d98671da-8c5a-11ed-821a-001a4aab830c. 2023-01-04T18:18:02.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:17:57.939963+0000 mgr.smithi050.emnywo (mgr.24517) 31 : cephadm [INF] Upgrade: Updating mon.smithi098 2023-01-04T18:18:02.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:17:57.947664+0000 mgr.smithi050.emnywo (mgr.24517) 32 : cephadm [INF] Deploying daemon mon.smithi098 on smithi098 2023-01-04T18:18:02.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:17:57.939963+0000 mgr.smithi050.emnywo (mgr.24517) 31 : cephadm [INF] Upgrade: Updating mon.smithi098 2023-01-04T18:18:02.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:17:57.947664+0000 mgr.smithi050.emnywo (mgr.24517) 32 : cephadm [INF] Deploying daemon mon.smithi098 on smithi098 2023-01-04T18:18:03.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:17:58.596001+0000 mgr.smithi050.emnywo (mgr.24517) 33 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 303 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 229 op/s 2023-01-04T18:18:03.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:17:59.539349+0000 mon.smithi050 (mon.0) 15 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi050"}]: dispatch 2023-01-04T18:18:03.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:17:59.539521+0000 mon.smithi050 (mon.0) 16 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2023-01-04T18:18:03.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:00.596346+0000 mgr.smithi050.emnywo (mgr.24517) 34 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 303 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 229 op/s 2023-01-04T18:18:03.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:02.544536+0000 mon.smithi098 (mon.1) 1 : cluster [INF] mon.smithi098 calling monitor election 2023-01-04T18:18:03.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:02.545437+0000 mon.smithi050 (mon.0) 17 : cluster [INF] mon.smithi050 calling monitor election 2023-01-04T18:18:03.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:02.558196+0000 mon.smithi050 (mon.0) 18 : cluster [INF] mon.smithi050 is new leader, mons smithi050,smithi098 in quorum (ranks 0,1) 2023-01-04T18:18:03.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:02.564397+0000 mon.smithi050 (mon.0) 19 : cluster [DBG] monmap e2: 2 mons at {smithi050=[v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0],smithi098=[v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0]} 2023-01-04T18:18:03.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:02.564974+0000 mon.smithi050 (mon.0) 20 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 1 up:standby-replay 2 up:standby 2023-01-04T18:18:03.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:02.565013+0000 mon.smithi050 (mon.0) 21 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2023-01-04T18:18:03.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:02.565313+0000 mon.smithi050 (mon.0) 22 : cluster [DBG] mgrmap e29: smithi050.emnywo(active, since 38s), standbys: smithi098.vhfzum 2023-01-04T18:18:03.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:02.578605+0000 mon.smithi050 (mon.0) 23 : cluster [WRN] Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-01-04T18:18:03.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:02.578628+0000 mon.smithi050 (mon.0) 24 : cluster [WRN] [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-01-04T18:18:03.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:02.578646+0000 mon.smithi050 (mon.0) 25 : cluster [WRN] fs cephfs has deprecated feature inline_data enabled. 2023-01-04T18:18:03.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:02.581087+0000 mon.smithi050 (mon.0) 26 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:03.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:02.582038+0000 mon.smithi050 (mon.0) 27 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:18:03.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:02.583217+0000 mon.smithi050 (mon.0) 28 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:18:03.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:02.583934+0000 mon.smithi050 (mon.0) 29 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:18:03.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:18:02.584597+0000 mgr.smithi050.emnywo (mgr.24517) 35 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:18:03.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:02.596740+0000 mgr.smithi050.emnywo (mgr.24517) 36 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 418 op/s 2023-01-04T18:18:04.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:17:58.596001+0000 mgr.smithi050.emnywo (mgr.24517) 33 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 303 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 229 op/s 2023-01-04T18:18:04.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:59.539349+0000 mon.smithi050 (mon.0) 15 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi050"}]: dispatch 2023-01-04T18:18:04.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:17:59.539521+0000 mon.smithi050 (mon.0) 16 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2023-01-04T18:18:04.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:00.596346+0000 mgr.smithi050.emnywo (mgr.24517) 34 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 303 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 229 op/s 2023-01-04T18:18:04.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:02.544536+0000 mon.smithi098 (mon.1) 1 : cluster [INF] mon.smithi098 calling monitor election 2023-01-04T18:18:04.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:02.545437+0000 mon.smithi050 (mon.0) 17 : cluster [INF] mon.smithi050 calling monitor election 2023-01-04T18:18:04.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:02.558196+0000 mon.smithi050 (mon.0) 18 : cluster [INF] mon.smithi050 is new leader, mons smithi050,smithi098 in quorum (ranks 0,1) 2023-01-04T18:18:04.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:02.564397+0000 mon.smithi050 (mon.0) 19 : cluster [DBG] monmap e2: 2 mons at {smithi050=[v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0],smithi098=[v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0]} 2023-01-04T18:18:04.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:02.564974+0000 mon.smithi050 (mon.0) 20 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 1 up:standby-replay 2 up:standby 2023-01-04T18:18:04.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:02.565013+0000 mon.smithi050 (mon.0) 21 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2023-01-04T18:18:04.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:02.565313+0000 mon.smithi050 (mon.0) 22 : cluster [DBG] mgrmap e29: smithi050.emnywo(active, since 38s), standbys: smithi098.vhfzum 2023-01-04T18:18:04.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:02.578605+0000 mon.smithi050 (mon.0) 23 : cluster [WRN] Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-01-04T18:18:04.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:02.578628+0000 mon.smithi050 (mon.0) 24 : cluster [WRN] [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-01-04T18:18:04.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:02.578646+0000 mon.smithi050 (mon.0) 25 : cluster [WRN] fs cephfs has deprecated feature inline_data enabled. 2023-01-04T18:18:04.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:02.581087+0000 mon.smithi050 (mon.0) 26 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:04.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:02.582038+0000 mon.smithi050 (mon.0) 27 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:18:04.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:02.583217+0000 mon.smithi050 (mon.0) 28 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:18:04.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:02.583934+0000 mon.smithi050 (mon.0) 29 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:18:04.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:18:02.584597+0000 mgr.smithi050.emnywo (mgr.24517) 35 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:18:04.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:02.596740+0000 mgr.smithi050.emnywo (mgr.24517) 36 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 418 op/s 2023-01-04T18:18:06.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:04.597120+0000 mgr.smithi050.emnywo (mgr.24517) 37 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 316 op/s 2023-01-04T18:18:06.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:05 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:04.597120+0000 mgr.smithi050.emnywo (mgr.24517) 37 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 316 op/s 2023-01-04T18:18:08.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:06.597639+0000 mgr.smithi050.emnywo (mgr.24517) 38 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 478 op/s 2023-01-04T18:18:08.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:07.066046+0000 mon.smithi050 (mon.0) 30 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:08.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:07.069916+0000 mon.smithi050 (mon.0) 31 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:08.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:07.077872+0000 mon.smithi050 (mon.0) 32 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:18:08.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:07.080862+0000 mon.smithi050 (mon.0) 33 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:18:08.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:07.082493+0000 mon.smithi050 (mon.0) 34 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:18:08.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:18:07.083155+0000 mgr.smithi050.emnywo (mgr.24517) 39 : cephadm [INF] Upgrade: Setting container_image for all mon 2023-01-04T18:18:08.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:07.088701+0000 mon.smithi050 (mon.0) 35 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:08.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:07.089555+0000 mon.smithi050 (mon.0) 36 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi050"}]: dispatch 2023-01-04T18:18:08.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:07.092717+0000 mon.smithi050 (mon.0) 37 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi050"}]': finished 2023-01-04T18:18:08.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:07.098428+0000 mon.smithi050 (mon.0) 38 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi098"}]: dispatch 2023-01-04T18:18:08.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:07.104590+0000 mon.smithi050 (mon.0) 39 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi098"}]': finished 2023-01-04T18:18:08.543 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:06.597639+0000 mgr.smithi050.emnywo (mgr.24517) 38 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 478 op/s 2023-01-04T18:18:08.543 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:07.066046+0000 mon.smithi050 (mon.0) 30 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:08.543 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:07.069916+0000 mon.smithi050 (mon.0) 31 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:08.543 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:07.077872+0000 mon.smithi050 (mon.0) 32 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:18:08.543 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:07.080862+0000 mon.smithi050 (mon.0) 33 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:18:08.544 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:07.082493+0000 mon.smithi050 (mon.0) 34 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:18:08.544 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:18:07.083155+0000 mgr.smithi050.emnywo (mgr.24517) 39 : cephadm [INF] Upgrade: Setting container_image for all mon 2023-01-04T18:18:08.544 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:07.088701+0000 mon.smithi050 (mon.0) 35 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:08.544 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:07.089555+0000 mon.smithi050 (mon.0) 36 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi050"}]: dispatch 2023-01-04T18:18:08.544 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:07.092717+0000 mon.smithi050 (mon.0) 37 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi050"}]': finished 2023-01-04T18:18:08.544 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:07.098428+0000 mon.smithi050 (mon.0) 38 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi098"}]: dispatch 2023-01-04T18:18:08.544 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:07.104590+0000 mon.smithi050 (mon.0) 39 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi098"}]': finished 2023-01-04T18:18:10.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:08.598480+0000 mgr.smithi050.emnywo (mgr.24517) 40 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 350 op/s 2023-01-04T18:18:10.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:08.598480+0000 mgr.smithi050.emnywo (mgr.24517) 40 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 350 op/s 2023-01-04T18:18:11.458 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:18:10.378797+0000 mgr.smithi050.emnywo (mgr.24517) 41 : cephadm [INF] Upgrade: Updating crash.smithi050 (1/2) 2023-01-04T18:18:11.458 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:10.382983+0000 mon.smithi050 (mon.0) 40 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:11.459 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:10.383783+0000 mon.smithi050 (mon.0) 41 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi050", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-01-04T18:18:11.459 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:10.384456+0000 mon.smithi050 (mon.0) 42 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:18:11.459 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:18:10.384996+0000 mgr.smithi050.emnywo (mgr.24517) 42 : cephadm [INF] Deploying daemon crash.smithi050 on smithi050 2023-01-04T18:18:11.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:18:10.378797+0000 mgr.smithi050.emnywo (mgr.24517) 41 : cephadm [INF] Upgrade: Updating crash.smithi050 (1/2) 2023-01-04T18:18:11.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:10.382983+0000 mon.smithi050 (mon.0) 40 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:11.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:10.383783+0000 mon.smithi050 (mon.0) 41 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi050", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-01-04T18:18:11.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:10.384456+0000 mon.smithi050 (mon.0) 42 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:18:11.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:18:10.384996+0000 mgr.smithi050.emnywo (mgr.24517) 42 : cephadm [INF] Deploying daemon crash.smithi050 on smithi050 2023-01-04T18:18:12.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:10.598801+0000 mgr.smithi050.emnywo (mgr.24517) 43 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 350 op/s 2023-01-04T18:18:12.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:10.598801+0000 mgr.smithi050.emnywo (mgr.24517) 43 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 350 op/s 2023-01-04T18:18:14.512 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:12.599220+0000 mgr.smithi050.emnywo (mgr.24517) 44 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 299 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 865 op/s 2023-01-04T18:18:14.513 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:13.454706+0000 mon.smithi050 (mon.0) 43 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:14.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:12.599220+0000 mgr.smithi050.emnywo (mgr.24517) 44 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 299 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 865 op/s 2023-01-04T18:18:14.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:13.454706+0000 mon.smithi050 (mon.0) 43 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:16.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:14.599542+0000 mgr.smithi050.emnywo (mgr.24517) 45 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 299 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 676 op/s 2023-01-04T18:18:16.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:18:15.032108+0000 mgr.smithi050.emnywo (mgr.24517) 46 : cephadm [INF] Upgrade: Updating crash.smithi098 (2/2) 2023-01-04T18:18:16.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:15.038529+0000 mon.smithi050 (mon.0) 44 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:16.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:15.039396+0000 mon.smithi050 (mon.0) 45 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi098", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-01-04T18:18:16.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:15.040218+0000 mon.smithi050 (mon.0) 46 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:18:16.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:18:15.040937+0000 mgr.smithi050.emnywo (mgr.24517) 47 : cephadm [INF] Deploying daemon crash.smithi098 on smithi098 2023-01-04T18:18:16.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:14.599542+0000 mgr.smithi050.emnywo (mgr.24517) 45 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 299 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 676 op/s 2023-01-04T18:18:16.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:18:15.032108+0000 mgr.smithi050.emnywo (mgr.24517) 46 : cephadm [INF] Upgrade: Updating crash.smithi098 (2/2) 2023-01-04T18:18:16.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:15.038529+0000 mon.smithi050 (mon.0) 44 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:16.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:15.039396+0000 mon.smithi050 (mon.0) 45 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi098", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-01-04T18:18:16.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:15.040218+0000 mon.smithi050 (mon.0) 46 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:18:16.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:18:15.040937+0000 mgr.smithi050.emnywo (mgr.24517) 47 : cephadm [INF] Deploying daemon crash.smithi098 on smithi098 2023-01-04T18:18:18.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:16.600105+0000 mgr.smithi050.emnywo (mgr.24517) 48 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 282 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 1.12k op/s 2023-01-04T18:18:18.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:16.600105+0000 mgr.smithi050.emnywo (mgr.24517) 48 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 282 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 1.12k op/s 2023-01-04T18:18:20.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:18.605575+0000 mgr.smithi050.emnywo (mgr.24517) 49 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 282 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 955 op/s 2023-01-04T18:18:20.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:18.605575+0000 mgr.smithi050.emnywo (mgr.24517) 49 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 282 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 955 op/s 2023-01-04T18:18:22.316 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:20.605917+0000 mgr.smithi050.emnywo (mgr.24517) 50 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 282 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 955 op/s 2023-01-04T18:18:22.543 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:20.605917+0000 mgr.smithi050.emnywo (mgr.24517) 50 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 282 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 955 op/s 2023-01-04T18:18:23.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:23 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:22.398228+0000 mon.smithi050 (mon.0) 47 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:23.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:23 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:22.399741+0000 mon.smithi050 (mon.0) 48 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:18:23.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:23 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:22.401912+0000 mon.smithi050 (mon.0) 49 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:18:23.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:23 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:22.402993+0000 mon.smithi050 (mon.0) 50 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:18:23.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:23 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:18:22.403873+0000 mgr.smithi050.emnywo (mgr.24517) 51 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:18:23.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:22.398228+0000 mon.smithi050 (mon.0) 47 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:23.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:22.399741+0000 mon.smithi050 (mon.0) 48 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:18:23.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:22.401912+0000 mon.smithi050 (mon.0) 49 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:18:23.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:22.402993+0000 mon.smithi050 (mon.0) 50 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:18:23.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:18:22.403873+0000 mgr.smithi050.emnywo (mgr.24517) 51 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:18:24.777 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:22.606479+0000 mgr.smithi050.emnywo (mgr.24517) 52 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 270 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 1.31k op/s 2023-01-04T18:18:24.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:22.606479+0000 mgr.smithi050.emnywo (mgr.24517) 52 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 270 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 1.31k op/s 2023-01-04T18:18:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.016+0000 7f2695ffd700 1 -- 172.21.15.50:0/2358173517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26900f77c0 msgr2=0x7f26900f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.016+0000 7f2695ffd700 1 --2- 172.21.15.50:0/2358173517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26900f77c0 0x7f26900f7c20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f267c004660 tx=0x7f267c009b30).stop 2023-01-04T18:18:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.016+0000 7f2695ffd700 1 -- 172.21.15.50:0/2358173517 shutdown_connections 2023-01-04T18:18:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.016+0000 7f2695ffd700 1 --2- 172.21.15.50:0/2358173517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26900f77c0 0x7f26900f7c20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.016+0000 7f2695ffd700 1 --2- 172.21.15.50:0/2358173517 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26900f6520 0x7f26900f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:25.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.016+0000 7f2695ffd700 1 -- 172.21.15.50:0/2358173517 >> 172.21.15.50:0/2358173517 conn(0x7f26900f1ca0 msgr2=0x7f26900f40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:25.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.017+0000 7f2695ffd700 1 -- 172.21.15.50:0/2358173517 shutdown_connections 2023-01-04T18:18:25.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.017+0000 7f2695ffd700 1 -- 172.21.15.50:0/2358173517 wait complete. 2023-01-04T18:18:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.017+0000 7f2695ffd700 1 Processor -- start 2023-01-04T18:18:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.017+0000 7f2695ffd700 1 -- start start 2023-01-04T18:18:25.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.018+0000 7f2695ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26900f6520 0x7f269006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.018+0000 7f2695ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26900f77c0 0x7f2690069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.018+0000 7f2695ffd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269006a380 con 0x7f26900f6520 2023-01-04T18:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.018+0000 7f2695ffd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269006a4c0 con 0x7f26900f77c0 2023-01-04T18:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.018+0000 7f2694ffb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26900f6520 0x7f269006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.018+0000 7f2694ffb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26900f6520 0x7f269006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45790/0 (socket says 172.21.15.50:45790) 2023-01-04T18:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.018+0000 7f2694ffb700 1 -- 172.21.15.50:0/1702785148 learned_addr learned my addr 172.21.15.50:0/1702785148 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.018+0000 7f268ffff700 1 --2- 172.21.15.50:0/1702785148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26900f77c0 0x7f2690069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.018+0000 7f2694ffb700 1 -- 172.21.15.50:0/1702785148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26900f77c0 msgr2=0x7f2690069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.018+0000 7f2694ffb700 1 --2- 172.21.15.50:0/1702785148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26900f77c0 0x7f2690069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:25.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.018+0000 7f2694ffb700 1 -- 172.21.15.50:0/1702785148 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267c005040 con 0x7f26900f6520 2023-01-04T18:18:25.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.018+0000 7f2694ffb700 1 --2- 172.21.15.50:0/1702785148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26900f6520 0x7f269006b9a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f268400e7c0 tx=0x7f268400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:25.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.019+0000 7f268d7fa700 1 -- 172.21.15.50:0/1702785148 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26840092e0 con 0x7f26900f6520 2023-01-04T18:18:25.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.019+0000 7f2695ffd700 1 -- 172.21.15.50:0/1702785148 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269006a7a0 con 0x7f26900f6520 2023-01-04T18:18:25.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.019+0000 7f268d7fa700 1 -- 172.21.15.50:0/1702785148 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f268400f040 con 0x7f26900f6520 2023-01-04T18:18:25.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.019+0000 7f268d7fa700 1 -- 172.21.15.50:0/1702785148 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2684014810 con 0x7f26900f6520 2023-01-04T18:18:25.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.019+0000 7f2695ffd700 1 -- 172.21.15.50:0/1702785148 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269010ed00 con 0x7f26900f6520 2023-01-04T18:18:25.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.020+0000 7f2695ffd700 1 -- 172.21.15.50:0/1702785148 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2690045ad0 con 0x7f26900f6520 2023-01-04T18:18:25.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.020+0000 7f268d7fa700 1 -- 172.21.15.50:0/1702785148 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 77020+0+0 (secure 0 0 0) 0x7f268401b030 con 0x7f26900f6520 2023-01-04T18:18:25.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.020+0000 7f268d7fa700 1 --2- 172.21.15.50:0/1702785148 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2680060cc0 0x7f2680063180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:25.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.021+0000 7f268d7fa700 1 -- 172.21.15.50:0/1702785148 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f268407bdf0 con 0x7f26900f6520 2023-01-04T18:18:25.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.021+0000 7f268ffff700 1 --2- 172.21.15.50:0/1702785148 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2680060cc0 0x7f2680063180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:25.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.021+0000 7f268ffff700 1 --2- 172.21.15.50:0/1702785148 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2680060cc0 0x7f2680063180 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f267c009720 tx=0x7f267c016040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:25.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.025+0000 7f268d7fa700 1 -- 172.21.15.50:0/1702785148 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f268404c540 con 0x7f26900f6520 2023-01-04T18:18:25.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.230+0000 7f2695ffd700 1 -- 172.21.15.50:0/1702785148 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f26900fedc0 con 0x7f2680060cc0 2023-01-04T18:18:25.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.232+0000 7f268d7fa700 1 -- 172.21.15.50:0/1702785148 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f26900fedc0 con 0x7f2680060cc0 2023-01-04T18:18:25.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.235+0000 7f2695ffd700 1 -- 172.21.15.50:0/1702785148 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2680060cc0 msgr2=0x7f2680063180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:25.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.235+0000 7f2695ffd700 1 --2- 172.21.15.50:0/1702785148 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2680060cc0 0x7f2680063180 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f267c009720 tx=0x7f267c016040).stop 2023-01-04T18:18:25.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.235+0000 7f2695ffd700 1 -- 172.21.15.50:0/1702785148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26900f6520 msgr2=0x7f269006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:25.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.235+0000 7f2695ffd700 1 --2- 172.21.15.50:0/1702785148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26900f6520 0x7f269006b9a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f268400e7c0 tx=0x7f268400b040).stop 2023-01-04T18:18:25.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.235+0000 7f2695ffd700 1 -- 172.21.15.50:0/1702785148 shutdown_connections 2023-01-04T18:18:25.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.235+0000 7f2695ffd700 1 --2- 172.21.15.50:0/1702785148 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2680060cc0 0x7f2680063180 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:25.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.235+0000 7f2695ffd700 1 --2- 172.21.15.50:0/1702785148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26900f6520 0x7f269006b9a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:25.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.235+0000 7f2695ffd700 1 --2- 172.21.15.50:0/1702785148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26900f77c0 0x7f2690069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:25.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.235+0000 7f2695ffd700 1 -- 172.21.15.50:0/1702785148 >> 172.21.15.50:0/1702785148 conn(0x7f26900f1ca0 msgr2=0x7f26900fb210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:25.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.236+0000 7f2695ffd700 1 -- 172.21.15.50:0/1702785148 shutdown_connections 2023-01-04T18:18:25.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.236+0000 7f2695ffd700 1 -- 172.21.15.50:0/1702785148 wait complete. 2023-01-04T18:18:25.254 INFO:teuthology.orchestra.run.smithi050.stdout:true 2023-01-04T18:18:25.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.378+0000 7fa8e2a9e700 1 -- 172.21.15.50:0/1442997789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8dc069540 msgr2=0x7fa8dc067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:25.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.378+0000 7fa8e2a9e700 1 --2- 172.21.15.50:0/1442997789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8dc069540 0x7fa8dc067bd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa8d80046e0 tx=0x7fa8d8009b30).stop 2023-01-04T18:18:25.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.382+0000 7fa8e2a9e700 1 -- 172.21.15.50:0/1442997789 shutdown_connections 2023-01-04T18:18:25.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.382+0000 7fa8e2a9e700 1 --2- 172.21.15.50:0/1442997789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8dc0680c0 0x7fa8dc068540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-01-04T18:18:25.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.382+0000 7fa8e2a9e700 1 --2- 172.21.15.50:0/1442997789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8dc069540 0x7fa8dc067bd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:25.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.382+0000 7fa8e2a9e700 1 -- 172.21.15.50:0/1442997789 >> 172.21.15.50:0/1442997789 conn(0x7fa8dc063530 msgr2=0x7fa8dc065950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:25.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.393+0000 7fa8e2a9e700 1 -- 172.21.15.50:0/1442997789 shutdown_connections 2023-01-04T18:18:25.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.393+0000 7fa8e2a9e700 1 -- 172.21.15.50:0/1442997789 wait complete. 2023-01-04T18:18:25.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.394+0000 7fa8e2a9e700 1 Processor -- start 2023-01-04T18:18:25.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.394+0000 7fa8e2a9e700 1 -- start start 2023-01-04T18:18:25.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.394+0000 7fa8e2a9e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8dc0680c0 0x7fa8dc10d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:25.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.394+0000 7fa8e2a9e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8dc069540 0x7fa8dc10d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:25.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.394+0000 7fa8e2a9e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc10dfb0 con 0x7fa8dc069540 2023-01-04T18:18:25.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.394+0000 7fa8e2a9e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc10e860 con 0x7fa8dc0680c0 2023-01-04T18:18:25.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.396+0000 7fa8e129b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8dc069540 0x7fa8dc10d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:25.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.396+0000 7fa8e129b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8dc069540 0x7fa8dc10d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45814/0 (socket says 172.21.15.50:45814) 2023-01-04T18:18:25.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.396+0000 7fa8e129b700 1 -- 172.21.15.50:0/2088228196 learned_addr learned my addr 172.21.15.50:0/2088228196 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:18:25.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.399+0000 7fa8e1a9c700 1 --2- 172.21.15.50:0/2088228196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8dc0680c0 0x7fa8dc10d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:25.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.400+0000 7fa8e1a9c700 1 -- 172.21.15.50:0/2088228196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8dc069540 msgr2=0x7fa8dc10d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:25.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.400+0000 7fa8e1a9c700 1 --2- 172.21.15.50:0/2088228196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8dc069540 0x7fa8dc10d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:25.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.400+0000 7fa8e1a9c700 1 -- 172.21.15.50:0/2088228196 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d8005040 con 0x7fa8dc0680c0 2023-01-04T18:18:25.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.400+0000 7fa8e1a9c700 1 --2- 172.21.15.50:0/2088228196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8dc0680c0 0x7fa8dc10d480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fa8d80046e0 tx=0x7fa8d8009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:25.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.400+0000 7fa8d27fc700 1 -- 172.21.15.50:0/2088228196 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8d802a070 con 0x7fa8dc0680c0 2023-01-04T18:18:25.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.400+0000 7fa8d27fc700 1 -- 172.21.15.50:0/2088228196 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa8d8004160 con 0x7fa8dc0680c0 2023-01-04T18:18:25.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.400+0000 7fa8d27fc700 1 -- 172.21.15.50:0/2088228196 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8d802ec50 con 0x7fa8dc0680c0 2023-01-04T18:18:25.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.405+0000 7fa8e2a9e700 1 -- 172.21.15.50:0/2088228196 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8dc10eae0 con 0x7fa8dc0680c0 2023-01-04T18:18:25.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.405+0000 7fa8e2a9e700 1 -- 172.21.15.50:0/2088228196 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8dc10f010 con 0x7fa8dc0680c0 2023-01-04T18:18:25.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.409+0000 7fa8e2a9e700 1 -- 172.21.15.50:0/2088228196 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8dc059100 con 0x7fa8dc0680c0 2023-01-04T18:18:25.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.409+0000 7fa8d27fc700 1 -- 172.21.15.50:0/2088228196 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 29) v1 ==== 77020+0+0 (secure 0 0 0) 0x7fa8d802e410 con 0x7fa8dc0680c0 2023-01-04T18:18:25.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.410+0000 7fa8d27fc700 1 --2- 172.21.15.50:0/2088228196 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa8c8060d10 0x7fa8c80631d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:25.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.410+0000 7fa8d27fc700 1 -- 172.21.15.50:0/2088228196 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fa8d808dbb0 con 0x7fa8dc0680c0 2023-01-04T18:18:25.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.415+0000 7fa8e129b700 1 --2- 172.21.15.50:0/2088228196 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa8c8060d10 0x7fa8c80631d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:25.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.416+0000 7fa8e129b700 1 --2- 172.21.15.50:0/2088228196 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa8c8060d10 0x7fa8c80631d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fa8cc006fd0 tx=0x7fa8cc008040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:25.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.418+0000 7fa8d27fc700 1 -- 172.21.15.50:0/2088228196 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fa8d8061be0 con 0x7fa8dc0680c0 2023-01-04T18:18:25.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:24.871892+0000 mon.smithi050 (mon.0) 51 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:18:25.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:24.878465+0000 mon.smithi050 (mon.0) 52 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:18:25.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.716+0000 7fa8e2a9e700 1 -- 172.21.15.50:0/2088228196 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8dc105400 con 0x7fa8c8060d10 2023-01-04T18:18:25.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.717+0000 7fa8d27fc700 1 -- 172.21.15.50:0/2088228196 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fa8dc105400 con 0x7fa8c8060d10 2023-01-04T18:18:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.719+0000 7fa8e2a9e700 1 -- 172.21.15.50:0/2088228196 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa8c8060d10 msgr2=0x7fa8c80631d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.719+0000 7fa8e2a9e700 1 --2- 172.21.15.50:0/2088228196 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa8c8060d10 0x7fa8c80631d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fa8cc006fd0 tx=0x7fa8cc008040).stop 2023-01-04T18:18:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.719+0000 7fa8e2a9e700 1 -- 172.21.15.50:0/2088228196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8dc0680c0 msgr2=0x7fa8dc10d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.719+0000 7fa8e2a9e700 1 --2- 172.21.15.50:0/2088228196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8dc0680c0 0x7fa8dc10d480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fa8d80046e0 tx=0x7fa8d8009b30).stop 2023-01-04T18:18:25.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.719+0000 7fa8e2a9e700 1 -- 172.21.15.50:0/2088228196 shutdown_connections 2023-01-04T18:18:25.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.719+0000 7fa8e2a9e700 1 --2- 172.21.15.50:0/2088228196 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa8c8060d10 0x7fa8c80631d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:25.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.719+0000 7fa8e2a9e700 1 --2- 172.21.15.50:0/2088228196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8dc0680c0 0x7fa8dc10d480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:25.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.719+0000 7fa8e2a9e700 1 --2- 172.21.15.50:0/2088228196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8dc069540 0x7fa8dc10d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:25.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.719+0000 7fa8e2a9e700 1 -- 172.21.15.50:0/2088228196 >> 172.21.15.50:0/2088228196 conn(0x7fa8dc063530 msgr2=0x7fa8dc101300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:25.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.719+0000 7fa8e2a9e700 1 -- 172.21.15.50:0/2088228196 shutdown_connections 2023-01-04T18:18:25.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.719+0000 7fa8e2a9e700 1 -- 172.21.15.50:0/2088228196 wait complete. 2023-01-04T18:18:25.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:24.871892+0000 mon.smithi050 (mon.0) 51 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:18:25.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:24.878465+0000 mon.smithi050 (mon.0) 52 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:18:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.860+0000 7f707f59e700 1 -- 172.21.15.50:0/3997556931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70800f77d0 msgr2=0x7f70800f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.860+0000 7f707f59e700 1 --2- 172.21.15.50:0/3997556931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70800f77d0 0x7f70800f7c30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7074004660 tx=0x7f7074009b30).stop 2023-01-04T18:18:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.860+0000 7f707f59e700 1 -- 172.21.15.50:0/3997556931 shutdown_connections 2023-01-04T18:18:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.860+0000 7f707f59e700 1 --2- 172.21.15.50:0/3997556931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70800f77d0 0x7f70800f7c30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.860+0000 7f707f59e700 1 --2- 172.21.15.50:0/3997556931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70800f6530 0x7f70800f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.860+0000 7f707f59e700 1 -- 172.21.15.50:0/3997556931 >> 172.21.15.50:0/3997556931 conn(0x7f70800f1c90 msgr2=0x7f70800f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.860+0000 7f707f59e700 1 -- 172.21.15.50:0/3997556931 shutdown_connections 2023-01-04T18:18:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.860+0000 7f707f59e700 1 -- 172.21.15.50:0/3997556931 wait complete. 2023-01-04T18:18:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.861+0000 7f707f59e700 1 Processor -- start 2023-01-04T18:18:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.861+0000 7f707f59e700 1 -- start start 2023-01-04T18:18:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.861+0000 7f707f59e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70800f6530 0x7f708006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.861+0000 7f707f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70800f77d0 0x7f7080069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.862+0000 7f707f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708010a980 con 0x7f70800f77d0 2023-01-04T18:18:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.862+0000 7f707f59e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708010aac0 con 0x7f70800f6530 2023-01-04T18:18:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.862+0000 7f707dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70800f77d0 0x7f7080069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.862+0000 7f707e59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70800f6530 0x7f708006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.862+0000 7f707e59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70800f6530 0x7f708006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.50:38552/0 (socket says 172.21.15.50:38552) 2023-01-04T18:18:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.862+0000 7f707e59c700 1 -- 172.21.15.50:0/3857740988 learned_addr learned my addr 172.21.15.50:0/3857740988 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:18:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.862+0000 7f707dd9b700 1 -- 172.21.15.50:0/3857740988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70800f6530 msgr2=0x7f708006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.862+0000 7f707dd9b700 1 --2- 172.21.15.50:0/3857740988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70800f6530 0x7f708006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.862+0000 7f707dd9b700 1 -- 172.21.15.50:0/3857740988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7074005040 con 0x7f70800f77d0 2023-01-04T18:18:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.862+0000 7f707e59c700 1 --2- 172.21.15.50:0/3857740988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70800f6530 0x7f708006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-01-04T18:18:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.862+0000 7f707dd9b700 1 --2- 172.21.15.50:0/3857740988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70800f77d0 0x7f7080069e20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7074011000 tx=0x7f707400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.862+0000 7f706effd700 1 -- 172.21.15.50:0/3857740988 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7074019070 con 0x7f70800f77d0 2023-01-04T18:18:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.862+0000 7f706effd700 1 -- 172.21.15.50:0/3857740988 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7074013380 con 0x7f70800f77d0 2023-01-04T18:18:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.862+0000 7f706effd700 1 -- 172.21.15.50:0/3857740988 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f707401ed00 con 0x7f70800f77d0 2023-01-04T18:18:25.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.862+0000 7f707f59e700 1 -- 172.21.15.50:0/3857740988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f708006a370 con 0x7f70800f77d0 2023-01-04T18:18:25.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.863+0000 7f707f59e700 1 -- 172.21.15.50:0/3857740988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f708006a850 con 0x7f70800f77d0 2023-01-04T18:18:25.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.864+0000 7f707f59e700 1 -- 172.21.15.50:0/3857740988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7080045ad0 con 0x7f70800f77d0 2023-01-04T18:18:25.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.864+0000 7f706effd700 1 -- 172.21.15.50:0/3857740988 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 77020+0+0 (secure 0 0 0) 0x7f707401e420 con 0x7f70800f77d0 2023-01-04T18:18:25.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.864+0000 7f706effd700 1 --2- 172.21.15.50:0/3857740988 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7068060cc0 0x7f7068063180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:25.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.864+0000 7f706effd700 1 -- 172.21.15.50:0/3857740988 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f707407d0c0 con 0x7f70800f77d0 2023-01-04T18:18:25.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.864+0000 7f707e59c700 1 --2- 172.21.15.50:0/3857740988 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7068060cc0 0x7f7068063180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:25.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.865+0000 7f707e59c700 1 --2- 172.21.15.50:0/3857740988 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7068060cc0 0x7f7068063180 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7070004fd0 tx=0x7f707000b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:25.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:25.869+0000 7f706effd700 1 -- 172.21.15.50:0/3857740988 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f707404d670 con 0x7f70800f77d0 2023-01-04T18:18:26.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.127+0000 7f707f59e700 1 -- 172.21.15.50:0/3857740988 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f708006aac0 con 0x7f7068060cc0 2023-01-04T18:18:26.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.136+0000 7f706effd700 1 -- 172.21.15.50:0/3857740988 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f708006aac0 con 0x7f7068060cc0 2023-01-04T18:18:26.139 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-01-04T18:18:26.140 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager.smithi050 smithi050 *:9093,9094 running (6m) 29s ago 7m 18.1M - 0.20.0 0881eb8f169f b5d3e2678a23 2023-01-04T18:18:26.140 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi050 smithi050 starting - - - - 2023-01-04T18:18:26.140 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi098 smithi098 starting - - - - 2023-01-04T18:18:26.140 INFO:teuthology.orchestra.run.smithi050.stdout:grafana.smithi050 smithi050 *:3000 running (6m) 29s ago 7m 37.0M - 6.7.4 557c83e11646 7e5dccbafe78 2023-01-04T18:18:26.140 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.ezoiwl smithi050 running (3m) 29s ago 3m 7003M - 16.2.4 8d91d370c2b8 6c5c5f2be8b9 2023-01-04T18:18:26.140 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.kefmuy smithi050 running (3m) 29s ago 3m 17.7M - 16.2.4 8d91d370c2b8 58cace913b55 2023-01-04T18:18:26.141 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.laynsk smithi098 running (3m) 19s ago 3m 15.6M - 16.2.4 8d91d370c2b8 8ff8af70b989 2023-01-04T18:18:26.141 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.memais smithi098 running (3m) 19s ago 3m 925M - 16.2.4 8d91d370c2b8 d59d9b4dbf7d 2023-01-04T18:18:26.141 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi050.emnywo smithi050 *:8443,9283 running (74s) 29s ago 9m 432M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d ee677216e754 2023-01-04T18:18:26.141 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi098.vhfzum smithi098 *:8443,9283 running (48s) 19s ago 7m 394M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d f3d98bf0cf66 2023-01-04T18:18:26.141 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi050 smithi050 running (39s) 29s ago 9m 33.7M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 0423819cbaa7 2023-01-04T18:18:26.141 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi098 smithi098 running (25s) 19s ago 7m 33.9M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 12094818aefc 2023-01-04T18:18:26.141 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi050 smithi050 *:9100 running (7m) 29s ago 7m 18.3M - 0.18.1 e5a616e4b9cf 88892b2e5e5a 2023-01-04T18:18:26.141 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi098 smithi098 *:9100 running (7m) 19s ago 7m 18.4M - 0.18.1 e5a616e4b9cf 49bcde8331b6 2023-01-04T18:18:26.141 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (6m) 29s ago 6m 715M 4096M 16.2.4 8d91d370c2b8 b46676195180 2023-01-04T18:18:26.141 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi050 running (6m) 29s ago 6m 720M 4096M 16.2.4 8d91d370c2b8 e4928bcfd146 2023-01-04T18:18:26.141 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi050 running (6m) 29s ago 6m 636M 4096M 16.2.4 8d91d370c2b8 babab394b338 2023-01-04T18:18:26.141 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi098 running (5m) 19s ago 5m 984M 4096M 16.2.4 8d91d370c2b8 b02df8e3cb23 2023-01-04T18:18:26.142 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi098 running (5m) 19s ago 5m 753M 4096M 16.2.4 8d91d370c2b8 92273135ca82 2023-01-04T18:18:26.142 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi098 running (5m) 19s ago 5m 787M 4096M 16.2.4 8d91d370c2b8 366d0bfff809 2023-01-04T18:18:26.142 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus.smithi050 smithi050 *:9095 running (85s) 29s ago 7m 50.5M - 2.18.1 de242295e225 7bdcf7a45d34 2023-01-04T18:18:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.138+0000 7f707f59e700 1 -- 172.21.15.50:0/3857740988 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7068060cc0 msgr2=0x7f7068063180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:26.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.138+0000 7f707f59e700 1 --2- 172.21.15.50:0/3857740988 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7068060cc0 0x7f7068063180 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7070004fd0 tx=0x7f707000b040).stop 2023-01-04T18:18:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.138+0000 7f707f59e700 1 -- 172.21.15.50:0/3857740988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70800f77d0 msgr2=0x7f7080069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.138+0000 7f707f59e700 1 --2- 172.21.15.50:0/3857740988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70800f77d0 0x7f7080069e20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7074011000 tx=0x7f707400b040).stop 2023-01-04T18:18:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.138+0000 7f707f59e700 1 -- 172.21.15.50:0/3857740988 shutdown_connections 2023-01-04T18:18:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.138+0000 7f707f59e700 1 --2- 172.21.15.50:0/3857740988 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7068060cc0 0x7f7068063180 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.138+0000 7f707f59e700 1 --2- 172.21.15.50:0/3857740988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70800f6530 0x7f708006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.138+0000 7f707f59e700 1 --2- 172.21.15.50:0/3857740988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70800f77d0 0x7f7080069e20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.138+0000 7f707f59e700 1 -- 172.21.15.50:0/3857740988 >> 172.21.15.50:0/3857740988 conn(0x7f70800f1c90 msgr2=0x7f70800fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.138+0000 7f707f59e700 1 -- 172.21.15.50:0/3857740988 shutdown_connections 2023-01-04T18:18:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.138+0000 7f707f59e700 1 -- 172.21.15.50:0/3857740988 wait complete. 2023-01-04T18:18:26.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.278+0000 7efbfc426700 1 -- 172.21.15.50:0/476272989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efbf40602b0 msgr2=0x7efbf40fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:26.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.278+0000 7efbfc426700 1 --2- 172.21.15.50:0/476272989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efbf40602b0 0x7efbf40fb700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7efbf0004660 tx=0x7efbf0009b30).stop 2023-01-04T18:18:26.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.278+0000 7efbfc426700 1 -- 172.21.15.50:0/476272989 shutdown_connections 2023-01-04T18:18:26.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.278+0000 7efbfc426700 1 --2- 172.21.15.50:0/476272989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efbf40fbbf0 0x7efbf40fdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:26.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.278+0000 7efbfc426700 1 --2- 172.21.15.50:0/476272989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efbf40602b0 0x7efbf40fb700 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:26.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.278+0000 7efbfc426700 1 -- 172.21.15.50:0/476272989 >> 172.21.15.50:0/476272989 conn(0x7efbf40f0d40 msgr2=0x7efbf40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:26.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.278+0000 7efbfc426700 1 -- 172.21.15.50:0/476272989 shutdown_connections 2023-01-04T18:18:26.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.278+0000 7efbfc426700 1 -- 172.21.15.50:0/476272989 wait complete. 2023-01-04T18:18:26.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.279+0000 7efbfc426700 1 Processor -- start 2023-01-04T18:18:26.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.279+0000 7efbfc426700 1 -- start start 2023-01-04T18:18:26.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.279+0000 7efbfc426700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efbf40602b0 0x7efbf4109100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:26.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.279+0000 7efbfc426700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efbf40fbbf0 0x7efbf41095f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:26.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.279+0000 7efbfc426700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf4109ba0 con 0x7efbf40fbbf0 2023-01-04T18:18:26.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.279+0000 7efbfc426700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf4109ce0 con 0x7efbf40602b0 2023-01-04T18:18:26.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.279+0000 7efbf99c1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efbf40fbbf0 0x7efbf41095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:26.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.279+0000 7efbf99c1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efbf40fbbf0 0x7efbf41095f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45840/0 (socket says 172.21.15.50:45840) 2023-01-04T18:18:26.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.279+0000 7efbfa1c2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efbf40602b0 0x7efbf4109100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:26.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.279+0000 7efbf99c1700 1 -- 172.21.15.50:0/3233441692 learned_addr learned my addr 172.21.15.50:0/3233441692 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:18:26.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.279+0000 7efbf99c1700 1 -- 172.21.15.50:0/3233441692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efbf40602b0 msgr2=0x7efbf4109100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:26.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.279+0000 7efbf99c1700 1 --2- 172.21.15.50:0/3233441692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efbf40602b0 0x7efbf4109100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:26.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.279+0000 7efbf99c1700 1 -- 172.21.15.50:0/3233441692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe4005040 con 0x7efbf40fbbf0 2023-01-04T18:18:26.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.280+0000 7efbf99c1700 1 --2- 172.21.15.50:0/3233441692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efbf40fbbf0 0x7efbf41095f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7efbe4004870 tx=0x7efbe4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:26.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.280+0000 7efbeaffd700 1 -- 172.21.15.50:0/3233441692 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efbe400e030 con 0x7efbf40fbbf0 2023-01-04T18:18:26.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.280+0000 7efbfc426700 1 -- 172.21.15.50:0/3233441692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf0005040 con 0x7efbf40fbbf0 2023-01-04T18:18:26.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.280+0000 7efbeaffd700 1 -- 172.21.15.50:0/3233441692 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7efbe400f040 con 0x7efbf40fbbf0 2023-01-04T18:18:26.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.280+0000 7efbeaffd700 1 -- 172.21.15.50:0/3233441692 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efbe4014830 con 0x7efbf40fbbf0 2023-01-04T18:18:26.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.280+0000 7efbfc426700 1 -- 172.21.15.50:0/3233441692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf410aa30 con 0x7efbf40fbbf0 2023-01-04T18:18:26.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.281+0000 7efbfc426700 1 -- 172.21.15.50:0/3233441692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf4045ad0 con 0x7efbf40fbbf0 2023-01-04T18:18:26.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.281+0000 7efbeaffd700 1 -- 172.21.15.50:0/3233441692 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 77020+0+0 (secure 0 0 0) 0x7efbe4010500 con 0x7efbf40fbbf0 2023-01-04T18:18:26.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.282+0000 7efbeaffd700 1 --2- 172.21.15.50:0/3233441692 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7efbe0060c70 0x7efbe0063130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:26.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.282+0000 7efbeaffd700 1 -- 172.21.15.50:0/3233441692 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7efbe407c410 con 0x7efbf40fbbf0 2023-01-04T18:18:26.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.282+0000 7efbfa1c2700 1 --2- 172.21.15.50:0/3233441692 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7efbe0060c70 0x7efbe0063130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:26.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.282+0000 7efbfa1c2700 1 --2- 172.21.15.50:0/3233441692 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7efbe0060c70 0x7efbe0063130 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7efbf0009720 tx=0x7efbf0016040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:26.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.287+0000 7efbeaffd700 1 -- 172.21.15.50:0/3233441692 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7efbe4050370 con 0x7efbf40fbbf0 2023-01-04T18:18:26.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.703+0000 7efbfc426700 1 -- 172.21.15.50:0/3233441692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efbf4101070 con 0x7efbf40fbbf0 2023-01-04T18:18:26.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.704+0000 7efbeaffd700 1 -- 172.21.15.50:0/3233441692 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+715 (secure 0 0 0) 0x7efbe404ff60 con 0x7efbf40fbbf0 2023-01-04T18:18:26.707 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:18:26.707 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": { 2023-01-04T18:18:26.707 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:18:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:18:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": { 2023-01-04T18:18:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:18:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:18:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": { 2023-01-04T18:18:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2023-01-04T18:18:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:18:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2023-01-04T18:18:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-01-04T18:18:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:18:26.708 INFO:teuthology.orchestra.run.smithi050.stdout: "overall": { 2023-01-04T18:18:26.709 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 4, 2023-01-04T18:18:26.709 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 10 2023-01-04T18:18:26.709 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-01-04T18:18:26.709 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:18:26.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.706+0000 7efbfc426700 1 -- 172.21.15.50:0/3233441692 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7efbe0060c70 msgr2=0x7efbe0063130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.706+0000 7efbfc426700 1 --2- 172.21.15.50:0/3233441692 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7efbe0060c70 0x7efbe0063130 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7efbf0009720 tx=0x7efbf0016040).stop 2023-01-04T18:18:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.706+0000 7efbfc426700 1 -- 172.21.15.50:0/3233441692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efbf40fbbf0 msgr2=0x7efbf41095f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.706+0000 7efbfc426700 1 --2- 172.21.15.50:0/3233441692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efbf40fbbf0 0x7efbf41095f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7efbe4004870 tx=0x7efbe4009b30).stop 2023-01-04T18:18:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.706+0000 7efbfc426700 1 -- 172.21.15.50:0/3233441692 shutdown_connections 2023-01-04T18:18:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.706+0000 7efbfc426700 1 --2- 172.21.15.50:0/3233441692 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7efbe0060c70 0x7efbe0063130 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.706+0000 7efbfc426700 1 --2- 172.21.15.50:0/3233441692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efbf40602b0 0x7efbf4109100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.706+0000 7efbfc426700 1 --2- 172.21.15.50:0/3233441692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efbf40fbbf0 0x7efbf41095f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.706+0000 7efbfc426700 1 -- 172.21.15.50:0/3233441692 >> 172.21.15.50:0/3233441692 conn(0x7efbf40f0d40 msgr2=0x7efbf40f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.706+0000 7efbfc426700 1 -- 172.21.15.50:0/3233441692 shutdown_connections 2023-01-04T18:18:26.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.706+0000 7efbfc426700 1 -- 172.21.15.50:0/3233441692 wait complete. 2023-01-04T18:18:26.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:24.606795+0000 mgr.smithi050.emnywo (mgr.24517) 53 : cluster [DBG] pgmap v34: 65 pgs: 65 active+clean; 270 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 797 op/s 2023-01-04T18:18:26.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:25.232739+0000 mgr.smithi050.emnywo (mgr.24517) 54 : audit [DBG] from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:18:26.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.826+0000 7f1759871700 1 -- 172.21.15.50:0/3742866515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17540f51a0 msgr2=0x7f17540f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:26.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.826+0000 7f1759871700 1 --2- 172.21.15.50:0/3742866515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17540f51a0 0x7f17540f7920 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1740004660 tx=0x7f1740009b30).stop 2023-01-04T18:18:26.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.826+0000 7f1759871700 1 -- 172.21.15.50:0/3742866515 shutdown_connections 2023-01-04T18:18:26.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.826+0000 7f1759871700 1 --2- 172.21.15.50:0/3742866515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17540f51a0 0x7f17540f7920 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:26.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.826+0000 7f1759871700 1 --2- 172.21.15.50:0/3742866515 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17540f4800 0x7f17540f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:26.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.826+0000 7f1759871700 1 -- 172.21.15.50:0/3742866515 >> 172.21.15.50:0/3742866515 conn(0x7f17540f0320 msgr2=0x7f17540f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:26.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.826+0000 7f1759871700 1 -- 172.21.15.50:0/3742866515 shutdown_connections 2023-01-04T18:18:26.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.826+0000 7f1759871700 1 -- 172.21.15.50:0/3742866515 wait complete. 2023-01-04T18:18:26.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:24.606795+0000 mgr.smithi050.emnywo (mgr.24517) 53 : cluster [DBG] pgmap v34: 65 pgs: 65 active+clean; 270 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 797 op/s 2023-01-04T18:18:26.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:25.232739+0000 mgr.smithi050.emnywo (mgr.24517) 54 : audit [DBG] from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:18:26.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.826+0000 7f1759871700 1 Processor -- start 2023-01-04T18:18:26.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.827+0000 7f1759871700 1 -- start start 2023-01-04T18:18:26.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.827+0000 7f1759871700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17540f4800 0x7f1754106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:26.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.827+0000 7f1759871700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17540f51a0 0x7f1754107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:26.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.827+0000 7f1759871700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1754107850 con 0x7f17540f51a0 2023-01-04T18:18:26.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.827+0000 7f1759871700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1754108060 con 0x7f17540f4800 2023-01-04T18:18:26.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.827+0000 7f1753fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17540f51a0 0x7f1754107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:26.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.827+0000 7f175886f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17540f4800 0x7f1754106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:26.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.827+0000 7f1753fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17540f51a0 0x7f1754107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32920/0 (socket says 172.21.15.50:32920) 2023-01-04T18:18:26.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.827+0000 7f1753fff700 1 -- 172.21.15.50:0/2050274782 learned_addr learned my addr 172.21.15.50:0/2050274782 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:18:26.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.827+0000 7f1753fff700 1 -- 172.21.15.50:0/2050274782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17540f4800 msgr2=0x7f1754106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:26.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.827+0000 7f1753fff700 1 --2- 172.21.15.50:0/2050274782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17540f4800 0x7f1754106d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:26.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.827+0000 7f1753fff700 1 -- 172.21.15.50:0/2050274782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1740005040 con 0x7f17540f51a0 2023-01-04T18:18:26.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.828+0000 7f1753fff700 1 --2- 172.21.15.50:0/2050274782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17540f51a0 0x7f1754107250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f1740014040 tx=0x7f174000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:26.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.828+0000 7f17517fa700 1 -- 172.21.15.50:0/2050274782 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1740019070 con 0x7f17540f51a0 2023-01-04T18:18:26.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.828+0000 7f17517fa700 1 -- 172.21.15.50:0/2050274782 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f174001e420 con 0x7f17540f51a0 2023-01-04T18:18:26.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.828+0000 7f1759871700 1 -- 172.21.15.50:0/2050274782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1754108280 con 0x7f17540f51a0 2023-01-04T18:18:26.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.828+0000 7f17517fa700 1 -- 172.21.15.50:0/2050274782 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1740014620 con 0x7f17540f51a0 2023-01-04T18:18:26.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.828+0000 7f1759871700 1 -- 172.21.15.50:0/2050274782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1754108760 con 0x7f17540f51a0 2023-01-04T18:18:26.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.829+0000 7f1759871700 1 -- 172.21.15.50:0/2050274782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1754059100 con 0x7f17540f51a0 2023-01-04T18:18:26.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.829+0000 7f17517fa700 1 -- 172.21.15.50:0/2050274782 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 77020+0+0 (secure 0 0 0) 0x7f174001e9e0 con 0x7f17540f51a0 2023-01-04T18:18:26.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.830+0000 7f17517fa700 1 --2- 172.21.15.50:0/2050274782 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1744060cc0 0x7f1744063180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:26.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.830+0000 7f17517fa700 1 -- 172.21.15.50:0/2050274782 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f174007d1f0 con 0x7f17540f51a0 2023-01-04T18:18:26.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.830+0000 7f175886f700 1 --2- 172.21.15.50:0/2050274782 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1744060cc0 0x7f1744063180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:26.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.830+0000 7f175886f700 1 --2- 172.21.15.50:0/2050274782 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1744060cc0 0x7f1744063180 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f1754106ad0 tx=0x7f174800b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:26.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:26.834+0000 7f17517fa700 1 -- 172.21.15.50:0/2050274782 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f174004d780 con 0x7f17540f51a0 2023-01-04T18:18:27.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.114+0000 7f1759871700 1 -- 172.21.15.50:0/2050274782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f17540fedf0 con 0x7f17540f51a0 2023-01-04T18:18:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.115+0000 7f17517fa700 1 -- 172.21.15.50:0/2050274782 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1793 (secure 0 0 0) 0x7f1740004490 con 0x7f17540f51a0 2023-01-04T18:18:27.119 INFO:teuthology.orchestra.run.smithi050.stdout:e13 2023-01-04T18:18:27.119 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:18:27.119 INFO:teuthology.orchestra.run.smithi050.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:18:27.119 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-01-04T18:18:27.119 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:18:27.119 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-01-04T18:18:27.120 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-01-04T18:18:27.120 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 10 2023-01-04T18:18:27.120 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 2023-01-04T18:18:27.120 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:18:27.120 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-01-04T18:14:43.958806+0000 2023-01-04T18:18:27.120 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-01-04T18:18:27.120 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-01-04T18:18:27.120 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 60 2023-01-04T18:18:27.120 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-01-04T18:18:27.120 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-01-04T18:18:27.121 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-01-04T18:18:27.121 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-01-04T18:18:27.121 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 0 2023-01-04T18:18:27.121 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:18:27.121 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 1 2023-01-04T18:18:27.121 INFO:teuthology.orchestra.run.smithi050.stdout:in 0 2023-01-04T18:18:27.122 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=14430} 2023-01-04T18:18:27.122 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-01-04T18:18:27.122 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-01-04T18:18:27.122 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-01-04T18:18:27.122 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-01-04T18:18:27.123 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-01-04T18:18:27.123 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data enabled 2023-01-04T18:18:27.123 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-01-04T18:18:27.123 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 1 2023-01-04T18:18:27.123 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.ezoiwl{0:14430} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:18:27.123 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.memais{0:24291} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.98:6824/1196398070,v1:172.21.15.98:6825/1196398070] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:18:27.123 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:18:27.123 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:18:27.123 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2023-01-04T18:18:27.123 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:18:27.124 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.kefmuy{-1:14440} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:18:27.124 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.laynsk{-1:24297} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:18:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.118+0000 7f1759871700 1 -- 172.21.15.50:0/2050274782 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1744060cc0 msgr2=0x7f1744063180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.118+0000 7f1759871700 1 --2- 172.21.15.50:0/2050274782 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1744060cc0 0x7f1744063180 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f1754106ad0 tx=0x7f174800b040).stop 2023-01-04T18:18:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.118+0000 7f1759871700 1 -- 172.21.15.50:0/2050274782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17540f51a0 msgr2=0x7f1754107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.118+0000 7f1759871700 1 --2- 172.21.15.50:0/2050274782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17540f51a0 0x7f1754107250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f1740014040 tx=0x7f174000b040).stop 2023-01-04T18:18:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.119+0000 7f1759871700 1 -- 172.21.15.50:0/2050274782 shutdown_connections 2023-01-04T18:18:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.119+0000 7f1759871700 1 --2- 172.21.15.50:0/2050274782 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1744060cc0 0x7f1744063180 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.119+0000 7f1759871700 1 --2- 172.21.15.50:0/2050274782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17540f4800 0x7f1754106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.119+0000 7f1759871700 1 --2- 172.21.15.50:0/2050274782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17540f51a0 0x7f1754107250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.119+0000 7f1759871700 1 -- 172.21.15.50:0/2050274782 >> 172.21.15.50:0/2050274782 conn(0x7f17540f0320 msgr2=0x7f17540fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.119+0000 7f1759871700 1 -- 172.21.15.50:0/2050274782 shutdown_connections 2023-01-04T18:18:27.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.119+0000 7f1759871700 1 -- 172.21.15.50:0/2050274782 wait complete. 2023-01-04T18:18:27.126 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2023-01-04T18:18:27.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.230+0000 7fc130d75700 1 -- 172.21.15.50:0/3454987642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc12c0f66e0 msgr2=0x7fc12c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.230+0000 7fc130d75700 1 --2- 172.21.15.50:0/3454987642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc12c0f66e0 0x7fc12c0f6b00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fc11c004660 tx=0x7fc11c009b30).stop 2023-01-04T18:18:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.230+0000 7fc130d75700 1 -- 172.21.15.50:0/3454987642 shutdown_connections 2023-01-04T18:18:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.230+0000 7fc130d75700 1 --2- 172.21.15.50:0/3454987642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc12c0f7980 0x7fc12c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.230+0000 7fc130d75700 1 --2- 172.21.15.50:0/3454987642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc12c0f66e0 0x7fc12c0f6b00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.230+0000 7fc130d75700 1 -- 172.21.15.50:0/3454987642 >> 172.21.15.50:0/3454987642 conn(0x7fc12c0f1e40 msgr2=0x7fc12c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.230+0000 7fc130d75700 1 -- 172.21.15.50:0/3454987642 shutdown_connections 2023-01-04T18:18:27.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.230+0000 7fc130d75700 1 -- 172.21.15.50:0/3454987642 wait complete. 2023-01-04T18:18:27.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.231+0000 7fc130d75700 1 Processor -- start 2023-01-04T18:18:27.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.231+0000 7fc130d75700 1 -- start start 2023-01-04T18:18:27.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.231+0000 7fc130d75700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc12c0f66e0 0x7fc12c106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:27.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.231+0000 7fc130d75700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc12c0f7980 0x7fc12c1074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:27.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.231+0000 7fc130d75700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c107a70 con 0x7fc12c0f7980 2023-01-04T18:18:27.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.231+0000 7fc130d75700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c107bb0 con 0x7fc12c0f66e0 2023-01-04T18:18:27.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.231+0000 7fc129d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc12c0f7980 0x7fc12c1074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:27.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.231+0000 7fc129d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc12c0f7980 0x7fc12c1074c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32944/0 (socket says 172.21.15.50:32944) 2023-01-04T18:18:27.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.231+0000 7fc129d9b700 1 -- 172.21.15.50:0/2413837898 learned_addr learned my addr 172.21.15.50:0/2413837898 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:18:27.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.231+0000 7fc12a59c700 1 --2- 172.21.15.50:0/2413837898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc12c0f66e0 0x7fc12c106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:27.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.232+0000 7fc129d9b700 1 -- 172.21.15.50:0/2413837898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc12c0f66e0 msgr2=0x7fc12c106fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:27.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.232+0000 7fc129d9b700 1 --2- 172.21.15.50:0/2413837898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc12c0f66e0 0x7fc12c106fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.232+0000 7fc129d9b700 1 -- 172.21.15.50:0/2413837898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c005040 con 0x7fc12c0f7980 2023-01-04T18:18:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.232+0000 7fc12a59c700 1 --2- 172.21.15.50:0/2413837898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc12c0f66e0 0x7fc12c106fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-01-04T18:18:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.232+0000 7fc129d9b700 1 --2- 172.21.15.50:0/2413837898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc12c0f7980 0x7fc12c1074c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fc1200026d0 tx=0x7fc120009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.232+0000 7fc11affd700 1 -- 172.21.15.50:0/2413837898 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1200079c0 con 0x7fc12c0f7980 2023-01-04T18:18:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.232+0000 7fc11affd700 1 -- 172.21.15.50:0/2413837898 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc12000f040 con 0x7fc12c0f7980 2023-01-04T18:18:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.232+0000 7fc11affd700 1 -- 172.21.15.50:0/2413837898 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc120014980 con 0x7fc12c0f7980 2023-01-04T18:18:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.232+0000 7fc130d75700 1 -- 172.21.15.50:0/2413837898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc12c108550 con 0x7fc12c0f7980 2023-01-04T18:18:27.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.232+0000 7fc130d75700 1 -- 172.21.15.50:0/2413837898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc12c108b10 con 0x7fc12c0f7980 2023-01-04T18:18:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.233+0000 7fc130d75700 1 -- 172.21.15.50:0/2413837898 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12c045ad0 con 0x7fc12c0f7980 2023-01-04T18:18:27.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.234+0000 7fc11affd700 1 -- 172.21.15.50:0/2413837898 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 29) v1 ==== 77020+0+0 (secure 0 0 0) 0x7fc1200090d0 con 0x7fc12c0f7980 2023-01-04T18:18:27.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.234+0000 7fc11affd700 1 --2- 172.21.15.50:0/2413837898 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc114060cd0 0x7fc114063190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:27.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.235+0000 7fc11affd700 1 -- 172.21.15.50:0/2413837898 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fc12007bca0 con 0x7fc12c0f7980 2023-01-04T18:18:27.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.235+0000 7fc12a59c700 1 --2- 172.21.15.50:0/2413837898 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc114060cd0 0x7fc114063190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:27.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.235+0000 7fc12a59c700 1 --2- 172.21.15.50:0/2413837898 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc114060cd0 0x7fc114063190 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fc11c009f50 tx=0x7fc11c009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:27.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.239+0000 7fc11affd700 1 -- 172.21.15.50:0/2413837898 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fc12004fd90 con 0x7fc12c0f7980 2023-01-04T18:18:27.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.512+0000 7fc130d75700 1 -- 172.21.15.50:0/2413837898 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc12c0fefe0 con 0x7fc114060cd0 2023-01-04T18:18:27.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.515+0000 7fc11affd700 1 -- 172.21.15.50:0/2413837898 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fc12c0fefe0 con 0x7fc114060cd0 2023-01-04T18:18:27.528 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:18:27.528 INFO:teuthology.orchestra.run.smithi050.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308", 2023-01-04T18:18:27.528 INFO:teuthology.orchestra.run.smithi050.stdout: "in_progress": true, 2023-01-04T18:18:27.528 INFO:teuthology.orchestra.run.smithi050.stdout: "which": "Upgrading all daemon types on all hosts", 2023-01-04T18:18:27.528 INFO:teuthology.orchestra.run.smithi050.stdout: "services_complete": [ 2023-01-04T18:18:27.528 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr", 2023-01-04T18:18:27.528 INFO:teuthology.orchestra.run.smithi050.stdout: "mon" 2023-01-04T18:18:27.528 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-01-04T18:18:27.529 INFO:teuthology.orchestra.run.smithi050.stdout: "progress": "5/21 daemons upgraded", 2023-01-04T18:18:27.529 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "Currently upgrading crash daemons", 2023-01-04T18:18:27.529 INFO:teuthology.orchestra.run.smithi050.stdout: "is_paused": false 2023-01-04T18:18:27.529 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:18:27.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.533+0000 7fc130d75700 1 -- 172.21.15.50:0/2413837898 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc114060cd0 msgr2=0x7fc114063190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:27.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.533+0000 7fc130d75700 1 --2- 172.21.15.50:0/2413837898 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc114060cd0 0x7fc114063190 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fc11c009f50 tx=0x7fc11c009b30).stop 2023-01-04T18:18:27.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.533+0000 7fc130d75700 1 -- 172.21.15.50:0/2413837898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc12c0f7980 msgr2=0x7fc12c1074c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:27.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.533+0000 7fc130d75700 1 --2- 172.21.15.50:0/2413837898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc12c0f7980 0x7fc12c1074c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fc1200026d0 tx=0x7fc120009de0).stop 2023-01-04T18:18:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.536+0000 7fc130d75700 1 -- 172.21.15.50:0/2413837898 shutdown_connections 2023-01-04T18:18:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.536+0000 7fc130d75700 1 --2- 172.21.15.50:0/2413837898 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc114060cd0 0x7fc114063190 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.536+0000 7fc130d75700 1 --2- 172.21.15.50:0/2413837898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc12c0f66e0 0x7fc12c106fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.536+0000 7fc130d75700 1 --2- 172.21.15.50:0/2413837898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc12c0f7980 0x7fc12c1074c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:27.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.536+0000 7fc130d75700 1 -- 172.21.15.50:0/2413837898 >> 172.21.15.50:0/2413837898 conn(0x7fc12c0f1e40 msgr2=0x7fc12c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:27.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.537+0000 7fc130d75700 1 -- 172.21.15.50:0/2413837898 shutdown_connections 2023-01-04T18:18:27.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:27.539+0000 7fc130d75700 1 -- 172.21.15.50:0/2413837898 wait complete. 2023-01-04T18:18:27.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:25.718385+0000 mgr.smithi050.emnywo (mgr.24517) 55 : audit [DBG] from='client.44103 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:18:27.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:26.128983+0000 mgr.smithi050.emnywo (mgr.24517) 56 : audit [DBG] from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:18:27.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:26.705225+0000 mon.smithi050 (mon.0) 53 : audit [DBG] from='client.? 172.21.15.50:0/3233441692' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:18:27.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:26.948975+0000 mon.smithi050 (mon.0) 54 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:27.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:27.115871+0000 mon.smithi050 (mon.0) 55 : audit [DBG] from='client.? 172.21.15.50:0/2050274782' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:18:27.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:25.718385+0000 mgr.smithi050.emnywo (mgr.24517) 55 : audit [DBG] from='client.44103 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:18:27.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:26.128983+0000 mgr.smithi050.emnywo (mgr.24517) 56 : audit [DBG] from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:18:27.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:26.705225+0000 mon.smithi050 (mon.0) 53 : audit [DBG] from='client.? 172.21.15.50:0/3233441692' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:18:27.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:26.948975+0000 mon.smithi050 (mon.0) 54 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:27.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:27.115871+0000 mon.smithi050 (mon.0) 55 : audit [DBG] from='client.? 172.21.15.50:0/2050274782' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:18:28.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:26.607250+0000 mgr.smithi050.emnywo (mgr.24517) 57 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 1.05k op/s 2023-01-04T18:18:28.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:27.514470+0000 mgr.smithi050.emnywo (mgr.24517) 58 : audit [DBG] from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:18:28.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:26.607250+0000 mgr.smithi050.emnywo (mgr.24517) 57 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 1.05k op/s 2023-01-04T18:18:28.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:27.514470+0000 mgr.smithi050.emnywo (mgr.24517) 58 : audit [DBG] from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:18:29.404 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2023-01-04T18:18:29.404 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2023-01-04T18:18:29.708 DEBUG:teuthology.parallel:result is None 2023-01-04T18:18:30.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:28.610854+0000 mgr.smithi050.emnywo (mgr.24517) 59 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 606 op/s 2023-01-04T18:18:30.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:30.265426+0000 mon.smithi050 (mon.0) 56 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:30.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:30.269845+0000 mon.smithi050 (mon.0) 57 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:30.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:30.275816+0000 mon.smithi050 (mon.0) 58 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:18:30.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:30.278315+0000 mon.smithi050 (mon.0) 59 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:18:30.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:30.279639+0000 mon.smithi050 (mon.0) 60 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:18:30.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:30.281446+0000 mon.smithi050 (mon.0) 61 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:18:30.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:30.287210+0000 mon.smithi050 (mon.0) 62 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:30.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:30.288119+0000 mon.smithi050 (mon.0) 63 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi050"}]: dispatch 2023-01-04T18:18:30.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:30.292783+0000 mon.smithi050 (mon.0) 64 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi050"}]': finished 2023-01-04T18:18:30.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:30.293504+0000 mon.smithi050 (mon.0) 65 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi098"}]: dispatch 2023-01-04T18:18:30.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:30.296877+0000 mon.smithi050 (mon.0) 66 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi098"}]': finished 2023-01-04T18:18:30.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:30.298683+0000 mon.smithi050 (mon.0) 67 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-01-04T18:18:30.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:28.610854+0000 mgr.smithi050.emnywo (mgr.24517) 59 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 606 op/s 2023-01-04T18:18:30.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:30.265426+0000 mon.smithi050 (mon.0) 56 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:30.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:30.269845+0000 mon.smithi050 (mon.0) 57 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:30.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:30.275816+0000 mon.smithi050 (mon.0) 58 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:18:30.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:30.278315+0000 mon.smithi050 (mon.0) 59 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:18:30.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:30.279639+0000 mon.smithi050 (mon.0) 60 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:18:30.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:30.281446+0000 mon.smithi050 (mon.0) 61 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:18:30.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:30.287210+0000 mon.smithi050 (mon.0) 62 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:30.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:30.288119+0000 mon.smithi050 (mon.0) 63 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi050"}]: dispatch 2023-01-04T18:18:30.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:30.292783+0000 mon.smithi050 (mon.0) 64 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi050"}]': finished 2023-01-04T18:18:30.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:30.293504+0000 mon.smithi050 (mon.0) 65 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi098"}]: dispatch 2023-01-04T18:18:30.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:30.296877+0000 mon.smithi050 (mon.0) 66 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi098"}]': finished 2023-01-04T18:18:30.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:30.298683+0000 mon.smithi050 (mon.0) 67 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-01-04T18:18:31.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:18:30.282207+0000 mgr.smithi050.emnywo (mgr.24517) 60 : cephadm [INF] Upgrade: Setting container_image for all crash 2023-01-04T18:18:31.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:30.298830+0000 mgr.smithi050.emnywo (mgr.24517) 61 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-01-04T18:18:31.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:18:30.299720+0000 mgr.smithi050.emnywo (mgr.24517) 62 : cephadm [INF] Upgrade: osd.0 is safe to restart 2023-01-04T18:18:31.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:18:30.282207+0000 mgr.smithi050.emnywo (mgr.24517) 60 : cephadm [INF] Upgrade: Setting container_image for all crash 2023-01-04T18:18:31.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:30.298830+0000 mgr.smithi050.emnywo (mgr.24517) 61 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-01-04T18:18:31.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:18:30.299720+0000 mgr.smithi050.emnywo (mgr.24517) 62 : cephadm [INF] Upgrade: osd.0 is safe to restart 2023-01-04T18:18:32.649 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:30.611154+0000 mgr.smithi050.emnywo (mgr.24517) 63 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 606 op/s 2023-01-04T18:18:32.649 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:31.784993+0000 mon.smithi050 (mon.0) 68 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:32.650 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:31.785904+0000 mon.smithi050 (mon.0) 69 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-01-04T18:18:32.650 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:31.786561+0000 mon.smithi050 (mon.0) 70 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:18:32.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:30.611154+0000 mgr.smithi050.emnywo (mgr.24517) 63 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 606 op/s 2023-01-04T18:18:32.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:31.784993+0000 mon.smithi050 (mon.0) 68 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:32.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:31.785904+0000 mon.smithi050 (mon.0) 69 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-01-04T18:18:32.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:31.786561+0000 mon.smithi050 (mon.0) 70 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:18:33.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:33 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:18:31.780861+0000 mgr.smithi050.emnywo (mgr.24517) 64 : cephadm [INF] Upgrade: Updating osd.0 2023-01-04T18:18:33.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:33 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:18:31.787862+0000 mgr.smithi050.emnywo (mgr.24517) 65 : cephadm [INF] Deploying daemon osd.0 on smithi050 2023-01-04T18:18:33.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:33 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:18:31.780861+0000 mgr.smithi050.emnywo (mgr.24517) 64 : cephadm [INF] Upgrade: Updating osd.0 2023-01-04T18:18:33.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:33 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:18:31.787862+0000 mgr.smithi050.emnywo (mgr.24517) 65 : cephadm [INF] Deploying daemon osd.0 on smithi050 2023-01-04T18:18:34.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:32.611642+0000 mgr.smithi050.emnywo (mgr.24517) 66 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 237 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 845 op/s 2023-01-04T18:18:34.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:32.611642+0000 mgr.smithi050.emnywo (mgr.24517) 66 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 237 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 845 op/s 2023-01-04T18:18:36.757 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:34.611992+0000 mgr.smithi050.emnywo (mgr.24517) 67 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 237 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 488 op/s 2023-01-04T18:18:36.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:34.611992+0000 mgr.smithi050.emnywo (mgr.24517) 67 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 237 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 488 op/s 2023-01-04T18:18:37.450 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:37 smithi050 systemd[1]: Stopping Ceph osd.0 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:18:37.790 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:37 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.0[143343]: debug 2023-01-04T18:18:37.446+0000 7ff710299700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-01-04T18:18:37.790 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:37 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.0[143343]: debug 2023-01-04T18:18:37.446+0000 7ff710299700 -1 osd.0 45 *** Got signal Terminated *** 2023-01-04T18:18:37.790 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:37 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.0[143343]: debug 2023-01-04T18:18:37.446+0000 7ff710299700 -1 osd.0 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-01-04T18:18:37.790 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:37 smithi050 bash[175721]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.0 2023-01-04T18:18:38.290 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:37 smithi050 bash[175763]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-0" found: no such container 2023-01-04T18:18:38.290 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:37 smithi050 bash[175777]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.0" found: no such container 2023-01-04T18:18:38.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:36.612571+0000 mgr.smithi050.emnywo (mgr.24517) 68 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 230 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 1.17k op/s 2023-01-04T18:18:38.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:37.715309+0000 mon.smithi050 (mon.0) 71 : cluster [DBG] osd.0 reported immediately failed by osd.3 2023-01-04T18:18:38.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:37.715343+0000 mon.smithi050 (mon.0) 72 : cluster [INF] osd.0 failed (root=default,host=smithi050) (connection refused reported by osd.3) 2023-01-04T18:18:38.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:37.715547+0000 mon.smithi050 (mon.0) 73 : cluster [DBG] osd.0 reported immediately failed by osd.3 2023-01-04T18:18:38.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:37.715661+0000 mon.smithi050 (mon.0) 74 : cluster [DBG] osd.0 reported immediately failed by osd.4 2023-01-04T18:18:38.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:37.715707+0000 mon.smithi050 (mon.0) 75 : cluster [DBG] osd.0 reported immediately failed by osd.5 2023-01-04T18:18:38.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:37.715805+0000 mon.smithi050 (mon.0) 76 : cluster [DBG] osd.0 reported immediately failed by osd.1 2023-01-04T18:18:38.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:37.715848+0000 mon.smithi050 (mon.0) 77 : cluster [DBG] osd.0 reported immediately failed by osd.2 2023-01-04T18:18:38.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:37.715954+0000 mon.smithi050 (mon.0) 78 : cluster [DBG] osd.0 reported immediately failed by osd.4 2023-01-04T18:18:38.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:37.715997+0000 mon.smithi050 (mon.0) 79 : cluster [DBG] osd.0 reported immediately failed by osd.5 2023-01-04T18:18:38.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:37.716093+0000 mon.smithi050 (mon.0) 80 : cluster [DBG] osd.0 reported immediately failed by osd.1 2023-01-04T18:18:38.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:37.716151+0000 mon.smithi050 (mon.0) 81 : cluster [DBG] osd.0 reported immediately failed by osd.2 2023-01-04T18:18:38.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:37.716256+0000 mon.smithi050 (mon.0) 82 : cluster [DBG] osd.0 reported immediately failed by osd.2 2023-01-04T18:18:38.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:38.116204+0000 mon.smithi050 (mon.0) 83 : cluster [DBG] osd.0 reported immediately failed by osd.5 2023-01-04T18:18:38.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:38.116259+0000 mon.smithi050 (mon.0) 84 : cluster [DBG] osd.0 reported immediately failed by osd.5 2023-01-04T18:18:38.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:38.116399+0000 mon.smithi050 (mon.0) 85 : cluster [DBG] osd.0 reported immediately failed by osd.3 2023-01-04T18:18:38.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:38.116479+0000 mon.smithi050 (mon.0) 86 : cluster [DBG] osd.0 reported immediately failed by osd.4 2023-01-04T18:18:38.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:38.116617+0000 mon.smithi050 (mon.0) 87 : cluster [DBG] osd.0 reported immediately failed by osd.3 2023-01-04T18:18:38.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:38.116693+0000 mon.smithi050 (mon.0) 88 : cluster [DBG] osd.0 reported immediately failed by osd.2 2023-01-04T18:18:38.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:38.116775+0000 mon.smithi050 (mon.0) 89 : cluster [DBG] osd.0 reported immediately failed by osd.4 2023-01-04T18:18:38.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:38.116867+0000 mon.smithi050 (mon.0) 90 : cluster [DBG] osd.0 reported immediately failed by osd.1 2023-01-04T18:18:38.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:38.116910+0000 mon.smithi050 (mon.0) 91 : cluster [DBG] osd.0 reported immediately failed by osd.2 2023-01-04T18:18:38.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:38.117008+0000 mon.smithi050 (mon.0) 92 : cluster [DBG] osd.0 reported immediately failed by osd.1 2023-01-04T18:18:38.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:38.117081+0000 mon.smithi050 (mon.0) 93 : cluster [DBG] osd.0 reported immediately failed by osd.2 2023-01-04T18:18:38.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:38.407116+0000 mon.smithi050 (mon.0) 94 : cluster [DBG] osd.0 reported immediately failed by osd.3 2023-01-04T18:18:38.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:38.409863+0000 mon.smithi050 (mon.0) 95 : cluster [DBG] osd.0 reported immediately failed by osd.5 2023-01-04T18:18:38.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:38.410077+0000 mon.smithi050 (mon.0) 96 : cluster [DBG] osd.0 reported immediately failed by osd.4 2023-01-04T18:18:38.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:38.411981+0000 mon.smithi050 (mon.0) 97 : cluster [DBG] osd.0 reported immediately failed by osd.1 2023-01-04T18:18:39.033 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:36.612571+0000 mgr.smithi050.emnywo (mgr.24517) 68 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 230 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 1.17k op/s 2023-01-04T18:18:39.033 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:37.715309+0000 mon.smithi050 (mon.0) 71 : cluster [DBG] osd.0 reported immediately failed by osd.3 2023-01-04T18:18:39.033 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:37.715343+0000 mon.smithi050 (mon.0) 72 : cluster [INF] osd.0 failed (root=default,host=smithi050) (connection refused reported by osd.3) 2023-01-04T18:18:39.033 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:37.715547+0000 mon.smithi050 (mon.0) 73 : cluster [DBG] osd.0 reported immediately failed by osd.3 2023-01-04T18:18:39.033 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:37.715661+0000 mon.smithi050 (mon.0) 74 : cluster [DBG] osd.0 reported immediately failed by osd.4 2023-01-04T18:18:39.033 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:37.715707+0000 mon.smithi050 (mon.0) 75 : cluster [DBG] osd.0 reported immediately failed by osd.5 2023-01-04T18:18:39.033 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:37.715805+0000 mon.smithi050 (mon.0) 76 : cluster [DBG] osd.0 reported immediately failed by osd.1 2023-01-04T18:18:39.034 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:37.715848+0000 mon.smithi050 (mon.0) 77 : cluster [DBG] osd.0 reported immediately failed by osd.2 2023-01-04T18:18:39.034 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:37.715954+0000 mon.smithi050 (mon.0) 78 : cluster [DBG] osd.0 reported immediately failed by osd.4 2023-01-04T18:18:39.034 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:37.715997+0000 mon.smithi050 (mon.0) 79 : cluster [DBG] osd.0 reported immediately failed by osd.5 2023-01-04T18:18:39.034 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:37.716093+0000 mon.smithi050 (mon.0) 80 : cluster [DBG] osd.0 reported immediately failed by osd.1 2023-01-04T18:18:39.034 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:37.716151+0000 mon.smithi050 (mon.0) 81 : cluster [DBG] osd.0 reported immediately failed by osd.2 2023-01-04T18:18:39.034 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:37.716256+0000 mon.smithi050 (mon.0) 82 : cluster [DBG] osd.0 reported immediately failed by osd.2 2023-01-04T18:18:39.034 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:38.116204+0000 mon.smithi050 (mon.0) 83 : cluster [DBG] osd.0 reported immediately failed by osd.5 2023-01-04T18:18:39.034 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:38.116259+0000 mon.smithi050 (mon.0) 84 : cluster [DBG] osd.0 reported immediately failed by osd.5 2023-01-04T18:18:39.034 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:38.116399+0000 mon.smithi050 (mon.0) 85 : cluster [DBG] osd.0 reported immediately failed by osd.3 2023-01-04T18:18:39.034 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:38.116479+0000 mon.smithi050 (mon.0) 86 : cluster [DBG] osd.0 reported immediately failed by osd.4 2023-01-04T18:18:39.034 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:38.116617+0000 mon.smithi050 (mon.0) 87 : cluster [DBG] osd.0 reported immediately failed by osd.3 2023-01-04T18:18:39.035 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:38.116693+0000 mon.smithi050 (mon.0) 88 : cluster [DBG] osd.0 reported immediately failed by osd.2 2023-01-04T18:18:39.035 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:38.116775+0000 mon.smithi050 (mon.0) 89 : cluster [DBG] osd.0 reported immediately failed by osd.4 2023-01-04T18:18:39.035 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:38.116867+0000 mon.smithi050 (mon.0) 90 : cluster [DBG] osd.0 reported immediately failed by osd.1 2023-01-04T18:18:39.035 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:38.116910+0000 mon.smithi050 (mon.0) 91 : cluster [DBG] osd.0 reported immediately failed by osd.2 2023-01-04T18:18:39.035 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:38.117008+0000 mon.smithi050 (mon.0) 92 : cluster [DBG] osd.0 reported immediately failed by osd.1 2023-01-04T18:18:39.035 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:38.117081+0000 mon.smithi050 (mon.0) 93 : cluster [DBG] osd.0 reported immediately failed by osd.2 2023-01-04T18:18:39.035 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:38.407116+0000 mon.smithi050 (mon.0) 94 : cluster [DBG] osd.0 reported immediately failed by osd.3 2023-01-04T18:18:39.035 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:38.409863+0000 mon.smithi050 (mon.0) 95 : cluster [DBG] osd.0 reported immediately failed by osd.5 2023-01-04T18:18:39.035 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:38.410077+0000 mon.smithi050 (mon.0) 96 : cluster [DBG] osd.0 reported immediately failed by osd.4 2023-01-04T18:18:39.035 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:38.411981+0000 mon.smithi050 (mon.0) 97 : cluster [DBG] osd.0 reported immediately failed by osd.1 2023-01-04T18:18:39.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:39 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:38.533633+0000 mon.smithi050 (mon.0) 98 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-01-04T18:18:39.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:39 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:38.537755+0000 mon.smithi050 (mon.0) 99 : cluster [DBG] osdmap e46: 6 total, 5 up, 6 in 2023-01-04T18:18:39.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:39 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:38.538674+0000 mon.smithi050 (mon.0) 100 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-01-04T18:18:39.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:39 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:38.541923+0000 mon.smithi050 (mon.0) 101 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-01-04T18:18:39.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:39 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:39.537990+0000 mon.smithi050 (mon.0) 102 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2023-01-04T18:18:39.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:39 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:39.538141+0000 mon.smithi050 (mon.0) 103 : cluster [DBG] osdmap e47: 6 total, 5 up, 6 in 2023-01-04T18:18:39.792 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:39 smithi050 systemd[1]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.0.service: Succeeded. 2023-01-04T18:18:39.792 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:39 smithi050 systemd[1]: Stopped Ceph osd.0 for d98671da-8c5a-11ed-821a-001a4aab830c. 2023-01-04T18:18:39.792 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:39 smithi050 systemd[1]: Starting Ceph osd.0 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:18:40.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:39 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:38.533633+0000 mon.smithi050 (mon.0) 98 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-01-04T18:18:40.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:39 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:38.537755+0000 mon.smithi050 (mon.0) 99 : cluster [DBG] osdmap e46: 6 total, 5 up, 6 in 2023-01-04T18:18:40.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:39 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:38.538674+0000 mon.smithi050 (mon.0) 100 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-01-04T18:18:40.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:39 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:38.541923+0000 mon.smithi050 (mon.0) 101 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2023-01-04T18:18:40.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:39 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:39.537990+0000 mon.smithi050 (mon.0) 102 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2023-01-04T18:18:40.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:39 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:39.538141+0000 mon.smithi050 (mon.0) 103 : cluster [DBG] osdmap e47: 6 total, 5 up, 6 in 2023-01-04T18:18:40.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:38.612960+0000 mgr.smithi050.emnywo (mgr.24517) 69 : cluster [DBG] pgmap v42: 65 pgs: 9 stale+active+clean, 56 active+clean; 230 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 1.11k op/s 2023-01-04T18:18:40.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:39.845700+0000 mon.smithi050 (mon.0) 104 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:41.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:38.612960+0000 mgr.smithi050.emnywo (mgr.24517) 69 : cluster [DBG] pgmap v42: 65 pgs: 9 stale+active+clean, 56 active+clean; 230 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 1.11k op/s 2023-01-04T18:18:41.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:39.845700+0000 mon.smithi050 (mon.0) 104 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:42.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:40.613387+0000 mgr.smithi050.emnywo (mgr.24517) 70 : cluster [DBG] pgmap v44: 65 pgs: 9 stale+active+clean, 56 active+clean; 230 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 610 KiB/s rd, 937 KiB/s wr, 1.03k op/s 2023-01-04T18:18:42.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:40.613387+0000 mgr.smithi050.emnywo (mgr.24517) 70 : cluster [DBG] pgmap v44: 65 pgs: 9 stale+active+clean, 56 active+clean; 230 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 610 KiB/s rd, 937 KiB/s wr, 1.03k op/s 2023-01-04T18:18:42.540 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:42 smithi050 bash[175994]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-01-04T18:18:42.640 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:42 smithi050 bash[175994]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-01-04T18:18:42.640 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:42 smithi050 bash[175994]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-01-04T18:18:42.640 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:42 smithi050 bash[175994]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-01-04T18:18:42.640 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:42 smithi050 bash[175994]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2023-01-04T18:18:42.640 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:42 smithi050 bash[175994]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-01-04T18:18:42.641 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:42 smithi050 bash[175994]: --> ceph-volume raw activate successful for osd ID: 0 2023-01-04T18:18:43.536 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:43.091370+0000 mon.smithi050 (mon.0) 105 : cluster [WRN] Health check failed: Degraded data redundancy: 1306/8622 objects degraded (15.147%), 33 pgs degraded (PG_DEGRADED) 2023-01-04T18:18:43.585 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:43.091370+0000 mon.smithi050 (mon.0) 105 : cluster [WRN] Health check failed: Degraded data redundancy: 1306/8622 objects degraded (15.147%), 33 pgs degraded (PG_DEGRADED) 2023-01-04T18:18:44.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:42.613954+0000 mgr.smithi050.emnywo (mgr.24517) 71 : cluster [DBG] pgmap v45: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 227 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 1.16k op/s; 1306/8622 objects degraded (15.147%) 2023-01-04T18:18:44.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:42.613954+0000 mgr.smithi050.emnywo (mgr.24517) 71 : cluster [DBG] pgmap v45: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 227 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 1.16k op/s; 1306/8622 objects degraded (15.147%) 2023-01-04T18:18:46.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:44.614551+0000 mgr.smithi050.emnywo (mgr.24517) 72 : cluster [DBG] pgmap v46: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 227 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 439 KiB/s rd, 499 KiB/s wr, 129 op/s; 1306/8622 objects degraded (15.147%) 2023-01-04T18:18:46.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:44.614551+0000 mgr.smithi050.emnywo (mgr.24517) 72 : cluster [DBG] pgmap v46: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 227 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 439 KiB/s rd, 499 KiB/s wr, 129 op/s; 1306/8622 objects degraded (15.147%) 2023-01-04T18:18:47.540 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:47 smithi050 podman[176444]: 2023-01-04T18:18:48.151 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-0[176458]: debug 2023-01-04T18:18:47.990+0000 7f2011d0e700 1 -- 172.21.15.50:0/3544590109 <== mon.0 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5580695684e0 con 0x55806952f000 2023-01-04T18:18:48.151 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:47 smithi050 bash[176444]: 60dafedcb429295582d4581fea61acb936c303eb70800452d17e38e1fd572a3c 2023-01-04T18:18:48.151 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:48 smithi050 systemd[1]: Started Ceph osd.0 for d98671da-8c5a-11ed-821a-001a4aab830c. 2023-01-04T18:18:48.152 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:46.615207+0000 mgr.smithi050.emnywo (mgr.24517) 73 : cluster [DBG] pgmap v47: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 217 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 449 op/s; 795/5151 objects degraded (15.434%) 2023-01-04T18:18:48.152 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:48.122854+0000 mon.smithi050 (mon.0) 106 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:48.152 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:48.123703+0000 mon.smithi050 (mon.0) 107 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:18:48.152 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:48.125047+0000 mon.smithi050 (mon.0) 108 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:18:48.152 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:48.125853+0000 mon.smithi050 (mon.0) 109 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:18:48.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:46.615207+0000 mgr.smithi050.emnywo (mgr.24517) 73 : cluster [DBG] pgmap v47: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 217 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 449 op/s; 795/5151 objects degraded (15.434%) 2023-01-04T18:18:48.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:48.122854+0000 mon.smithi050 (mon.0) 106 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:48.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:48.123703+0000 mon.smithi050 (mon.0) 107 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:18:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:48.125047+0000 mon.smithi050 (mon.0) 108 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:18:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:48.125853+0000 mon.smithi050 (mon.0) 109 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:18:48.790 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-0[176458]: debug 2023-01-04T18:18:48.512+0000 7f2019784200 -1 Falling back to public interface 2023-01-04T18:18:49.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:49 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:18:48.126601+0000 mgr.smithi050.emnywo (mgr.24517) 74 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:18:49.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:49 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:18:48.126601+0000 mgr.smithi050.emnywo (mgr.24517) 74 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:18:50.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:48.615823+0000 mgr.smithi050.emnywo (mgr.24517) 75 : cluster [DBG] pgmap v48: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 217 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 363 op/s; 795/5151 objects degraded (15.434%) 2023-01-04T18:18:50.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:48.615823+0000 mgr.smithi050.emnywo (mgr.24517) 75 : cluster [DBG] pgmap v48: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 217 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 363 op/s; 795/5151 objects degraded (15.434%) 2023-01-04T18:18:50.685 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2023-01-04T18:18:50.686 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-01-04T18:18:51.047 DEBUG:teuthology.parallel:result is None 2023-01-04T18:18:51.047 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-01-04T18:18:51.085 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-01-04T18:18:51.085 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2023-01-04T18:18:51.119 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2023-01-04T18:18:51.119 DEBUG:teuthology.parallel:result is None 2023-01-04T18:18:52.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:50.616254+0000 mgr.smithi050.emnywo (mgr.24517) 76 : cluster [DBG] pgmap v49: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 217 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 956 KiB/s rd, 1013 KiB/s wr, 327 op/s; 795/5151 objects degraded (15.434%) 2023-01-04T18:18:52.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:52.091361+0000 mon.smithi050 (mon.0) 110 : cluster [WRN] Health check update: Degraded data redundancy: 795/5151 objects degraded (15.434%), 33 pgs degraded (PG_DEGRADED) 2023-01-04T18:18:52.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:50.616254+0000 mgr.smithi050.emnywo (mgr.24517) 76 : cluster [DBG] pgmap v49: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 217 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 956 KiB/s rd, 1013 KiB/s wr, 327 op/s; 795/5151 objects degraded (15.434%) 2023-01-04T18:18:52.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:52.091361+0000 mon.smithi050 (mon.0) 110 : cluster [WRN] Health check update: Degraded data redundancy: 795/5151 objects degraded (15.434%), 33 pgs degraded (PG_DEGRADED) 2023-01-04T18:18:54.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:52.616800+0000 mgr.smithi050.emnywo (mgr.24517) 77 : cluster [DBG] pgmap v50: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 210 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 440 op/s; 260/1629 objects degraded (15.961%) 2023-01-04T18:18:54.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:52.616800+0000 mgr.smithi050.emnywo (mgr.24517) 77 : cluster [DBG] pgmap v50: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 210 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 440 op/s; 260/1629 objects degraded (15.961%) 2023-01-04T18:18:56.040 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-0[176458]: debug 2023-01-04T18:18:55.936+0000 7f2019784200 -1 osd.0 45 log_to_monitors {default=true} 2023-01-04T18:18:56.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:54.617367+0000 mgr.smithi050.emnywo (mgr.24517) 78 : cluster [DBG] pgmap v51: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 210 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 354 op/s; 260/1629 objects degraded (15.961%) 2023-01-04T18:18:56.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:54.718136+0000 mon.smithi050 (mon.0) 111 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:56.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:54.842003+0000 mon.smithi050 (mon.0) 112 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:56.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:55.142828+0000 mon.smithi050 (mon.0) 113 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:56.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:55.148500+0000 mon.smithi050 (mon.0) 114 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:18:56.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:55.150778+0000 mon.smithi050 (mon.0) 115 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:18:56.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:55.151984+0000 mon.smithi050 (mon.0) 116 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:18:56.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:55.153232+0000 mon.smithi050 (mon.0) 117 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:18:56.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:55.154323+0000 mon.smithi050 (mon.0) 118 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:18:56.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:55.154463+0000 mgr.smithi050.emnywo (mgr.24517) 79 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:18:56.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:18:55.155126+0000 mgr.smithi050.emnywo (mgr.24517) 80 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-01-04T18:18:56.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:54.617367+0000 mgr.smithi050.emnywo (mgr.24517) 78 : cluster [DBG] pgmap v51: 65 pgs: 33 active+undersized+degraded, 1 active+undersized, 31 active+clean; 210 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 354 op/s; 260/1629 objects degraded (15.961%) 2023-01-04T18:18:56.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:54.718136+0000 mon.smithi050 (mon.0) 111 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:56.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:54.842003+0000 mon.smithi050 (mon.0) 112 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:56.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:55.142828+0000 mon.smithi050 (mon.0) 113 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:18:56.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:55.148500+0000 mon.smithi050 (mon.0) 114 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:18:56.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:55.150778+0000 mon.smithi050 (mon.0) 115 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:18:56.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:55.151984+0000 mon.smithi050 (mon.0) 116 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:18:56.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:55.153232+0000 mon.smithi050 (mon.0) 117 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:18:56.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:55.154323+0000 mon.smithi050 (mon.0) 118 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:18:56.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:55.154463+0000 mgr.smithi050.emnywo (mgr.24517) 79 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:18:56.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:18:55.155126+0000 mgr.smithi050.emnywo (mgr.24517) 80 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-01-04T18:18:57.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:55.940259+0000 mon.smithi050 (mon.0) 119 : audit [INF] from='osd.0 [v2:172.21.15.50:6802/2203732943,v1:172.21.15.50:6803/2203732943]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-01-04T18:18:57.041 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:18:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-0[176458]: debug 2023-01-04T18:18:56.735+0000 7f200a482700 -1 osd.0 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-04T18:18:57.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:55.940259+0000 mon.smithi050 (mon.0) 119 : audit [INF] from='osd.0 [v2:172.21.15.50:6802/2203732943,v1:172.21.15.50:6803/2203732943]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-01-04T18:18:57.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.662+0000 7fd7de8f1700 1 -- 172.21.15.50:0/2207198117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7d80f55c0 msgr2=0x7fd7d80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:57.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.662+0000 7fd7de8f1700 1 --2- 172.21.15.50:0/2207198117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7d80f55c0 0x7fd7d80f59e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fd7c8004660 tx=0x7fd7c8009b30).stop 2023-01-04T18:18:57.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.662+0000 7fd7de8f1700 1 -- 172.21.15.50:0/2207198117 shutdown_connections 2023-01-04T18:18:57.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.662+0000 7fd7de8f1700 1 --2- 172.21.15.50:0/2207198117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7d80f6860 0x7fd7d80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:57.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.662+0000 7fd7de8f1700 1 --2- 172.21.15.50:0/2207198117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7d80f55c0 0x7fd7d80f59e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:57.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.662+0000 7fd7de8f1700 1 -- 172.21.15.50:0/2207198117 >> 172.21.15.50:0/2207198117 conn(0x7fd7d80f0d40 msgr2=0x7fd7d80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:57.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.662+0000 7fd7de8f1700 1 -- 172.21.15.50:0/2207198117 shutdown_connections 2023-01-04T18:18:57.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.662+0000 7fd7de8f1700 1 -- 172.21.15.50:0/2207198117 wait complete. 2023-01-04T18:18:57.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.663+0000 7fd7de8f1700 1 Processor -- start 2023-01-04T18:18:57.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.663+0000 7fd7de8f1700 1 -- start start 2023-01-04T18:18:57.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.663+0000 7fd7de8f1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7d80f55c0 0x7fd7d8109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:57.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.663+0000 7fd7de8f1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7d80f6860 0x7fd7d810c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:57.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.663+0000 7fd7de8f1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80603e0 con 0x7fd7d80f6860 2023-01-04T18:18:57.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.663+0000 7fd7de8f1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d8060520 con 0x7fd7d80f55c0 2023-01-04T18:18:57.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.663+0000 7fd7d77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7d80f6860 0x7fd7d810c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:57.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.664+0000 7fd7d77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7d80f6860 0x7fd7d810c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53738/0 (socket says 172.21.15.50:53738) 2023-01-04T18:18:57.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.664+0000 7fd7d77fe700 1 -- 172.21.15.50:0/1644072978 learned_addr learned my addr 172.21.15.50:0/1644072978 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:18:57.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.664+0000 7fd7d7fff700 1 --2- 172.21.15.50:0/1644072978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7d80f55c0 0x7fd7d8109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:57.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.664+0000 7fd7d77fe700 1 -- 172.21.15.50:0/1644072978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7d80f55c0 msgr2=0x7fd7d8109c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:57.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.664+0000 7fd7d77fe700 1 --2- 172.21.15.50:0/1644072978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7d80f55c0 0x7fd7d8109c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:57.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.664+0000 7fd7d77fe700 1 -- 172.21.15.50:0/1644072978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7cc005040 con 0x7fd7d80f6860 2023-01-04T18:18:57.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.664+0000 7fd7d77fe700 1 --2- 172.21.15.50:0/1644072978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7d80f6860 0x7fd7d810c110 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fd7cc004870 tx=0x7fd7cc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:57.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.664+0000 7fd7d4ff9700 1 -- 172.21.15.50:0/1644072978 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7cc00e030 con 0x7fd7d80f6860 2023-01-04T18:18:57.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.664+0000 7fd7d4ff9700 1 -- 172.21.15.50:0/1644072978 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd7cc00f040 con 0x7fd7d80f6860 2023-01-04T18:18:57.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.664+0000 7fd7de8f1700 1 -- 172.21.15.50:0/1644072978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c8005040 con 0x7fd7d80f6860 2023-01-04T18:18:57.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.664+0000 7fd7d4ff9700 1 -- 172.21.15.50:0/1644072978 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7cc014940 con 0x7fd7d80f6860 2023-01-04T18:18:57.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.664+0000 7fd7de8f1700 1 -- 172.21.15.50:0/1644072978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d810ca70 con 0x7fd7d80f6860 2023-01-04T18:18:57.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.665+0000 7fd7de8f1700 1 -- 172.21.15.50:0/1644072978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d8045ad0 con 0x7fd7d80f6860 2023-01-04T18:18:57.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.665+0000 7fd7d4ff9700 1 -- 172.21.15.50:0/1644072978 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fd7cc010530 con 0x7fd7d80f6860 2023-01-04T18:18:57.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.666+0000 7fd7d4ff9700 1 --2- 172.21.15.50:0/1644072978 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd7c0060be0 0x7fd7c00630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:57.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.666+0000 7fd7d4ff9700 1 -- 172.21.15.50:0/1644072978 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fd7cc07c250 con 0x7fd7d80f6860 2023-01-04T18:18:57.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.666+0000 7fd7d7fff700 1 --2- 172.21.15.50:0/1644072978 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd7c0060be0 0x7fd7c00630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:57.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.666+0000 7fd7d7fff700 1 --2- 172.21.15.50:0/1644072978 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd7c0060be0 0x7fd7c00630a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fd7c80043d0 tx=0x7fd7c800b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:57.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.670+0000 7fd7d4ff9700 1 -- 172.21.15.50:0/1644072978 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fd7cc04c8f0 con 0x7fd7d80f6860 2023-01-04T18:18:57.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.889+0000 7fd7de8f1700 1 -- 172.21.15.50:0/1644072978 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7d8057f10 con 0x7fd7c0060be0 2023-01-04T18:18:57.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.891+0000 7fd7d4ff9700 1 -- 172.21.15.50:0/1644072978 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd7d8057f10 con 0x7fd7c0060be0 2023-01-04T18:18:57.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.892+0000 7fd7de8f1700 1 -- 172.21.15.50:0/1644072978 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd7c0060be0 msgr2=0x7fd7c00630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:57.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.892+0000 7fd7de8f1700 1 --2- 172.21.15.50:0/1644072978 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd7c0060be0 0x7fd7c00630a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fd7c80043d0 tx=0x7fd7c800b040).stop 2023-01-04T18:18:57.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.892+0000 7fd7de8f1700 1 -- 172.21.15.50:0/1644072978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7d80f6860 msgr2=0x7fd7d810c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:57.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.892+0000 7fd7de8f1700 1 --2- 172.21.15.50:0/1644072978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7d80f6860 0x7fd7d810c110 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fd7cc004870 tx=0x7fd7cc009b30).stop 2023-01-04T18:18:57.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.892+0000 7fd7de8f1700 1 -- 172.21.15.50:0/1644072978 shutdown_connections 2023-01-04T18:18:57.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.892+0000 7fd7de8f1700 1 --2- 172.21.15.50:0/1644072978 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd7c0060be0 0x7fd7c00630a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:57.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.892+0000 7fd7de8f1700 1 --2- 172.21.15.50:0/1644072978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7d80f55c0 0x7fd7d8109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:57.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.892+0000 7fd7de8f1700 1 --2- 172.21.15.50:0/1644072978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7d80f6860 0x7fd7d810c110 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:57.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.892+0000 7fd7de8f1700 1 -- 172.21.15.50:0/1644072978 >> 172.21.15.50:0/1644072978 conn(0x7fd7d80f0d40 msgr2=0x7fd7d80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:57.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.892+0000 7fd7de8f1700 1 -- 172.21.15.50:0/1644072978 shutdown_connections 2023-01-04T18:18:57.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.893+0000 7fd7de8f1700 1 -- 172.21.15.50:0/1644072978 wait complete. 2023-01-04T18:18:57.906 INFO:teuthology.orchestra.run.smithi050.stdout:true 2023-01-04T18:18:58.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.995+0000 7fefa0f03700 1 -- 172.21.15.50:0/394932420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef9c0f6860 msgr2=0x7fef9c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:58.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.995+0000 7fefa0f03700 1 --2- 172.21.15.50:0/394932420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef9c0f6860 0x7fef9c0f6cc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fef84004660 tx=0x7fef84009b30).stop 2023-01-04T18:18:58.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.995+0000 7fefa0f03700 1 -- 172.21.15.50:0/394932420 shutdown_connections 2023-01-04T18:18:58.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.995+0000 7fefa0f03700 1 --2- 172.21.15.50:0/394932420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef9c0f6860 0x7fef9c0f6cc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:58.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.995+0000 7fefa0f03700 1 --2- 172.21.15.50:0/394932420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef9c0f55c0 0x7fef9c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.995+0000 7fefa0f03700 1 -- 172.21.15.50:0/394932420 >> 172.21.15.50:0/394932420 conn(0x7fef9c0f0d40 msgr2=0x7fef9c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.995+0000 7fefa0f03700 1 -- 172.21.15.50:0/394932420 shutdown_connections 2023-01-04T18:18:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.995+0000 7fefa0f03700 1 -- 172.21.15.50:0/394932420 wait complete. 2023-01-04T18:18:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.996+0000 7fefa0f03700 1 Processor -- start 2023-01-04T18:18:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.996+0000 7fefa0f03700 1 -- start start 2023-01-04T18:18:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.996+0000 7fefa0f03700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef9c0f55c0 0x7fef9c0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.996+0000 7fefa0f03700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef9c0f6860 0x7fef9c0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.996+0000 7fefa0f03700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c0f8100 con 0x7fef9c0f55c0 2023-01-04T18:18:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.996+0000 7fefa0f03700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c0f8240 con 0x7fef9c0f6860 2023-01-04T18:18:58.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.996+0000 7fef9a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef9c0f55c0 0x7fef9c0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.996+0000 7fef9a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef9c0f55c0 0x7fef9c0f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53760/0 (socket says 172.21.15.50:53760) 2023-01-04T18:18:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.996+0000 7fef9a59c700 1 -- 172.21.15.50:0/1511310654 learned_addr learned my addr 172.21.15.50:0/1511310654 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:18:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.996+0000 7fef99d9b700 1 --2- 172.21.15.50:0/1511310654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef9c0f6860 0x7fef9c0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.996+0000 7fef9a59c700 1 -- 172.21.15.50:0/1511310654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef9c0f6860 msgr2=0x7fef9c0f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.996+0000 7fef9a59c700 1 --2- 172.21.15.50:0/1511310654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef9c0f6860 0x7fef9c0f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.996+0000 7fef9a59c700 1 -- 172.21.15.50:0/1511310654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef84005040 con 0x7fef9c0f55c0 2023-01-04T18:18:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.997+0000 7fef9a59c700 1 --2- 172.21.15.50:0/1511310654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef9c0f55c0 0x7fef9c0f9720 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fef8c002700 tx=0x7fef8c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.997+0000 7fef92ffd700 1 -- 172.21.15.50:0/1511310654 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef8c0079c0 con 0x7fef9c0f55c0 2023-01-04T18:18:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.997+0000 7fef92ffd700 1 -- 172.21.15.50:0/1511310654 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fef8c00f040 con 0x7fef9c0f55c0 2023-01-04T18:18:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.997+0000 7fefa0f03700 1 -- 172.21.15.50:0/1511310654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9c0f8520 con 0x7fef9c0f55c0 2023-01-04T18:18:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.997+0000 7fef92ffd700 1 -- 172.21.15.50:0/1511310654 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef8c0148d0 con 0x7fef9c0f55c0 2023-01-04T18:18:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.997+0000 7fefa0f03700 1 -- 172.21.15.50:0/1511310654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9c10efc0 con 0x7fef9c0f55c0 2023-01-04T18:18:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.998+0000 7fefa0f03700 1 -- 172.21.15.50:0/1511310654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9c045ad0 con 0x7fef9c0f55c0 2023-01-04T18:18:58.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.998+0000 7fef92ffd700 1 -- 172.21.15.50:0/1511310654 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fef8c01b060 con 0x7fef9c0f55c0 2023-01-04T18:18:58.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.998+0000 7fef92ffd700 1 --2- 172.21.15.50:0/1511310654 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fef88060be0 0x7fef880630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:58.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.999+0000 7fef92ffd700 1 -- 172.21.15.50:0/1511310654 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fef8c07bb00 con 0x7fef9c0f55c0 2023-01-04T18:18:58.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.999+0000 7fef99d9b700 1 --2- 172.21.15.50:0/1511310654 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fef88060be0 0x7fef880630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:58.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:57.999+0000 7fef99d9b700 1 --2- 172.21.15.50:0/1511310654 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fef88060be0 0x7fef880630a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fef84004630 tx=0x7fef84009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:58.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.003+0000 7fef92ffd700 1 -- 172.21.15.50:0/1511310654 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fef8c04c120 con 0x7fef9c0f55c0 2023-01-04T18:18:58.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:56.617997+0000 mgr.smithi050.emnywo (mgr.24517) 81 : cluster [DBG] pgmap v52: 65 pgs: 29 active+undersized+degraded, 5 active+undersized, 31 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 397 op/s; 42/216 objects degraded (19.444%) 2023-01-04T18:18:58.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:56.730310+0000 mon.smithi050 (mon.0) 120 : audit [INF] from='osd.0 [v2:172.21.15.50:6802/2203732943,v1:172.21.15.50:6803/2203732943]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-01-04T18:18:58.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:56.730398+0000 mon.smithi050 (mon.0) 121 : cluster [DBG] osdmap e48: 6 total, 5 up, 6 in 2023-01-04T18:18:58.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:56.730888+0000 mon.smithi050 (mon.0) 122 : cluster [DBG] mgrmap e30: smithi050.emnywo(active, since 93s), standbys: smithi098.vhfzum 2023-01-04T18:18:58.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:56.731327+0000 mon.smithi050 (mon.0) 123 : audit [INF] from='osd.0 [v2:172.21.15.50:6802/2203732943,v1:172.21.15.50:6803/2203732943]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-01-04T18:18:58.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:57.092187+0000 mon.smithi050 (mon.0) 124 : cluster [WRN] Health check update: Degraded data redundancy: 42/216 objects degraded (19.444%), 29 pgs degraded (PG_DEGRADED) 2023-01-04T18:18:58.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:56.617997+0000 mgr.smithi050.emnywo (mgr.24517) 81 : cluster [DBG] pgmap v52: 65 pgs: 29 active+undersized+degraded, 5 active+undersized, 31 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 397 op/s; 42/216 objects degraded (19.444%) 2023-01-04T18:18:58.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:56.730310+0000 mon.smithi050 (mon.0) 120 : audit [INF] from='osd.0 [v2:172.21.15.50:6802/2203732943,v1:172.21.15.50:6803/2203732943]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-01-04T18:18:58.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:56.730398+0000 mon.smithi050 (mon.0) 121 : cluster [DBG] osdmap e48: 6 total, 5 up, 6 in 2023-01-04T18:18:58.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:56.730888+0000 mon.smithi050 (mon.0) 122 : cluster [DBG] mgrmap e30: smithi050.emnywo(active, since 93s), standbys: smithi098.vhfzum 2023-01-04T18:18:58.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:56.731327+0000 mon.smithi050 (mon.0) 123 : audit [INF] from='osd.0 [v2:172.21.15.50:6802/2203732943,v1:172.21.15.50:6803/2203732943]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-01-04T18:18:58.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:57.092187+0000 mon.smithi050 (mon.0) 124 : cluster [WRN] Health check update: Degraded data redundancy: 42/216 objects degraded (19.444%), 29 pgs degraded (PG_DEGRADED) 2023-01-04T18:18:58.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.195+0000 7fefa0f03700 1 -- 172.21.15.50:0/1511310654 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fef9c0faca0 con 0x7fef88060be0 2023-01-04T18:18:58.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.196+0000 7fef92ffd700 1 -- 172.21.15.50:0/1511310654 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fef9c0faca0 con 0x7fef88060be0 2023-01-04T18:18:58.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.198+0000 7fefa0f03700 1 -- 172.21.15.50:0/1511310654 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fef88060be0 msgr2=0x7fef880630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:58.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.198+0000 7fefa0f03700 1 --2- 172.21.15.50:0/1511310654 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fef88060be0 0x7fef880630a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fef84004630 tx=0x7fef84009b30).stop 2023-01-04T18:18:58.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.198+0000 7fefa0f03700 1 -- 172.21.15.50:0/1511310654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef9c0f55c0 msgr2=0x7fef9c0f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:58.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.198+0000 7fefa0f03700 1 --2- 172.21.15.50:0/1511310654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef9c0f55c0 0x7fef9c0f9720 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fef8c002700 tx=0x7fef8c009d80).stop 2023-01-04T18:18:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.198+0000 7fefa0f03700 1 -- 172.21.15.50:0/1511310654 shutdown_connections 2023-01-04T18:18:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.198+0000 7fefa0f03700 1 --2- 172.21.15.50:0/1511310654 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fef88060be0 0x7fef880630a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.198+0000 7fefa0f03700 1 --2- 172.21.15.50:0/1511310654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef9c0f55c0 0x7fef9c0f9720 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.198+0000 7fefa0f03700 1 --2- 172.21.15.50:0/1511310654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef9c0f6860 0x7fef9c0f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.198+0000 7fefa0f03700 1 -- 172.21.15.50:0/1511310654 >> 172.21.15.50:0/1511310654 conn(0x7fef9c0f0d40 msgr2=0x7fef9c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.198+0000 7fefa0f03700 1 -- 172.21.15.50:0/1511310654 shutdown_connections 2023-01-04T18:18:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.198+0000 7fefa0f03700 1 -- 172.21.15.50:0/1511310654 wait complete. 2023-01-04T18:18:58.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.299+0000 7f0ad543c700 1 -- 172.21.15.50:0/1488614175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad00f6540 msgr2=0x7f0ad00f6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:58.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.299+0000 7f0ad543c700 1 --2- 172.21.15.50:0/1488614175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad00f6540 0x7f0ad00f6960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f0ac0004660 tx=0x7f0ac0009b30).stop 2023-01-04T18:18:58.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.299+0000 7f0ad543c700 1 -- 172.21.15.50:0/1488614175 shutdown_connections 2023-01-04T18:18:58.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.299+0000 7f0ad543c700 1 --2- 172.21.15.50:0/1488614175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ad00f77e0 0x7f0ad00f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:58.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.299+0000 7f0ad543c700 1 --2- 172.21.15.50:0/1488614175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad00f6540 0x7f0ad00f6960 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:58.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.299+0000 7f0ad543c700 1 -- 172.21.15.50:0/1488614175 >> 172.21.15.50:0/1488614175 conn(0x7f0ad00f1ca0 msgr2=0x7f0ad00f40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:58.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.299+0000 7f0ad543c700 1 -- 172.21.15.50:0/1488614175 shutdown_connections 2023-01-04T18:18:58.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.299+0000 7f0ad543c700 1 -- 172.21.15.50:0/1488614175 wait complete. 2023-01-04T18:18:58.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.300+0000 7f0ad543c700 1 Processor -- start 2023-01-04T18:18:58.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.300+0000 7f0ad543c700 1 -- start start 2023-01-04T18:18:58.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.300+0000 7f0ad543c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ad00f6540 0x7f0ad0108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:58.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.300+0000 7f0ad543c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad00f77e0 0x7f0ad0109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:58.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.300+0000 7f0ad543c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad0109a00 con 0x7f0ad00f77e0 2023-01-04T18:18:58.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.300+0000 7f0ad543c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad0109b40 con 0x7f0ad00f6540 2023-01-04T18:18:58.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.301+0000 7f0ace7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad00f77e0 0x7f0ad0109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:58.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.301+0000 7f0ace7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad00f77e0 0x7f0ad0109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53778/0 (socket says 172.21.15.50:53778) 2023-01-04T18:18:58.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.301+0000 7f0ace7fc700 1 -- 172.21.15.50:0/1603083809 learned_addr learned my addr 172.21.15.50:0/1603083809 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:18:58.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.301+0000 7f0aceffd700 1 --2- 172.21.15.50:0/1603083809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ad00f6540 0x7f0ad0108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:58.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.301+0000 7f0ace7fc700 1 -- 172.21.15.50:0/1603083809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ad00f6540 msgr2=0x7f0ad0108f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:58.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.301+0000 7f0ace7fc700 1 --2- 172.21.15.50:0/1603083809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ad00f6540 0x7f0ad0108f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:58.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.301+0000 7f0ace7fc700 1 -- 172.21.15.50:0/1603083809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac0005040 con 0x7f0ad00f77e0 2023-01-04T18:18:58.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.301+0000 7f0ace7fc700 1 --2- 172.21.15.50:0/1603083809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad00f77e0 0x7f0ad0109450 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f0ac400e7f0 tx=0x7f0ac400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:58.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.301+0000 7f0ab77fe700 1 -- 172.21.15.50:0/1603083809 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ac40092e0 con 0x7f0ad00f77e0 2023-01-04T18:18:58.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.301+0000 7f0ab77fe700 1 -- 172.21.15.50:0/1603083809 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0ac400f040 con 0x7f0ad00f77e0 2023-01-04T18:18:58.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.301+0000 7f0ab77fe700 1 -- 172.21.15.50:0/1603083809 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ac40147e0 con 0x7f0ad00f77e0 2023-01-04T18:18:58.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.301+0000 7f0ad543c700 1 -- 172.21.15.50:0/1603083809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad010a4e0 con 0x7f0ad00f77e0 2023-01-04T18:18:58.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.301+0000 7f0ad543c700 1 -- 172.21.15.50:0/1603083809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad010aa20 con 0x7f0ad00f77e0 2023-01-04T18:18:58.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.302+0000 7f0ad543c700 1 -- 172.21.15.50:0/1603083809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad0045ad0 con 0x7f0ad00f77e0 2023-01-04T18:18:58.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.303+0000 7f0ab77fe700 1 -- 172.21.15.50:0/1603083809 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f0ac401b030 con 0x7f0ad00f77e0 2023-01-04T18:18:58.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.303+0000 7f0ab77fe700 1 --2- 172.21.15.50:0/1603083809 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0ab8060c30 0x7f0ab80630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:58.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.303+0000 7f0ab77fe700 1 -- 172.21.15.50:0/1603083809 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f0ac407b9b0 con 0x7f0ad00f77e0 2023-01-04T18:18:58.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.303+0000 7f0aceffd700 1 --2- 172.21.15.50:0/1603083809 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0ab8060c30 0x7f0ab80630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:58.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.304+0000 7f0aceffd700 1 --2- 172.21.15.50:0/1603083809 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0ab8060c30 0x7f0ab80630f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f0ac0009720 tx=0x7f0ac0016040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:58.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.308+0000 7f0ab77fe700 1 -- 172.21.15.50:0/1603083809 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f0ac404fab0 con 0x7f0ad00f77e0 2023-01-04T18:18:58.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.491+0000 7f0ad543c700 1 -- 172.21.15.50:0/1603083809 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ad00fee80 con 0x7f0ab8060c30 2023-01-04T18:18:58.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.500+0000 7f0ab77fe700 1 -- 172.21.15.50:0/1603083809 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f0ac000f070 con 0x7f0ab8060c30 2023-01-04T18:18:58.504 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-01-04T18:18:58.504 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager.smithi050 smithi050 *:9093,9094 running (7m) 3s ago 8m 22.4M - 0.20.0 0881eb8f169f b5d3e2678a23 2023-01-04T18:18:58.504 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi050 smithi050 running (45s) 3s ago 8m 7050k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cfe28e5ab81e 2023-01-04T18:18:58.504 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi098 smithi098 running (36s) 31s ago 7m 7042k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cf5f0ca60522 2023-01-04T18:18:58.504 INFO:teuthology.orchestra.run.smithi050.stdout:grafana.smithi050 smithi050 *:3000 running (7m) 3s ago 8m 37.2M - 6.7.4 557c83e11646 7e5dccbafe78 2023-01-04T18:18:58.505 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.ezoiwl smithi050 running (4m) 3s ago 4m 9.91G - 16.2.4 8d91d370c2b8 6c5c5f2be8b9 2023-01-04T18:18:58.505 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.kefmuy smithi050 running (4m) 3s ago 4m 18.0M - 16.2.4 8d91d370c2b8 58cace913b55 2023-01-04T18:18:58.505 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.laynsk smithi098 running (4m) 31s ago 4m 15.7M - 16.2.4 8d91d370c2b8 8ff8af70b989 2023-01-04T18:18:58.505 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.memais smithi098 running (4m) 31s ago 4m 1070M - 16.2.4 8d91d370c2b8 d59d9b4dbf7d 2023-01-04T18:18:58.505 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi050.emnywo smithi050 *:8443,9283 running (107s) 3s ago 9m 440M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d ee677216e754 2023-01-04T18:18:58.505 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi098.vhfzum smithi098 *:8443,9283 running (81s) 31s ago 7m 394M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d f3d98bf0cf66 2023-01-04T18:18:58.505 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi050 smithi050 running (71s) 3s ago 9m 74.3M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 0423819cbaa7 2023-01-04T18:18:58.505 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi098 smithi098 running (57s) 31s ago 7m 39.4M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 12094818aefc 2023-01-04T18:18:58.505 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi050 smithi050 *:9100 running (8m) 3s ago 8m 18.3M - 0.18.1 e5a616e4b9cf 88892b2e5e5a 2023-01-04T18:18:58.505 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi098 smithi098 *:9100 running (7m) 31s ago 7m 18.4M - 0.18.1 e5a616e4b9cf 49bcde8331b6 2023-01-04T18:18:58.505 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (12s) 3s ago 7m 13.9M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 60dafedcb429 2023-01-04T18:18:58.505 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi050 running (6m) 3s ago 6m 1098M 4096M 16.2.4 8d91d370c2b8 e4928bcfd146 2023-01-04T18:18:58.506 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi050 running (6m) 3s ago 6m 915M 4096M 16.2.4 8d91d370c2b8 babab394b338 2023-01-04T18:18:58.506 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi098 running (6m) 31s ago 6m 1186M 4096M 16.2.4 8d91d370c2b8 b02df8e3cb23 2023-01-04T18:18:58.506 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi098 running (6m) 31s ago 6m 876M 4096M 16.2.4 8d91d370c2b8 92273135ca82 2023-01-04T18:18:58.506 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi098 running (5m) 31s ago 5m 971M 4096M 16.2.4 8d91d370c2b8 366d0bfff809 2023-01-04T18:18:58.506 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus.smithi050 smithi050 *:9095 running (117s) 3s ago 8m 55.3M - 2.18.1 de242295e225 7bdcf7a45d34 2023-01-04T18:18:58.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.502+0000 7f0ad543c700 1 -- 172.21.15.50:0/1603083809 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0ab8060c30 msgr2=0x7f0ab80630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:58.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.502+0000 7f0ad543c700 1 --2- 172.21.15.50:0/1603083809 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0ab8060c30 0x7f0ab80630f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f0ac0009720 tx=0x7f0ac0016040).stop 2023-01-04T18:18:58.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.502+0000 7f0ad543c700 1 -- 172.21.15.50:0/1603083809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad00f77e0 msgr2=0x7f0ad0109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:58.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.502+0000 7f0ad543c700 1 --2- 172.21.15.50:0/1603083809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad00f77e0 0x7f0ad0109450 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f0ac400e7f0 tx=0x7f0ac400b040).stop 2023-01-04T18:18:58.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.502+0000 7f0ad543c700 1 -- 172.21.15.50:0/1603083809 shutdown_connections 2023-01-04T18:18:58.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.502+0000 7f0ad543c700 1 --2- 172.21.15.50:0/1603083809 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0ab8060c30 0x7f0ab80630f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:58.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.502+0000 7f0ad543c700 1 --2- 172.21.15.50:0/1603083809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ad00f6540 0x7f0ad0108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:58.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.502+0000 7f0ad543c700 1 --2- 172.21.15.50:0/1603083809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad00f77e0 0x7f0ad0109450 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:58.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.502+0000 7f0ad543c700 1 -- 172.21.15.50:0/1603083809 >> 172.21.15.50:0/1603083809 conn(0x7f0ad00f1ca0 msgr2=0x7f0ad006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:58.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.502+0000 7f0ad543c700 1 -- 172.21.15.50:0/1603083809 shutdown_connections 2023-01-04T18:18:58.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.503+0000 7f0ad543c700 1 -- 172.21.15.50:0/1603083809 wait complete. 2023-01-04T18:18:58.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.604+0000 7f183d96e700 1 -- 172.21.15.50:0/4185293955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18380f6860 msgr2=0x7f18380f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:58.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.604+0000 7f183d96e700 1 --2- 172.21.15.50:0/4185293955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18380f6860 0x7f18380f6cc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1820004660 tx=0x7f1820009b30).stop 2023-01-04T18:18:58.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.604+0000 7f183d96e700 1 -- 172.21.15.50:0/4185293955 shutdown_connections 2023-01-04T18:18:58.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.604+0000 7f183d96e700 1 --2- 172.21.15.50:0/4185293955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18380f6860 0x7f18380f6cc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:58.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.604+0000 7f183d96e700 1 --2- 172.21.15.50:0/4185293955 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18380f55c0 0x7f18380f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:58.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.604+0000 7f183d96e700 1 -- 172.21.15.50:0/4185293955 >> 172.21.15.50:0/4185293955 conn(0x7f18380f0d40 msgr2=0x7f18380f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:58.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.604+0000 7f183d96e700 1 -- 172.21.15.50:0/4185293955 shutdown_connections 2023-01-04T18:18:58.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.604+0000 7f183d96e700 1 -- 172.21.15.50:0/4185293955 wait complete. 2023-01-04T18:18:58.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.605+0000 7f183d96e700 1 Processor -- start 2023-01-04T18:18:58.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.605+0000 7f183d96e700 1 -- start start 2023-01-04T18:18:58.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.605+0000 7f183d96e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18380f55c0 0x7f1838105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:58.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.605+0000 7f183d96e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18380f6860 0x7f1838106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:58.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.605+0000 7f183d96e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1838106910 con 0x7f18380f55c0 2023-01-04T18:18:58.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.605+0000 7f183d96e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1838106a50 con 0x7f18380f6860 2023-01-04T18:18:58.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.605+0000 7f1836ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18380f55c0 0x7f1838105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:58.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.605+0000 7f1836ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18380f55c0 0x7f1838105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53786/0 (socket says 172.21.15.50:53786) 2023-01-04T18:18:58.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.605+0000 7f1836ffd700 1 -- 172.21.15.50:0/700677981 learned_addr learned my addr 172.21.15.50:0/700677981 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:18:58.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.605+0000 7f18367fc700 1 --2- 172.21.15.50:0/700677981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18380f6860 0x7f1838106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:58.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.605+0000 7f1836ffd700 1 -- 172.21.15.50:0/700677981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18380f6860 msgr2=0x7f1838106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:58.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.605+0000 7f1836ffd700 1 --2- 172.21.15.50:0/700677981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18380f6860 0x7f1838106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:58.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.605+0000 7f1836ffd700 1 -- 172.21.15.50:0/700677981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1820005040 con 0x7f18380f55c0 2023-01-04T18:18:58.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.605+0000 7f1836ffd700 1 --2- 172.21.15.50:0/700677981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18380f55c0 0x7f1838105e70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1828002700 tx=0x7f1828009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:58.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.606+0000 7f182f7fe700 1 -- 172.21.15.50:0/700677981 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18280079c0 con 0x7f18380f55c0 2023-01-04T18:18:58.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.606+0000 7f183d96e700 1 -- 172.21.15.50:0/700677981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18381073f0 con 0x7f18380f55c0 2023-01-04T18:18:58.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.606+0000 7f182f7fe700 1 -- 172.21.15.50:0/700677981 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f182800f040 con 0x7f18380f55c0 2023-01-04T18:18:58.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.606+0000 7f182f7fe700 1 -- 172.21.15.50:0/700677981 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18280148d0 con 0x7f18380f55c0 2023-01-04T18:18:58.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.606+0000 7f183d96e700 1 -- 172.21.15.50:0/700677981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18381079b0 con 0x7f18380f55c0 2023-01-04T18:18:58.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.607+0000 7f183d96e700 1 -- 172.21.15.50:0/700677981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1838045ad0 con 0x7f18380f55c0 2023-01-04T18:18:58.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.607+0000 7f182f7fe700 1 -- 172.21.15.50:0/700677981 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f182801b060 con 0x7f18380f55c0 2023-01-04T18:18:58.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.607+0000 7f182f7fe700 1 --2- 172.21.15.50:0/700677981 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1824060be0 0x7f18240630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:58.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.607+0000 7f182f7fe700 1 -- 172.21.15.50:0/700677981 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f182807bbc0 con 0x7f18380f55c0 2023-01-04T18:18:58.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.608+0000 7f18367fc700 1 --2- 172.21.15.50:0/700677981 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1824060be0 0x7f18240630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:58.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.608+0000 7f18367fc700 1 --2- 172.21.15.50:0/700677981 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1824060be0 0x7f18240630a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1820004630 tx=0x7f1820009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:58.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.612+0000 7f182f7fe700 1 -- 172.21.15.50:0/700677981 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f182804fb50 con 0x7f18380f55c0 2023-01-04T18:18:58.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.913+0000 7f183d96e700 1 -- 172.21.15.50:0/700677981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f18380fded0 con 0x7f18380f55c0 2023-01-04T18:18:58.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.913+0000 7f182f7fe700 1 -- 172.21.15.50:0/700677981 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+824 (secure 0 0 0) 0x7f182804f740 con 0x7f18380f55c0 2023-01-04T18:18:58.917 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:18:58.917 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": { 2023-01-04T18:18:58.917 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:18:58.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:18:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": { 2023-01-04T18:18:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:18:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:18:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": { 2023-01-04T18:18:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 1, 2023-01-04T18:18:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2023-01-04T18:18:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:18:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2023-01-04T18:18:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-01-04T18:18:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:18:58.919 INFO:teuthology.orchestra.run.smithi050.stdout: "overall": { 2023-01-04T18:18:58.919 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 5, 2023-01-04T18:18:58.919 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9 2023-01-04T18:18:58.919 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-01-04T18:18:58.919 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:18:58.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.916+0000 7f183d96e700 1 -- 172.21.15.50:0/700677981 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1824060be0 msgr2=0x7f18240630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:58.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.916+0000 7f183d96e700 1 --2- 172.21.15.50:0/700677981 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1824060be0 0x7f18240630a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1820004630 tx=0x7f1820009b30).stop 2023-01-04T18:18:58.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.916+0000 7f183d96e700 1 -- 172.21.15.50:0/700677981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18380f55c0 msgr2=0x7f1838105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:58.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.916+0000 7f183d96e700 1 --2- 172.21.15.50:0/700677981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18380f55c0 0x7f1838105e70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1828002700 tx=0x7f1828009d80).stop 2023-01-04T18:18:58.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.916+0000 7f183d96e700 1 -- 172.21.15.50:0/700677981 shutdown_connections 2023-01-04T18:18:58.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.916+0000 7f183d96e700 1 --2- 172.21.15.50:0/700677981 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1824060be0 0x7f18240630a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:58.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.916+0000 7f183d96e700 1 --2- 172.21.15.50:0/700677981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18380f55c0 0x7f1838105e70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:58.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.916+0000 7f183d96e700 1 --2- 172.21.15.50:0/700677981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18380f6860 0x7f1838106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:58.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.916+0000 7f183d96e700 1 -- 172.21.15.50:0/700677981 >> 172.21.15.50:0/700677981 conn(0x7f18380f0d40 msgr2=0x7f18380fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:58.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.916+0000 7f183d96e700 1 -- 172.21.15.50:0/700677981 shutdown_connections 2023-01-04T18:18:58.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:58.916+0000 7f183d96e700 1 -- 172.21.15.50:0/700677981 wait complete. 2023-01-04T18:18:59.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.018+0000 7f098d718700 1 -- 172.21.15.50:0/1385808076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09880fbbf0 msgr2=0x7f09880fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:59.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.018+0000 7f098d718700 1 --2- 172.21.15.50:0/1385808076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09880fbbf0 0x7f09880fdfe0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f097c004660 tx=0x7f097c009b30).stop 2023-01-04T18:18:59.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.018+0000 7f098d718700 1 -- 172.21.15.50:0/1385808076 shutdown_connections 2023-01-04T18:18:59.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.018+0000 7f098d718700 1 --2- 172.21.15.50:0/1385808076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09880fbbf0 0x7f09880fdfe0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:59.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.018+0000 7f098d718700 1 --2- 172.21.15.50:0/1385808076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09880602b0 0x7f09880fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:59.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.018+0000 7f098d718700 1 -- 172.21.15.50:0/1385808076 >> 172.21.15.50:0/1385808076 conn(0x7f09880f0d40 msgr2=0x7f09880f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:59.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.018+0000 7f098d718700 1 -- 172.21.15.50:0/1385808076 shutdown_connections 2023-01-04T18:18:59.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.018+0000 7f098d718700 1 -- 172.21.15.50:0/1385808076 wait complete. 2023-01-04T18:18:59.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.018+0000 7f098d718700 1 Processor -- start 2023-01-04T18:18:59.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.019+0000 7f098d718700 1 -- start start 2023-01-04T18:18:59.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.019+0000 7f098d718700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09880602b0 0x7f0988109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:59.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.019+0000 7f098d718700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09880fbbf0 0x7f0988109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.019+0000 7f098d718700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0988109c00 con 0x7f09880fbbf0 2023-01-04T18:18:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.019+0000 7f098d718700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0988109d40 con 0x7f09880602b0 2023-01-04T18:18:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.019+0000 7f09867fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09880fbbf0 0x7f0988109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.019+0000 7f09867fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09880fbbf0 0x7f0988109650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53800/0 (socket says 172.21.15.50:53800) 2023-01-04T18:18:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.019+0000 7f09867fc700 1 -- 172.21.15.50:0/1024826094 learned_addr learned my addr 172.21.15.50:0/1024826094 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:18:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.019+0000 7f0986ffd700 1 --2- 172.21.15.50:0/1024826094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09880602b0 0x7f0988109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.019+0000 7f09867fc700 1 -- 172.21.15.50:0/1024826094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09880602b0 msgr2=0x7f0988109160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.019+0000 7f09867fc700 1 --2- 172.21.15.50:0/1024826094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09880602b0 0x7f0988109160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.019+0000 7f09867fc700 1 -- 172.21.15.50:0/1024826094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c005040 con 0x7f09880fbbf0 2023-01-04T18:18:59.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.019+0000 7f09867fc700 1 --2- 172.21.15.50:0/1024826094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09880fbbf0 0x7f0988109650 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f097c004e30 tx=0x7f097c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:59.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.020+0000 7f096f7fe700 1 -- 172.21.15.50:0/1024826094 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f097c018070 con 0x7f09880fbbf0 2023-01-04T18:18:59.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.020+0000 7f098d718700 1 -- 172.21.15.50:0/1024826094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098810a680 con 0x7f09880fbbf0 2023-01-04T18:18:59.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.020+0000 7f096f7fe700 1 -- 172.21.15.50:0/1024826094 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f097c009630 con 0x7f09880fbbf0 2023-01-04T18:18:59.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.020+0000 7f096f7fe700 1 -- 172.21.15.50:0/1024826094 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f097c01c3c0 con 0x7f09880fbbf0 2023-01-04T18:18:59.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.020+0000 7f098d718700 1 -- 172.21.15.50:0/1024826094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098810abe0 con 0x7f09880fbbf0 2023-01-04T18:18:59.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.021+0000 7f098d718700 1 -- 172.21.15.50:0/1024826094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0988045ad0 con 0x7f09880fbbf0 2023-01-04T18:18:59.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.021+0000 7f096f7fe700 1 -- 172.21.15.50:0/1024826094 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f097c01d420 con 0x7f09880fbbf0 2023-01-04T18:18:59.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.021+0000 7f096f7fe700 1 --2- 172.21.15.50:0/1024826094 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0970060be0 0x7f09700630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:59.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.022+0000 7f096f7fe700 1 -- 172.21.15.50:0/1024826094 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f097c07d9d0 con 0x7f09880fbbf0 2023-01-04T18:18:59.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.022+0000 7f0986ffd700 1 --2- 172.21.15.50:0/1024826094 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0970060be0 0x7f09700630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:59.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.022+0000 7f0986ffd700 1 --2- 172.21.15.50:0/1024826094 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0970060be0 0x7f09700630a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f0978004c40 tx=0x7f097800b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:59.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.026+0000 7f096f7fe700 1 -- 172.21.15.50:0/1024826094 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f097c051920 con 0x7f09880fbbf0 2023-01-04T18:18:59.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:57.723423+0000 mon.smithi050 (mon.0) 125 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-01-04T18:18:59.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:57.726930+0000 mon.smithi050 (mon.0) 126 : cluster [INF] osd.0 [v2:172.21.15.50:6802/2203732943,v1:172.21.15.50:6803/2203732943] boot 2023-01-04T18:18:59.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:57.726996+0000 mon.smithi050 (mon.0) 127 : cluster [DBG] osdmap e49: 6 total, 6 up, 6 in 2023-01-04T18:18:59.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:57.727467+0000 mon.smithi050 (mon.0) 128 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-01-04T18:18:59.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:57.891816+0000 mgr.smithi050.emnywo (mgr.24517) 82 : audit [DBG] from='client.34148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:18:59.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:58.197352+0000 mgr.smithi050.emnywo (mgr.24517) 83 : audit [DBG] from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:18:59.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:58.493495+0000 mgr.smithi050.emnywo (mgr.24517) 84 : audit [DBG] from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:18:59.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:57.723423+0000 mon.smithi050 (mon.0) 125 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-01-04T18:18:59.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:57.726930+0000 mon.smithi050 (mon.0) 126 : cluster [INF] osd.0 [v2:172.21.15.50:6802/2203732943,v1:172.21.15.50:6803/2203732943] boot 2023-01-04T18:18:59.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:57.726996+0000 mon.smithi050 (mon.0) 127 : cluster [DBG] osdmap e49: 6 total, 6 up, 6 in 2023-01-04T18:18:59.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:57.727467+0000 mon.smithi050 (mon.0) 128 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-01-04T18:18:59.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:57.891816+0000 mgr.smithi050.emnywo (mgr.24517) 82 : audit [DBG] from='client.34148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:18:59.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:58.197352+0000 mgr.smithi050.emnywo (mgr.24517) 83 : audit [DBG] from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:18:59.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:58.493495+0000 mgr.smithi050.emnywo (mgr.24517) 84 : audit [DBG] from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:18:59.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.244+0000 7f098d718700 1 -- 172.21.15.50:0/1024826094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0988027a00 con 0x7f09880fbbf0 2023-01-04T18:18:59.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.245+0000 7f096f7fe700 1 -- 172.21.15.50:0/1024826094 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1793 (secure 0 0 0) 0x7f097c051510 con 0x7f09880fbbf0 2023-01-04T18:18:59.248 INFO:teuthology.orchestra.run.smithi050.stdout:e13 2023-01-04T18:18:59.249 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:18:59.249 INFO:teuthology.orchestra.run.smithi050.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:18:59.249 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-01-04T18:18:59.249 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:18:59.249 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-01-04T18:18:59.249 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-01-04T18:18:59.249 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 10 2023-01-04T18:18:59.249 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 2023-01-04T18:18:59.249 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:18:59.249 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-01-04T18:14:43.958806+0000 2023-01-04T18:18:59.249 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-01-04T18:18:59.250 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-01-04T18:18:59.250 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 60 2023-01-04T18:18:59.250 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-01-04T18:18:59.250 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-01-04T18:18:59.250 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-01-04T18:18:59.250 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-01-04T18:18:59.250 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 0 2023-01-04T18:18:59.250 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:18:59.250 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 1 2023-01-04T18:18:59.250 INFO:teuthology.orchestra.run.smithi050.stdout:in 0 2023-01-04T18:18:59.250 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=14430} 2023-01-04T18:18:59.251 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-01-04T18:18:59.251 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-01-04T18:18:59.251 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-01-04T18:18:59.251 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-01-04T18:18:59.251 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-01-04T18:18:59.251 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data enabled 2023-01-04T18:18:59.251 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-01-04T18:18:59.251 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 1 2023-01-04T18:18:59.251 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.ezoiwl{0:14430} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:18:59.251 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.memais{0:24291} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.98:6824/1196398070,v1:172.21.15.98:6825/1196398070] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:18:59.251 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:18:59.251 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:18:59.252 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2023-01-04T18:18:59.252 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:18:59.252 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.kefmuy{-1:14440} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:18:59.252 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.laynsk{-1:24297} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:18:59.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.247+0000 7f098d718700 1 -- 172.21.15.50:0/1024826094 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0970060be0 msgr2=0x7f09700630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:59.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.247+0000 7f098d718700 1 --2- 172.21.15.50:0/1024826094 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0970060be0 0x7f09700630a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f0978004c40 tx=0x7f097800b040).stop 2023-01-04T18:18:59.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.247+0000 7f098d718700 1 -- 172.21.15.50:0/1024826094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09880fbbf0 msgr2=0x7f0988109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:59.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.247+0000 7f098d718700 1 --2- 172.21.15.50:0/1024826094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09880fbbf0 0x7f0988109650 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f097c004e30 tx=0x7f097c009b30).stop 2023-01-04T18:18:59.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.247+0000 7f098d718700 1 -- 172.21.15.50:0/1024826094 shutdown_connections 2023-01-04T18:18:59.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.247+0000 7f098d718700 1 --2- 172.21.15.50:0/1024826094 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0970060be0 0x7f09700630a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:59.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.247+0000 7f098d718700 1 --2- 172.21.15.50:0/1024826094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09880602b0 0x7f0988109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:59.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.247+0000 7f098d718700 1 --2- 172.21.15.50:0/1024826094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09880fbbf0 0x7f0988109650 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:59.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.247+0000 7f098d718700 1 -- 172.21.15.50:0/1024826094 >> 172.21.15.50:0/1024826094 conn(0x7f09880f0d40 msgr2=0x7f09880f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:59.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.247+0000 7f098d718700 1 -- 172.21.15.50:0/1024826094 shutdown_connections 2023-01-04T18:18:59.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.247+0000 7f098d718700 1 -- 172.21.15.50:0/1024826094 wait complete. 2023-01-04T18:18:59.253 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2023-01-04T18:18:59.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.349+0000 7f23071fa700 1 -- 172.21.15.50:0/1060602532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23000f6860 msgr2=0x7f23000f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:59.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.349+0000 7f23071fa700 1 --2- 172.21.15.50:0/1060602532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23000f6860 0x7f23000f6cc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f22ec004660 tx=0x7f22ec009b30).stop 2023-01-04T18:18:59.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.349+0000 7f23071fa700 1 -- 172.21.15.50:0/1060602532 shutdown_connections 2023-01-04T18:18:59.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.349+0000 7f23071fa700 1 --2- 172.21.15.50:0/1060602532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23000f6860 0x7f23000f6cc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:59.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.349+0000 7f23071fa700 1 --2- 172.21.15.50:0/1060602532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23000f55c0 0x7f23000f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:59.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.349+0000 7f23071fa700 1 -- 172.21.15.50:0/1060602532 >> 172.21.15.50:0/1060602532 conn(0x7f23000f0d40 msgr2=0x7f23000f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:59.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.349+0000 7f23071fa700 1 -- 172.21.15.50:0/1060602532 shutdown_connections 2023-01-04T18:18:59.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.349+0000 7f23071fa700 1 -- 172.21.15.50:0/1060602532 wait complete. 2023-01-04T18:18:59.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.349+0000 7f23071fa700 1 Processor -- start 2023-01-04T18:18:59.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.349+0000 7f23071fa700 1 -- start start 2023-01-04T18:18:59.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.350+0000 7f23071fa700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23000f55c0 0x7f2300109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:59.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.350+0000 7f23071fa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23000f6860 0x7f230010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:59.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.350+0000 7f23071fa700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23000603e0 con 0x7f23000f55c0 2023-01-04T18:18:59.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.350+0000 7f23071fa700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2300060520 con 0x7f23000f6860 2023-01-04T18:18:59.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.350+0000 7f2304f96700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23000f55c0 0x7f2300109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:59.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.350+0000 7f2304f96700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23000f55c0 0x7f2300109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53814/0 (socket says 172.21.15.50:53814) 2023-01-04T18:18:59.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.350+0000 7f2304f96700 1 -- 172.21.15.50:0/2003427001 learned_addr learned my addr 172.21.15.50:0/2003427001 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:18:59.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.350+0000 7f22fffff700 1 --2- 172.21.15.50:0/2003427001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23000f6860 0x7f230010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:59.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.350+0000 7f2304f96700 1 -- 172.21.15.50:0/2003427001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23000f6860 msgr2=0x7f230010c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:59.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.350+0000 7f2304f96700 1 --2- 172.21.15.50:0/2003427001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23000f6860 0x7f230010c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:59.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.350+0000 7f2304f96700 1 -- 172.21.15.50:0/2003427001 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec005040 con 0x7f23000f55c0 2023-01-04T18:18:59.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.350+0000 7f2304f96700 1 --2- 172.21.15.50:0/2003427001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23000f55c0 0x7f2300109c70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f22f4002700 tx=0x7f22f4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:59.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.351+0000 7f22fd7fa700 1 -- 172.21.15.50:0/2003427001 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22f40079c0 con 0x7f23000f55c0 2023-01-04T18:18:59.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.351+0000 7f23071fa700 1 -- 172.21.15.50:0/2003427001 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230010c720 con 0x7f23000f55c0 2023-01-04T18:18:59.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.351+0000 7f22fd7fa700 1 -- 172.21.15.50:0/2003427001 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f22f400f040 con 0x7f23000f55c0 2023-01-04T18:18:59.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.351+0000 7f22fd7fa700 1 -- 172.21.15.50:0/2003427001 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22f40148d0 con 0x7f23000f55c0 2023-01-04T18:18:59.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.351+0000 7f23071fa700 1 -- 172.21.15.50:0/2003427001 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230010cce0 con 0x7f23000f55c0 2023-01-04T18:18:59.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.352+0000 7f23071fa700 1 -- 172.21.15.50:0/2003427001 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2300045ad0 con 0x7f23000f55c0 2023-01-04T18:18:59.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.352+0000 7f22fd7fa700 1 -- 172.21.15.50:0/2003427001 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f22f401b060 con 0x7f23000f55c0 2023-01-04T18:18:59.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.352+0000 7f22fd7fa700 1 --2- 172.21.15.50:0/2003427001 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f22f0060be0 0x7f22f00630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:18:59.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.353+0000 7f22fd7fa700 1 -- 172.21.15.50:0/2003427001 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f22f407bc00 con 0x7f23000f55c0 2023-01-04T18:18:59.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.353+0000 7f22fffff700 1 --2- 172.21.15.50:0/2003427001 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f22f0060be0 0x7f22f00630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:18:59.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.353+0000 7f22fffff700 1 --2- 172.21.15.50:0/2003427001 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f22f0060be0 0x7f22f00630a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f22ec004630 tx=0x7f22ec009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:18:59.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.357+0000 7f22fd7fa700 1 -- 172.21.15.50:0/2003427001 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f22f4081020 con 0x7f23000f55c0 2023-01-04T18:18:59.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.544+0000 7f23071fa700 1 -- 172.21.15.50:0/2003427001 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f23000fdf00 con 0x7f22f0060be0 2023-01-04T18:18:59.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.546+0000 7f22fd7fa700 1 -- 172.21.15.50:0/2003427001 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f22ec019040 con 0x7f22f0060be0 2023-01-04T18:18:59.549 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:18:59.549 INFO:teuthology.orchestra.run.smithi050.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308", 2023-01-04T18:18:59.549 INFO:teuthology.orchestra.run.smithi050.stdout: "in_progress": true, 2023-01-04T18:18:59.549 INFO:teuthology.orchestra.run.smithi050.stdout: "which": "Upgrading all daemon types on all hosts", 2023-01-04T18:18:59.549 INFO:teuthology.orchestra.run.smithi050.stdout: "services_complete": [ 2023-01-04T18:18:59.549 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2023-01-04T18:18:59.549 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr", 2023-01-04T18:18:59.549 INFO:teuthology.orchestra.run.smithi050.stdout: "mon" 2023-01-04T18:18:59.550 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-01-04T18:18:59.550 INFO:teuthology.orchestra.run.smithi050.stdout: "progress": "7/21 daemons upgraded", 2023-01-04T18:18:59.550 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "Currently upgrading osd daemons", 2023-01-04T18:18:59.550 INFO:teuthology.orchestra.run.smithi050.stdout: "is_paused": false 2023-01-04T18:18:59.550 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:18:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.547+0000 7f23071fa700 1 -- 172.21.15.50:0/2003427001 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f22f0060be0 msgr2=0x7f22f00630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.547+0000 7f23071fa700 1 --2- 172.21.15.50:0/2003427001 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f22f0060be0 0x7f22f00630a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f22ec004630 tx=0x7f22ec009b30).stop 2023-01-04T18:18:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.547+0000 7f23071fa700 1 -- 172.21.15.50:0/2003427001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23000f55c0 msgr2=0x7f2300109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:18:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.547+0000 7f23071fa700 1 --2- 172.21.15.50:0/2003427001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23000f55c0 0x7f2300109c70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f22f4002700 tx=0x7f22f4009d80).stop 2023-01-04T18:18:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.547+0000 7f23071fa700 1 -- 172.21.15.50:0/2003427001 shutdown_connections 2023-01-04T18:18:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.547+0000 7f23071fa700 1 --2- 172.21.15.50:0/2003427001 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f22f0060be0 0x7f22f00630a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.547+0000 7f23071fa700 1 --2- 172.21.15.50:0/2003427001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23000f55c0 0x7f2300109c70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.547+0000 7f23071fa700 1 --2- 172.21.15.50:0/2003427001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23000f6860 0x7f230010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:18:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.547+0000 7f23071fa700 1 -- 172.21.15.50:0/2003427001 >> 172.21.15.50:0/2003427001 conn(0x7f23000f0d40 msgr2=0x7f23000fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:18:59.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.547+0000 7f23071fa700 1 -- 172.21.15.50:0/2003427001 shutdown_connections 2023-01-04T18:18:59.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:18:59.547+0000 7f23071fa700 1 -- 172.21.15.50:0/2003427001 wait complete. 2023-01-04T18:19:00.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:58.618408+0000 mgr.smithi050.emnywo (mgr.24517) 85 : cluster [DBG] pgmap v55: 65 pgs: 29 active+undersized+degraded, 5 active+undersized, 31 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 990 KiB/s rd, 917 KiB/s wr, 271 op/s; 42/216 objects degraded (19.444%) 2023-01-04T18:19:00.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:58.734768+0000 mon.smithi050 (mon.0) 129 : cluster [DBG] osdmap e50: 6 total, 6 up, 6 in 2023-01-04T18:19:00.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:58.914976+0000 mon.smithi050 (mon.0) 130 : audit [DBG] from='client.? 172.21.15.50:0/700677981' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:19:00.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:59.246457+0000 mon.smithi050 (mon.0) 131 : audit [DBG] from='client.? 172.21.15.50:0/1024826094' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:19:00.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:18:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:18:59.546761+0000 mgr.smithi050.emnywo (mgr.24517) 86 : audit [DBG] from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:19:00.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:58.618408+0000 mgr.smithi050.emnywo (mgr.24517) 85 : cluster [DBG] pgmap v55: 65 pgs: 29 active+undersized+degraded, 5 active+undersized, 31 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 990 KiB/s rd, 917 KiB/s wr, 271 op/s; 42/216 objects degraded (19.444%) 2023-01-04T18:19:00.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:58.734768+0000 mon.smithi050 (mon.0) 129 : cluster [DBG] osdmap e50: 6 total, 6 up, 6 in 2023-01-04T18:19:00.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:58.914976+0000 mon.smithi050 (mon.0) 130 : audit [DBG] from='client.? 172.21.15.50:0/700677981' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:19:00.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:59.246457+0000 mon.smithi050 (mon.0) 131 : audit [DBG] from='client.? 172.21.15.50:0/1024826094' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:19:00.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:18:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:18:59.546761+0000 mgr.smithi050.emnywo (mgr.24517) 86 : audit [DBG] from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:19:01.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:18:59.739034+0000 mon.smithi050 (mon.0) 132 : cluster [DBG] osdmap e51: 6 total, 6 up, 6 in 2023-01-04T18:19:01.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:18:59.739034+0000 mon.smithi050 (mon.0) 132 : cluster [DBG] osdmap e51: 6 total, 6 up, 6 in 2023-01-04T18:19:02.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:01 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:00.618796+0000 mgr.smithi050.emnywo (mgr.24517) 87 : cluster [DBG] pgmap v58: 65 pgs: 29 active+undersized+degraded, 5 active+undersized, 31 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 42/216 objects degraded (19.444%) 2023-01-04T18:19:02.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:00.618796+0000 mgr.smithi050.emnywo (mgr.24517) 87 : cluster [DBG] pgmap v58: 65 pgs: 29 active+undersized+degraded, 5 active+undersized, 31 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 42/216 objects degraded (19.444%) 2023-01-04T18:19:03.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:02.096448+0000 mon.smithi050 (mon.0) 133 : cluster [DBG] osdmap e52: 6 total, 6 up, 6 in 2023-01-04T18:19:03.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:02.096448+0000 mon.smithi050 (mon.0) 133 : cluster [DBG] osdmap e52: 6 total, 6 up, 6 in 2023-01-04T18:19:04.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:02.619320+0000 mgr.smithi050.emnywo (mgr.24517) 88 : cluster [DBG] pgmap v60: 65 pgs: 9 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 17 active+recovery_wait+degraded, 38 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 1.0 KiB/s wr, 3 op/s; 1440/210 objects degraded (685.714%); 0 B/s, 20 objects/s recovering 2023-01-04T18:19:04.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:03.097615+0000 mon.smithi050 (mon.0) 134 : cluster [WRN] Health check update: Degraded data redundancy: 1440/210 objects degraded (685.714%), 26 pgs degraded (PG_DEGRADED) 2023-01-04T18:19:04.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:03.102351+0000 mon.smithi050 (mon.0) 135 : cluster [DBG] osdmap e53: 6 total, 6 up, 6 in 2023-01-04T18:19:04.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:02.619320+0000 mgr.smithi050.emnywo (mgr.24517) 88 : cluster [DBG] pgmap v60: 65 pgs: 9 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 17 active+recovery_wait+degraded, 38 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 1.0 KiB/s wr, 3 op/s; 1440/210 objects degraded (685.714%); 0 B/s, 20 objects/s recovering 2023-01-04T18:19:04.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:03.097615+0000 mon.smithi050 (mon.0) 134 : cluster [WRN] Health check update: Degraded data redundancy: 1440/210 objects degraded (685.714%), 26 pgs degraded (PG_DEGRADED) 2023-01-04T18:19:04.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:03.102351+0000 mon.smithi050 (mon.0) 135 : cluster [DBG] osdmap e53: 6 total, 6 up, 6 in 2023-01-04T18:19:06.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:04.619721+0000 mgr.smithi050.emnywo (mgr.24517) 89 : cluster [DBG] pgmap v62: 65 pgs: 9 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 17 active+recovery_wait+degraded, 38 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 869 B/s rd, 869 B/s wr, 2 op/s; 1440/210 objects degraded (685.714%); 0 B/s, 16 objects/s recovering 2023-01-04T18:19:06.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:04.619721+0000 mgr.smithi050.emnywo (mgr.24517) 89 : cluster [DBG] pgmap v62: 65 pgs: 9 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 17 active+recovery_wait+degraded, 38 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 869 B/s rd, 869 B/s wr, 2 op/s; 1440/210 objects degraded (685.714%); 0 B/s, 16 objects/s recovering 2023-01-04T18:19:08.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:06.620199+0000 mgr.smithi050.emnywo (mgr.24517) 90 : cluster [DBG] pgmap v63: 65 pgs: 6 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 9 active+recovery_wait+degraded, 49 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 743 B/s wr, 3 op/s; 1252/210 objects degraded (596.190%); 1.2 MiB/s, 8 keys/s, 41 objects/s recovering 2023-01-04T18:19:08.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:06.620199+0000 mgr.smithi050.emnywo (mgr.24517) 90 : cluster [DBG] pgmap v63: 65 pgs: 6 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 9 active+recovery_wait+degraded, 49 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 743 B/s wr, 3 op/s; 1252/210 objects degraded (596.190%); 1.2 MiB/s, 8 keys/s, 41 objects/s recovering 2023-01-04T18:19:09.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:09 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:08.104164+0000 mon.smithi050 (mon.0) 136 : cluster [DBG] osdmap e54: 6 total, 6 up, 6 in 2023-01-04T18:19:09.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:09 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:08.104164+0000 mon.smithi050 (mon.0) 136 : cluster [DBG] osdmap e54: 6 total, 6 up, 6 in 2023-01-04T18:19:10.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:08.620644+0000 mgr.smithi050.emnywo (mgr.24517) 91 : cluster [DBG] pgmap v65: 65 pgs: 6 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 1 active+recovering+undersized+degraded+remapped, 8 active+recovery_wait+degraded, 49 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 784 B/s rd, 1 op/s; 1142/210 objects degraded (543.810%); 1.2 MiB/s, 9 keys/s, 41 objects/s recovering 2023-01-04T18:19:10.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:09.105687+0000 mon.smithi050 (mon.0) 137 : cluster [WRN] Health check update: Degraded data redundancy: 1142/210 objects degraded (543.810%), 15 pgs degraded (PG_DEGRADED) 2023-01-04T18:19:10.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:09.111258+0000 mon.smithi050 (mon.0) 138 : cluster [DBG] osdmap e55: 6 total, 6 up, 6 in 2023-01-04T18:19:10.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:09.841454+0000 mon.smithi050 (mon.0) 139 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:19:10.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:08.620644+0000 mgr.smithi050.emnywo (mgr.24517) 91 : cluster [DBG] pgmap v65: 65 pgs: 6 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 1 active+recovering+undersized+degraded+remapped, 8 active+recovery_wait+degraded, 49 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 784 B/s rd, 1 op/s; 1142/210 objects degraded (543.810%); 1.2 MiB/s, 9 keys/s, 41 objects/s recovering 2023-01-04T18:19:10.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:09.105687+0000 mon.smithi050 (mon.0) 137 : cluster [WRN] Health check update: Degraded data redundancy: 1142/210 objects degraded (543.810%), 15 pgs degraded (PG_DEGRADED) 2023-01-04T18:19:10.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:09.111258+0000 mon.smithi050 (mon.0) 138 : cluster [DBG] osdmap e55: 6 total, 6 up, 6 in 2023-01-04T18:19:10.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:09.841454+0000 mon.smithi050 (mon.0) 139 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:19:11.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:10.113175+0000 mon.smithi050 (mon.0) 140 : cluster [DBG] osdmap e56: 6 total, 6 up, 6 in 2023-01-04T18:19:11.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:10.165797+0000 mon.smithi050 (mon.0) 141 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:19:11.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:10.165968+0000 mgr.smithi050.emnywo (mgr.24517) 92 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:19:11.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:19:10.166722+0000 mgr.smithi050.emnywo (mgr.24517) 93 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2023-01-04T18:19:11.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:10.113175+0000 mon.smithi050 (mon.0) 140 : cluster [DBG] osdmap e56: 6 total, 6 up, 6 in 2023-01-04T18:19:11.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:10.165797+0000 mon.smithi050 (mon.0) 141 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:19:11.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:10.165968+0000 mgr.smithi050.emnywo (mgr.24517) 92 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:19:11.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:19:10.166722+0000 mgr.smithi050.emnywo (mgr.24517) 93 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2023-01-04T18:19:12.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:10.621007+0000 mgr.smithi050.emnywo (mgr.24517) 94 : cluster [DBG] pgmap v68: 65 pgs: 6 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 1 active+recovering+undersized+degraded+remapped, 8 active+recovery_wait+degraded, 49 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 1142/210 objects degraded (543.810%); 1.3 MiB/s, 10 keys/s, 45 objects/s recovering 2023-01-04T18:19:12.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:10.621007+0000 mgr.smithi050.emnywo (mgr.24517) 94 : cluster [DBG] pgmap v68: 65 pgs: 6 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 1 active+recovering+undersized+degraded+remapped, 8 active+recovery_wait+degraded, 49 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 1142/210 objects degraded (543.810%); 1.3 MiB/s, 10 keys/s, 45 objects/s recovering 2023-01-04T18:19:14.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:12.621590+0000 mgr.smithi050.emnywo (mgr.24517) 95 : cluster [DBG] pgmap v69: 65 pgs: 5 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 6 active+recovery_wait+degraded, 53 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 897/210 objects degraded (427.143%); 1.1 MiB/s, 53 objects/s recovering 2023-01-04T18:19:14.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:12.621590+0000 mgr.smithi050.emnywo (mgr.24517) 95 : cluster [DBG] pgmap v69: 65 pgs: 5 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 6 active+recovery_wait+degraded, 53 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 897/210 objects degraded (427.143%); 1.1 MiB/s, 53 objects/s recovering 2023-01-04T18:19:16.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:14.622024+0000 mgr.smithi050.emnywo (mgr.24517) 96 : cluster [DBG] pgmap v70: 65 pgs: 5 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 6 active+recovery_wait+degraded, 53 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 785 B/s rd, 1 op/s; 897/210 objects degraded (427.143%); 1.0 MiB/s, 36 objects/s recovering 2023-01-04T18:19:16.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:14.622024+0000 mgr.smithi050.emnywo (mgr.24517) 96 : cluster [DBG] pgmap v70: 65 pgs: 5 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 6 active+recovery_wait+degraded, 53 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 785 B/s rd, 1 op/s; 897/210 objects degraded (427.143%); 1.0 MiB/s, 36 objects/s recovering 2023-01-04T18:19:17.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:17 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:17.096969+0000 mon.smithi050 (mon.0) 142 : cluster [WRN] Health check update: Degraded data redundancy: 897/210 objects degraded (427.143%), 11 pgs degraded (PG_DEGRADED) 2023-01-04T18:19:17.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:17 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:17.096969+0000 mon.smithi050 (mon.0) 142 : cluster [WRN] Health check update: Degraded data redundancy: 897/210 objects degraded (427.143%), 11 pgs degraded (PG_DEGRADED) 2023-01-04T18:19:18.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:16.622770+0000 mgr.smithi050.emnywo (mgr.24517) 97 : cluster [DBG] pgmap v71: 65 pgs: 5 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 6 active+recovery_wait+degraded, 53 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 897/210 objects degraded (427.143%); 870 KiB/s, 29 objects/s recovering 2023-01-04T18:19:18.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:16.622770+0000 mgr.smithi050.emnywo (mgr.24517) 97 : cluster [DBG] pgmap v71: 65 pgs: 5 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 6 active+recovery_wait+degraded, 53 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 897/210 objects degraded (427.143%); 870 KiB/s, 29 objects/s recovering 2023-01-04T18:19:20.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:18.623215+0000 mgr.smithi050.emnywo (mgr.24517) 98 : cluster [DBG] pgmap v72: 65 pgs: 5 active+recovery_wait+undersized+degraded+remapped, 6 active+recovery_wait+degraded, 54 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 897/210 objects degraded (427.143%); 732 KiB/s, 30 objects/s recovering 2023-01-04T18:19:20.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:18.623215+0000 mgr.smithi050.emnywo (mgr.24517) 98 : cluster [DBG] pgmap v72: 65 pgs: 5 active+recovery_wait+undersized+degraded+remapped, 6 active+recovery_wait+degraded, 54 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 897/210 objects degraded (427.143%); 732 KiB/s, 30 objects/s recovering 2023-01-04T18:19:22.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:20.623699+0000 mgr.smithi050.emnywo (mgr.24517) 99 : cluster [DBG] pgmap v73: 65 pgs: 5 active+recovery_wait+undersized+degraded+remapped, 6 active+recovery_wait+degraded, 54 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 974 B/s rd, 1 op/s; 897/210 objects degraded (427.143%); 662 KiB/s, 27 objects/s recovering 2023-01-04T18:19:22.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:20.623699+0000 mgr.smithi050.emnywo (mgr.24517) 99 : cluster [DBG] pgmap v73: 65 pgs: 5 active+recovery_wait+undersized+degraded+remapped, 6 active+recovery_wait+degraded, 54 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 974 B/s rd, 1 op/s; 897/210 objects degraded (427.143%); 662 KiB/s, 27 objects/s recovering 2023-01-04T18:19:23.537 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:23 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:23.137626+0000 mon.smithi050 (mon.0) 143 : cluster [WRN] Health check update: Degraded data redundancy: 807/210 objects degraded (384.286%), 10 pgs degraded (PG_DEGRADED) 2023-01-04T18:19:23.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:23.137626+0000 mon.smithi050 (mon.0) 143 : cluster [WRN] Health check update: Degraded data redundancy: 807/210 objects degraded (384.286%), 10 pgs degraded (PG_DEGRADED) 2023-01-04T18:19:24.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:22.624505+0000 mgr.smithi050.emnywo (mgr.24517) 100 : cluster [DBG] pgmap v74: 65 pgs: 1 active+recovering+undersized+remapped, 4 active+recovery_wait+undersized+degraded+remapped, 6 active+recovery_wait+degraded, 54 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 807/210 objects degraded (384.286%); 580 KiB/s, 28 objects/s recovering 2023-01-04T18:19:24.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:22.624505+0000 mgr.smithi050.emnywo (mgr.24517) 100 : cluster [DBG] pgmap v74: 65 pgs: 1 active+recovering+undersized+remapped, 4 active+recovery_wait+undersized+degraded+remapped, 6 active+recovery_wait+degraded, 54 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 807/210 objects degraded (384.286%); 580 KiB/s, 28 objects/s recovering 2023-01-04T18:19:25.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:24.195685+0000 mon.smithi050 (mon.0) 144 : cluster [DBG] osdmap e57: 6 total, 6 up, 6 in 2023-01-04T18:19:25.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:24.873247+0000 mon.smithi050 (mon.0) 145 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:19:25.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:24.879849+0000 mon.smithi050 (mon.0) 146 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:19:25.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:25.181329+0000 mon.smithi050 (mon.0) 147 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:19:25.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:24.195685+0000 mon.smithi050 (mon.0) 144 : cluster [DBG] osdmap e57: 6 total, 6 up, 6 in 2023-01-04T18:19:25.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:24.873247+0000 mon.smithi050 (mon.0) 145 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:19:25.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:24.879849+0000 mon.smithi050 (mon.0) 146 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:19:25.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:25.181329+0000 mon.smithi050 (mon.0) 147 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:19:26.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:24.624844+0000 mgr.smithi050.emnywo (mgr.24517) 101 : cluster [DBG] pgmap v76: 65 pgs: 1 active+recovering+undersized+remapped, 4 active+recovery_wait+undersized+degraded+remapped, 6 active+recovery_wait+degraded, 54 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 807/210 objects degraded (384.286%); 0 B/s, 10 objects/s recovering 2023-01-04T18:19:26.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:25.181498+0000 mgr.smithi050.emnywo (mgr.24517) 102 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:19:26.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:19:25.182283+0000 mgr.smithi050.emnywo (mgr.24517) 103 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2023-01-04T18:19:26.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:25.200277+0000 mon.smithi050 (mon.0) 148 : cluster [DBG] osdmap e58: 6 total, 6 up, 6 in 2023-01-04T18:19:26.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:24.624844+0000 mgr.smithi050.emnywo (mgr.24517) 101 : cluster [DBG] pgmap v76: 65 pgs: 1 active+recovering+undersized+remapped, 4 active+recovery_wait+undersized+degraded+remapped, 6 active+recovery_wait+degraded, 54 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 807/210 objects degraded (384.286%); 0 B/s, 10 objects/s recovering 2023-01-04T18:19:26.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:25.181498+0000 mgr.smithi050.emnywo (mgr.24517) 102 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:19:26.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:19:25.182283+0000 mgr.smithi050.emnywo (mgr.24517) 103 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2023-01-04T18:19:26.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:25.200277+0000 mon.smithi050 (mon.0) 148 : cluster [DBG] osdmap e58: 6 total, 6 up, 6 in 2023-01-04T18:19:28.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:26.625287+0000 mgr.smithi050.emnywo (mgr.24517) 104 : cluster [DBG] pgmap v78: 65 pgs: 4 active+recovery_wait+undersized+degraded+remapped, 6 active+recovery_wait+degraded, 55 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 807/210 objects degraded (384.286%); 0 B/s, 11 objects/s recovering 2023-01-04T18:19:28.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:26.625287+0000 mgr.smithi050.emnywo (mgr.24517) 104 : cluster [DBG] pgmap v78: 65 pgs: 4 active+recovery_wait+undersized+degraded+remapped, 6 active+recovery_wait+degraded, 55 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 807/210 objects degraded (384.286%); 0 B/s, 11 objects/s recovering 2023-01-04T18:19:29.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:29.201561+0000 mon.smithi050 (mon.0) 149 : cluster [WRN] Health check update: Degraded data redundancy: 720/210 objects degraded (342.857%), 9 pgs degraded (PG_DEGRADED) 2023-01-04T18:19:29.583 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:29.201561+0000 mon.smithi050 (mon.0) 149 : cluster [WRN] Health check update: Degraded data redundancy: 720/210 objects degraded (342.857%), 9 pgs degraded (PG_DEGRADED) 2023-01-04T18:19:29.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.652+0000 7fc572b24700 1 -- 172.21.15.50:0/3407477178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc56c0f6860 msgr2=0x7fc56c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.652+0000 7fc572b24700 1 --2- 172.21.15.50:0/3407477178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc56c0f6860 0x7fc56c0f6cc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc558004660 tx=0x7fc558009b30).stop 2023-01-04T18:19:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.652+0000 7fc572b24700 1 -- 172.21.15.50:0/3407477178 shutdown_connections 2023-01-04T18:19:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.652+0000 7fc572b24700 1 --2- 172.21.15.50:0/3407477178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc56c0f6860 0x7fc56c0f6cc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.652+0000 7fc572b24700 1 --2- 172.21.15.50:0/3407477178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc56c0f55c0 0x7fc56c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.652+0000 7fc572b24700 1 -- 172.21.15.50:0/3407477178 >> 172.21.15.50:0/3407477178 conn(0x7fc56c0f0d40 msgr2=0x7fc56c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:19:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.652+0000 7fc572b24700 1 -- 172.21.15.50:0/3407477178 shutdown_connections 2023-01-04T18:19:29.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.652+0000 7fc572b24700 1 -- 172.21.15.50:0/3407477178 wait complete. 2023-01-04T18:19:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.653+0000 7fc572b24700 1 Processor -- start 2023-01-04T18:19:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.653+0000 7fc572b24700 1 -- start start 2023-01-04T18:19:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.653+0000 7fc572b24700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc56c0f55c0 0x7fc56c109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:19:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.653+0000 7fc572b24700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc56c0f6860 0x7fc56c10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:19:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.653+0000 7fc572b24700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c0603c0 con 0x7fc56c0f6860 2023-01-04T18:19:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.653+0000 7fc572b24700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c060500 con 0x7fc56c0f55c0 2023-01-04T18:19:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.653+0000 7fc56bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc56c0f6860 0x7fc56c10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:19:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.653+0000 7fc56bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc56c0f6860 0x7fc56c10c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57150/0 (socket says 172.21.15.50:57150) 2023-01-04T18:19:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.653+0000 7fc56bfff700 1 -- 172.21.15.50:0/590273581 learned_addr learned my addr 172.21.15.50:0/590273581 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:19:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.653+0000 7fc5708c0700 1 --2- 172.21.15.50:0/590273581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc56c0f55c0 0x7fc56c109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:19:29.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.654+0000 7fc56bfff700 1 -- 172.21.15.50:0/590273581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc56c0f55c0 msgr2=0x7fc56c109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.654+0000 7fc56bfff700 1 --2- 172.21.15.50:0/590273581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc56c0f55c0 0x7fc56c109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.654+0000 7fc56bfff700 1 -- 172.21.15.50:0/590273581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc558005040 con 0x7fc56c0f6860 2023-01-04T18:19:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.654+0000 7fc56bfff700 1 --2- 172.21.15.50:0/590273581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc56c0f6860 0x7fc56c10c190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc558009830 tx=0x7fc558009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:19:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.654+0000 7fc5697fa700 1 -- 172.21.15.50:0/590273581 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc558018070 con 0x7fc56c0f6860 2023-01-04T18:19:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.654+0000 7fc5697fa700 1 -- 172.21.15.50:0/590273581 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc55801d8e0 con 0x7fc56c0f6860 2023-01-04T18:19:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.654+0000 7fc572b24700 1 -- 172.21.15.50:0/590273581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc56c10c6e0 con 0x7fc56c0f6860 2023-01-04T18:19:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.654+0000 7fc5697fa700 1 -- 172.21.15.50:0/590273581 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc55801c480 con 0x7fc56c0f6860 2023-01-04T18:19:29.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.654+0000 7fc572b24700 1 -- 172.21.15.50:0/590273581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc56c10cc10 con 0x7fc56c0f6860 2023-01-04T18:19:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.655+0000 7fc572b24700 1 -- 172.21.15.50:0/590273581 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56c0f49b0 con 0x7fc56c0f6860 2023-01-04T18:19:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.655+0000 7fc5697fa700 1 -- 172.21.15.50:0/590273581 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fc55801da50 con 0x7fc56c0f6860 2023-01-04T18:19:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.656+0000 7fc5697fa700 1 --2- 172.21.15.50:0/590273581 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc55c060be0 0x7fc55c0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:19:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.656+0000 7fc5697fa700 1 -- 172.21.15.50:0/590273581 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5928+0+0 (secure 0 0 0) 0x7fc55807dc60 con 0x7fc56c0f6860 2023-01-04T18:19:29.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.656+0000 7fc5708c0700 1 --2- 172.21.15.50:0/590273581 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc55c060be0 0x7fc55c0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:19:29.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.656+0000 7fc5708c0700 1 --2- 172.21.15.50:0/590273581 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc55c060be0 0x7fc55c0630a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fc56c060040 tx=0x7fc560009040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:19:29.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.660+0000 7fc5697fa700 1 -- 172.21.15.50:0/590273581 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fc55804e210 con 0x7fc56c0f6860 2023-01-04T18:19:29.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.848+0000 7fc572b24700 1 -- 172.21.15.50:0/590273581 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc56c0fded0 con 0x7fc55c060be0 2023-01-04T18:19:29.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.850+0000 7fc5697fa700 1 -- 172.21.15.50:0/590273581 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc56c0fded0 con 0x7fc55c060be0 2023-01-04T18:19:29.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.851+0000 7fc572b24700 1 -- 172.21.15.50:0/590273581 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc55c060be0 msgr2=0x7fc55c0630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:29.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.851+0000 7fc572b24700 1 --2- 172.21.15.50:0/590273581 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc55c060be0 0x7fc55c0630a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fc56c060040 tx=0x7fc560009040).stop 2023-01-04T18:19:29.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.851+0000 7fc572b24700 1 -- 172.21.15.50:0/590273581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc56c0f6860 msgr2=0x7fc56c10c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:29.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.851+0000 7fc572b24700 1 --2- 172.21.15.50:0/590273581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc56c0f6860 0x7fc56c10c190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc558009830 tx=0x7fc558009b30).stop 2023-01-04T18:19:29.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.851+0000 7fc572b24700 1 -- 172.21.15.50:0/590273581 shutdown_connections 2023-01-04T18:19:29.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.851+0000 7fc572b24700 1 --2- 172.21.15.50:0/590273581 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc55c060be0 0x7fc55c0630a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:29.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.851+0000 7fc572b24700 1 --2- 172.21.15.50:0/590273581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc56c0f55c0 0x7fc56c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:29.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.851+0000 7fc572b24700 1 --2- 172.21.15.50:0/590273581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc56c0f6860 0x7fc56c10c190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:29.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.851+0000 7fc572b24700 1 -- 172.21.15.50:0/590273581 >> 172.21.15.50:0/590273581 conn(0x7fc56c0f0d40 msgr2=0x7fc56c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:19:29.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.851+0000 7fc572b24700 1 -- 172.21.15.50:0/590273581 shutdown_connections 2023-01-04T18:19:29.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.852+0000 7fc572b24700 1 -- 172.21.15.50:0/590273581 wait complete. 2023-01-04T18:19:29.865 INFO:teuthology.orchestra.run.smithi050.stdout:true 2023-01-04T18:19:29.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.954+0000 7f66410a7700 1 -- 172.21.15.50:0/1762574658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f663c0f9710 msgr2=0x7f663c0fbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:29.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.954+0000 7f66410a7700 1 --2- 172.21.15.50:0/1762574658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f663c0f9710 0x7f663c0fbb00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f6630004660 tx=0x7f6630009b30).stop 2023-01-04T18:19:29.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.954+0000 7f66410a7700 1 -- 172.21.15.50:0/1762574658 shutdown_connections 2023-01-04T18:19:29.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.954+0000 7f66410a7700 1 --2- 172.21.15.50:0/1762574658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f663c0f9710 0x7f663c0fbb00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:29.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.954+0000 7f66410a7700 1 --2- 172.21.15.50:0/1762574658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f663c060290 0x7f663c0f9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:29.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.955+0000 7f66410a7700 1 -- 172.21.15.50:0/1762574658 >> 172.21.15.50:0/1762574658 conn(0x7f663c0f0b90 msgr2=0x7f663c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:19:29.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.955+0000 7f66410a7700 1 -- 172.21.15.50:0/1762574658 shutdown_connections 2023-01-04T18:19:29.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.955+0000 7f66410a7700 1 -- 172.21.15.50:0/1762574658 wait complete. 2023-01-04T18:19:29.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.955+0000 7f66410a7700 1 Processor -- start 2023-01-04T18:19:29.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.955+0000 7f66410a7700 1 -- start start 2023-01-04T18:19:29.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.955+0000 7f66410a7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f663c060290 0x7f663c108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:19:29.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.955+0000 7f66410a7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f663c0f9710 0x7f663c109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:19:29.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.956+0000 7f66410a7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c109a20 con 0x7f663c0f9710 2023-01-04T18:19:29.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.956+0000 7f66410a7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c109b60 con 0x7f663c060290 2023-01-04T18:19:29.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.956+0000 7f663b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f663c0f9710 0x7f663c109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:19:29.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.956+0000 7f663b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f663c0f9710 0x7f663c109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57158/0 (socket says 172.21.15.50:57158) 2023-01-04T18:19:29.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.956+0000 7f663b7fe700 1 -- 172.21.15.50:0/1658750707 learned_addr learned my addr 172.21.15.50:0/1658750707 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:19:29.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.956+0000 7f663bfff700 1 --2- 172.21.15.50:0/1658750707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f663c060290 0x7f663c108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:19:29.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.956+0000 7f663b7fe700 1 -- 172.21.15.50:0/1658750707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f663c060290 msgr2=0x7f663c108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:29.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.956+0000 7f663b7fe700 1 --2- 172.21.15.50:0/1658750707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f663c060290 0x7f663c108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:29.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.956+0000 7f663b7fe700 1 -- 172.21.15.50:0/1658750707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6630005040 con 0x7f663c0f9710 2023-01-04T18:19:29.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.956+0000 7f663bfff700 1 --2- 172.21.15.50:0/1658750707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f663c060290 0x7f663c108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-01-04T18:19:29.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.956+0000 7f663b7fe700 1 --2- 172.21.15.50:0/1658750707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f663c0f9710 0x7f663c109470 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f6630004e30 tx=0x7f6630009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:19:29.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.956+0000 7f6638ff9700 1 -- 172.21.15.50:0/1658750707 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6630018070 con 0x7f663c0f9710 2023-01-04T18:19:29.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.956+0000 7f66410a7700 1 -- 172.21.15.50:0/1658750707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663c10a4a0 con 0x7f663c0f9710 2023-01-04T18:19:29.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.956+0000 7f6638ff9700 1 -- 172.21.15.50:0/1658750707 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6630009630 con 0x7f663c0f9710 2023-01-04T18:19:29.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.956+0000 7f6638ff9700 1 -- 172.21.15.50:0/1658750707 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f663001c3c0 con 0x7f663c0f9710 2023-01-04T18:19:29.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.956+0000 7f66410a7700 1 -- 172.21.15.50:0/1658750707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663c10aa00 con 0x7f663c0f9710 2023-01-04T18:19:29.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.957+0000 7f66410a7700 1 -- 172.21.15.50:0/1658750707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663c045ad0 con 0x7f663c0f9710 2023-01-04T18:19:29.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.958+0000 7f6638ff9700 1 -- 172.21.15.50:0/1658750707 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f663001d420 con 0x7f663c0f9710 2023-01-04T18:19:29.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.958+0000 7f6638ff9700 1 --2- 172.21.15.50:0/1658750707 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6624060c30 0x7f66240630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:19:29.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.958+0000 7f6638ff9700 1 -- 172.21.15.50:0/1658750707 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5928+0+0 (secure 0 0 0) 0x7f663007da50 con 0x7f663c0f9710 2023-01-04T18:19:29.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.958+0000 7f663bfff700 1 --2- 172.21.15.50:0/1658750707 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6624060c30 0x7f66240630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:19:29.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.959+0000 7f663bfff700 1 --2- 172.21.15.50:0/1658750707 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6624060c30 0x7f66240630f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f662c009fd0 tx=0x7f662c00b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:19:29.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:29.966+0000 7f6638ff9700 1 -- 172.21.15.50:0/1658750707 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f6630051ae0 con 0x7f663c0f9710 2023-01-04T18:19:30.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.155+0000 7f66410a7700 1 -- 172.21.15.50:0/1658750707 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f663c0fa5d0 con 0x7f6624060c30 2023-01-04T18:19:30.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.156+0000 7f6638ff9700 1 -- 172.21.15.50:0/1658750707 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f663c0fa5d0 con 0x7f6624060c30 2023-01-04T18:19:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.158+0000 7f66410a7700 1 -- 172.21.15.50:0/1658750707 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6624060c30 msgr2=0x7f66240630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.158+0000 7f66410a7700 1 --2- 172.21.15.50:0/1658750707 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6624060c30 0x7f66240630f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f662c009fd0 tx=0x7f662c00b040).stop 2023-01-04T18:19:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.158+0000 7f66410a7700 1 -- 172.21.15.50:0/1658750707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f663c0f9710 msgr2=0x7f663c109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.158+0000 7f66410a7700 1 --2- 172.21.15.50:0/1658750707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f663c0f9710 0x7f663c109470 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f6630004e30 tx=0x7f6630009b30).stop 2023-01-04T18:19:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.158+0000 7f66410a7700 1 -- 172.21.15.50:0/1658750707 shutdown_connections 2023-01-04T18:19:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.158+0000 7f66410a7700 1 --2- 172.21.15.50:0/1658750707 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6624060c30 0x7f66240630f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.158+0000 7f66410a7700 1 --2- 172.21.15.50:0/1658750707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f663c060290 0x7f663c108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.158+0000 7f66410a7700 1 --2- 172.21.15.50:0/1658750707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f663c0f9710 0x7f663c109470 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.158+0000 7f66410a7700 1 -- 172.21.15.50:0/1658750707 >> 172.21.15.50:0/1658750707 conn(0x7f663c0f0b90 msgr2=0x7f663c0f9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:19:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.158+0000 7f66410a7700 1 -- 172.21.15.50:0/1658750707 shutdown_connections 2023-01-04T18:19:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.158+0000 7f66410a7700 1 -- 172.21.15.50:0/1658750707 wait complete. 2023-01-04T18:19:30.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.260+0000 7fe1c7d6e700 1 -- 172.21.15.50:0/3278630224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1c00f6860 msgr2=0x7fe1c00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:30.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.260+0000 7fe1c7d6e700 1 --2- 172.21.15.50:0/3278630224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1c00f6860 0x7fe1c00f6cc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fe1b0004660 tx=0x7fe1b0009b30).stop 2023-01-04T18:19:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.260+0000 7fe1c7d6e700 1 -- 172.21.15.50:0/3278630224 shutdown_connections 2023-01-04T18:19:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.260+0000 7fe1c7d6e700 1 --2- 172.21.15.50:0/3278630224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1c00f6860 0x7fe1c00f6cc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.260+0000 7fe1c7d6e700 1 --2- 172.21.15.50:0/3278630224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1c00f55c0 0x7fe1c00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.260+0000 7fe1c7d6e700 1 -- 172.21.15.50:0/3278630224 >> 172.21.15.50:0/3278630224 conn(0x7fe1c00f0d40 msgr2=0x7fe1c00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:19:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.260+0000 7fe1c7d6e700 1 -- 172.21.15.50:0/3278630224 shutdown_connections 2023-01-04T18:19:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.260+0000 7fe1c7d6e700 1 -- 172.21.15.50:0/3278630224 wait complete. 2023-01-04T18:19:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.261+0000 7fe1c7d6e700 1 Processor -- start 2023-01-04T18:19:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.261+0000 7fe1c7d6e700 1 -- start start 2023-01-04T18:19:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.261+0000 7fe1c7d6e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1c00f55c0 0x7fe1c0106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:19:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.261+0000 7fe1c7d6e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1c00f6860 0x7fe1c0107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:19:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.261+0000 7fe1c7d6e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c01079b0 con 0x7fe1c00f55c0 2023-01-04T18:19:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.261+0000 7fe1c7d6e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c0107af0 con 0x7fe1c00f6860 2023-01-04T18:19:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.261+0000 7fe1c5b0a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1c00f55c0 0x7fe1c0106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:19:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.261+0000 7fe1c5b0a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1c00f55c0 0x7fe1c0106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57166/0 (socket says 172.21.15.50:57166) 2023-01-04T18:19:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.261+0000 7fe1c5b0a700 1 -- 172.21.15.50:0/3739784089 learned_addr learned my addr 172.21.15.50:0/3739784089 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:19:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.261+0000 7fe1c5309700 1 --2- 172.21.15.50:0/3739784089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1c00f6860 0x7fe1c0107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:19:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.261+0000 7fe1c5b0a700 1 -- 172.21.15.50:0/3739784089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1c00f6860 msgr2=0x7fe1c0107400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.261+0000 7fe1c5b0a700 1 --2- 172.21.15.50:0/3739784089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1c00f6860 0x7fe1c0107400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.261+0000 7fe1c5b0a700 1 -- 172.21.15.50:0/3739784089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b0005040 con 0x7fe1c00f55c0 2023-01-04T18:19:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.261+0000 7fe1c5b0a700 1 --2- 172.21.15.50:0/3739784089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1c00f55c0 0x7fe1c0106f10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fe1bc00e7c0 tx=0x7fe1bc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:19:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.262+0000 7fe1b67fc700 1 -- 172.21.15.50:0/3739784089 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1bc0092e0 con 0x7fe1c00f55c0 2023-01-04T18:19:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.262+0000 7fe1b67fc700 1 -- 172.21.15.50:0/3739784089 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe1bc00f040 con 0x7fe1c00f55c0 2023-01-04T18:19:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.262+0000 7fe1c7d6e700 1 -- 172.21.15.50:0/3739784089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c0108490 con 0x7fe1c00f55c0 2023-01-04T18:19:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.262+0000 7fe1b67fc700 1 -- 172.21.15.50:0/3739784089 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1bc0147e0 con 0x7fe1c00f55c0 2023-01-04T18:19:30.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.262+0000 7fe1c7d6e700 1 -- 172.21.15.50:0/3739784089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c01089d0 con 0x7fe1c00f55c0 2023-01-04T18:19:30.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.263+0000 7fe1c7d6e700 1 -- 172.21.15.50:0/3739784089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c0045ad0 con 0x7fe1c00f55c0 2023-01-04T18:19:30.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.263+0000 7fe1b67fc700 1 -- 172.21.15.50:0/3739784089 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fe1bc01b030 con 0x7fe1c00f55c0 2023-01-04T18:19:30.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.264+0000 7fe1b67fc700 1 --2- 172.21.15.50:0/3739784089 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe1ac060be0 0x7fe1ac0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:19:30.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.264+0000 7fe1b67fc700 1 -- 172.21.15.50:0/3739784089 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5928+0+0 (secure 0 0 0) 0x7fe1bc07bd50 con 0x7fe1c00f55c0 2023-01-04T18:19:30.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.264+0000 7fe1c5309700 1 --2- 172.21.15.50:0/3739784089 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe1ac060be0 0x7fe1ac0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:19:30.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.264+0000 7fe1c5309700 1 --2- 172.21.15.50:0/3739784089 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe1ac060be0 0x7fe1ac0630a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fe1b0009720 tx=0x7fe1b000b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:19:30.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.268+0000 7fe1b67fc700 1 -- 172.21.15.50:0/3739784089 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fe1bc04fcd0 con 0x7fe1c00f55c0 2023-01-04T18:19:30.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.450+0000 7fe1c7d6e700 1 -- 172.21.15.50:0/3739784089 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1c00faca0 con 0x7fe1ac060be0 2023-01-04T18:19:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.460+0000 7fe1b67fc700 1 -- 172.21.15.50:0/3739784089 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7fe1c00faca0 con 0x7fe1ac060be0 2023-01-04T18:19:30.463 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-01-04T18:19:30.463 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager.smithi050 smithi050 *:9093,9094 running (7m) 35s ago 9m 22.4M - 0.20.0 0881eb8f169f b5d3e2678a23 2023-01-04T18:19:30.463 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi050 smithi050 running (77s) 35s ago 8m 7050k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cfe28e5ab81e 2023-01-04T18:19:30.463 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi098 smithi098 running (68s) 63s ago 8m 7042k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cf5f0ca60522 2023-01-04T18:19:30.464 INFO:teuthology.orchestra.run.smithi050.stdout:grafana.smithi050 smithi050 *:3000 running (7m) 35s ago 8m 37.2M - 6.7.4 557c83e11646 7e5dccbafe78 2023-01-04T18:19:30.464 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.ezoiwl smithi050 running (4m) 35s ago 4m 9.91G - 16.2.4 8d91d370c2b8 6c5c5f2be8b9 2023-01-04T18:19:30.464 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.kefmuy smithi050 running (4m) 35s ago 4m 18.0M - 16.2.4 8d91d370c2b8 58cace913b55 2023-01-04T18:19:30.464 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.laynsk smithi098 running (4m) 63s ago 4m 15.7M - 16.2.4 8d91d370c2b8 8ff8af70b989 2023-01-04T18:19:30.464 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.memais smithi098 running (4m) 63s ago 4m 1070M - 16.2.4 8d91d370c2b8 d59d9b4dbf7d 2023-01-04T18:19:30.464 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi050.emnywo smithi050 *:8443,9283 running (2m) 35s ago 10m 440M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d ee677216e754 2023-01-04T18:19:30.464 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi098.vhfzum smithi098 *:8443,9283 running (113s) 63s ago 8m 394M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d f3d98bf0cf66 2023-01-04T18:19:30.464 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi050 smithi050 running (103s) 35s ago 10m 74.3M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 0423819cbaa7 2023-01-04T18:19:30.464 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi098 smithi098 running (89s) 63s ago 8m 39.4M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 12094818aefc 2023-01-04T18:19:30.464 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi050 smithi050 *:9100 running (8m) 35s ago 8m 18.3M - 0.18.1 e5a616e4b9cf 88892b2e5e5a 2023-01-04T18:19:30.464 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi098 smithi098 *:9100 running (8m) 63s ago 8m 18.4M - 0.18.1 e5a616e4b9cf 49bcde8331b6 2023-01-04T18:19:30.464 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (44s) 35s ago 7m 13.9M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 60dafedcb429 2023-01-04T18:19:30.465 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi050 running (7m) 35s ago 7m 1098M 4096M 16.2.4 8d91d370c2b8 e4928bcfd146 2023-01-04T18:19:30.465 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi050 running (7m) 35s ago 7m 915M 4096M 16.2.4 8d91d370c2b8 babab394b338 2023-01-04T18:19:30.465 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi098 running (6m) 63s ago 6m 1186M 4096M 16.2.4 8d91d370c2b8 b02df8e3cb23 2023-01-04T18:19:30.465 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi098 running (6m) 63s ago 6m 876M 4096M 16.2.4 8d91d370c2b8 92273135ca82 2023-01-04T18:19:30.465 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi098 running (6m) 63s ago 6m 971M 4096M 16.2.4 8d91d370c2b8 366d0bfff809 2023-01-04T18:19:30.465 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus.smithi050 smithi050 *:9095 running (2m) 35s ago 8m 55.3M - 2.18.1 de242295e225 7bdcf7a45d34 2023-01-04T18:19:30.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.461+0000 7fe1c7d6e700 1 -- 172.21.15.50:0/3739784089 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe1ac060be0 msgr2=0x7fe1ac0630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:30.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.461+0000 7fe1c7d6e700 1 --2- 172.21.15.50:0/3739784089 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe1ac060be0 0x7fe1ac0630a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fe1b0009720 tx=0x7fe1b000b040).stop 2023-01-04T18:19:30.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.461+0000 7fe1c7d6e700 1 -- 172.21.15.50:0/3739784089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1c00f55c0 msgr2=0x7fe1c0106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:30.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.461+0000 7fe1c7d6e700 1 --2- 172.21.15.50:0/3739784089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1c00f55c0 0x7fe1c0106f10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fe1bc00e7c0 tx=0x7fe1bc00b040).stop 2023-01-04T18:19:30.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.461+0000 7fe1c7d6e700 1 -- 172.21.15.50:0/3739784089 shutdown_connections 2023-01-04T18:19:30.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.461+0000 7fe1c7d6e700 1 --2- 172.21.15.50:0/3739784089 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe1ac060be0 0x7fe1ac0630a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:30.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.461+0000 7fe1c7d6e700 1 --2- 172.21.15.50:0/3739784089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1c00f55c0 0x7fe1c0106f10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:30.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.461+0000 7fe1c7d6e700 1 --2- 172.21.15.50:0/3739784089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1c00f6860 0x7fe1c0107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:30.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.461+0000 7fe1c7d6e700 1 -- 172.21.15.50:0/3739784089 >> 172.21.15.50:0/3739784089 conn(0x7fe1c00f0d40 msgr2=0x7fe1c005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:19:30.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.462+0000 7fe1c7d6e700 1 -- 172.21.15.50:0/3739784089 shutdown_connections 2023-01-04T18:19:30.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.462+0000 7fe1c7d6e700 1 -- 172.21.15.50:0/3739784089 wait complete. 2023-01-04T18:19:30.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:28.625659+0000 mgr.smithi050.emnywo (mgr.24517) 105 : cluster [DBG] pgmap v79: 65 pgs: 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 5 active+recovery_wait+degraded, 55 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 720/210 objects degraded (342.857%); 0 B/s, 16 objects/s recovering 2023-01-04T18:19:30.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.563+0000 7f682569c700 1 -- 172.21.15.50:0/2531309394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68200f9860 msgr2=0x7f68200fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:30.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.563+0000 7f682569c700 1 --2- 172.21.15.50:0/2531309394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68200f9860 0x7f68200fbc70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f6814004660 tx=0x7f6814009b30).stop 2023-01-04T18:19:30.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.563+0000 7f682569c700 1 -- 172.21.15.50:0/2531309394 shutdown_connections 2023-01-04T18:19:30.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.563+0000 7f682569c700 1 --2- 172.21.15.50:0/2531309394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68200f9860 0x7f68200fbc70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:30.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.563+0000 7f682569c700 1 --2- 172.21.15.50:0/2531309394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68200602d0 0x7f68200f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:30.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.563+0000 7f682569c700 1 -- 172.21.15.50:0/2531309394 >> 172.21.15.50:0/2531309394 conn(0x7f68200f0d40 msgr2=0x7f68200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:19:30.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.563+0000 7f682569c700 1 -- 172.21.15.50:0/2531309394 shutdown_connections 2023-01-04T18:19:30.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.563+0000 7f682569c700 1 -- 172.21.15.50:0/2531309394 wait complete. 2023-01-04T18:19:30.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.563+0000 7f682569c700 1 Processor -- start 2023-01-04T18:19:30.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.564+0000 7f682569c700 1 -- start start 2023-01-04T18:19:30.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.564+0000 7f682569c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68200602d0 0x7f68200f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:19:30.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.564+0000 7f682569c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68200f9860 0x7f68200f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:19:30.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.564+0000 7f682569c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68200f5740 con 0x7f68200602d0 2023-01-04T18:19:30.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.564+0000 7f682569c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68200f5880 con 0x7f68200f9860 2023-01-04T18:19:30.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.564+0000 7f681effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68200602d0 0x7f68200f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:19:30.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.564+0000 7f681effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68200602d0 0x7f68200f6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57186/0 (socket says 172.21.15.50:57186) 2023-01-04T18:19:30.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.564+0000 7f681effd700 1 -- 172.21.15.50:0/1921148483 learned_addr learned my addr 172.21.15.50:0/1921148483 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:19:30.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.564+0000 7f681e7fc700 1 --2- 172.21.15.50:0/1921148483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68200f9860 0x7f68200f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:19:30.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.564+0000 7f681effd700 1 -- 172.21.15.50:0/1921148483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68200f9860 msgr2=0x7f68200f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:30.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.564+0000 7f681effd700 1 --2- 172.21.15.50:0/1921148483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68200f9860 0x7f68200f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:30.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.564+0000 7f681effd700 1 -- 172.21.15.50:0/1921148483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6814005040 con 0x7f68200602d0 2023-01-04T18:19:30.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.564+0000 7f681effd700 1 --2- 172.21.15.50:0/1921148483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68200602d0 0x7f68200f6d60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f68100026d0 tx=0x7f6810009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:19:30.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.565+0000 7f68077fe700 1 -- 172.21.15.50:0/1921148483 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68100079c0 con 0x7f68200602d0 2023-01-04T18:19:30.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.565+0000 7f68077fe700 1 -- 172.21.15.50:0/1921148483 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f681000f040 con 0x7f68200602d0 2023-01-04T18:19:30.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.565+0000 7f682569c700 1 -- 172.21.15.50:0/1921148483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68200f5b60 con 0x7f68200602d0 2023-01-04T18:19:30.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.565+0000 7f68077fe700 1 -- 172.21.15.50:0/1921148483 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6810014980 con 0x7f68200602d0 2023-01-04T18:19:30.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.565+0000 7f682569c700 1 -- 172.21.15.50:0/1921148483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682010ef90 con 0x7f68200602d0 2023-01-04T18:19:30.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.566+0000 7f682569c700 1 -- 172.21.15.50:0/1921148483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6820045ad0 con 0x7f68200602d0 2023-01-04T18:19:30.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.566+0000 7f68077fe700 1 -- 172.21.15.50:0/1921148483 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f68100090d0 con 0x7f68200602d0 2023-01-04T18:19:30.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.567+0000 7f68077fe700 1 --2- 172.21.15.50:0/1921148483 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6808060be0 0x7f68080630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:19:30.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.567+0000 7f68077fe700 1 -- 172.21.15.50:0/1921148483 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5928+0+0 (secure 0 0 0) 0x7f681007bd20 con 0x7f68200602d0 2023-01-04T18:19:30.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.567+0000 7f681e7fc700 1 --2- 172.21.15.50:0/1921148483 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6808060be0 0x7f68080630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:19:30.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.567+0000 7f681e7fc700 1 --2- 172.21.15.50:0/1921148483 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6808060be0 0x7f68080630a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6814004630 tx=0x7f6814009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:19:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.571+0000 7f68077fe700 1 -- 172.21.15.50:0/1921148483 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f681004c380 con 0x7f68200602d0 2023-01-04T18:19:30.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:28.625659+0000 mgr.smithi050.emnywo (mgr.24517) 105 : cluster [DBG] pgmap v79: 65 pgs: 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 5 active+recovery_wait+degraded, 55 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 720/210 objects degraded (342.857%); 0 B/s, 16 objects/s recovering 2023-01-04T18:19:30.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.820+0000 7f682569c700 1 -- 172.21.15.50:0/1921148483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f68200fef60 con 0x7f68200602d0 2023-01-04T18:19:30.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.820+0000 7f68077fe700 1 -- 172.21.15.50:0/1921148483 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+824 (secure 0 0 0) 0x7f681004f9a0 con 0x7f68200602d0 2023-01-04T18:19:30.824 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:19:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": { 2023-01-04T18:19:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:19:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:19:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": { 2023-01-04T18:19:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:19:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:19:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": { 2023-01-04T18:19:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 1, 2023-01-04T18:19:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2023-01-04T18:19:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:19:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2023-01-04T18:19:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-01-04T18:19:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:19:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: "overall": { 2023-01-04T18:19:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 5, 2023-01-04T18:19:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9 2023-01-04T18:19:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-01-04T18:19:30.825 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:19:30.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.822+0000 7f682569c700 1 -- 172.21.15.50:0/1921148483 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6808060be0 msgr2=0x7f68080630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:30.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.822+0000 7f682569c700 1 --2- 172.21.15.50:0/1921148483 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6808060be0 0x7f68080630a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6814004630 tx=0x7f6814009b30).stop 2023-01-04T18:19:30.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.822+0000 7f682569c700 1 -- 172.21.15.50:0/1921148483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68200602d0 msgr2=0x7f68200f6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:30.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.822+0000 7f682569c700 1 --2- 172.21.15.50:0/1921148483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68200602d0 0x7f68200f6d60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f68100026d0 tx=0x7f6810009de0).stop 2023-01-04T18:19:30.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.822+0000 7f682569c700 1 -- 172.21.15.50:0/1921148483 shutdown_connections 2023-01-04T18:19:30.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.822+0000 7f682569c700 1 --2- 172.21.15.50:0/1921148483 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6808060be0 0x7f68080630a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:30.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.822+0000 7f682569c700 1 --2- 172.21.15.50:0/1921148483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68200602d0 0x7f68200f6d60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:30.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.822+0000 7f682569c700 1 --2- 172.21.15.50:0/1921148483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68200f9860 0x7f68200f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:30.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.822+0000 7f682569c700 1 -- 172.21.15.50:0/1921148483 >> 172.21.15.50:0/1921148483 conn(0x7f68200f0d40 msgr2=0x7f68200f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:19:30.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.822+0000 7f682569c700 1 -- 172.21.15.50:0/1921148483 shutdown_connections 2023-01-04T18:19:30.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.822+0000 7f682569c700 1 -- 172.21.15.50:0/1921148483 wait complete. 2023-01-04T18:19:30.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.929+0000 7f7320d64700 1 -- 172.21.15.50:0/3511788513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f731c0f55c0 msgr2=0x7f731c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:30.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.929+0000 7f7320d64700 1 --2- 172.21.15.50:0/3511788513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f731c0f55c0 0x7f731c0f59e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f730c004660 tx=0x7f730c009b30).stop 2023-01-04T18:19:30.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.930+0000 7f7320d64700 1 -- 172.21.15.50:0/3511788513 shutdown_connections 2023-01-04T18:19:30.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.930+0000 7f7320d64700 1 --2- 172.21.15.50:0/3511788513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f731c0f6860 0x7f731c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:30.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.930+0000 7f7320d64700 1 --2- 172.21.15.50:0/3511788513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f731c0f55c0 0x7f731c0f59e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:30.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.930+0000 7f7320d64700 1 -- 172.21.15.50:0/3511788513 >> 172.21.15.50:0/3511788513 conn(0x7f731c0f0d40 msgr2=0x7f731c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:19:30.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.930+0000 7f7320d64700 1 -- 172.21.15.50:0/3511788513 shutdown_connections 2023-01-04T18:19:30.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.930+0000 7f7320d64700 1 -- 172.21.15.50:0/3511788513 wait complete. 2023-01-04T18:19:30.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.931+0000 7f7320d64700 1 Processor -- start 2023-01-04T18:19:30.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.931+0000 7f7320d64700 1 -- start start 2023-01-04T18:19:30.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.931+0000 7f7320d64700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f731c0f55c0 0x7f731c109cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:19:30.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.931+0000 7f7320d64700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f731c0f6860 0x7f731c10c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:19:30.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.931+0000 7f7320d64700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c0603c0 con 0x7f731c0f55c0 2023-01-04T18:19:30.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.931+0000 7f7320d64700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c060500 con 0x7f731c0f6860 2023-01-04T18:19:30.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.931+0000 7f731a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f731c0f55c0 0x7f731c109cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:19:30.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.931+0000 7f731a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f731c0f55c0 0x7f731c109cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57208/0 (socket says 172.21.15.50:57208) 2023-01-04T18:19:30.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.931+0000 7f731a59c700 1 -- 172.21.15.50:0/1244178295 learned_addr learned my addr 172.21.15.50:0/1244178295 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:19:30.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.931+0000 7f7311d9b700 1 --2- 172.21.15.50:0/1244178295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f731c0f6860 0x7f731c10c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:19:30.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.931+0000 7f731a59c700 1 -- 172.21.15.50:0/1244178295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f731c0f6860 msgr2=0x7f731c10c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:30.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.931+0000 7f731a59c700 1 --2- 172.21.15.50:0/1244178295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f731c0f6860 0x7f731c10c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:30.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.931+0000 7f731a59c700 1 -- 172.21.15.50:0/1244178295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730c005040 con 0x7f731c0f55c0 2023-01-04T18:19:30.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.931+0000 7f7311d9b700 1 --2- 172.21.15.50:0/1244178295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f731c0f6860 0x7f731c10c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:19:30.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.932+0000 7f731a59c700 1 --2- 172.21.15.50:0/1244178295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f731c0f55c0 0x7f731c109cf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f730c004e30 tx=0x7f730c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:19:30.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.932+0000 7f73137fe700 1 -- 172.21.15.50:0/1244178295 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f730c018070 con 0x7f731c0f55c0 2023-01-04T18:19:30.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.932+0000 7f7320d64700 1 -- 172.21.15.50:0/1244178295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731c10c740 con 0x7f731c0f55c0 2023-01-04T18:19:30.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.932+0000 7f73137fe700 1 -- 172.21.15.50:0/1244178295 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f730c009630 con 0x7f731c0f55c0 2023-01-04T18:19:30.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.932+0000 7f73137fe700 1 -- 172.21.15.50:0/1244178295 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f730c01c3c0 con 0x7f731c0f55c0 2023-01-04T18:19:30.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.932+0000 7f7320d64700 1 -- 172.21.15.50:0/1244178295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731c10cc70 con 0x7f731c0f55c0 2023-01-04T18:19:30.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.933+0000 7f7320d64700 1 -- 172.21.15.50:0/1244178295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731c0f49b0 con 0x7f731c0f55c0 2023-01-04T18:19:30.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.933+0000 7f73137fe700 1 -- 172.21.15.50:0/1244178295 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f730c01c5f0 con 0x7f731c0f55c0 2023-01-04T18:19:30.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.934+0000 7f73137fe700 1 --2- 172.21.15.50:0/1244178295 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7308060be0 0x7f73080630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:19:30.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.934+0000 7f73137fe700 1 -- 172.21.15.50:0/1244178295 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5928+0+0 (secure 0 0 0) 0x7f730c07d990 con 0x7f731c0f55c0 2023-01-04T18:19:30.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.934+0000 7f7311d9b700 1 --2- 172.21.15.50:0/1244178295 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7308060be0 0x7f73080630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:19:30.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.934+0000 7f7311d9b700 1 --2- 172.21.15.50:0/1244178295 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7308060be0 0x7f73080630a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f7304009740 tx=0x7f7304009be0).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:19:30.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:30.940+0000 7f73137fe700 1 -- 172.21.15.50:0/1244178295 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f730c04df40 con 0x7f731c0f55c0 2023-01-04T18:19:31.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.198+0000 7f7320d64700 1 -- 172.21.15.50:0/1244178295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f731c0fde60 con 0x7f731c0f55c0 2023-01-04T18:19:31.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.198+0000 7f73137fe700 1 -- 172.21.15.50:0/1244178295 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1793 (secure 0 0 0) 0x7f730c051560 con 0x7f731c0f55c0 2023-01-04T18:19:31.202 INFO:teuthology.orchestra.run.smithi050.stdout:e13 2023-01-04T18:19:31.202 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:19:31.202 INFO:teuthology.orchestra.run.smithi050.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:19:31.202 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-01-04T18:19:31.202 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:19:31.202 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-01-04T18:19:31.202 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-01-04T18:19:31.202 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 10 2023-01-04T18:19:31.202 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 2023-01-04T18:19:31.203 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:19:31.203 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-01-04T18:14:43.958806+0000 2023-01-04T18:19:31.203 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-01-04T18:19:31.203 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-01-04T18:19:31.203 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 60 2023-01-04T18:19:31.203 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-01-04T18:19:31.203 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-01-04T18:19:31.203 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-01-04T18:19:31.203 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-01-04T18:19:31.203 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 0 2023-01-04T18:19:31.203 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:19:31.203 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 1 2023-01-04T18:19:31.203 INFO:teuthology.orchestra.run.smithi050.stdout:in 0 2023-01-04T18:19:31.204 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=14430} 2023-01-04T18:19:31.204 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-01-04T18:19:31.204 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-01-04T18:19:31.204 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-01-04T18:19:31.204 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-01-04T18:19:31.204 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-01-04T18:19:31.204 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data enabled 2023-01-04T18:19:31.204 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-01-04T18:19:31.204 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 1 2023-01-04T18:19:31.204 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.ezoiwl{0:14430} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:19:31.204 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.memais{0:24291} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.98:6824/1196398070,v1:172.21.15.98:6825/1196398070] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:19:31.205 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:19:31.205 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:19:31.205 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2023-01-04T18:19:31.205 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:19:31.205 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.kefmuy{-1:14440} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:19:31.205 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.laynsk{-1:24297} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:19:31.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.200+0000 7f7320d64700 1 -- 172.21.15.50:0/1244178295 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7308060be0 msgr2=0x7f73080630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:31.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.200+0000 7f7320d64700 1 --2- 172.21.15.50:0/1244178295 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7308060be0 0x7f73080630a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f7304009740 tx=0x7f7304009be0).stop 2023-01-04T18:19:31.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.200+0000 7f7320d64700 1 -- 172.21.15.50:0/1244178295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f731c0f55c0 msgr2=0x7f731c109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:31.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.200+0000 7f7320d64700 1 --2- 172.21.15.50:0/1244178295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f731c0f55c0 0x7f731c109cf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f730c004e30 tx=0x7f730c009b30).stop 2023-01-04T18:19:31.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.200+0000 7f7320d64700 1 -- 172.21.15.50:0/1244178295 shutdown_connections 2023-01-04T18:19:31.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.200+0000 7f7320d64700 1 --2- 172.21.15.50:0/1244178295 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7308060be0 0x7f73080630a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:31.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.200+0000 7f7320d64700 1 --2- 172.21.15.50:0/1244178295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f731c0f55c0 0x7f731c109cf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:31.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.200+0000 7f7320d64700 1 --2- 172.21.15.50:0/1244178295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f731c0f6860 0x7f731c10c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:31.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.200+0000 7f7320d64700 1 -- 172.21.15.50:0/1244178295 >> 172.21.15.50:0/1244178295 conn(0x7f731c0f0d40 msgr2=0x7f731c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:19:31.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.201+0000 7f7320d64700 1 -- 172.21.15.50:0/1244178295 shutdown_connections 2023-01-04T18:19:31.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.201+0000 7f7320d64700 1 -- 172.21.15.50:0/1244178295 wait complete. 2023-01-04T18:19:31.207 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2023-01-04T18:19:31.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.310+0000 7fd18d329700 1 -- 172.21.15.50:0/2043342975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1880f7980 msgr2=0x7fd1880f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:31.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.310+0000 7fd18d329700 1 --2- 172.21.15.50:0/2043342975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1880f7980 0x7fd1880f7de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fd17c004660 tx=0x7fd17c009b30).stop 2023-01-04T18:19:31.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.310+0000 7fd18d329700 1 -- 172.21.15.50:0/2043342975 shutdown_connections 2023-01-04T18:19:31.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.310+0000 7fd18d329700 1 --2- 172.21.15.50:0/2043342975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1880f7980 0x7fd1880f7de0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:31.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.310+0000 7fd18d329700 1 --2- 172.21.15.50:0/2043342975 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1880f66e0 0x7fd1880f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:31.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.310+0000 7fd18d329700 1 -- 172.21.15.50:0/2043342975 >> 172.21.15.50:0/2043342975 conn(0x7fd1880f1e40 msgr2=0x7fd1880f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:19:31.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.310+0000 7fd18d329700 1 -- 172.21.15.50:0/2043342975 shutdown_connections 2023-01-04T18:19:31.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.310+0000 7fd18d329700 1 -- 172.21.15.50:0/2043342975 wait complete. 2023-01-04T18:19:31.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.310+0000 7fd18d329700 1 Processor -- start 2023-01-04T18:19:31.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.311+0000 7fd18d329700 1 -- start start 2023-01-04T18:19:31.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.311+0000 7fd18d329700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1880f66e0 0x7fd188109120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:19:31.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.311+0000 7fd18d329700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1880f7980 0x7fd188109610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:19:31.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.311+0000 7fd18d329700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd188109bc0 con 0x7fd1880f7980 2023-01-04T18:19:31.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.311+0000 7fd18d329700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd188109d00 con 0x7fd1880f66e0 2023-01-04T18:19:31.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.311+0000 7fd1867fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1880f7980 0x7fd188109610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:19:31.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.311+0000 7fd1867fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1880f7980 0x7fd188109610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57236/0 (socket says 172.21.15.50:57236) 2023-01-04T18:19:31.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.311+0000 7fd1867fc700 1 -- 172.21.15.50:0/4047587054 learned_addr learned my addr 172.21.15.50:0/4047587054 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:19:31.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.311+0000 7fd186ffd700 1 --2- 172.21.15.50:0/4047587054 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1880f66e0 0x7fd188109120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:19:31.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.311+0000 7fd1867fc700 1 -- 172.21.15.50:0/4047587054 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1880f66e0 msgr2=0x7fd188109120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.311+0000 7fd1867fc700 1 --2- 172.21.15.50:0/4047587054 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1880f66e0 0x7fd188109120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.311+0000 7fd1867fc700 1 -- 172.21.15.50:0/4047587054 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c005040 con 0x7fd1880f7980 2023-01-04T18:19:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.311+0000 7fd1867fc700 1 --2- 172.21.15.50:0/4047587054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1880f7980 0x7fd188109610 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd17c009f50 tx=0x7fd17c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:19:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.312+0000 7fd16f7fe700 1 -- 172.21.15.50:0/4047587054 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd17c018070 con 0x7fd1880f7980 2023-01-04T18:19:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.312+0000 7fd16f7fe700 1 -- 172.21.15.50:0/4047587054 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd17c009630 con 0x7fd1880f7980 2023-01-04T18:19:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.312+0000 7fd18d329700 1 -- 172.21.15.50:0/4047587054 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd18810a640 con 0x7fd1880f7980 2023-01-04T18:19:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.312+0000 7fd16f7fe700 1 -- 172.21.15.50:0/4047587054 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd17c01c3c0 con 0x7fd1880f7980 2023-01-04T18:19:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.312+0000 7fd18d329700 1 -- 172.21.15.50:0/4047587054 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18810aba0 con 0x7fd1880f7980 2023-01-04T18:19:31.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.313+0000 7fd18d329700 1 -- 172.21.15.50:0/4047587054 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd188045ad0 con 0x7fd1880f7980 2023-01-04T18:19:31.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.313+0000 7fd16f7fe700 1 -- 172.21.15.50:0/4047587054 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fd17c01d420 con 0x7fd1880f7980 2023-01-04T18:19:31.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.314+0000 7fd16f7fe700 1 --2- 172.21.15.50:0/4047587054 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd170060be0 0x7fd1700630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:19:31.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.314+0000 7fd16f7fe700 1 -- 172.21.15.50:0/4047587054 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5928+0+0 (secure 0 0 0) 0x7fd17c07d8d0 con 0x7fd1880f7980 2023-01-04T18:19:31.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.314+0000 7fd186ffd700 1 --2- 172.21.15.50:0/4047587054 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd170060be0 0x7fd1700630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:19:31.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.314+0000 7fd186ffd700 1 --2- 172.21.15.50:0/4047587054 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd170060be0 0x7fd1700630a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fd1880f77e0 tx=0x7fd17800b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:19:31.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.318+0000 7fd16f7fe700 1 -- 172.21.15.50:0/4047587054 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fd17c051930 con 0x7fd1880f7980 2023-01-04T18:19:31.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.508+0000 7fd18d329700 1 -- 172.21.15.50:0/4047587054 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1880fef80 con 0x7fd170060be0 2023-01-04T18:19:31.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.509+0000 7fd16f7fe700 1 -- 172.21.15.50:0/4047587054 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd1880fef80 con 0x7fd170060be0 2023-01-04T18:19:31.512 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:19:31.513 INFO:teuthology.orchestra.run.smithi050.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308", 2023-01-04T18:19:31.513 INFO:teuthology.orchestra.run.smithi050.stdout: "in_progress": true, 2023-01-04T18:19:31.513 INFO:teuthology.orchestra.run.smithi050.stdout: "which": "Upgrading all daemon types on all hosts", 2023-01-04T18:19:31.513 INFO:teuthology.orchestra.run.smithi050.stdout: "services_complete": [ 2023-01-04T18:19:31.513 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2023-01-04T18:19:31.513 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr", 2023-01-04T18:19:31.513 INFO:teuthology.orchestra.run.smithi050.stdout: "mon" 2023-01-04T18:19:31.513 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-01-04T18:19:31.513 INFO:teuthology.orchestra.run.smithi050.stdout: "progress": "7/21 daemons upgraded", 2023-01-04T18:19:31.513 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "Currently upgrading osd daemons", 2023-01-04T18:19:31.513 INFO:teuthology.orchestra.run.smithi050.stdout: "is_paused": false 2023-01-04T18:19:31.514 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:19:31.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.511+0000 7fd18d329700 1 -- 172.21.15.50:0/4047587054 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd170060be0 msgr2=0x7fd1700630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:31.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.511+0000 7fd18d329700 1 --2- 172.21.15.50:0/4047587054 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd170060be0 0x7fd1700630a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fd1880f77e0 tx=0x7fd17800b040).stop 2023-01-04T18:19:31.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.511+0000 7fd18d329700 1 -- 172.21.15.50:0/4047587054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1880f7980 msgr2=0x7fd188109610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:19:31.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.511+0000 7fd18d329700 1 --2- 172.21.15.50:0/4047587054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1880f7980 0x7fd188109610 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd17c009f50 tx=0x7fd17c009b30).stop 2023-01-04T18:19:31.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.511+0000 7fd18d329700 1 -- 172.21.15.50:0/4047587054 shutdown_connections 2023-01-04T18:19:31.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.511+0000 7fd18d329700 1 --2- 172.21.15.50:0/4047587054 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd170060be0 0x7fd1700630a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:31.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.511+0000 7fd18d329700 1 --2- 172.21.15.50:0/4047587054 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1880f66e0 0x7fd188109120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:31.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.511+0000 7fd18d329700 1 --2- 172.21.15.50:0/4047587054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1880f7980 0x7fd188109610 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:19:31.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.511+0000 7fd18d329700 1 -- 172.21.15.50:0/4047587054 >> 172.21.15.50:0/4047587054 conn(0x7fd1880f1e40 msgr2=0x7fd18806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:19:31.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.511+0000 7fd18d329700 1 -- 172.21.15.50:0/4047587054 shutdown_connections 2023-01-04T18:19:31.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:19:31.511+0000 7fd18d329700 1 -- 172.21.15.50:0/4047587054 wait complete. 2023-01-04T18:19:31.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:29.850897+0000 mgr.smithi050.emnywo (mgr.24517) 106 : audit [DBG] from='client.34172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:19:31.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:30.157589+0000 mgr.smithi050.emnywo (mgr.24517) 107 : audit [DBG] from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:19:31.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:30.452706+0000 mgr.smithi050.emnywo (mgr.24517) 108 : audit [DBG] from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:19:31.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:30.821642+0000 mon.smithi050 (mon.0) 150 : audit [DBG] from='client.? 172.21.15.50:0/1921148483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:19:31.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:31.199692+0000 mon.smithi050 (mon.0) 151 : audit [DBG] from='client.? 172.21.15.50:0/1244178295' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:19:31.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:29.850897+0000 mgr.smithi050.emnywo (mgr.24517) 106 : audit [DBG] from='client.34172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:19:31.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:30.157589+0000 mgr.smithi050.emnywo (mgr.24517) 107 : audit [DBG] from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:19:31.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:30.452706+0000 mgr.smithi050.emnywo (mgr.24517) 108 : audit [DBG] from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:19:31.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:30.821642+0000 mon.smithi050 (mon.0) 150 : audit [DBG] from='client.? 172.21.15.50:0/1921148483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:19:31.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:31.199692+0000 mon.smithi050 (mon.0) 151 : audit [DBG] from='client.? 172.21.15.50:0/1244178295' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:19:32.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:30.625999+0000 mgr.smithi050.emnywo (mgr.24517) 109 : cluster [DBG] pgmap v80: 65 pgs: 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 5 active+recovery_wait+degraded, 55 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 720/210 objects degraded (342.857%); 0 B/s, 8 objects/s recovering 2023-01-04T18:19:32.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:31.510422+0000 mgr.smithi050.emnywo (mgr.24517) 110 : audit [DBG] from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:19:32.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:30.625999+0000 mgr.smithi050.emnywo (mgr.24517) 109 : cluster [DBG] pgmap v80: 65 pgs: 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 5 active+recovery_wait+degraded, 55 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 720/210 objects degraded (342.857%); 0 B/s, 8 objects/s recovering 2023-01-04T18:19:32.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:31.510422+0000 mgr.smithi050.emnywo (mgr.24517) 110 : audit [DBG] from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:19:34.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:32.626439+0000 mgr.smithi050.emnywo (mgr.24517) 111 : cluster [DBG] pgmap v81: 65 pgs: 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 3 active+recovery_wait+degraded, 57 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 639/210 objects degraded (304.286%); 0 B/s, 21 objects/s recovering 2023-01-04T18:19:34.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:32.626439+0000 mgr.smithi050.emnywo (mgr.24517) 111 : cluster [DBG] pgmap v81: 65 pgs: 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 3 active+recovery_wait+degraded, 57 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 639/210 objects degraded (304.286%); 0 B/s, 21 objects/s recovering 2023-01-04T18:19:36.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:34.626768+0000 mgr.smithi050.emnywo (mgr.24517) 112 : cluster [DBG] pgmap v82: 65 pgs: 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 3 active+recovery_wait+degraded, 57 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 639/210 objects degraded (304.286%); 0 B/s, 18 objects/s recovering 2023-01-04T18:19:36.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:34.626768+0000 mgr.smithi050.emnywo (mgr.24517) 112 : cluster [DBG] pgmap v82: 65 pgs: 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 3 active+recovery_wait+degraded, 57 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 639/210 objects degraded (304.286%); 0 B/s, 18 objects/s recovering 2023-01-04T18:19:37.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:37 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:37.100577+0000 mon.smithi050 (mon.0) 152 : cluster [WRN] Health check update: Degraded data redundancy: 639/210 objects degraded (304.286%), 7 pgs degraded (PG_DEGRADED) 2023-01-04T18:19:37.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:37 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:37.100577+0000 mon.smithi050 (mon.0) 152 : cluster [WRN] Health check update: Degraded data redundancy: 639/210 objects degraded (304.286%), 7 pgs degraded (PG_DEGRADED) 2023-01-04T18:19:38.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:36.627288+0000 mgr.smithi050.emnywo (mgr.24517) 113 : cluster [DBG] pgmap v83: 65 pgs: 1 active+recovering+undersized+remapped, 3 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 2 active+recovery_wait+degraded, 58 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 461/210 objects degraded (219.524%); 0 B/s, 27 objects/s recovering 2023-01-04T18:19:38.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:36.627288+0000 mgr.smithi050.emnywo (mgr.24517) 113 : cluster [DBG] pgmap v83: 65 pgs: 1 active+recovering+undersized+remapped, 3 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 2 active+recovery_wait+degraded, 58 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 461/210 objects degraded (219.524%); 0 B/s, 27 objects/s recovering 2023-01-04T18:19:40.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:38.627715+0000 mgr.smithi050.emnywo (mgr.24517) 114 : cluster [DBG] pgmap v84: 65 pgs: 1 active+recovering+undersized+remapped, 3 active+recovery_wait+undersized+degraded+remapped, 2 active+recovery_wait+degraded, 59 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 461/210 objects degraded (219.524%); 0 B/s, 24 objects/s recovering 2023-01-04T18:19:40.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:40.182729+0000 mon.smithi050 (mon.0) 153 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:19:40.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:38.627715+0000 mgr.smithi050.emnywo (mgr.24517) 114 : cluster [DBG] pgmap v84: 65 pgs: 1 active+recovering+undersized+remapped, 3 active+recovery_wait+undersized+degraded+remapped, 2 active+recovery_wait+degraded, 59 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 461/210 objects degraded (219.524%); 0 B/s, 24 objects/s recovering 2023-01-04T18:19:40.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:40.182729+0000 mon.smithi050 (mon.0) 153 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:19:41.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:40.182919+0000 mgr.smithi050.emnywo (mgr.24517) 115 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:19:41.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:19:40.183680+0000 mgr.smithi050.emnywo (mgr.24517) 116 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2023-01-04T18:19:41.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:40.279015+0000 mon.smithi050 (mon.0) 154 : cluster [DBG] osdmap e59: 6 total, 6 up, 6 in 2023-01-04T18:19:41.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:40.182919+0000 mgr.smithi050.emnywo (mgr.24517) 115 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:19:41.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:19:40.183680+0000 mgr.smithi050.emnywo (mgr.24517) 116 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2023-01-04T18:19:41.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:40.279015+0000 mon.smithi050 (mon.0) 154 : cluster [DBG] osdmap e59: 6 total, 6 up, 6 in 2023-01-04T18:19:42.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:40.628057+0000 mgr.smithi050.emnywo (mgr.24517) 117 : cluster [DBG] pgmap v86: 65 pgs: 1 active+recovering+undersized+remapped, 3 active+recovery_wait+undersized+degraded+remapped, 2 active+recovery_wait+degraded, 59 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 461/210 objects degraded (219.524%); 0 B/s, 25 objects/s recovering 2023-01-04T18:19:42.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:41.283822+0000 mon.smithi050 (mon.0) 155 : cluster [DBG] osdmap e60: 6 total, 6 up, 6 in 2023-01-04T18:19:42.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:42.101424+0000 mon.smithi050 (mon.0) 156 : cluster [WRN] Health check update: Degraded data redundancy: 461/210 objects degraded (219.524%), 5 pgs degraded (PG_DEGRADED) 2023-01-04T18:19:42.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:40.628057+0000 mgr.smithi050.emnywo (mgr.24517) 117 : cluster [DBG] pgmap v86: 65 pgs: 1 active+recovering+undersized+remapped, 3 active+recovery_wait+undersized+degraded+remapped, 2 active+recovery_wait+degraded, 59 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 461/210 objects degraded (219.524%); 0 B/s, 25 objects/s recovering 2023-01-04T18:19:42.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:41.283822+0000 mon.smithi050 (mon.0) 155 : cluster [DBG] osdmap e60: 6 total, 6 up, 6 in 2023-01-04T18:19:42.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:42.101424+0000 mon.smithi050 (mon.0) 156 : cluster [WRN] Health check update: Degraded data redundancy: 461/210 objects degraded (219.524%), 5 pgs degraded (PG_DEGRADED) 2023-01-04T18:19:44.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:42.628744+0000 mgr.smithi050.emnywo (mgr.24517) 118 : cluster [DBG] pgmap v88: 65 pgs: 1 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 61 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 282/210 objects degraded (134.286%); 0 B/s, 35 objects/s recovering 2023-01-04T18:19:44.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:42.628744+0000 mgr.smithi050.emnywo (mgr.24517) 118 : cluster [DBG] pgmap v88: 65 pgs: 1 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 61 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 282/210 objects degraded (134.286%); 0 B/s, 35 objects/s recovering 2023-01-04T18:19:46.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:44.629219+0000 mgr.smithi050.emnywo (mgr.24517) 119 : cluster [DBG] pgmap v89: 65 pgs: 1 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 61 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 282/210 objects degraded (134.286%); 0 B/s, 19 objects/s recovering 2023-01-04T18:19:46.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:44.629219+0000 mgr.smithi050.emnywo (mgr.24517) 119 : cluster [DBG] pgmap v89: 65 pgs: 1 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 61 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 282/210 objects degraded (134.286%); 0 B/s, 19 objects/s recovering 2023-01-04T18:19:47.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:47 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:47.102506+0000 mon.smithi050 (mon.0) 157 : cluster [WRN] Health check update: Degraded data redundancy: 282/210 objects degraded (134.286%), 3 pgs degraded (PG_DEGRADED) 2023-01-04T18:19:47.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:47.102506+0000 mon.smithi050 (mon.0) 157 : cluster [WRN] Health check update: Degraded data redundancy: 282/210 objects degraded (134.286%), 3 pgs degraded (PG_DEGRADED) 2023-01-04T18:19:48.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:46.629985+0000 mgr.smithi050.emnywo (mgr.24517) 120 : cluster [DBG] pgmap v90: 65 pgs: 1 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 61 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 282/210 objects degraded (134.286%); 0 B/s, 24 objects/s recovering 2023-01-04T18:19:48.660 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:46.629985+0000 mgr.smithi050.emnywo (mgr.24517) 120 : cluster [DBG] pgmap v90: 65 pgs: 1 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 61 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 282/210 objects degraded (134.286%); 0 B/s, 24 objects/s recovering 2023-01-04T18:19:50.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:48.630397+0000 mgr.smithi050.emnywo (mgr.24517) 121 : cluster [DBG] pgmap v91: 65 pgs: 1 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 61 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 282/210 objects degraded (134.286%); 0 B/s, 23 objects/s recovering 2023-01-04T18:19:50.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:49.300038+0000 mon.smithi050 (mon.0) 158 : cluster [DBG] osdmap e61: 6 total, 6 up, 6 in 2023-01-04T18:19:50.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:48.630397+0000 mgr.smithi050.emnywo (mgr.24517) 121 : cluster [DBG] pgmap v91: 65 pgs: 1 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 61 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 282/210 objects degraded (134.286%); 0 B/s, 23 objects/s recovering 2023-01-04T18:19:50.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:49.300038+0000 mon.smithi050 (mon.0) 158 : cluster [DBG] osdmap e61: 6 total, 6 up, 6 in 2023-01-04T18:19:51.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:51 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:50.301857+0000 mon.smithi050 (mon.0) 159 : cluster [DBG] osdmap e62: 6 total, 6 up, 6 in 2023-01-04T18:19:51.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:50.301857+0000 mon.smithi050 (mon.0) 159 : cluster [DBG] osdmap e62: 6 total, 6 up, 6 in 2023-01-04T18:19:52.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:50.630736+0000 mgr.smithi050.emnywo (mgr.24517) 122 : cluster [DBG] pgmap v94: 65 pgs: 1 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 61 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 282/210 objects degraded (134.286%); 0 B/s, 7 objects/s recovering 2023-01-04T18:19:52.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:50.630736+0000 mgr.smithi050.emnywo (mgr.24517) 122 : cluster [DBG] pgmap v94: 65 pgs: 1 active+recovering+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 61 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 282/210 objects degraded (134.286%); 0 B/s, 7 objects/s recovering 2023-01-04T18:19:53.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:53.308627+0000 mon.smithi050 (mon.0) 160 : cluster [WRN] Health check update: Degraded data redundancy: 189/210 objects degraded (90.000%), 2 pgs degraded (PG_DEGRADED) 2023-01-04T18:19:53.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:53.308627+0000 mon.smithi050 (mon.0) 160 : cluster [WRN] Health check update: Degraded data redundancy: 189/210 objects degraded (90.000%), 2 pgs degraded (PG_DEGRADED) 2023-01-04T18:19:54.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:52.631179+0000 mgr.smithi050.emnywo (mgr.24517) 123 : cluster [DBG] pgmap v95: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 62 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 189/210 objects degraded (90.000%); 0 B/s, 14 objects/s recovering 2023-01-04T18:19:54.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:52.631179+0000 mgr.smithi050.emnywo (mgr.24517) 123 : cluster [DBG] pgmap v95: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 62 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 189/210 objects degraded (90.000%); 0 B/s, 14 objects/s recovering 2023-01-04T18:19:55.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:55.199166+0000 mon.smithi050 (mon.0) 161 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:19:55.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:55.200306+0000 mon.smithi050 (mon.0) 162 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:19:55.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:55.200921+0000 mon.smithi050 (mon.0) 163 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:19:55.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:55.199166+0000 mon.smithi050 (mon.0) 161 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:19:55.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:55.200306+0000 mon.smithi050 (mon.0) 162 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:19:55.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:55.200921+0000 mon.smithi050 (mon.0) 163 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:19:56.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:54.631508+0000 mgr.smithi050.emnywo (mgr.24517) 124 : cluster [DBG] pgmap v96: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 62 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 189/210 objects degraded (90.000%); 0 B/s, 7 objects/s recovering 2023-01-04T18:19:56.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:19:55.201465+0000 mgr.smithi050.emnywo (mgr.24517) 125 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:19:56.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:55.559907+0000 mon.smithi050 (mon.0) 164 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:19:56.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:55.981011+0000 mon.smithi050 (mon.0) 165 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:19:56.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:55.985700+0000 mon.smithi050 (mon.0) 166 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:19:56.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:55.987744+0000 mon.smithi050 (mon.0) 167 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:19:56.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:55.988905+0000 mon.smithi050 (mon.0) 168 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:19:56.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:55.989985+0000 mon.smithi050 (mon.0) 169 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:19:56.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:55.991106+0000 mon.smithi050 (mon.0) 170 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:19:57.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:54.631508+0000 mgr.smithi050.emnywo (mgr.24517) 124 : cluster [DBG] pgmap v96: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 62 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 189/210 objects degraded (90.000%); 0 B/s, 7 objects/s recovering 2023-01-04T18:19:57.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:19:55.201465+0000 mgr.smithi050.emnywo (mgr.24517) 125 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:19:57.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:55.559907+0000 mon.smithi050 (mon.0) 164 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:19:57.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:55.981011+0000 mon.smithi050 (mon.0) 165 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:19:57.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:55.985700+0000 mon.smithi050 (mon.0) 166 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:19:57.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:55.987744+0000 mon.smithi050 (mon.0) 167 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:19:57.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:55.988905+0000 mon.smithi050 (mon.0) 168 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:19:57.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:55.989985+0000 mon.smithi050 (mon.0) 169 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:19:57.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:55.991106+0000 mon.smithi050 (mon.0) 170 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:19:57.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:19:55.991259+0000 mgr.smithi050.emnywo (mgr.24517) 126 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:19:57.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:19:55.991933+0000 mgr.smithi050.emnywo (mgr.24517) 127 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2023-01-04T18:19:57.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:56.983370+0000 mon.smithi050 (mon.0) 171 : cluster [DBG] osdmap e63: 6 total, 6 up, 6 in 2023-01-04T18:19:58.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:19:55.991259+0000 mgr.smithi050.emnywo (mgr.24517) 126 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:19:58.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:19:55.991933+0000 mgr.smithi050.emnywo (mgr.24517) 127 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2023-01-04T18:19:58.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:56.983370+0000 mon.smithi050 (mon.0) 171 : cluster [DBG] osdmap e63: 6 total, 6 up, 6 in 2023-01-04T18:19:58.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:56.632018+0000 mgr.smithi050.emnywo (mgr.24517) 128 : cluster [DBG] pgmap v97: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 62 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 189/210 objects degraded (90.000%); 0 B/s, 14 objects/s recovering 2023-01-04T18:19:58.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:19:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:57.984243+0000 mon.smithi050 (mon.0) 172 : cluster [DBG] osdmap e64: 6 total, 6 up, 6 in 2023-01-04T18:19:59.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:56.632018+0000 mgr.smithi050.emnywo (mgr.24517) 128 : cluster [DBG] pgmap v97: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 62 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 189/210 objects degraded (90.000%); 0 B/s, 14 objects/s recovering 2023-01-04T18:19:59.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:19:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:57.984243+0000 mon.smithi050 (mon.0) 172 : cluster [DBG] osdmap e64: 6 total, 6 up, 6 in 2023-01-04T18:20:00.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:19:58.632477+0000 mgr.smithi050.emnywo (mgr.24517) 129 : cluster [DBG] pgmap v100: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 62 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 189/210 objects degraded (90.000%); 0 B/s, 14 objects/s recovering 2023-01-04T18:20:00.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:00.000183+0000 mon.smithi050 (mon.0) 173 : cluster [WRN] Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 189/210 objects degraded (90.000%), 2 pgs degraded 2023-01-04T18:20:00.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:00.000234+0000 mon.smithi050 (mon.0) 174 : cluster [WRN] [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-01-04T18:20:00.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:00.000254+0000 mon.smithi050 (mon.0) 175 : cluster [WRN] fs cephfs has deprecated feature inline_data enabled. 2023-01-04T18:20:00.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:00.000281+0000 mon.smithi050 (mon.0) 176 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 189/210 objects degraded (90.000%), 2 pgs degraded 2023-01-04T18:20:00.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:00.000329+0000 mon.smithi050 (mon.0) 177 : cluster [WRN] pg 3.10 is active+recovery_wait+undersized+degraded+remapped, acting [5,1] 2023-01-04T18:20:00.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:00.000358+0000 mon.smithi050 (mon.0) 178 : cluster [WRN] pg 3.15 is active+recovery_wait+degraded, acting [3,0,4] 2023-01-04T18:20:01.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:19:58.632477+0000 mgr.smithi050.emnywo (mgr.24517) 129 : cluster [DBG] pgmap v100: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 62 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 189/210 objects degraded (90.000%); 0 B/s, 14 objects/s recovering 2023-01-04T18:20:01.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:00.000183+0000 mon.smithi050 (mon.0) 173 : cluster [WRN] Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 189/210 objects degraded (90.000%), 2 pgs degraded 2023-01-04T18:20:01.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:00.000234+0000 mon.smithi050 (mon.0) 174 : cluster [WRN] [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-01-04T18:20:01.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:00.000254+0000 mon.smithi050 (mon.0) 175 : cluster [WRN] fs cephfs has deprecated feature inline_data enabled. 2023-01-04T18:20:01.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:00.000281+0000 mon.smithi050 (mon.0) 176 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 189/210 objects degraded (90.000%), 2 pgs degraded 2023-01-04T18:20:01.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:00.000329+0000 mon.smithi050 (mon.0) 177 : cluster [WRN] pg 3.10 is active+recovery_wait+undersized+degraded+remapped, acting [5,1] 2023-01-04T18:20:01.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:00.000358+0000 mon.smithi050 (mon.0) 178 : cluster [WRN] pg 3.15 is active+recovery_wait+degraded, acting [3,0,4] 2023-01-04T18:20:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.631+0000 7f8e17fff700 1 -- 172.21.15.50:0/1159467604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e180f5430 msgr2=0x7f8e180f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.631+0000 7f8e17fff700 1 --2- 172.21.15.50:0/1159467604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e180f5430 0x7f8e180f5850 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f8e08004660 tx=0x7f8e08009b30).stop 2023-01-04T18:20:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.631+0000 7f8e17fff700 1 -- 172.21.15.50:0/1159467604 shutdown_connections 2023-01-04T18:20:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.631+0000 7f8e17fff700 1 --2- 172.21.15.50:0/1159467604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e180f66d0 0x7f8e180f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.631+0000 7f8e17fff700 1 --2- 172.21.15.50:0/1159467604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e180f5430 0x7f8e180f5850 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.631+0000 7f8e17fff700 1 -- 172.21.15.50:0/1159467604 >> 172.21.15.50:0/1159467604 conn(0x7f8e180f0b90 msgr2=0x7f8e180f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.631+0000 7f8e17fff700 1 -- 172.21.15.50:0/1159467604 shutdown_connections 2023-01-04T18:20:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.631+0000 7f8e17fff700 1 -- 172.21.15.50:0/1159467604 wait complete. 2023-01-04T18:20:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.632+0000 7f8e17fff700 1 Processor -- start 2023-01-04T18:20:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.632+0000 7f8e17fff700 1 -- start start 2023-01-04T18:20:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.632+0000 7f8e17fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e180f5430 0x7f8e18105ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:01.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.632+0000 7f8e17fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e180f66d0 0x7f8e181061d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:01.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.632+0000 7f8e17fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e18106780 con 0x7f8e180f66d0 2023-01-04T18:20:01.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.632+0000 7f8e17fff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e18106f80 con 0x7f8e180f5430 2023-01-04T18:20:01.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.633+0000 7f8e167fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e180f66d0 0x7f8e181061d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:01.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.633+0000 7f8e167fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e180f66d0 0x7f8e181061d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58078/0 (socket says 172.21.15.50:58078) 2023-01-04T18:20:01.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.633+0000 7f8e167fc700 1 -- 172.21.15.50:0/2064786775 learned_addr learned my addr 172.21.15.50:0/2064786775 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:20:01.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.633+0000 7f8e16ffd700 1 --2- 172.21.15.50:0/2064786775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e180f5430 0x7f8e18105ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:01.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.633+0000 7f8e167fc700 1 -- 172.21.15.50:0/2064786775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e180f5430 msgr2=0x7f8e18105ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:01.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.633+0000 7f8e167fc700 1 --2- 172.21.15.50:0/2064786775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e180f5430 0x7f8e18105ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:01.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.633+0000 7f8e167fc700 1 -- 172.21.15.50:0/2064786775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e08005040 con 0x7f8e180f66d0 2023-01-04T18:20:01.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.633+0000 7f8e16ffd700 1 --2- 172.21.15.50:0/2064786775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e180f5430 0x7f8e18105ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-01-04T18:20:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.633+0000 7f8e167fc700 1 --2- 172.21.15.50:0/2064786775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e180f66d0 0x7f8e181061d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f8e0c00e7f0 tx=0x7f8e0c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.633+0000 7f8dff7fe700 1 -- 172.21.15.50:0/2064786775 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e0c0092e0 con 0x7f8e180f66d0 2023-01-04T18:20:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.633+0000 7f8dff7fe700 1 -- 172.21.15.50:0/2064786775 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8e0c00f040 con 0x7f8e180f66d0 2023-01-04T18:20:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.633+0000 7f8dff7fe700 1 -- 172.21.15.50:0/2064786775 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e0c0147e0 con 0x7f8e180f66d0 2023-01-04T18:20:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.633+0000 7f8e17fff700 1 -- 172.21.15.50:0/2064786775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e18107260 con 0x7f8e180f66d0 2023-01-04T18:20:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.633+0000 7f8e17fff700 1 -- 172.21.15.50:0/2064786775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e181077a0 con 0x7f8e180f66d0 2023-01-04T18:20:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.634+0000 7f8e17fff700 1 -- 172.21.15.50:0/2064786775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e18059100 con 0x7f8e180f66d0 2023-01-04T18:20:01.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.635+0000 7f8dff7fe700 1 -- 172.21.15.50:0/2064786775 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f8e0c01b030 con 0x7f8e180f66d0 2023-01-04T18:20:01.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.635+0000 7f8dff7fe700 1 --2- 172.21.15.50:0/2064786775 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f8e00060c30 0x7f8e000630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:01.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.636+0000 7f8dff7fe700 1 -- 172.21.15.50:0/2064786775 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f8e0c07bb80 con 0x7f8e180f66d0 2023-01-04T18:20:01.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.636+0000 7f8e16ffd700 1 --2- 172.21.15.50:0/2064786775 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f8e00060c30 0x7f8e000630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:01.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.636+0000 7f8e16ffd700 1 --2- 172.21.15.50:0/2064786775 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f8e00060c30 0x7f8e000630f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8e08009720 tx=0x7f8e08016040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:01.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.639+0000 7f8dff7fe700 1 -- 172.21.15.50:0/2064786775 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f8e0c04fc20 con 0x7f8e180f66d0 2023-01-04T18:20:01.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.828+0000 7f8e17fff700 1 -- 172.21.15.50:0/2064786775 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e180ff690 con 0x7f8e00060c30 2023-01-04T18:20:01.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.829+0000 7f8dff7fe700 1 -- 172.21.15.50:0/2064786775 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8e180ff690 con 0x7f8e00060c30 2023-01-04T18:20:01.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.831+0000 7f8e17fff700 1 -- 172.21.15.50:0/2064786775 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f8e00060c30 msgr2=0x7f8e000630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:01.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.831+0000 7f8e17fff700 1 --2- 172.21.15.50:0/2064786775 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f8e00060c30 0x7f8e000630f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8e08009720 tx=0x7f8e08016040).stop 2023-01-04T18:20:01.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.831+0000 7f8e17fff700 1 -- 172.21.15.50:0/2064786775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e180f66d0 msgr2=0x7f8e181061d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:01.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.831+0000 7f8e17fff700 1 --2- 172.21.15.50:0/2064786775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e180f66d0 0x7f8e181061d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f8e0c00e7f0 tx=0x7f8e0c00b040).stop 2023-01-04T18:20:01.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.831+0000 7f8e17fff700 1 -- 172.21.15.50:0/2064786775 shutdown_connections 2023-01-04T18:20:01.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.831+0000 7f8e17fff700 1 --2- 172.21.15.50:0/2064786775 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f8e00060c30 0x7f8e000630f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:01.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.831+0000 7f8e17fff700 1 --2- 172.21.15.50:0/2064786775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e180f5430 0x7f8e18105ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:01.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.831+0000 7f8e17fff700 1 --2- 172.21.15.50:0/2064786775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e180f66d0 0x7f8e181061d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:01.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.831+0000 7f8e17fff700 1 -- 172.21.15.50:0/2064786775 >> 172.21.15.50:0/2064786775 conn(0x7f8e180f0b90 msgr2=0x7f8e180fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:01.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.831+0000 7f8e17fff700 1 -- 172.21.15.50:0/2064786775 shutdown_connections 2023-01-04T18:20:01.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.831+0000 7f8e17fff700 1 -- 172.21.15.50:0/2064786775 wait complete. 2023-01-04T18:20:01.844 INFO:teuthology.orchestra.run.smithi050.stdout:true 2023-01-04T18:20:01.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.934+0000 7fb8b6ff2700 1 -- 172.21.15.50:0/2166395270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8b00f66e0 msgr2=0x7fb8b00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:01.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.934+0000 7fb8b6ff2700 1 --2- 172.21.15.50:0/2166395270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8b00f66e0 0x7fb8b00f6b00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fb8a4004660 tx=0x7fb8a4009b30).stop 2023-01-04T18:20:01.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.934+0000 7fb8b6ff2700 1 -- 172.21.15.50:0/2166395270 shutdown_connections 2023-01-04T18:20:01.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.934+0000 7fb8b6ff2700 1 --2- 172.21.15.50:0/2166395270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8b00f7980 0x7fb8b00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:01.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.934+0000 7fb8b6ff2700 1 --2- 172.21.15.50:0/2166395270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8b00f66e0 0x7fb8b00f6b00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:01.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.934+0000 7fb8b6ff2700 1 -- 172.21.15.50:0/2166395270 >> 172.21.15.50:0/2166395270 conn(0x7fb8b00f1e40 msgr2=0x7fb8b00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:01.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.934+0000 7fb8b6ff2700 1 -- 172.21.15.50:0/2166395270 shutdown_connections 2023-01-04T18:20:01.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.934+0000 7fb8b6ff2700 1 -- 172.21.15.50:0/2166395270 wait complete. 2023-01-04T18:20:01.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.934+0000 7fb8b6ff2700 1 Processor -- start 2023-01-04T18:20:01.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.934+0000 7fb8b6ff2700 1 -- start start 2023-01-04T18:20:01.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.935+0000 7fb8b6ff2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8b00f66e0 0x7fb8b0106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:01.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.935+0000 7fb8b6ff2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8b00f7980 0x7fb8b0107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:01.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.935+0000 7fb8b6ff2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b0107a20 con 0x7fb8b00f66e0 2023-01-04T18:20:01.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.935+0000 7fb8b6ff2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b0107b60 con 0x7fb8b00f7980 2023-01-04T18:20:01.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.935+0000 7fb8b4d8e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8b00f66e0 0x7fb8b0106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:01.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.935+0000 7fb8b4d8e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8b00f66e0 0x7fb8b0106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58090/0 (socket says 172.21.15.50:58090) 2023-01-04T18:20:01.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.935+0000 7fb8b4d8e700 1 -- 172.21.15.50:0/3209516948 learned_addr learned my addr 172.21.15.50:0/3209516948 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:20:01.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.935+0000 7fb8affff700 1 --2- 172.21.15.50:0/3209516948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8b00f7980 0x7fb8b0107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:01.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.935+0000 7fb8b4d8e700 1 -- 172.21.15.50:0/3209516948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8b00f7980 msgr2=0x7fb8b0107470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:01.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.935+0000 7fb8b4d8e700 1 --2- 172.21.15.50:0/3209516948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8b00f7980 0x7fb8b0107470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:01.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.935+0000 7fb8b4d8e700 1 -- 172.21.15.50:0/3209516948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a4005040 con 0x7fb8b00f66e0 2023-01-04T18:20:01.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.935+0000 7fb8b4d8e700 1 --2- 172.21.15.50:0/3209516948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8b00f66e0 0x7fb8b0106f80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fb8a4014040 tx=0x7fb8a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:01.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.936+0000 7fb8ad7fa700 1 -- 172.21.15.50:0/3209516948 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8a4019070 con 0x7fb8b00f66e0 2023-01-04T18:20:01.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.936+0000 7fb8ad7fa700 1 -- 172.21.15.50:0/3209516948 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb8a401e420 con 0x7fb8b00f66e0 2023-01-04T18:20:01.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.936+0000 7fb8b6ff2700 1 -- 172.21.15.50:0/3209516948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b01084a0 con 0x7fb8b00f66e0 2023-01-04T18:20:01.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.936+0000 7fb8ad7fa700 1 -- 172.21.15.50:0/3209516948 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8a4014620 con 0x7fb8b00f66e0 2023-01-04T18:20:01.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.936+0000 7fb8b6ff2700 1 -- 172.21.15.50:0/3209516948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b0108980 con 0x7fb8b00f66e0 2023-01-04T18:20:01.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.936+0000 7fb8b6ff2700 1 -- 172.21.15.50:0/3209516948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b0045ad0 con 0x7fb8b00f66e0 2023-01-04T18:20:01.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.937+0000 7fb8ad7fa700 1 -- 172.21.15.50:0/3209516948 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fb8a401e9e0 con 0x7fb8b00f66e0 2023-01-04T18:20:01.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.937+0000 7fb8ad7fa700 1 --2- 172.21.15.50:0/3209516948 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb8a0060be0 0x7fb8a00630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:01.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.937+0000 7fb8ad7fa700 1 -- 172.21.15.50:0/3209516948 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5841+0+0 (secure 0 0 0) 0x7fb8a407d130 con 0x7fb8b00f66e0 2023-01-04T18:20:01.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.937+0000 7fb8affff700 1 --2- 172.21.15.50:0/3209516948 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb8a0060be0 0x7fb8a00630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:01.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.938+0000 7fb8affff700 1 --2- 172.21.15.50:0/3209516948 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb8a0060be0 0x7fb8a00630a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fb89c009fd0 tx=0x7fb89c00b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:01.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:01.942+0000 7fb8ad7fa700 1 -- 172.21.15.50:0/3209516948 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fb8a4051160 con 0x7fb8b00f66e0 2023-01-04T18:20:02.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:01 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:00.632908+0000 mgr.smithi050.emnywo (mgr.24517) 130 : cluster [DBG] pgmap v101: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 63 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 189/210 objects degraded (90.000%); 0 B/s, 8 objects/s recovering 2023-01-04T18:20:02.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:01 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:01.567863+0000 mon.smithi050 (mon.0) 179 : cluster [WRN] Health check update: Degraded data redundancy: 189/210 objects degraded (90.000%), 2 pgs degraded, 1 pg undersized (PG_DEGRADED) 2023-01-04T18:20:02.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:00.632908+0000 mgr.smithi050.emnywo (mgr.24517) 130 : cluster [DBG] pgmap v101: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+degraded, 63 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 189/210 objects degraded (90.000%); 0 B/s, 8 objects/s recovering 2023-01-04T18:20:02.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:01.567863+0000 mon.smithi050 (mon.0) 179 : cluster [WRN] Health check update: Degraded data redundancy: 189/210 objects degraded (90.000%), 2 pgs degraded, 1 pg undersized (PG_DEGRADED) 2023-01-04T18:20:02.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.130+0000 7fb8b6ff2700 1 -- 172.21.15.50:0/3209516948 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8b0100ef0 con 0x7fb8a0060be0 2023-01-04T18:20:02.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.132+0000 7fb8ad7fa700 1 -- 172.21.15.50:0/3209516948 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb8b0100ef0 con 0x7fb8a0060be0 2023-01-04T18:20:02.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.133+0000 7fb8b6ff2700 1 -- 172.21.15.50:0/3209516948 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb8a0060be0 msgr2=0x7fb8a00630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:02.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.133+0000 7fb8b6ff2700 1 --2- 172.21.15.50:0/3209516948 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb8a0060be0 0x7fb8a00630a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fb89c009fd0 tx=0x7fb89c00b040).stop 2023-01-04T18:20:02.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.133+0000 7fb8b6ff2700 1 -- 172.21.15.50:0/3209516948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8b00f66e0 msgr2=0x7fb8b0106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:02.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.133+0000 7fb8b6ff2700 1 --2- 172.21.15.50:0/3209516948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8b00f66e0 0x7fb8b0106f80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fb8a4014040 tx=0x7fb8a400b040).stop 2023-01-04T18:20:02.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.134+0000 7fb8b6ff2700 1 -- 172.21.15.50:0/3209516948 shutdown_connections 2023-01-04T18:20:02.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.134+0000 7fb8b6ff2700 1 --2- 172.21.15.50:0/3209516948 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb8a0060be0 0x7fb8a00630a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:02.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.134+0000 7fb8b6ff2700 1 --2- 172.21.15.50:0/3209516948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8b00f66e0 0x7fb8b0106f80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:02.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.134+0000 7fb8b6ff2700 1 --2- 172.21.15.50:0/3209516948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8b00f7980 0x7fb8b0107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:02.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.134+0000 7fb8b6ff2700 1 -- 172.21.15.50:0/3209516948 >> 172.21.15.50:0/3209516948 conn(0x7fb8b00f1e40 msgr2=0x7fb8b00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:02.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.134+0000 7fb8b6ff2700 1 -- 172.21.15.50:0/3209516948 shutdown_connections 2023-01-04T18:20:02.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.134+0000 7fb8b6ff2700 1 -- 172.21.15.50:0/3209516948 wait complete. 2023-01-04T18:20:02.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.235+0000 7ff40ace4700 1 -- 172.21.15.50:0/939866250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4040f5430 msgr2=0x7ff4040f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:02.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.235+0000 7ff40ace4700 1 --2- 172.21.15.50:0/939866250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4040f5430 0x7ff4040f5850 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7ff400004660 tx=0x7ff400009b30).stop 2023-01-04T18:20:02.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.236+0000 7ff40ace4700 1 -- 172.21.15.50:0/939866250 shutdown_connections 2023-01-04T18:20:02.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.236+0000 7ff40ace4700 1 --2- 172.21.15.50:0/939866250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4040f66d0 0x7ff4040f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:02.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.236+0000 7ff40ace4700 1 --2- 172.21.15.50:0/939866250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4040f5430 0x7ff4040f5850 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:02.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.236+0000 7ff40ace4700 1 -- 172.21.15.50:0/939866250 >> 172.21.15.50:0/939866250 conn(0x7ff4040f0b90 msgr2=0x7ff4040f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:02.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.236+0000 7ff40ace4700 1 -- 172.21.15.50:0/939866250 shutdown_connections 2023-01-04T18:20:02.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.236+0000 7ff40ace4700 1 -- 172.21.15.50:0/939866250 wait complete. 2023-01-04T18:20:02.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.236+0000 7ff40ace4700 1 Processor -- start 2023-01-04T18:20:02.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.236+0000 7ff40ace4700 1 -- start start 2023-01-04T18:20:02.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.236+0000 7ff40ace4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4040f5430 0x7ff4041098c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.236+0000 7ff40ace4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4040f66d0 0x7ff40410bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.236+0000 7ff40ace4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4040603e0 con 0x7ff4040f5430 2023-01-04T18:20:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.236+0000 7ff40ace4700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff404060520 con 0x7ff4040f66d0 2023-01-04T18:20:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.237+0000 7ff409ce2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4040f5430 0x7ff4041098c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.237+0000 7ff409ce2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4040f5430 0x7ff4041098c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58108/0 (socket says 172.21.15.50:58108) 2023-01-04T18:20:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.237+0000 7ff409ce2700 1 -- 172.21.15.50:0/1875743295 learned_addr learned my addr 172.21.15.50:0/1875743295 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:20:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.237+0000 7ff4094e1700 1 --2- 172.21.15.50:0/1875743295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4040f66d0 0x7ff40410bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.237+0000 7ff409ce2700 1 -- 172.21.15.50:0/1875743295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4040f66d0 msgr2=0x7ff40410bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.237+0000 7ff409ce2700 1 --2- 172.21.15.50:0/1875743295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4040f66d0 0x7ff40410bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.237+0000 7ff409ce2700 1 -- 172.21.15.50:0/1875743295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff400005040 con 0x7ff4040f5430 2023-01-04T18:20:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.237+0000 7ff409ce2700 1 --2- 172.21.15.50:0/1875743295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4040f5430 0x7ff4041098c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ff4000139e0 tx=0x7ff40000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:02.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.237+0000 7ff3fa7fc700 1 -- 172.21.15.50:0/1875743295 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff400019070 con 0x7ff4040f5430 2023-01-04T18:20:02.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.237+0000 7ff3fa7fc700 1 -- 172.21.15.50:0/1875743295 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff400013ab0 con 0x7ff4040f5430 2023-01-04T18:20:02.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.237+0000 7ff40ace4700 1 -- 172.21.15.50:0/1875743295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40410c310 con 0x7ff4040f5430 2023-01-04T18:20:02.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.237+0000 7ff3fa7fc700 1 -- 172.21.15.50:0/1875743295 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff400014420 con 0x7ff4040f5430 2023-01-04T18:20:02.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.237+0000 7ff40ace4700 1 -- 172.21.15.50:0/1875743295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40410c7f0 con 0x7ff4040f5430 2023-01-04T18:20:02.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.238+0000 7ff40ace4700 1 -- 172.21.15.50:0/1875743295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff404045ad0 con 0x7ff4040f5430 2023-01-04T18:20:02.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.239+0000 7ff3fa7fc700 1 -- 172.21.15.50:0/1875743295 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7ff40001e420 con 0x7ff4040f5430 2023-01-04T18:20:02.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.239+0000 7ff3fa7fc700 1 --2- 172.21.15.50:0/1875743295 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff3f0060c30 0x7ff3f00630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:02.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.239+0000 7ff3fa7fc700 1 -- 172.21.15.50:0/1875743295 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5841+0+0 (secure 0 0 0) 0x7ff40007d4a0 con 0x7ff4040f5430 2023-01-04T18:20:02.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.239+0000 7ff4094e1700 1 --2- 172.21.15.50:0/1875743295 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff3f0060c30 0x7ff3f00630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:02.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.240+0000 7ff4094e1700 1 --2- 172.21.15.50:0/1875743295 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff3f0060c30 0x7ff3f00630f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7ff3f4009fd0 tx=0x7ff3f400b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:02.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.243+0000 7ff3fa7fc700 1 -- 172.21.15.50:0/1875743295 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7ff40004daa0 con 0x7ff4040f5430 2023-01-04T18:20:02.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.427+0000 7ff40ace4700 1 -- 172.21.15.50:0/1875743295 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4040fdd30 con 0x7ff3f0060c30 2023-01-04T18:20:02.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.437+0000 7ff3fa7fc700 1 -- 172.21.15.50:0/1875743295 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7ff4040fdd30 con 0x7ff3f0060c30 2023-01-04T18:20:02.439 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-01-04T18:20:02.439 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager.smithi050 smithi050 *:9093,9094 running (8m) 67s ago 9m 22.4M - 0.20.0 0881eb8f169f b5d3e2678a23 2023-01-04T18:20:02.439 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi050 smithi050 running (109s) 67s ago 9m 7050k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cfe28e5ab81e 2023-01-04T18:20:02.439 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi098 smithi098 running (100s) 95s ago 9m 7042k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cf5f0ca60522 2023-01-04T18:20:02.440 INFO:teuthology.orchestra.run.smithi050.stdout:grafana.smithi050 smithi050 *:3000 running (8m) 67s ago 9m 37.2M - 6.7.4 557c83e11646 7e5dccbafe78 2023-01-04T18:20:02.440 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.ezoiwl smithi050 running (5m) 67s ago 5m 9.91G - 16.2.4 8d91d370c2b8 6c5c5f2be8b9 2023-01-04T18:20:02.440 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.kefmuy smithi050 running (5m) 67s ago 5m 18.0M - 16.2.4 8d91d370c2b8 58cace913b55 2023-01-04T18:20:02.440 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.laynsk smithi098 running (5m) 95s ago 5m 15.7M - 16.2.4 8d91d370c2b8 8ff8af70b989 2023-01-04T18:20:02.440 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.memais smithi098 running (5m) 95s ago 5m 1070M - 16.2.4 8d91d370c2b8 d59d9b4dbf7d 2023-01-04T18:20:02.440 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi050.emnywo smithi050 *:8443,9283 running (2m) 67s ago 10m 440M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d ee677216e754 2023-01-04T18:20:02.440 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi098.vhfzum smithi098 *:8443,9283 running (2m) 95s ago 8m 394M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d f3d98bf0cf66 2023-01-04T18:20:02.440 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi050 smithi050 running (2m) 67s ago 10m 74.3M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 0423819cbaa7 2023-01-04T18:20:02.440 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi098 smithi098 running (2m) 95s ago 8m 39.4M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 12094818aefc 2023-01-04T18:20:02.440 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi050 smithi050 *:9100 running (9m) 67s ago 9m 18.3M - 0.18.1 e5a616e4b9cf 88892b2e5e5a 2023-01-04T18:20:02.441 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi098 smithi098 *:9100 running (8m) 95s ago 8m 18.4M - 0.18.1 e5a616e4b9cf 49bcde8331b6 2023-01-04T18:20:02.441 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (76s) 67s ago 8m 13.9M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 60dafedcb429 2023-01-04T18:20:02.441 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi050 running (7m) 67s ago 7m 1098M 4096M 16.2.4 8d91d370c2b8 e4928bcfd146 2023-01-04T18:20:02.441 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi050 running (7m) 67s ago 7m 915M 4096M 16.2.4 8d91d370c2b8 babab394b338 2023-01-04T18:20:02.441 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi098 running (7m) 95s ago 7m 1186M 4096M 16.2.4 8d91d370c2b8 b02df8e3cb23 2023-01-04T18:20:02.441 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi098 running (7m) 95s ago 7m 876M 4096M 16.2.4 8d91d370c2b8 92273135ca82 2023-01-04T18:20:02.441 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi098 running (6m) 95s ago 6m 971M 4096M 16.2.4 8d91d370c2b8 366d0bfff809 2023-01-04T18:20:02.441 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus.smithi050 smithi050 *:9095 running (3m) 67s ago 9m 55.3M - 2.18.1 de242295e225 7bdcf7a45d34 2023-01-04T18:20:02.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.439+0000 7ff40ace4700 1 -- 172.21.15.50:0/1875743295 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff3f0060c30 msgr2=0x7ff3f00630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:02.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.439+0000 7ff40ace4700 1 --2- 172.21.15.50:0/1875743295 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff3f0060c30 0x7ff3f00630f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7ff3f4009fd0 tx=0x7ff3f400b040).stop 2023-01-04T18:20:02.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.439+0000 7ff40ace4700 1 -- 172.21.15.50:0/1875743295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4040f5430 msgr2=0x7ff4041098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:02.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.439+0000 7ff40ace4700 1 --2- 172.21.15.50:0/1875743295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4040f5430 0x7ff4041098c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ff4000139e0 tx=0x7ff40000b040).stop 2023-01-04T18:20:02.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.439+0000 7ff40ace4700 1 -- 172.21.15.50:0/1875743295 shutdown_connections 2023-01-04T18:20:02.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.439+0000 7ff40ace4700 1 --2- 172.21.15.50:0/1875743295 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff3f0060c30 0x7ff3f00630f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:02.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.439+0000 7ff40ace4700 1 --2- 172.21.15.50:0/1875743295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4040f5430 0x7ff4041098c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:02.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.439+0000 7ff40ace4700 1 --2- 172.21.15.50:0/1875743295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4040f66d0 0x7ff40410bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:02.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.439+0000 7ff40ace4700 1 -- 172.21.15.50:0/1875743295 >> 172.21.15.50:0/1875743295 conn(0x7ff4040f0b90 msgr2=0x7ff4040fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:02.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.439+0000 7ff40ace4700 1 -- 172.21.15.50:0/1875743295 shutdown_connections 2023-01-04T18:20:02.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.439+0000 7ff40ace4700 1 -- 172.21.15.50:0/1875743295 wait complete. 2023-01-04T18:20:02.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.539+0000 7f17ed783700 1 -- 172.21.15.50:0/1384073170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17e80f5bb0 msgr2=0x7f17e80f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:02.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.539+0000 7f17ed783700 1 --2- 172.21.15.50:0/1384073170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17e80f5bb0 0x7f17e80f5fd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f17d8004660 tx=0x7f17d8009b30).stop 2023-01-04T18:20:02.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.539+0000 7f17ed783700 1 -- 172.21.15.50:0/1384073170 shutdown_connections 2023-01-04T18:20:02.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.539+0000 7f17ed783700 1 --2- 172.21.15.50:0/1384073170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17e80f64c0 0x7f17e80f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:02.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.539+0000 7f17ed783700 1 --2- 172.21.15.50:0/1384073170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17e80f5bb0 0x7f17e80f5fd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:02.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.539+0000 7f17ed783700 1 -- 172.21.15.50:0/1384073170 >> 172.21.15.50:0/1384073170 conn(0x7f17e80f0540 msgr2=0x7f17e80f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:02.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.539+0000 7f17ed783700 1 -- 172.21.15.50:0/1384073170 shutdown_connections 2023-01-04T18:20:02.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.539+0000 7f17ed783700 1 -- 172.21.15.50:0/1384073170 wait complete. 2023-01-04T18:20:02.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.540+0000 7f17ed783700 1 Processor -- start 2023-01-04T18:20:02.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.540+0000 7f17ed783700 1 -- start start 2023-01-04T18:20:02.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.540+0000 7f17ed783700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17e80f5bb0 0x7f17e8109c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:02.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.540+0000 7f17ed783700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17e80f64c0 0x7f17e810c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:02.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.540+0000 7f17ed783700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e80f56a0 con 0x7f17e80f64c0 2023-01-04T18:20:02.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.540+0000 7f17ed783700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e80f57e0 con 0x7f17e80f5bb0 2023-01-04T18:20:02.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.540+0000 7f17e67fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17e80f64c0 0x7f17e810c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:02.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.540+0000 7f17e67fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17e80f64c0 0x7f17e810c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58112/0 (socket says 172.21.15.50:58112) 2023-01-04T18:20:02.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.540+0000 7f17e67fc700 1 -- 172.21.15.50:0/7081927 learned_addr learned my addr 172.21.15.50:0/7081927 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:20:02.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.540+0000 7f17e6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17e80f5bb0 0x7f17e8109c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:02.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.541+0000 7f17e67fc700 1 -- 172.21.15.50:0/7081927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17e80f5bb0 msgr2=0x7f17e8109c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:02.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.541+0000 7f17e67fc700 1 --2- 172.21.15.50:0/7081927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17e80f5bb0 0x7f17e8109c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:02.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.541+0000 7f17e67fc700 1 -- 172.21.15.50:0/7081927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d8005040 con 0x7f17e80f64c0 2023-01-04T18:20:02.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.541+0000 7f17e6ffd700 1 --2- 172.21.15.50:0/7081927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17e80f5bb0 0x7f17e8109c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-01-04T18:20:02.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.541+0000 7f17e67fc700 1 --2- 172.21.15.50:0/7081927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17e80f64c0 0x7f17e810c120 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f17d000e7f0 tx=0x7f17d000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:02.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.541+0000 7f17df7fe700 1 -- 172.21.15.50:0/7081927 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17d00092e0 con 0x7f17e80f64c0 2023-01-04T18:20:02.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.541+0000 7f17df7fe700 1 -- 172.21.15.50:0/7081927 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f17d000f040 con 0x7f17e80f64c0 2023-01-04T18:20:02.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.541+0000 7f17ed783700 1 -- 172.21.15.50:0/7081927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e810c6d0 con 0x7f17e80f64c0 2023-01-04T18:20:02.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.541+0000 7f17df7fe700 1 -- 172.21.15.50:0/7081927 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17d00147e0 con 0x7f17e80f64c0 2023-01-04T18:20:02.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.541+0000 7f17ed783700 1 -- 172.21.15.50:0/7081927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e810cc10 con 0x7f17e80f64c0 2023-01-04T18:20:02.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.542+0000 7f17ed783700 1 -- 172.21.15.50:0/7081927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e8045ad0 con 0x7f17e80f64c0 2023-01-04T18:20:02.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.542+0000 7f17df7fe700 1 -- 172.21.15.50:0/7081927 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f17d001b030 con 0x7f17e80f64c0 2023-01-04T18:20:02.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.543+0000 7f17df7fe700 1 --2- 172.21.15.50:0/7081927 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f17d4060be0 0x7f17d40630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:02.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.543+0000 7f17df7fe700 1 -- 172.21.15.50:0/7081927 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f17d007bae0 con 0x7f17e80f64c0 2023-01-04T18:20:02.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.543+0000 7f17e6ffd700 1 --2- 172.21.15.50:0/7081927 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f17d4060be0 0x7f17d40630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:02.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.543+0000 7f17e6ffd700 1 --2- 172.21.15.50:0/7081927 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f17d4060be0 0x7f17d40630a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f17d8004d80 tx=0x7f17d8016040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:02.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.547+0000 7f17df7fe700 1 -- 172.21.15.50:0/7081927 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f17d004c190 con 0x7f17e80f64c0 2023-01-04T18:20:02.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.788+0000 7f17ed783700 1 -- 172.21.15.50:0/7081927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f17e8027a00 con 0x7f17e80f64c0 2023-01-04T18:20:02.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.789+0000 7f17df7fe700 1 -- 172.21.15.50:0/7081927 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+824 (secure 0 0 0) 0x7f17d0019020 con 0x7f17e80f64c0 2023-01-04T18:20:02.791 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:20:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": { 2023-01-04T18:20:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:20:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:20:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": { 2023-01-04T18:20:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:20:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:20:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": { 2023-01-04T18:20:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 1, 2023-01-04T18:20:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2023-01-04T18:20:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:20:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2023-01-04T18:20:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-01-04T18:20:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:20:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: "overall": { 2023-01-04T18:20:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 5, 2023-01-04T18:20:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9 2023-01-04T18:20:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-01-04T18:20:02.793 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:20:02.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.791+0000 7f17ed783700 1 -- 172.21.15.50:0/7081927 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f17d4060be0 msgr2=0x7f17d40630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:02.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.791+0000 7f17ed783700 1 --2- 172.21.15.50:0/7081927 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f17d4060be0 0x7f17d40630a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f17d8004d80 tx=0x7f17d8016040).stop 2023-01-04T18:20:02.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.791+0000 7f17ed783700 1 -- 172.21.15.50:0/7081927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17e80f64c0 msgr2=0x7f17e810c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:02.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.791+0000 7f17ed783700 1 --2- 172.21.15.50:0/7081927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17e80f64c0 0x7f17e810c120 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f17d000e7f0 tx=0x7f17d000b040).stop 2023-01-04T18:20:02.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.791+0000 7f17ed783700 1 -- 172.21.15.50:0/7081927 shutdown_connections 2023-01-04T18:20:02.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.791+0000 7f17ed783700 1 --2- 172.21.15.50:0/7081927 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f17d4060be0 0x7f17d40630a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:02.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.791+0000 7f17ed783700 1 --2- 172.21.15.50:0/7081927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17e80f5bb0 0x7f17e8109c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:02.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.791+0000 7f17ed783700 1 --2- 172.21.15.50:0/7081927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17e80f64c0 0x7f17e810c120 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:02.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.791+0000 7f17ed783700 1 -- 172.21.15.50:0/7081927 >> 172.21.15.50:0/7081927 conn(0x7f17e80f0540 msgr2=0x7f17e80fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:02.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.791+0000 7f17ed783700 1 -- 172.21.15.50:0/7081927 shutdown_connections 2023-01-04T18:20:02.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.791+0000 7f17ed783700 1 -- 172.21.15.50:0/7081927 wait complete. 2023-01-04T18:20:02.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.896+0000 7f11207a9700 1 -- 172.21.15.50:0/2286875080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11180f7980 msgr2=0x7f11180f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:02.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.896+0000 7f11207a9700 1 --2- 172.21.15.50:0/2286875080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11180f7980 0x7f11180f7de0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f1114004660 tx=0x7f1114009b30).stop 2023-01-04T18:20:02.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.896+0000 7f11207a9700 1 -- 172.21.15.50:0/2286875080 shutdown_connections 2023-01-04T18:20:02.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.896+0000 7f11207a9700 1 --2- 172.21.15.50:0/2286875080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11180f7980 0x7f11180f7de0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:02.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.896+0000 7f11207a9700 1 --2- 172.21.15.50:0/2286875080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11180f66e0 0x7f11180f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:02.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.896+0000 7f11207a9700 1 -- 172.21.15.50:0/2286875080 >> 172.21.15.50:0/2286875080 conn(0x7f11180f1e40 msgr2=0x7f11180f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:02.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.896+0000 7f11207a9700 1 -- 172.21.15.50:0/2286875080 shutdown_connections 2023-01-04T18:20:02.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.896+0000 7f11207a9700 1 -- 172.21.15.50:0/2286875080 wait complete. 2023-01-04T18:20:02.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.896+0000 7f11207a9700 1 Processor -- start 2023-01-04T18:20:02.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.896+0000 7f11207a9700 1 -- start start 2023-01-04T18:20:02.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.896+0000 7f11207a9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11180f66e0 0x7f1118106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:02.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.896+0000 7f11207a9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11180f7980 0x7f1118107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:02.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.896+0000 7f11207a9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11181079d0 con 0x7f11180f66e0 2023-01-04T18:20:02.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.896+0000 7f11207a9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1118107b10 con 0x7f11180f7980 2023-01-04T18:20:02.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.897+0000 7f111e545700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11180f66e0 0x7f1118106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:02.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.897+0000 7f111e545700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11180f66e0 0x7f1118106f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58136/0 (socket says 172.21.15.50:58136) 2023-01-04T18:20:02.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.897+0000 7f111e545700 1 -- 172.21.15.50:0/300132206 learned_addr learned my addr 172.21.15.50:0/300132206 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:20:02.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.897+0000 7f111dd44700 1 --2- 172.21.15.50:0/300132206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11180f7980 0x7f1118107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:02.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.897+0000 7f111e545700 1 -- 172.21.15.50:0/300132206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11180f7980 msgr2=0x7f1118107420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:02.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.897+0000 7f111e545700 1 --2- 172.21.15.50:0/300132206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11180f7980 0x7f1118107420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:02.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.897+0000 7f111e545700 1 -- 172.21.15.50:0/300132206 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1114005040 con 0x7f11180f66e0 2023-01-04T18:20:02.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.897+0000 7f111e545700 1 --2- 172.21.15.50:0/300132206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11180f66e0 0x7f1118106f30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f110800e7c0 tx=0x7f110800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:02.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.897+0000 7f110effd700 1 -- 172.21.15.50:0/300132206 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11080092e0 con 0x7f11180f66e0 2023-01-04T18:20:02.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.897+0000 7f11207a9700 1 -- 172.21.15.50:0/300132206 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11181084b0 con 0x7f11180f66e0 2023-01-04T18:20:02.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.897+0000 7f110effd700 1 -- 172.21.15.50:0/300132206 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f110800f040 con 0x7f11180f66e0 2023-01-04T18:20:02.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.897+0000 7f110effd700 1 -- 172.21.15.50:0/300132206 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1108014810 con 0x7f11180f66e0 2023-01-04T18:20:02.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.897+0000 7f11207a9700 1 -- 172.21.15.50:0/300132206 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11181089f0 con 0x7f11180f66e0 2023-01-04T18:20:02.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.898+0000 7f11207a9700 1 -- 172.21.15.50:0/300132206 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1118045ad0 con 0x7f11180f66e0 2023-01-04T18:20:02.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.899+0000 7f110effd700 1 -- 172.21.15.50:0/300132206 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f110801b030 con 0x7f11180f66e0 2023-01-04T18:20:02.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.899+0000 7f110effd700 1 --2- 172.21.15.50:0/300132206 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1104060be0 0x7f11040630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:02.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.899+0000 7f110effd700 1 -- 172.21.15.50:0/300132206 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f110807bc90 con 0x7f11180f66e0 2023-01-04T18:20:02.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.899+0000 7f111dd44700 1 --2- 172.21.15.50:0/300132206 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1104060be0 0x7f11040630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:02.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.900+0000 7f111dd44700 1 --2- 172.21.15.50:0/300132206 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1104060be0 0x7f11040630a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f1114009720 tx=0x7f1114016040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:02.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:02.903+0000 7f110effd700 1 -- 172.21.15.50:0/300132206 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f110804fcc0 con 0x7f11180f66e0 2023-01-04T18:20:03.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.123+0000 7f11207a9700 1 -- 172.21.15.50:0/300132206 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f11180fef40 con 0x7f11180f66e0 2023-01-04T18:20:03.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.124+0000 7f110effd700 1 -- 172.21.15.50:0/300132206 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1793 (secure 0 0 0) 0x7f1108019030 con 0x7f11180f66e0 2023-01-04T18:20:03.126 INFO:teuthology.orchestra.run.smithi050.stdout:e13 2023-01-04T18:20:03.126 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:20:03.126 INFO:teuthology.orchestra.run.smithi050.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:20:03.127 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-01-04T18:20:03.127 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:20:03.127 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-01-04T18:20:03.127 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-01-04T18:20:03.127 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 10 2023-01-04T18:20:03.127 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 2023-01-04T18:20:03.127 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:20:03.127 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-01-04T18:14:43.958806+0000 2023-01-04T18:20:03.127 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-01-04T18:20:03.127 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-01-04T18:20:03.127 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 60 2023-01-04T18:20:03.127 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-01-04T18:20:03.128 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-01-04T18:20:03.128 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-01-04T18:20:03.128 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-01-04T18:20:03.128 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 0 2023-01-04T18:20:03.128 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:20:03.128 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 1 2023-01-04T18:20:03.128 INFO:teuthology.orchestra.run.smithi050.stdout:in 0 2023-01-04T18:20:03.128 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=14430} 2023-01-04T18:20:03.128 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-01-04T18:20:03.128 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-01-04T18:20:03.128 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-01-04T18:20:03.128 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-01-04T18:20:03.129 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-01-04T18:20:03.129 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data enabled 2023-01-04T18:20:03.129 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-01-04T18:20:03.129 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 1 2023-01-04T18:20:03.129 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.ezoiwl{0:14430} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:20:03.129 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.memais{0:24291} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.98:6824/1196398070,v1:172.21.15.98:6825/1196398070] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:20:03.129 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:20:03.129 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:20:03.129 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2023-01-04T18:20:03.129 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:20:03.129 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.kefmuy{-1:14440} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:20:03.129 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.laynsk{-1:24297} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:20:03.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.126+0000 7f11207a9700 1 -- 172.21.15.50:0/300132206 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1104060be0 msgr2=0x7f11040630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:03.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.126+0000 7f11207a9700 1 --2- 172.21.15.50:0/300132206 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1104060be0 0x7f11040630a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f1114009720 tx=0x7f1114016040).stop 2023-01-04T18:20:03.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.126+0000 7f11207a9700 1 -- 172.21.15.50:0/300132206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11180f66e0 msgr2=0x7f1118106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:03.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.126+0000 7f11207a9700 1 --2- 172.21.15.50:0/300132206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11180f66e0 0x7f1118106f30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f110800e7c0 tx=0x7f110800b040).stop 2023-01-04T18:20:03.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.126+0000 7f11207a9700 1 -- 172.21.15.50:0/300132206 shutdown_connections 2023-01-04T18:20:03.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.126+0000 7f11207a9700 1 --2- 172.21.15.50:0/300132206 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1104060be0 0x7f11040630a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:03.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.126+0000 7f11207a9700 1 --2- 172.21.15.50:0/300132206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11180f66e0 0x7f1118106f30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:03.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.126+0000 7f11207a9700 1 --2- 172.21.15.50:0/300132206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11180f7980 0x7f1118107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:03.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.126+0000 7f11207a9700 1 -- 172.21.15.50:0/300132206 >> 172.21.15.50:0/300132206 conn(0x7f11180f1e40 msgr2=0x7f11180fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:03.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.126+0000 7f11207a9700 1 -- 172.21.15.50:0/300132206 shutdown_connections 2023-01-04T18:20:03.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.126+0000 7f11207a9700 1 -- 172.21.15.50:0/300132206 wait complete. 2023-01-04T18:20:03.131 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2023-01-04T18:20:03.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.228+0000 7f7b4de93700 1 -- 172.21.15.50:0/1250978215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b480f55c0 msgr2=0x7f7b480f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:03.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.228+0000 7f7b4de93700 1 --2- 172.21.15.50:0/1250978215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b480f55c0 0x7f7b480f59e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f7b38004660 tx=0x7f7b38009b30).stop 2023-01-04T18:20:03.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.228+0000 7f7b4de93700 1 -- 172.21.15.50:0/1250978215 shutdown_connections 2023-01-04T18:20:03.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.228+0000 7f7b4de93700 1 --2- 172.21.15.50:0/1250978215 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b480f6860 0x7f7b480f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:03.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.228+0000 7f7b4de93700 1 --2- 172.21.15.50:0/1250978215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b480f55c0 0x7f7b480f59e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:03.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.228+0000 7f7b4de93700 1 -- 172.21.15.50:0/1250978215 >> 172.21.15.50:0/1250978215 conn(0x7f7b480f0d40 msgr2=0x7f7b480f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:03.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.228+0000 7f7b4de93700 1 -- 172.21.15.50:0/1250978215 shutdown_connections 2023-01-04T18:20:03.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.228+0000 7f7b4de93700 1 -- 172.21.15.50:0/1250978215 wait complete. 2023-01-04T18:20:03.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.229+0000 7f7b4de93700 1 Processor -- start 2023-01-04T18:20:03.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.229+0000 7f7b4de93700 1 -- start start 2023-01-04T18:20:03.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.229+0000 7f7b4de93700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b480f55c0 0x7f7b48109bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:03.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.229+0000 7f7b4de93700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b480f6860 0x7f7b4810c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:03.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.229+0000 7f7b4de93700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b48060420 con 0x7f7b480f55c0 2023-01-04T18:20:03.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.229+0000 7f7b4de93700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b48060560 con 0x7f7b480f6860 2023-01-04T18:20:03.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.229+0000 7f7b477fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b480f55c0 0x7f7b48109bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:03.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.230+0000 7f7b477fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b480f55c0 0x7f7b48109bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58150/0 (socket says 172.21.15.50:58150) 2023-01-04T18:20:03.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.230+0000 7f7b477fe700 1 -- 172.21.15.50:0/1964529422 learned_addr learned my addr 172.21.15.50:0/1964529422 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:20:03.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.230+0000 7f7b46ffd700 1 --2- 172.21.15.50:0/1964529422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b480f6860 0x7f7b4810c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:03.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.230+0000 7f7b477fe700 1 -- 172.21.15.50:0/1964529422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b480f6860 msgr2=0x7f7b4810c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:03.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.230+0000 7f7b477fe700 1 --2- 172.21.15.50:0/1964529422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b480f6860 0x7f7b4810c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:03.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.230+0000 7f7b477fe700 1 -- 172.21.15.50:0/1964529422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c005040 con 0x7f7b480f55c0 2023-01-04T18:20:03.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.230+0000 7f7b477fe700 1 --2- 172.21.15.50:0/1964529422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b480f55c0 0x7f7b48109bd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f7b38014040 tx=0x7f7b3800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:03.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.230+0000 7f7b2ffff700 1 -- 172.21.15.50:0/1964529422 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b38019070 con 0x7f7b480f55c0 2023-01-04T18:20:03.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.230+0000 7f7b2ffff700 1 -- 172.21.15.50:0/1964529422 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7b3801e420 con 0x7f7b480f55c0 2023-01-04T18:20:03.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.230+0000 7f7b4de93700 1 -- 172.21.15.50:0/1964529422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b38005040 con 0x7f7b480f55c0 2023-01-04T18:20:03.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.230+0000 7f7b2ffff700 1 -- 172.21.15.50:0/1964529422 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b38014620 con 0x7f7b480f55c0 2023-01-04T18:20:03.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.230+0000 7f7b4de93700 1 -- 172.21.15.50:0/1964529422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4810c9a0 con 0x7f7b480f55c0 2023-01-04T18:20:03.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.231+0000 7f7b4de93700 1 -- 172.21.15.50:0/1964529422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b480f49b0 con 0x7f7b480f55c0 2023-01-04T18:20:03.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.231+0000 7f7b2ffff700 1 -- 172.21.15.50:0/1964529422 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f7b38014780 con 0x7f7b480f55c0 2023-01-04T18:20:03.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.232+0000 7f7b2ffff700 1 --2- 172.21.15.50:0/1964529422 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7b30060be0 0x7f7b300630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:03.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.232+0000 7f7b2ffff700 1 -- 172.21.15.50:0/1964529422 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f7b3807d110 con 0x7f7b480f55c0 2023-01-04T18:20:03.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.232+0000 7f7b46ffd700 1 --2- 172.21.15.50:0/1964529422 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7b30060be0 0x7f7b300630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:03.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.232+0000 7f7b46ffd700 1 --2- 172.21.15.50:0/1964529422 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7b30060be0 0x7f7b300630a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7b3c009050 tx=0x7f7b3c00b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:03.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.237+0000 7f7b2ffff700 1 -- 172.21.15.50:0/1964529422 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f7b3804d8e0 con 0x7f7b480f55c0 2023-01-04T18:20:03.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.425+0000 7f7b4de93700 1 -- 172.21.15.50:0/1964529422 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b480fde30 con 0x7f7b30060be0 2023-01-04T18:20:03.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.426+0000 7f7b2ffff700 1 -- 172.21.15.50:0/1964529422 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7b480fde30 con 0x7f7b30060be0 2023-01-04T18:20:03.428 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:20:03.428 INFO:teuthology.orchestra.run.smithi050.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308", 2023-01-04T18:20:03.428 INFO:teuthology.orchestra.run.smithi050.stdout: "in_progress": true, 2023-01-04T18:20:03.428 INFO:teuthology.orchestra.run.smithi050.stdout: "which": "Upgrading all daemon types on all hosts", 2023-01-04T18:20:03.429 INFO:teuthology.orchestra.run.smithi050.stdout: "services_complete": [ 2023-01-04T18:20:03.429 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2023-01-04T18:20:03.429 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr", 2023-01-04T18:20:03.429 INFO:teuthology.orchestra.run.smithi050.stdout: "mon" 2023-01-04T18:20:03.429 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-01-04T18:20:03.429 INFO:teuthology.orchestra.run.smithi050.stdout: "progress": "7/21 daemons upgraded", 2023-01-04T18:20:03.429 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "Currently upgrading osd daemons", 2023-01-04T18:20:03.429 INFO:teuthology.orchestra.run.smithi050.stdout: "is_paused": false 2023-01-04T18:20:03.429 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:20:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.428+0000 7f7b4de93700 1 -- 172.21.15.50:0/1964529422 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7b30060be0 msgr2=0x7f7b300630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.428+0000 7f7b4de93700 1 --2- 172.21.15.50:0/1964529422 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7b30060be0 0x7f7b300630a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7b3c009050 tx=0x7f7b3c00b040).stop 2023-01-04T18:20:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.428+0000 7f7b4de93700 1 -- 172.21.15.50:0/1964529422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b480f55c0 msgr2=0x7f7b48109bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.428+0000 7f7b4de93700 1 --2- 172.21.15.50:0/1964529422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b480f55c0 0x7f7b48109bd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f7b38014040 tx=0x7f7b3800b040).stop 2023-01-04T18:20:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.428+0000 7f7b4de93700 1 -- 172.21.15.50:0/1964529422 shutdown_connections 2023-01-04T18:20:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.428+0000 7f7b4de93700 1 --2- 172.21.15.50:0/1964529422 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7b30060be0 0x7f7b300630a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:03.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.428+0000 7f7b4de93700 1 --2- 172.21.15.50:0/1964529422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b480f55c0 0x7f7b48109bd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:03.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.428+0000 7f7b4de93700 1 --2- 172.21.15.50:0/1964529422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b480f6860 0x7f7b4810c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:03.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.428+0000 7f7b4de93700 1 -- 172.21.15.50:0/1964529422 >> 172.21.15.50:0/1964529422 conn(0x7f7b480f0d40 msgr2=0x7f7b480fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:03.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.428+0000 7f7b4de93700 1 -- 172.21.15.50:0/1964529422 shutdown_connections 2023-01-04T18:20:03.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:03.428+0000 7f7b4de93700 1 -- 172.21.15.50:0/1964529422 wait complete. 2023-01-04T18:20:03.537 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:01.829670+0000 mgr.smithi050.emnywo (mgr.24517) 131 : audit [DBG] from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:20:03.537 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:02.131866+0000 mgr.smithi050.emnywo (mgr.24517) 132 : audit [DBG] from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:20:03.538 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:02.428663+0000 mgr.smithi050.emnywo (mgr.24517) 133 : audit [DBG] from='client.34204 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:20:03.538 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:02.789461+0000 mon.smithi050 (mon.0) 180 : audit [DBG] from='client.? 172.21.15.50:0/7081927' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:20:03.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:01.829670+0000 mgr.smithi050.emnywo (mgr.24517) 131 : audit [DBG] from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:20:03.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:02.131866+0000 mgr.smithi050.emnywo (mgr.24517) 132 : audit [DBG] from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:20:03.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:02.428663+0000 mgr.smithi050.emnywo (mgr.24517) 133 : audit [DBG] from='client.34204 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:20:03.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:02.789461+0000 mon.smithi050 (mon.0) 180 : audit [DBG] from='client.? 172.21.15.50:0/7081927' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:20:04.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:02.633366+0000 mgr.smithi050.emnywo (mgr.24517) 134 : cluster [DBG] pgmap v102: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 63 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 102/210 objects degraded (48.571%); 0 B/s, 14 objects/s recovering 2023-01-04T18:20:04.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:03.124322+0000 mon.smithi050 (mon.0) 181 : audit [DBG] from='client.? 172.21.15.50:0/300132206' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:20:04.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:03.426062+0000 mgr.smithi050.emnywo (mgr.24517) 135 : audit [DBG] from='client.34216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:20:04.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:02.633366+0000 mgr.smithi050.emnywo (mgr.24517) 134 : cluster [DBG] pgmap v102: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 63 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 102/210 objects degraded (48.571%); 0 B/s, 14 objects/s recovering 2023-01-04T18:20:04.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:03.124322+0000 mon.smithi050 (mon.0) 181 : audit [DBG] from='client.? 172.21.15.50:0/300132206' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:20:04.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:03.426062+0000 mgr.smithi050.emnywo (mgr.24517) 135 : audit [DBG] from='client.34216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:20:05.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:04.117153+0000 mon.smithi050 (mon.0) 182 : cluster [DBG] osdmap e65: 6 total, 6 up, 6 in 2023-01-04T18:20:05.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:05 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:04.117153+0000 mon.smithi050 (mon.0) 182 : cluster [DBG] osdmap e65: 6 total, 6 up, 6 in 2023-01-04T18:20:06.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:04.633792+0000 mgr.smithi050.emnywo (mgr.24517) 136 : cluster [DBG] pgmap v104: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 63 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 669 B/s rd, 1 op/s; 102/210 objects degraded (48.571%); 0 B/s, 7 objects/s recovering 2023-01-04T18:20:06.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:05.122826+0000 mon.smithi050 (mon.0) 183 : cluster [DBG] osdmap e66: 6 total, 6 up, 6 in 2023-01-04T18:20:06.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:04.633792+0000 mgr.smithi050.emnywo (mgr.24517) 136 : cluster [DBG] pgmap v104: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering, 63 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 669 B/s rd, 1 op/s; 102/210 objects degraded (48.571%); 0 B/s, 7 objects/s recovering 2023-01-04T18:20:06.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:05.122826+0000 mon.smithi050 (mon.0) 183 : cluster [DBG] osdmap e66: 6 total, 6 up, 6 in 2023-01-04T18:20:07.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:07.105806+0000 mon.smithi050 (mon.0) 184 : cluster [WRN] Health check update: Degraded data redundancy: 102/210 objects degraded (48.571%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2023-01-04T18:20:07.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:07.105806+0000 mon.smithi050 (mon.0) 184 : cluster [WRN] Health check update: Degraded data redundancy: 102/210 objects degraded (48.571%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2023-01-04T18:20:08.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:06.634374+0000 mgr.smithi050.emnywo (mgr.24517) 137 : cluster [DBG] pgmap v106: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 24 objects/s recovering 2023-01-04T18:20:08.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:07.122367+0000 mon.smithi050 (mon.0) 185 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 102/210 objects degraded (48.571%), 1 pg degraded, 1 pg undersized) 2023-01-04T18:20:08.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:06.634374+0000 mgr.smithi050.emnywo (mgr.24517) 137 : cluster [DBG] pgmap v106: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 24 objects/s recovering 2023-01-04T18:20:08.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:07.122367+0000 mon.smithi050 (mon.0) 185 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 102/210 objects degraded (48.571%), 1 pg degraded, 1 pg undersized) 2023-01-04T18:20:10.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:08.634767+0000 mgr.smithi050.emnywo (mgr.24517) 138 : cluster [DBG] pgmap v107: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 23 objects/s recovering 2023-01-04T18:20:10.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:09.844773+0000 mon.smithi050 (mon.0) 186 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:10.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:08.634767+0000 mgr.smithi050.emnywo (mgr.24517) 138 : cluster [DBG] pgmap v107: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 23 objects/s recovering 2023-01-04T18:20:10.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:09.844773+0000 mon.smithi050 (mon.0) 186 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:11.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:11.006809+0000 mon.smithi050 (mon.0) 187 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:20:11.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:11.006809+0000 mon.smithi050 (mon.0) 187 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:20:12.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:10.635216+0000 mgr.smithi050.emnywo (mgr.24517) 139 : cluster [DBG] pgmap v108: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 0 B/s, 17 objects/s recovering 2023-01-04T18:20:12.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:11.007049+0000 mgr.smithi050.emnywo (mgr.24517) 140 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:20:12.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:20:11.008146+0000 mgr.smithi050.emnywo (mgr.24517) 141 : cephadm [INF] Upgrade: osd.1 is safe to restart 2023-01-04T18:20:12.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:10.635216+0000 mgr.smithi050.emnywo (mgr.24517) 139 : cluster [DBG] pgmap v108: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 0 B/s, 17 objects/s recovering 2023-01-04T18:20:12.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:11.007049+0000 mgr.smithi050.emnywo (mgr.24517) 140 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-01-04T18:20:12.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:20:11.008146+0000 mgr.smithi050.emnywo (mgr.24517) 141 : cephadm [INF] Upgrade: osd.1 is safe to restart 2023-01-04T18:20:13.398 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:20:12.307653+0000 mgr.smithi050.emnywo (mgr.24517) 142 : cephadm [INF] Upgrade: Updating osd.1 2023-01-04T18:20:13.398 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:12.311598+0000 mon.smithi050 (mon.0) 188 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:13.399 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:12.312345+0000 mon.smithi050 (mon.0) 189 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-01-04T18:20:13.399 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:12.312882+0000 mon.smithi050 (mon.0) 190 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:20:13.399 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:20:12.314110+0000 mgr.smithi050.emnywo (mgr.24517) 143 : cephadm [INF] Deploying daemon osd.1 on smithi050 2023-01-04T18:20:13.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:20:12.307653+0000 mgr.smithi050.emnywo (mgr.24517) 142 : cephadm [INF] Upgrade: Updating osd.1 2023-01-04T18:20:13.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:12.311598+0000 mon.smithi050 (mon.0) 188 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:13.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:12.312345+0000 mon.smithi050 (mon.0) 189 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-01-04T18:20:13.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:12.312882+0000 mon.smithi050 (mon.0) 190 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:20:13.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:20:12.314110+0000 mgr.smithi050.emnywo (mgr.24517) 143 : cephadm [INF] Deploying daemon osd.1 on smithi050 2023-01-04T18:20:14.499 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:12.635598+0000 mgr.smithi050.emnywo (mgr.24517) 144 : cluster [DBG] pgmap v109: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 16 objects/s recovering 2023-01-04T18:20:14.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:12.635598+0000 mgr.smithi050.emnywo (mgr.24517) 144 : cluster [DBG] pgmap v109: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 16 objects/s recovering 2023-01-04T18:20:14.782 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:14 smithi050 systemd[1]: Stopping Ceph osd.1 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:20:15.040 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.1[146792]: debug 2023-01-04T18:20:14.777+0000 7f7635a81700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-01-04T18:20:15.040 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.1[146792]: debug 2023-01-04T18:20:14.777+0000 7f7635a81700 -1 osd.1 66 *** Got signal Terminated *** 2023-01-04T18:20:15.040 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.1[146792]: debug 2023-01-04T18:20:14.777+0000 7f7635a81700 -1 osd.1 66 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-01-04T18:20:15.040 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:15 smithi050 bash[179010]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.1 2023-01-04T18:20:15.540 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:15 smithi050 bash[179054]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-1" found: no such container 2023-01-04T18:20:15.540 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:15 smithi050 bash[179067]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.1" found: no such container 2023-01-04T18:20:16.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:14.635897+0000 mgr.smithi050.emnywo (mgr.24517) 145 : cluster [DBG] pgmap v110: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 0 B/s, 13 objects/s recovering 2023-01-04T18:20:16.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:14.907737+0000 mon.smithi050 (mon.0) 191 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:16.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.037701+0000 mon.smithi050 (mon.0) 192 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-01-04T18:20:16.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.037732+0000 mon.smithi050 (mon.0) 193 : cluster [INF] osd.1 failed (root=default,host=smithi050) (connection refused reported by osd.2) 2023-01-04T18:20:16.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.037910+0000 mon.smithi050 (mon.0) 194 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-01-04T18:20:16.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.037957+0000 mon.smithi050 (mon.0) 195 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-01-04T18:20:16.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.038065+0000 mon.smithi050 (mon.0) 196 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-01-04T18:20:16.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.038153+0000 mon.smithi050 (mon.0) 197 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-01-04T18:20:16.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.038197+0000 mon.smithi050 (mon.0) 198 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-01-04T18:20:16.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.038293+0000 mon.smithi050 (mon.0) 199 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-01-04T18:20:16.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.038405+0000 mon.smithi050 (mon.0) 200 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-01-04T18:20:16.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.038470+0000 mon.smithi050 (mon.0) 201 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-01-04T18:20:16.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.038718+0000 mon.smithi050 (mon.0) 202 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-01-04T18:20:16.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.038821+0000 mon.smithi050 (mon.0) 203 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-01-04T18:20:16.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.110975+0000 mon.smithi050 (mon.0) 204 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-01-04T18:20:16.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.422769+0000 mon.smithi050 (mon.0) 205 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-01-04T18:20:16.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.438558+0000 mon.smithi050 (mon.0) 206 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-01-04T18:20:16.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.438668+0000 mon.smithi050 (mon.0) 207 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-01-04T18:20:16.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.438752+0000 mon.smithi050 (mon.0) 208 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-01-04T18:20:16.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.438834+0000 mon.smithi050 (mon.0) 209 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-01-04T18:20:16.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.438922+0000 mon.smithi050 (mon.0) 210 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-01-04T18:20:16.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.439003+0000 mon.smithi050 (mon.0) 211 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-01-04T18:20:16.293 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.439080+0000 mon.smithi050 (mon.0) 212 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-01-04T18:20:16.293 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.439158+0000 mon.smithi050 (mon.0) 213 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-01-04T18:20:16.293 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.439239+0000 mon.smithi050 (mon.0) 214 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-01-04T18:20:16.293 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.439331+0000 mon.smithi050 (mon.0) 215 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-01-04T18:20:16.293 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.439417+0000 mon.smithi050 (mon.0) 216 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-01-04T18:20:16.293 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.443265+0000 mon.smithi050 (mon.0) 217 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-01-04T18:20:16.293 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.623700+0000 mon.smithi050 (mon.0) 218 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-01-04T18:20:16.293 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.644440+0000 mon.smithi050 (mon.0) 219 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-01-04T18:20:16.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:14.635897+0000 mgr.smithi050.emnywo (mgr.24517) 145 : cluster [DBG] pgmap v110: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 0 B/s, 13 objects/s recovering 2023-01-04T18:20:16.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:14.907737+0000 mon.smithi050 (mon.0) 191 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:16.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.037701+0000 mon.smithi050 (mon.0) 192 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-01-04T18:20:16.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.037732+0000 mon.smithi050 (mon.0) 193 : cluster [INF] osd.1 failed (root=default,host=smithi050) (connection refused reported by osd.2) 2023-01-04T18:20:16.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.037910+0000 mon.smithi050 (mon.0) 194 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-01-04T18:20:16.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.037957+0000 mon.smithi050 (mon.0) 195 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-01-04T18:20:16.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.038065+0000 mon.smithi050 (mon.0) 196 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-01-04T18:20:16.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.038153+0000 mon.smithi050 (mon.0) 197 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-01-04T18:20:16.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.038197+0000 mon.smithi050 (mon.0) 198 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-01-04T18:20:16.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.038293+0000 mon.smithi050 (mon.0) 199 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-01-04T18:20:16.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.038405+0000 mon.smithi050 (mon.0) 200 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-01-04T18:20:16.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.038470+0000 mon.smithi050 (mon.0) 201 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-01-04T18:20:16.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.038718+0000 mon.smithi050 (mon.0) 202 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-01-04T18:20:16.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.038821+0000 mon.smithi050 (mon.0) 203 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-01-04T18:20:16.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.110975+0000 mon.smithi050 (mon.0) 204 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-01-04T18:20:16.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.422769+0000 mon.smithi050 (mon.0) 205 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-01-04T18:20:16.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.438558+0000 mon.smithi050 (mon.0) 206 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-01-04T18:20:16.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.438668+0000 mon.smithi050 (mon.0) 207 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-01-04T18:20:16.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.438752+0000 mon.smithi050 (mon.0) 208 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-01-04T18:20:16.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.438834+0000 mon.smithi050 (mon.0) 209 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-01-04T18:20:16.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.438922+0000 mon.smithi050 (mon.0) 210 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-01-04T18:20:16.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.439003+0000 mon.smithi050 (mon.0) 211 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-01-04T18:20:16.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.439080+0000 mon.smithi050 (mon.0) 212 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-01-04T18:20:16.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.439158+0000 mon.smithi050 (mon.0) 213 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-01-04T18:20:16.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.439239+0000 mon.smithi050 (mon.0) 214 : cluster [DBG] osd.1 reported immediately failed by osd.0 2023-01-04T18:20:16.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.439331+0000 mon.smithi050 (mon.0) 215 : cluster [DBG] osd.1 reported immediately failed by osd.5 2023-01-04T18:20:16.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.439417+0000 mon.smithi050 (mon.0) 216 : cluster [DBG] osd.1 reported immediately failed by osd.3 2023-01-04T18:20:16.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.443265+0000 mon.smithi050 (mon.0) 217 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-01-04T18:20:16.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.623700+0000 mon.smithi050 (mon.0) 218 : cluster [DBG] osd.1 reported immediately failed by osd.2 2023-01-04T18:20:16.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.644440+0000 mon.smithi050 (mon.0) 219 : cluster [DBG] osd.1 reported immediately failed by osd.4 2023-01-04T18:20:17.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.906789+0000 mon.smithi050 (mon.0) 220 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-01-04T18:20:17.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:15.913484+0000 mon.smithi050 (mon.0) 221 : cluster [DBG] osdmap e67: 6 total, 5 up, 6 in 2023-01-04T18:20:17.041 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:16 smithi050 systemd[1]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.1.service: Succeeded. 2023-01-04T18:20:17.041 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:16 smithi050 systemd[1]: Stopped Ceph osd.1 for d98671da-8c5a-11ed-821a-001a4aab830c. 2023-01-04T18:20:17.041 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:16 smithi050 systemd[1]: Starting Ceph osd.1 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:20:17.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.906789+0000 mon.smithi050 (mon.0) 220 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-01-04T18:20:17.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:15.913484+0000 mon.smithi050 (mon.0) 221 : cluster [DBG] osdmap e67: 6 total, 5 up, 6 in 2023-01-04T18:20:18.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:17 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:16.636288+0000 mgr.smithi050.emnywo (mgr.24517) 146 : cluster [DBG] pgmap v112: 65 pgs: 12 stale+active+clean, 53 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2023-01-04T18:20:18.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:17 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:16.916118+0000 mon.smithi050 (mon.0) 222 : cluster [DBG] osdmap e68: 6 total, 5 up, 6 in 2023-01-04T18:20:18.334 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:17 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:16.636288+0000 mgr.smithi050.emnywo (mgr.24517) 146 : cluster [DBG] pgmap v112: 65 pgs: 12 stale+active+clean, 53 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2023-01-04T18:20:18.334 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:17 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:16.916118+0000 mon.smithi050 (mon.0) 222 : cluster [DBG] osdmap e68: 6 total, 5 up, 6 in 2023-01-04T18:20:19.226 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:18.916237+0000 mon.smithi050 (mon.0) 223 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY) 2023-01-04T18:20:19.227 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:19 smithi050 bash[179289]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-01-04T18:20:19.227 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:19 smithi050 bash[179289]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-01-04T18:20:19.227 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:19 smithi050 bash[179289]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-01-04T18:20:19.227 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:19 smithi050 bash[179289]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-01-04T18:20:19.227 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:19 smithi050 bash[179289]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2023-01-04T18:20:19.227 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:19 smithi050 bash[179289]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-01-04T18:20:19.227 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:19 smithi050 bash[179289]: --> ceph-volume raw activate successful for osd ID: 1 2023-01-04T18:20:19.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:18.916237+0000 mon.smithi050 (mon.0) 223 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY) 2023-01-04T18:20:20.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:18.636626+0000 mgr.smithi050.emnywo (mgr.24517) 147 : cluster [DBG] pgmap v114: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2023-01-04T18:20:20.291 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:20 smithi050 podman[179746]: 2023-01-04T18:20:20.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:18.636626+0000 mgr.smithi050.emnywo (mgr.24517) 147 : cluster [DBG] pgmap v114: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2023-01-04T18:20:20.790 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-1[179762]: debug 2023-01-04T18:20:20.334+0000 7f2a1a035700 1 -- 172.21.15.50:0/3330148401 <== mon.0 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5640cdee44e0 con 0x5640cdeab400 2023-01-04T18:20:20.791 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:20 smithi050 bash[179746]: 625bd99952d9a29e48aef2d137171f92c8df82b066aa226fb46764d3b3fd0924 2023-01-04T18:20:20.791 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:20 smithi050 systemd[1]: Started Ceph osd.1 for d98671da-8c5a-11ed-821a-001a4aab830c. 2023-01-04T18:20:21.290 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-1[179762]: debug 2023-01-04T18:20:20.854+0000 7f2a21aab200 -1 Falling back to public interface 2023-01-04T18:20:21.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:20.386733+0000 mon.smithi050 (mon.0) 224 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:21.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:20.387488+0000 mon.smithi050 (mon.0) 225 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:20:21.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:20.388509+0000 mon.smithi050 (mon.0) 226 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:20:21.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:20.389072+0000 mon.smithi050 (mon.0) 227 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:20:21.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:20:20.389625+0000 mgr.smithi050.emnywo (mgr.24517) 148 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:20:21.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:20.386733+0000 mon.smithi050 (mon.0) 224 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:21.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:20.387488+0000 mon.smithi050 (mon.0) 225 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:20:21.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:20.388509+0000 mon.smithi050 (mon.0) 226 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:20:21.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:20.389072+0000 mon.smithi050 (mon.0) 227 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:20:21.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:20:20.389625+0000 mgr.smithi050.emnywo (mgr.24517) 148 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:20:22.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:20.637008+0000 mgr.smithi050.emnywo (mgr.24517) 149 : cluster [DBG] pgmap v115: 65 pgs: 2 active+undersized+degraded, 5 peering, 7 stale+active+clean, 6 active+undersized, 45 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 10/210 objects degraded (4.762%) 2023-01-04T18:20:22.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:21.385002+0000 mon.smithi050 (mon.0) 228 : cluster [WRN] Health check failed: Degraded data redundancy: 10/210 objects degraded (4.762%), 2 pgs degraded (PG_DEGRADED) 2023-01-04T18:20:22.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:20.637008+0000 mgr.smithi050.emnywo (mgr.24517) 149 : cluster [DBG] pgmap v115: 65 pgs: 2 active+undersized+degraded, 5 peering, 7 stale+active+clean, 6 active+undersized, 45 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 10/210 objects degraded (4.762%) 2023-01-04T18:20:22.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:21.385002+0000 mon.smithi050 (mon.0) 228 : cluster [WRN] Health check failed: Degraded data redundancy: 10/210 objects degraded (4.762%), 2 pgs degraded (PG_DEGRADED) 2023-01-04T18:20:23.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:23 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:23.391157+0000 mon.smithi050 (mon.0) 229 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 3 pgs peering) 2023-01-04T18:20:23.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:23.391157+0000 mon.smithi050 (mon.0) 229 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 3 pgs peering) 2023-01-04T18:20:24.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:22.637507+0000 mgr.smithi050.emnywo (mgr.24517) 150 : cluster [DBG] pgmap v116: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 29/210 objects degraded (13.810%) 2023-01-04T18:20:24.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:22.637507+0000 mgr.smithi050.emnywo (mgr.24517) 150 : cluster [DBG] pgmap v116: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 29/210 objects degraded (13.810%) 2023-01-04T18:20:26.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:24.637825+0000 mgr.smithi050.emnywo (mgr.24517) 151 : cluster [DBG] pgmap v117: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 469 B/s rd, 0 op/s; 29/210 objects degraded (13.810%) 2023-01-04T18:20:26.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:24.845180+0000 mon.smithi050 (mon.0) 230 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:26.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:24.876881+0000 mon.smithi050 (mon.0) 231 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:20:26.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:24.880913+0000 mon.smithi050 (mon.0) 232 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:20:26.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:24.637825+0000 mgr.smithi050.emnywo (mgr.24517) 151 : cluster [DBG] pgmap v117: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 469 B/s rd, 0 op/s; 29/210 objects degraded (13.810%) 2023-01-04T18:20:26.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:24.845180+0000 mon.smithi050 (mon.0) 230 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:26.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:24.876881+0000 mon.smithi050 (mon.0) 231 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:20:26.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:24.880913+0000 mon.smithi050 (mon.0) 232 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:20:27.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:26.573437+0000 mon.smithi050 (mon.0) 233 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:27.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:26.576740+0000 mon.smithi050 (mon.0) 234 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:27.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:26.581538+0000 mon.smithi050 (mon.0) 235 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:20:27.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:26.583613+0000 mon.smithi050 (mon.0) 236 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:20:27.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:26.584683+0000 mon.smithi050 (mon.0) 237 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:20:27.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:26.585706+0000 mon.smithi050 (mon.0) 238 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:20:27.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:26.586758+0000 mon.smithi050 (mon.0) 239 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-01-04T18:20:27.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:26.586891+0000 mgr.smithi050.emnywo (mgr.24517) 152 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-01-04T18:20:27.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:20:26.587540+0000 mgr.smithi050.emnywo (mgr.24517) 153 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-01-04T18:20:27.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:27.109437+0000 mon.smithi050 (mon.0) 240 : cluster [WRN] Health check update: Degraded data redundancy: 29/210 objects degraded (13.810%), 12 pgs degraded (PG_DEGRADED) 2023-01-04T18:20:28.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:26.573437+0000 mon.smithi050 (mon.0) 233 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:28.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:26.576740+0000 mon.smithi050 (mon.0) 234 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:28.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:26.581538+0000 mon.smithi050 (mon.0) 235 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:20:28.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:26.583613+0000 mon.smithi050 (mon.0) 236 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:20:28.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:26.584683+0000 mon.smithi050 (mon.0) 237 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:20:28.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:26.585706+0000 mon.smithi050 (mon.0) 238 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:20:28.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:26.586758+0000 mon.smithi050 (mon.0) 239 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-01-04T18:20:28.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:26.586891+0000 mgr.smithi050.emnywo (mgr.24517) 152 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-01-04T18:20:28.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:20:26.587540+0000 mgr.smithi050.emnywo (mgr.24517) 153 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-01-04T18:20:28.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:27.109437+0000 mon.smithi050 (mon.0) 240 : cluster [WRN] Health check update: Degraded data redundancy: 29/210 objects degraded (13.810%), 12 pgs degraded (PG_DEGRADED) 2023-01-04T18:20:29.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:26.638324+0000 mgr.smithi050.emnywo (mgr.24517) 154 : cluster [DBG] pgmap v118: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 29/210 objects degraded (13.810%) 2023-01-04T18:20:29.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:26.638324+0000 mgr.smithi050.emnywo (mgr.24517) 154 : cluster [DBG] pgmap v118: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 29/210 objects degraded (13.810%) 2023-01-04T18:20:29.540 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-1[179762]: debug 2023-01-04T18:20:29.134+0000 7f2a21aab200 -1 osd.1 66 log_to_monitors {default=true} 2023-01-04T18:20:30.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:29.138145+0000 mon.smithi050 (mon.0) 241 : audit [INF] from='osd.1 [v2:172.21.15.50:6810/4163598188,v1:172.21.15.50:6811/4163598188]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-01-04T18:20:30.040 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:20:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-1[179762]: debug 2023-01-04T18:20:29.592+0000 7f2a13fac700 -1 osd.1 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-04T18:20:30.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:29.138145+0000 mon.smithi050 (mon.0) 241 : audit [INF] from='osd.1 [v2:172.21.15.50:6810/4163598188,v1:172.21.15.50:6811/4163598188]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-01-04T18:20:31.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:28.638782+0000 mgr.smithi050.emnywo (mgr.24517) 155 : cluster [DBG] pgmap v119: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 786 B/s rd, 1 op/s; 29/210 objects degraded (13.810%) 2023-01-04T18:20:31.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:29.582646+0000 mon.smithi050 (mon.0) 242 : audit [INF] from='osd.1 [v2:172.21.15.50:6810/4163598188,v1:172.21.15.50:6811/4163598188]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-01-04T18:20:31.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:29.582725+0000 mon.smithi050 (mon.0) 243 : cluster [DBG] osdmap e69: 6 total, 5 up, 6 in 2023-01-04T18:20:31.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:29.583273+0000 mon.smithi050 (mon.0) 244 : audit [INF] from='osd.1 [v2:172.21.15.50:6810/4163598188,v1:172.21.15.50:6811/4163598188]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-01-04T18:20:31.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:28.638782+0000 mgr.smithi050.emnywo (mgr.24517) 155 : cluster [DBG] pgmap v119: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 786 B/s rd, 1 op/s; 29/210 objects degraded (13.810%) 2023-01-04T18:20:31.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:29.582646+0000 mon.smithi050 (mon.0) 242 : audit [INF] from='osd.1 [v2:172.21.15.50:6810/4163598188,v1:172.21.15.50:6811/4163598188]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-01-04T18:20:31.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:29.582725+0000 mon.smithi050 (mon.0) 243 : cluster [DBG] osdmap e69: 6 total, 5 up, 6 in 2023-01-04T18:20:31.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:29.583273+0000 mon.smithi050 (mon.0) 244 : audit [INF] from='osd.1 [v2:172.21.15.50:6810/4163598188,v1:172.21.15.50:6811/4163598188]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-01-04T18:20:32.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:30.584496+0000 mon.smithi050 (mon.0) 245 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-01-04T18:20:32.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:30.587765+0000 mon.smithi050 (mon.0) 246 : cluster [INF] osd.1 [v2:172.21.15.50:6810/4163598188,v1:172.21.15.50:6811/4163598188] boot 2023-01-04T18:20:32.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:30.587807+0000 mon.smithi050 (mon.0) 247 : cluster [DBG] osdmap e70: 6 total, 6 up, 6 in 2023-01-04T18:20:32.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:30.588358+0000 mon.smithi050 (mon.0) 248 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-01-04T18:20:32.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:31.590096+0000 mon.smithi050 (mon.0) 249 : cluster [DBG] osdmap e71: 6 total, 6 up, 6 in 2023-01-04T18:20:32.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:30.584496+0000 mon.smithi050 (mon.0) 245 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-01-04T18:20:32.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:30.587765+0000 mon.smithi050 (mon.0) 246 : cluster [INF] osd.1 [v2:172.21.15.50:6810/4163598188,v1:172.21.15.50:6811/4163598188] boot 2023-01-04T18:20:32.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:30.587807+0000 mon.smithi050 (mon.0) 247 : cluster [DBG] osdmap e70: 6 total, 6 up, 6 in 2023-01-04T18:20:32.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:30.588358+0000 mon.smithi050 (mon.0) 248 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-01-04T18:20:32.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:31.590096+0000 mon.smithi050 (mon.0) 249 : cluster [DBG] osdmap e71: 6 total, 6 up, 6 in 2023-01-04T18:20:33.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:30.639433+0000 mgr.smithi050.emnywo (mgr.24517) 156 : cluster [DBG] pgmap v122: 65 pgs: 6 peering, 10 active+undersized+degraded, 18 active+undersized, 31 active+clean; 194 MiB data, 1013 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 19/210 objects degraded (9.048%) 2023-01-04T18:20:33.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:32.110276+0000 mon.smithi050 (mon.0) 250 : cluster [WRN] Health check update: Degraded data redundancy: 19/210 objects degraded (9.048%), 10 pgs degraded (PG_DEGRADED) 2023-01-04T18:20:33.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:30.639433+0000 mgr.smithi050.emnywo (mgr.24517) 156 : cluster [DBG] pgmap v122: 65 pgs: 6 peering, 10 active+undersized+degraded, 18 active+undersized, 31 active+clean; 194 MiB data, 1013 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 19/210 objects degraded (9.048%) 2023-01-04T18:20:33.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:32.110276+0000 mon.smithi050 (mon.0) 250 : cluster [WRN] Health check update: Degraded data redundancy: 19/210 objects degraded (9.048%), 10 pgs degraded (PG_DEGRADED) 2023-01-04T18:20:33.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.543+0000 7fecfe20d700 1 -- 172.21.15.50:0/2493929918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecf80f7980 msgr2=0x7fecf80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:33.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.543+0000 7fecfe20d700 1 --2- 172.21.15.50:0/2493929918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecf80f7980 0x7fecf80f7de0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fecec004660 tx=0x7fecec009b30).stop 2023-01-04T18:20:33.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.543+0000 7fecfe20d700 1 -- 172.21.15.50:0/2493929918 shutdown_connections 2023-01-04T18:20:33.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.543+0000 7fecfe20d700 1 --2- 172.21.15.50:0/2493929918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecf80f7980 0x7fecf80f7de0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:33.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.543+0000 7fecfe20d700 1 --2- 172.21.15.50:0/2493929918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecf80f66e0 0x7fecf80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:33.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.543+0000 7fecfe20d700 1 -- 172.21.15.50:0/2493929918 >> 172.21.15.50:0/2493929918 conn(0x7fecf80f1e40 msgr2=0x7fecf80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:33.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.544+0000 7fecfe20d700 1 -- 172.21.15.50:0/2493929918 shutdown_connections 2023-01-04T18:20:33.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.544+0000 7fecfe20d700 1 -- 172.21.15.50:0/2493929918 wait complete. 2023-01-04T18:20:33.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.544+0000 7fecfe20d700 1 Processor -- start 2023-01-04T18:20:33.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.544+0000 7fecfe20d700 1 -- start start 2023-01-04T18:20:33.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.545+0000 7fecfe20d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecf80f66e0 0x7fecf8106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:33.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.545+0000 7fecfe20d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecf80f7980 0x7fecf8107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:33.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.545+0000 7fecfe20d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf8107a20 con 0x7fecf80f66e0 2023-01-04T18:20:33.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.545+0000 7fecfe20d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf8107b60 con 0x7fecf80f7980 2023-01-04T18:20:33.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.545+0000 7fecf77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecf80f66e0 0x7fecf8106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:33.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.545+0000 7fecf77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecf80f66e0 0x7fecf8106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35662/0 (socket says 172.21.15.50:35662) 2023-01-04T18:20:33.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.545+0000 7fecf77fe700 1 -- 172.21.15.50:0/2003571199 learned_addr learned my addr 172.21.15.50:0/2003571199 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:20:33.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.545+0000 7fecf6ffd700 1 --2- 172.21.15.50:0/2003571199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecf80f7980 0x7fecf8107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:33.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.545+0000 7fecf77fe700 1 -- 172.21.15.50:0/2003571199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecf80f7980 msgr2=0x7fecf8107470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:33.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.545+0000 7fecf77fe700 1 --2- 172.21.15.50:0/2003571199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecf80f7980 0x7fecf8107470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:33.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.545+0000 7fecf77fe700 1 -- 172.21.15.50:0/2003571199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec005040 con 0x7fecf80f66e0 2023-01-04T18:20:33.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.545+0000 7fecf77fe700 1 --2- 172.21.15.50:0/2003571199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecf80f66e0 0x7fecf8106f80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fece8002700 tx=0x7fece8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:33.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.545+0000 7fecdffff700 1 -- 172.21.15.50:0/2003571199 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fece80079c0 con 0x7fecf80f66e0 2023-01-04T18:20:33.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.545+0000 7fecfe20d700 1 -- 172.21.15.50:0/2003571199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf8108500 con 0x7fecf80f66e0 2023-01-04T18:20:33.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.545+0000 7fecdffff700 1 -- 172.21.15.50:0/2003571199 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fece800f040 con 0x7fecf80f66e0 2023-01-04T18:20:33.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.545+0000 7fecdffff700 1 -- 172.21.15.50:0/2003571199 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fece80148d0 con 0x7fecf80f66e0 2023-01-04T18:20:33.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.546+0000 7fecfe20d700 1 -- 172.21.15.50:0/2003571199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf8108ac0 con 0x7fecf80f66e0 2023-01-04T18:20:33.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.547+0000 7fecdffff700 1 -- 172.21.15.50:0/2003571199 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fece801b060 con 0x7fecf80f66e0 2023-01-04T18:20:33.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.547+0000 7fecfe20d700 1 -- 172.21.15.50:0/2003571199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf8045ad0 con 0x7fecf80f66e0 2023-01-04T18:20:33.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.547+0000 7fecdffff700 1 --2- 172.21.15.50:0/2003571199 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fece0060be0 0x7fece00630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:33.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.547+0000 7fecdffff700 1 -- 172.21.15.50:0/2003571199 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fece807ba60 con 0x7fecf80f66e0 2023-01-04T18:20:33.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.547+0000 7fecf6ffd700 1 --2- 172.21.15.50:0/2003571199 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fece0060be0 0x7fece00630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:33.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.548+0000 7fecf6ffd700 1 --2- 172.21.15.50:0/2003571199 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fece0060be0 0x7fece00630a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fecec004630 tx=0x7fecec009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:33.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.552+0000 7fecdffff700 1 -- 172.21.15.50:0/2003571199 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fece804fb30 con 0x7fecf80f66e0 2023-01-04T18:20:33.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.742+0000 7fecfe20d700 1 -- 172.21.15.50:0/2003571199 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fecf8108d90 con 0x7fece0060be0 2023-01-04T18:20:33.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.743+0000 7fecdffff700 1 -- 172.21.15.50:0/2003571199 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fecf8108d90 con 0x7fece0060be0 2023-01-04T18:20:33.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.745+0000 7fecfe20d700 1 -- 172.21.15.50:0/2003571199 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fece0060be0 msgr2=0x7fece00630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:33.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.745+0000 7fecfe20d700 1 --2- 172.21.15.50:0/2003571199 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fece0060be0 0x7fece00630a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fecec004630 tx=0x7fecec009b30).stop 2023-01-04T18:20:33.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.745+0000 7fecfe20d700 1 -- 172.21.15.50:0/2003571199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecf80f66e0 msgr2=0x7fecf8106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:33.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.745+0000 7fecfe20d700 1 --2- 172.21.15.50:0/2003571199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecf80f66e0 0x7fecf8106f80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fece8002700 tx=0x7fece8009d80).stop 2023-01-04T18:20:33.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.745+0000 7fecfe20d700 1 -- 172.21.15.50:0/2003571199 shutdown_connections 2023-01-04T18:20:33.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.745+0000 7fecfe20d700 1 --2- 172.21.15.50:0/2003571199 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fece0060be0 0x7fece00630a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:33.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.745+0000 7fecfe20d700 1 --2- 172.21.15.50:0/2003571199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecf80f66e0 0x7fecf8106f80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:33.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.745+0000 7fecfe20d700 1 --2- 172.21.15.50:0/2003571199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecf80f7980 0x7fecf8107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:33.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.745+0000 7fecfe20d700 1 -- 172.21.15.50:0/2003571199 >> 172.21.15.50:0/2003571199 conn(0x7fecf80f1e40 msgr2=0x7fecf80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:33.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.745+0000 7fecfe20d700 1 -- 172.21.15.50:0/2003571199 shutdown_connections 2023-01-04T18:20:33.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.745+0000 7fecfe20d700 1 -- 172.21.15.50:0/2003571199 wait complete. 2023-01-04T18:20:33.758 INFO:teuthology.orchestra.run.smithi050.stdout:true 2023-01-04T18:20:33.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:33 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:32.639989+0000 mgr.smithi050.emnywo (mgr.24517) 157 : cluster [DBG] pgmap v124: 65 pgs: 1 active, 20 peering, 7 active+undersized+degraded, 5 active+undersized, 32 active+clean; 194 MiB data, 1017 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 16/210 objects degraded (7.619%) 2023-01-04T18:20:33.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.847+0000 7f5136562700 1 -- 172.21.15.50:0/3848013441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51300f5430 msgr2=0x7f51300f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:33.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.847+0000 7f5136562700 1 --2- 172.21.15.50:0/3848013441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51300f5430 0x7f51300f5850 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f512c004660 tx=0x7f512c009b30).stop 2023-01-04T18:20:33.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.847+0000 7f5136562700 1 -- 172.21.15.50:0/3848013441 shutdown_connections 2023-01-04T18:20:33.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.847+0000 7f5136562700 1 --2- 172.21.15.50:0/3848013441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51300f66d0 0x7f51300f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:33.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.847+0000 7f5136562700 1 --2- 172.21.15.50:0/3848013441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51300f5430 0x7f51300f5850 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:33.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.847+0000 7f5136562700 1 -- 172.21.15.50:0/3848013441 >> 172.21.15.50:0/3848013441 conn(0x7f51300f0b90 msgr2=0x7f51300f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:33.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.847+0000 7f5136562700 1 -- 172.21.15.50:0/3848013441 shutdown_connections 2023-01-04T18:20:33.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.848+0000 7f5136562700 1 -- 172.21.15.50:0/3848013441 wait complete. 2023-01-04T18:20:33.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.848+0000 7f5136562700 1 Processor -- start 2023-01-04T18:20:33.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.848+0000 7f5136562700 1 -- start start 2023-01-04T18:20:33.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.848+0000 7f5136562700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51300f5430 0x7f5130106e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:33.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.848+0000 7f5136562700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51300f66d0 0x7f5130107320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:33.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.848+0000 7f5136562700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5130107920 con 0x7f51300f66d0 2023-01-04T18:20:33.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.848+0000 7f5136562700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5130108130 con 0x7f51300f5430 2023-01-04T18:20:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.848+0000 7f5134d5f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51300f66d0 0x7f5130107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.848+0000 7f5134d5f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51300f66d0 0x7f5130107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35674/0 (socket says 172.21.15.50:35674) 2023-01-04T18:20:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.848+0000 7f5134d5f700 1 -- 172.21.15.50:0/2629222899 learned_addr learned my addr 172.21.15.50:0/2629222899 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:20:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.849+0000 7f5135560700 1 --2- 172.21.15.50:0/2629222899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51300f5430 0x7f5130106e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.849+0000 7f5134d5f700 1 -- 172.21.15.50:0/2629222899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51300f5430 msgr2=0x7f5130106e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.849+0000 7f5134d5f700 1 --2- 172.21.15.50:0/2629222899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51300f5430 0x7f5130106e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.849+0000 7f5134d5f700 1 -- 172.21.15.50:0/2629222899 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512c005040 con 0x7f51300f66d0 2023-01-04T18:20:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.849+0000 7f5135560700 1 --2- 172.21.15.50:0/2629222899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51300f5430 0x7f5130106e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-01-04T18:20:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.849+0000 7f5134d5f700 1 --2- 172.21.15.50:0/2629222899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51300f66d0 0x7f5130107320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f512000c790 tx=0x7f5120007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.849+0000 7f5125ffb700 1 -- 172.21.15.50:0/2629222899 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f512000e680 con 0x7f51300f66d0 2023-01-04T18:20:33.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.849+0000 7f5125ffb700 1 -- 172.21.15.50:0/2629222899 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f512000eca0 con 0x7f51300f66d0 2023-01-04T18:20:33.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.849+0000 7f5136562700 1 -- 172.21.15.50:0/2629222899 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51301083b0 con 0x7f51300f66d0 2023-01-04T18:20:33.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.849+0000 7f5125ffb700 1 -- 172.21.15.50:0/2629222899 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5120013de0 con 0x7f51300f66d0 2023-01-04T18:20:33.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.849+0000 7f5136562700 1 -- 172.21.15.50:0/2629222899 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5130108970 con 0x7f51300f66d0 2023-01-04T18:20:33.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.850+0000 7f5136562700 1 -- 172.21.15.50:0/2629222899 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5130059100 con 0x7f51300f66d0 2023-01-04T18:20:33.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.850+0000 7f5125ffb700 1 -- 172.21.15.50:0/2629222899 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f512001a060 con 0x7f51300f66d0 2023-01-04T18:20:33.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.851+0000 7f5125ffb700 1 --2- 172.21.15.50:0/2629222899 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f511c060c30 0x7f511c0630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:33.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.851+0000 7f5125ffb700 1 -- 172.21.15.50:0/2629222899 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f512007beb0 con 0x7f51300f66d0 2023-01-04T18:20:33.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.851+0000 7f5135560700 1 --2- 172.21.15.50:0/2629222899 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f511c060c30 0x7f511c0630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:33.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.851+0000 7f5135560700 1 --2- 172.21.15.50:0/2629222899 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f511c060c30 0x7f511c0630f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f512c009d60 tx=0x7f512c009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:33.855+0000 7f5125ffb700 1 -- 172.21.15.50:0/2629222899 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f512004c550 con 0x7f51300f66d0 2023-01-04T18:20:34.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.044+0000 7f5136562700 1 -- 172.21.15.50:0/2629222899 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f51300fab10 con 0x7f511c060c30 2023-01-04T18:20:34.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.046+0000 7f5125ffb700 1 -- 172.21.15.50:0/2629222899 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f51300fab10 con 0x7f511c060c30 2023-01-04T18:20:34.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.048+0000 7f5136562700 1 -- 172.21.15.50:0/2629222899 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f511c060c30 msgr2=0x7f511c0630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:34.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.048+0000 7f5136562700 1 --2- 172.21.15.50:0/2629222899 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f511c060c30 0x7f511c0630f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f512c009d60 tx=0x7f512c009b30).stop 2023-01-04T18:20:34.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.048+0000 7f5136562700 1 -- 172.21.15.50:0/2629222899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51300f66d0 msgr2=0x7f5130107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:34.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.048+0000 7f5136562700 1 --2- 172.21.15.50:0/2629222899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51300f66d0 0x7f5130107320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f512000c790 tx=0x7f5120007d70).stop 2023-01-04T18:20:34.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.048+0000 7f5136562700 1 -- 172.21.15.50:0/2629222899 shutdown_connections 2023-01-04T18:20:34.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.048+0000 7f5136562700 1 --2- 172.21.15.50:0/2629222899 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f511c060c30 0x7f511c0630f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:34.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.048+0000 7f5136562700 1 --2- 172.21.15.50:0/2629222899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51300f5430 0x7f5130106e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:34.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.048+0000 7f5136562700 1 --2- 172.21.15.50:0/2629222899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51300f66d0 0x7f5130107320 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:34.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.048+0000 7f5136562700 1 -- 172.21.15.50:0/2629222899 >> 172.21.15.50:0/2629222899 conn(0x7f51300f0b90 msgr2=0x7f513005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:34.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.048+0000 7f5136562700 1 -- 172.21.15.50:0/2629222899 shutdown_connections 2023-01-04T18:20:34.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.048+0000 7f5136562700 1 -- 172.21.15.50:0/2629222899 wait complete. 2023-01-04T18:20:34.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:33 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:32.639989+0000 mgr.smithi050.emnywo (mgr.24517) 157 : cluster [DBG] pgmap v124: 65 pgs: 1 active, 20 peering, 7 active+undersized+degraded, 5 active+undersized, 32 active+clean; 194 MiB data, 1017 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 16/210 objects degraded (7.619%) 2023-01-04T18:20:34.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.149+0000 7f5720b1c700 1 -- 172.21.15.50:0/188416758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f571c0f6860 msgr2=0x7f571c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:34.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.149+0000 7f5720b1c700 1 --2- 172.21.15.50:0/188416758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f571c0f6860 0x7f571c0f6cc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f5704004660 tx=0x7f5704009b30).stop 2023-01-04T18:20:34.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.149+0000 7f5720b1c700 1 -- 172.21.15.50:0/188416758 shutdown_connections 2023-01-04T18:20:34.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.149+0000 7f5720b1c700 1 --2- 172.21.15.50:0/188416758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f571c0f6860 0x7f571c0f6cc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:34.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.149+0000 7f5720b1c700 1 --2- 172.21.15.50:0/188416758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f571c0f55c0 0x7f571c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:34.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.149+0000 7f5720b1c700 1 -- 172.21.15.50:0/188416758 >> 172.21.15.50:0/188416758 conn(0x7f571c0f0d40 msgr2=0x7f571c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:34.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.149+0000 7f5720b1c700 1 -- 172.21.15.50:0/188416758 shutdown_connections 2023-01-04T18:20:34.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.149+0000 7f5720b1c700 1 -- 172.21.15.50:0/188416758 wait complete. 2023-01-04T18:20:34.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.150+0000 7f5720b1c700 1 Processor -- start 2023-01-04T18:20:34.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.150+0000 7f5720b1c700 1 -- start start 2023-01-04T18:20:34.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.150+0000 7f5720b1c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f571c0f55c0 0x7f571c106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:34.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.150+0000 7f5720b1c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f571c0f6860 0x7f571c107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:34.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.150+0000 7f5720b1c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c107a30 con 0x7f571c0f55c0 2023-01-04T18:20:34.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.150+0000 7f5720b1c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c107b70 con 0x7f571c0f6860 2023-01-04T18:20:34.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.150+0000 7f571a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f571c0f55c0 0x7f571c106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:34.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.150+0000 7f571a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f571c0f55c0 0x7f571c106f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35696/0 (socket says 172.21.15.50:35696) 2023-01-04T18:20:34.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.150+0000 7f571a59c700 1 -- 172.21.15.50:0/767740435 learned_addr learned my addr 172.21.15.50:0/767740435 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:20:34.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.150+0000 7f5719d9b700 1 --2- 172.21.15.50:0/767740435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f571c0f6860 0x7f571c107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:34.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.150+0000 7f571a59c700 1 -- 172.21.15.50:0/767740435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f571c0f6860 msgr2=0x7f571c107480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:34.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.150+0000 7f571a59c700 1 --2- 172.21.15.50:0/767740435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f571c0f6860 0x7f571c107480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:34.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.150+0000 7f571a59c700 1 -- 172.21.15.50:0/767740435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5704005040 con 0x7f571c0f55c0 2023-01-04T18:20:34.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.151+0000 7f571a59c700 1 --2- 172.21.15.50:0/767740435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f571c0f55c0 0x7f571c106f90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f570c002700 tx=0x7f570c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:34.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.151+0000 7f5712ffd700 1 -- 172.21.15.50:0/767740435 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f570c0079c0 con 0x7f571c0f55c0 2023-01-04T18:20:34.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.151+0000 7f5712ffd700 1 -- 172.21.15.50:0/767740435 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f570c00f040 con 0x7f571c0f55c0 2023-01-04T18:20:34.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.151+0000 7f5712ffd700 1 -- 172.21.15.50:0/767740435 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f570c0148d0 con 0x7f571c0f55c0 2023-01-04T18:20:34.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.151+0000 7f5720b1c700 1 -- 172.21.15.50:0/767740435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f571c108510 con 0x7f571c0f55c0 2023-01-04T18:20:34.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.151+0000 7f5720b1c700 1 -- 172.21.15.50:0/767740435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571c108a80 con 0x7f571c0f55c0 2023-01-04T18:20:34.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.152+0000 7f5720b1c700 1 -- 172.21.15.50:0/767740435 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f571c045ad0 con 0x7f571c0f55c0 2023-01-04T18:20:34.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.152+0000 7f5712ffd700 1 -- 172.21.15.50:0/767740435 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f570c01b060 con 0x7f571c0f55c0 2023-01-04T18:20:34.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.153+0000 7f5712ffd700 1 --2- 172.21.15.50:0/767740435 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5708060be0 0x7f57080630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:34.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.153+0000 7f5712ffd700 1 -- 172.21.15.50:0/767740435 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f570c07bb00 con 0x7f571c0f55c0 2023-01-04T18:20:34.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.153+0000 7f5719d9b700 1 --2- 172.21.15.50:0/767740435 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5708060be0 0x7f57080630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:34.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.153+0000 7f5719d9b700 1 --2- 172.21.15.50:0/767740435 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5708060be0 0x7f57080630a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f5704004630 tx=0x7f5704009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:34.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.157+0000 7f5712ffd700 1 -- 172.21.15.50:0/767740435 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f570c04fb50 con 0x7f571c0f55c0 2023-01-04T18:20:34.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.338+0000 7f5720b1c700 1 -- 172.21.15.50:0/767740435 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f571c0faca0 con 0x7f5708060be0 2023-01-04T18:20:34.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.348+0000 7f5712ffd700 1 -- 172.21.15.50:0/767740435 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f571c0faca0 con 0x7f5708060be0 2023-01-04T18:20:34.351 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-01-04T18:20:34.351 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager.smithi050 smithi050 *:9093,9094 running (8m) 7s ago 10m 24.5M - 0.20.0 0881eb8f169f b5d3e2678a23 2023-01-04T18:20:34.352 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi050 smithi050 running (2m) 7s ago 10m 7050k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cfe28e5ab81e 2023-01-04T18:20:34.352 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi098 smithi098 running (2m) 2m ago 9m 7042k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cf5f0ca60522 2023-01-04T18:20:34.352 INFO:teuthology.orchestra.run.smithi050.stdout:grafana.smithi050 smithi050 *:3000 running (8m) 7s ago 9m 37.3M - 6.7.4 557c83e11646 7e5dccbafe78 2023-01-04T18:20:34.352 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.ezoiwl smithi050 running (6m) 7s ago 6m 10.0G - 16.2.4 8d91d370c2b8 6c5c5f2be8b9 2023-01-04T18:20:34.352 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.kefmuy smithi050 running (5m) 7s ago 5m 18.4M - 16.2.4 8d91d370c2b8 58cace913b55 2023-01-04T18:20:34.352 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.laynsk smithi098 running (5m) 2m ago 5m 15.7M - 16.2.4 8d91d370c2b8 8ff8af70b989 2023-01-04T18:20:34.352 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.memais smithi098 running (5m) 2m ago 5m 1070M - 16.2.4 8d91d370c2b8 d59d9b4dbf7d 2023-01-04T18:20:34.352 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi050.emnywo smithi050 *:8443,9283 running (3m) 7s ago 11m 444M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d ee677216e754 2023-01-04T18:20:34.352 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi098.vhfzum smithi098 *:8443,9283 running (2m) 2m ago 9m 394M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d f3d98bf0cf66 2023-01-04T18:20:34.352 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi050 smithi050 running (2m) 7s ago 11m 90.3M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 0423819cbaa7 2023-01-04T18:20:34.353 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi098 smithi098 running (2m) 2m ago 9m 39.4M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 12094818aefc 2023-01-04T18:20:34.353 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi050 smithi050 *:9100 running (9m) 7s ago 9m 18.4M - 0.18.1 e5a616e4b9cf 88892b2e5e5a 2023-01-04T18:20:34.353 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi098 smithi098 *:9100 running (9m) 2m ago 9m 18.4M - 0.18.1 e5a616e4b9cf 49bcde8331b6 2023-01-04T18:20:34.353 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (108s) 7s ago 8m 357M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 60dafedcb429 2023-01-04T18:20:34.353 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi050 running (14s) 7s ago 8m 12.6M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 625bd99952d9 2023-01-04T18:20:34.353 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi050 running (8m) 7s ago 8m 934M 4096M 16.2.4 8d91d370c2b8 babab394b338 2023-01-04T18:20:34.353 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi098 running (7m) 2m ago 7m 1186M 4096M 16.2.4 8d91d370c2b8 b02df8e3cb23 2023-01-04T18:20:34.353 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi098 running (7m) 2m ago 7m 876M 4096M 16.2.4 8d91d370c2b8 92273135ca82 2023-01-04T18:20:34.353 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi098 running (7m) 2m ago 7m 971M 4096M 16.2.4 8d91d370c2b8 366d0bfff809 2023-01-04T18:20:34.353 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus.smithi050 smithi050 *:9095 running (3m) 7s ago 9m 65.4M - 2.18.1 de242295e225 7bdcf7a45d34 2023-01-04T18:20:34.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.349+0000 7f5720b1c700 1 -- 172.21.15.50:0/767740435 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5708060be0 msgr2=0x7f57080630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:34.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.349+0000 7f5720b1c700 1 --2- 172.21.15.50:0/767740435 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5708060be0 0x7f57080630a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f5704004630 tx=0x7f5704009b30).stop 2023-01-04T18:20:34.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.349+0000 7f5720b1c700 1 -- 172.21.15.50:0/767740435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f571c0f55c0 msgr2=0x7f571c106f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:34.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.349+0000 7f5720b1c700 1 --2- 172.21.15.50:0/767740435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f571c0f55c0 0x7f571c106f90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f570c002700 tx=0x7f570c009d80).stop 2023-01-04T18:20:34.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.349+0000 7f5720b1c700 1 -- 172.21.15.50:0/767740435 shutdown_connections 2023-01-04T18:20:34.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.349+0000 7f5720b1c700 1 --2- 172.21.15.50:0/767740435 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5708060be0 0x7f57080630a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:34.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.349+0000 7f5720b1c700 1 --2- 172.21.15.50:0/767740435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f571c0f55c0 0x7f571c106f90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:34.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.349+0000 7f5720b1c700 1 --2- 172.21.15.50:0/767740435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f571c0f6860 0x7f571c107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:34.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.349+0000 7f5720b1c700 1 -- 172.21.15.50:0/767740435 >> 172.21.15.50:0/767740435 conn(0x7f571c0f0d40 msgr2=0x7f571c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:34.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.350+0000 7f5720b1c700 1 -- 172.21.15.50:0/767740435 shutdown_connections 2023-01-04T18:20:34.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.350+0000 7f5720b1c700 1 -- 172.21.15.50:0/767740435 wait complete. 2023-01-04T18:20:34.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.452+0000 7fb9a87f8700 1 -- 172.21.15.50:0/3407441150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9a00f7970 msgr2=0x7fb9a00f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:34.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.452+0000 7fb9a87f8700 1 --2- 172.21.15.50:0/3407441150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9a00f7970 0x7fb9a00f7dd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fb990004660 tx=0x7fb990009b30).stop 2023-01-04T18:20:34.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.452+0000 7fb9a87f8700 1 -- 172.21.15.50:0/3407441150 shutdown_connections 2023-01-04T18:20:34.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.452+0000 7fb9a87f8700 1 --2- 172.21.15.50:0/3407441150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9a00f7970 0x7fb9a00f7dd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:34.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.452+0000 7fb9a87f8700 1 --2- 172.21.15.50:0/3407441150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9a00f66d0 0x7fb9a00f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:34.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.452+0000 7fb9a87f8700 1 -- 172.21.15.50:0/3407441150 >> 172.21.15.50:0/3407441150 conn(0x7fb9a00f1e50 msgr2=0x7fb9a00f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:34.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.452+0000 7fb9a87f8700 1 -- 172.21.15.50:0/3407441150 shutdown_connections 2023-01-04T18:20:34.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.452+0000 7fb9a87f8700 1 -- 172.21.15.50:0/3407441150 wait complete. 2023-01-04T18:20:34.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.453+0000 7fb9a87f8700 1 Processor -- start 2023-01-04T18:20:34.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.453+0000 7fb9a87f8700 1 -- start start 2023-01-04T18:20:34.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.453+0000 7fb9a87f8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9a00f66d0 0x7fb9a0106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:34.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.453+0000 7fb9a87f8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9a00f7970 0x7fb9a0107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:34.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.453+0000 7fb9a87f8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a0107a10 con 0x7fb9a00f7970 2023-01-04T18:20:34.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.453+0000 7fb9a87f8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a0107b50 con 0x7fb9a00f66d0 2023-01-04T18:20:34.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.453+0000 7fb9a5d93700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9a00f7970 0x7fb9a0107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:34.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.453+0000 7fb9a5d93700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9a00f7970 0x7fb9a0107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35714/0 (socket says 172.21.15.50:35714) 2023-01-04T18:20:34.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.453+0000 7fb9a5d93700 1 -- 172.21.15.50:0/1240358378 learned_addr learned my addr 172.21.15.50:0/1240358378 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:20:34.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.453+0000 7fb9a6594700 1 --2- 172.21.15.50:0/1240358378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9a00f66d0 0x7fb9a0106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:34.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.454+0000 7fb9a5d93700 1 -- 172.21.15.50:0/1240358378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9a00f66d0 msgr2=0x7fb9a0106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:34.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.454+0000 7fb9a5d93700 1 --2- 172.21.15.50:0/1240358378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9a00f66d0 0x7fb9a0106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:34.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.454+0000 7fb9a5d93700 1 -- 172.21.15.50:0/1240358378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb990005040 con 0x7fb9a00f7970 2023-01-04T18:20:34.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.454+0000 7fb9a5d93700 1 --2- 172.21.15.50:0/1240358378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9a00f7970 0x7fb9a0107460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fb990009f50 tx=0x7fb990009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:34.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.454+0000 7fb996ffd700 1 -- 172.21.15.50:0/1240358378 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb990018070 con 0x7fb9a00f7970 2023-01-04T18:20:34.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.454+0000 7fb996ffd700 1 -- 172.21.15.50:0/1240358378 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb990009630 con 0x7fb9a00f7970 2023-01-04T18:20:34.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.454+0000 7fb9a87f8700 1 -- 172.21.15.50:0/1240358378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a0108490 con 0x7fb9a00f7970 2023-01-04T18:20:34.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.454+0000 7fb996ffd700 1 -- 172.21.15.50:0/1240358378 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb99001c3c0 con 0x7fb9a00f7970 2023-01-04T18:20:34.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.454+0000 7fb9a87f8700 1 -- 172.21.15.50:0/1240358378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a01089f0 con 0x7fb9a00f7970 2023-01-04T18:20:34.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.455+0000 7fb9a87f8700 1 -- 172.21.15.50:0/1240358378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a0045ad0 con 0x7fb9a00f7970 2023-01-04T18:20:34.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.455+0000 7fb996ffd700 1 -- 172.21.15.50:0/1240358378 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fb99001d420 con 0x7fb9a00f7970 2023-01-04T18:20:34.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.456+0000 7fb996ffd700 1 --2- 172.21.15.50:0/1240358378 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb98c060be0 0x7fb98c0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:34.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.456+0000 7fb996ffd700 1 -- 172.21.15.50:0/1240358378 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb99007da10 con 0x7fb9a00f7970 2023-01-04T18:20:34.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.456+0000 7fb9a6594700 1 --2- 172.21.15.50:0/1240358378 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb98c060be0 0x7fb98c0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:34.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.456+0000 7fb9a6594700 1 --2- 172.21.15.50:0/1240358378 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb98c060be0 0x7fb98c0630a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fb9a00f77d0 tx=0x7fb99c00b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:34.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.460+0000 7fb996ffd700 1 -- 172.21.15.50:0/1240358378 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fb9900519a0 con 0x7fb9a00f7970 2023-01-04T18:20:34.710 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:20:34.710 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": { 2023-01-04T18:20:34.710 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:20:34.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:20:34.710 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": { 2023-01-04T18:20:34.710 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:20:34.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:20:34.711 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": { 2023-01-04T18:20:34.711 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2, 2023-01-04T18:20:34.711 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-01-04T18:20:34.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:20:34.711 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2023-01-04T18:20:34.711 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-01-04T18:20:34.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:20:34.711 INFO:teuthology.orchestra.run.smithi050.stdout: "overall": { 2023-01-04T18:20:34.711 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 6, 2023-01-04T18:20:34.711 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 8 2023-01-04T18:20:34.712 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-01-04T18:20:34.712 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:20:34.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.706+0000 7fb9a87f8700 1 -- 172.21.15.50:0/1240358378 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb9a0027a00 con 0x7fb9a00f7970 2023-01-04T18:20:34.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.706+0000 7fb996ffd700 1 -- 172.21.15.50:0/1240358378 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+824 (secure 0 0 0) 0x7fb990051590 con 0x7fb9a00f7970 2023-01-04T18:20:34.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.708+0000 7fb9a87f8700 1 -- 172.21.15.50:0/1240358378 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb98c060be0 msgr2=0x7fb98c0630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:34.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.708+0000 7fb9a87f8700 1 --2- 172.21.15.50:0/1240358378 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb98c060be0 0x7fb98c0630a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fb9a00f77d0 tx=0x7fb99c00b040).stop 2023-01-04T18:20:34.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.708+0000 7fb9a87f8700 1 -- 172.21.15.50:0/1240358378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9a00f7970 msgr2=0x7fb9a0107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:34.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.708+0000 7fb9a87f8700 1 --2- 172.21.15.50:0/1240358378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9a00f7970 0x7fb9a0107460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fb990009f50 tx=0x7fb990009b30).stop 2023-01-04T18:20:34.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.708+0000 7fb9a87f8700 1 -- 172.21.15.50:0/1240358378 shutdown_connections 2023-01-04T18:20:34.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.708+0000 7fb9a87f8700 1 --2- 172.21.15.50:0/1240358378 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb98c060be0 0x7fb98c0630a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:34.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.708+0000 7fb9a87f8700 1 --2- 172.21.15.50:0/1240358378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9a00f66d0 0x7fb9a0106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:34.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.708+0000 7fb9a87f8700 1 --2- 172.21.15.50:0/1240358378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9a00f7970 0x7fb9a0107460 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:34.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.708+0000 7fb9a87f8700 1 -- 172.21.15.50:0/1240358378 >> 172.21.15.50:0/1240358378 conn(0x7fb9a00f1e50 msgr2=0x7fb9a00fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:34.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.708+0000 7fb9a87f8700 1 -- 172.21.15.50:0/1240358378 shutdown_connections 2023-01-04T18:20:34.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.708+0000 7fb9a87f8700 1 -- 172.21.15.50:0/1240358378 wait complete. 2023-01-04T18:20:34.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.810+0000 7f58626a0700 1 -- 172.21.15.50:0/1670449598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f585c0f55c0 msgr2=0x7f585c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:34.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.810+0000 7f58626a0700 1 --2- 172.21.15.50:0/1670449598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f585c0f55c0 0x7f585c0f59e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f584c004660 tx=0x7f584c009b30).stop 2023-01-04T18:20:34.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.810+0000 7f58626a0700 1 -- 172.21.15.50:0/1670449598 shutdown_connections 2023-01-04T18:20:34.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.810+0000 7f58626a0700 1 --2- 172.21.15.50:0/1670449598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c0f6860 0x7f585c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:34.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.810+0000 7f58626a0700 1 --2- 172.21.15.50:0/1670449598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f585c0f55c0 0x7f585c0f59e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:34.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.810+0000 7f58626a0700 1 -- 172.21.15.50:0/1670449598 >> 172.21.15.50:0/1670449598 conn(0x7f585c0f0d40 msgr2=0x7f585c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:34.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.810+0000 7f58626a0700 1 -- 172.21.15.50:0/1670449598 shutdown_connections 2023-01-04T18:20:34.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.810+0000 7f58626a0700 1 -- 172.21.15.50:0/1670449598 wait complete. 2023-01-04T18:20:34.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.811+0000 7f58626a0700 1 Processor -- start 2023-01-04T18:20:34.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.811+0000 7f58626a0700 1 -- start start 2023-01-04T18:20:34.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.811+0000 7f58626a0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c0f55c0 0x7f585c109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:34.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.811+0000 7f58626a0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f585c0f6860 0x7f585c10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:34.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.811+0000 7f58626a0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c0603e0 con 0x7f585c0f6860 2023-01-04T18:20:34.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.811+0000 7f58626a0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c060520 con 0x7f585c0f55c0 2023-01-04T18:20:34.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.811+0000 7f585b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f585c0f6860 0x7f585c10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:34.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.811+0000 7f585b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f585c0f6860 0x7f585c10c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35732/0 (socket says 172.21.15.50:35732) 2023-01-04T18:20:34.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.811+0000 7f585b7fe700 1 -- 172.21.15.50:0/2949083256 learned_addr learned my addr 172.21.15.50:0/2949083256 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:20:34.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.812+0000 7f585bfff700 1 --2- 172.21.15.50:0/2949083256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c0f55c0 0x7f585c109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:34.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.812+0000 7f585b7fe700 1 -- 172.21.15.50:0/2949083256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c0f55c0 msgr2=0x7f585c109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:34.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.812+0000 7f585b7fe700 1 --2- 172.21.15.50:0/2949083256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c0f55c0 0x7f585c109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:34.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.812+0000 7f585b7fe700 1 -- 172.21.15.50:0/2949083256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c005040 con 0x7f585c0f6860 2023-01-04T18:20:34.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.812+0000 7f585b7fe700 1 --2- 172.21.15.50:0/2949083256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f585c0f6860 0x7f585c10c190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f585000c530 tx=0x7f5850007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:34.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.812+0000 7f5858ff9700 1 -- 172.21.15.50:0/2949083256 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f585000f650 con 0x7f585c0f6860 2023-01-04T18:20:34.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.812+0000 7f58626a0700 1 -- 172.21.15.50:0/2949083256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585c10c740 con 0x7f585c0f6860 2023-01-04T18:20:34.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.812+0000 7f5858ff9700 1 -- 172.21.15.50:0/2949083256 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f585000fc70 con 0x7f585c0f6860 2023-01-04T18:20:34.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.812+0000 7f5858ff9700 1 -- 172.21.15.50:0/2949083256 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5850012db0 con 0x7f585c0f6860 2023-01-04T18:20:34.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.812+0000 7f58626a0700 1 -- 172.21.15.50:0/2949083256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585c10cd00 con 0x7f585c0f6860 2023-01-04T18:20:34.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.813+0000 7f58626a0700 1 -- 172.21.15.50:0/2949083256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585c045ad0 con 0x7f585c0f6860 2023-01-04T18:20:34.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.813+0000 7f5858ff9700 1 -- 172.21.15.50:0/2949083256 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f5850010070 con 0x7f585c0f6860 2023-01-04T18:20:34.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.814+0000 7f5858ff9700 1 --2- 172.21.15.50:0/2949083256 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5844060be0 0x7f58440630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:34.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.814+0000 7f5858ff9700 1 -- 172.21.15.50:0/2949083256 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f585007ba40 con 0x7f585c0f6860 2023-01-04T18:20:34.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.814+0000 7f585bfff700 1 --2- 172.21.15.50:0/2949083256 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5844060be0 0x7f58440630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:34.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.814+0000 7f585bfff700 1 --2- 172.21.15.50:0/2949083256 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5844060be0 0x7f58440630a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f585c060060 tx=0x7f584c009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:34.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:34.818+0000 7f5858ff9700 1 -- 172.21.15.50:0/2949083256 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f5850047c30 con 0x7f585c0f6860 2023-01-04T18:20:35.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.035+0000 7f58626a0700 1 -- 172.21.15.50:0/2949083256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f585c027a00 con 0x7f585c0f6860 2023-01-04T18:20:35.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.036+0000 7f5858ff9700 1 -- 172.21.15.50:0/2949083256 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1793 (secure 0 0 0) 0x7f585004c060 con 0x7f585c0f6860 2023-01-04T18:20:35.039 INFO:teuthology.orchestra.run.smithi050.stdout:e13 2023-01-04T18:20:35.039 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:20:35.040 INFO:teuthology.orchestra.run.smithi050.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:20:35.040 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-01-04T18:20:35.040 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:20:35.040 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-01-04T18:20:35.040 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-01-04T18:20:35.040 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 10 2023-01-04T18:20:35.040 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 2023-01-04T18:20:35.040 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:20:35.040 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-01-04T18:14:43.958806+0000 2023-01-04T18:20:35.040 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-01-04T18:20:35.040 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-01-04T18:20:35.041 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 60 2023-01-04T18:20:35.041 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-01-04T18:20:35.041 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-01-04T18:20:35.041 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-01-04T18:20:35.041 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-01-04T18:20:35.041 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 0 2023-01-04T18:20:35.041 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:20:35.041 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 1 2023-01-04T18:20:35.041 INFO:teuthology.orchestra.run.smithi050.stdout:in 0 2023-01-04T18:20:35.041 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=14430} 2023-01-04T18:20:35.042 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-01-04T18:20:35.042 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-01-04T18:20:35.042 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-01-04T18:20:35.042 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-01-04T18:20:35.042 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-01-04T18:20:35.042 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data enabled 2023-01-04T18:20:35.042 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-01-04T18:20:35.042 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 1 2023-01-04T18:20:35.042 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.ezoiwl{0:14430} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:20:35.042 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.memais{0:24291} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.98:6824/1196398070,v1:172.21.15.98:6825/1196398070] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:20:35.042 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:20:35.043 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:20:35.043 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2023-01-04T18:20:35.043 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:20:35.043 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.kefmuy{-1:14440} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:20:35.043 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.laynsk{-1:24297} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:20:35.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:33.744128+0000 mgr.smithi050.emnywo (mgr.24517) 158 : audit [DBG] from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:20:35.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:34.046821+0000 mgr.smithi050.emnywo (mgr.24517) 159 : audit [DBG] from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:20:35.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:34.340716+0000 mgr.smithi050.emnywo (mgr.24517) 160 : audit [DBG] from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:20:35.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.037+0000 7f58626a0700 1 -- 172.21.15.50:0/2949083256 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5844060be0 msgr2=0x7f58440630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:35.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.038+0000 7f58626a0700 1 --2- 172.21.15.50:0/2949083256 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5844060be0 0x7f58440630a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f585c060060 tx=0x7f584c009b30).stop 2023-01-04T18:20:35.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.038+0000 7f58626a0700 1 -- 172.21.15.50:0/2949083256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f585c0f6860 msgr2=0x7f585c10c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:35.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.038+0000 7f58626a0700 1 --2- 172.21.15.50:0/2949083256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f585c0f6860 0x7f585c10c190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f585000c530 tx=0x7f5850007e20).stop 2023-01-04T18:20:35.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.038+0000 7f58626a0700 1 -- 172.21.15.50:0/2949083256 shutdown_connections 2023-01-04T18:20:35.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.038+0000 7f58626a0700 1 --2- 172.21.15.50:0/2949083256 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5844060be0 0x7f58440630a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:35.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.038+0000 7f58626a0700 1 --2- 172.21.15.50:0/2949083256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f585c0f55c0 0x7f585c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:35.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.038+0000 7f58626a0700 1 --2- 172.21.15.50:0/2949083256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f585c0f6860 0x7f585c10c190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:35.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.038+0000 7f58626a0700 1 -- 172.21.15.50:0/2949083256 >> 172.21.15.50:0/2949083256 conn(0x7f585c0f0d40 msgr2=0x7f585c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:35.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.038+0000 7f58626a0700 1 -- 172.21.15.50:0/2949083256 shutdown_connections 2023-01-04T18:20:35.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.038+0000 7f58626a0700 1 -- 172.21.15.50:0/2949083256 wait complete. 2023-01-04T18:20:35.045 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2023-01-04T18:20:35.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:33.744128+0000 mgr.smithi050.emnywo (mgr.24517) 158 : audit [DBG] from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:20:35.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:34.046821+0000 mgr.smithi050.emnywo (mgr.24517) 159 : audit [DBG] from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:20:35.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:34.340716+0000 mgr.smithi050.emnywo (mgr.24517) 160 : audit [DBG] from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:20:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.140+0000 7f351ba33700 1 -- 172.21.15.50:0/1856984844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35140f55c0 msgr2=0x7f35140f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.140+0000 7f351ba33700 1 --2- 172.21.15.50:0/1856984844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35140f55c0 0x7f35140f59e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f3510004660 tx=0x7f3510009b30).stop 2023-01-04T18:20:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.140+0000 7f351ba33700 1 -- 172.21.15.50:0/1856984844 shutdown_connections 2023-01-04T18:20:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.140+0000 7f351ba33700 1 --2- 172.21.15.50:0/1856984844 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35140f6860 0x7f35140f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.140+0000 7f351ba33700 1 --2- 172.21.15.50:0/1856984844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35140f55c0 0x7f35140f59e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.140+0000 7f351ba33700 1 -- 172.21.15.50:0/1856984844 >> 172.21.15.50:0/1856984844 conn(0x7f35140f0d40 msgr2=0x7f35140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.140+0000 7f351ba33700 1 -- 172.21.15.50:0/1856984844 shutdown_connections 2023-01-04T18:20:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.140+0000 7f351ba33700 1 -- 172.21.15.50:0/1856984844 wait complete. 2023-01-04T18:20:35.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.141+0000 7f351ba33700 1 Processor -- start 2023-01-04T18:20:35.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.141+0000 7f351ba33700 1 -- start start 2023-01-04T18:20:35.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.141+0000 7f351ba33700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35140f55c0 0x7f3514109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:35.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.141+0000 7f351ba33700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35140f6860 0x7f351410c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:35.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.141+0000 7f351ba33700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35140603e0 con 0x7f35140f6860 2023-01-04T18:20:35.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.141+0000 7f351ba33700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3514060520 con 0x7f35140f55c0 2023-01-04T18:20:35.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.141+0000 7f3518fce700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35140f6860 0x7f351410c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:35.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.141+0000 7f3518fce700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35140f6860 0x7f351410c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35758/0 (socket says 172.21.15.50:35758) 2023-01-04T18:20:35.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.141+0000 7f3518fce700 1 -- 172.21.15.50:0/2255405389 learned_addr learned my addr 172.21.15.50:0/2255405389 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:20:35.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.142+0000 7f35197cf700 1 --2- 172.21.15.50:0/2255405389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35140f55c0 0x7f3514109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:35.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.142+0000 7f3518fce700 1 -- 172.21.15.50:0/2255405389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35140f55c0 msgr2=0x7f3514109c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:35.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.142+0000 7f3518fce700 1 --2- 172.21.15.50:0/2255405389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35140f55c0 0x7f3514109c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:35.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.142+0000 7f3518fce700 1 -- 172.21.15.50:0/2255405389 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3510005040 con 0x7f35140f6860 2023-01-04T18:20:35.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.142+0000 7f35197cf700 1 --2- 172.21.15.50:0/2255405389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35140f55c0 0x7f3514109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-01-04T18:20:35.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.142+0000 7f3518fce700 1 --2- 172.21.15.50:0/2255405389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35140f6860 0x7f351410c110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f3508002700 tx=0x7f3508009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:35.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.142+0000 7f3505ffb700 1 -- 172.21.15.50:0/2255405389 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3508009320 con 0x7f35140f6860 2023-01-04T18:20:35.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.142+0000 7f351ba33700 1 -- 172.21.15.50:0/2255405389 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351410c6c0 con 0x7f35140f6860 2023-01-04T18:20:35.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.142+0000 7f3505ffb700 1 -- 172.21.15.50:0/2255405389 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f350800f040 con 0x7f35140f6860 2023-01-04T18:20:35.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.142+0000 7f3505ffb700 1 -- 172.21.15.50:0/2255405389 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35080148a0 con 0x7f35140f6860 2023-01-04T18:20:35.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.142+0000 7f351ba33700 1 -- 172.21.15.50:0/2255405389 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351410cc80 con 0x7f35140f6860 2023-01-04T18:20:35.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.143+0000 7f351ba33700 1 -- 172.21.15.50:0/2255405389 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3514045ad0 con 0x7f35140f6860 2023-01-04T18:20:35.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.144+0000 7f3505ffb700 1 -- 172.21.15.50:0/2255405389 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f35080077b0 con 0x7f35140f6860 2023-01-04T18:20:35.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.144+0000 7f3505ffb700 1 --2- 172.21.15.50:0/2255405389 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f3500060be0 0x7f35000630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:20:35.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.144+0000 7f3505ffb700 1 -- 172.21.15.50:0/2255405389 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f350807c050 con 0x7f35140f6860 2023-01-04T18:20:35.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.144+0000 7f35197cf700 1 --2- 172.21.15.50:0/2255405389 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f3500060be0 0x7f35000630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:20:35.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.145+0000 7f35197cf700 1 --2- 172.21.15.50:0/2255405389 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f3500060be0 0x7f35000630a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3510009d60 tx=0x7f3510009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:20:35.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.148+0000 7f3505ffb700 1 -- 172.21.15.50:0/2255405389 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f350804c670 con 0x7f35140f6860 2023-01-04T18:20:35.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.335+0000 7f351ba33700 1 -- 172.21.15.50:0/2255405389 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3514057f10 con 0x7f3500060be0 2023-01-04T18:20:35.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.337+0000 7f3505ffb700 1 -- 172.21.15.50:0/2255405389 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3514057f10 con 0x7f3500060be0 2023-01-04T18:20:35.340 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:20:35.340 INFO:teuthology.orchestra.run.smithi050.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308", 2023-01-04T18:20:35.340 INFO:teuthology.orchestra.run.smithi050.stdout: "in_progress": true, 2023-01-04T18:20:35.340 INFO:teuthology.orchestra.run.smithi050.stdout: "which": "Upgrading all daemon types on all hosts", 2023-01-04T18:20:35.340 INFO:teuthology.orchestra.run.smithi050.stdout: "services_complete": [ 2023-01-04T18:20:35.341 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2023-01-04T18:20:35.341 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr", 2023-01-04T18:20:35.341 INFO:teuthology.orchestra.run.smithi050.stdout: "mon" 2023-01-04T18:20:35.341 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-01-04T18:20:35.341 INFO:teuthology.orchestra.run.smithi050.stdout: "progress": "8/21 daemons upgraded", 2023-01-04T18:20:35.341 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "Currently upgrading osd daemons", 2023-01-04T18:20:35.341 INFO:teuthology.orchestra.run.smithi050.stdout: "is_paused": false 2023-01-04T18:20:35.341 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:20:35.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.338+0000 7f351ba33700 1 -- 172.21.15.50:0/2255405389 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f3500060be0 msgr2=0x7f35000630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:35.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.338+0000 7f351ba33700 1 --2- 172.21.15.50:0/2255405389 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f3500060be0 0x7f35000630a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3510009d60 tx=0x7f3510009b30).stop 2023-01-04T18:20:35.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.338+0000 7f351ba33700 1 -- 172.21.15.50:0/2255405389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35140f6860 msgr2=0x7f351410c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:20:35.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.338+0000 7f351ba33700 1 --2- 172.21.15.50:0/2255405389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35140f6860 0x7f351410c110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f3508002700 tx=0x7f3508009e00).stop 2023-01-04T18:20:35.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.339+0000 7f351ba33700 1 -- 172.21.15.50:0/2255405389 shutdown_connections 2023-01-04T18:20:35.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.339+0000 7f351ba33700 1 --2- 172.21.15.50:0/2255405389 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f3500060be0 0x7f35000630a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:35.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.339+0000 7f351ba33700 1 --2- 172.21.15.50:0/2255405389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35140f55c0 0x7f3514109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:35.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.339+0000 7f351ba33700 1 --2- 172.21.15.50:0/2255405389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35140f6860 0x7f351410c110 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:20:35.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.339+0000 7f351ba33700 1 -- 172.21.15.50:0/2255405389 >> 172.21.15.50:0/2255405389 conn(0x7f35140f0d40 msgr2=0x7f35140fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:20:35.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.339+0000 7f351ba33700 1 -- 172.21.15.50:0/2255405389 shutdown_connections 2023-01-04T18:20:35.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:20:35.339+0000 7f351ba33700 1 -- 172.21.15.50:0/2255405389 wait complete. 2023-01-04T18:20:36.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:34.640373+0000 mgr.smithi050.emnywo (mgr.24517) 161 : cluster [DBG] pgmap v125: 65 pgs: 1 active, 20 peering, 44 active+clean; 194 MiB data, 1017 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:20:36.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:34.707653+0000 mon.smithi050 (mon.0) 251 : audit [DBG] from='client.? 172.21.15.50:0/1240358378' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:20:36.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:35.037317+0000 mon.smithi050 (mon.0) 252 : audit [DBG] from='client.? 172.21.15.50:0/2949083256' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:20:36.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:35.337995+0000 mgr.smithi050.emnywo (mgr.24517) 162 : audit [DBG] from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:20:36.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:34.640373+0000 mgr.smithi050.emnywo (mgr.24517) 161 : cluster [DBG] pgmap v125: 65 pgs: 1 active, 20 peering, 44 active+clean; 194 MiB data, 1017 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:20:36.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:34.707653+0000 mon.smithi050 (mon.0) 251 : audit [DBG] from='client.? 172.21.15.50:0/1240358378' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:20:36.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:35.037317+0000 mon.smithi050 (mon.0) 252 : audit [DBG] from='client.? 172.21.15.50:0/2949083256' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:20:36.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:35.337995+0000 mgr.smithi050.emnywo (mgr.24517) 162 : audit [DBG] from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:20:37.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:35.612900+0000 mon.smithi050 (mon.0) 253 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/210 objects degraded (7.619%), 7 pgs degraded) 2023-01-04T18:20:37.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:35.612900+0000 mon.smithi050 (mon.0) 253 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/210 objects degraded (7.619%), 7 pgs degraded) 2023-01-04T18:20:38.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:36.641010+0000 mgr.smithi050.emnywo (mgr.24517) 163 : cluster [DBG] pgmap v126: 65 pgs: 1 active, 64 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2023-01-04T18:20:38.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:36.641010+0000 mgr.smithi050.emnywo (mgr.24517) 163 : cluster [DBG] pgmap v126: 65 pgs: 1 active, 64 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2023-01-04T18:20:40.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:38.641540+0000 mgr.smithi050.emnywo (mgr.24517) 164 : cluster [DBG] pgmap v127: 65 pgs: 65 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2023-01-04T18:20:40.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:39.845284+0000 mon.smithi050 (mon.0) 254 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:40.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:38.641540+0000 mgr.smithi050.emnywo (mgr.24517) 164 : cluster [DBG] pgmap v127: 65 pgs: 65 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2023-01-04T18:20:40.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:39.845284+0000 mon.smithi050 (mon.0) 254 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:42.502 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:40.642105+0000 mgr.smithi050.emnywo (mgr.24517) 165 : cluster [DBG] pgmap v128: 65 pgs: 65 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2023-01-04T18:20:42.502 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:41.593764+0000 mon.smithi050 (mon.0) 255 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-01-04T18:20:42.502 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:41.593982+0000 mgr.smithi050.emnywo (mgr.24517) 166 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-01-04T18:20:42.502 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:20:41.595072+0000 mgr.smithi050.emnywo (mgr.24517) 167 : cephadm [INF] Upgrade: osd.2 is safe to restart 2023-01-04T18:20:42.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:40.642105+0000 mgr.smithi050.emnywo (mgr.24517) 165 : cluster [DBG] pgmap v128: 65 pgs: 65 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2023-01-04T18:20:42.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:41.593764+0000 mon.smithi050 (mon.0) 255 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-01-04T18:20:42.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:41.593982+0000 mgr.smithi050.emnywo (mgr.24517) 166 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-01-04T18:20:42.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:20:41.595072+0000 mgr.smithi050.emnywo (mgr.24517) 167 : cephadm [INF] Upgrade: osd.2 is safe to restart 2023-01-04T18:20:44.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:42.642749+0000 mgr.smithi050.emnywo (mgr.24517) 168 : cluster [DBG] pgmap v129: 65 pgs: 65 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 833 B/s rd, 1 op/s 2023-01-04T18:20:44.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:20:42.895183+0000 mgr.smithi050.emnywo (mgr.24517) 169 : cephadm [INF] Upgrade: Updating osd.2 2023-01-04T18:20:44.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:42.899230+0000 mon.smithi050 (mon.0) 256 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:44.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:42.899883+0000 mon.smithi050 (mon.0) 257 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-01-04T18:20:44.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:42.900462+0000 mon.smithi050 (mon.0) 258 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:20:44.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:20:42.901449+0000 mgr.smithi050.emnywo (mgr.24517) 170 : cephadm [INF] Deploying daemon osd.2 on smithi050 2023-01-04T18:20:44.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:42.642749+0000 mgr.smithi050.emnywo (mgr.24517) 168 : cluster [DBG] pgmap v129: 65 pgs: 65 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 833 B/s rd, 1 op/s 2023-01-04T18:20:44.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:20:42.895183+0000 mgr.smithi050.emnywo (mgr.24517) 169 : cephadm [INF] Upgrade: Updating osd.2 2023-01-04T18:20:44.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:42.899230+0000 mon.smithi050 (mon.0) 256 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:44.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:42.899883+0000 mon.smithi050 (mon.0) 257 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-01-04T18:20:44.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:42.900462+0000 mon.smithi050 (mon.0) 258 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:20:44.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:20:42.901449+0000 mgr.smithi050.emnywo (mgr.24517) 170 : cephadm [INF] Deploying daemon osd.2 on smithi050 2023-01-04T18:20:45.540 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:45 smithi050 systemd[1]: Stopping Ceph osd.2 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:20:45.838 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.2[151157]: debug 2023-01-04T18:20:45.552+0000 7f95f4cf6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-01-04T18:20:45.838 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.2[151157]: debug 2023-01-04T18:20:45.552+0000 7f95f4cf6700 -1 osd.2 71 *** Got signal Terminated *** 2023-01-04T18:20:45.838 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.2[151157]: debug 2023-01-04T18:20:45.552+0000 7f95f4cf6700 -1 osd.2 71 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-01-04T18:20:46.104 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:44.643098+0000 mgr.smithi050.emnywo (mgr.24517) 171 : cluster [DBG] pgmap v130: 65 pgs: 65 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2023-01-04T18:20:46.104 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:44.924328+0000 mon.smithi050 (mon.0) 259 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:46.104 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:45.808652+0000 mon.smithi050 (mon.0) 260 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-01-04T18:20:46.104 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:45.808682+0000 mon.smithi050 (mon.0) 261 : cluster [INF] osd.2 failed (root=default,host=smithi050) (connection refused reported by osd.0) 2023-01-04T18:20:46.105 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:45.808810+0000 mon.smithi050 (mon.0) 262 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-01-04T18:20:46.105 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:45.808905+0000 mon.smithi050 (mon.0) 263 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-01-04T18:20:46.105 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:45.808989+0000 mon.smithi050 (mon.0) 264 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-01-04T18:20:46.105 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:45.809152+0000 mon.smithi050 (mon.0) 265 : cluster [DBG] osd.2 reported immediately failed by osd.3 2023-01-04T18:20:46.105 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:45.809236+0000 mon.smithi050 (mon.0) 266 : cluster [DBG] osd.2 reported immediately failed by osd.5 2023-01-04T18:20:46.105 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:45.809313+0000 mon.smithi050 (mon.0) 267 : cluster [DBG] osd.2 reported immediately failed by osd.3 2023-01-04T18:20:46.105 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:45.809395+0000 mon.smithi050 (mon.0) 268 : cluster [DBG] osd.2 reported immediately failed by osd.4 2023-01-04T18:20:46.105 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:45.809465+0000 mon.smithi050 (mon.0) 269 : cluster [DBG] osd.2 reported immediately failed by osd.5 2023-01-04T18:20:46.105 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:45.809544+0000 mon.smithi050 (mon.0) 270 : cluster [DBG] osd.2 reported immediately failed by osd.4 2023-01-04T18:20:46.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:44.643098+0000 mgr.smithi050.emnywo (mgr.24517) 171 : cluster [DBG] pgmap v130: 65 pgs: 65 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2023-01-04T18:20:46.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:44.924328+0000 mon.smithi050 (mon.0) 259 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:46.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:45.808652+0000 mon.smithi050 (mon.0) 260 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-01-04T18:20:46.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:45.808682+0000 mon.smithi050 (mon.0) 261 : cluster [INF] osd.2 failed (root=default,host=smithi050) (connection refused reported by osd.0) 2023-01-04T18:20:46.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:45.808810+0000 mon.smithi050 (mon.0) 262 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-01-04T18:20:46.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:45.808905+0000 mon.smithi050 (mon.0) 263 : cluster [DBG] osd.2 reported immediately failed by osd.0 2023-01-04T18:20:46.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:45.808989+0000 mon.smithi050 (mon.0) 264 : cluster [DBG] osd.2 reported immediately failed by osd.1 2023-01-04T18:20:46.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:45.809152+0000 mon.smithi050 (mon.0) 265 : cluster [DBG] osd.2 reported immediately failed by osd.3 2023-01-04T18:20:46.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:45.809236+0000 mon.smithi050 (mon.0) 266 : cluster [DBG] osd.2 reported immediately failed by osd.5 2023-01-04T18:20:46.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:45.809313+0000 mon.smithi050 (mon.0) 267 : cluster [DBG] osd.2 reported immediately failed by osd.3 2023-01-04T18:20:46.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:45.809395+0000 mon.smithi050 (mon.0) 268 : cluster [DBG] osd.2 reported immediately failed by osd.4 2023-01-04T18:20:46.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:45.809465+0000 mon.smithi050 (mon.0) 269 : cluster [DBG] osd.2 reported immediately failed by osd.5 2023-01-04T18:20:46.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:45.809544+0000 mon.smithi050 (mon.0) 270 : cluster [DBG] osd.2 reported immediately failed by osd.4 2023-01-04T18:20:46.540 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:46 smithi050 bash[181861]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.2 2023-01-04T18:20:47.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:45.923259+0000 mon.smithi050 (mon.0) 271 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-01-04T18:20:47.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:45.929548+0000 mon.smithi050 (mon.0) 272 : cluster [DBG] osdmap e72: 6 total, 5 up, 6 in 2023-01-04T18:20:47.040 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:46 smithi050 bash[181905]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-2" found: no such container 2023-01-04T18:20:47.040 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:46 smithi050 bash[181920]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.2" found: no such container 2023-01-04T18:20:47.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:45.923259+0000 mon.smithi050 (mon.0) 271 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-01-04T18:20:47.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:45.929548+0000 mon.smithi050 (mon.0) 272 : cluster [DBG] osdmap e72: 6 total, 5 up, 6 in 2023-01-04T18:20:48.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:46.643672+0000 mgr.smithi050.emnywo (mgr.24517) 172 : cluster [DBG] pgmap v132: 65 pgs: 9 stale+active+clean, 56 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2023-01-04T18:20:48.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:46.935805+0000 mon.smithi050 (mon.0) 273 : cluster [DBG] osdmap e73: 6 total, 5 up, 6 in 2023-01-04T18:20:48.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:47 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:46.643672+0000 mgr.smithi050.emnywo (mgr.24517) 172 : cluster [DBG] pgmap v132: 65 pgs: 9 stale+active+clean, 56 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2023-01-04T18:20:48.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:47 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:46.935805+0000 mon.smithi050 (mon.0) 273 : cluster [DBG] osdmap e73: 6 total, 5 up, 6 in 2023-01-04T18:20:48.661 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:48 smithi050 systemd[1]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.2.service: Succeeded. 2023-01-04T18:20:48.661 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:48 smithi050 systemd[1]: Stopped Ceph osd.2 for d98671da-8c5a-11ed-821a-001a4aab830c. 2023-01-04T18:20:48.661 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:48 smithi050 systemd[1]: Starting Ceph osd.2 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:20:49.269 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:48.934913+0000 mon.smithi050 (mon.0) 274 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY) 2023-01-04T18:20:49.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:48.934913+0000 mon.smithi050 (mon.0) 274 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY) 2023-01-04T18:20:50.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:49 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:48.644062+0000 mgr.smithi050.emnywo (mgr.24517) 173 : cluster [DBG] pgmap v134: 65 pgs: 8 peering, 6 stale+active+clean, 51 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2023-01-04T18:20:50.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:49 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:48.644062+0000 mgr.smithi050.emnywo (mgr.24517) 173 : cluster [DBG] pgmap v134: 65 pgs: 8 peering, 6 stale+active+clean, 51 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2023-01-04T18:20:51.040 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:50 smithi050 bash[182144]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-01-04T18:20:51.040 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:50 smithi050 bash[182144]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-01-04T18:20:51.040 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:50 smithi050 bash[182144]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-01-04T18:20:51.040 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:50 smithi050 bash[182144]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-01-04T18:20:51.041 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:50 smithi050 bash[182144]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2023-01-04T18:20:51.041 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:50 smithi050 bash[182144]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-01-04T18:20:51.041 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:50 smithi050 bash[182144]: --> ceph-volume raw activate successful for osd ID: 2 2023-01-04T18:20:51.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:51 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:50.988716+0000 mon.smithi050 (mon.0) 275 : cluster [WRN] Health check failed: Degraded data redundancy: 13/210 objects degraded (6.190%), 3 pgs degraded (PG_DEGRADED) 2023-01-04T18:20:51.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:50.988716+0000 mon.smithi050 (mon.0) 275 : cluster [WRN] Health check failed: Degraded data redundancy: 13/210 objects degraded (6.190%), 3 pgs degraded (PG_DEGRADED) 2023-01-04T18:20:52.109 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:50.644467+0000 mgr.smithi050.emnywo (mgr.24517) 174 : cluster [DBG] pgmap v135: 65 pgs: 3 active+undersized+degraded, 8 peering, 2 stale+active+clean, 4 active+undersized, 48 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 13/210 objects degraded (6.190%) 2023-01-04T18:20:52.109 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:51 smithi050 podman[182575]: 2023-01-04T18:20:52.109 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-2[182591]: debug 2023-01-04T18:20:52.000+0000 7f6fdc3e7700 1 -- 172.21.15.50:0/2594555552 <== mon.0 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e2533f84e0 con 0x55e2533bf400 2023-01-04T18:20:52.109 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:52 smithi050 bash[182575]: badf94f13661a7a9eeaa2a7a0b192933db77423808908ac9079fcb69a55fbaec 2023-01-04T18:20:52.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:50.644467+0000 mgr.smithi050.emnywo (mgr.24517) 174 : cluster [DBG] pgmap v135: 65 pgs: 3 active+undersized+degraded, 8 peering, 2 stale+active+clean, 4 active+undersized, 48 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 13/210 objects degraded (6.190%) 2023-01-04T18:20:52.529 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:52 smithi050 systemd[1]: Started Ceph osd.2 for d98671da-8c5a-11ed-821a-001a4aab830c. 2023-01-04T18:20:52.790 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-2[182591]: debug 2023-01-04T18:20:52.524+0000 7f6fe3e5d200 -1 Falling back to public interface 2023-01-04T18:20:53.538 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:52.151588+0000 mon.smithi050 (mon.0) 276 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:53.539 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:52.152345+0000 mon.smithi050 (mon.0) 277 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:20:53.539 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:52.153365+0000 mon.smithi050 (mon.0) 278 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:20:53.539 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:52.153941+0000 mon.smithi050 (mon.0) 279 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:20:53.539 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:20:52.154481+0000 mgr.smithi050.emnywo (mgr.24517) 175 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:20:53.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:52.151588+0000 mon.smithi050 (mon.0) 276 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:53.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:52.152345+0000 mon.smithi050 (mon.0) 277 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:20:53.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:52.153365+0000 mon.smithi050 (mon.0) 278 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:20:53.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:52.153941+0000 mon.smithi050 (mon.0) 279 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:20:53.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:20:52.154481+0000 mgr.smithi050.emnywo (mgr.24517) 175 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:20:54.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:52.644915+0000 mgr.smithi050.emnywo (mgr.24517) 176 : cluster [DBG] pgmap v136: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 29/210 objects degraded (13.810%) 2023-01-04T18:20:54.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:53.149814+0000 mon.smithi050 (mon.0) 280 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 3 pgs peering) 2023-01-04T18:20:54.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:52.644915+0000 mgr.smithi050.emnywo (mgr.24517) 176 : cluster [DBG] pgmap v136: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 29/210 objects degraded (13.810%) 2023-01-04T18:20:54.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:53.149814+0000 mon.smithi050 (mon.0) 280 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 3 pgs peering) 2023-01-04T18:20:56.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:54.645337+0000 mgr.smithi050.emnywo (mgr.24517) 177 : cluster [DBG] pgmap v137: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 29/210 objects degraded (13.810%) 2023-01-04T18:20:56.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:54.844804+0000 mon.smithi050 (mon.0) 281 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:56.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:54.645337+0000 mgr.smithi050.emnywo (mgr.24517) 177 : cluster [DBG] pgmap v137: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 29/210 objects degraded (13.810%) 2023-01-04T18:20:56.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:54.844804+0000 mon.smithi050 (mon.0) 281 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:58.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:56.645764+0000 mgr.smithi050.emnywo (mgr.24517) 178 : cluster [DBG] pgmap v138: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 29/210 objects degraded (13.810%) 2023-01-04T18:20:58.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:57.114837+0000 mon.smithi050 (mon.0) 282 : cluster [WRN] Health check update: Degraded data redundancy: 29/210 objects degraded (13.810%), 11 pgs degraded (PG_DEGRADED) 2023-01-04T18:20:58.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:56.645764+0000 mgr.smithi050.emnywo (mgr.24517) 178 : cluster [DBG] pgmap v138: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 29/210 objects degraded (13.810%) 2023-01-04T18:20:58.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:57.114837+0000 mon.smithi050 (mon.0) 282 : cluster [WRN] Health check update: Degraded data redundancy: 29/210 objects degraded (13.810%), 11 pgs degraded (PG_DEGRADED) 2023-01-04T18:20:58.922 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-2[182591]: debug 2023-01-04T18:20:58.821+0000 7f6fe3e5d200 -1 osd.2 71 log_to_monitors {default=true} 2023-01-04T18:20:59.790 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:20:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-2[182591]: debug 2023-01-04T18:20:59.500+0000 7f6fd6b5f700 -1 osd.2 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-04T18:20:59.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:58.484944+0000 mon.smithi050 (mon.0) 283 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:59.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:58.826640+0000 mon.smithi050 (mon.0) 284 : audit [INF] from='osd.2 [v2:172.21.15.50:6818/2194889581,v1:172.21.15.50:6819/2194889581]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-01-04T18:20:59.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:58.909494+0000 mon.smithi050 (mon.0) 285 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:59.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:58.914305+0000 mon.smithi050 (mon.0) 286 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:20:59.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:58.916415+0000 mon.smithi050 (mon.0) 287 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:20:59.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:58.917540+0000 mon.smithi050 (mon.0) 288 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:20:59.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:58.918612+0000 mon.smithi050 (mon.0) 289 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:20:59.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:20:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:58.919725+0000 mon.smithi050 (mon.0) 290 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-01-04T18:20:59.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:58.484944+0000 mon.smithi050 (mon.0) 283 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:59.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:58.826640+0000 mon.smithi050 (mon.0) 284 : audit [INF] from='osd.2 [v2:172.21.15.50:6818/2194889581,v1:172.21.15.50:6819/2194889581]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-01-04T18:20:59.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:58.909494+0000 mon.smithi050 (mon.0) 285 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:20:59.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:58.914305+0000 mon.smithi050 (mon.0) 286 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:20:59.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:58.916415+0000 mon.smithi050 (mon.0) 287 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:20:59.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:58.917540+0000 mon.smithi050 (mon.0) 288 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:20:59.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:58.918612+0000 mon.smithi050 (mon.0) 289 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:20:59.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:20:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:58.919725+0000 mon.smithi050 (mon.0) 290 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-01-04T18:21:00.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:58.646212+0000 mgr.smithi050.emnywo (mgr.24517) 179 : cluster [DBG] pgmap v139: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 29/210 objects degraded (13.810%) 2023-01-04T18:21:00.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:58.919866+0000 mgr.smithi050.emnywo (mgr.24517) 180 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-01-04T18:21:00.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:20:58.920559+0000 mgr.smithi050.emnywo (mgr.24517) 181 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-01-04T18:21:00.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:59.490182+0000 mon.smithi050 (mon.0) 291 : audit [INF] from='osd.2 [v2:172.21.15.50:6818/2194889581,v1:172.21.15.50:6819/2194889581]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-01-04T18:21:00.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:20:59.490269+0000 mon.smithi050 (mon.0) 292 : cluster [DBG] osdmap e74: 6 total, 5 up, 6 in 2023-01-04T18:21:00.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:59.490805+0000 mon.smithi050 (mon.0) 293 : audit [INF] from='osd.2 [v2:172.21.15.50:6818/2194889581,v1:172.21.15.50:6819/2194889581]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-01-04T18:21:00.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:20:59.934813+0000 mon.smithi050 (mon.0) 294 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:00.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:58.646212+0000 mgr.smithi050.emnywo (mgr.24517) 179 : cluster [DBG] pgmap v139: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 29/210 objects degraded (13.810%) 2023-01-04T18:21:00.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:58.919866+0000 mgr.smithi050.emnywo (mgr.24517) 180 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-01-04T18:21:00.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:20:58.920559+0000 mgr.smithi050.emnywo (mgr.24517) 181 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-01-04T18:21:00.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:59.490182+0000 mon.smithi050 (mon.0) 291 : audit [INF] from='osd.2 [v2:172.21.15.50:6818/2194889581,v1:172.21.15.50:6819/2194889581]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-01-04T18:21:00.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:20:59.490269+0000 mon.smithi050 (mon.0) 292 : cluster [DBG] osdmap e74: 6 total, 5 up, 6 in 2023-01-04T18:21:00.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:59.490805+0000 mon.smithi050 (mon.0) 293 : audit [INF] from='osd.2 [v2:172.21.15.50:6818/2194889581,v1:172.21.15.50:6819/2194889581]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-01-04T18:21:00.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:20:59.934813+0000 mon.smithi050 (mon.0) 294 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:01.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:01 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:00.487631+0000 mon.smithi050 (mon.0) 295 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-01-04T18:21:01.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:01 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:00.492755+0000 mon.smithi050 (mon.0) 296 : cluster [INF] osd.2 [v2:172.21.15.50:6818/2194889581,v1:172.21.15.50:6819/2194889581] boot 2023-01-04T18:21:01.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:01 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:00.492834+0000 mon.smithi050 (mon.0) 297 : cluster [DBG] osdmap e75: 6 total, 6 up, 6 in 2023-01-04T18:21:01.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:01 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:00.494656+0000 mon.smithi050 (mon.0) 298 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-01-04T18:21:01.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:01 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:01.493907+0000 mon.smithi050 (mon.0) 299 : cluster [DBG] osdmap e76: 6 total, 6 up, 6 in 2023-01-04T18:21:01.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:00.487631+0000 mon.smithi050 (mon.0) 295 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-01-04T18:21:01.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:00.492755+0000 mon.smithi050 (mon.0) 296 : cluster [INF] osd.2 [v2:172.21.15.50:6818/2194889581,v1:172.21.15.50:6819/2194889581] boot 2023-01-04T18:21:01.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:00.492834+0000 mon.smithi050 (mon.0) 297 : cluster [DBG] osdmap e75: 6 total, 6 up, 6 in 2023-01-04T18:21:01.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:00.494656+0000 mon.smithi050 (mon.0) 298 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-01-04T18:21:01.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:01.493907+0000 mon.smithi050 (mon.0) 299 : cluster [DBG] osdmap e76: 6 total, 6 up, 6 in 2023-01-04T18:21:02.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:00.646724+0000 mgr.smithi050.emnywo (mgr.24517) 182 : cluster [DBG] pgmap v142: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 29/210 objects degraded (13.810%) 2023-01-04T18:21:02.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:00.646724+0000 mgr.smithi050.emnywo (mgr.24517) 182 : cluster [DBG] pgmap v142: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 29/210 objects degraded (13.810%) 2023-01-04T18:21:03.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:03.509929+0000 mon.smithi050 (mon.0) 300 : cluster [WRN] Health check update: Degraded data redundancy: 19/210 objects degraded (9.048%), 6 pgs degraded (PG_DEGRADED) 2023-01-04T18:21:03.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:03.509929+0000 mon.smithi050 (mon.0) 300 : cluster [WRN] Health check update: Degraded data redundancy: 19/210 objects degraded (9.048%), 6 pgs degraded (PG_DEGRADED) 2023-01-04T18:21:04.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:02.647225+0000 mgr.smithi050.emnywo (mgr.24517) 183 : cluster [DBG] pgmap v144: 65 pgs: 10 peering, 6 active+undersized+degraded, 6 active+undersized, 43 active+clean; 194 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 19/210 objects degraded (9.048%) 2023-01-04T18:21:05.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:02.647225+0000 mgr.smithi050.emnywo (mgr.24517) 183 : cluster [DBG] pgmap v144: 65 pgs: 10 peering, 6 active+undersized+degraded, 6 active+undersized, 43 active+clean; 194 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 19/210 objects degraded (9.048%) 2023-01-04T18:21:05.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.456+0000 7f030b05a700 1 -- 172.21.15.50:0/3058217945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03040f7980 msgr2=0x7f03040f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:05.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.456+0000 7f030b05a700 1 --2- 172.21.15.50:0/3058217945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03040f7980 0x7f03040f7de0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f02f4004660 tx=0x7f02f4009b30).stop 2023-01-04T18:21:05.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.456+0000 7f030b05a700 1 -- 172.21.15.50:0/3058217945 shutdown_connections 2023-01-04T18:21:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.456+0000 7f030b05a700 1 --2- 172.21.15.50:0/3058217945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03040f7980 0x7f03040f7de0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.456+0000 7f030b05a700 1 --2- 172.21.15.50:0/3058217945 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03040f66e0 0x7f03040f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.456+0000 7f030b05a700 1 -- 172.21.15.50:0/3058217945 >> 172.21.15.50:0/3058217945 conn(0x7f03040f1e40 msgr2=0x7f03040f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.456+0000 7f030b05a700 1 -- 172.21.15.50:0/3058217945 shutdown_connections 2023-01-04T18:21:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.456+0000 7f030b05a700 1 -- 172.21.15.50:0/3058217945 wait complete. 2023-01-04T18:21:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.457+0000 7f030b05a700 1 Processor -- start 2023-01-04T18:21:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.457+0000 7f030b05a700 1 -- start start 2023-01-04T18:21:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.457+0000 7f030b05a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03040f66e0 0x7f0304106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:05.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.457+0000 7f030b05a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03040f7980 0x7f0304107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:05.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.457+0000 7f030b05a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03041079d0 con 0x7f03040f66e0 2023-01-04T18:21:05.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.457+0000 7f030b05a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0304107b10 con 0x7f03040f7980 2023-01-04T18:21:05.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.457+0000 7f0308df6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03040f66e0 0x7f0304106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:05.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.457+0000 7f0308df6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03040f66e0 0x7f0304106f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43664/0 (socket says 172.21.15.50:43664) 2023-01-04T18:21:05.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.457+0000 7f0308df6700 1 -- 172.21.15.50:0/254056312 learned_addr learned my addr 172.21.15.50:0/254056312 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:21:05.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.457+0000 7f02fbfff700 1 --2- 172.21.15.50:0/254056312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03040f7980 0x7f0304107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:05.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.458+0000 7f0308df6700 1 -- 172.21.15.50:0/254056312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03040f7980 msgr2=0x7f0304107420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:05.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.458+0000 7f0308df6700 1 --2- 172.21.15.50:0/254056312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03040f7980 0x7f0304107420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:05.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.458+0000 7f0308df6700 1 -- 172.21.15.50:0/254056312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f4005040 con 0x7f03040f66e0 2023-01-04T18:21:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.458+0000 7f0308df6700 1 --2- 172.21.15.50:0/254056312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03040f66e0 0x7f0304106f30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f030000e7c0 tx=0x7f030000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.458+0000 7f02f97fa700 1 -- 172.21.15.50:0/254056312 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03000092e0 con 0x7f03040f66e0 2023-01-04T18:21:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.458+0000 7f030b05a700 1 -- 172.21.15.50:0/254056312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03041084b0 con 0x7f03040f66e0 2023-01-04T18:21:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.458+0000 7f02f97fa700 1 -- 172.21.15.50:0/254056312 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f030000f040 con 0x7f03040f66e0 2023-01-04T18:21:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.458+0000 7f02f97fa700 1 -- 172.21.15.50:0/254056312 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0300014810 con 0x7f03040f66e0 2023-01-04T18:21:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.458+0000 7f030b05a700 1 -- 172.21.15.50:0/254056312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03041089f0 con 0x7f03040f66e0 2023-01-04T18:21:05.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.459+0000 7f030b05a700 1 -- 172.21.15.50:0/254056312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0304045ad0 con 0x7f03040f66e0 2023-01-04T18:21:05.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.459+0000 7f02f97fa700 1 -- 172.21.15.50:0/254056312 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f030001b030 con 0x7f03040f66e0 2023-01-04T18:21:05.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.460+0000 7f02f97fa700 1 --2- 172.21.15.50:0/254056312 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f02ec060be0 0x7f02ec0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:05.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.460+0000 7f02f97fa700 1 -- 172.21.15.50:0/254056312 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f030007bc80 con 0x7f03040f66e0 2023-01-04T18:21:05.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.460+0000 7f02fbfff700 1 --2- 172.21.15.50:0/254056312 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f02ec060be0 0x7f02ec0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:05.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.460+0000 7f02fbfff700 1 --2- 172.21.15.50:0/254056312 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f02ec060be0 0x7f02ec0630a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f02f4009720 tx=0x7f02f4016040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:05.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.464+0000 7f02f97fa700 1 -- 172.21.15.50:0/254056312 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f030004fe20 con 0x7f03040f66e0 2023-01-04T18:21:05.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.655+0000 7f030b05a700 1 -- 172.21.15.50:0/254056312 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f03040fefb0 con 0x7f02ec060be0 2023-01-04T18:21:05.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.656+0000 7f02f97fa700 1 -- 172.21.15.50:0/254056312 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f03040fefb0 con 0x7f02ec060be0 2023-01-04T18:21:05.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.658+0000 7f030b05a700 1 -- 172.21.15.50:0/254056312 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f02ec060be0 msgr2=0x7f02ec0630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:05.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.658+0000 7f030b05a700 1 --2- 172.21.15.50:0/254056312 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f02ec060be0 0x7f02ec0630a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f02f4009720 tx=0x7f02f4016040).stop 2023-01-04T18:21:05.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.658+0000 7f030b05a700 1 -- 172.21.15.50:0/254056312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03040f66e0 msgr2=0x7f0304106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:05.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.658+0000 7f030b05a700 1 --2- 172.21.15.50:0/254056312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03040f66e0 0x7f0304106f30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f030000e7c0 tx=0x7f030000b040).stop 2023-01-04T18:21:05.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.658+0000 7f030b05a700 1 -- 172.21.15.50:0/254056312 shutdown_connections 2023-01-04T18:21:05.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.658+0000 7f030b05a700 1 --2- 172.21.15.50:0/254056312 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f02ec060be0 0x7f02ec0630a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:05.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.658+0000 7f030b05a700 1 --2- 172.21.15.50:0/254056312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03040f66e0 0x7f0304106f30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:05.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.658+0000 7f030b05a700 1 --2- 172.21.15.50:0/254056312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03040f7980 0x7f0304107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:05.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.658+0000 7f030b05a700 1 -- 172.21.15.50:0/254056312 >> 172.21.15.50:0/254056312 conn(0x7f03040f1e40 msgr2=0x7f03040fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:05.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.658+0000 7f030b05a700 1 -- 172.21.15.50:0/254056312 shutdown_connections 2023-01-04T18:21:05.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.658+0000 7f030b05a700 1 -- 172.21.15.50:0/254056312 wait complete. 2023-01-04T18:21:05.672 INFO:teuthology.orchestra.run.smithi050.stdout:true 2023-01-04T18:21:05.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.760+0000 7ffa8b59e700 1 -- 172.21.15.50:0/2230654218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa8c0f6530 msgr2=0x7ffa8c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:05.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.760+0000 7ffa8b59e700 1 --2- 172.21.15.50:0/2230654218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa8c0f6530 0x7ffa8c0f6950 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7ffa7c004660 tx=0x7ffa7c009b30).stop 2023-01-04T18:21:05.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.761+0000 7ffa8b59e700 1 -- 172.21.15.50:0/2230654218 shutdown_connections 2023-01-04T18:21:05.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.761+0000 7ffa8b59e700 1 --2- 172.21.15.50:0/2230654218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa8c0f77d0 0x7ffa8c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:05.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.761+0000 7ffa8b59e700 1 --2- 172.21.15.50:0/2230654218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa8c0f6530 0x7ffa8c0f6950 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:05.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.761+0000 7ffa8b59e700 1 -- 172.21.15.50:0/2230654218 >> 172.21.15.50:0/2230654218 conn(0x7ffa8c0f1c90 msgr2=0x7ffa8c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:05.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.761+0000 7ffa8b59e700 1 -- 172.21.15.50:0/2230654218 shutdown_connections 2023-01-04T18:21:05.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.761+0000 7ffa8b59e700 1 -- 172.21.15.50:0/2230654218 wait complete. 2023-01-04T18:21:05.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.761+0000 7ffa8b59e700 1 Processor -- start 2023-01-04T18:21:05.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.761+0000 7ffa8b59e700 1 -- start start 2023-01-04T18:21:05.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.761+0000 7ffa8b59e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa8c0f6530 0x7ffa8c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:05.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.761+0000 7ffa8b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa8c0f77d0 0x7ffa8c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.761+0000 7ffa8b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c06a380 con 0x7ffa8c0f77d0 2023-01-04T18:21:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.761+0000 7ffa8b59e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c06a4c0 con 0x7ffa8c0f6530 2023-01-04T18:21:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.761+0000 7ffa89d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa8c0f77d0 0x7ffa8c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.762+0000 7ffa89d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa8c0f77d0 0x7ffa8c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43678/0 (socket says 172.21.15.50:43678) 2023-01-04T18:21:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.762+0000 7ffa89d9b700 1 -- 172.21.15.50:0/4052132758 learned_addr learned my addr 172.21.15.50:0/4052132758 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:21:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.762+0000 7ffa8a59c700 1 --2- 172.21.15.50:0/4052132758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa8c0f6530 0x7ffa8c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.762+0000 7ffa89d9b700 1 -- 172.21.15.50:0/4052132758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa8c0f6530 msgr2=0x7ffa8c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.762+0000 7ffa89d9b700 1 --2- 172.21.15.50:0/4052132758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa8c0f6530 0x7ffa8c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.762+0000 7ffa89d9b700 1 -- 172.21.15.50:0/4052132758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c005040 con 0x7ffa8c0f77d0 2023-01-04T18:21:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.762+0000 7ffa8a59c700 1 --2- 172.21.15.50:0/4052132758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa8c0f6530 0x7ffa8c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:21:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.762+0000 7ffa89d9b700 1 --2- 172.21.15.50:0/4052132758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa8c0f77d0 0x7ffa8c069e20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7ffa800026d0 tx=0x7ffa80009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:05.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.762+0000 7ffa7affd700 1 -- 172.21.15.50:0/4052132758 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa80009320 con 0x7ffa8c0f77d0 2023-01-04T18:21:05.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.762+0000 7ffa7affd700 1 -- 172.21.15.50:0/4052132758 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ffa8000f040 con 0x7ffa8c0f77d0 2023-01-04T18:21:05.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.762+0000 7ffa8b59e700 1 -- 172.21.15.50:0/4052132758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8c06a7a0 con 0x7ffa8c0f77d0 2023-01-04T18:21:05.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.762+0000 7ffa7affd700 1 -- 172.21.15.50:0/4052132758 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa800148a0 con 0x7ffa8c0f77d0 2023-01-04T18:21:05.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.762+0000 7ffa8b59e700 1 -- 172.21.15.50:0/4052132758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa8c10ede0 con 0x7ffa8c0f77d0 2023-01-04T18:21:05.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.763+0000 7ffa8b59e700 1 -- 172.21.15.50:0/4052132758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8c045ad0 con 0x7ffa8c0f77d0 2023-01-04T18:21:05.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.763+0000 7ffa7affd700 1 -- 172.21.15.50:0/4052132758 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7ffa80009480 con 0x7ffa8c0f77d0 2023-01-04T18:21:05.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.764+0000 7ffa7affd700 1 --2- 172.21.15.50:0/4052132758 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ffa74060c30 0x7ffa740630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:05.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.764+0000 7ffa7affd700 1 -- 172.21.15.50:0/4052132758 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5812+0+0 (secure 0 0 0) 0x7ffa8007c2a0 con 0x7ffa8c0f77d0 2023-01-04T18:21:05.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.764+0000 7ffa8a59c700 1 --2- 172.21.15.50:0/4052132758 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ffa74060c30 0x7ffa740630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:05.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.764+0000 7ffa8a59c700 1 --2- 172.21.15.50:0/4052132758 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ffa74060c30 0x7ffa740630f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7ffa8c06b730 tx=0x7ffa7c009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:05.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.768+0000 7ffa7affd700 1 -- 172.21.15.50:0/4052132758 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7ffa8004c940 con 0x7ffa8c0f77d0 2023-01-04T18:21:05.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.957+0000 7ffa8b59e700 1 -- 172.21.15.50:0/4052132758 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa8c0feda0 con 0x7ffa74060c30 2023-01-04T18:21:05.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.958+0000 7ffa7affd700 1 -- 172.21.15.50:0/4052132758 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ffa8c0feda0 con 0x7ffa74060c30 2023-01-04T18:21:05.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.960+0000 7ffa8b59e700 1 -- 172.21.15.50:0/4052132758 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ffa74060c30 msgr2=0x7ffa740630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:05.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.960+0000 7ffa8b59e700 1 --2- 172.21.15.50:0/4052132758 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ffa74060c30 0x7ffa740630f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7ffa8c06b730 tx=0x7ffa7c009b30).stop 2023-01-04T18:21:05.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.960+0000 7ffa8b59e700 1 -- 172.21.15.50:0/4052132758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa8c0f77d0 msgr2=0x7ffa8c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:05.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.960+0000 7ffa8b59e700 1 --2- 172.21.15.50:0/4052132758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa8c0f77d0 0x7ffa8c069e20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7ffa800026d0 tx=0x7ffa80009de0).stop 2023-01-04T18:21:05.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.960+0000 7ffa8b59e700 1 -- 172.21.15.50:0/4052132758 shutdown_connections 2023-01-04T18:21:05.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.960+0000 7ffa8b59e700 1 --2- 172.21.15.50:0/4052132758 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ffa74060c30 0x7ffa740630f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:05.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.960+0000 7ffa8b59e700 1 --2- 172.21.15.50:0/4052132758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa8c0f6530 0x7ffa8c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:05.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.960+0000 7ffa8b59e700 1 --2- 172.21.15.50:0/4052132758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa8c0f77d0 0x7ffa8c069e20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:05.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.960+0000 7ffa8b59e700 1 -- 172.21.15.50:0/4052132758 >> 172.21.15.50:0/4052132758 conn(0x7ffa8c0f1c90 msgr2=0x7ffa8c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:05.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.960+0000 7ffa8b59e700 1 -- 172.21.15.50:0/4052132758 shutdown_connections 2023-01-04T18:21:05.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:05.960+0000 7ffa8b59e700 1 -- 172.21.15.50:0/4052132758 wait complete. 2023-01-04T18:21:06.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:04.647730+0000 mgr.smithi050.emnywo (mgr.24517) 184 : cluster [DBG] pgmap v145: 65 pgs: 10 peering, 55 active+clean; 194 MiB data, 972 MiB used, 535 GiB / 536 GiB avail 2023-01-04T18:21:06.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:05.563547+0000 mon.smithi050 (mon.0) 301 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/210 objects degraded (9.048%), 6 pgs degraded) 2023-01-04T18:21:06.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.061+0000 7fdddf70f700 1 -- 172.21.15.50:0/3009599528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd80f6860 msgr2=0x7fddd80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:06.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.061+0000 7fdddf70f700 1 --2- 172.21.15.50:0/3009599528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd80f6860 0x7fddd80f6cc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fddcc004660 tx=0x7fddcc009b30).stop 2023-01-04T18:21:06.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.061+0000 7fdddf70f700 1 -- 172.21.15.50:0/3009599528 shutdown_connections 2023-01-04T18:21:06.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.061+0000 7fdddf70f700 1 --2- 172.21.15.50:0/3009599528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd80f6860 0x7fddd80f6cc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:06.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.061+0000 7fdddf70f700 1 --2- 172.21.15.50:0/3009599528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddd80f55c0 0x7fddd80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:06.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.061+0000 7fdddf70f700 1 -- 172.21.15.50:0/3009599528 >> 172.21.15.50:0/3009599528 conn(0x7fddd80f0d40 msgr2=0x7fddd80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:06.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.061+0000 7fdddf70f700 1 -- 172.21.15.50:0/3009599528 shutdown_connections 2023-01-04T18:21:06.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.061+0000 7fdddf70f700 1 -- 172.21.15.50:0/3009599528 wait complete. 2023-01-04T18:21:06.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.062+0000 7fdddf70f700 1 Processor -- start 2023-01-04T18:21:06.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.062+0000 7fdddf70f700 1 -- start start 2023-01-04T18:21:06.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.062+0000 7fdddf70f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddd80f55c0 0x7fddd8109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:06.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.062+0000 7fdddf70f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd80f6860 0x7fddd810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:06.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.062+0000 7fdddf70f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd80603e0 con 0x7fddd80f6860 2023-01-04T18:21:06.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.062+0000 7fdddf70f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd8060520 con 0x7fddd80f55c0 2023-01-04T18:21:06.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.062+0000 7fdddccaa700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd80f6860 0x7fddd810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:06.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.062+0000 7fdddccaa700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd80f6860 0x7fddd810c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43694/0 (socket says 172.21.15.50:43694) 2023-01-04T18:21:06.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.062+0000 7fdddccaa700 1 -- 172.21.15.50:0/3647243484 learned_addr learned my addr 172.21.15.50:0/3647243484 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:21:06.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.062+0000 7fdddd4ab700 1 --2- 172.21.15.50:0/3647243484 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddd80f55c0 0x7fddd8109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:06.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.063+0000 7fdddccaa700 1 -- 172.21.15.50:0/3647243484 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddd80f55c0 msgr2=0x7fddd8109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:06.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.063+0000 7fdddccaa700 1 --2- 172.21.15.50:0/3647243484 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddd80f55c0 0x7fddd8109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:06.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.063+0000 7fdddccaa700 1 -- 172.21.15.50:0/3647243484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc005040 con 0x7fddd80f6860 2023-01-04T18:21:06.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.063+0000 7fdddd4ab700 1 --2- 172.21.15.50:0/3647243484 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddd80f55c0 0x7fddd8109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:21:06.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.063+0000 7fdddccaa700 1 --2- 172.21.15.50:0/3647243484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd80f6860 0x7fddd810c170 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fddcc009830 tx=0x7fddcc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:06.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.063+0000 7fddc9ffb700 1 -- 172.21.15.50:0/3647243484 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddcc018070 con 0x7fddd80f6860 2023-01-04T18:21:06.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.063+0000 7fddc9ffb700 1 -- 172.21.15.50:0/3647243484 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fddcc01d8e0 con 0x7fddd80f6860 2023-01-04T18:21:06.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.063+0000 7fdddf70f700 1 -- 172.21.15.50:0/3647243484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd810c6c0 con 0x7fddd80f6860 2023-01-04T18:21:06.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.063+0000 7fddc9ffb700 1 -- 172.21.15.50:0/3647243484 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddcc01c540 con 0x7fddd80f6860 2023-01-04T18:21:06.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.063+0000 7fdddf70f700 1 -- 172.21.15.50:0/3647243484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd810cc20 con 0x7fddd80f6860 2023-01-04T18:21:06.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.064+0000 7fdddf70f700 1 -- 172.21.15.50:0/3647243484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd8045ad0 con 0x7fddd80f6860 2023-01-04T18:21:06.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.065+0000 7fddc9ffb700 1 -- 172.21.15.50:0/3647243484 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fddcc01da50 con 0x7fddd80f6860 2023-01-04T18:21:06.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.065+0000 7fddc9ffb700 1 --2- 172.21.15.50:0/3647243484 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fddc4060be0 0x7fddc40630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:06.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.065+0000 7fddc9ffb700 1 -- 172.21.15.50:0/3647243484 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fddcc07dad0 con 0x7fddd80f6860 2023-01-04T18:21:06.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.065+0000 7fdddd4ab700 1 --2- 172.21.15.50:0/3647243484 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fddc4060be0 0x7fddc40630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:06.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.066+0000 7fdddd4ab700 1 --2- 172.21.15.50:0/3647243484 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fddc4060be0 0x7fddc40630a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fddd8060060 tx=0x7fddd4009040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:06.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.069+0000 7fddc9ffb700 1 -- 172.21.15.50:0/3647243484 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fddcc04e170 con 0x7fddd80f6860 2023-01-04T18:21:06.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:05 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:04.647730+0000 mgr.smithi050.emnywo (mgr.24517) 184 : cluster [DBG] pgmap v145: 65 pgs: 10 peering, 55 active+clean; 194 MiB data, 972 MiB used, 535 GiB / 536 GiB avail 2023-01-04T18:21:06.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:05 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:05.563547+0000 mon.smithi050 (mon.0) 301 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/210 objects degraded (9.048%), 6 pgs degraded) 2023-01-04T18:21:06.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.251+0000 7fdddf70f700 1 -- 172.21.15.50:0/3647243484 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fddd80fde60 con 0x7fddc4060be0 2023-01-04T18:21:06.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.261+0000 7fddc9ffb700 1 -- 172.21.15.50:0/3647243484 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fddd80fde60 con 0x7fddc4060be0 2023-01-04T18:21:06.264 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-01-04T18:21:06.265 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager.smithi050 smithi050 *:9093,9094 running (9m) 7s ago 10m 24.6M - 0.20.0 0881eb8f169f b5d3e2678a23 2023-01-04T18:21:06.265 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi050 smithi050 running (2m) 7s ago 10m 7050k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cfe28e5ab81e 2023-01-04T18:21:06.265 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi098 smithi098 running (2m) 2m ago 10m 7042k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cf5f0ca60522 2023-01-04T18:21:06.265 INFO:teuthology.orchestra.run.smithi050.stdout:grafana.smithi050 smithi050 *:3000 running (9m) 7s ago 10m 37.3M - 6.7.4 557c83e11646 7e5dccbafe78 2023-01-04T18:21:06.265 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.ezoiwl smithi050 running (6m) 7s ago 6m 10.0G - 16.2.4 8d91d370c2b8 6c5c5f2be8b9 2023-01-04T18:21:06.265 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.kefmuy smithi050 running (6m) 7s ago 6m 18.6M - 16.2.4 8d91d370c2b8 58cace913b55 2023-01-04T18:21:06.265 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.laynsk smithi098 running (6m) 2m ago 6m 15.7M - 16.2.4 8d91d370c2b8 8ff8af70b989 2023-01-04T18:21:06.265 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.memais smithi098 running (6m) 2m ago 6m 1070M - 16.2.4 8d91d370c2b8 d59d9b4dbf7d 2023-01-04T18:21:06.265 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi050.emnywo smithi050 *:8443,9283 running (3m) 7s ago 11m 445M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d ee677216e754 2023-01-04T18:21:06.265 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi098.vhfzum smithi098 *:8443,9283 running (3m) 2m ago 9m 394M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d f3d98bf0cf66 2023-01-04T18:21:06.265 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi050 smithi050 running (3m) 7s ago 11m 97.2M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 0423819cbaa7 2023-01-04T18:21:06.265 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi098 smithi098 running (3m) 2m ago 9m 39.4M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 12094818aefc 2023-01-04T18:21:06.266 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi050 smithi050 *:9100 running (10m) 7s ago 10m 18.4M - 0.18.1 e5a616e4b9cf 88892b2e5e5a 2023-01-04T18:21:06.266 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi098 smithi098 *:9100 running (9m) 2m ago 9m 18.4M - 0.18.1 e5a616e4b9cf 49bcde8331b6 2023-01-04T18:21:06.266 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (2m) 7s ago 9m 359M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 60dafedcb429 2023-01-04T18:21:06.266 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi050 running (46s) 7s ago 9m 327M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 625bd99952d9 2023-01-04T18:21:06.266 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi050 running (14s) 7s ago 8m 14.4M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d badf94f13661 2023-01-04T18:21:06.266 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi098 running (8m) 2m ago 8m 1186M 4096M 16.2.4 8d91d370c2b8 b02df8e3cb23 2023-01-04T18:21:06.266 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi098 running (8m) 2m ago 8m 876M 4096M 16.2.4 8d91d370c2b8 92273135ca82 2023-01-04T18:21:06.266 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi098 running (7m) 2m ago 7m 971M 4096M 16.2.4 8d91d370c2b8 366d0bfff809 2023-01-04T18:21:06.266 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus.smithi050 smithi050 *:9095 running (4m) 7s ago 10m 66.0M - 2.18.1 de242295e225 7bdcf7a45d34 2023-01-04T18:21:06.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.263+0000 7fdddf70f700 1 -- 172.21.15.50:0/3647243484 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fddc4060be0 msgr2=0x7fddc40630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:06.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.263+0000 7fdddf70f700 1 --2- 172.21.15.50:0/3647243484 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fddc4060be0 0x7fddc40630a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fddd8060060 tx=0x7fddd4009040).stop 2023-01-04T18:21:06.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.263+0000 7fdddf70f700 1 -- 172.21.15.50:0/3647243484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd80f6860 msgr2=0x7fddd810c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:06.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.263+0000 7fdddf70f700 1 --2- 172.21.15.50:0/3647243484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd80f6860 0x7fddd810c170 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fddcc009830 tx=0x7fddcc009b30).stop 2023-01-04T18:21:06.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.263+0000 7fdddf70f700 1 -- 172.21.15.50:0/3647243484 shutdown_connections 2023-01-04T18:21:06.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.263+0000 7fdddf70f700 1 --2- 172.21.15.50:0/3647243484 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fddc4060be0 0x7fddc40630a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:06.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.263+0000 7fdddf70f700 1 --2- 172.21.15.50:0/3647243484 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddd80f55c0 0x7fddd8109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:06.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.263+0000 7fdddf70f700 1 --2- 172.21.15.50:0/3647243484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddd80f6860 0x7fddd810c170 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:06.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.263+0000 7fdddf70f700 1 -- 172.21.15.50:0/3647243484 >> 172.21.15.50:0/3647243484 conn(0x7fddd80f0d40 msgr2=0x7fddd80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:06.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.263+0000 7fdddf70f700 1 -- 172.21.15.50:0/3647243484 shutdown_connections 2023-01-04T18:21:06.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.263+0000 7fdddf70f700 1 -- 172.21.15.50:0/3647243484 wait complete. 2023-01-04T18:21:06.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.364+0000 7fdf89205700 1 -- 172.21.15.50:0/3757514966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf840f96a0 msgr2=0x7fdf840fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:06.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.364+0000 7fdf89205700 1 --2- 172.21.15.50:0/3757514966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf840f96a0 0x7fdf840fbaf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fdf78004660 tx=0x7fdf78009b30).stop 2023-01-04T18:21:06.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.364+0000 7fdf89205700 1 -- 172.21.15.50:0/3757514966 shutdown_connections 2023-01-04T18:21:06.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.364+0000 7fdf89205700 1 --2- 172.21.15.50:0/3757514966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf840f96a0 0x7fdf840fbaf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:06.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.364+0000 7fdf89205700 1 --2- 172.21.15.50:0/3757514966 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf84060270 0x7fdf840f91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:06.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.364+0000 7fdf89205700 1 -- 172.21.15.50:0/3757514966 >> 172.21.15.50:0/3757514966 conn(0x7fdf840f0b90 msgr2=0x7fdf840f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:06.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.364+0000 7fdf89205700 1 -- 172.21.15.50:0/3757514966 shutdown_connections 2023-01-04T18:21:06.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.364+0000 7fdf89205700 1 -- 172.21.15.50:0/3757514966 wait complete. 2023-01-04T18:21:06.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.364+0000 7fdf89205700 1 Processor -- start 2023-01-04T18:21:06.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.364+0000 7fdf89205700 1 -- start start 2023-01-04T18:21:06.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.365+0000 7fdf89205700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf84060270 0x7fdf84106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:06.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.365+0000 7fdf89205700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf840f96a0 0x7fdf84107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:06.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.365+0000 7fdf89205700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf84107840 con 0x7fdf84060270 2023-01-04T18:21:06.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.365+0000 7fdf89205700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf84108050 con 0x7fdf840f96a0 2023-01-04T18:21:06.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.365+0000 7fdf83fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf84060270 0x7fdf84106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:06.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.365+0000 7fdf83fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf84060270 0x7fdf84106d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43708/0 (socket says 172.21.15.50:43708) 2023-01-04T18:21:06.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.365+0000 7fdf83fff700 1 -- 172.21.15.50:0/3950579655 learned_addr learned my addr 172.21.15.50:0/3950579655 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:21:06.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.365+0000 7fdf837fe700 1 --2- 172.21.15.50:0/3950579655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf840f96a0 0x7fdf84107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:06.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.365+0000 7fdf83fff700 1 -- 172.21.15.50:0/3950579655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf840f96a0 msgr2=0x7fdf84107240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:06.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.365+0000 7fdf83fff700 1 --2- 172.21.15.50:0/3950579655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf840f96a0 0x7fdf84107240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:06.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.365+0000 7fdf83fff700 1 -- 172.21.15.50:0/3950579655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf78005040 con 0x7fdf84060270 2023-01-04T18:21:06.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.365+0000 7fdf83fff700 1 --2- 172.21.15.50:0/3950579655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf84060270 0x7fdf84106d50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fdf7400e7f0 tx=0x7fdf7400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:06.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.365+0000 7fdf80ff9700 1 -- 172.21.15.50:0/3950579655 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf740092e0 con 0x7fdf84060270 2023-01-04T18:21:06.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.365+0000 7fdf80ff9700 1 -- 172.21.15.50:0/3950579655 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdf7400f040 con 0x7fdf84060270 2023-01-04T18:21:06.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.365+0000 7fdf89205700 1 -- 172.21.15.50:0/3950579655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf841082d0 con 0x7fdf84060270 2023-01-04T18:21:06.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.365+0000 7fdf80ff9700 1 -- 172.21.15.50:0/3950579655 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf740147e0 con 0x7fdf84060270 2023-01-04T18:21:06.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.365+0000 7fdf89205700 1 -- 172.21.15.50:0/3950579655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf84108810 con 0x7fdf84060270 2023-01-04T18:21:06.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.366+0000 7fdf89205700 1 -- 172.21.15.50:0/3950579655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf84059100 con 0x7fdf84060270 2023-01-04T18:21:06.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.367+0000 7fdf80ff9700 1 -- 172.21.15.50:0/3950579655 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fdf7401b030 con 0x7fdf84060270 2023-01-04T18:21:06.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.367+0000 7fdf80ff9700 1 --2- 172.21.15.50:0/3950579655 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fdf6c060c30 0x7fdf6c0630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:06.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.367+0000 7fdf80ff9700 1 -- 172.21.15.50:0/3950579655 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fdf7407b9b0 con 0x7fdf84060270 2023-01-04T18:21:06.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.367+0000 7fdf837fe700 1 --2- 172.21.15.50:0/3950579655 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fdf6c060c30 0x7fdf6c0630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:06.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.368+0000 7fdf837fe700 1 --2- 172.21.15.50:0/3950579655 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fdf6c060c30 0x7fdf6c0630f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fdf78009d60 tx=0x7fdf78016040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:06.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.372+0000 7fdf80ff9700 1 -- 172.21.15.50:0/3950579655 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fdf7404c080 con 0x7fdf84060270 2023-01-04T18:21:06.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.615+0000 7fdf89205700 1 -- 172.21.15.50:0/3950579655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdf840fed00 con 0x7fdf84060270 2023-01-04T18:21:06.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.617+0000 7fdf80ff9700 1 -- 172.21.15.50:0/3950579655 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+824 (secure 0 0 0) 0x7fdf74019070 con 0x7fdf84060270 2023-01-04T18:21:06.835 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:21:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": { 2023-01-04T18:21:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:21:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:21:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": { 2023-01-04T18:21:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:21:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:21:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": { 2023-01-04T18:21:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 3, 2023-01-04T18:21:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 3 2023-01-04T18:21:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:21:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2023-01-04T18:21:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-01-04T18:21:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:21:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: "overall": { 2023-01-04T18:21:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 7, 2023-01-04T18:21:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7 2023-01-04T18:21:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-01-04T18:21:06.837 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:21:06.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.619+0000 7fdf89205700 1 -- 172.21.15.50:0/3950579655 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fdf6c060c30 msgr2=0x7fdf6c0630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:06.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.619+0000 7fdf89205700 1 --2- 172.21.15.50:0/3950579655 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fdf6c060c30 0x7fdf6c0630f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fdf78009d60 tx=0x7fdf78016040).stop 2023-01-04T18:21:06.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.619+0000 7fdf89205700 1 -- 172.21.15.50:0/3950579655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf84060270 msgr2=0x7fdf84106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:06.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.619+0000 7fdf89205700 1 --2- 172.21.15.50:0/3950579655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf84060270 0x7fdf84106d50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fdf7400e7f0 tx=0x7fdf7400b040).stop 2023-01-04T18:21:06.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.619+0000 7fdf89205700 1 -- 172.21.15.50:0/3950579655 shutdown_connections 2023-01-04T18:21:06.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.619+0000 7fdf89205700 1 --2- 172.21.15.50:0/3950579655 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fdf6c060c30 0x7fdf6c0630f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:06.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.619+0000 7fdf89205700 1 --2- 172.21.15.50:0/3950579655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf84060270 0x7fdf84106d50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:06.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.619+0000 7fdf89205700 1 --2- 172.21.15.50:0/3950579655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf840f96a0 0x7fdf84107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:06.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.619+0000 7fdf89205700 1 -- 172.21.15.50:0/3950579655 >> 172.21.15.50:0/3950579655 conn(0x7fdf840f0b90 msgr2=0x7fdf840f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.619+0000 7fdf89205700 1 -- 172.21.15.50:0/3950579655 shutdown_connections 2023-01-04T18:21:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.619+0000 7fdf89205700 1 -- 172.21.15.50:0/3950579655 wait complete. 2023-01-04T18:21:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.720+0000 7fccb9bca700 1 -- 172.21.15.50:0/2862977762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccb40f5430 msgr2=0x7fccb40f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.720+0000 7fccb9bca700 1 --2- 172.21.15.50:0/2862977762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccb40f5430 0x7fccb40f5850 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fcca8004660 tx=0x7fcca8009b30).stop 2023-01-04T18:21:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.720+0000 7fccb9bca700 1 -- 172.21.15.50:0/2862977762 shutdown_connections 2023-01-04T18:21:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.720+0000 7fccb9bca700 1 --2- 172.21.15.50:0/2862977762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fccb40f66d0 0x7fccb40f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.720+0000 7fccb9bca700 1 --2- 172.21.15.50:0/2862977762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccb40f5430 0x7fccb40f5850 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.720+0000 7fccb9bca700 1 -- 172.21.15.50:0/2862977762 >> 172.21.15.50:0/2862977762 conn(0x7fccb40f0b90 msgr2=0x7fccb40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.720+0000 7fccb9bca700 1 -- 172.21.15.50:0/2862977762 shutdown_connections 2023-01-04T18:21:06.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.720+0000 7fccb9bca700 1 -- 172.21.15.50:0/2862977762 wait complete. 2023-01-04T18:21:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.721+0000 7fccb9bca700 1 Processor -- start 2023-01-04T18:21:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.721+0000 7fccb9bca700 1 -- start start 2023-01-04T18:21:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.721+0000 7fccb9bca700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fccb40f5430 0x7fccb40f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.721+0000 7fccb9bca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccb40f66d0 0x7fccb40f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.721+0000 7fccb9bca700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb40f7f70 con 0x7fccb40f66d0 2023-01-04T18:21:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.721+0000 7fccb9bca700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb40f80b0 con 0x7fccb40f5430 2023-01-04T18:21:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.721+0000 7fccb3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccb40f66d0 0x7fccb40f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.721+0000 7fccb3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccb40f66d0 0x7fccb40f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52006/0 (socket says 172.21.15.50:52006) 2023-01-04T18:21:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.721+0000 7fccb3fff700 1 -- 172.21.15.50:0/3682398981 learned_addr learned my addr 172.21.15.50:0/3682398981 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:21:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.722+0000 7fccb8bc8700 1 --2- 172.21.15.50:0/3682398981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fccb40f5430 0x7fccb40f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:06.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.722+0000 7fccb3fff700 1 -- 172.21.15.50:0/3682398981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fccb40f5430 msgr2=0x7fccb40f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:06.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.722+0000 7fccb3fff700 1 --2- 172.21.15.50:0/3682398981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fccb40f5430 0x7fccb40f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:06.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.722+0000 7fccb3fff700 1 -- 172.21.15.50:0/3682398981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca8005040 con 0x7fccb40f66d0 2023-01-04T18:21:06.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.722+0000 7fccb3fff700 1 --2- 172.21.15.50:0/3682398981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccb40f66d0 0x7fccb40f7a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fcca00026d0 tx=0x7fcca0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:06.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.722+0000 7fccb17fa700 1 -- 172.21.15.50:0/3682398981 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcca00079c0 con 0x7fccb40f66d0 2023-01-04T18:21:06.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.722+0000 7fccb17fa700 1 -- 172.21.15.50:0/3682398981 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcca000f040 con 0x7fccb40f66d0 2023-01-04T18:21:06.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.722+0000 7fccb9bca700 1 -- 172.21.15.50:0/3682398981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb40f8390 con 0x7fccb40f66d0 2023-01-04T18:21:06.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.722+0000 7fccb17fa700 1 -- 172.21.15.50:0/3682398981 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcca0014980 con 0x7fccb40f66d0 2023-01-04T18:21:06.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.722+0000 7fccb9bca700 1 -- 172.21.15.50:0/3682398981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb410edf0 con 0x7fccb40f66d0 2023-01-04T18:21:06.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.723+0000 7fccb9bca700 1 -- 172.21.15.50:0/3682398981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb4045ad0 con 0x7fccb40f66d0 2023-01-04T18:21:06.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.724+0000 7fccb17fa700 1 -- 172.21.15.50:0/3682398981 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fcca0014ae0 con 0x7fccb40f66d0 2023-01-04T18:21:06.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.724+0000 7fccb17fa700 1 --2- 172.21.15.50:0/3682398981 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fcca4060c30 0x7fcca40630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:06.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.724+0000 7fccb17fa700 1 -- 172.21.15.50:0/3682398981 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fcca007bc80 con 0x7fccb40f66d0 2023-01-04T18:21:06.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.724+0000 7fccb8bc8700 1 --2- 172.21.15.50:0/3682398981 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fcca4060c30 0x7fcca40630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:06.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.724+0000 7fccb8bc8700 1 --2- 172.21.15.50:0/3682398981 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fcca4060c30 0x7fcca40630f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fccb40f9320 tx=0x7fcca8009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:06.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.728+0000 7fccb17fa700 1 -- 172.21.15.50:0/3682398981 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fcca004c2a0 con 0x7fccb40f66d0 2023-01-04T18:21:06.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.948+0000 7fccb9bca700 1 -- 172.21.15.50:0/3682398981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fccb40fdbc0 con 0x7fccb40f66d0 2023-01-04T18:21:06.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.949+0000 7fccb17fa700 1 -- 172.21.15.50:0/3682398981 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1793 (secure 0 0 0) 0x7fcca004f8c0 con 0x7fccb40f66d0 2023-01-04T18:21:06.952 INFO:teuthology.orchestra.run.smithi050.stdout:e13 2023-01-04T18:21:06.953 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:21:06.953 INFO:teuthology.orchestra.run.smithi050.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:21:06.953 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-01-04T18:21:06.953 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:21:06.953 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-01-04T18:21:06.953 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-01-04T18:21:06.953 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 10 2023-01-04T18:21:06.953 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 2023-01-04T18:21:06.953 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:21:06.953 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-01-04T18:14:43.958806+0000 2023-01-04T18:21:06.953 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-01-04T18:21:06.954 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-01-04T18:21:06.954 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 60 2023-01-04T18:21:06.954 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-01-04T18:21:06.954 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-01-04T18:21:06.954 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-01-04T18:21:06.954 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-01-04T18:21:06.954 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 0 2023-01-04T18:21:06.954 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:21:06.954 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 1 2023-01-04T18:21:06.954 INFO:teuthology.orchestra.run.smithi050.stdout:in 0 2023-01-04T18:21:06.954 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=14430} 2023-01-04T18:21:06.955 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-01-04T18:21:06.955 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-01-04T18:21:06.955 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-01-04T18:21:06.955 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-01-04T18:21:06.955 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-01-04T18:21:06.955 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data enabled 2023-01-04T18:21:06.955 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-01-04T18:21:06.955 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 1 2023-01-04T18:21:06.955 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.ezoiwl{0:14430} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:21:06.955 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.memais{0:24291} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.98:6824/1196398070,v1:172.21.15.98:6825/1196398070] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:21:06.955 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:21:06.955 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:21:06.956 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2023-01-04T18:21:06.956 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:21:06.956 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.kefmuy{-1:14440} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:21:06.956 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.laynsk{-1:24297} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:21:06.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.950+0000 7fccb9bca700 1 -- 172.21.15.50:0/3682398981 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fcca4060c30 msgr2=0x7fcca40630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:06.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.950+0000 7fccb9bca700 1 --2- 172.21.15.50:0/3682398981 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fcca4060c30 0x7fcca40630f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fccb40f9320 tx=0x7fcca8009b30).stop 2023-01-04T18:21:06.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.950+0000 7fccb9bca700 1 -- 172.21.15.50:0/3682398981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccb40f66d0 msgr2=0x7fccb40f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:06.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.950+0000 7fccb9bca700 1 --2- 172.21.15.50:0/3682398981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccb40f66d0 0x7fccb40f7a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fcca00026d0 tx=0x7fcca0009de0).stop 2023-01-04T18:21:06.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.950+0000 7fccb9bca700 1 -- 172.21.15.50:0/3682398981 shutdown_connections 2023-01-04T18:21:06.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.950+0000 7fccb9bca700 1 --2- 172.21.15.50:0/3682398981 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fcca4060c30 0x7fcca40630f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:06.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.950+0000 7fccb9bca700 1 --2- 172.21.15.50:0/3682398981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fccb40f5430 0x7fccb40f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:06.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.950+0000 7fccb9bca700 1 --2- 172.21.15.50:0/3682398981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccb40f66d0 0x7fccb40f7a10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:06.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.950+0000 7fccb9bca700 1 -- 172.21.15.50:0/3682398981 >> 172.21.15.50:0/3682398981 conn(0x7fccb40f0b90 msgr2=0x7fccb405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:06.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.951+0000 7fccb9bca700 1 -- 172.21.15.50:0/3682398981 shutdown_connections 2023-01-04T18:21:06.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:06.951+0000 7fccb9bca700 1 -- 172.21.15.50:0/3682398981 wait complete. 2023-01-04T18:21:06.959 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2023-01-04T18:21:07.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:05.657134+0000 mgr.smithi050.emnywo (mgr.24517) 185 : audit [DBG] from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:21:07.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:05.959388+0000 mgr.smithi050.emnywo (mgr.24517) 186 : audit [DBG] from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:21:07.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:06.253748+0000 mgr.smithi050.emnywo (mgr.24517) 187 : audit [DBG] from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:21:07.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.054+0000 7f5c0a2fa700 1 -- 172.21.15.50:0/1131289779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c040f66e0 msgr2=0x7f5c040f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:07.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.054+0000 7f5c0a2fa700 1 --2- 172.21.15.50:0/1131289779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c040f66e0 0x7f5c040f6b00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f5bf4004660 tx=0x7f5bf4009b30).stop 2023-01-04T18:21:07.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.054+0000 7f5c0a2fa700 1 -- 172.21.15.50:0/1131289779 shutdown_connections 2023-01-04T18:21:07.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.054+0000 7f5c0a2fa700 1 --2- 172.21.15.50:0/1131289779 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c040f7980 0x7f5c040f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:07.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.054+0000 7f5c0a2fa700 1 --2- 172.21.15.50:0/1131289779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c040f66e0 0x7f5c040f6b00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:07.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.054+0000 7f5c0a2fa700 1 -- 172.21.15.50:0/1131289779 >> 172.21.15.50:0/1131289779 conn(0x7f5c040f1e40 msgr2=0x7f5c040f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:07.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.054+0000 7f5c0a2fa700 1 -- 172.21.15.50:0/1131289779 shutdown_connections 2023-01-04T18:21:07.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.054+0000 7f5c0a2fa700 1 -- 172.21.15.50:0/1131289779 wait complete. 2023-01-04T18:21:07.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.054+0000 7f5c0a2fa700 1 Processor -- start 2023-01-04T18:21:07.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.054+0000 7f5c0a2fa700 1 -- start start 2023-01-04T18:21:07.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.055+0000 7f5c0a2fa700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c040f66e0 0x7f5c0406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:07.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.055+0000 7f5c0a2fa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c040f7980 0x7f5c04069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:07.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.055+0000 7f5c0a2fa700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0406a380 con 0x7f5c040f66e0 2023-01-04T18:21:07.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.055+0000 7f5c0a2fa700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0406a4c0 con 0x7f5c040f7980 2023-01-04T18:21:07.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.055+0000 7f5c03fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c040f66e0 0x7f5c0406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:07.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.055+0000 7f5c03fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c040f66e0 0x7f5c0406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52028/0 (socket says 172.21.15.50:52028) 2023-01-04T18:21:07.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.055+0000 7f5c03fff700 1 -- 172.21.15.50:0/2960882654 learned_addr learned my addr 172.21.15.50:0/2960882654 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:21:07.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.055+0000 7f5c037fe700 1 --2- 172.21.15.50:0/2960882654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c040f7980 0x7f5c04069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:07.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.055+0000 7f5c03fff700 1 -- 172.21.15.50:0/2960882654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c040f7980 msgr2=0x7f5c04069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:07.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.055+0000 7f5c03fff700 1 --2- 172.21.15.50:0/2960882654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c040f7980 0x7f5c04069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:07.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.055+0000 7f5c03fff700 1 -- 172.21.15.50:0/2960882654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf4005040 con 0x7f5c040f66e0 2023-01-04T18:21:07.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.055+0000 7f5c037fe700 1 --2- 172.21.15.50:0/2960882654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c040f7980 0x7f5c04069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:21:07.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.055+0000 7f5c03fff700 1 --2- 172.21.15.50:0/2960882654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c040f66e0 0x7f5c0406b9a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f5bf4009f50 tx=0x7f5bf4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:07.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.055+0000 7f5c00ff9700 1 -- 172.21.15.50:0/2960882654 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bf4018070 con 0x7f5c040f66e0 2023-01-04T18:21:07.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.055+0000 7f5c00ff9700 1 -- 172.21.15.50:0/2960882654 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5bf401d8e0 con 0x7f5c040f66e0 2023-01-04T18:21:07.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.055+0000 7f5c0a2fa700 1 -- 172.21.15.50:0/2960882654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0406a740 con 0x7f5c040f66e0 2023-01-04T18:21:07.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.055+0000 7f5c00ff9700 1 -- 172.21.15.50:0/2960882654 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bf401c4c0 con 0x7f5c040f66e0 2023-01-04T18:21:07.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.056+0000 7f5c0a2fa700 1 -- 172.21.15.50:0/2960882654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0406aca0 con 0x7f5c040f66e0 2023-01-04T18:21:07.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.056+0000 7f5c0a2fa700 1 -- 172.21.15.50:0/2960882654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c04045ad0 con 0x7f5c040f66e0 2023-01-04T18:21:07.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.057+0000 7f5c00ff9700 1 -- 172.21.15.50:0/2960882654 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f5bf401d420 con 0x7f5c040f66e0 2023-01-04T18:21:07.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.057+0000 7f5c00ff9700 1 --2- 172.21.15.50:0/2960882654 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5bf0060be0 0x7f5bf00630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:07.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.057+0000 7f5c00ff9700 1 -- 172.21.15.50:0/2960882654 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f5bf407daf0 con 0x7f5c040f66e0 2023-01-04T18:21:07.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.057+0000 7f5c037fe700 1 --2- 172.21.15.50:0/2960882654 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5bf0060be0 0x7f5bf00630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:07.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.058+0000 7f5c037fe700 1 --2- 172.21.15.50:0/2960882654 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5bf0060be0 0x7f5bf00630a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f5bec004a90 tx=0x7f5bec009040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:07.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.062+0000 7f5c00ff9700 1 -- 172.21.15.50:0/2960882654 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f5bf404e190 con 0x7f5c040f66e0 2023-01-04T18:21:07.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:05.657134+0000 mgr.smithi050.emnywo (mgr.24517) 185 : audit [DBG] from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:21:07.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:05.959388+0000 mgr.smithi050.emnywo (mgr.24517) 186 : audit [DBG] from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:21:07.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:06.253748+0000 mgr.smithi050.emnywo (mgr.24517) 187 : audit [DBG] from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:21:07.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.250+0000 7f5c0a2fa700 1 -- 172.21.15.50:0/2960882654 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c040fefb0 con 0x7f5bf0060be0 2023-01-04T18:21:07.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.251+0000 7f5c00ff9700 1 -- 172.21.15.50:0/2960882654 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5c040fefb0 con 0x7f5bf0060be0 2023-01-04T18:21:07.255 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:21:07.255 INFO:teuthology.orchestra.run.smithi050.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308", 2023-01-04T18:21:07.255 INFO:teuthology.orchestra.run.smithi050.stdout: "in_progress": true, 2023-01-04T18:21:07.255 INFO:teuthology.orchestra.run.smithi050.stdout: "which": "Upgrading all daemon types on all hosts", 2023-01-04T18:21:07.255 INFO:teuthology.orchestra.run.smithi050.stdout: "services_complete": [ 2023-01-04T18:21:07.256 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2023-01-04T18:21:07.256 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr", 2023-01-04T18:21:07.256 INFO:teuthology.orchestra.run.smithi050.stdout: "mon" 2023-01-04T18:21:07.256 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-01-04T18:21:07.256 INFO:teuthology.orchestra.run.smithi050.stdout: "progress": "9/21 daemons upgraded", 2023-01-04T18:21:07.256 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "Currently upgrading osd daemons", 2023-01-04T18:21:07.257 INFO:teuthology.orchestra.run.smithi050.stdout: "is_paused": false 2023-01-04T18:21:07.257 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:21:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.253+0000 7f5c0a2fa700 1 -- 172.21.15.50:0/2960882654 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5bf0060be0 msgr2=0x7f5bf00630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.253+0000 7f5c0a2fa700 1 --2- 172.21.15.50:0/2960882654 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5bf0060be0 0x7f5bf00630a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f5bec004a90 tx=0x7f5bec009040).stop 2023-01-04T18:21:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.253+0000 7f5c0a2fa700 1 -- 172.21.15.50:0/2960882654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c040f66e0 msgr2=0x7f5c0406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.253+0000 7f5c0a2fa700 1 --2- 172.21.15.50:0/2960882654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c040f66e0 0x7f5c0406b9a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f5bf4009f50 tx=0x7f5bf4009b30).stop 2023-01-04T18:21:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.253+0000 7f5c0a2fa700 1 -- 172.21.15.50:0/2960882654 shutdown_connections 2023-01-04T18:21:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.253+0000 7f5c0a2fa700 1 --2- 172.21.15.50:0/2960882654 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5bf0060be0 0x7f5bf00630a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.253+0000 7f5c0a2fa700 1 --2- 172.21.15.50:0/2960882654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c040f66e0 0x7f5c0406b9a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.253+0000 7f5c0a2fa700 1 --2- 172.21.15.50:0/2960882654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c040f7980 0x7f5c04069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.253+0000 7f5c0a2fa700 1 -- 172.21.15.50:0/2960882654 >> 172.21.15.50:0/2960882654 conn(0x7f5c040f1e40 msgr2=0x7f5c040fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:07.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.253+0000 7f5c0a2fa700 1 -- 172.21.15.50:0/2960882654 shutdown_connections 2023-01-04T18:21:07.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:07.253+0000 7f5c0a2fa700 1 -- 172.21.15.50:0/2960882654 wait complete. 2023-01-04T18:21:08.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:06.618603+0000 mon.smithi050 (mon.0) 302 : audit [DBG] from='client.? 172.21.15.50:0/3950579655' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:21:08.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:06.648194+0000 mgr.smithi050.emnywo (mgr.24517) 188 : cluster [DBG] pgmap v146: 65 pgs: 65 active+clean; 194 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 0 op/s 2023-01-04T18:21:08.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:06.950222+0000 mon.smithi050 (mon.0) 303 : audit [DBG] from='client.? 172.21.15.50:0/3682398981' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:21:08.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:07.252376+0000 mgr.smithi050.emnywo (mgr.24517) 189 : audit [DBG] from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:21:08.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:06.618603+0000 mon.smithi050 (mon.0) 302 : audit [DBG] from='client.? 172.21.15.50:0/3950579655' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:21:08.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:06.648194+0000 mgr.smithi050.emnywo (mgr.24517) 188 : cluster [DBG] pgmap v146: 65 pgs: 65 active+clean; 194 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 0 op/s 2023-01-04T18:21:08.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:06.950222+0000 mon.smithi050 (mon.0) 303 : audit [DBG] from='client.? 172.21.15.50:0/3682398981' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:21:08.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:07.252376+0000 mgr.smithi050.emnywo (mgr.24517) 189 : audit [DBG] from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:21:10.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:09 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:08.648707+0000 mgr.smithi050.emnywo (mgr.24517) 190 : cluster [DBG] pgmap v147: 65 pgs: 65 active+clean; 194 MiB data, 976 MiB used, 535 GiB / 536 GiB avail 2023-01-04T18:21:10.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:09 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:08.648707+0000 mgr.smithi050.emnywo (mgr.24517) 190 : cluster [DBG] pgmap v147: 65 pgs: 65 active+clean; 194 MiB data, 976 MiB used, 535 GiB / 536 GiB avail 2023-01-04T18:21:11.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:09.845207+0000 mon.smithi050 (mon.0) 304 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:11.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:09.845207+0000 mon.smithi050 (mon.0) 304 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:12.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:10.649394+0000 mgr.smithi050.emnywo (mgr.24517) 191 : cluster [DBG] pgmap v148: 65 pgs: 65 active+clean; 194 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 0 op/s 2023-01-04T18:21:12.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:10.649394+0000 mgr.smithi050.emnywo (mgr.24517) 191 : cluster [DBG] pgmap v148: 65 pgs: 65 active+clean; 194 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 0 op/s 2023-01-04T18:21:14.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:12.649983+0000 mgr.smithi050.emnywo (mgr.24517) 192 : cluster [DBG] pgmap v149: 65 pgs: 65 active+clean; 194 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 917 B/s rd, 0 op/s 2023-01-04T18:21:14.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:13.929760+0000 mon.smithi050 (mon.0) 305 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-01-04T18:21:14.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:12.649983+0000 mgr.smithi050.emnywo (mgr.24517) 192 : cluster [DBG] pgmap v149: 65 pgs: 65 active+clean; 194 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 917 B/s rd, 0 op/s 2023-01-04T18:21:14.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:13.929760+0000 mon.smithi050 (mon.0) 305 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-01-04T18:21:15.253 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:13.930015+0000 mgr.smithi050.emnywo (mgr.24517) 193 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-01-04T18:21:15.253 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:21:13.931151+0000 mgr.smithi050.emnywo (mgr.24517) 194 : cephadm [INF] Upgrade: osd.3 is safe to restart 2023-01-04T18:21:15.253 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:14.945229+0000 mon.smithi050 (mon.0) 306 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:15.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:13.930015+0000 mgr.smithi050.emnywo (mgr.24517) 193 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-01-04T18:21:15.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:21:13.931151+0000 mgr.smithi050.emnywo (mgr.24517) 194 : cephadm [INF] Upgrade: osd.3 is safe to restart 2023-01-04T18:21:15.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:14.945229+0000 mon.smithi050 (mon.0) 306 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:16.698 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:14.650481+0000 mgr.smithi050.emnywo (mgr.24517) 195 : cluster [DBG] pgmap v150: 65 pgs: 65 active+clean; 194 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 0 op/s 2023-01-04T18:21:16.698 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:21:15.514316+0000 mgr.smithi050.emnywo (mgr.24517) 196 : cephadm [INF] Upgrade: Updating osd.3 2023-01-04T18:21:16.698 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:15.519294+0000 mon.smithi050 (mon.0) 307 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:16.698 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:15.520472+0000 mon.smithi050 (mon.0) 308 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-01-04T18:21:16.698 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:15.521336+0000 mon.smithi050 (mon.0) 309 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:21:16.698 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:21:15.522627+0000 mgr.smithi050.emnywo (mgr.24517) 197 : cephadm [INF] Deploying daemon osd.3 on smithi098 2023-01-04T18:21:16.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:14.650481+0000 mgr.smithi050.emnywo (mgr.24517) 195 : cluster [DBG] pgmap v150: 65 pgs: 65 active+clean; 194 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 0 op/s 2023-01-04T18:21:16.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:21:15.514316+0000 mgr.smithi050.emnywo (mgr.24517) 196 : cephadm [INF] Upgrade: Updating osd.3 2023-01-04T18:21:16.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:15.519294+0000 mon.smithi050 (mon.0) 307 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:16.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:15.520472+0000 mon.smithi050 (mon.0) 308 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-01-04T18:21:16.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:15.521336+0000 mon.smithi050 (mon.0) 309 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:21:16.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:21:15.522627+0000 mgr.smithi050.emnywo (mgr.24517) 197 : cephadm [INF] Deploying daemon osd.3 on smithi098 2023-01-04T18:21:18.081 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:17 smithi098 systemd[1]: Stopping Ceph osd.3 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:21:18.351 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.3[109061]: debug 2023-01-04T18:21:18.082+0000 7fc89b50f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-01-04T18:21:18.352 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.3[109061]: debug 2023-01-04T18:21:18.082+0000 7fc89b50f700 -1 osd.3 76 *** Got signal Terminated *** 2023-01-04T18:21:18.352 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.3[109061]: debug 2023-01-04T18:21:18.082+0000 7fc89b50f700 -1 osd.3 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-01-04T18:21:18.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:16.651027+0000 mgr.smithi050.emnywo (mgr.24517) 198 : cluster [DBG] pgmap v151: 65 pgs: 65 active+clean; 194 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:21:18.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:18.314209+0000 mon.smithi050 (mon.0) 310 : cluster [DBG] osd.3 reported immediately failed by osd.5 2023-01-04T18:21:18.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:18.314255+0000 mon.smithi050 (mon.0) 311 : cluster [INF] osd.3 failed (root=default,host=smithi098) (connection refused reported by osd.5) 2023-01-04T18:21:18.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:18.347294+0000 mon.smithi050 (mon.0) 312 : cluster [DBG] osd.3 reported immediately failed by osd.5 2023-01-04T18:21:18.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:18.347407+0000 mon.smithi050 (mon.0) 313 : cluster [DBG] osd.3 reported immediately failed by osd.5 2023-01-04T18:21:18.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:18.347568+0000 mon.smithi050 (mon.0) 314 : cluster [DBG] osd.3 reported immediately failed by osd.4 2023-01-04T18:21:18.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:18.347674+0000 mon.smithi050 (mon.0) 315 : cluster [DBG] osd.3 reported immediately failed by osd.4 2023-01-04T18:21:18.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:18.347892+0000 mon.smithi050 (mon.0) 316 : cluster [DBG] osd.3 reported immediately failed by osd.4 2023-01-04T18:21:18.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:18.348007+0000 mon.smithi050 (mon.0) 317 : cluster [DBG] osd.3 reported immediately failed by osd.0 2023-01-04T18:21:18.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:18.348118+0000 mon.smithi050 (mon.0) 318 : cluster [DBG] osd.3 reported immediately failed by osd.1 2023-01-04T18:21:18.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:18.348223+0000 mon.smithi050 (mon.0) 319 : cluster [DBG] osd.3 reported immediately failed by osd.2 2023-01-04T18:21:18.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:18.348341+0000 mon.smithi050 (mon.0) 320 : cluster [DBG] osd.3 reported immediately failed by osd.0 2023-01-04T18:21:18.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:18.348461+0000 mon.smithi050 (mon.0) 321 : cluster [DBG] osd.3 reported immediately failed by osd.1 2023-01-04T18:21:18.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:18.348573+0000 mon.smithi050 (mon.0) 322 : cluster [DBG] osd.3 reported immediately failed by osd.2 2023-01-04T18:21:18.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:18.515212+0000 mon.smithi050 (mon.0) 323 : cluster [DBG] osd.3 reported immediately failed by osd.5 2023-01-04T18:21:18.830 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:18 smithi098 bash[125949]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.3 2023-01-04T18:21:18.831 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:18 smithi098 bash[125991]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-3" found: no such container 2023-01-04T18:21:18.831 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:18 smithi098 bash[126003]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.3" found: no such container 2023-01-04T18:21:18.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:16.651027+0000 mgr.smithi050.emnywo (mgr.24517) 198 : cluster [DBG] pgmap v151: 65 pgs: 65 active+clean; 194 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:21:18.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:18.314209+0000 mon.smithi050 (mon.0) 310 : cluster [DBG] osd.3 reported immediately failed by osd.5 2023-01-04T18:21:18.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:18.314255+0000 mon.smithi050 (mon.0) 311 : cluster [INF] osd.3 failed (root=default,host=smithi098) (connection refused reported by osd.5) 2023-01-04T18:21:18.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:18.347294+0000 mon.smithi050 (mon.0) 312 : cluster [DBG] osd.3 reported immediately failed by osd.5 2023-01-04T18:21:18.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:18.347407+0000 mon.smithi050 (mon.0) 313 : cluster [DBG] osd.3 reported immediately failed by osd.5 2023-01-04T18:21:18.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:18.347568+0000 mon.smithi050 (mon.0) 314 : cluster [DBG] osd.3 reported immediately failed by osd.4 2023-01-04T18:21:18.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:18.347674+0000 mon.smithi050 (mon.0) 315 : cluster [DBG] osd.3 reported immediately failed by osd.4 2023-01-04T18:21:18.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:18.347892+0000 mon.smithi050 (mon.0) 316 : cluster [DBG] osd.3 reported immediately failed by osd.4 2023-01-04T18:21:18.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:18.348007+0000 mon.smithi050 (mon.0) 317 : cluster [DBG] osd.3 reported immediately failed by osd.0 2023-01-04T18:21:18.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:18.348118+0000 mon.smithi050 (mon.0) 318 : cluster [DBG] osd.3 reported immediately failed by osd.1 2023-01-04T18:21:18.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:18.348223+0000 mon.smithi050 (mon.0) 319 : cluster [DBG] osd.3 reported immediately failed by osd.2 2023-01-04T18:21:18.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:18.348341+0000 mon.smithi050 (mon.0) 320 : cluster [DBG] osd.3 reported immediately failed by osd.0 2023-01-04T18:21:18.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:18.348461+0000 mon.smithi050 (mon.0) 321 : cluster [DBG] osd.3 reported immediately failed by osd.1 2023-01-04T18:21:18.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:18.348573+0000 mon.smithi050 (mon.0) 322 : cluster [DBG] osd.3 reported immediately failed by osd.2 2023-01-04T18:21:18.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:18.515212+0000 mon.smithi050 (mon.0) 323 : cluster [DBG] osd.3 reported immediately failed by osd.5 2023-01-04T18:21:19.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:18.519904+0000 mon.smithi050 (mon.0) 324 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-01-04T18:21:19.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:18.526536+0000 mon.smithi050 (mon.0) 325 : cluster [DBG] osdmap e77: 6 total, 5 up, 6 in 2023-01-04T18:21:19.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:18.519904+0000 mon.smithi050 (mon.0) 324 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-01-04T18:21:19.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:18.526536+0000 mon.smithi050 (mon.0) 325 : cluster [DBG] osdmap e77: 6 total, 5 up, 6 in 2023-01-04T18:21:20.105 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:20 smithi098 systemd[1]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.3.service: Succeeded. 2023-01-04T18:21:20.105 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:20 smithi098 systemd[1]: Stopped Ceph osd.3 for d98671da-8c5a-11ed-821a-001a4aab830c. 2023-01-04T18:21:20.534 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:20 smithi098 systemd[1]: Starting Ceph osd.3 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:21:20.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:18.651471+0000 mgr.smithi050.emnywo (mgr.24517) 199 : cluster [DBG] pgmap v153: 65 pgs: 16 stale+active+clean, 49 active+clean; 194 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2023-01-04T18:21:20.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:19.532040+0000 mon.smithi050 (mon.0) 326 : cluster [DBG] osdmap e78: 6 total, 5 up, 6 in 2023-01-04T18:21:20.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:18.651471+0000 mgr.smithi050.emnywo (mgr.24517) 199 : cluster [DBG] pgmap v153: 65 pgs: 16 stale+active+clean, 49 active+clean; 194 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2023-01-04T18:21:20.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:19.532040+0000 mon.smithi050 (mon.0) 326 : cluster [DBG] osdmap e78: 6 total, 5 up, 6 in 2023-01-04T18:21:22.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:21.531168+0000 mon.smithi050 (mon.0) 327 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-01-04T18:21:22.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:21.531204+0000 mon.smithi050 (mon.0) 328 : cluster [WRN] Health check failed: Degraded data redundancy: 13/210 objects degraded (6.190%), 5 pgs degraded (PG_DEGRADED) 2023-01-04T18:21:22.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:21.531168+0000 mon.smithi050 (mon.0) 327 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-01-04T18:21:22.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:21.531204+0000 mon.smithi050 (mon.0) 328 : cluster [WRN] Health check failed: Degraded data redundancy: 13/210 objects degraded (6.190%), 5 pgs degraded (PG_DEGRADED) 2023-01-04T18:21:22.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:20.652101+0000 mgr.smithi050.emnywo (mgr.24517) 200 : cluster [DBG] pgmap v155: 65 pgs: 5 active+undersized+degraded, 4 peering, 13 stale+active+clean, 4 active+undersized, 39 active+clean; 194 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 13/210 objects degraded (6.190%) 2023-01-04T18:21:22.831 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:22 smithi098 bash[126232]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-01-04T18:21:22.831 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:22 smithi098 bash[126232]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-01-04T18:21:22.831 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:22 smithi098 bash[126232]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-01-04T18:21:22.831 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:22 smithi098 bash[126232]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-01-04T18:21:22.831 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:22 smithi098 bash[126232]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2023-01-04T18:21:22.831 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:22 smithi098 bash[126232]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-01-04T18:21:22.831 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:22 smithi098 bash[126232]: --> ceph-volume raw activate successful for osd ID: 3 2023-01-04T18:21:22.859 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:20.652101+0000 mgr.smithi050.emnywo (mgr.24517) 200 : cluster [DBG] pgmap v155: 65 pgs: 5 active+undersized+degraded, 4 peering, 13 stale+active+clean, 4 active+undersized, 39 active+clean; 194 MiB data, 976 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 13/210 objects degraded (6.190%) 2023-01-04T18:21:23.930 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:23 smithi098 podman[126676]: 2023-01-04T18:21:23.930 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-3[126692]: debug 2023-01-04T18:21:23.865+0000 7f5c8e057700 1 -- 172.21.15.98:0/372073971 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5605905624e0 con 0x560590529000 2023-01-04T18:21:23.930 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:23 smithi098 bash[126676]: 93c4e177ba97c05a4fed3db29da0d085498dc7310d28234338ef6fe9743deab3 2023-01-04T18:21:24.330 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:23 smithi098 systemd[1]: Started Ceph osd.3 for d98671da-8c5a-11ed-821a-001a4aab830c. 2023-01-04T18:21:24.831 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-3[126692]: debug 2023-01-04T18:21:24.380+0000 7f5c95acd200 -1 Falling back to public interface 2023-01-04T18:21:24.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:22.652704+0000 mgr.smithi050.emnywo (mgr.24517) 201 : cluster [DBG] pgmap v156: 65 pgs: 14 active+undersized+degraded, 4 peering, 20 active+undersized, 27 active+clean; 194 MiB data, 980 MiB used, 535 GiB / 536 GiB avail; 43/210 objects degraded (20.476%) 2023-01-04T18:21:24.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:23.971132+0000 mon.smithi050 (mon.0) 329 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:24.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:23.972056+0000 mon.smithi050 (mon.0) 330 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:21:24.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:23.973435+0000 mon.smithi050 (mon.0) 331 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:21:24.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:23.974331+0000 mon.smithi050 (mon.0) 332 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:21:24.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:24.318992+0000 mon.smithi050 (mon.0) 333 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:25.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:22.652704+0000 mgr.smithi050.emnywo (mgr.24517) 201 : cluster [DBG] pgmap v156: 65 pgs: 14 active+undersized+degraded, 4 peering, 20 active+undersized, 27 active+clean; 194 MiB data, 980 MiB used, 535 GiB / 536 GiB avail; 43/210 objects degraded (20.476%) 2023-01-04T18:21:25.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:23.971132+0000 mon.smithi050 (mon.0) 329 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:25.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:23.972056+0000 mon.smithi050 (mon.0) 330 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:21:25.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:23.973435+0000 mon.smithi050 (mon.0) 331 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:21:25.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:23.974331+0000 mon.smithi050 (mon.0) 332 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:21:25.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:24.318992+0000 mon.smithi050 (mon.0) 333 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:26.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:21:23.975114+0000 mgr.smithi050.emnywo (mgr.24517) 202 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:21:26.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:24.846663+0000 mon.smithi050 (mon.0) 334 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:26.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:24.878369+0000 mon.smithi050 (mon.0) 335 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:21:26.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:24.882134+0000 mon.smithi050 (mon.0) 336 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:21:26.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:21:23.975114+0000 mgr.smithi050.emnywo (mgr.24517) 202 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:21:26.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:24.846663+0000 mon.smithi050 (mon.0) 334 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:26.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:24.878369+0000 mon.smithi050 (mon.0) 335 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:21:26.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:24.882134+0000 mon.smithi050 (mon.0) 336 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:21:27.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:24.653399+0000 mgr.smithi050.emnywo (mgr.24517) 203 : cluster [DBG] pgmap v157: 65 pgs: 16 active+undersized+degraded, 22 active+undersized, 27 active+clean; 194 MiB data, 964 MiB used, 535 GiB / 536 GiB avail; 46/210 objects degraded (21.905%) 2023-01-04T18:21:27.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:25.588409+0000 mon.smithi050 (mon.0) 337 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-01-04T18:21:27.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:24.653399+0000 mgr.smithi050.emnywo (mgr.24517) 203 : cluster [DBG] pgmap v157: 65 pgs: 16 active+undersized+degraded, 22 active+undersized, 27 active+clean; 194 MiB data, 964 MiB used, 535 GiB / 536 GiB avail; 46/210 objects degraded (21.905%) 2023-01-04T18:21:27.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:25.588409+0000 mon.smithi050 (mon.0) 337 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-01-04T18:21:28.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:27.121669+0000 mon.smithi050 (mon.0) 338 : cluster [WRN] Health check update: Degraded data redundancy: 46/210 objects degraded (21.905%), 16 pgs degraded (PG_DEGRADED) 2023-01-04T18:21:28.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:27.121669+0000 mon.smithi050 (mon.0) 338 : cluster [WRN] Health check update: Degraded data redundancy: 46/210 objects degraded (21.905%), 16 pgs degraded (PG_DEGRADED) 2023-01-04T18:21:28.911 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:26.653924+0000 mgr.smithi050.emnywo (mgr.24517) 204 : cluster [DBG] pgmap v158: 65 pgs: 16 active+undersized+degraded, 22 active+undersized, 27 active+clean; 194 MiB data, 964 MiB used, 535 GiB / 536 GiB avail; 46/210 objects degraded (21.905%) 2023-01-04T18:21:28.911 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:28.480012+0000 mon.smithi050 (mon.0) 339 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:29.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:26.653924+0000 mgr.smithi050.emnywo (mgr.24517) 204 : cluster [DBG] pgmap v158: 65 pgs: 16 active+undersized+degraded, 22 active+undersized, 27 active+clean; 194 MiB data, 964 MiB used, 535 GiB / 536 GiB avail; 46/210 objects degraded (21.905%) 2023-01-04T18:21:29.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:28.480012+0000 mon.smithi050 (mon.0) 339 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:30.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:28.654455+0000 mgr.smithi050.emnywo (mgr.24517) 205 : cluster [DBG] pgmap v159: 65 pgs: 16 active+undersized+degraded, 22 active+undersized, 27 active+clean; 194 MiB data, 964 MiB used, 535 GiB / 536 GiB avail; 46/210 objects degraded (21.905%) 2023-01-04T18:21:30.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:28.894963+0000 mon.smithi050 (mon.0) 340 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:30.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:28.901440+0000 mon.smithi050 (mon.0) 341 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:21:30.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:28.904394+0000 mon.smithi050 (mon.0) 342 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:21:30.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:28.905944+0000 mon.smithi050 (mon.0) 343 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:21:30.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:28.907402+0000 mon.smithi050 (mon.0) 344 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:21:30.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:28.908903+0000 mon.smithi050 (mon.0) 345 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-01-04T18:21:30.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:28.909102+0000 mgr.smithi050.emnywo (mgr.24517) 206 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-01-04T18:21:30.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:21:28.910147+0000 mgr.smithi050.emnywo (mgr.24517) 207 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2023-01-04T18:21:30.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:28.654455+0000 mgr.smithi050.emnywo (mgr.24517) 205 : cluster [DBG] pgmap v159: 65 pgs: 16 active+undersized+degraded, 22 active+undersized, 27 active+clean; 194 MiB data, 964 MiB used, 535 GiB / 536 GiB avail; 46/210 objects degraded (21.905%) 2023-01-04T18:21:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:28.894963+0000 mon.smithi050 (mon.0) 340 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:28.901440+0000 mon.smithi050 (mon.0) 341 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:21:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:28.904394+0000 mon.smithi050 (mon.0) 342 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:21:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:28.905944+0000 mon.smithi050 (mon.0) 343 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:21:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:28.907402+0000 mon.smithi050 (mon.0) 344 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:21:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:28.908903+0000 mon.smithi050 (mon.0) 345 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-01-04T18:21:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:28.909102+0000 mgr.smithi050.emnywo (mgr.24517) 206 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-01-04T18:21:30.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:21:28.910147+0000 mgr.smithi050.emnywo (mgr.24517) 207 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2023-01-04T18:21:32.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:30.655174+0000 mgr.smithi050.emnywo (mgr.24517) 208 : cluster [DBG] pgmap v160: 65 pgs: 16 active+undersized+degraded, 22 active+undersized, 27 active+clean; 194 MiB data, 964 MiB used, 535 GiB / 536 GiB avail; 46/210 objects degraded (21.905%) 2023-01-04T18:21:32.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:30.655174+0000 mgr.smithi050.emnywo (mgr.24517) 208 : cluster [DBG] pgmap v160: 65 pgs: 16 active+undersized+degraded, 22 active+undersized, 27 active+clean; 194 MiB data, 964 MiB used, 535 GiB / 536 GiB avail; 46/210 objects degraded (21.905%) 2023-01-04T18:21:34.080 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:33 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-3[126692]: debug 2023-01-04T18:21:33.611+0000 7f5c95acd200 -1 osd.3 76 log_to_monitors {default=true} 2023-01-04T18:21:34.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:32.655883+0000 mgr.smithi050.emnywo (mgr.24517) 209 : cluster [DBG] pgmap v161: 65 pgs: 16 active+undersized+degraded, 22 active+undersized, 27 active+clean; 194 MiB data, 964 MiB used, 535 GiB / 536 GiB avail; 46/210 objects degraded (21.905%) 2023-01-04T18:21:34.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:33.616335+0000 mon.smithi098 (mon.1) 2 : audit [INF] from='osd.3 [v2:172.21.15.98:6800/342235756,v1:172.21.15.98:6801/342235756]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-01-04T18:21:34.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:33.616758+0000 mon.smithi050 (mon.0) 346 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-01-04T18:21:34.580 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:21:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-3[126692]: debug 2023-01-04T18:21:34.143+0000 7f5c85fca700 -1 osd.3 76 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-04T18:21:34.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:32.655883+0000 mgr.smithi050.emnywo (mgr.24517) 209 : cluster [DBG] pgmap v161: 65 pgs: 16 active+undersized+degraded, 22 active+undersized, 27 active+clean; 194 MiB data, 964 MiB used, 535 GiB / 536 GiB avail; 46/210 objects degraded (21.905%) 2023-01-04T18:21:34.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:33.616335+0000 mon.smithi098 (mon.1) 2 : audit [INF] from='osd.3 [v2:172.21.15.98:6800/342235756,v1:172.21.15.98:6801/342235756]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-01-04T18:21:34.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:33.616758+0000 mon.smithi050 (mon.0) 346 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-01-04T18:21:35.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:34.131616+0000 mon.smithi050 (mon.0) 347 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-01-04T18:21:35.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:34.131735+0000 mon.smithi050 (mon.0) 348 : cluster [DBG] osdmap e79: 6 total, 5 up, 6 in 2023-01-04T18:21:35.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:34.132326+0000 mon.smithi098 (mon.1) 3 : audit [INF] from='osd.3 [v2:172.21.15.98:6800/342235756,v1:172.21.15.98:6801/342235756]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:21:35.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:34.132657+0000 mon.smithi050 (mon.0) 349 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:21:35.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:34.131616+0000 mon.smithi050 (mon.0) 347 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-01-04T18:21:35.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:34.131735+0000 mon.smithi050 (mon.0) 348 : cluster [DBG] osdmap e79: 6 total, 5 up, 6 in 2023-01-04T18:21:35.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:34.132326+0000 mon.smithi098 (mon.1) 3 : audit [INF] from='osd.3 [v2:172.21.15.98:6800/342235756,v1:172.21.15.98:6801/342235756]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:21:35.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:34.132657+0000 mon.smithi050 (mon.0) 349 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:21:36.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:34.656593+0000 mgr.smithi050.emnywo (mgr.24517) 210 : cluster [DBG] pgmap v163: 65 pgs: 16 active+undersized+degraded, 22 active+undersized, 27 active+clean; 194 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 46/210 objects degraded (21.905%) 2023-01-04T18:21:36.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:35.133813+0000 mon.smithi050 (mon.0) 350 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-01-04T18:21:36.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:35.137803+0000 mon.smithi050 (mon.0) 351 : cluster [INF] osd.3 [v2:172.21.15.98:6800/342235756,v1:172.21.15.98:6801/342235756] boot 2023-01-04T18:21:36.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:35.137853+0000 mon.smithi050 (mon.0) 352 : cluster [DBG] osdmap e80: 6 total, 6 up, 6 in 2023-01-04T18:21:36.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:35.144124+0000 mon.smithi050 (mon.0) 353 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:21:36.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:34.656593+0000 mgr.smithi050.emnywo (mgr.24517) 210 : cluster [DBG] pgmap v163: 65 pgs: 16 active+undersized+degraded, 22 active+undersized, 27 active+clean; 194 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 46/210 objects degraded (21.905%) 2023-01-04T18:21:36.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:35.133813+0000 mon.smithi050 (mon.0) 350 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-01-04T18:21:36.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:35.137803+0000 mon.smithi050 (mon.0) 351 : cluster [INF] osd.3 [v2:172.21.15.98:6800/342235756,v1:172.21.15.98:6801/342235756] boot 2023-01-04T18:21:36.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:35.137853+0000 mon.smithi050 (mon.0) 352 : cluster [DBG] osdmap e80: 6 total, 6 up, 6 in 2023-01-04T18:21:36.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:35.144124+0000 mon.smithi050 (mon.0) 353 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-01-04T18:21:37.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.370+0000 7f4026af1700 1 -- 172.21.15.50:0/3636955775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40200f55c0 msgr2=0x7f40200f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:37.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.370+0000 7f4026af1700 1 --2- 172.21.15.50:0/3636955775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40200f55c0 0x7f40200f59e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f4014004660 tx=0x7f4014009b30).stop 2023-01-04T18:21:37.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.370+0000 7f4026af1700 1 -- 172.21.15.50:0/3636955775 shutdown_connections 2023-01-04T18:21:37.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.370+0000 7f4026af1700 1 --2- 172.21.15.50:0/3636955775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40200f6860 0x7f40200f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:37.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.370+0000 7f4026af1700 1 --2- 172.21.15.50:0/3636955775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40200f55c0 0x7f40200f59e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:37.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.370+0000 7f4026af1700 1 -- 172.21.15.50:0/3636955775 >> 172.21.15.50:0/3636955775 conn(0x7f40200f0d40 msgr2=0x7f40200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:37.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.370+0000 7f4026af1700 1 -- 172.21.15.50:0/3636955775 shutdown_connections 2023-01-04T18:21:37.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.370+0000 7f4026af1700 1 -- 172.21.15.50:0/3636955775 wait complete. 2023-01-04T18:21:37.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.371+0000 7f4026af1700 1 Processor -- start 2023-01-04T18:21:37.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.371+0000 7f4026af1700 1 -- start start 2023-01-04T18:21:37.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.371+0000 7f4026af1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40200f55c0 0x7f402010c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:37.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.371+0000 7f4026af1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40200f6860 0x7f402010e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:37.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.371+0000 7f4026af1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40200602b0 con 0x7f40200f6860 2023-01-04T18:21:37.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.371+0000 7f4026af1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40200603f0 con 0x7f40200f55c0 2023-01-04T18:21:37.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.371+0000 7f401ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40200f6860 0x7f402010e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:37.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.371+0000 7f401ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40200f6860 0x7f402010e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48722/0 (socket says 172.21.15.50:48722) 2023-01-04T18:21:37.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.371+0000 7f401ffff700 1 -- 172.21.15.50:0/2481504305 learned_addr learned my addr 172.21.15.50:0/2481504305 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:21:37.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.371+0000 7f402488d700 1 --2- 172.21.15.50:0/2481504305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40200f55c0 0x7f402010c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:37.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.371+0000 7f401ffff700 1 -- 172.21.15.50:0/2481504305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40200f55c0 msgr2=0x7f402010c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:37.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.371+0000 7f401ffff700 1 --2- 172.21.15.50:0/2481504305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40200f55c0 0x7f402010c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:37.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.371+0000 7f401ffff700 1 -- 172.21.15.50:0/2481504305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4014005040 con 0x7f40200f6860 2023-01-04T18:21:37.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.371+0000 7f402488d700 1 --2- 172.21.15.50:0/2481504305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40200f55c0 0x7f402010c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:21:37.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.372+0000 7f401ffff700 1 --2- 172.21.15.50:0/2481504305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40200f6860 0x7f402010e5b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f400c00c530 tx=0x7f400c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:37.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.372+0000 7f401d7fa700 1 -- 172.21.15.50:0/2481504305 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f400c00f650 con 0x7f40200f6860 2023-01-04T18:21:37.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.372+0000 7f4026af1700 1 -- 172.21.15.50:0/2481504305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f402010eaa0 con 0x7f40200f6860 2023-01-04T18:21:37.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.372+0000 7f401d7fa700 1 -- 172.21.15.50:0/2481504305 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f400c00fc70 con 0x7f40200f6860 2023-01-04T18:21:37.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.372+0000 7f401d7fa700 1 -- 172.21.15.50:0/2481504305 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f400c012db0 con 0x7f40200f6860 2023-01-04T18:21:37.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.372+0000 7f4026af1700 1 -- 172.21.15.50:0/2481504305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402010ef20 con 0x7f40200f6860 2023-01-04T18:21:37.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.373+0000 7f4026af1700 1 -- 172.21.15.50:0/2481504305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4020045ad0 con 0x7f40200f6860 2023-01-04T18:21:37.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.373+0000 7f401d7fa700 1 -- 172.21.15.50:0/2481504305 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f400c010070 con 0x7f40200f6860 2023-01-04T18:21:37.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.374+0000 7f401d7fa700 1 --2- 172.21.15.50:0/2481504305 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4010060be0 0x7f40100630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:37.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.374+0000 7f401d7fa700 1 -- 172.21.15.50:0/2481504305 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f400c07ba20 con 0x7f40200f6860 2023-01-04T18:21:37.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.374+0000 7f402488d700 1 --2- 172.21.15.50:0/2481504305 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4010060be0 0x7f40100630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:37.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.374+0000 7f402488d700 1 --2- 172.21.15.50:0/2481504305 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4010060be0 0x7f40100630a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f4014009490 tx=0x7f4014009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:37.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.378+0000 7f401d7fa700 1 -- 172.21.15.50:0/2481504305 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f400c047c30 con 0x7f40200f6860 2023-01-04T18:21:37.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:37 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:36.148310+0000 mon.smithi050 (mon.0) 354 : cluster [DBG] osdmap e81: 6 total, 6 up, 6 in 2023-01-04T18:21:37.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.567+0000 7f4026af1700 1 -- 172.21.15.50:0/2481504305 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4020057f10 con 0x7f4010060be0 2023-01-04T18:21:37.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.568+0000 7f401d7fa700 1 -- 172.21.15.50:0/2481504305 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f4020057f10 con 0x7f4010060be0 2023-01-04T18:21:37.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.570+0000 7f4026af1700 1 -- 172.21.15.50:0/2481504305 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4010060be0 msgr2=0x7f40100630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:37.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.570+0000 7f4026af1700 1 --2- 172.21.15.50:0/2481504305 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4010060be0 0x7f40100630a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f4014009490 tx=0x7f4014009b30).stop 2023-01-04T18:21:37.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.570+0000 7f4026af1700 1 -- 172.21.15.50:0/2481504305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40200f6860 msgr2=0x7f402010e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:37.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.570+0000 7f4026af1700 1 --2- 172.21.15.50:0/2481504305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40200f6860 0x7f402010e5b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f400c00c530 tx=0x7f400c007e20).stop 2023-01-04T18:21:37.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.570+0000 7f4026af1700 1 -- 172.21.15.50:0/2481504305 shutdown_connections 2023-01-04T18:21:37.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.570+0000 7f4026af1700 1 --2- 172.21.15.50:0/2481504305 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4010060be0 0x7f40100630a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:37.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.570+0000 7f4026af1700 1 --2- 172.21.15.50:0/2481504305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40200f55c0 0x7f402010c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:37.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.570+0000 7f4026af1700 1 --2- 172.21.15.50:0/2481504305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40200f6860 0x7f402010e5b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:37.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.570+0000 7f4026af1700 1 -- 172.21.15.50:0/2481504305 >> 172.21.15.50:0/2481504305 conn(0x7f40200f0d40 msgr2=0x7f40200fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:37.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.570+0000 7f4026af1700 1 -- 172.21.15.50:0/2481504305 shutdown_connections 2023-01-04T18:21:37.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.570+0000 7f4026af1700 1 -- 172.21.15.50:0/2481504305 wait complete. 2023-01-04T18:21:37.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:37 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:36.148310+0000 mon.smithi050 (mon.0) 354 : cluster [DBG] osdmap e81: 6 total, 6 up, 6 in 2023-01-04T18:21:37.584 INFO:teuthology.orchestra.run.smithi050.stdout:true 2023-01-04T18:21:37.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.673+0000 7fc6a960b700 1 -- 172.21.15.50:0/1472947793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a40f66e0 msgr2=0x7fc6a40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:37.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.673+0000 7fc6a960b700 1 --2- 172.21.15.50:0/1472947793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a40f66e0 0x7fc6a40f6b00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fc698004660 tx=0x7fc698009b30).stop 2023-01-04T18:21:37.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.673+0000 7fc6a960b700 1 -- 172.21.15.50:0/1472947793 shutdown_connections 2023-01-04T18:21:37.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.673+0000 7fc6a960b700 1 --2- 172.21.15.50:0/1472947793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6a40f7980 0x7fc6a40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:37.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.673+0000 7fc6a960b700 1 --2- 172.21.15.50:0/1472947793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a40f66e0 0x7fc6a40f6b00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:37.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.673+0000 7fc6a960b700 1 -- 172.21.15.50:0/1472947793 >> 172.21.15.50:0/1472947793 conn(0x7fc6a40f1e40 msgr2=0x7fc6a40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:37.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.673+0000 7fc6a960b700 1 -- 172.21.15.50:0/1472947793 shutdown_connections 2023-01-04T18:21:37.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.673+0000 7fc6a960b700 1 -- 172.21.15.50:0/1472947793 wait complete. 2023-01-04T18:21:37.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.673+0000 7fc6a960b700 1 Processor -- start 2023-01-04T18:21:37.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.673+0000 7fc6a960b700 1 -- start start 2023-01-04T18:21:37.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.674+0000 7fc6a960b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a40f66e0 0x7fc6a4106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:37.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.674+0000 7fc6a960b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6a40f7980 0x7fc6a4107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:37.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.674+0000 7fc6a960b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a4107a20 con 0x7fc6a40f66e0 2023-01-04T18:21:37.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.674+0000 7fc6a960b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a4107b60 con 0x7fc6a40f7980 2023-01-04T18:21:37.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.674+0000 7fc6a2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a40f66e0 0x7fc6a4106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:37.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.674+0000 7fc6a2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a40f66e0 0x7fc6a4106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48738/0 (socket says 172.21.15.50:48738) 2023-01-04T18:21:37.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.674+0000 7fc6a2ffd700 1 -- 172.21.15.50:0/847331695 learned_addr learned my addr 172.21.15.50:0/847331695 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:21:37.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.674+0000 7fc6a27fc700 1 --2- 172.21.15.50:0/847331695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6a40f7980 0x7fc6a4107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:37.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.674+0000 7fc6a2ffd700 1 -- 172.21.15.50:0/847331695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6a40f7980 msgr2=0x7fc6a4107470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:37.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.674+0000 7fc6a2ffd700 1 --2- 172.21.15.50:0/847331695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6a40f7980 0x7fc6a4107470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:37.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.674+0000 7fc6a2ffd700 1 -- 172.21.15.50:0/847331695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc698005040 con 0x7fc6a40f66e0 2023-01-04T18:21:37.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.674+0000 7fc6a2ffd700 1 --2- 172.21.15.50:0/847331695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a40f66e0 0x7fc6a4106f80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fc698014040 tx=0x7fc69800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:37.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.674+0000 7fc68b7fe700 1 -- 172.21.15.50:0/847331695 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc698019070 con 0x7fc6a40f66e0 2023-01-04T18:21:37.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.674+0000 7fc68b7fe700 1 -- 172.21.15.50:0/847331695 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc69801e420 con 0x7fc6a40f66e0 2023-01-04T18:21:37.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.674+0000 7fc6a960b700 1 -- 172.21.15.50:0/847331695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a41084a0 con 0x7fc6a40f66e0 2023-01-04T18:21:37.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.674+0000 7fc68b7fe700 1 -- 172.21.15.50:0/847331695 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc698014620 con 0x7fc6a40f66e0 2023-01-04T18:21:37.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.675+0000 7fc6a960b700 1 -- 172.21.15.50:0/847331695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a4108980 con 0x7fc6a40f66e0 2023-01-04T18:21:37.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.675+0000 7fc6a960b700 1 -- 172.21.15.50:0/847331695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a4045ad0 con 0x7fc6a40f66e0 2023-01-04T18:21:37.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.676+0000 7fc68b7fe700 1 -- 172.21.15.50:0/847331695 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fc69801e9e0 con 0x7fc6a40f66e0 2023-01-04T18:21:37.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.676+0000 7fc68b7fe700 1 --2- 172.21.15.50:0/847331695 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc68c060be0 0x7fc68c0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:37.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.676+0000 7fc68b7fe700 1 -- 172.21.15.50:0/847331695 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fc69807cfe0 con 0x7fc6a40f66e0 2023-01-04T18:21:37.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.676+0000 7fc6a27fc700 1 --2- 172.21.15.50:0/847331695 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc68c060be0 0x7fc68c0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:37.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.677+0000 7fc6a27fc700 1 --2- 172.21.15.50:0/847331695 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc68c060be0 0x7fc68c0630a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fc694009fd0 tx=0x7fc69400b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:37.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.680+0000 7fc68b7fe700 1 -- 172.21.15.50:0/847331695 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fc6980510b0 con 0x7fc6a40f66e0 2023-01-04T18:21:37.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.869+0000 7fc6a960b700 1 -- 172.21.15.50:0/847331695 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6a40ff020 con 0x7fc68c060be0 2023-01-04T18:21:37.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.870+0000 7fc68b7fe700 1 -- 172.21.15.50:0/847331695 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fc69400f040 con 0x7fc68c060be0 2023-01-04T18:21:37.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.872+0000 7fc6a960b700 1 -- 172.21.15.50:0/847331695 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc68c060be0 msgr2=0x7fc68c0630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:37.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.872+0000 7fc6a960b700 1 --2- 172.21.15.50:0/847331695 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc68c060be0 0x7fc68c0630a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fc694009fd0 tx=0x7fc69400b040).stop 2023-01-04T18:21:37.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.872+0000 7fc6a960b700 1 -- 172.21.15.50:0/847331695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a40f66e0 msgr2=0x7fc6a4106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:37.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.872+0000 7fc6a960b700 1 --2- 172.21.15.50:0/847331695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a40f66e0 0x7fc6a4106f80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fc698014040 tx=0x7fc69800b040).stop 2023-01-04T18:21:37.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.872+0000 7fc6a960b700 1 -- 172.21.15.50:0/847331695 shutdown_connections 2023-01-04T18:21:37.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.872+0000 7fc6a960b700 1 --2- 172.21.15.50:0/847331695 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc68c060be0 0x7fc68c0630a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:37.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.872+0000 7fc6a960b700 1 --2- 172.21.15.50:0/847331695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6a40f66e0 0x7fc6a4106f80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:37.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.872+0000 7fc6a960b700 1 --2- 172.21.15.50:0/847331695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6a40f7980 0x7fc6a4107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:37.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.872+0000 7fc6a960b700 1 -- 172.21.15.50:0/847331695 >> 172.21.15.50:0/847331695 conn(0x7fc6a40f1e40 msgr2=0x7fc6a40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:37.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.872+0000 7fc6a960b700 1 -- 172.21.15.50:0/847331695 shutdown_connections 2023-01-04T18:21:37.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.872+0000 7fc6a960b700 1 -- 172.21.15.50:0/847331695 wait complete. 2023-01-04T18:21:37.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.974+0000 7f36b7eb8700 1 -- 172.21.15.50:0/754047909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b00f55c0 msgr2=0x7f36b00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:37.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.974+0000 7f36b7eb8700 1 --2- 172.21.15.50:0/754047909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b00f55c0 0x7f36b00f59e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f36ac004660 tx=0x7f36ac009b30).stop 2023-01-04T18:21:37.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.974+0000 7f36b7eb8700 1 -- 172.21.15.50:0/754047909 shutdown_connections 2023-01-04T18:21:37.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.974+0000 7f36b7eb8700 1 --2- 172.21.15.50:0/754047909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36b00f6860 0x7f36b00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:37.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.974+0000 7f36b7eb8700 1 --2- 172.21.15.50:0/754047909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b00f55c0 0x7f36b00f59e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:37.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.974+0000 7f36b7eb8700 1 -- 172.21.15.50:0/754047909 >> 172.21.15.50:0/754047909 conn(0x7f36b00f0d40 msgr2=0x7f36b00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:37.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.974+0000 7f36b7eb8700 1 -- 172.21.15.50:0/754047909 shutdown_connections 2023-01-04T18:21:37.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.974+0000 7f36b7eb8700 1 -- 172.21.15.50:0/754047909 wait complete. 2023-01-04T18:21:37.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.975+0000 7f36b7eb8700 1 Processor -- start 2023-01-04T18:21:37.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.975+0000 7f36b7eb8700 1 -- start start 2023-01-04T18:21:37.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.975+0000 7f36b7eb8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b00f55c0 0x7f36b00f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:37.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.975+0000 7f36b7eb8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36b00f6860 0x7f36b00f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:37.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.975+0000 7f36b7eb8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b00f8100 con 0x7f36b00f55c0 2023-01-04T18:21:37.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.975+0000 7f36b7eb8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b00f8240 con 0x7f36b00f6860 2023-01-04T18:21:37.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.975+0000 7f36b5c54700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b00f55c0 0x7f36b00f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:37.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.975+0000 7f36b5c54700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b00f55c0 0x7f36b00f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48754/0 (socket says 172.21.15.50:48754) 2023-01-04T18:21:37.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.975+0000 7f36b5c54700 1 -- 172.21.15.50:0/2926685664 learned_addr learned my addr 172.21.15.50:0/2926685664 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:21:37.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.975+0000 7f36b5453700 1 --2- 172.21.15.50:0/2926685664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36b00f6860 0x7f36b00f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:37.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.975+0000 7f36b5c54700 1 -- 172.21.15.50:0/2926685664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36b00f6860 msgr2=0x7f36b00f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:37.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.975+0000 7f36b5c54700 1 --2- 172.21.15.50:0/2926685664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36b00f6860 0x7f36b00f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:37.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.975+0000 7f36b5c54700 1 -- 172.21.15.50:0/2926685664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac005040 con 0x7f36b00f55c0 2023-01-04T18:21:37.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.975+0000 7f36b5453700 1 --2- 172.21.15.50:0/2926685664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36b00f6860 0x7f36b00f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:21:37.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.975+0000 7f36b5c54700 1 --2- 172.21.15.50:0/2926685664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b00f55c0 0x7f36b00f9720 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f36ac009f50 tx=0x7f36ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:37.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.976+0000 7f36a67fc700 1 -- 172.21.15.50:0/2926685664 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36ac018070 con 0x7f36b00f55c0 2023-01-04T18:21:37.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.976+0000 7f36b7eb8700 1 -- 172.21.15.50:0/2926685664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b00f84c0 con 0x7f36b00f55c0 2023-01-04T18:21:37.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.976+0000 7f36a67fc700 1 -- 172.21.15.50:0/2926685664 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f36ac01d8e0 con 0x7f36b00f55c0 2023-01-04T18:21:37.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.976+0000 7f36a67fc700 1 -- 172.21.15.50:0/2926685664 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36ac01c4c0 con 0x7f36b00f55c0 2023-01-04T18:21:37.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.976+0000 7f36b7eb8700 1 -- 172.21.15.50:0/2926685664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b00f8a20 con 0x7f36b00f55c0 2023-01-04T18:21:37.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.976+0000 7f36b7eb8700 1 -- 172.21.15.50:0/2926685664 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b0045ad0 con 0x7f36b00f55c0 2023-01-04T18:21:37.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.977+0000 7f36a67fc700 1 -- 172.21.15.50:0/2926685664 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f36ac01d420 con 0x7f36b00f55c0 2023-01-04T18:21:37.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.977+0000 7f36a67fc700 1 --2- 172.21.15.50:0/2926685664 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f369c060be0 0x7f369c0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:37.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.977+0000 7f36a67fc700 1 -- 172.21.15.50:0/2926685664 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f36ac07dbc0 con 0x7f36b00f55c0 2023-01-04T18:21:37.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.977+0000 7f36b5453700 1 --2- 172.21.15.50:0/2926685664 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f369c060be0 0x7f369c0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:37.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.978+0000 7f36b5453700 1 --2- 172.21.15.50:0/2926685664 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f369c060be0 0x7f369c0630a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f36a00041d0 tx=0x7f36a0009040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:37.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:37.982+0000 7f36a67fc700 1 -- 172.21.15.50:0/2926685664 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f36ac04e1e0 con 0x7f36b00f55c0 2023-01-04T18:21:38.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.167+0000 7f36b7eb8700 1 -- 172.21.15.50:0/2926685664 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f36b00faca0 con 0x7f369c060be0 2023-01-04T18:21:38.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.176+0000 7f36a67fc700 1 -- 172.21.15.50:0/2926685664 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f36b00faca0 con 0x7f369c060be0 2023-01-04T18:21:38.179 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-01-04T18:21:38.180 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager.smithi050 smithi050 *:9093,9094 running (10m) 39s ago 11m 24.6M - 0.20.0 0881eb8f169f b5d3e2678a23 2023-01-04T18:21:38.180 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi050 smithi050 running (3m) 39s ago 11m 7050k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cfe28e5ab81e 2023-01-04T18:21:38.180 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi098 smithi098 running (3m) 9s ago 10m 7180k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cf5f0ca60522 2023-01-04T18:21:38.180 INFO:teuthology.orchestra.run.smithi050.stdout:grafana.smithi050 smithi050 *:3000 running (9m) 39s ago 10m 37.3M - 6.7.4 557c83e11646 7e5dccbafe78 2023-01-04T18:21:38.180 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.ezoiwl smithi050 running (7m) 39s ago 7m 10.0G - 16.2.4 8d91d370c2b8 6c5c5f2be8b9 2023-01-04T18:21:38.180 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.kefmuy smithi050 running (7m) 39s ago 6m 18.6M - 16.2.4 8d91d370c2b8 58cace913b55 2023-01-04T18:21:38.180 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.laynsk smithi098 running (6m) 9s ago 6m 16.6M - 16.2.4 8d91d370c2b8 8ff8af70b989 2023-01-04T18:21:38.180 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.memais smithi098 running (7m) 9s ago 7m 1172M - 16.2.4 8d91d370c2b8 d59d9b4dbf7d 2023-01-04T18:21:38.180 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi050.emnywo smithi050 *:8443,9283 running (4m) 39s ago 12m 445M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d ee677216e754 2023-01-04T18:21:38.181 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi098.vhfzum smithi098 *:8443,9283 running (4m) 9s ago 10m 396M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d f3d98bf0cf66 2023-01-04T18:21:38.181 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi050 smithi050 running (3m) 39s ago 12m 97.2M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 0423819cbaa7 2023-01-04T18:21:38.181 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi098 smithi098 running (3m) 9s ago 10m 74.0M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 12094818aefc 2023-01-04T18:21:38.181 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi050 smithi050 *:9100 running (10m) 39s ago 10m 18.4M - 0.18.1 e5a616e4b9cf 88892b2e5e5a 2023-01-04T18:21:38.181 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi098 smithi098 *:9100 running (10m) 9s ago 10m 18.4M - 0.18.1 e5a616e4b9cf 49bcde8331b6 2023-01-04T18:21:38.181 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (2m) 39s ago 9m 359M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 60dafedcb429 2023-01-04T18:21:38.181 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi050 running (78s) 39s ago 9m 327M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 625bd99952d9 2023-01-04T18:21:38.181 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi050 running (46s) 39s ago 9m 14.4M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d badf94f13661 2023-01-04T18:21:38.181 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi098 running (14s) 9s ago 8m 15.1M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 93c4e177ba97 2023-01-04T18:21:38.181 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi098 running (8m) 9s ago 8m 1084M 4096M 16.2.4 8d91d370c2b8 92273135ca82 2023-01-04T18:21:38.182 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi098 running (8m) 9s ago 8m 1141M 4096M 16.2.4 8d91d370c2b8 366d0bfff809 2023-01-04T18:21:38.182 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus.smithi050 smithi050 *:9095 running (4m) 39s ago 10m 66.0M - 2.18.1 de242295e225 7bdcf7a45d34 2023-01-04T18:21:38.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.178+0000 7f36b7eb8700 1 -- 172.21.15.50:0/2926685664 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f369c060be0 msgr2=0x7f369c0630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:38.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.178+0000 7f36b7eb8700 1 --2- 172.21.15.50:0/2926685664 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f369c060be0 0x7f369c0630a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f36a00041d0 tx=0x7f36a0009040).stop 2023-01-04T18:21:38.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.178+0000 7f36b7eb8700 1 -- 172.21.15.50:0/2926685664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b00f55c0 msgr2=0x7f36b00f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:38.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.178+0000 7f36b7eb8700 1 --2- 172.21.15.50:0/2926685664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b00f55c0 0x7f36b00f9720 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f36ac009f50 tx=0x7f36ac009b30).stop 2023-01-04T18:21:38.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.178+0000 7f36b7eb8700 1 -- 172.21.15.50:0/2926685664 shutdown_connections 2023-01-04T18:21:38.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.178+0000 7f36b7eb8700 1 --2- 172.21.15.50:0/2926685664 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f369c060be0 0x7f369c0630a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:38.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.178+0000 7f36b7eb8700 1 --2- 172.21.15.50:0/2926685664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b00f55c0 0x7f36b00f9720 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:38.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.178+0000 7f36b7eb8700 1 --2- 172.21.15.50:0/2926685664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36b00f6860 0x7f36b00f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:38.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.178+0000 7f36b7eb8700 1 -- 172.21.15.50:0/2926685664 >> 172.21.15.50:0/2926685664 conn(0x7f36b00f0d40 msgr2=0x7f36b005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:38.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.178+0000 7f36b7eb8700 1 -- 172.21.15.50:0/2926685664 shutdown_connections 2023-01-04T18:21:38.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.178+0000 7f36b7eb8700 1 -- 172.21.15.50:0/2926685664 wait complete. 2023-01-04T18:21:38.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.278+0000 7f5a91f46700 1 -- 172.21.15.50:0/1355412529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a8c0f7980 msgr2=0x7f5a8c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:38.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.278+0000 7f5a91f46700 1 --2- 172.21.15.50:0/1355412529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a8c0f7980 0x7f5a8c0f7de0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f5a80004660 tx=0x7f5a80009b30).stop 2023-01-04T18:21:38.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.278+0000 7f5a91f46700 1 -- 172.21.15.50:0/1355412529 shutdown_connections 2023-01-04T18:21:38.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.278+0000 7f5a91f46700 1 --2- 172.21.15.50:0/1355412529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a8c0f7980 0x7f5a8c0f7de0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:38.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.278+0000 7f5a91f46700 1 --2- 172.21.15.50:0/1355412529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a8c0f66e0 0x7f5a8c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:38.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.278+0000 7f5a91f46700 1 -- 172.21.15.50:0/1355412529 >> 172.21.15.50:0/1355412529 conn(0x7f5a8c0f1e40 msgr2=0x7f5a8c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:38.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.279+0000 7f5a91f46700 1 -- 172.21.15.50:0/1355412529 shutdown_connections 2023-01-04T18:21:38.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.279+0000 7f5a91f46700 1 -- 172.21.15.50:0/1355412529 wait complete. 2023-01-04T18:21:38.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.279+0000 7f5a91f46700 1 Processor -- start 2023-01-04T18:21:38.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.279+0000 7f5a91f46700 1 -- start start 2023-01-04T18:21:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.279+0000 7f5a91f46700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a8c0f66e0 0x7f5a8c106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.279+0000 7f5a91f46700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a8c0f7980 0x7f5a8c107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.279+0000 7f5a91f46700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c107a20 con 0x7f5a8c0f66e0 2023-01-04T18:21:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.279+0000 7f5a91f46700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c107b60 con 0x7f5a8c0f7980 2023-01-04T18:21:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.280+0000 7f5a8b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a8c0f66e0 0x7f5a8c106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.280+0000 7f5a8b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a8c0f66e0 0x7f5a8c106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48768/0 (socket says 172.21.15.50:48768) 2023-01-04T18:21:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.280+0000 7f5a8b7fe700 1 -- 172.21.15.50:0/3992946553 learned_addr learned my addr 172.21.15.50:0/3992946553 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:21:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.280+0000 7f5a8affd700 1 --2- 172.21.15.50:0/3992946553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a8c0f7980 0x7f5a8c107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.280+0000 7f5a8b7fe700 1 -- 172.21.15.50:0/3992946553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a8c0f7980 msgr2=0x7f5a8c107470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.280+0000 7f5a8b7fe700 1 --2- 172.21.15.50:0/3992946553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a8c0f7980 0x7f5a8c107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.280+0000 7f5a8b7fe700 1 -- 172.21.15.50:0/3992946553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a80005040 con 0x7f5a8c0f66e0 2023-01-04T18:21:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.280+0000 7f5a8b7fe700 1 --2- 172.21.15.50:0/3992946553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a8c0f66e0 0x7f5a8c106f80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f5a7c00c790 tx=0x7f5a7c007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.280+0000 7f5a73fff700 1 -- 172.21.15.50:0/3992946553 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a7c00e680 con 0x7f5a8c0f66e0 2023-01-04T18:21:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.280+0000 7f5a91f46700 1 -- 172.21.15.50:0/3992946553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8c108500 con 0x7f5a8c0f66e0 2023-01-04T18:21:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.280+0000 7f5a73fff700 1 -- 172.21.15.50:0/3992946553 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5a7c00eca0 con 0x7f5a8c0f66e0 2023-01-04T18:21:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.280+0000 7f5a73fff700 1 -- 172.21.15.50:0/3992946553 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a7c012d80 con 0x7f5a8c0f66e0 2023-01-04T18:21:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.280+0000 7f5a91f46700 1 -- 172.21.15.50:0/3992946553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8c108ac0 con 0x7f5a8c0f66e0 2023-01-04T18:21:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.281+0000 7f5a91f46700 1 -- 172.21.15.50:0/3992946553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8c045ad0 con 0x7f5a8c0f66e0 2023-01-04T18:21:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.282+0000 7f5a73fff700 1 -- 172.21.15.50:0/3992946553 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f5a7c010070 con 0x7f5a8c0f66e0 2023-01-04T18:21:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.282+0000 7f5a73fff700 1 --2- 172.21.15.50:0/3992946553 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5a74060be0 0x7f5a740630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.282+0000 7f5a73fff700 1 -- 172.21.15.50:0/3992946553 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f5a7c07bd90 con 0x7f5a8c0f66e0 2023-01-04T18:21:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.282+0000 7f5a8affd700 1 --2- 172.21.15.50:0/3992946553 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5a74060be0 0x7f5a740630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.283+0000 7f5a8affd700 1 --2- 172.21.15.50:0/3992946553 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5a74060be0 0x7f5a740630a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f5a80009d60 tx=0x7f5a80009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:38.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.287+0000 7f5a73fff700 1 -- 172.21.15.50:0/3992946553 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f5a7c04fd80 con 0x7f5a8c0f66e0 2023-01-04T18:21:38.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.529+0000 7f5a91f46700 1 -- 172.21.15.50:0/3992946553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5a8c0fef70 con 0x7f5a8c0f66e0 2023-01-04T18:21:38.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.529+0000 7f5a73fff700 1 -- 172.21.15.50:0/3992946553 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+824 (secure 0 0 0) 0x7f5a7c04f970 con 0x7f5a8c0f66e0 2023-01-04T18:21:38.533 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:21:38.533 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": { 2023-01-04T18:21:38.533 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:21:38.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:21:38.533 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": { 2023-01-04T18:21:38.533 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:21:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:21:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": { 2023-01-04T18:21:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 4, 2023-01-04T18:21:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-01-04T18:21:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:21:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2023-01-04T18:21:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-01-04T18:21:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:21:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: "overall": { 2023-01-04T18:21:38.535 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 8, 2023-01-04T18:21:38.535 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2023-01-04T18:21:38.535 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-01-04T18:21:38.535 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:21:38.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.531+0000 7f5a91f46700 1 -- 172.21.15.50:0/3992946553 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5a74060be0 msgr2=0x7f5a740630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:38.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.531+0000 7f5a91f46700 1 --2- 172.21.15.50:0/3992946553 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5a74060be0 0x7f5a740630a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f5a80009d60 tx=0x7f5a80009b30).stop 2023-01-04T18:21:38.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.531+0000 7f5a91f46700 1 -- 172.21.15.50:0/3992946553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a8c0f66e0 msgr2=0x7f5a8c106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:38.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.531+0000 7f5a91f46700 1 --2- 172.21.15.50:0/3992946553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a8c0f66e0 0x7f5a8c106f80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f5a7c00c790 tx=0x7f5a7c007d90).stop 2023-01-04T18:21:38.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.531+0000 7f5a91f46700 1 -- 172.21.15.50:0/3992946553 shutdown_connections 2023-01-04T18:21:38.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.531+0000 7f5a91f46700 1 --2- 172.21.15.50:0/3992946553 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5a74060be0 0x7f5a740630a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:38.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.531+0000 7f5a91f46700 1 --2- 172.21.15.50:0/3992946553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a8c0f66e0 0x7f5a8c106f80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:38.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.531+0000 7f5a91f46700 1 --2- 172.21.15.50:0/3992946553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a8c0f7980 0x7f5a8c107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:38.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.531+0000 7f5a91f46700 1 -- 172.21.15.50:0/3992946553 >> 172.21.15.50:0/3992946553 conn(0x7f5a8c0f1e40 msgr2=0x7f5a8c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:38.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.531+0000 7f5a91f46700 1 -- 172.21.15.50:0/3992946553 shutdown_connections 2023-01-04T18:21:38.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.531+0000 7f5a91f46700 1 -- 172.21.15.50:0/3992946553 wait complete. 2023-01-04T18:21:38.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:36.657141+0000 mgr.smithi050.emnywo (mgr.24517) 211 : cluster [DBG] pgmap v166: 65 pgs: 8 peering, 14 active+undersized+degraded, 16 active+undersized, 27 active+clean; 194 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 39/210 objects degraded (18.571%) 2023-01-04T18:21:38.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:37.146212+0000 mon.smithi050 (mon.0) 355 : cluster [WRN] Health check update: Degraded data redundancy: 39/210 objects degraded (18.571%), 14 pgs degraded (PG_DEGRADED) 2023-01-04T18:21:38.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:37.569159+0000 mgr.smithi050.emnywo (mgr.24517) 212 : audit [DBG] from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:21:38.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:36.657141+0000 mgr.smithi050.emnywo (mgr.24517) 211 : cluster [DBG] pgmap v166: 65 pgs: 8 peering, 14 active+undersized+degraded, 16 active+undersized, 27 active+clean; 194 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 39/210 objects degraded (18.571%) 2023-01-04T18:21:38.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:37.146212+0000 mon.smithi050 (mon.0) 355 : cluster [WRN] Health check update: Degraded data redundancy: 39/210 objects degraded (18.571%), 14 pgs degraded (PG_DEGRADED) 2023-01-04T18:21:38.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:37.569159+0000 mgr.smithi050.emnywo (mgr.24517) 212 : audit [DBG] from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:21:38.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.633+0000 7f2371020700 1 -- 172.21.15.50:0/3329354150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c0f6860 msgr2=0x7f236c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:38.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.633+0000 7f2371020700 1 --2- 172.21.15.50:0/3329354150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c0f6860 0x7f236c0f6cc0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f2354004660 tx=0x7f2354009b30).stop 2023-01-04T18:21:38.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.633+0000 7f2371020700 1 -- 172.21.15.50:0/3329354150 shutdown_connections 2023-01-04T18:21:38.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.633+0000 7f2371020700 1 --2- 172.21.15.50:0/3329354150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c0f6860 0x7f236c0f6cc0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:38.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.633+0000 7f2371020700 1 --2- 172.21.15.50:0/3329354150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f236c0f55c0 0x7f236c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:38.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.633+0000 7f2371020700 1 -- 172.21.15.50:0/3329354150 >> 172.21.15.50:0/3329354150 conn(0x7f236c0f0d40 msgr2=0x7f236c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:38.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.633+0000 7f2371020700 1 -- 172.21.15.50:0/3329354150 shutdown_connections 2023-01-04T18:21:38.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.633+0000 7f2371020700 1 -- 172.21.15.50:0/3329354150 wait complete. 2023-01-04T18:21:38.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.634+0000 7f2371020700 1 Processor -- start 2023-01-04T18:21:38.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.634+0000 7f2371020700 1 -- start start 2023-01-04T18:21:38.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.634+0000 7f2371020700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c0f55c0 0x7f236c109c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:38.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.634+0000 7f2371020700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f236c0f6860 0x7f236c10c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:38.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.634+0000 7f2371020700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c060420 con 0x7f236c0f55c0 2023-01-04T18:21:38.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.634+0000 7f2371020700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c060560 con 0x7f236c0f6860 2023-01-04T18:21:38.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.634+0000 7f236ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c0f55c0 0x7f236c109c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:38.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.634+0000 7f236ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c0f55c0 0x7f236c109c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48796/0 (socket says 172.21.15.50:48796) 2023-01-04T18:21:38.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.634+0000 7f236ad9d700 1 -- 172.21.15.50:0/2432820221 learned_addr learned my addr 172.21.15.50:0/2432820221 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:21:38.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.634+0000 7f236a59c700 1 --2- 172.21.15.50:0/2432820221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f236c0f6860 0x7f236c10c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:38.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.634+0000 7f236ad9d700 1 -- 172.21.15.50:0/2432820221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f236c0f6860 msgr2=0x7f236c10c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:38.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.634+0000 7f236ad9d700 1 --2- 172.21.15.50:0/2432820221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f236c0f6860 0x7f236c10c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:38.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.634+0000 7f236ad9d700 1 -- 172.21.15.50:0/2432820221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2354005040 con 0x7f236c0f55c0 2023-01-04T18:21:38.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.634+0000 7f236ad9d700 1 --2- 172.21.15.50:0/2432820221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c0f55c0 0x7f236c109c40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f235c00c530 tx=0x7f235c007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:38.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.634+0000 7f23637fe700 1 -- 172.21.15.50:0/2432820221 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f235c00f650 con 0x7f236c0f55c0 2023-01-04T18:21:38.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.635+0000 7f2371020700 1 -- 172.21.15.50:0/2432820221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236c10c750 con 0x7f236c0f55c0 2023-01-04T18:21:38.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.635+0000 7f23637fe700 1 -- 172.21.15.50:0/2432820221 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f235c00fc70 con 0x7f236c0f55c0 2023-01-04T18:21:38.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.635+0000 7f23637fe700 1 -- 172.21.15.50:0/2432820221 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f235c012e00 con 0x7f236c0f55c0 2023-01-04T18:21:38.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.635+0000 7f2371020700 1 -- 172.21.15.50:0/2432820221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236c10cce0 con 0x7f236c0f55c0 2023-01-04T18:21:38.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.635+0000 7f2371020700 1 -- 172.21.15.50:0/2432820221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f236c045ad0 con 0x7f236c0f55c0 2023-01-04T18:21:38.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.636+0000 7f23637fe700 1 -- 172.21.15.50:0/2432820221 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f235c019030 con 0x7f236c0f55c0 2023-01-04T18:21:38.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.636+0000 7f23637fe700 1 --2- 172.21.15.50:0/2432820221 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2358060be0 0x7f23580630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:38.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.636+0000 7f23637fe700 1 -- 172.21.15.50:0/2432820221 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f235c07b9b0 con 0x7f236c0f55c0 2023-01-04T18:21:38.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.637+0000 7f236a59c700 1 --2- 172.21.15.50:0/2432820221 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2358060be0 0x7f23580630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:38.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.637+0000 7f236a59c700 1 --2- 172.21.15.50:0/2432820221 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2358060be0 0x7f23580630a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f2354004e30 tx=0x7f2354009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:38.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.641+0000 7f23637fe700 1 -- 172.21.15.50:0/2432820221 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f235c048c30 con 0x7f236c0f55c0 2023-01-04T18:21:38.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.862+0000 7f2371020700 1 -- 172.21.15.50:0/2432820221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f236c0586e0 con 0x7f236c0f55c0 2023-01-04T18:21:38.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.862+0000 7f23637fe700 1 -- 172.21.15.50:0/2432820221 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1793 (secure 0 0 0) 0x7f235c04c080 con 0x7f236c0f55c0 2023-01-04T18:21:38.866 INFO:teuthology.orchestra.run.smithi050.stdout:e13 2023-01-04T18:21:38.866 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:21:38.866 INFO:teuthology.orchestra.run.smithi050.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:21:38.867 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-01-04T18:21:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:21:38.867 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-01-04T18:21:38.867 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-01-04T18:21:38.867 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 10 2023-01-04T18:21:38.867 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 2023-01-04T18:21:38.867 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:21:38.867 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-01-04T18:14:43.958806+0000 2023-01-04T18:21:38.867 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-01-04T18:21:38.868 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-01-04T18:21:38.868 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 60 2023-01-04T18:21:38.868 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-01-04T18:21:38.868 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-01-04T18:21:38.868 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-01-04T18:21:38.868 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-01-04T18:21:38.868 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 0 2023-01-04T18:21:38.868 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:21:38.868 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 1 2023-01-04T18:21:38.868 INFO:teuthology.orchestra.run.smithi050.stdout:in 0 2023-01-04T18:21:38.868 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=14430} 2023-01-04T18:21:38.869 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-01-04T18:21:38.869 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-01-04T18:21:38.869 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-01-04T18:21:38.869 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-01-04T18:21:38.869 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-01-04T18:21:38.869 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data enabled 2023-01-04T18:21:38.869 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-01-04T18:21:38.869 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 1 2023-01-04T18:21:38.869 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.ezoiwl{0:14430} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:21:38.869 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.memais{0:24291} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.98:6824/1196398070,v1:172.21.15.98:6825/1196398070] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:21:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:21:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:21:38.870 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2023-01-04T18:21:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:21:38.870 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.kefmuy{-1:14440} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:21:38.870 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.laynsk{-1:24297} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:21:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.865+0000 7f2371020700 1 -- 172.21.15.50:0/2432820221 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2358060be0 msgr2=0x7f23580630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.865+0000 7f2371020700 1 --2- 172.21.15.50:0/2432820221 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2358060be0 0x7f23580630a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f2354004e30 tx=0x7f2354009b30).stop 2023-01-04T18:21:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.865+0000 7f2371020700 1 -- 172.21.15.50:0/2432820221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c0f55c0 msgr2=0x7f236c109c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.865+0000 7f2371020700 1 --2- 172.21.15.50:0/2432820221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c0f55c0 0x7f236c109c40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f235c00c530 tx=0x7f235c007e10).stop 2023-01-04T18:21:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.865+0000 7f2371020700 1 -- 172.21.15.50:0/2432820221 shutdown_connections 2023-01-04T18:21:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.865+0000 7f2371020700 1 --2- 172.21.15.50:0/2432820221 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2358060be0 0x7f23580630a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.865+0000 7f2371020700 1 --2- 172.21.15.50:0/2432820221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f236c0f55c0 0x7f236c109c40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.865+0000 7f2371020700 1 --2- 172.21.15.50:0/2432820221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f236c0f6860 0x7f236c10c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.865+0000 7f2371020700 1 -- 172.21.15.50:0/2432820221 >> 172.21.15.50:0/2432820221 conn(0x7f236c0f0d40 msgr2=0x7f236c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.865+0000 7f2371020700 1 -- 172.21.15.50:0/2432820221 shutdown_connections 2023-01-04T18:21:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.865+0000 7f2371020700 1 -- 172.21.15.50:0/2432820221 wait complete. 2023-01-04T18:21:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2023-01-04T18:21:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.967+0000 7f4dbf59e700 1 -- 172.21.15.50:0/2120066016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dc00f66d0 msgr2=0x7f4dc00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.967+0000 7f4dbf59e700 1 --2- 172.21.15.50:0/2120066016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dc00f66d0 0x7f4dc00f6b30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f4db4004660 tx=0x7f4db4009b30).stop 2023-01-04T18:21:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.967+0000 7f4dbf59e700 1 -- 172.21.15.50:0/2120066016 shutdown_connections 2023-01-04T18:21:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.967+0000 7f4dbf59e700 1 --2- 172.21.15.50:0/2120066016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dc00f66d0 0x7f4dc00f6b30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.967+0000 7f4dbf59e700 1 --2- 172.21.15.50:0/2120066016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dc00f5430 0x7f4dc00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.967+0000 7f4dbf59e700 1 -- 172.21.15.50:0/2120066016 >> 172.21.15.50:0/2120066016 conn(0x7f4dc00f0b90 msgr2=0x7f4dc00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.967+0000 7f4dbf59e700 1 -- 172.21.15.50:0/2120066016 shutdown_connections 2023-01-04T18:21:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.967+0000 7f4dbf59e700 1 -- 172.21.15.50:0/2120066016 wait complete. 2023-01-04T18:21:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.968+0000 7f4dbf59e700 1 Processor -- start 2023-01-04T18:21:38.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.968+0000 7f4dbf59e700 1 -- start start 2023-01-04T18:21:38.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.968+0000 7f4dbf59e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dc00f5430 0x7f4dc0105ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:38.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.968+0000 7f4dbf59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dc00f66d0 0x7f4dc01061d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:38.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.968+0000 7f4dbf59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc0106780 con 0x7f4dc00f66d0 2023-01-04T18:21:38.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.968+0000 7f4dbf59e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc0106f80 con 0x7f4dc00f5430 2023-01-04T18:21:38.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.968+0000 7f4dbdd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dc00f66d0 0x7f4dc01061d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:38.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.968+0000 7f4dbdd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dc00f66d0 0x7f4dc01061d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48812/0 (socket says 172.21.15.50:48812) 2023-01-04T18:21:38.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.968+0000 7f4dbdd9b700 1 -- 172.21.15.50:0/3780302732 learned_addr learned my addr 172.21.15.50:0/3780302732 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:21:38.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.968+0000 7f4dbe59c700 1 --2- 172.21.15.50:0/3780302732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dc00f5430 0x7f4dc0105ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:38.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.969+0000 7f4dbdd9b700 1 -- 172.21.15.50:0/3780302732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dc00f5430 msgr2=0x7f4dc0105ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:38.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.969+0000 7f4dbdd9b700 1 --2- 172.21.15.50:0/3780302732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dc00f5430 0x7f4dc0105ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:38.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.969+0000 7f4dbdd9b700 1 -- 172.21.15.50:0/3780302732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db4005040 con 0x7f4dc00f66d0 2023-01-04T18:21:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.969+0000 7f4dbdd9b700 1 --2- 172.21.15.50:0/3780302732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dc00f66d0 0x7f4dc01061d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f4db4009830 tx=0x7f4db4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.969+0000 7f4daeffd700 1 -- 172.21.15.50:0/3780302732 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4db4018070 con 0x7f4dc00f66d0 2023-01-04T18:21:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.969+0000 7f4daeffd700 1 -- 172.21.15.50:0/3780302732 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4db401d8e0 con 0x7f4dc00f66d0 2023-01-04T18:21:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.969+0000 7f4dbf59e700 1 -- 172.21.15.50:0/3780302732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc0107200 con 0x7f4dc00f66d0 2023-01-04T18:21:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.969+0000 7f4daeffd700 1 -- 172.21.15.50:0/3780302732 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4db401c480 con 0x7f4dc00f66d0 2023-01-04T18:21:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.969+0000 7f4dbf59e700 1 -- 172.21.15.50:0/3780302732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc0107760 con 0x7f4dc00f66d0 2023-01-04T18:21:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.970+0000 7f4dbf59e700 1 -- 172.21.15.50:0/3780302732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc0059100 con 0x7f4dc00f66d0 2023-01-04T18:21:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.970+0000 7f4daeffd700 1 -- 172.21.15.50:0/3780302732 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f4db401da50 con 0x7f4dc00f66d0 2023-01-04T18:21:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.971+0000 7f4daeffd700 1 --2- 172.21.15.50:0/3780302732 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4da8060c30 0x7f4da80630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:21:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.971+0000 7f4daeffd700 1 -- 172.21.15.50:0/3780302732 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f4db407dbe0 con 0x7f4dc00f66d0 2023-01-04T18:21:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.971+0000 7f4dbe59c700 1 --2- 172.21.15.50:0/3780302732 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4da8060c30 0x7f4da80630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:21:38.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.971+0000 7f4dbe59c700 1 --2- 172.21.15.50:0/3780302732 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4da8060c30 0x7f4da80630f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f4dc00f6530 tx=0x7f4db0009040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:21:38.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:38.975+0000 7f4daeffd700 1 -- 172.21.15.50:0/3780302732 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f4db4051c30 con 0x7f4dc00f66d0 2023-01-04T18:21:39.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:39.165+0000 7f4dbf59e700 1 -- 172.21.15.50:0/3780302732 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4dc00fdc30 con 0x7f4da8060c30 2023-01-04T18:21:39.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:39.166+0000 7f4daeffd700 1 -- 172.21.15.50:0/3780302732 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f4dc00fdc30 con 0x7f4da8060c30 2023-01-04T18:21:39.169 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:21:39.169 INFO:teuthology.orchestra.run.smithi050.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308", 2023-01-04T18:21:39.169 INFO:teuthology.orchestra.run.smithi050.stdout: "in_progress": true, 2023-01-04T18:21:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: "which": "Upgrading all daemon types on all hosts", 2023-01-04T18:21:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: "services_complete": [ 2023-01-04T18:21:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2023-01-04T18:21:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr", 2023-01-04T18:21:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: "mon" 2023-01-04T18:21:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-01-04T18:21:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: "progress": "10/21 daemons upgraded", 2023-01-04T18:21:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "Currently upgrading osd daemons", 2023-01-04T18:21:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: "is_paused": false 2023-01-04T18:21:39.170 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:21:39.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:39.168+0000 7f4dbf59e700 1 -- 172.21.15.50:0/3780302732 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4da8060c30 msgr2=0x7f4da80630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:39.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:39.168+0000 7f4dbf59e700 1 --2- 172.21.15.50:0/3780302732 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4da8060c30 0x7f4da80630f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f4dc00f6530 tx=0x7f4db0009040).stop 2023-01-04T18:21:39.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:39.168+0000 7f4dbf59e700 1 -- 172.21.15.50:0/3780302732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dc00f66d0 msgr2=0x7f4dc01061d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:21:39.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:39.168+0000 7f4dbf59e700 1 --2- 172.21.15.50:0/3780302732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dc00f66d0 0x7f4dc01061d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f4db4009830 tx=0x7f4db4009b30).stop 2023-01-04T18:21:39.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:39.168+0000 7f4dbf59e700 1 -- 172.21.15.50:0/3780302732 shutdown_connections 2023-01-04T18:21:39.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:39.168+0000 7f4dbf59e700 1 --2- 172.21.15.50:0/3780302732 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4da8060c30 0x7f4da80630f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:39.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:39.168+0000 7f4dbf59e700 1 --2- 172.21.15.50:0/3780302732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4dc00f5430 0x7f4dc0105ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:39.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:39.168+0000 7f4dbf59e700 1 --2- 172.21.15.50:0/3780302732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dc00f66d0 0x7f4dc01061d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:21:39.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:39.168+0000 7f4dbf59e700 1 -- 172.21.15.50:0/3780302732 >> 172.21.15.50:0/3780302732 conn(0x7f4dc00f0b90 msgr2=0x7f4dc00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:21:39.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:39.168+0000 7f4dbf59e700 1 -- 172.21.15.50:0/3780302732 shutdown_connections 2023-01-04T18:21:39.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:21:39.168+0000 7f4dbf59e700 1 -- 172.21.15.50:0/3780302732 wait complete. 2023-01-04T18:21:39.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:39 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:37.871784+0000 mgr.smithi050.emnywo (mgr.24517) 213 : audit [DBG] from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:21:39.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:39 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:38.168957+0000 mgr.smithi050.emnywo (mgr.24517) 214 : audit [DBG] from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:21:39.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:39 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:38.530819+0000 mon.smithi050 (mon.0) 356 : audit [DBG] from='client.? 172.21.15.50:0/3992946553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:21:39.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:39 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:38.864011+0000 mon.smithi050 (mon.0) 357 : audit [DBG] from='client.? 172.21.15.50:0/2432820221' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:21:39.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:39 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:37.871784+0000 mgr.smithi050.emnywo (mgr.24517) 213 : audit [DBG] from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:21:39.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:39 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:38.168957+0000 mgr.smithi050.emnywo (mgr.24517) 214 : audit [DBG] from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:21:39.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:39 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:38.530819+0000 mon.smithi050 (mon.0) 356 : audit [DBG] from='client.? 172.21.15.50:0/3992946553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:21:39.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:39 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:38.864011+0000 mon.smithi050 (mon.0) 357 : audit [DBG] from='client.? 172.21.15.50:0/2432820221' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:21:40.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:38.657552+0000 mgr.smithi050.emnywo (mgr.24517) 215 : cluster [DBG] pgmap v167: 65 pgs: 8 peering, 13 active+undersized+degraded, 13 active+undersized, 31 active+clean; 194 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 36/210 objects degraded (17.143%) 2023-01-04T18:21:40.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:39.167134+0000 mgr.smithi050.emnywo (mgr.24517) 216 : audit [DBG] from='client.34300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:21:40.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:39.846942+0000 mon.smithi050 (mon.0) 358 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:40.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:38.657552+0000 mgr.smithi050.emnywo (mgr.24517) 215 : cluster [DBG] pgmap v167: 65 pgs: 8 peering, 13 active+undersized+degraded, 13 active+undersized, 31 active+clean; 194 MiB data, 880 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 36/210 objects degraded (17.143%) 2023-01-04T18:21:40.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:39.167134+0000 mgr.smithi050.emnywo (mgr.24517) 216 : audit [DBG] from='client.34300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:21:40.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:39.846942+0000 mon.smithi050 (mon.0) 358 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:41.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:41.158678+0000 mon.smithi050 (mon.0) 359 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 36/210 objects degraded (17.143%), 13 pgs degraded) 2023-01-04T18:21:41.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:41.158678+0000 mon.smithi050 (mon.0) 359 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 36/210 objects degraded (17.143%), 13 pgs degraded) 2023-01-04T18:21:42.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:40.657999+0000 mgr.smithi050.emnywo (mgr.24517) 217 : cluster [DBG] pgmap v168: 65 pgs: 65 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 941 B/s rd, 2 op/s 2023-01-04T18:21:42.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:40.657999+0000 mgr.smithi050.emnywo (mgr.24517) 217 : cluster [DBG] pgmap v168: 65 pgs: 65 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 941 B/s rd, 2 op/s 2023-01-04T18:21:44.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:42.658424+0000 mgr.smithi050.emnywo (mgr.24517) 218 : cluster [DBG] pgmap v169: 65 pgs: 65 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2023-01-04T18:21:44.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:43.921363+0000 mon.smithi050 (mon.0) 360 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-01-04T18:21:44.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:42.658424+0000 mgr.smithi050.emnywo (mgr.24517) 218 : cluster [DBG] pgmap v169: 65 pgs: 65 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2023-01-04T18:21:44.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:43.921363+0000 mon.smithi050 (mon.0) 360 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-01-04T18:21:45.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:43.921616+0000 mgr.smithi050.emnywo (mgr.24517) 219 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-01-04T18:21:45.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:21:43.922734+0000 mgr.smithi050.emnywo (mgr.24517) 220 : cephadm [INF] Upgrade: osd.4 is safe to restart 2023-01-04T18:21:45.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:43.921616+0000 mgr.smithi050.emnywo (mgr.24517) 219 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-01-04T18:21:45.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:21:43.922734+0000 mgr.smithi050.emnywo (mgr.24517) 220 : cephadm [INF] Upgrade: osd.4 is safe to restart 2023-01-04T18:21:46.463 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:44.658995+0000 mgr.smithi050.emnywo (mgr.24517) 221 : cluster [DBG] pgmap v170: 65 pgs: 65 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:21:46.463 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:21:45.306848+0000 mgr.smithi050.emnywo (mgr.24517) 222 : cephadm [INF] Upgrade: Updating osd.4 2023-01-04T18:21:46.463 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:45.311614+0000 mon.smithi050 (mon.0) 361 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:46.463 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:45.312549+0000 mon.smithi050 (mon.0) 362 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-01-04T18:21:46.463 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:45.313350+0000 mon.smithi050 (mon.0) 363 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:21:46.463 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:21:45.314587+0000 mgr.smithi050.emnywo (mgr.24517) 223 : cephadm [INF] Deploying daemon osd.4 on smithi098 2023-01-04T18:21:46.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:44.658995+0000 mgr.smithi050.emnywo (mgr.24517) 221 : cluster [DBG] pgmap v170: 65 pgs: 65 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:21:46.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:21:45.306848+0000 mgr.smithi050.emnywo (mgr.24517) 222 : cephadm [INF] Upgrade: Updating osd.4 2023-01-04T18:21:46.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:45.311614+0000 mon.smithi050 (mon.0) 361 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:46.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:45.312549+0000 mon.smithi050 (mon.0) 362 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-01-04T18:21:46.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:45.313350+0000 mon.smithi050 (mon.0) 363 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:21:46.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:21:45.314587+0000 mgr.smithi050.emnywo (mgr.24517) 223 : cephadm [INF] Deploying daemon osd.4 on smithi098 2023-01-04T18:21:47.831 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:21:47 smithi098 systemd[1]: Stopping Ceph osd.4 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:21:47.831 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:21:47 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.4[112709]: debug 2023-01-04T18:21:47.770+0000 7f6d3b66d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-01-04T18:21:47.831 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:21:47 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.4[112709]: debug 2023-01-04T18:21:47.770+0000 7f6d3b66d700 -1 osd.4 81 *** Got signal Terminated *** 2023-01-04T18:21:47.831 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:21:47 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.4[112709]: debug 2023-01-04T18:21:47.770+0000 7f6d3b66d700 -1 osd.4 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-01-04T18:21:48.295 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:21:48 smithi098 bash[128431]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.4 2023-01-04T18:21:48.580 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:21:48 smithi098 bash[128478]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-4" found: no such container 2023-01-04T18:21:48.580 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:21:48 smithi098 bash[128491]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.4" found: no such container 2023-01-04T18:21:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:46.659467+0000 mgr.smithi050.emnywo (mgr.24517) 224 : cluster [DBG] pgmap v171: 65 pgs: 65 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s 2023-01-04T18:21:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:48.038327+0000 mon.smithi050 (mon.0) 364 : cluster [DBG] osd.4 reported immediately failed by osd.5 2023-01-04T18:21:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:48.038381+0000 mon.smithi050 (mon.0) 365 : cluster [INF] osd.4 failed (root=default,host=smithi098) (connection refused reported by osd.5) 2023-01-04T18:21:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:48.038609+0000 mon.smithi050 (mon.0) 366 : cluster [DBG] osd.4 reported immediately failed by osd.5 2023-01-04T18:21:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:48.038710+0000 mon.smithi050 (mon.0) 367 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-01-04T18:21:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:48.038817+0000 mon.smithi050 (mon.0) 368 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-01-04T18:21:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:48.038913+0000 mon.smithi050 (mon.0) 369 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-01-04T18:21:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:48.039056+0000 mon.smithi050 (mon.0) 370 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-01-04T18:21:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:48.039211+0000 mon.smithi050 (mon.0) 371 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-01-04T18:21:48.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:48.039342+0000 mon.smithi050 (mon.0) 372 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-01-04T18:21:48.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:48.039435+0000 mon.smithi050 (mon.0) 373 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-01-04T18:21:48.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:48.039568+0000 mon.smithi050 (mon.0) 374 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-01-04T18:21:48.661 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:46.659467+0000 mgr.smithi050.emnywo (mgr.24517) 224 : cluster [DBG] pgmap v171: 65 pgs: 65 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s 2023-01-04T18:21:48.661 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:48.038327+0000 mon.smithi050 (mon.0) 364 : cluster [DBG] osd.4 reported immediately failed by osd.5 2023-01-04T18:21:48.661 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:48.038381+0000 mon.smithi050 (mon.0) 365 : cluster [INF] osd.4 failed (root=default,host=smithi098) (connection refused reported by osd.5) 2023-01-04T18:21:48.661 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:48.038609+0000 mon.smithi050 (mon.0) 366 : cluster [DBG] osd.4 reported immediately failed by osd.5 2023-01-04T18:21:48.661 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:48.038710+0000 mon.smithi050 (mon.0) 367 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-01-04T18:21:48.661 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:48.038817+0000 mon.smithi050 (mon.0) 368 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-01-04T18:21:48.661 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:48.038913+0000 mon.smithi050 (mon.0) 369 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-01-04T18:21:48.661 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:48.039056+0000 mon.smithi050 (mon.0) 370 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-01-04T18:21:48.661 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:48.039211+0000 mon.smithi050 (mon.0) 371 : cluster [DBG] osd.4 reported immediately failed by osd.0 2023-01-04T18:21:48.662 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:48.039342+0000 mon.smithi050 (mon.0) 372 : cluster [DBG] osd.4 reported immediately failed by osd.1 2023-01-04T18:21:48.662 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:48.039435+0000 mon.smithi050 (mon.0) 373 : cluster [DBG] osd.4 reported immediately failed by osd.2 2023-01-04T18:21:48.662 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:48.039568+0000 mon.smithi050 (mon.0) 374 : cluster [DBG] osd.4 reported immediately failed by osd.3 2023-01-04T18:21:49.536 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:49 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:48.311999+0000 mon.smithi050 (mon.0) 375 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-01-04T18:21:49.536 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:49 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:48.316521+0000 mon.smithi050 (mon.0) 376 : cluster [DBG] osdmap e82: 6 total, 5 up, 6 in 2023-01-04T18:21:49.536 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:49 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:49.317457+0000 mon.smithi050 (mon.0) 377 : cluster [DBG] osdmap e83: 6 total, 5 up, 6 in 2023-01-04T18:21:49.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:49 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:48.311999+0000 mon.smithi050 (mon.0) 375 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-01-04T18:21:49.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:49 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:48.316521+0000 mon.smithi050 (mon.0) 376 : cluster [DBG] osdmap e82: 6 total, 5 up, 6 in 2023-01-04T18:21:49.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:49 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:49.317457+0000 mon.smithi050 (mon.0) 377 : cluster [DBG] osdmap e83: 6 total, 5 up, 6 in 2023-01-04T18:21:50.331 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:21:49 smithi098 systemd[1]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.4.service: Succeeded. 2023-01-04T18:21:50.331 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:21:49 smithi098 systemd[1]: Stopped Ceph osd.4 for d98671da-8c5a-11ed-821a-001a4aab830c. 2023-01-04T18:21:50.331 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:21:50 smithi098 systemd[1]: Starting Ceph osd.4 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:21:50.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:48.659827+0000 mgr.smithi050.emnywo (mgr.24517) 225 : cluster [DBG] pgmap v173: 65 pgs: 6 stale+active+clean, 59 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2023-01-04T18:21:50.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:49.963519+0000 mon.smithi050 (mon.0) 378 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:50.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:48.659827+0000 mgr.smithi050.emnywo (mgr.24517) 225 : cluster [DBG] pgmap v173: 65 pgs: 6 stale+active+clean, 59 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2023-01-04T18:21:50.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:49.963519+0000 mon.smithi050 (mon.0) 378 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:51.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:51.349895+0000 mon.smithi050 (mon.0) 379 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-01-04T18:21:51.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:51.349937+0000 mon.smithi050 (mon.0) 380 : cluster [WRN] Health check failed: Degraded data redundancy: 10/210 objects degraded (4.762%), 6 pgs degraded (PG_DEGRADED) 2023-01-04T18:21:51.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:51 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:51.349895+0000 mon.smithi050 (mon.0) 379 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-01-04T18:21:51.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:51 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:51.349937+0000 mon.smithi050 (mon.0) 380 : cluster [WRN] Health check failed: Degraded data redundancy: 10/210 objects degraded (4.762%), 6 pgs degraded (PG_DEGRADED) 2023-01-04T18:21:52.682 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:50.660409+0000 mgr.smithi050.emnywo (mgr.24517) 226 : cluster [DBG] pgmap v175: 65 pgs: 6 active+undersized+degraded, 11 peering, 2 stale+active+clean, 9 active+undersized, 37 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 10/210 objects degraded (4.762%) 2023-01-04T18:21:52.683 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:21:52 smithi098 bash[128711]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-01-04T18:21:52.683 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:21:52 smithi098 bash[128711]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-01-04T18:21:52.683 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:21:52 smithi098 bash[128711]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-01-04T18:21:52.683 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:21:52 smithi098 bash[128711]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-01-04T18:21:52.683 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:21:52 smithi098 bash[128711]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2023-01-04T18:21:52.684 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:21:52 smithi098 bash[128711]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-01-04T18:21:52.684 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:21:52 smithi098 bash[128711]: --> ceph-volume raw activate successful for osd ID: 4 2023-01-04T18:21:52.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:50.660409+0000 mgr.smithi050.emnywo (mgr.24517) 226 : cluster [DBG] pgmap v175: 65 pgs: 6 active+undersized+degraded, 11 peering, 2 stale+active+clean, 9 active+undersized, 37 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 10/210 objects degraded (4.762%) 2023-01-04T18:21:53.933 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:21:53 smithi098 podman[129165]: 2023-01-04T18:21:53.934 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:21:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-4[129181]: debug 2023-01-04T18:21:53.866+0000 7f59a5b55700 1 -- 172.21.15.98:0/1892147214 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556f8791c4e0 con 0x556f878e3000 2023-01-04T18:21:53.934 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:21:53 smithi098 bash[129165]: 9398016f5e814c0badf1289641eddf1782a9b3c38ea68b1f0f480aa77be5937a 2023-01-04T18:21:54.330 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:21:53 smithi098 systemd[1]: Started Ceph osd.4 for d98671da-8c5a-11ed-821a-001a4aab830c. 2023-01-04T18:21:54.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:52.661121+0000 mgr.smithi050.emnywo (mgr.24517) 227 : cluster [DBG] pgmap v176: 65 pgs: 9 active+undersized+degraded, 11 peering, 14 active+undersized, 31 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 17/210 objects degraded (8.095%) 2023-01-04T18:21:54.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:53.974963+0000 mon.smithi050 (mon.0) 381 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:54.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:53.975860+0000 mon.smithi050 (mon.0) 382 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:21:54.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:53.977279+0000 mon.smithi050 (mon.0) 383 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:21:54.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:53.978147+0000 mon.smithi050 (mon.0) 384 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:21:54.830 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:21:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-4[129181]: debug 2023-01-04T18:21:54.382+0000 7f59ad5cb200 -1 Falling back to public interface 2023-01-04T18:21:54.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:52.661121+0000 mgr.smithi050.emnywo (mgr.24517) 227 : cluster [DBG] pgmap v176: 65 pgs: 9 active+undersized+degraded, 11 peering, 14 active+undersized, 31 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 17/210 objects degraded (8.095%) 2023-01-04T18:21:54.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:53.974963+0000 mon.smithi050 (mon.0) 381 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:54.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:53.975860+0000 mon.smithi050 (mon.0) 382 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:21:54.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:53.977279+0000 mon.smithi050 (mon.0) 383 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:21:54.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:53.978147+0000 mon.smithi050 (mon.0) 384 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:21:55.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:21:53.978905+0000 mgr.smithi050.emnywo (mgr.24517) 228 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:21:55.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:54.846993+0000 mon.smithi050 (mon.0) 385 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:55.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:21:53.978905+0000 mgr.smithi050.emnywo (mgr.24517) 228 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:21:55.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:54.846993+0000 mon.smithi050 (mon.0) 385 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:56.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:54.661708+0000 mgr.smithi050.emnywo (mgr.24517) 229 : cluster [DBG] pgmap v177: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 35/210 objects degraded (16.667%) 2023-01-04T18:21:56.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:55.407226+0000 mon.smithi050 (mon.0) 386 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-01-04T18:21:56.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:54.661708+0000 mgr.smithi050.emnywo (mgr.24517) 229 : cluster [DBG] pgmap v177: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 35/210 objects degraded (16.667%) 2023-01-04T18:21:56.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:55.407226+0000 mon.smithi050 (mon.0) 386 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-01-04T18:21:57.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:57.127754+0000 mon.smithi050 (mon.0) 387 : cluster [WRN] Health check update: Degraded data redundancy: 35/210 objects degraded (16.667%), 14 pgs degraded (PG_DEGRADED) 2023-01-04T18:21:57.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:57.127754+0000 mon.smithi050 (mon.0) 387 : cluster [WRN] Health check update: Degraded data redundancy: 35/210 objects degraded (16.667%), 14 pgs degraded (PG_DEGRADED) 2023-01-04T18:21:58.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:56.662256+0000 mgr.smithi050.emnywo (mgr.24517) 230 : cluster [DBG] pgmap v178: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 613 B/s rd, 1 op/s; 35/210 objects degraded (16.667%) 2023-01-04T18:21:58.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:58.040600+0000 mon.smithi050 (mon.0) 388 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:58.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:58.044492+0000 mon.smithi050 (mon.0) 389 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:58.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:58.050694+0000 mon.smithi050 (mon.0) 390 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:21:58.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:58.053540+0000 mon.smithi050 (mon.0) 391 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:21:58.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:58.055038+0000 mon.smithi050 (mon.0) 392 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:21:58.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:58.056454+0000 mon.smithi050 (mon.0) 393 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:21:58.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:58.058032+0000 mon.smithi050 (mon.0) 394 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-01-04T18:21:58.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:56.662256+0000 mgr.smithi050.emnywo (mgr.24517) 230 : cluster [DBG] pgmap v178: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 613 B/s rd, 1 op/s; 35/210 objects degraded (16.667%) 2023-01-04T18:21:58.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:58.040600+0000 mon.smithi050 (mon.0) 388 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:58.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:58.044492+0000 mon.smithi050 (mon.0) 389 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:21:58.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:58.050694+0000 mon.smithi050 (mon.0) 390 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:21:58.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:58.053540+0000 mon.smithi050 (mon.0) 391 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:21:58.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:58.055038+0000 mon.smithi050 (mon.0) 392 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:21:58.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:58.056454+0000 mon.smithi050 (mon.0) 393 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:21:58.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:58.058032+0000 mon.smithi050 (mon.0) 394 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-01-04T18:21:59.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:21:58.058204+0000 mgr.smithi050.emnywo (mgr.24517) 231 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-01-04T18:21:59.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:21:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:21:58.058999+0000 mgr.smithi050.emnywo (mgr.24517) 232 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-01-04T18:21:59.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:21:58.058204+0000 mgr.smithi050.emnywo (mgr.24517) 231 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-01-04T18:21:59.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:21:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:21:58.058999+0000 mgr.smithi050.emnywo (mgr.24517) 232 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-01-04T18:22:00.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:21:58.662886+0000 mgr.smithi050.emnywo (mgr.24517) 233 : cluster [DBG] pgmap v179: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 35/210 objects degraded (16.667%) 2023-01-04T18:22:00.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:21:58.662886+0000 mgr.smithi050.emnywo (mgr.24517) 233 : cluster [DBG] pgmap v179: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 35/210 objects degraded (16.667%) 2023-01-04T18:22:02.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:00.663506+0000 mgr.smithi050.emnywo (mgr.24517) 234 : cluster [DBG] pgmap v180: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 902 B/s rd, 2 op/s; 35/210 objects degraded (16.667%) 2023-01-04T18:22:02.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:00.663506+0000 mgr.smithi050.emnywo (mgr.24517) 234 : cluster [DBG] pgmap v180: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 902 B/s rd, 2 op/s; 35/210 objects degraded (16.667%) 2023-01-04T18:22:03.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:03.272579+0000 mon.smithi098 (mon.1) 4 : audit [INF] from='osd.4 [v2:172.21.15.98:6808/4264187921,v1:172.21.15.98:6809/4264187921]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-01-04T18:22:03.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:03.273233+0000 mon.smithi050 (mon.0) 395 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-01-04T18:22:03.581 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:22:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-4[129181]: debug 2023-01-04T18:22:03.268+0000 7f59ad5cb200 -1 osd.4 81 log_to_monitors {default=true} 2023-01-04T18:22:03.581 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:22:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-4[129181]: debug 2023-01-04T18:22:03.450+0000 7f599cac6700 -1 osd.4 81 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-04T18:22:03.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:03.272579+0000 mon.smithi098 (mon.1) 4 : audit [INF] from='osd.4 [v2:172.21.15.98:6808/4264187921,v1:172.21.15.98:6809/4264187921]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-01-04T18:22:03.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:03.273233+0000 mon.smithi050 (mon.0) 395 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-01-04T18:22:04.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:02.663959+0000 mgr.smithi050.emnywo (mgr.24517) 235 : cluster [DBG] pgmap v181: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 35/210 objects degraded (16.667%) 2023-01-04T18:22:04.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:03.438883+0000 mon.smithi050 (mon.0) 396 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-01-04T18:22:04.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:03.438999+0000 mon.smithi050 (mon.0) 397 : cluster [DBG] osdmap e84: 6 total, 5 up, 6 in 2023-01-04T18:22:04.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:03.439584+0000 mon.smithi098 (mon.1) 5 : audit [INF] from='osd.4 [v2:172.21.15.98:6808/4264187921,v1:172.21.15.98:6809/4264187921]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:22:04.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:03.439924+0000 mon.smithi050 (mon.0) 398 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:22:04.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:02.663959+0000 mgr.smithi050.emnywo (mgr.24517) 235 : cluster [DBG] pgmap v181: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 881 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 35/210 objects degraded (16.667%) 2023-01-04T18:22:04.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:03.438883+0000 mon.smithi050 (mon.0) 396 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-01-04T18:22:04.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:03.438999+0000 mon.smithi050 (mon.0) 397 : cluster [DBG] osdmap e84: 6 total, 5 up, 6 in 2023-01-04T18:22:04.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:03.439584+0000 mon.smithi098 (mon.1) 5 : audit [INF] from='osd.4 [v2:172.21.15.98:6808/4264187921,v1:172.21.15.98:6809/4264187921]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:22:04.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:03.439924+0000 mon.smithi050 (mon.0) 398 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:22:05.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:05 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:04.436479+0000 mon.smithi050 (mon.0) 399 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-01-04T18:22:05.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:05 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:04.439779+0000 mon.smithi050 (mon.0) 400 : cluster [INF] osd.4 [v2:172.21.15.98:6808/4264187921,v1:172.21.15.98:6809/4264187921] boot 2023-01-04T18:22:05.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:05 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:04.439812+0000 mon.smithi050 (mon.0) 401 : cluster [DBG] osdmap e85: 6 total, 6 up, 6 in 2023-01-04T18:22:05.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:05 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:04.440133+0000 mon.smithi050 (mon.0) 402 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-01-04T18:22:05.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:05 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:05.441955+0000 mon.smithi050 (mon.0) 403 : cluster [DBG] osdmap e86: 6 total, 6 up, 6 in 2023-01-04T18:22:05.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:04.436479+0000 mon.smithi050 (mon.0) 399 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-01-04T18:22:05.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:04.439779+0000 mon.smithi050 (mon.0) 400 : cluster [INF] osd.4 [v2:172.21.15.98:6808/4264187921,v1:172.21.15.98:6809/4264187921] boot 2023-01-04T18:22:05.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:04.439812+0000 mon.smithi050 (mon.0) 401 : cluster [DBG] osdmap e85: 6 total, 6 up, 6 in 2023-01-04T18:22:05.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:04.440133+0000 mon.smithi050 (mon.0) 402 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-01-04T18:22:05.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:05.441955+0000 mon.smithi050 (mon.0) 403 : cluster [DBG] osdmap e86: 6 total, 6 up, 6 in 2023-01-04T18:22:06.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:04.664435+0000 mgr.smithi050.emnywo (mgr.24517) 236 : cluster [DBG] pgmap v184: 65 pgs: 8 peering, 10 active+undersized+degraded, 16 active+undersized, 31 active+clean; 194 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 29/210 objects degraded (13.810%) 2023-01-04T18:22:06.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:05.445062+0000 mon.smithi050 (mon.0) 404 : cluster [WRN] Health check update: Degraded data redundancy: 29/210 objects degraded (13.810%), 10 pgs degraded (PG_DEGRADED) 2023-01-04T18:22:06.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:04.664435+0000 mgr.smithi050.emnywo (mgr.24517) 236 : cluster [DBG] pgmap v184: 65 pgs: 8 peering, 10 active+undersized+degraded, 16 active+undersized, 31 active+clean; 194 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 29/210 objects degraded (13.810%) 2023-01-04T18:22:06.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:05.445062+0000 mon.smithi050 (mon.0) 404 : cluster [WRN] Health check update: Degraded data redundancy: 29/210 objects degraded (13.810%), 10 pgs degraded (PG_DEGRADED) 2023-01-04T18:22:08.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:06.664941+0000 mgr.smithi050.emnywo (mgr.24517) 237 : cluster [DBG] pgmap v186: 65 pgs: 8 peering, 9 active+undersized+degraded, 13 active+undersized, 35 active+clean; 194 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 26/210 objects degraded (12.381%) 2023-01-04T18:22:08.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:06.664941+0000 mgr.smithi050.emnywo (mgr.24517) 237 : cluster [DBG] pgmap v186: 65 pgs: 8 peering, 9 active+undersized+degraded, 13 active+undersized, 35 active+clean; 194 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 26/210 objects degraded (12.381%) 2023-01-04T18:22:09.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.286+0000 7efcb7e93700 1 -- 172.21.15.50:0/2567136694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcb00f55c0 msgr2=0x7efcb00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:09.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.286+0000 7efcb7e93700 1 --2- 172.21.15.50:0/2567136694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcb00f55c0 0x7efcb00f59e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7efcac004660 tx=0x7efcac009b30).stop 2023-01-04T18:22:09.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.286+0000 7efcb7e93700 1 -- 172.21.15.50:0/2567136694 shutdown_connections 2023-01-04T18:22:09.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.286+0000 7efcb7e93700 1 --2- 172.21.15.50:0/2567136694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efcb00f6860 0x7efcb00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:09.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.286+0000 7efcb7e93700 1 --2- 172.21.15.50:0/2567136694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcb00f55c0 0x7efcb00f59e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:09.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.286+0000 7efcb7e93700 1 -- 172.21.15.50:0/2567136694 >> 172.21.15.50:0/2567136694 conn(0x7efcb00f0d40 msgr2=0x7efcb00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:09.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.286+0000 7efcb7e93700 1 -- 172.21.15.50:0/2567136694 shutdown_connections 2023-01-04T18:22:09.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.286+0000 7efcb7e93700 1 -- 172.21.15.50:0/2567136694 wait complete. 2023-01-04T18:22:09.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.287+0000 7efcb7e93700 1 Processor -- start 2023-01-04T18:22:09.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.287+0000 7efcb7e93700 1 -- start start 2023-01-04T18:22:09.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.287+0000 7efcb7e93700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcb00f55c0 0x7efcb00f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:09.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.287+0000 7efcb7e93700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efcb00f6860 0x7efcb00f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:09.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.287+0000 7efcb7e93700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb00f8100 con 0x7efcb00f55c0 2023-01-04T18:22:09.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.287+0000 7efcb7e93700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb00f8240 con 0x7efcb00f6860 2023-01-04T18:22:09.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.287+0000 7efcb5c2f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcb00f55c0 0x7efcb00f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:09.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.287+0000 7efcb5c2f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcb00f55c0 0x7efcb00f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33818/0 (socket says 172.21.15.50:33818) 2023-01-04T18:22:09.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.287+0000 7efcb5c2f700 1 -- 172.21.15.50:0/3267925638 learned_addr learned my addr 172.21.15.50:0/3267925638 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:22:09.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.287+0000 7efcb542e700 1 --2- 172.21.15.50:0/3267925638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efcb00f6860 0x7efcb00f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:09.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.288+0000 7efcb5c2f700 1 -- 172.21.15.50:0/3267925638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efcb00f6860 msgr2=0x7efcb00f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:09.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.288+0000 7efcb5c2f700 1 --2- 172.21.15.50:0/3267925638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efcb00f6860 0x7efcb00f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:09.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.288+0000 7efcb5c2f700 1 -- 172.21.15.50:0/3267925638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcac005040 con 0x7efcb00f55c0 2023-01-04T18:22:09.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.288+0000 7efcb5c2f700 1 --2- 172.21.15.50:0/3267925638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcb00f55c0 0x7efcb00f9720 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7efcac004e30 tx=0x7efcac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:09.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.288+0000 7efca27fc700 1 -- 172.21.15.50:0/3267925638 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcac018070 con 0x7efcb00f55c0 2023-01-04T18:22:09.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.288+0000 7efca27fc700 1 -- 172.21.15.50:0/3267925638 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7efcac009630 con 0x7efcb00f55c0 2023-01-04T18:22:09.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.288+0000 7efcb7e93700 1 -- 172.21.15.50:0/3267925638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb00f84c0 con 0x7efcb00f55c0 2023-01-04T18:22:09.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.288+0000 7efca27fc700 1 -- 172.21.15.50:0/3267925638 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcac01c3c0 con 0x7efcb00f55c0 2023-01-04T18:22:09.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.288+0000 7efcb7e93700 1 -- 172.21.15.50:0/3267925638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb00f8a20 con 0x7efcb00f55c0 2023-01-04T18:22:09.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.289+0000 7efcb7e93700 1 -- 172.21.15.50:0/3267925638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb0045ad0 con 0x7efcb00f55c0 2023-01-04T18:22:09.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.290+0000 7efca27fc700 1 -- 172.21.15.50:0/3267925638 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7efcac01d420 con 0x7efcb00f55c0 2023-01-04T18:22:09.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.290+0000 7efca27fc700 1 --2- 172.21.15.50:0/3267925638 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7efc9c060be0 0x7efc9c0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:09.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.290+0000 7efca27fc700 1 -- 172.21.15.50:0/3267925638 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5812+0+0 (secure 0 0 0) 0x7efcac07d870 con 0x7efcb00f55c0 2023-01-04T18:22:09.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.290+0000 7efcb542e700 1 --2- 172.21.15.50:0/3267925638 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7efc9c060be0 0x7efc9c0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:09.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.291+0000 7efcb542e700 1 --2- 172.21.15.50:0/3267925638 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7efc9c060be0 0x7efc9c0630a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7efca4009760 tx=0x7efca4009c60).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:09.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.295+0000 7efca27fc700 1 -- 172.21.15.50:0/3267925638 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7efcac04df10 con 0x7efcb00f55c0 2023-01-04T18:22:09.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.485+0000 7efcb7e93700 1 -- 172.21.15.50:0/3267925638 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efcb00faca0 con 0x7efc9c060be0 2023-01-04T18:22:09.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.487+0000 7efca27fc700 1 -- 172.21.15.50:0/3267925638 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7efcb00faca0 con 0x7efc9c060be0 2023-01-04T18:22:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.488+0000 7efcb7e93700 1 -- 172.21.15.50:0/3267925638 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7efc9c060be0 msgr2=0x7efc9c0630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.488+0000 7efcb7e93700 1 --2- 172.21.15.50:0/3267925638 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7efc9c060be0 0x7efc9c0630a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7efca4009760 tx=0x7efca4009c60).stop 2023-01-04T18:22:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.488+0000 7efcb7e93700 1 -- 172.21.15.50:0/3267925638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcb00f55c0 msgr2=0x7efcb00f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.488+0000 7efcb7e93700 1 --2- 172.21.15.50:0/3267925638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcb00f55c0 0x7efcb00f9720 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7efcac004e30 tx=0x7efcac009b30).stop 2023-01-04T18:22:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.488+0000 7efcb7e93700 1 -- 172.21.15.50:0/3267925638 shutdown_connections 2023-01-04T18:22:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.488+0000 7efcb7e93700 1 --2- 172.21.15.50:0/3267925638 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7efc9c060be0 0x7efc9c0630a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.488+0000 7efcb7e93700 1 --2- 172.21.15.50:0/3267925638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcb00f55c0 0x7efcb00f9720 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:09.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.488+0000 7efcb7e93700 1 --2- 172.21.15.50:0/3267925638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efcb00f6860 0x7efcb00f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:09.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.488+0000 7efcb7e93700 1 -- 172.21.15.50:0/3267925638 >> 172.21.15.50:0/3267925638 conn(0x7efcb00f0d40 msgr2=0x7efcb005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:09.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.489+0000 7efcb7e93700 1 -- 172.21.15.50:0/3267925638 shutdown_connections 2023-01-04T18:22:09.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.489+0000 7efcb7e93700 1 -- 172.21.15.50:0/3267925638 wait complete. 2023-01-04T18:22:09.502 INFO:teuthology.orchestra.run.smithi050.stdout:true 2023-01-04T18:22:09.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.590+0000 7f6a2d469700 1 -- 172.21.15.50:0/3798160856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a280f5430 msgr2=0x7f6a280f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:09.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.590+0000 7f6a2d469700 1 --2- 172.21.15.50:0/3798160856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a280f5430 0x7f6a280f5850 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f6a18004660 tx=0x7f6a18009b30).stop 2023-01-04T18:22:09.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.590+0000 7f6a2d469700 1 -- 172.21.15.50:0/3798160856 shutdown_connections 2023-01-04T18:22:09.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.590+0000 7f6a2d469700 1 --2- 172.21.15.50:0/3798160856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a280f66d0 0x7f6a280f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:09.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.590+0000 7f6a2d469700 1 --2- 172.21.15.50:0/3798160856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a280f5430 0x7f6a280f5850 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:09.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.590+0000 7f6a2d469700 1 -- 172.21.15.50:0/3798160856 >> 172.21.15.50:0/3798160856 conn(0x7f6a280f0b90 msgr2=0x7f6a280f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:09.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.590+0000 7f6a2d469700 1 -- 172.21.15.50:0/3798160856 shutdown_connections 2023-01-04T18:22:09.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.590+0000 7f6a2d469700 1 -- 172.21.15.50:0/3798160856 wait complete. 2023-01-04T18:22:09.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.591+0000 7f6a2d469700 1 Processor -- start 2023-01-04T18:22:09.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.591+0000 7f6a2d469700 1 -- start start 2023-01-04T18:22:09.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.591+0000 7f6a2d469700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a280f5430 0x7f6a28109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:09.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.591+0000 7f6a2d469700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a280f66d0 0x7f6a2810bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:09.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.591+0000 7f6a2d469700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a280603e0 con 0x7f6a280f5430 2023-01-04T18:22:09.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.591+0000 7f6a2d469700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a28060520 con 0x7f6a280f66d0 2023-01-04T18:22:09.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.591+0000 7f6a27fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a280f5430 0x7f6a28109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:09.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.591+0000 7f6a27fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a280f5430 0x7f6a28109ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33832/0 (socket says 172.21.15.50:33832) 2023-01-04T18:22:09.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.591+0000 7f6a27fff700 1 -- 172.21.15.50:0/2174033785 learned_addr learned my addr 172.21.15.50:0/2174033785 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:22:09.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.592+0000 7f6a277fe700 1 --2- 172.21.15.50:0/2174033785 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a280f66d0 0x7f6a2810bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:09.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.592+0000 7f6a27fff700 1 -- 172.21.15.50:0/2174033785 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a280f66d0 msgr2=0x7f6a2810bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:09.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.592+0000 7f6a27fff700 1 --2- 172.21.15.50:0/2174033785 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a280f66d0 0x7f6a2810bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:09.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.592+0000 7f6a27fff700 1 -- 172.21.15.50:0/2174033785 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a18005040 con 0x7f6a280f5430 2023-01-04T18:22:09.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.592+0000 7f6a27fff700 1 --2- 172.21.15.50:0/2174033785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a280f5430 0x7f6a28109ab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f6a18007a60 tx=0x7f6a18009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:09.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.592+0000 7f6a24ff9700 1 -- 172.21.15.50:0/2174033785 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a18018070 con 0x7f6a280f5430 2023-01-04T18:22:09.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.592+0000 7f6a24ff9700 1 -- 172.21.15.50:0/2174033785 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6a18009630 con 0x7f6a280f5430 2023-01-04T18:22:09.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.592+0000 7f6a2d469700 1 -- 172.21.15.50:0/2174033785 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2810c500 con 0x7f6a280f5430 2023-01-04T18:22:09.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.592+0000 7f6a24ff9700 1 -- 172.21.15.50:0/2174033785 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a1801c4d0 con 0x7f6a280f5430 2023-01-04T18:22:09.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.592+0000 7f6a2d469700 1 -- 172.21.15.50:0/2174033785 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2810ca60 con 0x7f6a280f5430 2023-01-04T18:22:09.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.593+0000 7f6a2d469700 1 -- 172.21.15.50:0/2174033785 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a28045ad0 con 0x7f6a280f5430 2023-01-04T18:22:09.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.593+0000 7f6a24ff9700 1 -- 172.21.15.50:0/2174033785 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f6a1801d420 con 0x7f6a280f5430 2023-01-04T18:22:09.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.594+0000 7f6a24ff9700 1 --2- 172.21.15.50:0/2174033785 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6a10060c30 0x7f6a100630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:09.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.594+0000 7f6a24ff9700 1 -- 172.21.15.50:0/2174033785 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f6a1807d860 con 0x7f6a280f5430 2023-01-04T18:22:09.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.594+0000 7f6a277fe700 1 --2- 172.21.15.50:0/2174033785 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6a10060c30 0x7f6a100630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:09.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.594+0000 7f6a277fe700 1 --2- 172.21.15.50:0/2174033785 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6a10060c30 0x7f6a100630f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f6a1c004c40 tx=0x7f6a1c00b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:09.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.598+0000 7f6a24ff9700 1 -- 172.21.15.50:0/2174033785 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f6a1804df00 con 0x7f6a280f5430 2023-01-04T18:22:09.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.788+0000 7f6a2d469700 1 -- 172.21.15.50:0/2174033785 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a280fdd70 con 0x7f6a10060c30 2023-01-04T18:22:09.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.789+0000 7f6a24ff9700 1 -- 172.21.15.50:0/2174033785 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f6a1c00f040 con 0x7f6a10060c30 2023-01-04T18:22:09.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.791+0000 7f6a2d469700 1 -- 172.21.15.50:0/2174033785 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6a10060c30 msgr2=0x7f6a100630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:09.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.791+0000 7f6a2d469700 1 --2- 172.21.15.50:0/2174033785 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6a10060c30 0x7f6a100630f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f6a1c004c40 tx=0x7f6a1c00b040).stop 2023-01-04T18:22:09.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.791+0000 7f6a2d469700 1 -- 172.21.15.50:0/2174033785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a280f5430 msgr2=0x7f6a28109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:09.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.791+0000 7f6a2d469700 1 --2- 172.21.15.50:0/2174033785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a280f5430 0x7f6a28109ab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f6a18007a60 tx=0x7f6a18009b30).stop 2023-01-04T18:22:09.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.791+0000 7f6a2d469700 1 -- 172.21.15.50:0/2174033785 shutdown_connections 2023-01-04T18:22:09.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.791+0000 7f6a2d469700 1 --2- 172.21.15.50:0/2174033785 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6a10060c30 0x7f6a100630f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:09.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.791+0000 7f6a2d469700 1 --2- 172.21.15.50:0/2174033785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a280f5430 0x7f6a28109ab0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:09.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.791+0000 7f6a2d469700 1 --2- 172.21.15.50:0/2174033785 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a280f66d0 0x7f6a2810bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:09.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.791+0000 7f6a2d469700 1 -- 172.21.15.50:0/2174033785 >> 172.21.15.50:0/2174033785 conn(0x7f6a280f0b90 msgr2=0x7f6a280fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:09.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.791+0000 7f6a2d469700 1 -- 172.21.15.50:0/2174033785 shutdown_connections 2023-01-04T18:22:09.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.791+0000 7f6a2d469700 1 -- 172.21.15.50:0/2174033785 wait complete. 2023-01-04T18:22:09.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.893+0000 7f44e6a3e700 1 -- 172.21.15.50:0/166613880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00f7980 msgr2=0x7f44e00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:09.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.893+0000 7f44e6a3e700 1 --2- 172.21.15.50:0/166613880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00f7980 0x7f44e00f7de0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f44d4004660 tx=0x7f44d4009b30).stop 2023-01-04T18:22:09.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.893+0000 7f44e6a3e700 1 -- 172.21.15.50:0/166613880 shutdown_connections 2023-01-04T18:22:09.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.893+0000 7f44e6a3e700 1 --2- 172.21.15.50:0/166613880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00f7980 0x7f44e00f7de0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:09.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.893+0000 7f44e6a3e700 1 --2- 172.21.15.50:0/166613880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44e00f66e0 0x7f44e00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:09.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.893+0000 7f44e6a3e700 1 -- 172.21.15.50:0/166613880 >> 172.21.15.50:0/166613880 conn(0x7f44e00f1e40 msgr2=0x7f44e00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:09.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.893+0000 7f44e6a3e700 1 -- 172.21.15.50:0/166613880 shutdown_connections 2023-01-04T18:22:09.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.893+0000 7f44e6a3e700 1 -- 172.21.15.50:0/166613880 wait complete. 2023-01-04T18:22:09.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.894+0000 7f44e6a3e700 1 Processor -- start 2023-01-04T18:22:09.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.894+0000 7f44e6a3e700 1 -- start start 2023-01-04T18:22:09.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.894+0000 7f44e6a3e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00f66e0 0x7f44e0106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:09.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.894+0000 7f44e6a3e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44e00f7980 0x7f44e0107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:09.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.894+0000 7f44e6a3e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e01079d0 con 0x7f44e00f66e0 2023-01-04T18:22:09.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.894+0000 7f44e6a3e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e0107b10 con 0x7f44e00f7980 2023-01-04T18:22:09.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.894+0000 7f44dffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00f66e0 0x7f44e0106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:09.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.894+0000 7f44dffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00f66e0 0x7f44e0106f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33842/0 (socket says 172.21.15.50:33842) 2023-01-04T18:22:09.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.894+0000 7f44dffff700 1 -- 172.21.15.50:0/2459909813 learned_addr learned my addr 172.21.15.50:0/2459909813 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:22:09.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.895+0000 7f44df7fe700 1 --2- 172.21.15.50:0/2459909813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44e00f7980 0x7f44e0107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:09.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.895+0000 7f44dffff700 1 -- 172.21.15.50:0/2459909813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44e00f7980 msgr2=0x7f44e0107420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:09.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.895+0000 7f44dffff700 1 --2- 172.21.15.50:0/2459909813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44e00f7980 0x7f44e0107420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:09.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.895+0000 7f44dffff700 1 -- 172.21.15.50:0/2459909813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d4005040 con 0x7f44e00f66e0 2023-01-04T18:22:09.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.895+0000 7f44dffff700 1 --2- 172.21.15.50:0/2459909813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00f66e0 0x7f44e0106f30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f44d000e7c0 tx=0x7f44d000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:09.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.895+0000 7f44dcff9700 1 -- 172.21.15.50:0/2459909813 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44d00092e0 con 0x7f44e00f66e0 2023-01-04T18:22:09.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.895+0000 7f44dcff9700 1 -- 172.21.15.50:0/2459909813 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f44d000f040 con 0x7f44e00f66e0 2023-01-04T18:22:09.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.895+0000 7f44e6a3e700 1 -- 172.21.15.50:0/2459909813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e01084b0 con 0x7f44e00f66e0 2023-01-04T18:22:09.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.895+0000 7f44dcff9700 1 -- 172.21.15.50:0/2459909813 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44d0014810 con 0x7f44e00f66e0 2023-01-04T18:22:09.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.895+0000 7f44e6a3e700 1 -- 172.21.15.50:0/2459909813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e01089f0 con 0x7f44e00f66e0 2023-01-04T18:22:09.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.896+0000 7f44e6a3e700 1 -- 172.21.15.50:0/2459909813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e0045ad0 con 0x7f44e00f66e0 2023-01-04T18:22:09.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.896+0000 7f44dcff9700 1 -- 172.21.15.50:0/2459909813 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f44d001b030 con 0x7f44e00f66e0 2023-01-04T18:22:09.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.897+0000 7f44dcff9700 1 --2- 172.21.15.50:0/2459909813 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f44c8060be0 0x7f44c80630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:09.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.897+0000 7f44dcff9700 1 -- 172.21.15.50:0/2459909813 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f44d007bc30 con 0x7f44e00f66e0 2023-01-04T18:22:09.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.897+0000 7f44df7fe700 1 --2- 172.21.15.50:0/2459909813 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f44c8060be0 0x7f44c80630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:09.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.897+0000 7f44df7fe700 1 --2- 172.21.15.50:0/2459909813 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f44c8060be0 0x7f44c80630a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f44d4009720 tx=0x7f44d4016040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:09.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:09.901+0000 7f44dcff9700 1 -- 172.21.15.50:0/2459909813 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f44d004fc80 con 0x7f44e00f66e0 2023-01-04T18:22:10.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.083+0000 7f44e6a3e700 1 -- 172.21.15.50:0/2459909813 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f44e00fefb0 con 0x7f44c8060be0 2023-01-04T18:22:10.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.092+0000 7f44dcff9700 1 -- 172.21.15.50:0/2459909813 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f44e00fefb0 con 0x7f44c8060be0 2023-01-04T18:22:10.096 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-01-04T18:22:10.096 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager.smithi050 smithi050 *:9093,9094 running (10m) 71s ago 11m 24.6M - 0.20.0 0881eb8f169f b5d3e2678a23 2023-01-04T18:22:10.096 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi050 smithi050 running (3m) 71s ago 11m 7050k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cfe28e5ab81e 2023-01-04T18:22:10.096 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi098 smithi098 running (3m) 12s ago 11m 7184k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cf5f0ca60522 2023-01-04T18:22:10.096 INFO:teuthology.orchestra.run.smithi050.stdout:grafana.smithi050 smithi050 *:3000 running (10m) 71s ago 11m 37.3M - 6.7.4 557c83e11646 7e5dccbafe78 2023-01-04T18:22:10.096 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.ezoiwl smithi050 running (7m) 71s ago 7m 10.0G - 16.2.4 8d91d370c2b8 6c5c5f2be8b9 2023-01-04T18:22:10.097 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.kefmuy smithi050 running (7m) 71s ago 7m 18.6M - 16.2.4 8d91d370c2b8 58cace913b55 2023-01-04T18:22:10.097 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.laynsk smithi098 running (7m) 12s ago 7m 16.7M - 16.2.4 8d91d370c2b8 8ff8af70b989 2023-01-04T18:22:10.097 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.memais smithi098 running (7m) 12s ago 7m 1172M - 16.2.4 8d91d370c2b8 d59d9b4dbf7d 2023-01-04T18:22:10.097 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi050.emnywo smithi050 *:8443,9283 running (4m) 71s ago 12m 445M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d ee677216e754 2023-01-04T18:22:10.097 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi098.vhfzum smithi098 *:8443,9283 running (4m) 12s ago 10m 396M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d f3d98bf0cf66 2023-01-04T18:22:10.097 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi050 smithi050 running (4m) 71s ago 12m 97.2M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 0423819cbaa7 2023-01-04T18:22:10.097 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi098 smithi098 running (4m) 12s ago 10m 79.3M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 12094818aefc 2023-01-04T18:22:10.097 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi050 smithi050 *:9100 running (11m) 71s ago 11m 18.4M - 0.18.1 e5a616e4b9cf 88892b2e5e5a 2023-01-04T18:22:10.097 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi098 smithi098 *:9100 running (10m) 12s ago 10m 18.4M - 0.18.1 e5a616e4b9cf 49bcde8331b6 2023-01-04T18:22:10.097 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (3m) 71s ago 10m 359M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 60dafedcb429 2023-01-04T18:22:10.097 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi050 running (110s) 71s ago 10m 327M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 625bd99952d9 2023-01-04T18:22:10.097 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi050 running (78s) 71s ago 9m 14.4M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d badf94f13661 2023-01-04T18:22:10.098 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi098 running (46s) 12s ago 9m 374M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 93c4e177ba97 2023-01-04T18:22:10.098 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi098 running (16s) 12s ago 9m 12.6M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 9398016f5e81 2023-01-04T18:22:10.098 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi098 running (8m) 12s ago 8m 1147M 4096M 16.2.4 8d91d370c2b8 366d0bfff809 2023-01-04T18:22:10.098 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus.smithi050 smithi050 *:9095 running (5m) 71s ago 11m 66.0M - 2.18.1 de242295e225 7bdcf7a45d34 2023-01-04T18:22:10.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.094+0000 7f44e6a3e700 1 -- 172.21.15.50:0/2459909813 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f44c8060be0 msgr2=0x7f44c80630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:10.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.094+0000 7f44e6a3e700 1 --2- 172.21.15.50:0/2459909813 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f44c8060be0 0x7f44c80630a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f44d4009720 tx=0x7f44d4016040).stop 2023-01-04T18:22:10.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.094+0000 7f44e6a3e700 1 -- 172.21.15.50:0/2459909813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00f66e0 msgr2=0x7f44e0106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:10.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.094+0000 7f44e6a3e700 1 --2- 172.21.15.50:0/2459909813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00f66e0 0x7f44e0106f30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f44d000e7c0 tx=0x7f44d000b040).stop 2023-01-04T18:22:10.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.094+0000 7f44e6a3e700 1 -- 172.21.15.50:0/2459909813 shutdown_connections 2023-01-04T18:22:10.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.094+0000 7f44e6a3e700 1 --2- 172.21.15.50:0/2459909813 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f44c8060be0 0x7f44c80630a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:10.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.094+0000 7f44e6a3e700 1 --2- 172.21.15.50:0/2459909813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44e00f66e0 0x7f44e0106f30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:10.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.094+0000 7f44e6a3e700 1 --2- 172.21.15.50:0/2459909813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44e00f7980 0x7f44e0107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:10.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.094+0000 7f44e6a3e700 1 -- 172.21.15.50:0/2459909813 >> 172.21.15.50:0/2459909813 conn(0x7f44e00f1e40 msgr2=0x7f44e00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:10.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.095+0000 7f44e6a3e700 1 -- 172.21.15.50:0/2459909813 shutdown_connections 2023-01-04T18:22:10.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.095+0000 7f44e6a3e700 1 -- 172.21.15.50:0/2459909813 wait complete. 2023-01-04T18:22:10.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.195+0000 7fecfeebe700 1 -- 172.21.15.50:0/632125253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecf80f6530 msgr2=0x7fecf80f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.195+0000 7fecfeebe700 1 --2- 172.21.15.50:0/632125253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecf80f6530 0x7fecf80f6950 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fecf4004660 tx=0x7fecf4009b30).stop 2023-01-04T18:22:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.195+0000 7fecfeebe700 1 -- 172.21.15.50:0/632125253 shutdown_connections 2023-01-04T18:22:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.195+0000 7fecfeebe700 1 --2- 172.21.15.50:0/632125253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecf80f77d0 0x7fecf80f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.195+0000 7fecfeebe700 1 --2- 172.21.15.50:0/632125253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecf80f6530 0x7fecf80f6950 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.195+0000 7fecfeebe700 1 -- 172.21.15.50:0/632125253 >> 172.21.15.50:0/632125253 conn(0x7fecf80f1c90 msgr2=0x7fecf80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.195+0000 7fecfeebe700 1 -- 172.21.15.50:0/632125253 shutdown_connections 2023-01-04T18:22:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.195+0000 7fecfeebe700 1 -- 172.21.15.50:0/632125253 wait complete. 2023-01-04T18:22:10.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.196+0000 7fecfeebe700 1 Processor -- start 2023-01-04T18:22:10.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.196+0000 7fecfeebe700 1 -- start start 2023-01-04T18:22:10.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.196+0000 7fecfeebe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecf80f6530 0x7fecf8106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:10.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.196+0000 7fecfeebe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecf80f77d0 0x7fecf8107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:10.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.196+0000 7fecfeebe700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf8107910 con 0x7fecf80f77d0 2023-01-04T18:22:10.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.196+0000 7fecfeebe700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf8108120 con 0x7fecf80f6530 2023-01-04T18:22:10.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.196+0000 7fecfd6bb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecf80f77d0 0x7fecf8107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:10.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.196+0000 7fecfd6bb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecf80f77d0 0x7fecf8107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33860/0 (socket says 172.21.15.50:33860) 2023-01-04T18:22:10.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.196+0000 7fecfd6bb700 1 -- 172.21.15.50:0/416323923 learned_addr learned my addr 172.21.15.50:0/416323923 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:22:10.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.196+0000 7fecfdebc700 1 --2- 172.21.15.50:0/416323923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecf80f6530 0x7fecf8106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:10.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.196+0000 7fecfd6bb700 1 -- 172.21.15.50:0/416323923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecf80f6530 msgr2=0x7fecf8106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:10.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.196+0000 7fecfd6bb700 1 --2- 172.21.15.50:0/416323923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecf80f6530 0x7fecf8106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:10.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.196+0000 7fecfd6bb700 1 -- 172.21.15.50:0/416323923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf4005040 con 0x7fecf80f77d0 2023-01-04T18:22:10.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.196+0000 7fecfdebc700 1 --2- 172.21.15.50:0/416323923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecf80f6530 0x7fecf8106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-01-04T18:22:10.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.196+0000 7fecfd6bb700 1 --2- 172.21.15.50:0/416323923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecf80f77d0 0x7fecf8107310 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fecec0026d0 tx=0x7fecec009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:10.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.197+0000 7fecea7fc700 1 -- 172.21.15.50:0/416323923 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecec009320 con 0x7fecf80f77d0 2023-01-04T18:22:10.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.197+0000 7fecfeebe700 1 -- 172.21.15.50:0/416323923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf81083a0 con 0x7fecf80f77d0 2023-01-04T18:22:10.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.197+0000 7fecea7fc700 1 -- 172.21.15.50:0/416323923 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fecec00f040 con 0x7fecf80f77d0 2023-01-04T18:22:10.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.197+0000 7fecea7fc700 1 -- 172.21.15.50:0/416323923 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecec0148a0 con 0x7fecf80f77d0 2023-01-04T18:22:10.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.197+0000 7fecfeebe700 1 -- 172.21.15.50:0/416323923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf8108960 con 0x7fecf80f77d0 2023-01-04T18:22:10.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.198+0000 7fecfeebe700 1 -- 172.21.15.50:0/416323923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf8059100 con 0x7fecf80f77d0 2023-01-04T18:22:10.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.198+0000 7fecea7fc700 1 -- 172.21.15.50:0/416323923 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fecec009480 con 0x7fecf80f77d0 2023-01-04T18:22:10.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.198+0000 7fecea7fc700 1 --2- 172.21.15.50:0/416323923 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fece4060c30 0x7fece40630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:10.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.198+0000 7fecea7fc700 1 -- 172.21.15.50:0/416323923 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fecec07c380 con 0x7fecf80f77d0 2023-01-04T18:22:10.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.198+0000 7fecfdebc700 1 --2- 172.21.15.50:0/416323923 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fece4060c30 0x7fece40630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:10.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.199+0000 7fecfdebc700 1 --2- 172.21.15.50:0/416323923 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fece4060c30 0x7fece40630f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fecf4009d60 tx=0x7fecf4009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:10.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.202+0000 7fecea7fc700 1 -- 172.21.15.50:0/416323923 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fecec04c9a0 con 0x7fecf80f77d0 2023-01-04T18:22:10.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.442+0000 7fecfeebe700 1 -- 172.21.15.50:0/416323923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fecf80fedc0 con 0x7fecf80f77d0 2023-01-04T18:22:10.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.443+0000 7fecea7fc700 1 -- 172.21.15.50:0/416323923 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+824 (secure 0 0 0) 0x7fecec0181b0 con 0x7fecf80f77d0 2023-01-04T18:22:10.446 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:22:10.446 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": { 2023-01-04T18:22:10.446 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:22:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:22:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": { 2023-01-04T18:22:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:22:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:22:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": { 2023-01-04T18:22:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 5, 2023-01-04T18:22:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 1 2023-01-04T18:22:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:22:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2023-01-04T18:22:10.448 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2023-01-04T18:22:10.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:22:10.448 INFO:teuthology.orchestra.run.smithi050.stdout: "overall": { 2023-01-04T18:22:10.448 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 9, 2023-01-04T18:22:10.448 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2023-01-04T18:22:10.448 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-01-04T18:22:10.448 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:22:10.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.445+0000 7fecfeebe700 1 -- 172.21.15.50:0/416323923 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fece4060c30 msgr2=0x7fece40630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:10.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.445+0000 7fecfeebe700 1 --2- 172.21.15.50:0/416323923 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fece4060c30 0x7fece40630f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fecf4009d60 tx=0x7fecf4009b30).stop 2023-01-04T18:22:10.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.445+0000 7fecfeebe700 1 -- 172.21.15.50:0/416323923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecf80f77d0 msgr2=0x7fecf8107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:10.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.445+0000 7fecfeebe700 1 --2- 172.21.15.50:0/416323923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecf80f77d0 0x7fecf8107310 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fecec0026d0 tx=0x7fecec009de0).stop 2023-01-04T18:22:10.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.445+0000 7fecfeebe700 1 -- 172.21.15.50:0/416323923 shutdown_connections 2023-01-04T18:22:10.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.445+0000 7fecfeebe700 1 --2- 172.21.15.50:0/416323923 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fece4060c30 0x7fece40630f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:10.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.445+0000 7fecfeebe700 1 --2- 172.21.15.50:0/416323923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecf80f6530 0x7fecf8106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:10.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.445+0000 7fecfeebe700 1 --2- 172.21.15.50:0/416323923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecf80f77d0 0x7fecf8107310 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:10.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.445+0000 7fecfeebe700 1 -- 172.21.15.50:0/416323923 >> 172.21.15.50:0/416323923 conn(0x7fecf80f1c90 msgr2=0x7fecf80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:10.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.445+0000 7fecfeebe700 1 -- 172.21.15.50:0/416323923 shutdown_connections 2023-01-04T18:22:10.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.445+0000 7fecfeebe700 1 -- 172.21.15.50:0/416323923 wait complete. 2023-01-04T18:22:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.546+0000 7f8e41719700 1 -- 172.21.15.50:0/1863562354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e3c0f6700 msgr2=0x7f8e3c0f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.546+0000 7f8e41719700 1 --2- 172.21.15.50:0/1863562354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e3c0f6700 0x7f8e3c0f6b60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f8e2c004660 tx=0x7f8e2c009b30).stop 2023-01-04T18:22:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.547+0000 7f8e41719700 1 -- 172.21.15.50:0/1863562354 shutdown_connections 2023-01-04T18:22:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.547+0000 7f8e41719700 1 --2- 172.21.15.50:0/1863562354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e3c0f6700 0x7f8e3c0f6b60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.547+0000 7f8e41719700 1 --2- 172.21.15.50:0/1863562354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e3c0f5460 0x7f8e3c0f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.547+0000 7f8e41719700 1 -- 172.21.15.50:0/1863562354 >> 172.21.15.50:0/1863562354 conn(0x7f8e3c0f0bc0 msgr2=0x7f8e3c0f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.547+0000 7f8e41719700 1 -- 172.21.15.50:0/1863562354 shutdown_connections 2023-01-04T18:22:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.547+0000 7f8e41719700 1 -- 172.21.15.50:0/1863562354 wait complete. 2023-01-04T18:22:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.547+0000 7f8e41719700 1 Processor -- start 2023-01-04T18:22:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.547+0000 7f8e41719700 1 -- start start 2023-01-04T18:22:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.548+0000 7f8e41719700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e3c0f5460 0x7f8e3c109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.548+0000 7f8e41719700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e3c0f6700 0x7f8e3c10bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.548+0000 7f8e41719700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c0603e0 con 0x7f8e3c0f6700 2023-01-04T18:22:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.548+0000 7f8e41719700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c060520 con 0x7f8e3c0f5460 2023-01-04T18:22:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.548+0000 7f8e3a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e3c0f6700 0x7f8e3c10bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.548+0000 7f8e3a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e3c0f6700 0x7f8e3c10bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33888/0 (socket says 172.21.15.50:33888) 2023-01-04T18:22:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.548+0000 7f8e3a7fc700 1 -- 172.21.15.50:0/3415840617 learned_addr learned my addr 172.21.15.50:0/3415840617 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:22:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.548+0000 7f8e3affd700 1 --2- 172.21.15.50:0/3415840617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e3c0f5460 0x7f8e3c109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.548+0000 7f8e3a7fc700 1 -- 172.21.15.50:0/3415840617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e3c0f5460 msgr2=0x7f8e3c109a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.548+0000 7f8e3a7fc700 1 --2- 172.21.15.50:0/3415840617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e3c0f5460 0x7f8e3c109a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.548+0000 7f8e3a7fc700 1 -- 172.21.15.50:0/3415840617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c005040 con 0x7f8e3c0f6700 2023-01-04T18:22:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.548+0000 7f8e3affd700 1 --2- 172.21.15.50:0/3415840617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e3c0f5460 0x7f8e3c109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-01-04T18:22:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.548+0000 7f8e3a7fc700 1 --2- 172.21.15.50:0/3415840617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e3c0f6700 0x7f8e3c10bf20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f8e2c009f50 tx=0x7f8e2c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.548+0000 7f8e237fe700 1 -- 172.21.15.50:0/3415840617 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e2c018070 con 0x7f8e3c0f6700 2023-01-04T18:22:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.548+0000 7f8e41719700 1 -- 172.21.15.50:0/3415840617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3c10c470 con 0x7f8e3c0f6700 2023-01-04T18:22:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.548+0000 7f8e237fe700 1 -- 172.21.15.50:0/3415840617 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8e2c009630 con 0x7f8e3c0f6700 2023-01-04T18:22:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.548+0000 7f8e237fe700 1 -- 172.21.15.50:0/3415840617 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e2c01c3c0 con 0x7f8e3c0f6700 2023-01-04T18:22:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.548+0000 7f8e41719700 1 -- 172.21.15.50:0/3415840617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3c10c9d0 con 0x7f8e3c0f6700 2023-01-04T18:22:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.549+0000 7f8e41719700 1 -- 172.21.15.50:0/3415840617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e3c045ad0 con 0x7f8e3c0f6700 2023-01-04T18:22:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.550+0000 7f8e237fe700 1 -- 172.21.15.50:0/3415840617 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f8e2c01d420 con 0x7f8e3c0f6700 2023-01-04T18:22:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.550+0000 7f8e237fe700 1 --2- 172.21.15.50:0/3415840617 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f8e24060c30 0x7f8e240630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.550+0000 7f8e237fe700 1 -- 172.21.15.50:0/3415840617 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f8e2c07da10 con 0x7f8e3c0f6700 2023-01-04T18:22:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.550+0000 7f8e3affd700 1 --2- 172.21.15.50:0/3415840617 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f8e24060c30 0x7f8e240630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.551+0000 7f8e3affd700 1 --2- 172.21.15.50:0/3415840617 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f8e24060c30 0x7f8e240630f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f8e30009880 tx=0x7f8e3000b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:10.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.554+0000 7f8e237fe700 1 -- 172.21.15.50:0/3415840617 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f8e2c04e030 con 0x7f8e3c0f6700 2023-01-04T18:22:10.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.770+0000 7f8e41719700 1 -- 172.21.15.50:0/3415840617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8e3c027a00 con 0x7f8e3c0f6700 2023-01-04T18:22:10.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.770+0000 7f8e237fe700 1 -- 172.21.15.50:0/3415840617 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1793 (secure 0 0 0) 0x7f8e2c051650 con 0x7f8e3c0f6700 2023-01-04T18:22:10.774 INFO:teuthology.orchestra.run.smithi050.stdout:e13 2023-01-04T18:22:10.774 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:22:10.774 INFO:teuthology.orchestra.run.smithi050.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:22:10.774 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-01-04T18:22:10.774 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:22:10.775 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-01-04T18:22:10.775 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-01-04T18:22:10.775 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 10 2023-01-04T18:22:10.775 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 2023-01-04T18:22:10.775 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:22:10.775 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-01-04T18:14:43.958806+0000 2023-01-04T18:22:10.775 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-01-04T18:22:10.775 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-01-04T18:22:10.775 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 60 2023-01-04T18:22:10.775 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-01-04T18:22:10.775 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-01-04T18:22:10.775 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-01-04T18:22:10.776 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-01-04T18:22:10.776 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 0 2023-01-04T18:22:10.776 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:22:10.776 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 1 2023-01-04T18:22:10.776 INFO:teuthology.orchestra.run.smithi050.stdout:in 0 2023-01-04T18:22:10.776 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=14430} 2023-01-04T18:22:10.776 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-01-04T18:22:10.776 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-01-04T18:22:10.776 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-01-04T18:22:10.776 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-01-04T18:22:10.776 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-01-04T18:22:10.777 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data enabled 2023-01-04T18:22:10.777 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-01-04T18:22:10.777 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 1 2023-01-04T18:22:10.777 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.ezoiwl{0:14430} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.50:6826/4069909541,v1:172.21.15.50:6827/4069909541] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:22:10.777 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.memais{0:24291} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.98:6824/1196398070,v1:172.21.15.98:6825/1196398070] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:22:10.777 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:22:10.777 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:22:10.777 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2023-01-04T18:22:10.777 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:22:10.777 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.kefmuy{-1:14440} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:22:10.777 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.laynsk{-1:24297} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:22:10.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.772+0000 7f8e41719700 1 -- 172.21.15.50:0/3415840617 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f8e24060c30 msgr2=0x7f8e240630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:10.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.772+0000 7f8e41719700 1 --2- 172.21.15.50:0/3415840617 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f8e24060c30 0x7f8e240630f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f8e30009880 tx=0x7f8e3000b040).stop 2023-01-04T18:22:10.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.772+0000 7f8e41719700 1 -- 172.21.15.50:0/3415840617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e3c0f6700 msgr2=0x7f8e3c10bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:10.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.772+0000 7f8e41719700 1 --2- 172.21.15.50:0/3415840617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e3c0f6700 0x7f8e3c10bf20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f8e2c009f50 tx=0x7f8e2c009b30).stop 2023-01-04T18:22:10.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.772+0000 7f8e41719700 1 -- 172.21.15.50:0/3415840617 shutdown_connections 2023-01-04T18:22:10.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.772+0000 7f8e41719700 1 --2- 172.21.15.50:0/3415840617 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f8e24060c30 0x7f8e240630f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:10.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.772+0000 7f8e41719700 1 --2- 172.21.15.50:0/3415840617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e3c0f5460 0x7f8e3c109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:10.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.772+0000 7f8e41719700 1 --2- 172.21.15.50:0/3415840617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e3c0f6700 0x7f8e3c10bf20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:10.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.772+0000 7f8e41719700 1 -- 172.21.15.50:0/3415840617 >> 172.21.15.50:0/3415840617 conn(0x7f8e3c0f0bc0 msgr2=0x7f8e3c0fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:10.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.772+0000 7f8e41719700 1 -- 172.21.15.50:0/3415840617 shutdown_connections 2023-01-04T18:22:10.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.772+0000 7f8e41719700 1 -- 172.21.15.50:0/3415840617 wait complete. 2023-01-04T18:22:10.779 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2023-01-04T18:22:10.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:08.665474+0000 mgr.smithi050.emnywo (mgr.24517) 238 : cluster [DBG] pgmap v187: 65 pgs: 8 peering, 5 active+undersized+degraded, 5 active+undersized, 47 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 18/210 objects degraded (8.571%) 2023-01-04T18:22:10.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:09.487837+0000 mgr.smithi050.emnywo (mgr.24517) 239 : audit [DBG] from='client.34308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:22:10.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:09.846359+0000 mon.smithi050 (mon.0) 405 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:10.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:10.444234+0000 mon.smithi050 (mon.0) 406 : audit [DBG] from='client.? 172.21.15.50:0/416323923' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:10.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:08.665474+0000 mgr.smithi050.emnywo (mgr.24517) 238 : cluster [DBG] pgmap v187: 65 pgs: 8 peering, 5 active+undersized+degraded, 5 active+undersized, 47 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 18/210 objects degraded (8.571%) 2023-01-04T18:22:10.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:09.487837+0000 mgr.smithi050.emnywo (mgr.24517) 239 : audit [DBG] from='client.34308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:22:10.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:09.846359+0000 mon.smithi050 (mon.0) 405 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:10.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:10.444234+0000 mon.smithi050 (mon.0) 406 : audit [DBG] from='client.? 172.21.15.50:0/416323923' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.874+0000 7fd5c10f3700 1 -- 172.21.15.50:0/690394526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5bc0f66e0 msgr2=0x7fd5bc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.874+0000 7fd5c10f3700 1 --2- 172.21.15.50:0/690394526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5bc0f66e0 0x7fd5bc0f6b00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fd5ac004660 tx=0x7fd5ac009b30).stop 2023-01-04T18:22:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.874+0000 7fd5c10f3700 1 -- 172.21.15.50:0/690394526 shutdown_connections 2023-01-04T18:22:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.874+0000 7fd5c10f3700 1 --2- 172.21.15.50:0/690394526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5bc0f7980 0x7fd5bc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.874+0000 7fd5c10f3700 1 --2- 172.21.15.50:0/690394526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5bc0f66e0 0x7fd5bc0f6b00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.874+0000 7fd5c10f3700 1 -- 172.21.15.50:0/690394526 >> 172.21.15.50:0/690394526 conn(0x7fd5bc0f1e40 msgr2=0x7fd5bc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:10.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.874+0000 7fd5c10f3700 1 -- 172.21.15.50:0/690394526 shutdown_connections 2023-01-04T18:22:10.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.874+0000 7fd5c10f3700 1 -- 172.21.15.50:0/690394526 wait complete. 2023-01-04T18:22:10.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.875+0000 7fd5c10f3700 1 Processor -- start 2023-01-04T18:22:10.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.875+0000 7fd5c10f3700 1 -- start start 2023-01-04T18:22:10.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.875+0000 7fd5c10f3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5bc0f66e0 0x7fd5bc106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:10.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.875+0000 7fd5c10f3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5bc0f7980 0x7fd5bc1074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:10.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.875+0000 7fd5c10f3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc107a70 con 0x7fd5bc0f7980 2023-01-04T18:22:10.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.875+0000 7fd5c10f3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc107bb0 con 0x7fd5bc0f66e0 2023-01-04T18:22:10.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.876+0000 7fd5ba59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5bc0f7980 0x7fd5bc1074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:10.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.876+0000 7fd5ba59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5bc0f7980 0x7fd5bc1074c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33908/0 (socket says 172.21.15.50:33908) 2023-01-04T18:22:10.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.876+0000 7fd5ba59c700 1 -- 172.21.15.50:0/1511536491 learned_addr learned my addr 172.21.15.50:0/1511536491 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:22:10.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.876+0000 7fd5bad9d700 1 --2- 172.21.15.50:0/1511536491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5bc0f66e0 0x7fd5bc106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:10.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.876+0000 7fd5ba59c700 1 -- 172.21.15.50:0/1511536491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5bc0f66e0 msgr2=0x7fd5bc106fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:10.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.876+0000 7fd5ba59c700 1 --2- 172.21.15.50:0/1511536491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5bc0f66e0 0x7fd5bc106fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:10.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.876+0000 7fd5ba59c700 1 -- 172.21.15.50:0/1511536491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac005040 con 0x7fd5bc0f7980 2023-01-04T18:22:10.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.876+0000 7fd5ba59c700 1 --2- 172.21.15.50:0/1511536491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5bc0f7980 0x7fd5bc1074c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fd5b00026d0 tx=0x7fd5b0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:10.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.876+0000 7fd5a37fe700 1 -- 172.21.15.50:0/1511536491 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5b00079c0 con 0x7fd5bc0f7980 2023-01-04T18:22:10.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.876+0000 7fd5c10f3700 1 -- 172.21.15.50:0/1511536491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5bc108550 con 0x7fd5bc0f7980 2023-01-04T18:22:10.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.876+0000 7fd5a37fe700 1 -- 172.21.15.50:0/1511536491 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd5b000f040 con 0x7fd5bc0f7980 2023-01-04T18:22:10.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.876+0000 7fd5a37fe700 1 -- 172.21.15.50:0/1511536491 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5b0014980 con 0x7fd5bc0f7980 2023-01-04T18:22:10.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.876+0000 7fd5c10f3700 1 -- 172.21.15.50:0/1511536491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5bc108b10 con 0x7fd5bc0f7980 2023-01-04T18:22:10.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.877+0000 7fd5c10f3700 1 -- 172.21.15.50:0/1511536491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5bc045ad0 con 0x7fd5bc0f7980 2023-01-04T18:22:10.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.878+0000 7fd5a37fe700 1 -- 172.21.15.50:0/1511536491 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fd5b00090d0 con 0x7fd5bc0f7980 2023-01-04T18:22:10.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.878+0000 7fd5a37fe700 1 --2- 172.21.15.50:0/1511536491 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd5a4060be0 0x7fd5a40630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:10.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.878+0000 7fd5a37fe700 1 -- 172.21.15.50:0/1511536491 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fd5b007bca0 con 0x7fd5bc0f7980 2023-01-04T18:22:10.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.878+0000 7fd5bad9d700 1 --2- 172.21.15.50:0/1511536491 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd5a4060be0 0x7fd5a40630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:10.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.878+0000 7fd5bad9d700 1 --2- 172.21.15.50:0/1511536491 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd5a4060be0 0x7fd5a40630a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fd5ac004630 tx=0x7fd5ac009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:10.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:10.882+0000 7fd5a37fe700 1 -- 172.21.15.50:0/1511536491 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fd5b0080070 con 0x7fd5bc0f7980 2023-01-04T18:22:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:11.070+0000 7fd5c10f3700 1 -- 172.21.15.50:0/1511536491 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5bc0fefe0 con 0x7fd5a4060be0 2023-01-04T18:22:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:11.071+0000 7fd5a37fe700 1 -- 172.21.15.50:0/1511536491 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd5bc0fefe0 con 0x7fd5a4060be0 2023-01-04T18:22:11.074 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:22:11.074 INFO:teuthology.orchestra.run.smithi050.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308", 2023-01-04T18:22:11.074 INFO:teuthology.orchestra.run.smithi050.stdout: "in_progress": true, 2023-01-04T18:22:11.074 INFO:teuthology.orchestra.run.smithi050.stdout: "which": "Upgrading all daemon types on all hosts", 2023-01-04T18:22:11.075 INFO:teuthology.orchestra.run.smithi050.stdout: "services_complete": [ 2023-01-04T18:22:11.075 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2023-01-04T18:22:11.075 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr", 2023-01-04T18:22:11.075 INFO:teuthology.orchestra.run.smithi050.stdout: "mon" 2023-01-04T18:22:11.075 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-01-04T18:22:11.075 INFO:teuthology.orchestra.run.smithi050.stdout: "progress": "11/21 daemons upgraded", 2023-01-04T18:22:11.075 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "Currently upgrading osd daemons", 2023-01-04T18:22:11.075 INFO:teuthology.orchestra.run.smithi050.stdout: "is_paused": false 2023-01-04T18:22:11.075 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:22:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:11.073+0000 7fd5c10f3700 1 -- 172.21.15.50:0/1511536491 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd5a4060be0 msgr2=0x7fd5a40630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:11.073+0000 7fd5c10f3700 1 --2- 172.21.15.50:0/1511536491 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd5a4060be0 0x7fd5a40630a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fd5ac004630 tx=0x7fd5ac009b30).stop 2023-01-04T18:22:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:11.073+0000 7fd5c10f3700 1 -- 172.21.15.50:0/1511536491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5bc0f7980 msgr2=0x7fd5bc1074c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:11.073+0000 7fd5c10f3700 1 --2- 172.21.15.50:0/1511536491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5bc0f7980 0x7fd5bc1074c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fd5b00026d0 tx=0x7fd5b0009de0).stop 2023-01-04T18:22:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:11.073+0000 7fd5c10f3700 1 -- 172.21.15.50:0/1511536491 shutdown_connections 2023-01-04T18:22:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:11.073+0000 7fd5c10f3700 1 --2- 172.21.15.50:0/1511536491 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd5a4060be0 0x7fd5a40630a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:11.073+0000 7fd5c10f3700 1 --2- 172.21.15.50:0/1511536491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5bc0f66e0 0x7fd5bc106fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:11.073+0000 7fd5c10f3700 1 --2- 172.21.15.50:0/1511536491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5bc0f7980 0x7fd5bc1074c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:11.073+0000 7fd5c10f3700 1 -- 172.21.15.50:0/1511536491 >> 172.21.15.50:0/1511536491 conn(0x7fd5bc0f1e40 msgr2=0x7fd5bc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:11.073+0000 7fd5c10f3700 1 -- 172.21.15.50:0/1511536491 shutdown_connections 2023-01-04T18:22:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:11.073+0000 7fd5c10f3700 1 -- 172.21.15.50:0/1511536491 wait complete. 2023-01-04T18:22:11.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:09.790414+0000 mgr.smithi050.emnywo (mgr.24517) 240 : audit [DBG] from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:22:11.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:10.085423+0000 mgr.smithi050.emnywo (mgr.24517) 241 : audit [DBG] from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:22:11.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:10.772056+0000 mon.smithi050 (mon.0) 407 : audit [DBG] from='client.? 172.21.15.50:0/3415840617' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:22:11.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:09.790414+0000 mgr.smithi050.emnywo (mgr.24517) 240 : audit [DBG] from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:22:11.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:10.085423+0000 mgr.smithi050.emnywo (mgr.24517) 241 : audit [DBG] from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:22:11.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:10.772056+0000 mon.smithi050 (mon.0) 407 : audit [DBG] from='client.? 172.21.15.50:0/3415840617' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:22:12.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:10.665892+0000 mgr.smithi050.emnywo (mgr.24517) 242 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:22:12.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:11.072142+0000 mgr.smithi050.emnywo (mgr.24517) 243 : audit [DBG] from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:22:12.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:11.462984+0000 mon.smithi050 (mon.0) 408 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/210 objects degraded (8.571%), 5 pgs degraded) 2023-01-04T18:22:12.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:10.665892+0000 mgr.smithi050.emnywo (mgr.24517) 242 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:22:12.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:11.072142+0000 mgr.smithi050.emnywo (mgr.24517) 243 : audit [DBG] from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:22:12.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:11.462984+0000 mon.smithi050 (mon.0) 408 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/210 objects degraded (8.571%), 5 pgs degraded) 2023-01-04T18:22:13.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:13 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:13.074626+0000 mon.smithi050 (mon.0) 409 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-01-04T18:22:13.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:13 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:13.074626+0000 mon.smithi050 (mon.0) 409 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-01-04T18:22:14.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:12.666323+0000 mgr.smithi050.emnywo (mgr.24517) 244 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 497 B/s rd, 1 op/s 2023-01-04T18:22:14.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:13.074858+0000 mgr.smithi050.emnywo (mgr.24517) 245 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-01-04T18:22:14.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:22:13.076016+0000 mgr.smithi050.emnywo (mgr.24517) 246 : cephadm [INF] Upgrade: osd.5 is safe to restart 2023-01-04T18:22:14.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:12.666323+0000 mgr.smithi050.emnywo (mgr.24517) 244 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 497 B/s rd, 1 op/s 2023-01-04T18:22:14.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:13.074858+0000 mgr.smithi050.emnywo (mgr.24517) 245 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-01-04T18:22:14.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:22:13.076016+0000 mgr.smithi050.emnywo (mgr.24517) 246 : cephadm [INF] Upgrade: osd.5 is safe to restart 2023-01-04T18:22:15.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:22:14.563911+0000 mgr.smithi050.emnywo (mgr.24517) 247 : cephadm [INF] Upgrade: Updating osd.5 2023-01-04T18:22:15.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:14.568330+0000 mon.smithi050 (mon.0) 410 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:15.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:14.569260+0000 mon.smithi050 (mon.0) 411 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-01-04T18:22:15.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:14.570029+0000 mon.smithi050 (mon.0) 412 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:22:15.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:22:14.571236+0000 mgr.smithi050.emnywo (mgr.24517) 248 : cephadm [INF] Deploying daemon osd.5 on smithi098 2023-01-04T18:22:16.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:22:14.563911+0000 mgr.smithi050.emnywo (mgr.24517) 247 : cephadm [INF] Upgrade: Updating osd.5 2023-01-04T18:22:16.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:14.568330+0000 mon.smithi050 (mon.0) 410 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:16.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:14.569260+0000 mon.smithi050 (mon.0) 411 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-01-04T18:22:16.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:14.570029+0000 mon.smithi050 (mon.0) 412 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:22:16.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:22:14.571236+0000 mgr.smithi050.emnywo (mgr.24517) 248 : cephadm [INF] Deploying daemon osd.5 on smithi098 2023-01-04T18:22:16.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:14.666974+0000 mgr.smithi050.emnywo (mgr.24517) 249 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2023-01-04T18:22:17.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:14.666974+0000 mgr.smithi050.emnywo (mgr.24517) 249 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2023-01-04T18:22:17.237 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:17 smithi098 systemd[1]: Stopping Ceph osd.5 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:22:17.535 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:17 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.5[116368]: debug 2023-01-04T18:22:17.233+0000 7f59ac7ab700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-01-04T18:22:17.535 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:17 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.5[116368]: debug 2023-01-04T18:22:17.233+0000 7f59ac7ab700 -1 osd.5 86 *** Got signal Terminated *** 2023-01-04T18:22:17.536 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:17 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.5[116368]: debug 2023-01-04T18:22:17.233+0000 7f59ac7ab700 -1 osd.5 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-01-04T18:22:17.791 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:17 smithi098 bash[130837]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.5 2023-01-04T18:22:17.792 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:17 smithi098 bash[130881]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5" found: no such container 2023-01-04T18:22:18.080 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:17 smithi098 bash[130894]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.5" found: no such container 2023-01-04T18:22:18.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:16.667498+0000 mgr.smithi050.emnywo (mgr.24517) 250 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 820 B/s rd, 1 op/s 2023-01-04T18:22:18.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:17.500590+0000 mon.smithi050 (mon.0) 413 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-01-04T18:22:18.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:17.500643+0000 mon.smithi050 (mon.0) 414 : cluster [INF] osd.5 failed (root=default,host=smithi098) (connection refused reported by osd.4) 2023-01-04T18:22:18.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:17.500892+0000 mon.smithi050 (mon.0) 415 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-01-04T18:22:18.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:17.501034+0000 mon.smithi050 (mon.0) 416 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-01-04T18:22:18.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:17.501150+0000 mon.smithi050 (mon.0) 417 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-01-04T18:22:18.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:17.501269+0000 mon.smithi050 (mon.0) 418 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-01-04T18:22:18.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:17.501433+0000 mon.smithi050 (mon.0) 419 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-01-04T18:22:18.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:17.501549+0000 mon.smithi050 (mon.0) 420 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-01-04T18:22:18.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:17.501671+0000 mon.smithi050 (mon.0) 421 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-01-04T18:22:18.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:17.501779+0000 mon.smithi050 (mon.0) 422 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-01-04T18:22:18.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:17.501954+0000 mon.smithi050 (mon.0) 423 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-01-04T18:22:18.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:17.901734+0000 mon.smithi050 (mon.0) 424 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-01-04T18:22:18.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:17.901930+0000 mon.smithi050 (mon.0) 425 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-01-04T18:22:18.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:17.902042+0000 mon.smithi050 (mon.0) 426 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-01-04T18:22:18.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:17.902138+0000 mon.smithi050 (mon.0) 427 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-01-04T18:22:18.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:17.902234+0000 mon.smithi050 (mon.0) 428 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-01-04T18:22:18.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:17.902404+0000 mon.smithi050 (mon.0) 429 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-01-04T18:22:18.542 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:17.902510+0000 mon.smithi050 (mon.0) 430 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-01-04T18:22:18.543 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:17.902596+0000 mon.smithi050 (mon.0) 431 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-01-04T18:22:18.543 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:17.902727+0000 mon.smithi050 (mon.0) 432 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-01-04T18:22:18.543 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:17.902856+0000 mon.smithi050 (mon.0) 433 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-01-04T18:22:18.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:16.667498+0000 mgr.smithi050.emnywo (mgr.24517) 250 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 820 B/s rd, 1 op/s 2023-01-04T18:22:18.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:17.500590+0000 mon.smithi050 (mon.0) 413 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-01-04T18:22:18.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:17.500643+0000 mon.smithi050 (mon.0) 414 : cluster [INF] osd.5 failed (root=default,host=smithi098) (connection refused reported by osd.4) 2023-01-04T18:22:18.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:17.500892+0000 mon.smithi050 (mon.0) 415 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-01-04T18:22:18.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:17.501034+0000 mon.smithi050 (mon.0) 416 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-01-04T18:22:18.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:17.501150+0000 mon.smithi050 (mon.0) 417 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-01-04T18:22:18.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:17.501269+0000 mon.smithi050 (mon.0) 418 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-01-04T18:22:18.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:17.501433+0000 mon.smithi050 (mon.0) 419 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-01-04T18:22:18.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:17.501549+0000 mon.smithi050 (mon.0) 420 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-01-04T18:22:18.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:17.501671+0000 mon.smithi050 (mon.0) 421 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-01-04T18:22:18.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:17.501779+0000 mon.smithi050 (mon.0) 422 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-01-04T18:22:18.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:17.501954+0000 mon.smithi050 (mon.0) 423 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-01-04T18:22:18.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:17.901734+0000 mon.smithi050 (mon.0) 424 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-01-04T18:22:18.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:17.901930+0000 mon.smithi050 (mon.0) 425 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-01-04T18:22:18.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:17.902042+0000 mon.smithi050 (mon.0) 426 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-01-04T18:22:18.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:17.902138+0000 mon.smithi050 (mon.0) 427 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-01-04T18:22:18.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:17.902234+0000 mon.smithi050 (mon.0) 428 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-01-04T18:22:18.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:17.902404+0000 mon.smithi050 (mon.0) 429 : cluster [DBG] osd.5 reported immediately failed by osd.3 2023-01-04T18:22:18.583 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:17.902510+0000 mon.smithi050 (mon.0) 430 : cluster [DBG] osd.5 reported immediately failed by osd.0 2023-01-04T18:22:18.583 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:17.902596+0000 mon.smithi050 (mon.0) 431 : cluster [DBG] osd.5 reported immediately failed by osd.1 2023-01-04T18:22:18.583 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:17.902727+0000 mon.smithi050 (mon.0) 432 : cluster [DBG] osd.5 reported immediately failed by osd.2 2023-01-04T18:22:18.583 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:17.902856+0000 mon.smithi050 (mon.0) 433 : cluster [DBG] osd.5 reported immediately failed by osd.4 2023-01-04T18:22:19.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:18.134414+0000 mon.smithi050 (mon.0) 434 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-01-04T18:22:19.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:18.141818+0000 mon.smithi050 (mon.0) 435 : cluster [DBG] osdmap e87: 6 total, 5 up, 6 in 2023-01-04T18:22:19.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:18.134414+0000 mon.smithi050 (mon.0) 434 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-01-04T18:22:19.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:18.141818+0000 mon.smithi050 (mon.0) 435 : cluster [DBG] osdmap e87: 6 total, 5 up, 6 in 2023-01-04T18:22:19.830 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:19 smithi098 systemd[1]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.5.service: Succeeded. 2023-01-04T18:22:19.831 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:19 smithi098 systemd[1]: Stopped Ceph osd.5 for d98671da-8c5a-11ed-821a-001a4aab830c. 2023-01-04T18:22:19.831 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:19 smithi098 systemd[1]: Starting Ceph osd.5 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:22:20.142 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:18.667974+0000 mgr.smithi050.emnywo (mgr.24517) 251 : cluster [DBG] pgmap v193: 65 pgs: 7 peering, 9 stale+active+clean, 49 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2023-01-04T18:22:20.142 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:19.139570+0000 mon.smithi050 (mon.0) 436 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2023-01-04T18:22:20.142 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:19.148205+0000 mon.smithi050 (mon.0) 437 : cluster [DBG] osdmap e88: 6 total, 5 up, 6 in 2023-01-04T18:22:20.142 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:19.981394+0000 mon.smithi050 (mon.0) 438 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:20.421 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:18.667974+0000 mgr.smithi050.emnywo (mgr.24517) 251 : cluster [DBG] pgmap v193: 65 pgs: 7 peering, 9 stale+active+clean, 49 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2023-01-04T18:22:20.421 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:19.139570+0000 mon.smithi050 (mon.0) 436 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2023-01-04T18:22:20.421 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:19.148205+0000 mon.smithi050 (mon.0) 437 : cluster [DBG] osdmap e88: 6 total, 5 up, 6 in 2023-01-04T18:22:20.421 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:19.981394+0000 mon.smithi050 (mon.0) 438 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:21.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:21 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:21.138592+0000 mon.smithi050 (mon.0) 439 : cluster [WRN] Health check failed: Degraded data redundancy: 6/210 objects degraded (2.857%), 4 pgs degraded (PG_DEGRADED) 2023-01-04T18:22:21.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:21 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:21.138592+0000 mon.smithi050 (mon.0) 439 : cluster [WRN] Health check failed: Degraded data redundancy: 6/210 objects degraded (2.857%), 4 pgs degraded (PG_DEGRADED) 2023-01-04T18:22:22.194 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:21 smithi098 bash[131113]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-01-04T18:22:22.195 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:21 smithi098 bash[131113]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-01-04T18:22:22.195 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:21 smithi098 bash[131113]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-01-04T18:22:22.195 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:21 smithi098 bash[131113]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-01-04T18:22:22.195 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:21 smithi098 bash[131113]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2023-01-04T18:22:22.195 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:21 smithi098 bash[131113]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-01-04T18:22:22.195 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:21 smithi098 bash[131113]: --> ceph-volume raw activate successful for osd ID: 5 2023-01-04T18:22:22.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:20.668707+0000 mgr.smithi050.emnywo (mgr.24517) 252 : cluster [DBG] pgmap v195: 65 pgs: 4 active+undersized+degraded, 17 peering, 2 stale+active+clean, 4 active+undersized, 38 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 6/210 objects degraded (2.857%) 2023-01-04T18:22:22.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:20.668707+0000 mgr.smithi050.emnywo (mgr.24517) 252 : cluster [DBG] pgmap v195: 65 pgs: 4 active+undersized+degraded, 17 peering, 2 stale+active+clean, 4 active+undersized, 38 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 6/210 objects degraded (2.857%) 2023-01-04T18:22:23.291 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:23 smithi098 podman[131565]: 2023-01-04T18:22:23.291 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:22:23.228+0000 7f86285dc700 1 -- 172.21.15.98:0/2262117578 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e176f704e0 con 0x55e176f37400 2023-01-04T18:22:23.291 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:23 smithi098 bash[131565]: 82e86a9ed86489cf26300f13d761cad05acbd4001818d7e66a074057be5d129d 2023-01-04T18:22:23.580 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:23 smithi098 systemd[1]: Started Ceph osd.5 for d98671da-8c5a-11ed-821a-001a4aab830c. 2023-01-04T18:22:24.080 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:22:23.744+0000 7f8630052200 -1 Falling back to public interface 2023-01-04T18:22:24.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:22.669237+0000 mgr.smithi050.emnywo (mgr.24517) 253 : cluster [DBG] pgmap v196: 65 pgs: 4 active+undersized+degraded, 17 peering, 7 active+undersized, 37 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 6/210 objects degraded (2.857%) 2023-01-04T18:22:24.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:23.331785+0000 mon.smithi050 (mon.0) 440 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:24.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:23.332694+0000 mon.smithi050 (mon.0) 441 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:22:24.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:23.334262+0000 mon.smithi050 (mon.0) 442 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:22:24.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:23.335200+0000 mon.smithi050 (mon.0) 443 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:22:24.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:22:23.336054+0000 mgr.smithi050.emnywo (mgr.24517) 254 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:22:24.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:22.669237+0000 mgr.smithi050.emnywo (mgr.24517) 253 : cluster [DBG] pgmap v196: 65 pgs: 4 active+undersized+degraded, 17 peering, 7 active+undersized, 37 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 6/210 objects degraded (2.857%) 2023-01-04T18:22:24.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:23.331785+0000 mon.smithi050 (mon.0) 440 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:24.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:23.332694+0000 mon.smithi050 (mon.0) 441 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:22:24.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:23.334262+0000 mon.smithi050 (mon.0) 442 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:22:24.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:23.335200+0000 mon.smithi050 (mon.0) 443 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:22:24.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:22:23.336054+0000 mgr.smithi050.emnywo (mgr.24517) 254 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:22:26.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:24.669807+0000 mgr.smithi050.emnywo (mgr.24517) 255 : cluster [DBG] pgmap v197: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 30/210 objects degraded (14.286%) 2023-01-04T18:22:26.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:24.847853+0000 mon.smithi050 (mon.0) 444 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:26.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:24.879757+0000 mon.smithi050 (mon.0) 445 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:22:26.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:24.883424+0000 mon.smithi050 (mon.0) 446 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:22:26.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:25.331495+0000 mon.smithi050 (mon.0) 447 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs peering) 2023-01-04T18:22:26.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:24.669807+0000 mgr.smithi050.emnywo (mgr.24517) 255 : cluster [DBG] pgmap v197: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 30/210 objects degraded (14.286%) 2023-01-04T18:22:26.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:24.847853+0000 mon.smithi050 (mon.0) 444 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:26.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:24.879757+0000 mon.smithi050 (mon.0) 445 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:22:26.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:24.883424+0000 mon.smithi050 (mon.0) 446 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:22:26.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:25.331495+0000 mon.smithi050 (mon.0) 447 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs peering) 2023-01-04T18:22:28.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:26.670238+0000 mgr.smithi050.emnywo (mgr.24517) 256 : cluster [DBG] pgmap v198: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 480 B/s rd, 1 op/s; 30/210 objects degraded (14.286%) 2023-01-04T18:22:28.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:27.133755+0000 mon.smithi050 (mon.0) 448 : cluster [WRN] Health check update: Degraded data redundancy: 30/210 objects degraded (14.286%), 12 pgs degraded (PG_DEGRADED) 2023-01-04T18:22:28.293 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:27.386983+0000 mon.smithi050 (mon.0) 449 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:28.293 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:27.390990+0000 mon.smithi050 (mon.0) 450 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:28.293 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:27.397263+0000 mon.smithi050 (mon.0) 451 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:22:28.293 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:27.400032+0000 mon.smithi050 (mon.0) 452 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:28.293 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:27.401479+0000 mon.smithi050 (mon.0) 453 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:28.293 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:27.402823+0000 mon.smithi050 (mon.0) 454 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:28.293 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:27.404625+0000 mon.smithi050 (mon.0) 455 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:28.294 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:22:27.405317+0000 mgr.smithi050.emnywo (mgr.24517) 257 : cephadm [INF] Upgrade: Setting container_image for all osd 2023-01-04T18:22:28.294 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:27.409291+0000 mon.smithi050 (mon.0) 456 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:28.294 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:27.410150+0000 mon.smithi050 (mon.0) 457 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-01-04T18:22:28.294 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:27.413588+0000 mon.smithi050 (mon.0) 458 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-01-04T18:22:28.294 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:27.414342+0000 mon.smithi050 (mon.0) 459 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-01-04T18:22:28.294 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:27.417781+0000 mon.smithi050 (mon.0) 460 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-01-04T18:22:28.294 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:27.418527+0000 mon.smithi050 (mon.0) 461 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-01-04T18:22:28.294 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:27.422141+0000 mon.smithi050 (mon.0) 462 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-01-04T18:22:28.294 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:27.422859+0000 mon.smithi050 (mon.0) 463 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-01-04T18:22:28.294 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:27.426202+0000 mon.smithi050 (mon.0) 464 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-01-04T18:22:28.294 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:27.426951+0000 mon.smithi050 (mon.0) 465 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-01-04T18:22:28.295 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:27.430228+0000 mon.smithi050 (mon.0) 466 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-01-04T18:22:28.295 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:27.430912+0000 mon.smithi050 (mon.0) 467 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-01-04T18:22:28.295 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:27.434205+0000 mon.smithi050 (mon.0) 468 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-01-04T18:22:28.295 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:22:27.435806+0000 mgr.smithi050.emnywo (mgr.24517) 258 : cephadm [INF] Upgrade: Disabling standby-replay for filesystem cephfs 2023-01-04T18:22:28.295 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:27.438770+0000 mon.smithi050 (mon.0) 469 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:28.295 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:27.439197+0000 mon.smithi050 (mon.0) 470 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2023-01-04T18:22:28.295 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:27.442328+0000 mon.smithi050 (mon.0) 471 : cluster [DBG] osdmap e89: 6 total, 5 up, 6 in 2023-01-04T18:22:28.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:26.670238+0000 mgr.smithi050.emnywo (mgr.24517) 256 : cluster [DBG] pgmap v198: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 480 B/s rd, 1 op/s; 30/210 objects degraded (14.286%) 2023-01-04T18:22:28.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:27.133755+0000 mon.smithi050 (mon.0) 448 : cluster [WRN] Health check update: Degraded data redundancy: 30/210 objects degraded (14.286%), 12 pgs degraded (PG_DEGRADED) 2023-01-04T18:22:28.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:27.386983+0000 mon.smithi050 (mon.0) 449 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:28.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:27.390990+0000 mon.smithi050 (mon.0) 450 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:28.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:27.397263+0000 mon.smithi050 (mon.0) 451 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:22:28.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:27.400032+0000 mon.smithi050 (mon.0) 452 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:28.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:27.401479+0000 mon.smithi050 (mon.0) 453 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:28.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:27.402823+0000 mon.smithi050 (mon.0) 454 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:28.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:27.404625+0000 mon.smithi050 (mon.0) 455 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:28.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:22:27.405317+0000 mgr.smithi050.emnywo (mgr.24517) 257 : cephadm [INF] Upgrade: Setting container_image for all osd 2023-01-04T18:22:28.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:27.409291+0000 mon.smithi050 (mon.0) 456 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:28.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:27.410150+0000 mon.smithi050 (mon.0) 457 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-01-04T18:22:28.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:27.413588+0000 mon.smithi050 (mon.0) 458 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-01-04T18:22:28.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:27.414342+0000 mon.smithi050 (mon.0) 459 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-01-04T18:22:28.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:27.417781+0000 mon.smithi050 (mon.0) 460 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-01-04T18:22:28.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:27.418527+0000 mon.smithi050 (mon.0) 461 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-01-04T18:22:28.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:27.422141+0000 mon.smithi050 (mon.0) 462 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-01-04T18:22:28.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:27.422859+0000 mon.smithi050 (mon.0) 463 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-01-04T18:22:28.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:27.426202+0000 mon.smithi050 (mon.0) 464 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-01-04T18:22:28.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:27.426951+0000 mon.smithi050 (mon.0) 465 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-01-04T18:22:28.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:27.430228+0000 mon.smithi050 (mon.0) 466 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-01-04T18:22:28.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:27.430912+0000 mon.smithi050 (mon.0) 467 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-01-04T18:22:28.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:27.434205+0000 mon.smithi050 (mon.0) 468 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-01-04T18:22:28.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:22:27.435806+0000 mgr.smithi050.emnywo (mgr.24517) 258 : cephadm [INF] Upgrade: Disabling standby-replay for filesystem cephfs 2023-01-04T18:22:28.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:27.438770+0000 mon.smithi050 (mon.0) 469 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:28.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:27.439197+0000 mon.smithi050 (mon.0) 470 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2023-01-04T18:22:28.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:27.442328+0000 mon.smithi050 (mon.0) 471 : cluster [DBG] osdmap e89: 6 total, 5 up, 6 in 2023-01-04T18:22:29.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:28.441748+0000 mon.smithi050 (mon.0) 472 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2023-01-04T18:22:29.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:28.441875+0000 mon.smithi050 (mon.0) 473 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 2 up:standby 2023-01-04T18:22:29.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:28.442900+0000 mon.smithi050 (mon.0) 474 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:22:29.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:28.444235+0000 mon.smithi050 (mon.0) 475 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:22:29.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:28.445123+0000 mon.smithi050 (mon.0) 476 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:22:29.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:22:28.445901+0000 mgr.smithi050.emnywo (mgr.24517) 259 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:22:29.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:28.449997+0000 mon.smithi050 (mon.0) 477 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:29.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:28.456013+0000 mon.smithi050 (mon.0) 478 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:22:29.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:28.458712+0000 mon.smithi050 (mon.0) 479 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:29.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:28.460364+0000 mon.smithi050 (mon.0) 480 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:29.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:28.461845+0000 mon.smithi050 (mon.0) 481 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:29.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:28.463640+0000 mon.smithi050 (mon.0) 482 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:29.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:28.465546+0000 mon.smithi050 (mon.0) 483 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi050.ezoiwl"]}]: dispatch 2023-01-04T18:22:29.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:22:28.466173+0000 mgr.smithi050.emnywo (mgr.24517) 260 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi050.ezoiwl 2023-01-04T18:22:29.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:28.441748+0000 mon.smithi050 (mon.0) 472 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2023-01-04T18:22:29.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:28.441875+0000 mon.smithi050 (mon.0) 473 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 2 up:standby 2023-01-04T18:22:29.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:28.442900+0000 mon.smithi050 (mon.0) 474 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:22:29.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:28.444235+0000 mon.smithi050 (mon.0) 475 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:22:29.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:28.445123+0000 mon.smithi050 (mon.0) 476 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:22:29.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:22:28.445901+0000 mgr.smithi050.emnywo (mgr.24517) 259 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:22:29.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:28.449997+0000 mon.smithi050 (mon.0) 477 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:29.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:28.456013+0000 mon.smithi050 (mon.0) 478 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:22:29.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:28.458712+0000 mon.smithi050 (mon.0) 479 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:29.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:28.460364+0000 mon.smithi050 (mon.0) 480 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:29.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:28.461845+0000 mon.smithi050 (mon.0) 481 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:29.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:28.463640+0000 mon.smithi050 (mon.0) 482 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:29.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:28.465546+0000 mon.smithi050 (mon.0) 483 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi050.ezoiwl"]}]: dispatch 2023-01-04T18:22:29.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:22:28.466173+0000 mgr.smithi050.emnywo (mgr.24517) 260 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi050.ezoiwl 2023-01-04T18:22:30.717 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:28.670580+0000 mgr.smithi050.emnywo (mgr.24517) 261 : cluster [DBG] pgmap v200: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 430 B/s rd, 1 op/s; 30/210 objects degraded (14.286%) 2023-01-04T18:22:30.717 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:29.450837+0000 mon.smithi050 (mon.0) 484 : cluster [DBG] mds.? [v2:172.21.15.98:6824/3576035235,v1:172.21.15.98:6825/3576035235] up:boot 2023-01-04T18:22:30.717 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:29.450882+0000 mon.smithi050 (mon.0) 485 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 3 up:standby 2023-01-04T18:22:30.717 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:29.451014+0000 mon.smithi050 (mon.0) 486 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.memais"}]: dispatch 2023-01-04T18:22:30.717 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:29.862213+0000 mon.smithi050 (mon.0) 487 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:30.717 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:29.862972+0000 mon.smithi050 (mon.0) 488 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi050.ezoiwl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-01-04T18:22:30.718 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:29.863626+0000 mon.smithi050 (mon.0) 489 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:22:30.718 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:29.990764+0000 mon.smithi050 (mon.0) 490 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:30.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:28.670580+0000 mgr.smithi050.emnywo (mgr.24517) 261 : cluster [DBG] pgmap v200: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 430 B/s rd, 1 op/s; 30/210 objects degraded (14.286%) 2023-01-04T18:22:30.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:29.450837+0000 mon.smithi050 (mon.0) 484 : cluster [DBG] mds.? [v2:172.21.15.98:6824/3576035235,v1:172.21.15.98:6825/3576035235] up:boot 2023-01-04T18:22:30.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:29.450882+0000 mon.smithi050 (mon.0) 485 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 3 up:standby 2023-01-04T18:22:30.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:29.451014+0000 mon.smithi050 (mon.0) 486 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.memais"}]: dispatch 2023-01-04T18:22:30.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:29.862213+0000 mon.smithi050 (mon.0) 487 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:30.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:29.862972+0000 mon.smithi050 (mon.0) 488 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi050.ezoiwl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-01-04T18:22:30.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:29.863626+0000 mon.smithi050 (mon.0) 489 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:22:30.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:29.990764+0000 mon.smithi050 (mon.0) 490 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:31.330 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:22:30.958+0000 7f8630052200 -1 osd.5 86 log_to_monitors {default=true} 2023-01-04T18:22:31.330 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:22:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:22:31.161+0000 7f861f54d700 -1 osd.5 86 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-04T18:22:31.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:22:31.450+0000 7f3454949700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-01-04T18:22:31.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:22:29.858189+0000 mgr.smithi050.emnywo (mgr.24517) 262 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi050.ezoiwl 2023-01-04T18:22:31.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:22:29.864188+0000 mgr.smithi050.emnywo (mgr.24517) 263 : cephadm [INF] Deploying daemon mds.cephfs.smithi050.ezoiwl on smithi050 2023-01-04T18:22:31.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:30.962067+0000 mon.smithi098 (mon.1) 6 : audit [INF] from='osd.5 [v2:172.21.15.98:6816/3738895016,v1:172.21.15.98:6817/3738895016]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-01-04T18:22:31.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:30.962418+0000 mon.smithi050 (mon.0) 491 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-01-04T18:22:31.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:31.151366+0000 mon.smithi050 (mon.0) 492 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-01-04T18:22:31.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:31.151452+0000 mon.smithi050 (mon.0) 493 : cluster [DBG] osdmap e90: 6 total, 5 up, 6 in 2023-01-04T18:22:31.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:31.154721+0000 mon.smithi098 (mon.1) 7 : audit [INF] from='osd.5 [v2:172.21.15.98:6816/3738895016,v1:172.21.15.98:6817/3738895016]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:22:31.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:31.155325+0000 mon.smithi050 (mon.0) 494 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:22:31.830 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:22:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-3[126692]: debug 2023-01-04T18:22:31.475+0000 7f5c6d715700 -1 bdev(0x56059129a800 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 5 2023-01-04T18:22:31.831 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:22:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-3[126692]: debug 2023-01-04T18:22:31.476+0000 7f5c69f0e700 -1 bdev(0x56059129a800 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 9 2023-01-04T18:22:31.831 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:22:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-3[126692]: debug 2023-01-04T18:22:31.477+0000 7f5c68f0c700 -1 bdev(0x56059129a800 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 13 2023-01-04T18:22:31.831 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:22:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-3[126692]: debug 2023-01-04T18:22:31.479+0000 7f5c6c713700 -1 bdev(0x56059129a800 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 21 2023-01-04T18:22:31.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:22:29.858189+0000 mgr.smithi050.emnywo (mgr.24517) 262 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi050.ezoiwl 2023-01-04T18:22:31.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:22:29.864188+0000 mgr.smithi050.emnywo (mgr.24517) 263 : cephadm [INF] Deploying daemon mds.cephfs.smithi050.ezoiwl on smithi050 2023-01-04T18:22:31.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:30.962067+0000 mon.smithi098 (mon.1) 6 : audit [INF] from='osd.5 [v2:172.21.15.98:6816/3738895016,v1:172.21.15.98:6817/3738895016]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-01-04T18:22:31.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:30.962418+0000 mon.smithi050 (mon.0) 491 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-01-04T18:22:31.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:31.151366+0000 mon.smithi050 (mon.0) 492 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-01-04T18:22:31.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:31.151452+0000 mon.smithi050 (mon.0) 493 : cluster [DBG] osdmap e90: 6 total, 5 up, 6 in 2023-01-04T18:22:31.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:31.154721+0000 mon.smithi098 (mon.1) 7 : audit [INF] from='osd.5 [v2:172.21.15.98:6816/3738895016,v1:172.21.15.98:6817/3738895016]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:22:31.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:31.155325+0000 mon.smithi050 (mon.0) 494 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2023-01-04T18:22:32.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:30.671102+0000 mgr.smithi050.emnywo (mgr.24517) 264 : cluster [DBG] pgmap v201: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 30/210 objects degraded (14.286%) 2023-01-04T18:22:32.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:31.451053+0000 mon.smithi050 (mon.0) 495 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-01-04T18:22:32.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:31.451080+0000 mon.smithi050 (mon.0) 496 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-01-04T18:22:32.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:31.459535+0000 mon.smithi050 (mon.0) 497 : cluster [INF] Standby daemon mds.cephfs.smithi050.kefmuy assigned to filesystem cephfs as rank 0 2023-01-04T18:22:32.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:31.459648+0000 mon.smithi050 (mon.0) 498 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-01-04T18:22:32.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:31.459812+0000 mon.smithi050 (mon.0) 499 : cluster [DBG] fsmap cephfs:0/1 3 up:standby, 1 failed 2023-01-04T18:22:32.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:31.462168+0000 mon.smithi050 (mon.0) 500 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi050.kefmuy=up:replay} 2 up:standby 2023-01-04T18:22:32.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:32.149491+0000 mon.smithi050 (mon.0) 501 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-01-04T18:22:32.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:32.153322+0000 mon.smithi050 (mon.0) 502 : cluster [INF] osd.5 [v2:172.21.15.98:6816/3738895016,v1:172.21.15.98:6817/3738895016] boot 2023-01-04T18:22:32.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:32.153372+0000 mon.smithi050 (mon.0) 503 : cluster [DBG] osdmap e91: 6 total, 6 up, 6 in 2023-01-04T18:22:32.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:32.155686+0000 mon.smithi050 (mon.0) 504 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-01-04T18:22:32.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:30.671102+0000 mgr.smithi050.emnywo (mgr.24517) 264 : cluster [DBG] pgmap v201: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 790 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 30/210 objects degraded (14.286%) 2023-01-04T18:22:32.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:31.451053+0000 mon.smithi050 (mon.0) 495 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-01-04T18:22:32.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:31.451080+0000 mon.smithi050 (mon.0) 496 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-01-04T18:22:32.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:31.459535+0000 mon.smithi050 (mon.0) 497 : cluster [INF] Standby daemon mds.cephfs.smithi050.kefmuy assigned to filesystem cephfs as rank 0 2023-01-04T18:22:32.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:31.459648+0000 mon.smithi050 (mon.0) 498 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-01-04T18:22:32.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:31.459812+0000 mon.smithi050 (mon.0) 499 : cluster [DBG] fsmap cephfs:0/1 3 up:standby, 1 failed 2023-01-04T18:22:32.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:31.462168+0000 mon.smithi050 (mon.0) 500 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi050.kefmuy=up:replay} 2 up:standby 2023-01-04T18:22:32.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:32.149491+0000 mon.smithi050 (mon.0) 501 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-01-04T18:22:32.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:32.153322+0000 mon.smithi050 (mon.0) 502 : cluster [INF] osd.5 [v2:172.21.15.98:6816/3738895016,v1:172.21.15.98:6817/3738895016] boot 2023-01-04T18:22:32.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:32.153372+0000 mon.smithi050 (mon.0) 503 : cluster [DBG] osdmap e91: 6 total, 6 up, 6 in 2023-01-04T18:22:32.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:32.155686+0000 mon.smithi050 (mon.0) 504 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-01-04T18:22:34.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:32.671492+0000 mgr.smithi050.emnywo (mgr.24517) 265 : cluster [DBG] pgmap v204: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 730 MiB used, 536 GiB / 536 GiB avail; 684 KiB/s rd, 1 op/s; 30/210 objects degraded (14.286%) 2023-01-04T18:22:34.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:33.154495+0000 mon.smithi050 (mon.0) 505 : cluster [DBG] osdmap e92: 6 total, 6 up, 6 in 2023-01-04T18:22:34.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:32.671492+0000 mgr.smithi050.emnywo (mgr.24517) 265 : cluster [DBG] pgmap v204: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 730 MiB used, 536 GiB / 536 GiB avail; 684 KiB/s rd, 1 op/s; 30/210 objects degraded (14.286%) 2023-01-04T18:22:34.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:33.154495+0000 mon.smithi050 (mon.0) 505 : cluster [DBG] osdmap e92: 6 total, 6 up, 6 in 2023-01-04T18:22:35.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:35 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:35.153869+0000 mon.smithi050 (mon.0) 506 : cluster [WRN] Health check update: Degraded data redundancy: 9/210 objects degraded (4.286%), 4 pgs degraded (PG_DEGRADED) 2023-01-04T18:22:35.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:35.153869+0000 mon.smithi050 (mon.0) 506 : cluster [WRN] Health check update: Degraded data redundancy: 9/210 objects degraded (4.286%), 4 pgs degraded (PG_DEGRADED) 2023-01-04T18:22:36.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:34.671938+0000 mgr.smithi050.emnywo (mgr.24517) 266 : cluster [DBG] pgmap v206: 65 pgs: 4 active+undersized+degraded, 10 active+undersized, 51 active+clean; 194 MiB data, 730 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 5 op/s; 9/210 objects degraded (4.286%) 2023-01-04T18:22:36.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:34.671938+0000 mgr.smithi050.emnywo (mgr.24517) 266 : cluster [DBG] pgmap v206: 65 pgs: 4 active+undersized+degraded, 10 active+undersized, 51 active+clean; 194 MiB data, 730 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 5 op/s; 9/210 objects degraded (4.286%) 2023-01-04T18:22:38.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:36.672383+0000 mgr.smithi050.emnywo (mgr.24517) 267 : cluster [DBG] pgmap v207: 65 pgs: 1 active+undersized, 64 active+clean; 194 MiB data, 730 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2023-01-04T18:22:38.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:37.207732+0000 mon.smithi050 (mon.0) 507 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/210 objects degraded (4.286%), 4 pgs degraded) 2023-01-04T18:22:38.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:36.672383+0000 mgr.smithi050.emnywo (mgr.24517) 267 : cluster [DBG] pgmap v207: 65 pgs: 1 active+undersized, 64 active+clean; 194 MiB data, 730 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2023-01-04T18:22:38.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:37.207732+0000 mon.smithi050 (mon.0) 507 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/210 objects degraded (4.286%), 4 pgs degraded) 2023-01-04T18:22:40.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:38.672858+0000 mgr.smithi050.emnywo (mgr.24517) 268 : cluster [DBG] pgmap v208: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2023-01-04T18:22:40.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:39.847343+0000 mon.smithi050 (mon.0) 508 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:40.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:38.672858+0000 mgr.smithi050.emnywo (mgr.24517) 268 : cluster [DBG] pgmap v208: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2023-01-04T18:22:40.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:39.847343+0000 mon.smithi050 (mon.0) 508 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:41.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.213+0000 7fa89196a700 1 -- 172.21.15.50:0/2442844159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa88c0f66d0 msgr2=0x7fa88c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:41.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.213+0000 7fa89196a700 1 --2- 172.21.15.50:0/2442844159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa88c0f66d0 0x7fa88c0f6b30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fa878004660 tx=0x7fa878009b30).stop 2023-01-04T18:22:41.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.214+0000 7fa89196a700 1 -- 172.21.15.50:0/2442844159 shutdown_connections 2023-01-04T18:22:41.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.214+0000 7fa89196a700 1 --2- 172.21.15.50:0/2442844159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa88c0f66d0 0x7fa88c0f6b30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:41.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.214+0000 7fa89196a700 1 --2- 172.21.15.50:0/2442844159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa88c0f5430 0x7fa88c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:41.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.214+0000 7fa89196a700 1 -- 172.21.15.50:0/2442844159 >> 172.21.15.50:0/2442844159 conn(0x7fa88c0f0b90 msgr2=0x7fa88c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:41.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.214+0000 7fa89196a700 1 -- 172.21.15.50:0/2442844159 shutdown_connections 2023-01-04T18:22:41.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.214+0000 7fa89196a700 1 -- 172.21.15.50:0/2442844159 wait complete. 2023-01-04T18:22:41.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.214+0000 7fa89196a700 1 Processor -- start 2023-01-04T18:22:41.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.214+0000 7fa89196a700 1 -- start start 2023-01-04T18:22:41.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.215+0000 7fa89196a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa88c0f5430 0x7fa88c105bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:41.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.215+0000 7fa89196a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa88c0f66d0 0x7fa88c1060e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:41.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.215+0000 7fa89196a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c106690 con 0x7fa88c0f66d0 2023-01-04T18:22:41.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.215+0000 7fa89196a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c1067d0 con 0x7fa88c0f5430 2023-01-04T18:22:41.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.215+0000 7fa88bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa88c0f66d0 0x7fa88c1060e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:41.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.215+0000 7fa88bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa88c0f66d0 0x7fa88c1060e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32900/0 (socket says 172.21.15.50:32900) 2023-01-04T18:22:41.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.215+0000 7fa88bfff700 1 -- 172.21.15.50:0/547555648 learned_addr learned my addr 172.21.15.50:0/547555648 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:22:41.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.215+0000 7fa890968700 1 --2- 172.21.15.50:0/547555648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa88c0f5430 0x7fa88c105bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:41.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.215+0000 7fa88bfff700 1 -- 172.21.15.50:0/547555648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa88c0f5430 msgr2=0x7fa88c105bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:41.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.215+0000 7fa88bfff700 1 --2- 172.21.15.50:0/547555648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa88c0f5430 0x7fa88c105bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:41.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.215+0000 7fa88bfff700 1 -- 172.21.15.50:0/547555648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa878005040 con 0x7fa88c0f66d0 2023-01-04T18:22:41.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.215+0000 7fa88bfff700 1 --2- 172.21.15.50:0/547555648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa88c0f66d0 0x7fa88c1060e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fa878009f50 tx=0x7fa878009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:41.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.215+0000 7fa8897fa700 1 -- 172.21.15.50:0/547555648 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa878018070 con 0x7fa88c0f66d0 2023-01-04T18:22:41.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.215+0000 7fa89196a700 1 -- 172.21.15.50:0/547555648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88c107110 con 0x7fa88c0f66d0 2023-01-04T18:22:41.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.215+0000 7fa8897fa700 1 -- 172.21.15.50:0/547555648 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa878009630 con 0x7fa88c0f66d0 2023-01-04T18:22:41.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.215+0000 7fa8897fa700 1 -- 172.21.15.50:0/547555648 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa87801c3c0 con 0x7fa88c0f66d0 2023-01-04T18:22:41.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.215+0000 7fa89196a700 1 -- 172.21.15.50:0/547555648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88c107670 con 0x7fa88c0f66d0 2023-01-04T18:22:41.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.216+0000 7fa89196a700 1 -- 172.21.15.50:0/547555648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88c045ad0 con 0x7fa88c0f66d0 2023-01-04T18:22:41.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.218+0000 7fa8897fa700 1 -- 172.21.15.50:0/547555648 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fa87801d420 con 0x7fa88c0f66d0 2023-01-04T18:22:41.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.218+0000 7fa8897fa700 1 --2- 172.21.15.50:0/547555648 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa87c060c30 0x7fa87c0630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:41.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.218+0000 7fa8897fa700 1 -- 172.21.15.50:0/547555648 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fa87807e080 con 0x7fa88c0f66d0 2023-01-04T18:22:41.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.218+0000 7fa890968700 1 --2- 172.21.15.50:0/547555648 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa87c060c30 0x7fa87c0630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:41.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.219+0000 7fa890968700 1 --2- 172.21.15.50:0/547555648 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa87c060c30 0x7fa87c0630f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fa880009880 tx=0x7fa88000b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:41.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.222+0000 7fa8897fa700 1 -- 172.21.15.50:0/547555648 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fa878052100 con 0x7fa88c0f66d0 2023-01-04T18:22:41.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.415+0000 7fa89196a700 1 -- 172.21.15.50:0/547555648 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa88c05f620 con 0x7fa87c060c30 2023-01-04T18:22:41.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.416+0000 7fa8897fa700 1 -- 172.21.15.50:0/547555648 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa88c05f620 con 0x7fa87c060c30 2023-01-04T18:22:41.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.418+0000 7fa89196a700 1 -- 172.21.15.50:0/547555648 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa87c060c30 msgr2=0x7fa87c0630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:41.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.418+0000 7fa89196a700 1 --2- 172.21.15.50:0/547555648 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa87c060c30 0x7fa87c0630f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fa880009880 tx=0x7fa88000b040).stop 2023-01-04T18:22:41.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.418+0000 7fa89196a700 1 -- 172.21.15.50:0/547555648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa88c0f66d0 msgr2=0x7fa88c1060e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:41.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.418+0000 7fa89196a700 1 --2- 172.21.15.50:0/547555648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa88c0f66d0 0x7fa88c1060e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fa878009f50 tx=0x7fa878009b30).stop 2023-01-04T18:22:41.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.418+0000 7fa89196a700 1 -- 172.21.15.50:0/547555648 shutdown_connections 2023-01-04T18:22:41.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.418+0000 7fa89196a700 1 --2- 172.21.15.50:0/547555648 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa87c060c30 0x7fa87c0630f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:41.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.418+0000 7fa89196a700 1 --2- 172.21.15.50:0/547555648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa88c0f5430 0x7fa88c105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:41.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.418+0000 7fa89196a700 1 --2- 172.21.15.50:0/547555648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa88c0f66d0 0x7fa88c1060e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:41.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.418+0000 7fa89196a700 1 -- 172.21.15.50:0/547555648 >> 172.21.15.50:0/547555648 conn(0x7fa88c0f0b90 msgr2=0x7fa88c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:41.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.418+0000 7fa89196a700 1 -- 172.21.15.50:0/547555648 shutdown_connections 2023-01-04T18:22:41.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.418+0000 7fa89196a700 1 -- 172.21.15.50:0/547555648 wait complete. 2023-01-04T18:22:41.431 INFO:teuthology.orchestra.run.smithi050.stdout:true 2023-01-04T18:22:41.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.522+0000 7faad5846700 1 -- 172.21.15.50:0/3455563548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad00f6530 msgr2=0x7faad00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:41.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.522+0000 7faad5846700 1 --2- 172.21.15.50:0/3455563548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad00f6530 0x7faad00f6950 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7faac4004660 tx=0x7faac4009b30).stop 2023-01-04T18:22:41.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.522+0000 7faad5846700 1 -- 172.21.15.50:0/3455563548 shutdown_connections 2023-01-04T18:22:41.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.522+0000 7faad5846700 1 --2- 172.21.15.50:0/3455563548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faad00f77d0 0x7faad00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:41.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.522+0000 7faad5846700 1 --2- 172.21.15.50:0/3455563548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad00f6530 0x7faad00f6950 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:41.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.522+0000 7faad5846700 1 -- 172.21.15.50:0/3455563548 >> 172.21.15.50:0/3455563548 conn(0x7faad00f1c90 msgr2=0x7faad00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:41.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.522+0000 7faad5846700 1 -- 172.21.15.50:0/3455563548 shutdown_connections 2023-01-04T18:22:41.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.522+0000 7faad5846700 1 -- 172.21.15.50:0/3455563548 wait complete. 2023-01-04T18:22:41.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.522+0000 7faad5846700 1 Processor -- start 2023-01-04T18:22:41.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.522+0000 7faad5846700 1 -- start start 2023-01-04T18:22:41.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.523+0000 7faad5846700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faad00f6530 0x7faad0106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:41.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.523+0000 7faad5846700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad00f77d0 0x7faad0107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:41.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.523+0000 7faad5846700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad0107910 con 0x7faad00f77d0 2023-01-04T18:22:41.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.523+0000 7faad5846700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad0108120 con 0x7faad00f6530 2023-01-04T18:22:41.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.523+0000 7faacffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad00f77d0 0x7faad0107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:41.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.523+0000 7faacffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad00f77d0 0x7faad0107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32916/0 (socket says 172.21.15.50:32916) 2023-01-04T18:22:41.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.523+0000 7faacffff700 1 -- 172.21.15.50:0/3164269182 learned_addr learned my addr 172.21.15.50:0/3164269182 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:22:41.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.523+0000 7faad4844700 1 --2- 172.21.15.50:0/3164269182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faad00f6530 0x7faad0106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:41.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.523+0000 7faacffff700 1 -- 172.21.15.50:0/3164269182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faad00f6530 msgr2=0x7faad0106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:41.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.523+0000 7faacffff700 1 --2- 172.21.15.50:0/3164269182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faad00f6530 0x7faad0106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:41.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.523+0000 7faacffff700 1 -- 172.21.15.50:0/3164269182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac4005040 con 0x7faad00f77d0 2023-01-04T18:22:41.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.523+0000 7faacffff700 1 --2- 172.21.15.50:0/3164269182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad00f77d0 0x7faad0107310 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7faabc00c530 tx=0x7faabc007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:41.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.523+0000 7faacd7fa700 1 -- 172.21.15.50:0/3164269182 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faabc00f650 con 0x7faad00f77d0 2023-01-04T18:22:41.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.523+0000 7faacd7fa700 1 -- 172.21.15.50:0/3164269182 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7faabc00fc70 con 0x7faad00f77d0 2023-01-04T18:22:41.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.523+0000 7faad5846700 1 -- 172.21.15.50:0/3164269182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad01083a0 con 0x7faad00f77d0 2023-01-04T18:22:41.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.523+0000 7faacd7fa700 1 -- 172.21.15.50:0/3164269182 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faabc012d00 con 0x7faad00f77d0 2023-01-04T18:22:41.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.523+0000 7faad5846700 1 -- 172.21.15.50:0/3164269182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad0108960 con 0x7faad00f77d0 2023-01-04T18:22:41.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.524+0000 7faad5846700 1 -- 172.21.15.50:0/3164269182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad0059100 con 0x7faad00f77d0 2023-01-04T18:22:41.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.525+0000 7faacd7fa700 1 -- 172.21.15.50:0/3164269182 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7faabc010070 con 0x7faad00f77d0 2023-01-04T18:22:41.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.525+0000 7faacd7fa700 1 --2- 172.21.15.50:0/3164269182 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7faac0060c30 0x7faac00630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:41.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.525+0000 7faacd7fa700 1 -- 172.21.15.50:0/3164269182 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5898+0+0 (secure 0 0 0) 0x7faabc07b9e0 con 0x7faad00f77d0 2023-01-04T18:22:41.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.525+0000 7faad4844700 1 --2- 172.21.15.50:0/3164269182 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7faac0060c30 0x7faac00630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:41.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.526+0000 7faad4844700 1 --2- 172.21.15.50:0/3164269182 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7faac0060c30 0x7faac00630f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7faad0106b90 tx=0x7faac4009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:41.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.529+0000 7faacd7fa700 1 -- 172.21.15.50:0/3164269182 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7faabc047c30 con 0x7faad00f77d0 2023-01-04T18:22:41.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.720+0000 7faad5846700 1 -- 172.21.15.50:0/3164269182 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faad00fee50 con 0x7faac0060c30 2023-01-04T18:22:41.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.721+0000 7faacd7fa700 1 -- 172.21.15.50:0/3164269182 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7faad00fee50 con 0x7faac0060c30 2023-01-04T18:22:41.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.723+0000 7faad5846700 1 -- 172.21.15.50:0/3164269182 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7faac0060c30 msgr2=0x7faac00630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:41.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.723+0000 7faad5846700 1 --2- 172.21.15.50:0/3164269182 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7faac0060c30 0x7faac00630f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7faad0106b90 tx=0x7faac4009b30).stop 2023-01-04T18:22:41.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.723+0000 7faad5846700 1 -- 172.21.15.50:0/3164269182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad00f77d0 msgr2=0x7faad0107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:41.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.723+0000 7faad5846700 1 --2- 172.21.15.50:0/3164269182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad00f77d0 0x7faad0107310 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7faabc00c530 tx=0x7faabc007e20).stop 2023-01-04T18:22:41.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.723+0000 7faad5846700 1 -- 172.21.15.50:0/3164269182 shutdown_connections 2023-01-04T18:22:41.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.723+0000 7faad5846700 1 --2- 172.21.15.50:0/3164269182 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7faac0060c30 0x7faac00630f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:41.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.723+0000 7faad5846700 1 --2- 172.21.15.50:0/3164269182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faad00f6530 0x7faad0106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:41.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.723+0000 7faad5846700 1 --2- 172.21.15.50:0/3164269182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad00f77d0 0x7faad0107310 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:41.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.723+0000 7faad5846700 1 -- 172.21.15.50:0/3164269182 >> 172.21.15.50:0/3164269182 conn(0x7faad00f1c90 msgr2=0x7faad00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:41.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.723+0000 7faad5846700 1 -- 172.21.15.50:0/3164269182 shutdown_connections 2023-01-04T18:22:41.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.723+0000 7faad5846700 1 -- 172.21.15.50:0/3164269182 wait complete. 2023-01-04T18:22:41.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.824+0000 7f1c52053700 1 -- 172.21.15.50:0/635304081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c4c0f66e0 msgr2=0x7f1c4c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:41.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.824+0000 7f1c52053700 1 --2- 172.21.15.50:0/635304081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c4c0f66e0 0x7f1c4c0f6b00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f1c3c004660 tx=0x7f1c3c009b30).stop 2023-01-04T18:22:41.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.824+0000 7f1c52053700 1 -- 172.21.15.50:0/635304081 shutdown_connections 2023-01-04T18:22:41.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.824+0000 7f1c52053700 1 --2- 172.21.15.50:0/635304081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c4c0f7980 0x7f1c4c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:41.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.824+0000 7f1c52053700 1 --2- 172.21.15.50:0/635304081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c4c0f66e0 0x7f1c4c0f6b00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:41.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.824+0000 7f1c52053700 1 -- 172.21.15.50:0/635304081 >> 172.21.15.50:0/635304081 conn(0x7f1c4c0f1e40 msgr2=0x7f1c4c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:41.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.824+0000 7f1c52053700 1 -- 172.21.15.50:0/635304081 shutdown_connections 2023-01-04T18:22:41.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.824+0000 7f1c52053700 1 -- 172.21.15.50:0/635304081 wait complete. 2023-01-04T18:22:41.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.825+0000 7f1c52053700 1 Processor -- start 2023-01-04T18:22:41.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.825+0000 7f1c52053700 1 -- start start 2023-01-04T18:22:41.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.825+0000 7f1c52053700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c4c0f66e0 0x7f1c4c106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:41.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.825+0000 7f1c52053700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c4c0f7980 0x7f1c4c107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:41.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.825+0000 7f1c52053700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c107a30 con 0x7f1c4c0f7980 2023-01-04T18:22:41.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.825+0000 7f1c52053700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c107b70 con 0x7f1c4c0f66e0 2023-01-04T18:22:41.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.826+0000 7f1c4affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c4c0f7980 0x7f1c4c107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:41.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.826+0000 7f1c4affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c4c0f7980 0x7f1c4c107480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32928/0 (socket says 172.21.15.50:32928) 2023-01-04T18:22:41.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.826+0000 7f1c4affd700 1 -- 172.21.15.50:0/2276803329 learned_addr learned my addr 172.21.15.50:0/2276803329 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:22:41.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.826+0000 7f1c4b7fe700 1 --2- 172.21.15.50:0/2276803329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c4c0f66e0 0x7f1c4c106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:41.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.826+0000 7f1c4affd700 1 -- 172.21.15.50:0/2276803329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c4c0f66e0 msgr2=0x7f1c4c106f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:41.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.826+0000 7f1c4affd700 1 --2- 172.21.15.50:0/2276803329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c4c0f66e0 0x7f1c4c106f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:41.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.826+0000 7f1c4affd700 1 -- 172.21.15.50:0/2276803329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3c005040 con 0x7f1c4c0f7980 2023-01-04T18:22:41.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.826+0000 7f1c4affd700 1 --2- 172.21.15.50:0/2276803329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c4c0f7980 0x7f1c4c107480 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f1c3400c530 tx=0x7f1c34007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:41.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.826+0000 7f1c43fff700 1 -- 172.21.15.50:0/2276803329 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c3400f650 con 0x7f1c4c0f7980 2023-01-04T18:22:41.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.826+0000 7f1c43fff700 1 -- 172.21.15.50:0/2276803329 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1c3400fc70 con 0x7f1c4c0f7980 2023-01-04T18:22:41.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.826+0000 7f1c52053700 1 -- 172.21.15.50:0/2276803329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4c108510 con 0x7f1c4c0f7980 2023-01-04T18:22:41.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.826+0000 7f1c43fff700 1 -- 172.21.15.50:0/2276803329 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c34012db0 con 0x7f1c4c0f7980 2023-01-04T18:22:41.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.826+0000 7f1c52053700 1 -- 172.21.15.50:0/2276803329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4c108ad0 con 0x7f1c4c0f7980 2023-01-04T18:22:41.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.827+0000 7f1c52053700 1 -- 172.21.15.50:0/2276803329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c4c045ad0 con 0x7f1c4c0f7980 2023-01-04T18:22:41.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.828+0000 7f1c43fff700 1 -- 172.21.15.50:0/2276803329 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f1c34010070 con 0x7f1c4c0f7980 2023-01-04T18:22:41.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.828+0000 7f1c43fff700 1 --2- 172.21.15.50:0/2276803329 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1c38060be0 0x7f1c380630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:41.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.828+0000 7f1c43fff700 1 -- 172.21.15.50:0/2276803329 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f1c3407ba90 con 0x7f1c4c0f7980 2023-01-04T18:22:41.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.828+0000 7f1c4b7fe700 1 --2- 172.21.15.50:0/2276803329 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1c38060be0 0x7f1c380630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:41.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.828+0000 7f1c4b7fe700 1 --2- 172.21.15.50:0/2276803329 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1c38060be0 0x7f1c380630a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f1c3c004e30 tx=0x7f1c3c009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:41.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:41.832+0000 7f1c43fff700 1 -- 172.21.15.50:0/2276803329 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f1c34047c30 con 0x7f1c4c0f7980 2023-01-04T18:22:42.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.014+0000 7f1c52053700 1 -- 172.21.15.50:0/2276803329 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c4c108cf0 con 0x7f1c38060be0 2023-01-04T18:22:42.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.025+0000 7f1c43fff700 1 -- 172.21.15.50:0/2276803329 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f1c4c108cf0 con 0x7f1c38060be0 2023-01-04T18:22:42.027 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-01-04T18:22:42.028 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager.smithi050 smithi050 *:9093,9094 running (11m) 103s ago 12m 24.6M - 0.20.0 0881eb8f169f b5d3e2678a23 2023-01-04T18:22:42.028 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi050 smithi050 running (4m) 103s ago 12m 7050k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cfe28e5ab81e 2023-01-04T18:22:42.028 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi098 smithi098 running (4m) 14s ago 11m 7180k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cf5f0ca60522 2023-01-04T18:22:42.028 INFO:teuthology.orchestra.run.smithi050.stdout:grafana.smithi050 smithi050 *:3000 running (10m) 103s ago 12m 37.3M - 6.7.4 557c83e11646 7e5dccbafe78 2023-01-04T18:22:42.028 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.ezoiwl smithi050 running (8m) 103s ago 8m 10.0G - 16.2.4 8d91d370c2b8 6c5c5f2be8b9 2023-01-04T18:22:42.028 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.kefmuy smithi050 running (8m) 103s ago 8m 18.6M - 16.2.4 8d91d370c2b8 58cace913b55 2023-01-04T18:22:42.028 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.laynsk smithi098 running (8m) 14s ago 8m 16.8M - 16.2.4 8d91d370c2b8 8ff8af70b989 2023-01-04T18:22:42.028 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.memais smithi098 running (8m) 14s ago 8m 1172M - 16.2.4 8d91d370c2b8 d59d9b4dbf7d 2023-01-04T18:22:42.029 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi050.emnywo smithi050 *:8443,9283 running (5m) 103s ago 13m 445M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d ee677216e754 2023-01-04T18:22:42.029 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi098.vhfzum smithi098 *:8443,9283 running (5m) 14s ago 11m 396M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d f3d98bf0cf66 2023-01-04T18:22:42.029 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi050 smithi050 running (4m) 103s ago 13m 97.2M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 0423819cbaa7 2023-01-04T18:22:42.029 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi098 smithi098 running (4m) 14s ago 11m 86.5M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 12094818aefc 2023-01-04T18:22:42.029 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi050 smithi050 *:9100 running (11m) 103s ago 11m 18.4M - 0.18.1 e5a616e4b9cf 88892b2e5e5a 2023-01-04T18:22:42.029 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi098 smithi098 *:9100 running (11m) 14s ago 11m 18.4M - 0.18.1 e5a616e4b9cf 49bcde8331b6 2023-01-04T18:22:42.029 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (3m) 103s ago 10m 359M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 60dafedcb429 2023-01-04T18:22:42.029 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi050 running (2m) 103s ago 10m 327M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 625bd99952d9 2023-01-04T18:22:42.029 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi050 running (110s) 103s ago 10m 14.4M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d badf94f13661 2023-01-04T18:22:42.029 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi098 running (78s) 14s ago 10m 383M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 93c4e177ba97 2023-01-04T18:22:42.029 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi098 running (48s) 14s ago 9m 366M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 9398016f5e81 2023-01-04T18:22:42.030 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi098 running (19s) 14s ago 9m 16.0M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 82e86a9ed864 2023-01-04T18:22:42.030 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus.smithi050 smithi050 *:9095 running (5m) 103s ago 11m 66.0M - 2.18.1 de242295e225 7bdcf7a45d34 2023-01-04T18:22:42.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.027+0000 7f1c52053700 1 -- 172.21.15.50:0/2276803329 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1c38060be0 msgr2=0x7f1c380630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:42.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.027+0000 7f1c52053700 1 --2- 172.21.15.50:0/2276803329 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1c38060be0 0x7f1c380630a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f1c3c004e30 tx=0x7f1c3c009b30).stop 2023-01-04T18:22:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.027+0000 7f1c52053700 1 -- 172.21.15.50:0/2276803329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c4c0f7980 msgr2=0x7f1c4c107480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.027+0000 7f1c52053700 1 --2- 172.21.15.50:0/2276803329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c4c0f7980 0x7f1c4c107480 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f1c3400c530 tx=0x7f1c34007e20).stop 2023-01-04T18:22:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.027+0000 7f1c52053700 1 -- 172.21.15.50:0/2276803329 shutdown_connections 2023-01-04T18:22:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.027+0000 7f1c52053700 1 --2- 172.21.15.50:0/2276803329 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1c38060be0 0x7f1c380630a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.027+0000 7f1c52053700 1 --2- 172.21.15.50:0/2276803329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c4c0f66e0 0x7f1c4c106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.027+0000 7f1c52053700 1 --2- 172.21.15.50:0/2276803329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c4c0f7980 0x7f1c4c107480 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.027+0000 7f1c52053700 1 -- 172.21.15.50:0/2276803329 >> 172.21.15.50:0/2276803329 conn(0x7f1c4c0f1e40 msgr2=0x7f1c4c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.027+0000 7f1c52053700 1 -- 172.21.15.50:0/2276803329 shutdown_connections 2023-01-04T18:22:42.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.027+0000 7f1c52053700 1 -- 172.21.15.50:0/2276803329 wait complete. 2023-01-04T18:22:42.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.142+0000 7ffa66703700 1 -- 172.21.15.50:0/977796624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa600602b0 msgr2=0x7ffa600fb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:42.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.142+0000 7ffa66703700 1 --2- 172.21.15.50:0/977796624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa600602b0 0x7ffa600fb580 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7ffa5c004660 tx=0x7ffa5c009b30).stop 2023-01-04T18:22:42.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.142+0000 7ffa66703700 1 -- 172.21.15.50:0/977796624 shutdown_connections 2023-01-04T18:22:42.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.142+0000 7ffa66703700 1 --2- 172.21.15.50:0/977796624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa600fba70 0x7ffa600fde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:42.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.142+0000 7ffa66703700 1 --2- 172.21.15.50:0/977796624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa600602b0 0x7ffa600fb580 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:42.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.142+0000 7ffa66703700 1 -- 172.21.15.50:0/977796624 >> 172.21.15.50:0/977796624 conn(0x7ffa600f0ba0 msgr2=0x7ffa600f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:42.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.142+0000 7ffa66703700 1 -- 172.21.15.50:0/977796624 shutdown_connections 2023-01-04T18:22:42.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.142+0000 7ffa66703700 1 -- 172.21.15.50:0/977796624 wait complete. 2023-01-04T18:22:42.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.143+0000 7ffa66703700 1 Processor -- start 2023-01-04T18:22:42.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.143+0000 7ffa66703700 1 -- start start 2023-01-04T18:22:42.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.143+0000 7ffa66703700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa600602b0 0x7ffa600f7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:42.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.143+0000 7ffa66703700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa600fba70 0x7ffa600f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:42.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.143+0000 7ffa66703700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa600f8010 con 0x7ffa600fba70 2023-01-04T18:22:42.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.143+0000 7ffa66703700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa600f8150 con 0x7ffa600602b0 2023-01-04T18:22:42.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.143+0000 7ffa64f00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa600fba70 0x7ffa600f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:42.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.144+0000 7ffa64f00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa600fba70 0x7ffa600f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32946/0 (socket says 172.21.15.50:32946) 2023-01-04T18:22:42.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.144+0000 7ffa64f00700 1 -- 172.21.15.50:0/1418808596 learned_addr learned my addr 172.21.15.50:0/1418808596 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:22:42.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.144+0000 7ffa65701700 1 --2- 172.21.15.50:0/1418808596 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa600602b0 0x7ffa600f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:42.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.144+0000 7ffa64f00700 1 -- 172.21.15.50:0/1418808596 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa600602b0 msgr2=0x7ffa600f7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:42.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.144+0000 7ffa64f00700 1 --2- 172.21.15.50:0/1418808596 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa600602b0 0x7ffa600f7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:42.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.144+0000 7ffa64f00700 1 -- 172.21.15.50:0/1418808596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c005040 con 0x7ffa600fba70 2023-01-04T18:22:42.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.144+0000 7ffa64f00700 1 --2- 172.21.15.50:0/1418808596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa600fba70 0x7ffa600f7a10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7ffa5000e7c0 tx=0x7ffa5000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:42.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.144+0000 7ffa55ffb700 1 -- 172.21.15.50:0/1418808596 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa500092e0 con 0x7ffa600fba70 2023-01-04T18:22:42.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.144+0000 7ffa55ffb700 1 -- 172.21.15.50:0/1418808596 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ffa5000f040 con 0x7ffa600fba70 2023-01-04T18:22:42.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.144+0000 7ffa66703700 1 -- 172.21.15.50:0/1418808596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa600f8ac0 con 0x7ffa600fba70 2023-01-04T18:22:42.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.144+0000 7ffa55ffb700 1 -- 172.21.15.50:0/1418808596 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa500147e0 con 0x7ffa600fba70 2023-01-04T18:22:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.144+0000 7ffa66703700 1 -- 172.21.15.50:0/1418808596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa600f9000 con 0x7ffa600fba70 2023-01-04T18:22:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.146+0000 7ffa66703700 1 -- 172.21.15.50:0/1418808596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa60045ad0 con 0x7ffa600fba70 2023-01-04T18:22:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.146+0000 7ffa55ffb700 1 -- 172.21.15.50:0/1418808596 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7ffa50014a60 con 0x7ffa600fba70 2023-01-04T18:22:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.147+0000 7ffa55ffb700 1 --2- 172.21.15.50:0/1418808596 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ffa4c060c30 0x7ffa4c0630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.147+0000 7ffa55ffb700 1 -- 172.21.15.50:0/1418808596 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5898+0+0 (secure 0 0 0) 0x7ffa5007bfe0 con 0x7ffa600fba70 2023-01-04T18:22:42.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.148+0000 7ffa65701700 1 --2- 172.21.15.50:0/1418808596 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ffa4c060c30 0x7ffa4c0630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:42.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.148+0000 7ffa65701700 1 --2- 172.21.15.50:0/1418808596 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ffa4c060c30 0x7ffa4c0630f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7ffa5c005010 tx=0x7ffa5c016040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:42.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.151+0000 7ffa55ffb700 1 -- 172.21.15.50:0/1418808596 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7ffa5004c5b0 con 0x7ffa600fba70 2023-01-04T18:22:42.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:40.673268+0000 mgr.smithi050.emnywo (mgr.24517) 269 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 5 op/s 2023-01-04T18:22:42.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:41.149489+0000 mon.smithi050 (mon.0) 509 : cluster [DBG] mds.? [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592] up:reconnect 2023-01-04T18:22:42.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:41.149562+0000 mon.smithi050 (mon.0) 510 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi050.kefmuy=up:reconnect} 2 up:standby 2023-01-04T18:22:42.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:41.168688+0000 mds.cephfs.smithi050.kefmuy (mds.0) 1 : cluster [DBG] reconnect by client.24361 v1:172.21.15.50:0/1796285262 after 0.0219995 2023-01-04T18:22:42.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:41.173579+0000 mds.cephfs.smithi050.kefmuy (mds.0) 2 : cluster [DBG] reconnect by client.14550 v1:172.21.15.98:0/3097597380 after 0.0269993 2023-01-04T18:22:42.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:41.416212+0000 mgr.smithi050.emnywo (mgr.24517) 270 : audit [DBG] from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:22:42.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.412+0000 7ffa66703700 1 -- 172.21.15.50:0/1418808596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffa60101030 con 0x7ffa600fba70 2023-01-04T18:22:42.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.413+0000 7ffa55ffb700 1 -- 172.21.15.50:0/1418808596 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+731 (secure 0 0 0) 0x7ffa5004fbd0 con 0x7ffa600fba70 2023-01-04T18:22:42.416 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:22:42.416 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": { 2023-01-04T18:22:42.416 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:22:42.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:22:42.416 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": { 2023-01-04T18:22:42.416 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:22:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:22:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": { 2023-01-04T18:22:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 6 2023-01-04T18:22:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:22:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2023-01-04T18:22:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 3 2023-01-04T18:22:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:22:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: "overall": { 2023-01-04T18:22:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 10, 2023-01-04T18:22:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 3 2023-01-04T18:22:42.418 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-01-04T18:22:42.418 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:22:42.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.415+0000 7ffa66703700 1 -- 172.21.15.50:0/1418808596 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ffa4c060c30 msgr2=0x7ffa4c0630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:42.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.415+0000 7ffa66703700 1 --2- 172.21.15.50:0/1418808596 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ffa4c060c30 0x7ffa4c0630f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7ffa5c005010 tx=0x7ffa5c016040).stop 2023-01-04T18:22:42.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.415+0000 7ffa66703700 1 -- 172.21.15.50:0/1418808596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa600fba70 msgr2=0x7ffa600f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:42.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.415+0000 7ffa66703700 1 --2- 172.21.15.50:0/1418808596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa600fba70 0x7ffa600f7a10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7ffa5000e7c0 tx=0x7ffa5000b040).stop 2023-01-04T18:22:42.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.415+0000 7ffa66703700 1 -- 172.21.15.50:0/1418808596 shutdown_connections 2023-01-04T18:22:42.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.415+0000 7ffa66703700 1 --2- 172.21.15.50:0/1418808596 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ffa4c060c30 0x7ffa4c0630f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:42.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.415+0000 7ffa66703700 1 --2- 172.21.15.50:0/1418808596 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa600602b0 0x7ffa600f7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:42.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.415+0000 7ffa66703700 1 --2- 172.21.15.50:0/1418808596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa600fba70 0x7ffa600f7a10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:42.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.415+0000 7ffa66703700 1 -- 172.21.15.50:0/1418808596 >> 172.21.15.50:0/1418808596 conn(0x7ffa600f0ba0 msgr2=0x7ffa600f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:42.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.415+0000 7ffa66703700 1 -- 172.21.15.50:0/1418808596 shutdown_connections 2023-01-04T18:22:42.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.415+0000 7ffa66703700 1 -- 172.21.15.50:0/1418808596 wait complete. 2023-01-04T18:22:42.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.520+0000 7fe332a21700 1 -- 172.21.15.50:0/1386401265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe32c0f55c0 msgr2=0x7fe32c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:42.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.520+0000 7fe332a21700 1 --2- 172.21.15.50:0/1386401265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe32c0f55c0 0x7fe32c0f59e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fe320004660 tx=0x7fe320009b30).stop 2023-01-04T18:22:42.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.520+0000 7fe332a21700 1 -- 172.21.15.50:0/1386401265 shutdown_connections 2023-01-04T18:22:42.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.520+0000 7fe332a21700 1 --2- 172.21.15.50:0/1386401265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe32c0f6860 0x7fe32c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:42.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.520+0000 7fe332a21700 1 --2- 172.21.15.50:0/1386401265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe32c0f55c0 0x7fe32c0f59e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:42.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.520+0000 7fe332a21700 1 -- 172.21.15.50:0/1386401265 >> 172.21.15.50:0/1386401265 conn(0x7fe32c0f0d40 msgr2=0x7fe32c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:42.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.520+0000 7fe332a21700 1 -- 172.21.15.50:0/1386401265 shutdown_connections 2023-01-04T18:22:42.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.520+0000 7fe332a21700 1 -- 172.21.15.50:0/1386401265 wait complete. 2023-01-04T18:22:42.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.521+0000 7fe332a21700 1 Processor -- start 2023-01-04T18:22:42.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.521+0000 7fe332a21700 1 -- start start 2023-01-04T18:22:42.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.521+0000 7fe332a21700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe32c0f55c0 0x7fe32c105e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.521+0000 7fe332a21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe32c0f6860 0x7fe32c106380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.521+0000 7fe332a21700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c106930 con 0x7fe32c0f6860 2023-01-04T18:22:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.521+0000 7fe332a21700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c106a70 con 0x7fe32c0f55c0 2023-01-04T18:22:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.521+0000 7fe32b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe32c0f6860 0x7fe32c106380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.521+0000 7fe32b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe32c0f6860 0x7fe32c106380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32962/0 (socket says 172.21.15.50:32962) 2023-01-04T18:22:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.521+0000 7fe32b7fe700 1 -- 172.21.15.50:0/2716804495 learned_addr learned my addr 172.21.15.50:0/2716804495 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:22:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.521+0000 7fe32bfff700 1 --2- 172.21.15.50:0/2716804495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe32c0f55c0 0x7fe32c105e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.522+0000 7fe32b7fe700 1 -- 172.21.15.50:0/2716804495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe32c0f55c0 msgr2=0x7fe32c105e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.522+0000 7fe32b7fe700 1 --2- 172.21.15.50:0/2716804495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe32c0f55c0 0x7fe32c105e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.522+0000 7fe32b7fe700 1 -- 172.21.15.50:0/2716804495 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe320005040 con 0x7fe32c0f6860 2023-01-04T18:22:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.522+0000 7fe32b7fe700 1 --2- 172.21.15.50:0/2716804495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe32c0f6860 0x7fe32c106380 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fe31c0026d0 tx=0x7fe31c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.522+0000 7fe328ff9700 1 -- 172.21.15.50:0/2716804495 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe31c0079c0 con 0x7fe32c0f6860 2023-01-04T18:22:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.522+0000 7fe328ff9700 1 -- 172.21.15.50:0/2716804495 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe31c00f040 con 0x7fe32c0f6860 2023-01-04T18:22:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.522+0000 7fe332a21700 1 -- 172.21.15.50:0/2716804495 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32c107410 con 0x7fe32c0f6860 2023-01-04T18:22:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.522+0000 7fe328ff9700 1 -- 172.21.15.50:0/2716804495 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe31c014980 con 0x7fe32c0f6860 2023-01-04T18:22:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.522+0000 7fe332a21700 1 -- 172.21.15.50:0/2716804495 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32c1079d0 con 0x7fe32c0f6860 2023-01-04T18:22:42.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.523+0000 7fe332a21700 1 -- 172.21.15.50:0/2716804495 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32c045ad0 con 0x7fe32c0f6860 2023-01-04T18:22:42.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.524+0000 7fe328ff9700 1 -- 172.21.15.50:0/2716804495 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fe31c0090d0 con 0x7fe32c0f6860 2023-01-04T18:22:42.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.524+0000 7fe328ff9700 1 --2- 172.21.15.50:0/2716804495 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe314060be0 0x7fe3140630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:42.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.524+0000 7fe328ff9700 1 -- 172.21.15.50:0/2716804495 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fe31c07bc10 con 0x7fe32c0f6860 2023-01-04T18:22:42.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.524+0000 7fe32bfff700 1 --2- 172.21.15.50:0/2716804495 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe314060be0 0x7fe3140630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:42.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.525+0000 7fe32bfff700 1 --2- 172.21.15.50:0/2716804495 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe314060be0 0x7fe3140630a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fe320004630 tx=0x7fe320009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:42.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.528+0000 7fe328ff9700 1 -- 172.21.15.50:0/2716804495 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fe31c04fd40 con 0x7fe32c0f6860 2023-01-04T18:22:42.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:40.673268+0000 mgr.smithi050.emnywo (mgr.24517) 269 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 5 op/s 2023-01-04T18:22:42.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:41.149489+0000 mon.smithi050 (mon.0) 509 : cluster [DBG] mds.? [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592] up:reconnect 2023-01-04T18:22:42.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:41.149562+0000 mon.smithi050 (mon.0) 510 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi050.kefmuy=up:reconnect} 2 up:standby 2023-01-04T18:22:42.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:41.168688+0000 mds.cephfs.smithi050.kefmuy (mds.0) 1 : cluster [DBG] reconnect by client.24361 v1:172.21.15.50:0/1796285262 after 0.0219995 2023-01-04T18:22:42.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:41.173579+0000 mds.cephfs.smithi050.kefmuy (mds.0) 2 : cluster [DBG] reconnect by client.14550 v1:172.21.15.98:0/3097597380 after 0.0269993 2023-01-04T18:22:42.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:41.416212+0000 mgr.smithi050.emnywo (mgr.24517) 270 : audit [DBG] from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:22:42.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.757+0000 7fe332a21700 1 -- 172.21.15.50:0/2716804495 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe32c0ff870 con 0x7fe32c0f6860 2023-01-04T18:22:42.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.757+0000 7fe328ff9700 1 -- 172.21.15.50:0/2716804495 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1614 (secure 0 0 0) 0x7fe31c04f930 con 0x7fe32c0f6860 2023-01-04T18:22:42.760 INFO:teuthology.orchestra.run.smithi050.stdout:e19 2023-01-04T18:22:42.760 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:22:42.760 INFO:teuthology.orchestra.run.smithi050.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:22:42.760 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-01-04T18:22:42.760 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:22:42.760 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-01-04T18:22:42.760 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-01-04T18:22:42.761 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 19 2023-01-04T18:22:42.761 INFO:teuthology.orchestra.run.smithi050.stdout:flags 12 2023-01-04T18:22:42.761 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:22:42.761 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-01-04T18:22:42.147389+0000 2023-01-04T18:22:42.761 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-01-04T18:22:42.761 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-01-04T18:22:42.761 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 60 2023-01-04T18:22:42.761 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-01-04T18:22:42.761 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-01-04T18:22:42.761 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-01-04T18:22:42.761 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-01-04T18:22:42.761 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 90 2023-01-04T18:22:42.762 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:22:42.762 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 1 2023-01-04T18:22:42.762 INFO:teuthology.orchestra.run.smithi050.stdout:in 0 2023-01-04T18:22:42.762 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=14440} 2023-01-04T18:22:42.762 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-01-04T18:22:42.762 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-01-04T18:22:42.762 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-01-04T18:22:42.762 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-01-04T18:22:42.762 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-01-04T18:22:42.762 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data enabled 2023-01-04T18:22:42.762 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-01-04T18:22:42.762 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 1 2023-01-04T18:22:42.763 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.kefmuy{0:14440} state up:rejoin seq 123 join_fscid=1 addr [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:22:42.763 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:22:42.763 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:22:42.763 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2023-01-04T18:22:42.763 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:22:42.763 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.laynsk{-1:24297} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:22:42.763 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.memais{-1:44275} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.98:6824/3576035235,v1:172.21.15.98:6825/3576035235] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:22:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.759+0000 7fe332a21700 1 -- 172.21.15.50:0/2716804495 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe314060be0 msgr2=0x7fe3140630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.759+0000 7fe332a21700 1 --2- 172.21.15.50:0/2716804495 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe314060be0 0x7fe3140630a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fe320004630 tx=0x7fe320009b30).stop 2023-01-04T18:22:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.759+0000 7fe332a21700 1 -- 172.21.15.50:0/2716804495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe32c0f6860 msgr2=0x7fe32c106380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.759+0000 7fe332a21700 1 --2- 172.21.15.50:0/2716804495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe32c0f6860 0x7fe32c106380 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fe31c0026d0 tx=0x7fe31c009de0).stop 2023-01-04T18:22:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.759+0000 7fe332a21700 1 -- 172.21.15.50:0/2716804495 shutdown_connections 2023-01-04T18:22:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.760+0000 7fe332a21700 1 --2- 172.21.15.50:0/2716804495 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe314060be0 0x7fe3140630a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.760+0000 7fe332a21700 1 --2- 172.21.15.50:0/2716804495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe32c0f55c0 0x7fe32c105e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:42.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.760+0000 7fe332a21700 1 --2- 172.21.15.50:0/2716804495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe32c0f6860 0x7fe32c106380 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:42.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.760+0000 7fe332a21700 1 -- 172.21.15.50:0/2716804495 >> 172.21.15.50:0/2716804495 conn(0x7fe32c0f0d40 msgr2=0x7fe32c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:42.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.760+0000 7fe332a21700 1 -- 172.21.15.50:0/2716804495 shutdown_connections 2023-01-04T18:22:42.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.760+0000 7fe332a21700 1 -- 172.21.15.50:0/2716804495 wait complete. 2023-01-04T18:22:42.765 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 19 2023-01-04T18:22:42.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.865+0000 7f4ed3cd6700 1 -- 172.21.15.50:0/482558382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ecc0f55c0 msgr2=0x7f4ecc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:42.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.865+0000 7f4ed3cd6700 1 --2- 172.21.15.50:0/482558382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ecc0f55c0 0x7f4ecc0f59e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f4ec8004660 tx=0x7f4ec8009b30).stop 2023-01-04T18:22:42.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.865+0000 7f4ed3cd6700 1 -- 172.21.15.50:0/482558382 shutdown_connections 2023-01-04T18:22:42.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.865+0000 7f4ed3cd6700 1 --2- 172.21.15.50:0/482558382 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ecc0f6860 0x7f4ecc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:42.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.865+0000 7f4ed3cd6700 1 --2- 172.21.15.50:0/482558382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ecc0f55c0 0x7f4ecc0f59e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:42.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.865+0000 7f4ed3cd6700 1 -- 172.21.15.50:0/482558382 >> 172.21.15.50:0/482558382 conn(0x7f4ecc0f0d40 msgr2=0x7f4ecc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:42.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.865+0000 7f4ed3cd6700 1 -- 172.21.15.50:0/482558382 shutdown_connections 2023-01-04T18:22:42.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.865+0000 7f4ed3cd6700 1 -- 172.21.15.50:0/482558382 wait complete. 2023-01-04T18:22:42.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.866+0000 7f4ed3cd6700 1 Processor -- start 2023-01-04T18:22:42.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.866+0000 7f4ed3cd6700 1 -- start start 2023-01-04T18:22:42.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.866+0000 7f4ed3cd6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ecc0f55c0 0x7f4ecc105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:42.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.866+0000 7f4ed3cd6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ecc0f6860 0x7f4ecc1063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:42.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.866+0000 7f4ed3cd6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc106950 con 0x7f4ecc0f6860 2023-01-04T18:22:42.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.866+0000 7f4ed3cd6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc107150 con 0x7f4ecc0f55c0 2023-01-04T18:22:42.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.867+0000 7f4ed1271700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ecc0f6860 0x7f4ecc1063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:42.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.867+0000 7f4ed1271700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ecc0f6860 0x7f4ecc1063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32978/0 (socket says 172.21.15.50:32978) 2023-01-04T18:22:42.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.867+0000 7f4ed1271700 1 -- 172.21.15.50:0/2572284429 learned_addr learned my addr 172.21.15.50:0/2572284429 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:22:42.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.867+0000 7f4ed1a72700 1 --2- 172.21.15.50:0/2572284429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ecc0f55c0 0x7f4ecc105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:42.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.867+0000 7f4ed1271700 1 -- 172.21.15.50:0/2572284429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ecc0f55c0 msgr2=0x7f4ecc105eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:42.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.867+0000 7f4ed1271700 1 --2- 172.21.15.50:0/2572284429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ecc0f55c0 0x7f4ecc105eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:42.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.867+0000 7f4ed1271700 1 -- 172.21.15.50:0/2572284429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec8005040 con 0x7f4ecc0f6860 2023-01-04T18:22:42.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.867+0000 7f4ed1a72700 1 --2- 172.21.15.50:0/2572284429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ecc0f55c0 0x7f4ecc105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:22:42.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.867+0000 7f4ed1271700 1 --2- 172.21.15.50:0/2572284429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ecc0f6860 0x7f4ecc1063a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f4ebc00e7f0 tx=0x7f4ebc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:42.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.867+0000 7f4ec27fc700 1 -- 172.21.15.50:0/2572284429 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ebc0092e0 con 0x7f4ecc0f6860 2023-01-04T18:22:42.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.867+0000 7f4ec27fc700 1 -- 172.21.15.50:0/2572284429 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4ebc00f040 con 0x7f4ecc0f6860 2023-01-04T18:22:42.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.867+0000 7f4ed3cd6700 1 -- 172.21.15.50:0/2572284429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ecc107430 con 0x7f4ecc0f6860 2023-01-04T18:22:42.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.867+0000 7f4ec27fc700 1 -- 172.21.15.50:0/2572284429 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ebc0147e0 con 0x7f4ecc0f6860 2023-01-04T18:22:42.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.867+0000 7f4ed3cd6700 1 -- 172.21.15.50:0/2572284429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ecc107970 con 0x7f4ecc0f6860 2023-01-04T18:22:42.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.868+0000 7f4ed3cd6700 1 -- 172.21.15.50:0/2572284429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ecc0f49b0 con 0x7f4ecc0f6860 2023-01-04T18:22:42.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.868+0000 7f4ec27fc700 1 -- 172.21.15.50:0/2572284429 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f4ebc01b030 con 0x7f4ecc0f6860 2023-01-04T18:22:42.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.869+0000 7f4ec27fc700 1 --2- 172.21.15.50:0/2572284429 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4eb8060be0 0x7f4eb80630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:22:42.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.869+0000 7f4ec27fc700 1 -- 172.21.15.50:0/2572284429 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f4ebc07bb40 con 0x7f4ecc0f6860 2023-01-04T18:22:42.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.869+0000 7f4ed1a72700 1 --2- 172.21.15.50:0/2572284429 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4eb8060be0 0x7f4eb80630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:22:42.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.869+0000 7f4ed1a72700 1 --2- 172.21.15.50:0/2572284429 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4eb8060be0 0x7f4eb80630a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f4ec8009720 tx=0x7f4ec800b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:22:42.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:42.873+0000 7f4ec27fc700 1 -- 172.21.15.50:0/2572284429 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f4ebc04fbf0 con 0x7f4ecc0f6860 2023-01-04T18:22:43.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:43.060+0000 7f4ed3cd6700 1 -- 172.21.15.50:0/2572284429 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ecc0fde60 con 0x7f4eb8060be0 2023-01-04T18:22:43.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:43.061+0000 7f4ec27fc700 1 -- 172.21.15.50:0/2572284429 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4ecc0fde60 con 0x7f4eb8060be0 2023-01-04T18:22:43.064 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:22:43.064 INFO:teuthology.orchestra.run.smithi050.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308", 2023-01-04T18:22:43.064 INFO:teuthology.orchestra.run.smithi050.stdout: "in_progress": true, 2023-01-04T18:22:43.064 INFO:teuthology.orchestra.run.smithi050.stdout: "which": "Upgrading all daemon types on all hosts", 2023-01-04T18:22:43.065 INFO:teuthology.orchestra.run.smithi050.stdout: "services_complete": [ 2023-01-04T18:22:43.065 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2023-01-04T18:22:43.065 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr", 2023-01-04T18:22:43.065 INFO:teuthology.orchestra.run.smithi050.stdout: "osd", 2023-01-04T18:22:43.065 INFO:teuthology.orchestra.run.smithi050.stdout: "mon" 2023-01-04T18:22:43.065 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-01-04T18:22:43.066 INFO:teuthology.orchestra.run.smithi050.stdout: "progress": "12/21 daemons upgraded", 2023-01-04T18:22:43.066 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "Currently upgrading mds daemons", 2023-01-04T18:22:43.066 INFO:teuthology.orchestra.run.smithi050.stdout: "is_paused": false 2023-01-04T18:22:43.066 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:22:43.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:43.063+0000 7f4ed3cd6700 1 -- 172.21.15.50:0/2572284429 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4eb8060be0 msgr2=0x7f4eb80630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:43.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:43.063+0000 7f4ed3cd6700 1 --2- 172.21.15.50:0/2572284429 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4eb8060be0 0x7f4eb80630a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f4ec8009720 tx=0x7f4ec800b040).stop 2023-01-04T18:22:43.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:43.063+0000 7f4ed3cd6700 1 -- 172.21.15.50:0/2572284429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ecc0f6860 msgr2=0x7f4ecc1063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:22:43.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:43.063+0000 7f4ed3cd6700 1 --2- 172.21.15.50:0/2572284429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ecc0f6860 0x7f4ecc1063a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f4ebc00e7f0 tx=0x7f4ebc00b040).stop 2023-01-04T18:22:43.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:43.063+0000 7f4ed3cd6700 1 -- 172.21.15.50:0/2572284429 shutdown_connections 2023-01-04T18:22:43.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:43.063+0000 7f4ed3cd6700 1 --2- 172.21.15.50:0/2572284429 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4eb8060be0 0x7f4eb80630a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:43.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:43.063+0000 7f4ed3cd6700 1 --2- 172.21.15.50:0/2572284429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ecc0f55c0 0x7f4ecc105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:43.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:43.063+0000 7f4ed3cd6700 1 --2- 172.21.15.50:0/2572284429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ecc0f6860 0x7f4ecc1063a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:22:43.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:43.063+0000 7f4ed3cd6700 1 -- 172.21.15.50:0/2572284429 >> 172.21.15.50:0/2572284429 conn(0x7f4ecc0f0d40 msgr2=0x7f4ecc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:22:43.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:43.063+0000 7f4ed3cd6700 1 -- 172.21.15.50:0/2572284429 shutdown_connections 2023-01-04T18:22:43.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:22:43.063+0000 7f4ed3cd6700 1 -- 172.21.15.50:0/2572284429 wait complete. 2023-01-04T18:22:43.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:41.721137+0000 mgr.smithi050.emnywo (mgr.24517) 271 : audit [DBG] from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:22:43.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:42.015969+0000 mgr.smithi050.emnywo (mgr.24517) 272 : audit [DBG] from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:22:43.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:42.159142+0000 mon.smithi050 (mon.0) 511 : cluster [DBG] mds.? [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592] up:rejoin 2023-01-04T18:22:43.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:42.159207+0000 mon.smithi050 (mon.0) 512 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi050.kefmuy=up:rejoin} 2 up:standby 2023-01-04T18:22:43.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:42.247503+0000 mon.smithi050 (mon.0) 513 : cluster [INF] daemon mds.cephfs.smithi050.kefmuy is now active in filesystem cephfs as rank 0 2023-01-04T18:22:43.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:42.413467+0000 mon.smithi050 (mon.0) 514 : audit [DBG] from='client.? 172.21.15.50:0/1418808596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:43.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:42.757967+0000 mon.smithi050 (mon.0) 515 : audit [DBG] from='client.? 172.21.15.50:0/2716804495' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:22:43.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:41.721137+0000 mgr.smithi050.emnywo (mgr.24517) 271 : audit [DBG] from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:22:43.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:42.015969+0000 mgr.smithi050.emnywo (mgr.24517) 272 : audit [DBG] from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:22:43.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:42.159142+0000 mon.smithi050 (mon.0) 511 : cluster [DBG] mds.? [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592] up:rejoin 2023-01-04T18:22:43.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:42.159207+0000 mon.smithi050 (mon.0) 512 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi050.kefmuy=up:rejoin} 2 up:standby 2023-01-04T18:22:43.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:42.247503+0000 mon.smithi050 (mon.0) 513 : cluster [INF] daemon mds.cephfs.smithi050.kefmuy is now active in filesystem cephfs as rank 0 2023-01-04T18:22:43.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:42.413467+0000 mon.smithi050 (mon.0) 514 : audit [DBG] from='client.? 172.21.15.50:0/1418808596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:43.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:42.757967+0000 mon.smithi050 (mon.0) 515 : audit [DBG] from='client.? 172.21.15.50:0/2716804495' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:22:44.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:42.673658+0000 mgr.smithi050.emnywo (mgr.24517) 273 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 4 op/s 2023-01-04T18:22:44.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:43.061630+0000 mgr.smithi050.emnywo (mgr.24517) 274 : audit [DBG] from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:22:44.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:43.157837+0000 mon.smithi050 (mon.0) 516 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-01-04T18:22:44.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:43.164642+0000 mon.smithi050 (mon.0) 517 : cluster [DBG] mds.? [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592] up:active 2023-01-04T18:22:44.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:43.164693+0000 mon.smithi050 (mon.0) 518 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.kefmuy=up:active} 2 up:standby 2023-01-04T18:22:44.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:42.673658+0000 mgr.smithi050.emnywo (mgr.24517) 273 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 4 op/s 2023-01-04T18:22:44.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:43.061630+0000 mgr.smithi050.emnywo (mgr.24517) 274 : audit [DBG] from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:22:44.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:43.157837+0000 mon.smithi050 (mon.0) 516 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-01-04T18:22:44.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:43.164642+0000 mon.smithi050 (mon.0) 517 : cluster [DBG] mds.? [v2:172.21.15.50:6828/3827606592,v1:172.21.15.50:6829/3827606592] up:active 2023-01-04T18:22:44.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:43.164693+0000 mon.smithi050 (mon.0) 518 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.kefmuy=up:active} 2 up:standby 2023-01-04T18:22:46.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:44.674148+0000 mgr.smithi050.emnywo (mgr.24517) 275 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.9 KiB/s wr, 9 op/s 2023-01-04T18:22:46.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:44.814591+0000 mon.smithi050 (mon.0) 519 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:46.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:44.815449+0000 mon.smithi050 (mon.0) 520 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:22:46.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:44.816626+0000 mon.smithi050 (mon.0) 521 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:22:46.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:44.817375+0000 mon.smithi050 (mon.0) 522 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:22:46.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:22:44.818028+0000 mgr.smithi050.emnywo (mgr.24517) 276 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:22:46.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:45.000037+0000 mon.smithi050 (mon.0) 523 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:46.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:45.168240+0000 mon.smithi050 (mon.0) 524 : cluster [DBG] mds.? [v2:172.21.15.50:6826/336562041,v1:172.21.15.50:6827/336562041] up:boot 2023-01-04T18:22:46.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:45.168288+0000 mon.smithi050 (mon.0) 525 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.kefmuy=up:active} 3 up:standby 2023-01-04T18:22:46.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:45.168392+0000 mon.smithi050 (mon.0) 526 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi050.ezoiwl"}]: dispatch 2023-01-04T18:22:46.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:44.674148+0000 mgr.smithi050.emnywo (mgr.24517) 275 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.9 KiB/s wr, 9 op/s 2023-01-04T18:22:46.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:44.814591+0000 mon.smithi050 (mon.0) 519 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:46.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:44.815449+0000 mon.smithi050 (mon.0) 520 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:22:46.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:44.816626+0000 mon.smithi050 (mon.0) 521 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:22:46.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:44.817375+0000 mon.smithi050 (mon.0) 522 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:22:46.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:22:44.818028+0000 mgr.smithi050.emnywo (mgr.24517) 276 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:22:46.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:45.000037+0000 mon.smithi050 (mon.0) 523 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:46.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:45.168240+0000 mon.smithi050 (mon.0) 524 : cluster [DBG] mds.? [v2:172.21.15.50:6826/336562041,v1:172.21.15.50:6827/336562041] up:boot 2023-01-04T18:22:46.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:45.168288+0000 mon.smithi050 (mon.0) 525 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.kefmuy=up:active} 3 up:standby 2023-01-04T18:22:46.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:45.168392+0000 mon.smithi050 (mon.0) 526 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi050.ezoiwl"}]: dispatch 2023-01-04T18:22:48.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:46.674520+0000 mgr.smithi050.emnywo (mgr.24517) 277 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 8.2 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2023-01-04T18:22:48.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:46.674520+0000 mgr.smithi050.emnywo (mgr.24517) 277 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 8.2 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2023-01-04T18:22:50.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:48.674886+0000 mgr.smithi050.emnywo (mgr.24517) 278 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 6.2 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2023-01-04T18:22:50.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:48.674886+0000 mgr.smithi050.emnywo (mgr.24517) 278 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 6.2 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2023-01-04T18:22:51.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:50.507334+0000 mon.smithi050 (mon.0) 527 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:51.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:50.510390+0000 mon.smithi050 (mon.0) 528 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:51.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:50.515069+0000 mon.smithi050 (mon.0) 529 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:22:51.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:50.517182+0000 mon.smithi050 (mon.0) 530 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:51.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:50.518320+0000 mon.smithi050 (mon.0) 531 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:51.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:50.519416+0000 mon.smithi050 (mon.0) 532 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:51.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:50.520842+0000 mon.smithi050 (mon.0) 533 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:51.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:50.522416+0000 mon.smithi050 (mon.0) 534 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi050.kefmuy"]}]: dispatch 2023-01-04T18:22:51.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:22:50.522944+0000 mgr.smithi050.emnywo (mgr.24517) 279 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi050.kefmuy 2023-01-04T18:22:51.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:51 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:50.507334+0000 mon.smithi050 (mon.0) 527 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:51.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:51 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:50.510390+0000 mon.smithi050 (mon.0) 528 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:51.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:51 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:50.515069+0000 mon.smithi050 (mon.0) 529 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:22:51.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:51 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:50.517182+0000 mon.smithi050 (mon.0) 530 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:51.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:51 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:50.518320+0000 mon.smithi050 (mon.0) 531 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:51.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:51 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:50.519416+0000 mon.smithi050 (mon.0) 532 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:51.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:51 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:50.520842+0000 mon.smithi050 (mon.0) 533 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:22:51.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:51 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:50.522416+0000 mon.smithi050 (mon.0) 534 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi050.kefmuy"]}]: dispatch 2023-01-04T18:22:51.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:51 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:22:50.522944+0000 mgr.smithi050.emnywo (mgr.24517) 279 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi050.kefmuy 2023-01-04T18:22:52.619 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:50.675302+0000 mgr.smithi050.emnywo (mgr.24517) 280 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 5.9 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2023-01-04T18:22:52.619 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:51.913585+0000 mon.smithi050 (mon.0) 535 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:52.619 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:51.914275+0000 mon.smithi050 (mon.0) 536 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi050.kefmuy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-01-04T18:22:52.619 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:51.914923+0000 mon.smithi050 (mon.0) 537 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:22:52.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:50.675302+0000 mgr.smithi050.emnywo (mgr.24517) 280 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 5.9 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2023-01-04T18:22:52.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:51.913585+0000 mon.smithi050 (mon.0) 535 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:22:52.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:51.914275+0000 mon.smithi050 (mon.0) 536 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi050.kefmuy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-01-04T18:22:52.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:51.914923+0000 mon.smithi050 (mon.0) 537 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:22:53.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:22:53.511+0000 7f3454949700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-01-04T18:22:53.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:22:51.909560+0000 mgr.smithi050.emnywo (mgr.24517) 281 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi050.kefmuy 2023-01-04T18:22:53.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:22:51.915441+0000 mgr.smithi050.emnywo (mgr.24517) 282 : cephadm [INF] Deploying daemon mds.cephfs.smithi050.kefmuy on smithi050 2023-01-04T18:22:53.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:53.281043+0000 mon.smithi050 (mon.0) 538 : cluster [DBG] osdmap e93: 6 total, 6 up, 6 in 2023-01-04T18:22:53.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:22:51.909560+0000 mgr.smithi050.emnywo (mgr.24517) 281 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi050.kefmuy 2023-01-04T18:22:53.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:22:51.915441+0000 mgr.smithi050.emnywo (mgr.24517) 282 : cephadm [INF] Deploying daemon mds.cephfs.smithi050.kefmuy on smithi050 2023-01-04T18:22:53.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:53.281043+0000 mon.smithi050 (mon.0) 538 : cluster [DBG] osdmap e93: 6 total, 6 up, 6 in 2023-01-04T18:22:53.831 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:22:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-3[126692]: debug 2023-01-04T18:22:53.532+0000 7f5c69f0e700 -1 bdev(0x56059129a800 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 7 2023-01-04T18:22:53.831 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:22:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-3[126692]: debug 2023-01-04T18:22:53.535+0000 7f5c6cf14700 -1 bdev(0x56059129a800 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 14 2023-01-04T18:22:53.831 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:22:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-3[126692]: debug 2023-01-04T18:22:53.535+0000 7f5c6c713700 -1 bdev(0x56059129a800 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 11 2023-01-04T18:22:54.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:52.675733+0000 mgr.smithi050.emnywo (mgr.24517) 283 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 357 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2023-01-04T18:22:54.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:53.512491+0000 mon.smithi050 (mon.0) 539 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-01-04T18:22:54.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:53.512525+0000 mon.smithi050 (mon.0) 540 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-01-04T18:22:54.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:53.518383+0000 mon.smithi050 (mon.0) 541 : cluster [INF] Standby daemon mds.cephfs.smithi098.laynsk assigned to filesystem cephfs as rank 0 2023-01-04T18:22:54.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:53.518478+0000 mon.smithi050 (mon.0) 542 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-01-04T18:22:54.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:53.518646+0000 mon.smithi050 (mon.0) 543 : cluster [DBG] fsmap cephfs:0/1 3 up:standby, 1 failed 2023-01-04T18:22:54.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:53.520743+0000 mon.smithi050 (mon.0) 544 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi098.laynsk=up:replay} 2 up:standby 2023-01-04T18:22:54.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:52.675733+0000 mgr.smithi050.emnywo (mgr.24517) 283 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 357 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2023-01-04T18:22:54.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:53.512491+0000 mon.smithi050 (mon.0) 539 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-01-04T18:22:54.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:53.512525+0000 mon.smithi050 (mon.0) 540 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-01-04T18:22:54.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:53.518383+0000 mon.smithi050 (mon.0) 541 : cluster [INF] Standby daemon mds.cephfs.smithi098.laynsk assigned to filesystem cephfs as rank 0 2023-01-04T18:22:54.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:53.518478+0000 mon.smithi050 (mon.0) 542 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-01-04T18:22:54.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:53.518646+0000 mon.smithi050 (mon.0) 543 : cluster [DBG] fsmap cephfs:0/1 3 up:standby, 1 failed 2023-01-04T18:22:54.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:53.520743+0000 mon.smithi050 (mon.0) 544 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi098.laynsk=up:replay} 2 up:standby 2023-01-04T18:22:56.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:54.676251+0000 mgr.smithi050.emnywo (mgr.24517) 284 : cluster [DBG] pgmap v217: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 4.8 MiB/s rd, 2 op/s 2023-01-04T18:22:56.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:54.676251+0000 mgr.smithi050.emnywo (mgr.24517) 284 : cluster [DBG] pgmap v217: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 4.8 MiB/s rd, 2 op/s 2023-01-04T18:22:58.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:22:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:56.676696+0000 mgr.smithi050.emnywo (mgr.24517) 285 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 7.2 MiB/s rd, 3 op/s 2023-01-04T18:22:58.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:22:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:56.676696+0000 mgr.smithi050.emnywo (mgr.24517) 285 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 7.2 MiB/s rd, 3 op/s 2023-01-04T18:23:00.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:22:58.677070+0000 mgr.smithi050.emnywo (mgr.24517) 286 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 7.6 MiB/s rd, 3 op/s 2023-01-04T18:23:00.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:59.691596+0000 mon.smithi050 (mon.0) 545 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:00.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:59.692330+0000 mon.smithi050 (mon.0) 546 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:23:00.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:59.693326+0000 mon.smithi050 (mon.0) 547 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:23:00.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:22:59.693896+0000 mon.smithi050 (mon.0) 548 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:23:00.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:22:58.677070+0000 mgr.smithi050.emnywo (mgr.24517) 286 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 7.6 MiB/s rd, 3 op/s 2023-01-04T18:23:00.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:59.691596+0000 mon.smithi050 (mon.0) 545 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:00.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:59.692330+0000 mon.smithi050 (mon.0) 546 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:23:00.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:59.693326+0000 mon.smithi050 (mon.0) 547 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:23:00.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:22:59.693896+0000 mon.smithi050 (mon.0) 548 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:23:01.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:01 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:22:59.694446+0000 mgr.smithi050.emnywo (mgr.24517) 287 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:23:01.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:01 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:00.527702+0000 mon.smithi050 (mon.0) 549 : cluster [DBG] mds.? [v2:172.21.15.50:6828/2188030488,v1:172.21.15.50:6829/2188030488] up:boot 2023-01-04T18:23:01.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:01 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:00.527758+0000 mon.smithi050 (mon.0) 550 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi098.laynsk=up:replay} 3 up:standby 2023-01-04T18:23:01.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:01 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:00.528028+0000 mon.smithi050 (mon.0) 551 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi050.kefmuy"}]: dispatch 2023-01-04T18:23:01.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:22:59.694446+0000 mgr.smithi050.emnywo (mgr.24517) 287 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:23:01.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:00.527702+0000 mon.smithi050 (mon.0) 549 : cluster [DBG] mds.? [v2:172.21.15.50:6828/2188030488,v1:172.21.15.50:6829/2188030488] up:boot 2023-01-04T18:23:01.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:00.527758+0000 mon.smithi050 (mon.0) 550 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi098.laynsk=up:replay} 3 up:standby 2023-01-04T18:23:01.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:00.528028+0000 mon.smithi050 (mon.0) 551 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi050.kefmuy"}]: dispatch 2023-01-04T18:23:02.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:00.677476+0000 mgr.smithi050.emnywo (mgr.24517) 288 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2023-01-04T18:23:02.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:00.677476+0000 mgr.smithi050.emnywo (mgr.24517) 288 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2023-01-04T18:23:04.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:02.677840+0000 mgr.smithi050.emnywo (mgr.24517) 289 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2023-01-04T18:23:04.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:03.546780+0000 mon.smithi050 (mon.0) 552 : cluster [DBG] mds.? [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] up:reconnect 2023-01-04T18:23:04.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:03.546827+0000 mon.smithi050 (mon.0) 553 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi098.laynsk=up:reconnect} 3 up:standby 2023-01-04T18:23:04.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:03.566992+0000 mds.cephfs.smithi098.laynsk (mds.0) 1 : cluster [DBG] reconnect by client.14550 v1:172.21.15.98:0/3097597380 after 0.0219997 2023-01-04T18:23:04.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:03.567078+0000 mds.cephfs.smithi098.laynsk (mds.0) 2 : cluster [DBG] reconnect by client.24361 v1:172.21.15.50:0/1796285262 after 0.0219997 2023-01-04T18:23:05.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:02.677840+0000 mgr.smithi050.emnywo (mgr.24517) 289 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2023-01-04T18:23:05.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:03.546780+0000 mon.smithi050 (mon.0) 552 : cluster [DBG] mds.? [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] up:reconnect 2023-01-04T18:23:05.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:03.546827+0000 mon.smithi050 (mon.0) 553 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi098.laynsk=up:reconnect} 3 up:standby 2023-01-04T18:23:05.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:03.566992+0000 mds.cephfs.smithi098.laynsk (mds.0) 1 : cluster [DBG] reconnect by client.14550 v1:172.21.15.98:0/3097597380 after 0.0219997 2023-01-04T18:23:05.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:03.567078+0000 mds.cephfs.smithi098.laynsk (mds.0) 2 : cluster [DBG] reconnect by client.24361 v1:172.21.15.50:0/1796285262 after 0.0219997 2023-01-04T18:23:05.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:05 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:04.548697+0000 mon.smithi050 (mon.0) 554 : cluster [DBG] mds.? [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] up:rejoin 2023-01-04T18:23:05.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:05 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:04.548747+0000 mon.smithi050 (mon.0) 555 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi098.laynsk=up:rejoin} 3 up:standby 2023-01-04T18:23:05.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:05 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:04.624855+0000 mon.smithi050 (mon.0) 556 : cluster [INF] daemon mds.cephfs.smithi098.laynsk is now active in filesystem cephfs as rank 0 2023-01-04T18:23:05.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:05 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:04.826413+0000 mon.smithi050 (mon.0) 557 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:05.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:05 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:04.829584+0000 mon.smithi050 (mon.0) 558 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:05.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:05 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:04.835170+0000 mon.smithi050 (mon.0) 559 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:23:05.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:05 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:04.837410+0000 mon.smithi050 (mon.0) 560 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:05.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:05 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:04.838648+0000 mon.smithi050 (mon.0) 561 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:05.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:05 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:04.839852+0000 mon.smithi050 (mon.0) 562 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:05.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:05 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:04.841577+0000 mon.smithi050 (mon.0) 563 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:06.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:04.548697+0000 mon.smithi050 (mon.0) 554 : cluster [DBG] mds.? [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] up:rejoin 2023-01-04T18:23:06.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:04.548747+0000 mon.smithi050 (mon.0) 555 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi098.laynsk=up:rejoin} 3 up:standby 2023-01-04T18:23:06.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:04.624855+0000 mon.smithi050 (mon.0) 556 : cluster [INF] daemon mds.cephfs.smithi098.laynsk is now active in filesystem cephfs as rank 0 2023-01-04T18:23:06.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:04.826413+0000 mon.smithi050 (mon.0) 557 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:06.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:04.829584+0000 mon.smithi050 (mon.0) 558 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:06.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:04.835170+0000 mon.smithi050 (mon.0) 559 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:23:06.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:04.837410+0000 mon.smithi050 (mon.0) 560 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:06.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:04.838648+0000 mon.smithi050 (mon.0) 561 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:06.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:04.839852+0000 mon.smithi050 (mon.0) 562 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:06.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:05 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:04.841577+0000 mon.smithi050 (mon.0) 563 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:06.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:04.678385+0000 mgr.smithi050.emnywo (mgr.24517) 290 : cluster [DBG] pgmap v222: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2023-01-04T18:23:06.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:23:04.843071+0000 mgr.smithi050.emnywo (mgr.24517) 291 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi098.laynsk to be up:active (currently up:rejoin) 2023-01-04T18:23:06.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:05.550968+0000 mon.smithi050 (mon.0) 564 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-01-04T18:23:06.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:05.558450+0000 mon.smithi050 (mon.0) 565 : cluster [DBG] mds.? [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] up:active 2023-01-04T18:23:06.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:05.558547+0000 mon.smithi050 (mon.0) 566 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi098.laynsk=up:active} 3 up:standby 2023-01-04T18:23:07.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:04.678385+0000 mgr.smithi050.emnywo (mgr.24517) 290 : cluster [DBG] pgmap v222: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2023-01-04T18:23:07.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:23:04.843071+0000 mgr.smithi050.emnywo (mgr.24517) 291 : cephadm [INF] Upgrade: Waiting for mds.cephfs.smithi098.laynsk to be up:active (currently up:rejoin) 2023-01-04T18:23:07.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:05.550968+0000 mon.smithi050 (mon.0) 564 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-01-04T18:23:07.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:05.558450+0000 mon.smithi050 (mon.0) 565 : cluster [DBG] mds.? [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] up:active 2023-01-04T18:23:07.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:05.558547+0000 mon.smithi050 (mon.0) 566 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi098.laynsk=up:active} 3 up:standby 2023-01-04T18:23:08.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:06.678937+0000 mgr.smithi050.emnywo (mgr.24517) 292 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 3 op/s 2023-01-04T18:23:09.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:06.678937+0000 mgr.smithi050.emnywo (mgr.24517) 292 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 3 op/s 2023-01-04T18:23:10.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:08.679431+0000 mgr.smithi050.emnywo (mgr.24517) 293 : cluster [DBG] pgmap v224: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 9.9 MiB/s rd, 3 op/s 2023-01-04T18:23:10.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:09.849093+0000 mon.smithi050 (mon.0) 567 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:11.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:08.679431+0000 mgr.smithi050.emnywo (mgr.24517) 293 : cluster [DBG] pgmap v224: 65 pgs: 65 active+clean; 194 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 9.9 MiB/s rd, 3 op/s 2023-01-04T18:23:11.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:09.849093+0000 mon.smithi050 (mon.0) 567 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:12.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:10.680104+0000 mgr.smithi050.emnywo (mgr.24517) 294 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 9.6 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2023-01-04T18:23:12.859 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:10.680104+0000 mgr.smithi050.emnywo (mgr.24517) 294 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 9.6 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2023-01-04T18:23:13.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.179+0000 7f89fef9b700 1 -- 172.21.15.50:0/1890863796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89f80f55c0 msgr2=0x7f89f80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:13.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.179+0000 7f89fef9b700 1 --2- 172.21.15.50:0/1890863796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89f80f55c0 0x7f89f80f59e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f89ec004660 tx=0x7f89ec009b30).stop 2023-01-04T18:23:13.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.179+0000 7f89fef9b700 1 -- 172.21.15.50:0/1890863796 shutdown_connections 2023-01-04T18:23:13.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.179+0000 7f89fef9b700 1 --2- 172.21.15.50:0/1890863796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89f80f6860 0x7f89f80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:13.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.179+0000 7f89fef9b700 1 --2- 172.21.15.50:0/1890863796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89f80f55c0 0x7f89f80f59e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:13.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.179+0000 7f89fef9b700 1 -- 172.21.15.50:0/1890863796 >> 172.21.15.50:0/1890863796 conn(0x7f89f80f0d40 msgr2=0x7f89f80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:13.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.179+0000 7f89fef9b700 1 -- 172.21.15.50:0/1890863796 shutdown_connections 2023-01-04T18:23:13.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.179+0000 7f89fef9b700 1 -- 172.21.15.50:0/1890863796 wait complete. 2023-01-04T18:23:13.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.180+0000 7f89fef9b700 1 Processor -- start 2023-01-04T18:23:13.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.180+0000 7f89fef9b700 1 -- start start 2023-01-04T18:23:13.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.180+0000 7f89fef9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89f80f55c0 0x7f89f80f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:13.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.180+0000 7f89fef9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89f80f6860 0x7f89f80f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.180+0000 7f89fef9b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f80f8100 con 0x7f89f80f55c0 2023-01-04T18:23:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.180+0000 7f89fef9b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f80f8240 con 0x7f89f80f6860 2023-01-04T18:23:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.181+0000 7f89fcd37700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89f80f55c0 0x7f89f80f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.181+0000 7f89fcd37700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89f80f55c0 0x7f89f80f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60088/0 (socket says 172.21.15.50:60088) 2023-01-04T18:23:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.181+0000 7f89fcd37700 1 -- 172.21.15.50:0/3155563479 learned_addr learned my addr 172.21.15.50:0/3155563479 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:23:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.181+0000 7f89fcd37700 1 -- 172.21.15.50:0/3155563479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89f80f6860 msgr2=0x7f89f80f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.181+0000 7f89fcd37700 1 --2- 172.21.15.50:0/3155563479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89f80f6860 0x7f89f80f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-01-04T18:23:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.181+0000 7f89fcd37700 1 -- 172.21.15.50:0/3155563479 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec005040 con 0x7f89f80f55c0 2023-01-04T18:23:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.181+0000 7f89fcd37700 1 --2- 172.21.15.50:0/3155563479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89f80f55c0 0x7f89f80f9720 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f89ec004e30 tx=0x7f89ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.181+0000 7f89f57fa700 1 -- 172.21.15.50:0/3155563479 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89ec018070 con 0x7f89f80f55c0 2023-01-04T18:23:13.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.181+0000 7f89fef9b700 1 -- 172.21.15.50:0/3155563479 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f80f84c0 con 0x7f89f80f55c0 2023-01-04T18:23:13.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.181+0000 7f89f57fa700 1 -- 172.21.15.50:0/3155563479 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f89ec009630 con 0x7f89f80f55c0 2023-01-04T18:23:13.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.181+0000 7f89f57fa700 1 -- 172.21.15.50:0/3155563479 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89ec01c3c0 con 0x7f89f80f55c0 2023-01-04T18:23:13.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.181+0000 7f89fef9b700 1 -- 172.21.15.50:0/3155563479 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f80f8a20 con 0x7f89f80f55c0 2023-01-04T18:23:13.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.182+0000 7f89fef9b700 1 -- 172.21.15.50:0/3155563479 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f8045ad0 con 0x7f89f80f55c0 2023-01-04T18:23:13.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.183+0000 7f89f57fa700 1 -- 172.21.15.50:0/3155563479 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f89ec01d420 con 0x7f89f80f55c0 2023-01-04T18:23:13.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.183+0000 7f89f57fa700 1 --2- 172.21.15.50:0/3155563479 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f89e8060be0 0x7f89e80630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:13.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.183+0000 7f89f57fa700 1 -- 172.21.15.50:0/3155563479 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f89ec07db20 con 0x7f89f80f55c0 2023-01-04T18:23:13.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.183+0000 7f89f7fff700 1 --2- 172.21.15.50:0/3155563479 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f89e8060be0 0x7f89e80630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:13.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.184+0000 7f89f7fff700 1 --2- 172.21.15.50:0/3155563479 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f89e8060be0 0x7f89e80630a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f89e4004ad0 tx=0x7f89e4009af0).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:13.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.188+0000 7f89f57fa700 1 -- 172.21.15.50:0/3155563479 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f89ec04e0b0 con 0x7f89f80f55c0 2023-01-04T18:23:13.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.378+0000 7f89fef9b700 1 -- 172.21.15.50:0/3155563479 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f89f80faca0 con 0x7f89e8060be0 2023-01-04T18:23:13.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.379+0000 7f89f57fa700 1 -- 172.21.15.50:0/3155563479 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f89f80faca0 con 0x7f89e8060be0 2023-01-04T18:23:13.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.381+0000 7f89fef9b700 1 -- 172.21.15.50:0/3155563479 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f89e8060be0 msgr2=0x7f89e80630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:13.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.381+0000 7f89fef9b700 1 --2- 172.21.15.50:0/3155563479 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f89e8060be0 0x7f89e80630a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f89e4004ad0 tx=0x7f89e4009af0).stop 2023-01-04T18:23:13.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.381+0000 7f89fef9b700 1 -- 172.21.15.50:0/3155563479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89f80f55c0 msgr2=0x7f89f80f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:13.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.381+0000 7f89fef9b700 1 --2- 172.21.15.50:0/3155563479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89f80f55c0 0x7f89f80f9720 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f89ec004e30 tx=0x7f89ec009b30).stop 2023-01-04T18:23:13.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.381+0000 7f89fef9b700 1 -- 172.21.15.50:0/3155563479 shutdown_connections 2023-01-04T18:23:13.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.381+0000 7f89fef9b700 1 --2- 172.21.15.50:0/3155563479 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f89e8060be0 0x7f89e80630a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:13.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.381+0000 7f89fef9b700 1 --2- 172.21.15.50:0/3155563479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89f80f55c0 0x7f89f80f9720 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:13.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.381+0000 7f89fef9b700 1 --2- 172.21.15.50:0/3155563479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89f80f6860 0x7f89f80f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-01-04T18:23:13.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.381+0000 7f89fef9b700 1 -- 172.21.15.50:0/3155563479 >> 172.21.15.50:0/3155563479 conn(0x7f89f80f0d40 msgr2=0x7f89f805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:13.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.381+0000 7f89fef9b700 1 -- 172.21.15.50:0/3155563479 shutdown_connections 2023-01-04T18:23:13.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.381+0000 7f89fef9b700 1 -- 172.21.15.50:0/3155563479 wait complete. 2023-01-04T18:23:13.395 INFO:teuthology.orchestra.run.smithi050.stdout:true 2023-01-04T18:23:13.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.484+0000 7fb3318cd700 1 -- 172.21.15.50:0/841841891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb32c0f6700 msgr2=0x7fb32c0f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.484+0000 7fb3318cd700 1 --2- 172.21.15.50:0/841841891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb32c0f6700 0x7fb32c0f6b60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fb320004660 tx=0x7fb320009b30).stop 2023-01-04T18:23:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.484+0000 7fb3318cd700 1 -- 172.21.15.50:0/841841891 shutdown_connections 2023-01-04T18:23:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.484+0000 7fb3318cd700 1 --2- 172.21.15.50:0/841841891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb32c0f6700 0x7fb32c0f6b60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.484+0000 7fb3318cd700 1 --2- 172.21.15.50:0/841841891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb32c0f5460 0x7fb32c0f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.484+0000 7fb3318cd700 1 -- 172.21.15.50:0/841841891 >> 172.21.15.50:0/841841891 conn(0x7fb32c0f0bc0 msgr2=0x7fb32c0f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.485+0000 7fb3318cd700 1 -- 172.21.15.50:0/841841891 shutdown_connections 2023-01-04T18:23:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.485+0000 7fb3318cd700 1 -- 172.21.15.50:0/841841891 wait complete. 2023-01-04T18:23:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.485+0000 7fb3318cd700 1 Processor -- start 2023-01-04T18:23:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.485+0000 7fb3318cd700 1 -- start start 2023-01-04T18:23:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.485+0000 7fb3318cd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb32c0f5460 0x7fb32c109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.485+0000 7fb3318cd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb32c0f6700 0x7fb32c10bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.485+0000 7fb3318cd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c0603e0 con 0x7fb32c0f6700 2023-01-04T18:23:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.485+0000 7fb3318cd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c060520 con 0x7fb32c0f5460 2023-01-04T18:23:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.486+0000 7fb32a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb32c0f6700 0x7fb32c10bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.486+0000 7fb32a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb32c0f6700 0x7fb32c10bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60106/0 (socket says 172.21.15.50:60106) 2023-01-04T18:23:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.486+0000 7fb32a7fc700 1 -- 172.21.15.50:0/41908320 learned_addr learned my addr 172.21.15.50:0/41908320 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:23:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.486+0000 7fb32affd700 1 --2- 172.21.15.50:0/41908320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb32c0f5460 0x7fb32c109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.486+0000 7fb32a7fc700 1 -- 172.21.15.50:0/41908320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb32c0f5460 msgr2=0x7fb32c109ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.486+0000 7fb32a7fc700 1 --2- 172.21.15.50:0/41908320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb32c0f5460 0x7fb32c109ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.486+0000 7fb32a7fc700 1 -- 172.21.15.50:0/41908320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb320005040 con 0x7fb32c0f6700 2023-01-04T18:23:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.486+0000 7fb32affd700 1 --2- 172.21.15.50:0/41908320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb32c0f5460 0x7fb32c109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:23:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.486+0000 7fb32a7fc700 1 --2- 172.21.15.50:0/41908320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb32c0f6700 0x7fb32c10bfb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fb320009f50 tx=0x7fb320009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.486+0000 7fb3137fe700 1 -- 172.21.15.50:0/41908320 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb320018070 con 0x7fb32c0f6700 2023-01-04T18:23:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.486+0000 7fb3137fe700 1 -- 172.21.15.50:0/41908320 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb320009630 con 0x7fb32c0f6700 2023-01-04T18:23:13.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.486+0000 7fb3318cd700 1 -- 172.21.15.50:0/41908320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb32c10c500 con 0x7fb32c0f6700 2023-01-04T18:23:13.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.486+0000 7fb3137fe700 1 -- 172.21.15.50:0/41908320 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb32001c3c0 con 0x7fb32c0f6700 2023-01-04T18:23:13.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.486+0000 7fb3318cd700 1 -- 172.21.15.50:0/41908320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32c10ca60 con 0x7fb32c0f6700 2023-01-04T18:23:13.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.487+0000 7fb3318cd700 1 -- 172.21.15.50:0/41908320 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32c045ad0 con 0x7fb32c0f6700 2023-01-04T18:23:13.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.488+0000 7fb3137fe700 1 -- 172.21.15.50:0/41908320 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fb32001d420 con 0x7fb32c0f6700 2023-01-04T18:23:13.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.488+0000 7fb3137fe700 1 --2- 172.21.15.50:0/41908320 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb314060c30 0x7fb3140630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:13.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.488+0000 7fb3137fe700 1 -- 172.21.15.50:0/41908320 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fb32007da90 con 0x7fb32c0f6700 2023-01-04T18:23:13.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.488+0000 7fb32affd700 1 --2- 172.21.15.50:0/41908320 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb314060c30 0x7fb3140630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:13.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.488+0000 7fb32affd700 1 --2- 172.21.15.50:0/41908320 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb314060c30 0x7fb3140630f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fb32c060060 tx=0x7fb31c009c00).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:13.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.492+0000 7fb3137fe700 1 -- 172.21.15.50:0/41908320 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fb32004e080 con 0x7fb32c0f6700 2023-01-04T18:23:13.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.682+0000 7fb3318cd700 1 -- 172.21.15.50:0/41908320 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb32c0fdd60 con 0x7fb314060c30 2023-01-04T18:23:13.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.684+0000 7fb3137fe700 1 -- 172.21.15.50:0/41908320 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb32c0fdd60 con 0x7fb314060c30 2023-01-04T18:23:13.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.685+0000 7fb3318cd700 1 -- 172.21.15.50:0/41908320 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb314060c30 msgr2=0x7fb3140630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:13.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.685+0000 7fb3318cd700 1 --2- 172.21.15.50:0/41908320 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb314060c30 0x7fb3140630f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fb32c060060 tx=0x7fb31c009c00).stop 2023-01-04T18:23:13.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.685+0000 7fb3318cd700 1 -- 172.21.15.50:0/41908320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb32c0f6700 msgr2=0x7fb32c10bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:13.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.685+0000 7fb3318cd700 1 --2- 172.21.15.50:0/41908320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb32c0f6700 0x7fb32c10bfb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fb320009f50 tx=0x7fb320009b30).stop 2023-01-04T18:23:13.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.685+0000 7fb3318cd700 1 -- 172.21.15.50:0/41908320 shutdown_connections 2023-01-04T18:23:13.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.685+0000 7fb3318cd700 1 --2- 172.21.15.50:0/41908320 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb314060c30 0x7fb3140630f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:13.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.686+0000 7fb3318cd700 1 --2- 172.21.15.50:0/41908320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb32c0f5460 0x7fb32c109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:13.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.686+0000 7fb3318cd700 1 --2- 172.21.15.50:0/41908320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb32c0f6700 0x7fb32c10bfb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:13.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.686+0000 7fb3318cd700 1 -- 172.21.15.50:0/41908320 >> 172.21.15.50:0/41908320 conn(0x7fb32c0f0bc0 msgr2=0x7fb32c0fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:13.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.686+0000 7fb3318cd700 1 -- 172.21.15.50:0/41908320 shutdown_connections 2023-01-04T18:23:13.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.686+0000 7fb3318cd700 1 -- 172.21.15.50:0/41908320 wait complete. 2023-01-04T18:23:13.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.788+0000 7f47ad0c7700 1 -- 172.21.15.50:0/3140156020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a80f55c0 msgr2=0x7f47a80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.788+0000 7f47ad0c7700 1 --2- 172.21.15.50:0/3140156020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a80f55c0 0x7f47a80f59e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f479c004660 tx=0x7f479c009b30).stop 2023-01-04T18:23:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.788+0000 7f47ad0c7700 1 -- 172.21.15.50:0/3140156020 shutdown_connections 2023-01-04T18:23:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.788+0000 7f47ad0c7700 1 --2- 172.21.15.50:0/3140156020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47a80f6860 0x7f47a80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-01-04T18:23:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.788+0000 7f47ad0c7700 1 --2- 172.21.15.50:0/3140156020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a80f55c0 0x7f47a80f59e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.788+0000 7f47ad0c7700 1 -- 172.21.15.50:0/3140156020 >> 172.21.15.50:0/3140156020 conn(0x7f47a80f0d40 msgr2=0x7f47a80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.788+0000 7f47ad0c7700 1 -- 172.21.15.50:0/3140156020 shutdown_connections 2023-01-04T18:23:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.788+0000 7f47ad0c7700 1 -- 172.21.15.50:0/3140156020 wait complete. 2023-01-04T18:23:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.788+0000 7f47ad0c7700 1 Processor -- start 2023-01-04T18:23:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.788+0000 7f47ad0c7700 1 -- start start 2023-01-04T18:23:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.789+0000 7f47ad0c7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a80f55c0 0x7f47a8109d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.789+0000 7f47ad0c7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47a80f6860 0x7f47a810c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.789+0000 7f47ad0c7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a8060450 con 0x7f47a80f55c0 2023-01-04T18:23:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.789+0000 7f47ad0c7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a8060590 con 0x7f47a80f6860 2023-01-04T18:23:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.789+0000 7f47a6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a80f55c0 0x7f47a8109d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.789+0000 7f47a6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a80f55c0 0x7f47a8109d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60120/0 (socket says 172.21.15.50:60120) 2023-01-04T18:23:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.789+0000 7f47a6d9d700 1 -- 172.21.15.50:0/3201726384 learned_addr learned my addr 172.21.15.50:0/3201726384 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:23:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.789+0000 7f47a6d9d700 1 -- 172.21.15.50:0/3201726384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47a80f6860 msgr2=0x7f47a810c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.789+0000 7f47a6d9d700 1 --2- 172.21.15.50:0/3201726384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47a80f6860 0x7f47a810c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-01-04T18:23:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.789+0000 7f47a6d9d700 1 -- 172.21.15.50:0/3201726384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c005040 con 0x7f47a80f55c0 2023-01-04T18:23:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.789+0000 7f47a6d9d700 1 --2- 172.21.15.50:0/3201726384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a80f55c0 0x7f47a8109d00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f479c009f50 tx=0x7f479c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.789+0000 7f478f7fe700 1 -- 172.21.15.50:0/3201726384 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f479c018070 con 0x7f47a80f55c0 2023-01-04T18:23:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.789+0000 7f478f7fe700 1 -- 172.21.15.50:0/3201726384 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f479c01d8e0 con 0x7f47a80f55c0 2023-01-04T18:23:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.789+0000 7f47ad0c7700 1 -- 172.21.15.50:0/3201726384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a810c7b0 con 0x7f47a80f55c0 2023-01-04T18:23:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.789+0000 7f478f7fe700 1 -- 172.21.15.50:0/3201726384 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f479c01c550 con 0x7f47a80f55c0 2023-01-04T18:23:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.790+0000 7f47ad0c7700 1 -- 172.21.15.50:0/3201726384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a810cd10 con 0x7f47a80f55c0 2023-01-04T18:23:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.791+0000 7f47ad0c7700 1 -- 172.21.15.50:0/3201726384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a8045ad0 con 0x7f47a80f55c0 2023-01-04T18:23:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.791+0000 7f478f7fe700 1 -- 172.21.15.50:0/3201726384 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f479c01d420 con 0x7f47a80f55c0 2023-01-04T18:23:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.791+0000 7f478f7fe700 1 --2- 172.21.15.50:0/3201726384 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4790060be0 0x7f47900630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.791+0000 7f478f7fe700 1 -- 172.21.15.50:0/3201726384 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f479c07dba0 con 0x7f47a80f55c0 2023-01-04T18:23:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.791+0000 7f47a659c700 1 --2- 172.21.15.50:0/3201726384 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4790060be0 0x7f47900630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.792+0000 7f47a659c700 1 --2- 172.21.15.50:0/3201726384 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4790060be0 0x7f47900630a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f4798009610 tx=0x7f4798006ab0).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.795+0000 7f478f7fe700 1 -- 172.21.15.50:0/3201726384 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f479c04e140 con 0x7f47a80f55c0 2023-01-04T18:23:13.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.981+0000 7f47ad0c7700 1 -- 172.21.15.50:0/3201726384 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f47a8057f10 con 0x7f4790060be0 2023-01-04T18:23:13.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.990+0000 7f478f7fe700 1 -- 172.21.15.50:0/3201726384 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f47a8057f10 con 0x7f4790060be0 2023-01-04T18:23:13.994 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-01-04T18:23:13.994 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager.smithi050 smithi050 *:9093,9094 running (11m) 9s ago 12m 26.4M - 0.20.0 0881eb8f169f b5d3e2678a23 2023-01-04T18:23:13.994 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi050 smithi050 running (5m) 9s ago 12m 7050k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cfe28e5ab81e 2023-01-04T18:23:13.994 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi098 smithi098 running (4m) 46s ago 12m 7180k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cf5f0ca60522 2023-01-04T18:23:13.994 INFO:teuthology.orchestra.run.smithi050.stdout:grafana.smithi050 smithi050 *:3000 running (11m) 9s ago 12m 37.5M - 6.7.4 557c83e11646 7e5dccbafe78 2023-01-04T18:23:13.994 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.ezoiwl smithi050 running (31s) 9s ago 8m 15.7M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 146e50d0c3f4 2023-01-04T18:23:13.994 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.kefmuy smithi050 running (14s) 9s ago 8m 11.2M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 4aaf433888b2 2023-01-04T18:23:13.994 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.laynsk smithi098 running (8m) 46s ago 8m 16.8M - 16.2.4 8d91d370c2b8 8ff8af70b989 2023-01-04T18:23:13.994 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.memais smithi098 running (8m) 46s ago 8m 1172M - 16.2.4 8d91d370c2b8 d59d9b4dbf7d 2023-01-04T18:23:13.995 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi050.emnywo smithi050 *:8443,9283 running (6m) 9s ago 13m 450M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d ee677216e754 2023-01-04T18:23:13.995 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi098.vhfzum smithi098 *:8443,9283 running (5m) 46s ago 12m 396M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d f3d98bf0cf66 2023-01-04T18:23:13.995 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi050 smithi050 running (5m) 9s ago 13m 114M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 0423819cbaa7 2023-01-04T18:23:13.995 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi098 smithi098 running (5m) 46s ago 11m 86.5M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 12094818aefc 2023-01-04T18:23:13.995 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi050 smithi050 *:9100 running (12m) 9s ago 12m 18.4M - 0.18.1 e5a616e4b9cf 88892b2e5e5a 2023-01-04T18:23:13.995 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi098 smithi098 *:9100 running (11m) 46s ago 11m 18.4M - 0.18.1 e5a616e4b9cf 49bcde8331b6 2023-01-04T18:23:13.995 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (4m) 9s ago 11m 364M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 60dafedcb429 2023-01-04T18:23:13.995 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi050 running (2m) 9s ago 11m 364M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 625bd99952d9 2023-01-04T18:23:13.995 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi050 running (2m) 9s ago 10m 273M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d badf94f13661 2023-01-04T18:23:13.995 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi098 running (110s) 46s ago 10m 383M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 93c4e177ba97 2023-01-04T18:23:13.995 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi098 running (80s) 46s ago 10m 366M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 9398016f5e81 2023-01-04T18:23:13.995 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi098 running (51s) 46s ago 9m 16.0M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 82e86a9ed864 2023-01-04T18:23:13.998 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus.smithi050 smithi050 *:9095 running (6m) 9s ago 12m 67.1M - 2.18.1 de242295e225 7bdcf7a45d34 2023-01-04T18:23:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.992+0000 7f47ad0c7700 1 -- 172.21.15.50:0/3201726384 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4790060be0 msgr2=0x7f47900630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.992+0000 7f47ad0c7700 1 --2- 172.21.15.50:0/3201726384 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4790060be0 0x7f47900630a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f4798009610 tx=0x7f4798006ab0).stop 2023-01-04T18:23:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.992+0000 7f47ad0c7700 1 -- 172.21.15.50:0/3201726384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a80f55c0 msgr2=0x7f47a8109d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.992+0000 7f47ad0c7700 1 --2- 172.21.15.50:0/3201726384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a80f55c0 0x7f47a8109d00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f479c009f50 tx=0x7f479c009b30).stop 2023-01-04T18:23:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.992+0000 7f47ad0c7700 1 -- 172.21.15.50:0/3201726384 shutdown_connections 2023-01-04T18:23:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.992+0000 7f47ad0c7700 1 --2- 172.21.15.50:0/3201726384 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4790060be0 0x7f47900630a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.992+0000 7f47ad0c7700 1 --2- 172.21.15.50:0/3201726384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a80f55c0 0x7f47a8109d00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.992+0000 7f47ad0c7700 1 --2- 172.21.15.50:0/3201726384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47a80f6860 0x7f47a810c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-01-04T18:23:14.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.992+0000 7f47ad0c7700 1 -- 172.21.15.50:0/3201726384 >> 172.21.15.50:0/3201726384 conn(0x7f47a80f0d40 msgr2=0x7f47a80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:14.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.992+0000 7f47ad0c7700 1 -- 172.21.15.50:0/3201726384 shutdown_connections 2023-01-04T18:23:14.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:13.992+0000 7f47ad0c7700 1 -- 172.21.15.50:0/3201726384 wait complete. 2023-01-04T18:23:14.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.093+0000 7fca03dc3700 1 -- 172.21.15.50:0/2349209419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9fc0f6860 msgr2=0x7fc9fc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:14.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.093+0000 7fca03dc3700 1 --2- 172.21.15.50:0/2349209419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9fc0f6860 0x7fc9fc0f6cc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc9f0004660 tx=0x7fc9f0009b30).stop 2023-01-04T18:23:14.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.093+0000 7fca03dc3700 1 -- 172.21.15.50:0/2349209419 shutdown_connections 2023-01-04T18:23:14.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.093+0000 7fca03dc3700 1 --2- 172.21.15.50:0/2349209419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9fc0f6860 0x7fc9fc0f6cc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:14.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.093+0000 7fca03dc3700 1 --2- 172.21.15.50:0/2349209419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9fc0f55c0 0x7fc9fc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:14.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.093+0000 7fca03dc3700 1 -- 172.21.15.50:0/2349209419 >> 172.21.15.50:0/2349209419 conn(0x7fc9fc0f0d40 msgr2=0x7fc9fc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:14.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.093+0000 7fca03dc3700 1 -- 172.21.15.50:0/2349209419 shutdown_connections 2023-01-04T18:23:14.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.093+0000 7fca03dc3700 1 -- 172.21.15.50:0/2349209419 wait complete. 2023-01-04T18:23:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.094+0000 7fca03dc3700 1 Processor -- start 2023-01-04T18:23:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.094+0000 7fca03dc3700 1 -- start start 2023-01-04T18:23:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.094+0000 7fca03dc3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9fc0f55c0 0x7fc9fc0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.094+0000 7fca03dc3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9fc0f6860 0x7fc9fc0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.094+0000 7fca03dc3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc0f8100 con 0x7fc9fc0f55c0 2023-01-04T18:23:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.094+0000 7fca03dc3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc0f8240 con 0x7fc9fc0f6860 2023-01-04T18:23:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.094+0000 7fca01b5f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9fc0f55c0 0x7fc9fc0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.094+0000 7fca01b5f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9fc0f55c0 0x7fc9fc0f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60128/0 (socket says 172.21.15.50:60128) 2023-01-04T18:23:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.094+0000 7fca01b5f700 1 -- 172.21.15.50:0/2987254111 learned_addr learned my addr 172.21.15.50:0/2987254111 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:23:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.095+0000 7fca0135e700 1 --2- 172.21.15.50:0/2987254111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9fc0f6860 0x7fc9fc0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.095+0000 7fca01b5f700 1 -- 172.21.15.50:0/2987254111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9fc0f6860 msgr2=0x7fc9fc0f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.095+0000 7fca01b5f700 1 --2- 172.21.15.50:0/2987254111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9fc0f6860 0x7fc9fc0f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.095+0000 7fca01b5f700 1 -- 172.21.15.50:0/2987254111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f0005040 con 0x7fc9fc0f55c0 2023-01-04T18:23:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.095+0000 7fca01b5f700 1 --2- 172.21.15.50:0/2987254111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9fc0f55c0 0x7fc9fc0f9720 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fc9f800c530 tx=0x7fc9f8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.095+0000 7fc9ee7fc700 1 -- 172.21.15.50:0/2987254111 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9f800f650 con 0x7fc9fc0f55c0 2023-01-04T18:23:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.095+0000 7fc9ee7fc700 1 -- 172.21.15.50:0/2987254111 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc9f800fc70 con 0x7fc9fc0f55c0 2023-01-04T18:23:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.095+0000 7fc9ee7fc700 1 -- 172.21.15.50:0/2987254111 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9f8012e00 con 0x7fc9fc0f55c0 2023-01-04T18:23:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.095+0000 7fca03dc3700 1 -- 172.21.15.50:0/2987254111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9fc0f8520 con 0x7fc9fc0f55c0 2023-01-04T18:23:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.095+0000 7fca03dc3700 1 -- 172.21.15.50:0/2987254111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9fc10efc0 con 0x7fc9fc0f55c0 2023-01-04T18:23:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.096+0000 7fca03dc3700 1 -- 172.21.15.50:0/2987254111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9fc045ad0 con 0x7fc9fc0f55c0 2023-01-04T18:23:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.097+0000 7fc9ee7fc700 1 -- 172.21.15.50:0/2987254111 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fc9f8019030 con 0x7fc9fc0f55c0 2023-01-04T18:23:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.097+0000 7fc9ee7fc700 1 --2- 172.21.15.50:0/2987254111 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc9e8060be0 0x7fc9e80630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:14.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.097+0000 7fc9ee7fc700 1 -- 172.21.15.50:0/2987254111 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fc9f807b9a0 con 0x7fc9fc0f55c0 2023-01-04T18:23:14.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.097+0000 7fca0135e700 1 --2- 172.21.15.50:0/2987254111 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc9e8060be0 0x7fc9e80630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:14.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.097+0000 7fca0135e700 1 --2- 172.21.15.50:0/2987254111 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc9e8060be0 0x7fc9e80630a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fc9f0004e30 tx=0x7fc9f0009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.101+0000 7fc9ee7fc700 1 -- 172.21.15.50:0/2987254111 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fc9f8048c30 con 0x7fc9fc0f55c0 2023-01-04T18:23:14.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.342+0000 7fca03dc3700 1 -- 172.21.15.50:0/2987254111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc9fc10f820 con 0x7fc9fc0f55c0 2023-01-04T18:23:14.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.342+0000 7fc9ee7fc700 1 -- 172.21.15.50:0/2987254111 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+841 (secure 0 0 0) 0x7fc9f804c050 con 0x7fc9fc0f55c0 2023-01-04T18:23:14.346 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:23:14.346 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": { 2023-01-04T18:23:14.346 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:23:14.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:23:14.346 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": { 2023-01-04T18:23:14.346 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:23:14.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:23:14.347 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": { 2023-01-04T18:23:14.347 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 6 2023-01-04T18:23:14.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:23:14.347 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2023-01-04T18:23:14.347 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2, 2023-01-04T18:23:14.347 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-01-04T18:23:14.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:23:14.347 INFO:teuthology.orchestra.run.smithi050.stdout: "overall": { 2023-01-04T18:23:14.347 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 12, 2023-01-04T18:23:14.351 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2023-01-04T18:23:14.351 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-01-04T18:23:14.351 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:23:14.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.344+0000 7fca03dc3700 1 -- 172.21.15.50:0/2987254111 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc9e8060be0 msgr2=0x7fc9e80630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:14.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.344+0000 7fca03dc3700 1 --2- 172.21.15.50:0/2987254111 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc9e8060be0 0x7fc9e80630a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fc9f0004e30 tx=0x7fc9f0009b30).stop 2023-01-04T18:23:14.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.344+0000 7fca03dc3700 1 -- 172.21.15.50:0/2987254111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9fc0f55c0 msgr2=0x7fc9fc0f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:14.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.344+0000 7fca03dc3700 1 --2- 172.21.15.50:0/2987254111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9fc0f55c0 0x7fc9fc0f9720 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fc9f800c530 tx=0x7fc9f8007e10).stop 2023-01-04T18:23:14.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.344+0000 7fca03dc3700 1 -- 172.21.15.50:0/2987254111 shutdown_connections 2023-01-04T18:23:14.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.344+0000 7fca03dc3700 1 --2- 172.21.15.50:0/2987254111 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc9e8060be0 0x7fc9e80630a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:14.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.344+0000 7fca03dc3700 1 --2- 172.21.15.50:0/2987254111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9fc0f55c0 0x7fc9fc0f9720 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:14.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.344+0000 7fca03dc3700 1 --2- 172.21.15.50:0/2987254111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9fc0f6860 0x7fc9fc0f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:14.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.344+0000 7fca03dc3700 1 -- 172.21.15.50:0/2987254111 >> 172.21.15.50:0/2987254111 conn(0x7fc9fc0f0d40 msgr2=0x7fc9fc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:14.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.344+0000 7fca03dc3700 1 -- 172.21.15.50:0/2987254111 shutdown_connections 2023-01-04T18:23:14.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.344+0000 7fca03dc3700 1 -- 172.21.15.50:0/2987254111 wait complete. 2023-01-04T18:23:14.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.445+0000 7f534d0d7700 1 -- 172.21.15.50:0/2514124682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53480f55c0 msgr2=0x7f53480f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:14.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.445+0000 7f534d0d7700 1 --2- 172.21.15.50:0/2514124682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53480f55c0 0x7f53480f59e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f5330004660 tx=0x7f5330009b30).stop 2023-01-04T18:23:14.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.446+0000 7f534d0d7700 1 -- 172.21.15.50:0/2514124682 shutdown_connections 2023-01-04T18:23:14.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.446+0000 7f534d0d7700 1 --2- 172.21.15.50:0/2514124682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53480f6860 0x7f53480f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:14.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.446+0000 7f534d0d7700 1 --2- 172.21.15.50:0/2514124682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53480f55c0 0x7f53480f59e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:14.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.446+0000 7f534d0d7700 1 -- 172.21.15.50:0/2514124682 >> 172.21.15.50:0/2514124682 conn(0x7f53480f0d40 msgr2=0x7f53480f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:14.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.446+0000 7f534d0d7700 1 -- 172.21.15.50:0/2514124682 shutdown_connections 2023-01-04T18:23:14.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.446+0000 7f534d0d7700 1 -- 172.21.15.50:0/2514124682 wait complete. 2023-01-04T18:23:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.446+0000 7f534d0d7700 1 Processor -- start 2023-01-04T18:23:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.446+0000 7f534d0d7700 1 -- start start 2023-01-04T18:23:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.446+0000 7f534d0d7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53480f55c0 0x7f53480f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.446+0000 7f534d0d7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53480f6860 0x7f53480f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.446+0000 7f534d0d7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53480f8100 con 0x7f53480f6860 2023-01-04T18:23:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.446+0000 7f534d0d7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53480f8240 con 0x7f53480f55c0 2023-01-04T18:23:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.447+0000 7f534659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53480f6860 0x7f53480f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.447+0000 7f534659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53480f6860 0x7f53480f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60154/0 (socket says 172.21.15.50:60154) 2023-01-04T18:23:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.447+0000 7f534659c700 1 -- 172.21.15.50:0/2392896989 learned_addr learned my addr 172.21.15.50:0/2392896989 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:23:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.447+0000 7f5346d9d700 1 --2- 172.21.15.50:0/2392896989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53480f55c0 0x7f53480f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.447+0000 7f534659c700 1 -- 172.21.15.50:0/2392896989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53480f55c0 msgr2=0x7f53480f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.447+0000 7f534659c700 1 --2- 172.21.15.50:0/2392896989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53480f55c0 0x7f53480f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.447+0000 7f534659c700 1 -- 172.21.15.50:0/2392896989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5330005040 con 0x7f53480f6860 2023-01-04T18:23:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.447+0000 7f534659c700 1 --2- 172.21.15.50:0/2392896989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53480f6860 0x7f53480f7ba0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f533800c790 tx=0x7f5338007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.447+0000 7f533f7fe700 1 -- 172.21.15.50:0/2392896989 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f533800e680 con 0x7f53480f6860 2023-01-04T18:23:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.447+0000 7f534d0d7700 1 -- 172.21.15.50:0/2392896989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53480f8520 con 0x7f53480f6860 2023-01-04T18:23:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.447+0000 7f533f7fe700 1 -- 172.21.15.50:0/2392896989 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f533800eca0 con 0x7f53480f6860 2023-01-04T18:23:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.447+0000 7f533f7fe700 1 -- 172.21.15.50:0/2392896989 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5338013de0 con 0x7f53480f6860 2023-01-04T18:23:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.447+0000 7f534d0d7700 1 -- 172.21.15.50:0/2392896989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534810efc0 con 0x7f53480f6860 2023-01-04T18:23:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.448+0000 7f534d0d7700 1 -- 172.21.15.50:0/2392896989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5348045ad0 con 0x7f53480f6860 2023-01-04T18:23:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.449+0000 7f533f7fe700 1 -- 172.21.15.50:0/2392896989 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f533801a060 con 0x7f53480f6860 2023-01-04T18:23:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.449+0000 7f533f7fe700 1 --2- 172.21.15.50:0/2392896989 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5334060be0 0x7f53340630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.449+0000 7f533f7fe700 1 -- 172.21.15.50:0/2392896989 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f533807bfc0 con 0x7f53480f6860 2023-01-04T18:23:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.449+0000 7f5346d9d700 1 --2- 172.21.15.50:0/2392896989 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5334060be0 0x7f53340630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:14.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.450+0000 7f5346d9d700 1 --2- 172.21.15.50:0/2392896989 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5334060be0 0x7f53340630a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f53480f94b0 tx=0x7f5330009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.453+0000 7f533f7fe700 1 -- 172.21.15.50:0/2392896989 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f533804ff80 con 0x7f53480f6860 2023-01-04T18:23:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.668+0000 7f534d0d7700 1 -- 172.21.15.50:0/2392896989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f534810f670 con 0x7f53480f6860 2023-01-04T18:23:14.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.668+0000 7f533f7fe700 1 -- 172.21.15.50:0/2392896989 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+1788 (secure 0 0 0) 0x7f533804fb70 con 0x7f53480f6860 2023-01-04T18:23:14.672 INFO:teuthology.orchestra.run.smithi050.stdout:e27 2023-01-04T18:23:14.672 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:23:14.672 INFO:teuthology.orchestra.run.smithi050.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:23:14.672 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-01-04T18:23:14.673 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:23:14.673 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-01-04T18:23:14.673 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-01-04T18:23:14.673 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 27 2023-01-04T18:23:14.673 INFO:teuthology.orchestra.run.smithi050.stdout:flags 12 2023-01-04T18:23:14.673 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:23:14.673 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-01-04T18:23:05.550871+0000 2023-01-04T18:23:14.673 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-01-04T18:23:14.673 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-01-04T18:23:14.673 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 60 2023-01-04T18:23:14.673 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-01-04T18:23:14.673 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-01-04T18:23:14.674 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-01-04T18:23:14.674 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-01-04T18:23:14.674 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 93 2023-01-04T18:23:14.674 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:23:14.674 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 1 2023-01-04T18:23:14.674 INFO:teuthology.orchestra.run.smithi050.stdout:in 0 2023-01-04T18:23:14.674 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=24297} 2023-01-04T18:23:14.674 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-01-04T18:23:14.674 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-01-04T18:23:14.674 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-01-04T18:23:14.674 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-01-04T18:23:14.674 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-01-04T18:23:14.675 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data enabled 2023-01-04T18:23:14.675 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-01-04T18:23:14.675 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 1 2023-01-04T18:23:14.675 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.laynsk{0:24297} state up:active seq 129 join_fscid=1 addr [v2:172.21.15.98:6826/1785480263,v1:172.21.15.98:6827/1785480263] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:23:14.675 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:23:14.675 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:23:14.675 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2023-01-04T18:23:14.675 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:23:14.675 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.ezoiwl{-1:34362} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.50:6826/336562041,v1:172.21.15.50:6827/336562041] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:23:14.675 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.kefmuy{-1:34366} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.50:6828/2188030488,v1:172.21.15.50:6829/2188030488] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:23:14.675 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.memais{-1:44275} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.98:6824/3576035235,v1:172.21.15.98:6825/3576035235] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:23:14.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.670+0000 7f534d0d7700 1 -- 172.21.15.50:0/2392896989 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5334060be0 msgr2=0x7f53340630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:14.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.670+0000 7f534d0d7700 1 --2- 172.21.15.50:0/2392896989 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5334060be0 0x7f53340630a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f53480f94b0 tx=0x7f5330009b30).stop 2023-01-04T18:23:14.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.670+0000 7f534d0d7700 1 -- 172.21.15.50:0/2392896989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53480f6860 msgr2=0x7f53480f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:14.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.670+0000 7f534d0d7700 1 --2- 172.21.15.50:0/2392896989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53480f6860 0x7f53480f7ba0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f533800c790 tx=0x7f5338007d70).stop 2023-01-04T18:23:14.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.670+0000 7f534d0d7700 1 -- 172.21.15.50:0/2392896989 shutdown_connections 2023-01-04T18:23:14.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.670+0000 7f534d0d7700 1 --2- 172.21.15.50:0/2392896989 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5334060be0 0x7f53340630a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:14.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.670+0000 7f534d0d7700 1 --2- 172.21.15.50:0/2392896989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53480f55c0 0x7f53480f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:14.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.670+0000 7f534d0d7700 1 --2- 172.21.15.50:0/2392896989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53480f6860 0x7f53480f7ba0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:14.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.670+0000 7f534d0d7700 1 -- 172.21.15.50:0/2392896989 >> 172.21.15.50:0/2392896989 conn(0x7f53480f0d40 msgr2=0x7f534805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:14.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.670+0000 7f534d0d7700 1 -- 172.21.15.50:0/2392896989 shutdown_connections 2023-01-04T18:23:14.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.670+0000 7f534d0d7700 1 -- 172.21.15.50:0/2392896989 wait complete. 2023-01-04T18:23:14.677 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 27 2023-01-04T18:23:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.773+0000 7fc5c4525700 1 -- 172.21.15.50:0/850060563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5bc0f66e0 msgr2=0x7fc5bc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.773+0000 7fc5c4525700 1 --2- 172.21.15.50:0/850060563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5bc0f66e0 0x7fc5bc0f6b00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fc5b8004660 tx=0x7fc5b8009b30).stop 2023-01-04T18:23:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.773+0000 7fc5c4525700 1 -- 172.21.15.50:0/850060563 shutdown_connections 2023-01-04T18:23:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.773+0000 7fc5c4525700 1 --2- 172.21.15.50:0/850060563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5bc0f7980 0x7fc5bc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-01-04T18:23:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.773+0000 7fc5c4525700 1 --2- 172.21.15.50:0/850060563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5bc0f66e0 0x7fc5bc0f6b00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.773+0000 7fc5c4525700 1 -- 172.21.15.50:0/850060563 >> 172.21.15.50:0/850060563 conn(0x7fc5bc0f1e40 msgr2=0x7fc5bc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.773+0000 7fc5c4525700 1 -- 172.21.15.50:0/850060563 shutdown_connections 2023-01-04T18:23:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.773+0000 7fc5c4525700 1 -- 172.21.15.50:0/850060563 wait complete. 2023-01-04T18:23:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.773+0000 7fc5c4525700 1 Processor -- start 2023-01-04T18:23:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.774+0000 7fc5c4525700 1 -- start start 2023-01-04T18:23:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.774+0000 7fc5c4525700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5bc0f66e0 0x7fc5bc106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.774+0000 7fc5c4525700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5bc0f7980 0x7fc5bc1074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.774+0000 7fc5c4525700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc107b00 con 0x7fc5bc0f7980 2023-01-04T18:23:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.774+0000 7fc5c4525700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc1083b0 con 0x7fc5bc0f66e0 2023-01-04T18:23:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.774+0000 7fc5c1ac0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5bc0f7980 0x7fc5bc1074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.774+0000 7fc5c1ac0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5bc0f7980 0x7fc5bc1074c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60168/0 (socket says 172.21.15.50:60168) 2023-01-04T18:23:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.774+0000 7fc5c1ac0700 1 -- 172.21.15.50:0/2842842954 learned_addr learned my addr 172.21.15.50:0/2842842954 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:23:14.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.774+0000 7fc5c22c1700 1 --2- 172.21.15.50:0/2842842954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5bc0f66e0 0x7fc5bc106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:14.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.774+0000 7fc5c1ac0700 1 -- 172.21.15.50:0/2842842954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5bc0f66e0 msgr2=0x7fc5bc106fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:14.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.774+0000 7fc5c1ac0700 1 --2- 172.21.15.50:0/2842842954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5bc0f66e0 0x7fc5bc106fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:14.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.774+0000 7fc5c1ac0700 1 -- 172.21.15.50:0/2842842954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b8005040 con 0x7fc5bc0f7980 2023-01-04T18:23:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.774+0000 7fc5c22c1700 1 --2- 172.21.15.50:0/2842842954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5bc0f66e0 0x7fc5bc106fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-01-04T18:23:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.774+0000 7fc5c1ac0700 1 --2- 172.21.15.50:0/2842842954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5bc0f7980 0x7fc5bc1074c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fc5b000b410 tx=0x7fc5b0006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.774+0000 7fc5aeffd700 1 -- 172.21.15.50:0/2842842954 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5b00125f0 con 0x7fc5bc0f7980 2023-01-04T18:23:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.774+0000 7fc5aeffd700 1 -- 172.21.15.50:0/2842842954 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc5b0012c10 con 0x7fc5bc0f7980 2023-01-04T18:23:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.774+0000 7fc5aeffd700 1 -- 172.21.15.50:0/2842842954 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5b0002b00 con 0x7fc5bc0f7980 2023-01-04T18:23:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.774+0000 7fc5c4525700 1 -- 172.21.15.50:0/2842842954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5bc108690 con 0x7fc5bc0f7980 2023-01-04T18:23:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.775+0000 7fc5c4525700 1 -- 172.21.15.50:0/2842842954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5bc108c50 con 0x7fc5bc0f7980 2023-01-04T18:23:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.775+0000 7fc5c4525700 1 -- 172.21.15.50:0/2842842954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5bc0f5ad0 con 0x7fc5bc0f7980 2023-01-04T18:23:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.776+0000 7fc5aeffd700 1 -- 172.21.15.50:0/2842842954 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fc5b000f030 con 0x7fc5bc0f7980 2023-01-04T18:23:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.776+0000 7fc5aeffd700 1 --2- 172.21.15.50:0/2842842954 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc5a8060be0 0x7fc5a80630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:14.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.776+0000 7fc5aeffd700 1 -- 172.21.15.50:0/2842842954 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fc5b007c190 con 0x7fc5bc0f7980 2023-01-04T18:23:14.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.776+0000 7fc5c22c1700 1 --2- 172.21.15.50:0/2842842954 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc5a8060be0 0x7fc5a80630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:14.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.777+0000 7fc5c22c1700 1 --2- 172.21.15.50:0/2842842954 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc5a8060be0 0x7fc5a80630a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fc5b8005010 tx=0x7fc5b8009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:14.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.780+0000 7fc5aeffd700 1 -- 172.21.15.50:0/2842842954 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fc5b00501c0 con 0x7fc5bc0f7980 2023-01-04T18:23:14.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:12.680733+0000 mgr.smithi050.emnywo (mgr.24517) 295 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2023-01-04T18:23:14.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:13.380531+0000 mgr.smithi050.emnywo (mgr.24517) 296 : audit [DBG] from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:23:14.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:14.343939+0000 mon.smithi050 (mon.0) 568 : audit [DBG] from='client.? 172.21.15.50:0/2987254111' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:14.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.970+0000 7fc5c4525700 1 -- 172.21.15.50:0/2842842954 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5bc0fefc0 con 0x7fc5a8060be0 2023-01-04T18:23:14.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.972+0000 7fc5aeffd700 1 -- 172.21.15.50:0/2842842954 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc5bc0fefc0 con 0x7fc5a8060be0 2023-01-04T18:23:14.975 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:23:14.975 INFO:teuthology.orchestra.run.smithi050.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308", 2023-01-04T18:23:14.975 INFO:teuthology.orchestra.run.smithi050.stdout: "in_progress": true, 2023-01-04T18:23:14.975 INFO:teuthology.orchestra.run.smithi050.stdout: "which": "Upgrading all daemon types on all hosts", 2023-01-04T18:23:14.975 INFO:teuthology.orchestra.run.smithi050.stdout: "services_complete": [ 2023-01-04T18:23:14.975 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2023-01-04T18:23:14.975 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr", 2023-01-04T18:23:14.976 INFO:teuthology.orchestra.run.smithi050.stdout: "osd", 2023-01-04T18:23:14.976 INFO:teuthology.orchestra.run.smithi050.stdout: "mon" 2023-01-04T18:23:14.976 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-01-04T18:23:14.976 INFO:teuthology.orchestra.run.smithi050.stdout: "progress": "14/21 daemons upgraded", 2023-01-04T18:23:14.976 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "Currently upgrading mds daemons", 2023-01-04T18:23:14.976 INFO:teuthology.orchestra.run.smithi050.stdout: "is_paused": false 2023-01-04T18:23:14.976 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:23:14.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.973+0000 7fc5c4525700 1 -- 172.21.15.50:0/2842842954 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc5a8060be0 msgr2=0x7fc5a80630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:14.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.973+0000 7fc5c4525700 1 --2- 172.21.15.50:0/2842842954 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc5a8060be0 0x7fc5a80630a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fc5b8005010 tx=0x7fc5b8009b30).stop 2023-01-04T18:23:14.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.973+0000 7fc5c4525700 1 -- 172.21.15.50:0/2842842954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5bc0f7980 msgr2=0x7fc5bc1074c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:14.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.973+0000 7fc5c4525700 1 --2- 172.21.15.50:0/2842842954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5bc0f7980 0x7fc5bc1074c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fc5b000b410 tx=0x7fc5b0006ef0).stop 2023-01-04T18:23:14.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.973+0000 7fc5c4525700 1 -- 172.21.15.50:0/2842842954 shutdown_connections 2023-01-04T18:23:14.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.973+0000 7fc5c4525700 1 --2- 172.21.15.50:0/2842842954 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc5a8060be0 0x7fc5a80630a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:14.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.973+0000 7fc5c4525700 1 --2- 172.21.15.50:0/2842842954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5bc0f66e0 0x7fc5bc106fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:14.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.973+0000 7fc5c4525700 1 --2- 172.21.15.50:0/2842842954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5bc0f7980 0x7fc5bc1074c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:14.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.973+0000 7fc5c4525700 1 -- 172.21.15.50:0/2842842954 >> 172.21.15.50:0/2842842954 conn(0x7fc5bc0f1e40 msgr2=0x7fc5bc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:14.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.973+0000 7fc5c4525700 1 -- 172.21.15.50:0/2842842954 shutdown_connections 2023-01-04T18:23:14.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:14.974+0000 7fc5c4525700 1 -- 172.21.15.50:0/2842842954 wait complete. 2023-01-04T18:23:15.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:12.680733+0000 mgr.smithi050.emnywo (mgr.24517) 295 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2023-01-04T18:23:15.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:13.380531+0000 mgr.smithi050.emnywo (mgr.24517) 296 : audit [DBG] from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:23:15.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:14.343939+0000 mon.smithi050 (mon.0) 568 : audit [DBG] from='client.? 172.21.15.50:0/2987254111' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:15.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:13.684797+0000 mgr.smithi050.emnywo (mgr.24517) 297 : audit [DBG] from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:23:15.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:13.983337+0000 mgr.smithi050.emnywo (mgr.24517) 298 : audit [DBG] from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:23:15.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:14.670018+0000 mon.smithi050 (mon.0) 569 : audit [DBG] from='client.? 172.21.15.50:0/2392896989' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:23:15.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:14.852811+0000 mon.smithi050 (mon.0) 570 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:23:15.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:14.853948+0000 mon.smithi050 (mon.0) 571 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:23:15.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:14.854563+0000 mon.smithi050 (mon.0) 572 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:23:15.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:14.858592+0000 mon.smithi050 (mon.0) 573 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:15.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:14.863358+0000 mon.smithi050 (mon.0) 574 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:23:15.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:14.865473+0000 mon.smithi050 (mon.0) 575 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:15.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:14.866585+0000 mon.smithi050 (mon.0) 576 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:15.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:14.867687+0000 mon.smithi050 (mon.0) 577 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:15.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:14.869089+0000 mon.smithi050 (mon.0) 578 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:15.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:15 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:14.870703+0000 mon.smithi050 (mon.0) 579 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi098.memais"]}]: dispatch 2023-01-04T18:23:16.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:13.684797+0000 mgr.smithi050.emnywo (mgr.24517) 297 : audit [DBG] from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:23:16.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:13.983337+0000 mgr.smithi050.emnywo (mgr.24517) 298 : audit [DBG] from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:23:16.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:14.670018+0000 mon.smithi050 (mon.0) 569 : audit [DBG] from='client.? 172.21.15.50:0/2392896989' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:23:16.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:14.852811+0000 mon.smithi050 (mon.0) 570 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:23:16.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:14.853948+0000 mon.smithi050 (mon.0) 571 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:23:16.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:14.854563+0000 mon.smithi050 (mon.0) 572 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:23:16.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:14.858592+0000 mon.smithi050 (mon.0) 573 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:16.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:14.863358+0000 mon.smithi050 (mon.0) 574 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:23:16.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:14.865473+0000 mon.smithi050 (mon.0) 575 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:16.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:14.866585+0000 mon.smithi050 (mon.0) 576 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:16.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:14.867687+0000 mon.smithi050 (mon.0) 577 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:16.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:14.869089+0000 mon.smithi050 (mon.0) 578 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:16.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:15 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:14.870703+0000 mon.smithi050 (mon.0) 579 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi098.memais"]}]: dispatch 2023-01-04T18:23:16.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:14.681207+0000 mgr.smithi050.emnywo (mgr.24517) 299 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2023-01-04T18:23:16.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:23:14.855105+0000 mgr.smithi050.emnywo (mgr.24517) 300 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:23:16.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:23:14.871260+0000 mgr.smithi050.emnywo (mgr.24517) 301 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi098.memais 2023-01-04T18:23:16.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:14.972925+0000 mgr.smithi050.emnywo (mgr.24517) 302 : audit [DBG] from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:23:16.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:16.356582+0000 mon.smithi050 (mon.0) 580 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:16.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:16.357683+0000 mon.smithi050 (mon.0) 581 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.memais", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-01-04T18:23:16.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:16.358644+0000 mon.smithi050 (mon.0) 582 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:23:17.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:14.681207+0000 mgr.smithi050.emnywo (mgr.24517) 299 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2023-01-04T18:23:17.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:23:14.855105+0000 mgr.smithi050.emnywo (mgr.24517) 300 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:23:17.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:23:14.871260+0000 mgr.smithi050.emnywo (mgr.24517) 301 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi098.memais 2023-01-04T18:23:17.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:14.972925+0000 mgr.smithi050.emnywo (mgr.24517) 302 : audit [DBG] from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:23:17.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:16.356582+0000 mon.smithi050 (mon.0) 580 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:17.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:16.357683+0000 mon.smithi050 (mon.0) 581 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.memais", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-01-04T18:23:17.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:16.358644+0000 mon.smithi050 (mon.0) 582 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:23:17.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:17 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:23:16.351497+0000 mgr.smithi050.emnywo (mgr.24517) 303 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi098.memais 2023-01-04T18:23:17.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:17 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:23:16.359414+0000 mgr.smithi050.emnywo (mgr.24517) 304 : cephadm [INF] Deploying daemon mds.cephfs.smithi098.memais on smithi098 2023-01-04T18:23:18.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:17 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:23:16.351497+0000 mgr.smithi050.emnywo (mgr.24517) 303 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi098.memais 2023-01-04T18:23:18.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:17 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:23:16.359414+0000 mgr.smithi050.emnywo (mgr.24517) 304 : cephadm [INF] Deploying daemon mds.cephfs.smithi098.memais on smithi098 2023-01-04T18:23:19.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:16.681571+0000 mgr.smithi050.emnywo (mgr.24517) 305 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 16 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2023-01-04T18:23:19.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:17.706883+0000 mon.smithi050 (mon.0) 583 : cluster [WRN] daemon mds.cephfs.smithi098.memais compat changed unexpectedly 2023-01-04T18:23:19.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:17.710956+0000 mon.smithi050 (mon.0) 584 : cluster [DBG] osdmap e94: 6 total, 6 up, 6 in 2023-01-04T18:23:19.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:16.681571+0000 mgr.smithi050.emnywo (mgr.24517) 305 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 16 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2023-01-04T18:23:19.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:17.706883+0000 mon.smithi050 (mon.0) 583 : cluster [WRN] daemon mds.cephfs.smithi098.memais compat changed unexpectedly 2023-01-04T18:23:19.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:17.710956+0000 mon.smithi050 (mon.0) 584 : cluster [DBG] osdmap e94: 6 total, 6 up, 6 in 2023-01-04T18:23:20.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:18.588164+0000 mon.smithi050 (mon.0) 585 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi098.laynsk=up:active} 2 up:standby 2023-01-04T18:23:20.095 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:19.455707+0000 mon.smithi050 (mon.0) 586 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.memais"}]: dispatch 2023-01-04T18:23:20.095 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:18.588164+0000 mon.smithi050 (mon.0) 585 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi098.laynsk=up:active} 2 up:standby 2023-01-04T18:23:20.096 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:19.455707+0000 mon.smithi050 (mon.0) 586 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.memais"}]: dispatch 2023-01-04T18:23:20.989 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:18.682103+0000 mgr.smithi050.emnywo (mgr.24517) 306 : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2023-01-04T18:23:21.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:18.682103+0000 mgr.smithi050.emnywo (mgr.24517) 306 : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2023-01-04T18:23:22.859 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:20.682638+0000 mgr.smithi050.emnywo (mgr.24517) 307 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:23:22.859 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:22.155307+0000 mon.smithi050 (mon.0) 587 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:22.860 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:22.156194+0000 mon.smithi050 (mon.0) 588 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:23:22.860 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:22.157522+0000 mon.smithi050 (mon.0) 589 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:23:22.860 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:22.158355+0000 mon.smithi050 (mon.0) 590 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:23:23.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:20.682638+0000 mgr.smithi050.emnywo (mgr.24517) 307 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:23:23.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:22.155307+0000 mon.smithi050 (mon.0) 587 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:23.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:22.156194+0000 mon.smithi050 (mon.0) 588 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:23:23.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:22.157522+0000 mon.smithi050 (mon.0) 589 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:23:23.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:22.158355+0000 mon.smithi050 (mon.0) 590 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:23:24.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:23 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:23:22.159115+0000 mgr.smithi050.emnywo (mgr.24517) 308 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:23:24.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:23 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:22.598483+0000 mon.smithi050 (mon.0) 591 : cluster [DBG] mds.? [v2:172.21.15.98:6824/4224872601,v1:172.21.15.98:6825/4224872601] up:boot 2023-01-04T18:23:24.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:23 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:22.598567+0000 mon.smithi050 (mon.0) 592 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi098.laynsk=up:active} 3 up:standby 2023-01-04T18:23:24.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:23 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:22.598990+0000 mon.smithi050 (mon.0) 593 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.memais"}]: dispatch 2023-01-04T18:23:24.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:23:22.159115+0000 mgr.smithi050.emnywo (mgr.24517) 308 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:23:24.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:22.598483+0000 mon.smithi050 (mon.0) 591 : cluster [DBG] mds.? [v2:172.21.15.98:6824/4224872601,v1:172.21.15.98:6825/4224872601] up:boot 2023-01-04T18:23:24.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:22.598567+0000 mon.smithi050 (mon.0) 592 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi098.laynsk=up:active} 3 up:standby 2023-01-04T18:23:24.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:23 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:22.598990+0000 mon.smithi050 (mon.0) 593 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.memais"}]: dispatch 2023-01-04T18:23:25.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:22.683071+0000 mgr.smithi050.emnywo (mgr.24517) 309 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:23:25.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:22.683071+0000 mgr.smithi050.emnywo (mgr.24517) 309 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:23:26.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:24.881164+0000 mon.smithi050 (mon.0) 594 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:23:26.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:24.884721+0000 mon.smithi050 (mon.0) 595 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:23:26.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:24.881164+0000 mon.smithi050 (mon.0) 594 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:23:26.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:24.884721+0000 mon.smithi050 (mon.0) 595 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:23:27.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:24.683675+0000 mgr.smithi050.emnywo (mgr.24517) 310 : cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:23:27.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:26.002945+0000 mon.smithi050 (mon.0) 596 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:27.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:26.007235+0000 mon.smithi050 (mon.0) 597 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:27.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:26.013537+0000 mon.smithi050 (mon.0) 598 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:23:27.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:26.016560+0000 mon.smithi050 (mon.0) 599 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:27.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:26.018184+0000 mon.smithi050 (mon.0) 600 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:27.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:26.019595+0000 mon.smithi050 (mon.0) 601 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:27.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:26.021461+0000 mon.smithi050 (mon.0) 602 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:27.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:26.023534+0000 mon.smithi050 (mon.0) 603 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi098.laynsk"]}]: dispatch 2023-01-04T18:23:27.048 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:24.683675+0000 mgr.smithi050.emnywo (mgr.24517) 310 : cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:23:27.049 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:26.002945+0000 mon.smithi050 (mon.0) 596 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:27.049 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:26.007235+0000 mon.smithi050 (mon.0) 597 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:27.049 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:26.013537+0000 mon.smithi050 (mon.0) 598 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:23:27.049 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:26.016560+0000 mon.smithi050 (mon.0) 599 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:27.049 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:26.018184+0000 mon.smithi050 (mon.0) 600 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:27.050 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:26.019595+0000 mon.smithi050 (mon.0) 601 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:27.050 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:26.021461+0000 mon.smithi050 (mon.0) 602 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:27.050 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:26.023534+0000 mon.smithi050 (mon.0) 603 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi098.laynsk"]}]: dispatch 2023-01-04T18:23:28.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:23:26.024254+0000 mgr.smithi050.emnywo (mgr.24517) 311 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi098.laynsk 2023-01-04T18:23:28.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:27.605388+0000 mon.smithi050 (mon.0) 604 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:28.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:27.606323+0000 mon.smithi050 (mon.0) 605 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.laynsk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-01-04T18:23:28.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:27.607314+0000 mon.smithi050 (mon.0) 606 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:23:28.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:23:26.024254+0000 mgr.smithi050.emnywo (mgr.24517) 311 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi098.laynsk 2023-01-04T18:23:28.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:27.605388+0000 mon.smithi050 (mon.0) 604 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:28.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:27.606323+0000 mon.smithi050 (mon.0) 605 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.laynsk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-01-04T18:23:28.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:27.607314+0000 mon.smithi050 (mon.0) 606 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:23:28.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:26.684209+0000 mgr.smithi050.emnywo (mgr.24517) 312 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:23:28.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:23:27.600316+0000 mgr.smithi050.emnywo (mgr.24517) 313 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi098.laynsk 2023-01-04T18:23:28.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:23:27.608084+0000 mgr.smithi050.emnywo (mgr.24517) 314 : cephadm [INF] Deploying daemon mds.cephfs.smithi098.laynsk on smithi098 2023-01-04T18:23:29.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:26.684209+0000 mgr.smithi050.emnywo (mgr.24517) 312 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:23:29.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:23:27.600316+0000 mgr.smithi050.emnywo (mgr.24517) 313 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi098.laynsk 2023-01-04T18:23:29.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:23:27.608084+0000 mgr.smithi050.emnywo (mgr.24517) 314 : cephadm [INF] Deploying daemon mds.cephfs.smithi098.laynsk on smithi098 2023-01-04T18:23:30.040 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:23:29.617+0000 7f3454949700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-01-04T18:23:30.052 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:23:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-3[126692]: debug 2023-01-04T18:23:29.641+0000 7f5c68f0c700 -1 bdev(0x56059129a800 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 7 2023-01-04T18:23:30.052 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:23:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-3[126692]: debug 2023-01-04T18:23:29.641+0000 7f5c6c713700 -1 bdev(0x56059129a800 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 8 2023-01-04T18:23:30.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:28.684704+0000 mgr.smithi050.emnywo (mgr.24517) 315 : cluster [DBG] pgmap v235: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:23:30.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:29.051362+0000 mon.smithi050 (mon.0) 607 : cluster [DBG] osdmap e95: 6 total, 6 up, 6 in 2023-01-04T18:23:30.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:29.618410+0000 mon.smithi050 (mon.0) 608 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-01-04T18:23:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:29.618446+0000 mon.smithi050 (mon.0) 609 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-01-04T18:23:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:29.624356+0000 mon.smithi050 (mon.0) 610 : cluster [INF] Standby daemon mds.cephfs.smithi050.ezoiwl assigned to filesystem cephfs as rank 0 2023-01-04T18:23:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:29.624495+0000 mon.smithi050 (mon.0) 611 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-01-04T18:23:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:29.624714+0000 mon.smithi050 (mon.0) 612 : cluster [DBG] fsmap cephfs:0/1 3 up:standby, 1 failed 2023-01-04T18:23:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:29.627487+0000 mon.smithi050 (mon.0) 613 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi050.ezoiwl=up:replay} 2 up:standby 2023-01-04T18:23:30.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:28.684704+0000 mgr.smithi050.emnywo (mgr.24517) 315 : cluster [DBG] pgmap v235: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:23:30.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:29.051362+0000 mon.smithi050 (mon.0) 607 : cluster [DBG] osdmap e95: 6 total, 6 up, 6 in 2023-01-04T18:23:30.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:29.618410+0000 mon.smithi050 (mon.0) 608 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-01-04T18:23:30.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:29.618446+0000 mon.smithi050 (mon.0) 609 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-01-04T18:23:30.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:29.624356+0000 mon.smithi050 (mon.0) 610 : cluster [INF] Standby daemon mds.cephfs.smithi050.ezoiwl assigned to filesystem cephfs as rank 0 2023-01-04T18:23:30.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:29.624495+0000 mon.smithi050 (mon.0) 611 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-01-04T18:23:30.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:29.624714+0000 mon.smithi050 (mon.0) 612 : cluster [DBG] fsmap cephfs:0/1 3 up:standby, 1 failed 2023-01-04T18:23:30.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:29.627487+0000 mon.smithi050 (mon.0) 613 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi050.ezoiwl=up:replay} 2 up:standby 2023-01-04T18:23:31.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:30.637964+0000 mon.smithi050 (mon.0) 614 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.laynsk"}]: dispatch 2023-01-04T18:23:31.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:30.637964+0000 mon.smithi050 (mon.0) 614 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.laynsk"}]: dispatch 2023-01-04T18:23:32.315 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:30.685208+0000 mgr.smithi050.emnywo (mgr.24517) 316 : cluster [DBG] pgmap v237: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:23:32.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:30.685208+0000 mgr.smithi050.emnywo (mgr.24517) 316 : cluster [DBG] pgmap v237: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail 2023-01-04T18:23:34.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:32.685593+0000 mgr.smithi050.emnywo (mgr.24517) 317 : cluster [DBG] pgmap v238: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 0 op/s 2023-01-04T18:23:34.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:32.685593+0000 mgr.smithi050.emnywo (mgr.24517) 317 : cluster [DBG] pgmap v238: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 0 op/s 2023-01-04T18:23:36.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:34.686018+0000 mgr.smithi050.emnywo (mgr.24517) 318 : cluster [DBG] pgmap v239: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2023-01-04T18:23:36.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:34.686018+0000 mgr.smithi050.emnywo (mgr.24517) 318 : cluster [DBG] pgmap v239: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2023-01-04T18:23:38.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:36.686385+0000 mgr.smithi050.emnywo (mgr.24517) 319 : cluster [DBG] pgmap v240: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2023-01-04T18:23:38.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:37.415653+0000 mon.smithi050 (mon.0) 615 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:38.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:37.416548+0000 mon.smithi050 (mon.0) 616 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:23:38.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:37.417861+0000 mon.smithi050 (mon.0) 617 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:23:38.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:37.418551+0000 mon.smithi050 (mon.0) 618 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:23:38.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:23:37.419213+0000 mgr.smithi050.emnywo (mgr.24517) 320 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:23:38.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:38.159609+0000 mon.smithi050 (mon.0) 619 : cluster [DBG] mds.? [v2:172.21.15.98:6826/503298078,v1:172.21.15.98:6827/503298078] up:boot 2023-01-04T18:23:38.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:38.159715+0000 mon.smithi050 (mon.0) 620 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi050.ezoiwl=up:replay} 3 up:standby 2023-01-04T18:23:38.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:38.159829+0000 mon.smithi050 (mon.0) 621 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.laynsk"}]: dispatch 2023-01-04T18:23:38.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:36.686385+0000 mgr.smithi050.emnywo (mgr.24517) 319 : cluster [DBG] pgmap v240: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2023-01-04T18:23:38.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:37.415653+0000 mon.smithi050 (mon.0) 615 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:38.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:37.416548+0000 mon.smithi050 (mon.0) 616 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:23:38.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:37.417861+0000 mon.smithi050 (mon.0) 617 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:23:38.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:37.418551+0000 mon.smithi050 (mon.0) 618 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:23:38.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:23:37.419213+0000 mgr.smithi050.emnywo (mgr.24517) 320 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:23:38.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:38.159609+0000 mon.smithi050 (mon.0) 619 : cluster [DBG] mds.? [v2:172.21.15.98:6826/503298078,v1:172.21.15.98:6827/503298078] up:boot 2023-01-04T18:23:38.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:38.159715+0000 mon.smithi050 (mon.0) 620 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi050.ezoiwl=up:replay} 3 up:standby 2023-01-04T18:23:38.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:38.159829+0000 mon.smithi050 (mon.0) 621 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.laynsk"}]: dispatch 2023-01-04T18:23:40.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:38.686833+0000 mgr.smithi050.emnywo (mgr.24517) 321 : cluster [DBG] pgmap v241: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2023-01-04T18:23:40.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:39.419645+0000 mon.smithi050 (mon.0) 622 : cluster [DBG] mds.? [v2:172.21.15.50:6826/336562041,v1:172.21.15.50:6827/336562041] up:reconnect 2023-01-04T18:23:40.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:39.419696+0000 mon.smithi050 (mon.0) 623 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi050.ezoiwl=up:reconnect} 3 up:standby 2023-01-04T18:23:40.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:39.439610+0000 mds.cephfs.smithi050.ezoiwl (mds.0) 1 : cluster [DBG] reconnect by client.24361 v1:172.21.15.50:0/1796285262 after 0.0209995 2023-01-04T18:23:40.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:39.439820+0000 mds.cephfs.smithi050.ezoiwl (mds.0) 2 : cluster [DBG] reconnect by client.14550 v1:172.21.15.98:0/3097597380 after 0.0209995 2023-01-04T18:23:40.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:39.849429+0000 mon.smithi050 (mon.0) 624 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:40.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:38.686833+0000 mgr.smithi050.emnywo (mgr.24517) 321 : cluster [DBG] pgmap v241: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2023-01-04T18:23:40.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:39.419645+0000 mon.smithi050 (mon.0) 622 : cluster [DBG] mds.? [v2:172.21.15.50:6826/336562041,v1:172.21.15.50:6827/336562041] up:reconnect 2023-01-04T18:23:40.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:39.419696+0000 mon.smithi050 (mon.0) 623 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi050.ezoiwl=up:reconnect} 3 up:standby 2023-01-04T18:23:40.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:39.439610+0000 mds.cephfs.smithi050.ezoiwl (mds.0) 1 : cluster [DBG] reconnect by client.24361 v1:172.21.15.50:0/1796285262 after 0.0209995 2023-01-04T18:23:40.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:39.439820+0000 mds.cephfs.smithi050.ezoiwl (mds.0) 2 : cluster [DBG] reconnect by client.14550 v1:172.21.15.98:0/3097597380 after 0.0209995 2023-01-04T18:23:40.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:39.849429+0000 mon.smithi050 (mon.0) 624 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:41.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:40.425037+0000 mon.smithi050 (mon.0) 625 : cluster [DBG] mds.? [v2:172.21.15.50:6826/336562041,v1:172.21.15.50:6827/336562041] up:rejoin 2023-01-04T18:23:41.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:40.425102+0000 mon.smithi050 (mon.0) 626 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi050.ezoiwl=up:rejoin} 3 up:standby 2023-01-04T18:23:41.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:40.492918+0000 mon.smithi050 (mon.0) 627 : cluster [INF] daemon mds.cephfs.smithi050.ezoiwl is now active in filesystem cephfs as rank 0 2023-01-04T18:23:41.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:40.722055+0000 mon.smithi050 (mon.0) 628 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:41.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:40.725454+0000 mon.smithi050 (mon.0) 629 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:41.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:40.731247+0000 mon.smithi050 (mon.0) 630 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:23:41.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:40.733799+0000 mon.smithi050 (mon.0) 631 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:41.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:40.735134+0000 mon.smithi050 (mon.0) 632 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:41.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:40.736437+0000 mon.smithi050 (mon.0) 633 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:41.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:40.738155+0000 mon.smithi050 (mon.0) 634 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:41.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:40.740092+0000 mon.smithi050 (mon.0) 635 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:41.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:40.744428+0000 mon.smithi050 (mon.0) 636 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:41.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:40.745248+0000 mon.smithi050 (mon.0) 637 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi050.ezoiwl"}]: dispatch 2023-01-04T18:23:41.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:40.748169+0000 mon.smithi050 (mon.0) 638 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi050.ezoiwl"}]': finished 2023-01-04T18:23:41.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:40.748922+0000 mon.smithi050 (mon.0) 639 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi050.kefmuy"}]: dispatch 2023-01-04T18:23:41.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:40.751823+0000 mon.smithi050 (mon.0) 640 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi050.kefmuy"}]': finished 2023-01-04T18:23:41.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:40.752477+0000 mon.smithi050 (mon.0) 641 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.laynsk"}]: dispatch 2023-01-04T18:23:41.792 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:40.755337+0000 mon.smithi050 (mon.0) 642 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.laynsk"}]': finished 2023-01-04T18:23:41.793 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:40.755999+0000 mon.smithi050 (mon.0) 643 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.memais"}]: dispatch 2023-01-04T18:23:41.793 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:40.758846+0000 mon.smithi050 (mon.0) 644 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.memais"}]': finished 2023-01-04T18:23:41.793 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:40.759736+0000 mon.smithi050 (mon.0) 645 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2023-01-04T18:23:41.831 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-3[126692]: debug 2023-01-04T18:23:41.455+0000 7f5c7071b700 -1 bdev(0x56059129a800 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 5 2023-01-04T18:23:41.831 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-3[126692]: debug 2023-01-04T18:23:41.456+0000 7f5c6cf14700 -1 bdev(0x56059129a800 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 13 2023-01-04T18:23:41.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:40.425037+0000 mon.smithi050 (mon.0) 625 : cluster [DBG] mds.? [v2:172.21.15.50:6826/336562041,v1:172.21.15.50:6827/336562041] up:rejoin 2023-01-04T18:23:41.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:40.425102+0000 mon.smithi050 (mon.0) 626 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi050.ezoiwl=up:rejoin} 3 up:standby 2023-01-04T18:23:41.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:40.492918+0000 mon.smithi050 (mon.0) 627 : cluster [INF] daemon mds.cephfs.smithi050.ezoiwl is now active in filesystem cephfs as rank 0 2023-01-04T18:23:41.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:40.722055+0000 mon.smithi050 (mon.0) 628 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:41.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:40.725454+0000 mon.smithi050 (mon.0) 629 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:41.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:40.731247+0000 mon.smithi050 (mon.0) 630 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:23:41.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:40.733799+0000 mon.smithi050 (mon.0) 631 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:41.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:40.735134+0000 mon.smithi050 (mon.0) 632 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:41.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:40.736437+0000 mon.smithi050 (mon.0) 633 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:41.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:40.738155+0000 mon.smithi050 (mon.0) 634 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:41.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:40.740092+0000 mon.smithi050 (mon.0) 635 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:41.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:40.744428+0000 mon.smithi050 (mon.0) 636 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:41.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:40.745248+0000 mon.smithi050 (mon.0) 637 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi050.ezoiwl"}]: dispatch 2023-01-04T18:23:41.834 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:40.748169+0000 mon.smithi050 (mon.0) 638 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi050.ezoiwl"}]': finished 2023-01-04T18:23:41.834 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:40.748922+0000 mon.smithi050 (mon.0) 639 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi050.kefmuy"}]: dispatch 2023-01-04T18:23:41.834 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:40.751823+0000 mon.smithi050 (mon.0) 640 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi050.kefmuy"}]': finished 2023-01-04T18:23:41.834 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:40.752477+0000 mon.smithi050 (mon.0) 641 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.laynsk"}]: dispatch 2023-01-04T18:23:41.834 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:40.755337+0000 mon.smithi050 (mon.0) 642 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.laynsk"}]': finished 2023-01-04T18:23:41.834 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:40.755999+0000 mon.smithi050 (mon.0) 643 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.memais"}]: dispatch 2023-01-04T18:23:41.835 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:40.758846+0000 mon.smithi050 (mon.0) 644 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.memais"}]': finished 2023-01-04T18:23:41.835 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:40.759736+0000 mon.smithi050 (mon.0) 645 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2023-01-04T18:23:42.433 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:40.687337+0000 mgr.smithi050.emnywo (mgr.24517) 322 : cluster [DBG] pgmap v242: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2023-01-04T18:23:42.434 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:23:40.740753+0000 mgr.smithi050.emnywo (mgr.24517) 323 : cephadm [INF] Upgrade: Setting container_image for all mds 2023-01-04T18:23:42.434 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:23:40.759533+0000 mgr.smithi050.emnywo (mgr.24517) 324 : cephadm [INF] Upgrade: Enabling allow_standby_replay on filesystem cephfs 2023-01-04T18:23:42.434 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:41.423760+0000 mon.smithi050 (mon.0) 646 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-01-04T18:23:42.434 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:41.431507+0000 mon.smithi050 (mon.0) 647 : cluster [DBG] mds.? [v2:172.21.15.50:6826/336562041,v1:172.21.15.50:6827/336562041] up:active 2023-01-04T18:23:42.434 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:41.431614+0000 mon.smithi050 (mon.0) 648 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2023-01-04T18:23:42.434 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:41.432094+0000 mon.smithi050 (mon.0) 649 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 3 up:standby 2023-01-04T18:23:42.434 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:41.440725+0000 mon.smithi050 (mon.0) 650 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 1 up:standby-replay 2 up:standby 2023-01-04T18:23:42.434 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:41.452121+0000 mon.smithi050 (mon.0) 651 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:42.434 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:41.453515+0000 mon.smithi050 (mon.0) 652 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:42.434 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:23:41.454657+0000 mgr.smithi050.emnywo (mgr.24517) 325 : cephadm [INF] Upgrade: Setting container_image for all rgw 2023-01-04T18:23:42.434 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:41.467717+0000 mon.smithi050 (mon.0) 653 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:42.435 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:41.469829+0000 mon.smithi050 (mon.0) 654 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:42.435 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:23:41.470734+0000 mgr.smithi050.emnywo (mgr.24517) 326 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2023-01-04T18:23:42.435 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:41.475522+0000 mon.smithi050 (mon.0) 655 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:42.435 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:41.476873+0000 mon.smithi050 (mon.0) 656 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:42.435 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:41.478024+0000 mon.smithi050 (mon.0) 657 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:42.435 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:23:41.478696+0000 mgr.smithi050.emnywo (mgr.24517) 327 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2023-01-04T18:23:42.435 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:41.484079+0000 mon.smithi050 (mon.0) 658 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:42.435 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:41.485465+0000 mon.smithi050 (mon.0) 659 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:42.435 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:23:41.486181+0000 mgr.smithi050.emnywo (mgr.24517) 328 : cephadm [INF] Upgrade: Setting container_image for all nfs 2023-01-04T18:23:42.435 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:41.490274+0000 mon.smithi050 (mon.0) 660 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:42.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:40.687337+0000 mgr.smithi050.emnywo (mgr.24517) 322 : cluster [DBG] pgmap v242: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2023-01-04T18:23:42.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:23:40.740753+0000 mgr.smithi050.emnywo (mgr.24517) 323 : cephadm [INF] Upgrade: Setting container_image for all mds 2023-01-04T18:23:42.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:23:40.759533+0000 mgr.smithi050.emnywo (mgr.24517) 324 : cephadm [INF] Upgrade: Enabling allow_standby_replay on filesystem cephfs 2023-01-04T18:23:42.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:41.423760+0000 mon.smithi050 (mon.0) 646 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-01-04T18:23:42.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:41.431507+0000 mon.smithi050 (mon.0) 647 : cluster [DBG] mds.? [v2:172.21.15.50:6826/336562041,v1:172.21.15.50:6827/336562041] up:active 2023-01-04T18:23:42.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:41.431614+0000 mon.smithi050 (mon.0) 648 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2023-01-04T18:23:42.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:41.432094+0000 mon.smithi050 (mon.0) 649 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 3 up:standby 2023-01-04T18:23:42.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:41.440725+0000 mon.smithi050 (mon.0) 650 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi050.ezoiwl=up:active} 1 up:standby-replay 2 up:standby 2023-01-04T18:23:42.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:41.452121+0000 mon.smithi050 (mon.0) 651 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:42.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:41.453515+0000 mon.smithi050 (mon.0) 652 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:42.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:23:41.454657+0000 mgr.smithi050.emnywo (mgr.24517) 325 : cephadm [INF] Upgrade: Setting container_image for all rgw 2023-01-04T18:23:42.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:41.467717+0000 mon.smithi050 (mon.0) 653 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:42.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:41.469829+0000 mon.smithi050 (mon.0) 654 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:42.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:23:41.470734+0000 mgr.smithi050.emnywo (mgr.24517) 326 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2023-01-04T18:23:42.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:41.475522+0000 mon.smithi050 (mon.0) 655 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:42.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:41.476873+0000 mon.smithi050 (mon.0) 656 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:42.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:41.478024+0000 mon.smithi050 (mon.0) 657 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:42.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:23:41.478696+0000 mgr.smithi050.emnywo (mgr.24517) 327 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2023-01-04T18:23:42.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:41.484079+0000 mon.smithi050 (mon.0) 658 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:42.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:41.485465+0000 mon.smithi050 (mon.0) 659 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:42.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:23:41.486181+0000 mgr.smithi050.emnywo (mgr.24517) 328 : cephadm [INF] Upgrade: Setting container_image for all nfs 2023-01-04T18:23:42.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:41.490274+0000 mon.smithi050 (mon.0) 660 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:44.716 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:42.687729+0000 mgr.smithi050.emnywo (mgr.24517) 329 : cluster [DBG] pgmap v243: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2023-01-04T18:23:44.716 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:23:42.910073+0000 mgr.smithi050.emnywo (mgr.24517) 330 : cephadm [INF] Upgrade: Updating node-exporter.smithi050 (1/2) 2023-01-04T18:23:44.716 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:23:42.910276+0000 mgr.smithi050.emnywo (mgr.24517) 331 : cephadm [INF] Deploying daemon node-exporter.smithi050 on smithi050 2023-01-04T18:23:44.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:42.687729+0000 mgr.smithi050.emnywo (mgr.24517) 329 : cluster [DBG] pgmap v243: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2023-01-04T18:23:44.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:23:42.910073+0000 mgr.smithi050.emnywo (mgr.24517) 330 : cephadm [INF] Upgrade: Updating node-exporter.smithi050 (1/2) 2023-01-04T18:23:44.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:23:42.910276+0000 mgr.smithi050.emnywo (mgr.24517) 331 : cephadm [INF] Deploying daemon node-exporter.smithi050 on smithi050 2023-01-04T18:23:45.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.081+0000 7f5b9c939700 1 -- 172.21.15.50:0/1301731294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b980f66e0 msgr2=0x7f5b980f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:45.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.081+0000 7f5b9c939700 1 --2- 172.21.15.50:0/1301731294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b980f66e0 0x7f5b980f6b00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f5b88004660 tx=0x7f5b88009b30).stop 2023-01-04T18:23:45.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.081+0000 7f5b9c939700 1 -- 172.21.15.50:0/1301731294 shutdown_connections 2023-01-04T18:23:45.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.081+0000 7f5b9c939700 1 --2- 172.21.15.50:0/1301731294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b980f7980 0x7f5b980f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:45.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.081+0000 7f5b9c939700 1 --2- 172.21.15.50:0/1301731294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b980f66e0 0x7f5b980f6b00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:45.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.081+0000 7f5b9c939700 1 -- 172.21.15.50:0/1301731294 >> 172.21.15.50:0/1301731294 conn(0x7f5b980f1e40 msgr2=0x7f5b980f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:45.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.081+0000 7f5b9c939700 1 -- 172.21.15.50:0/1301731294 shutdown_connections 2023-01-04T18:23:45.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.081+0000 7f5b9c939700 1 -- 172.21.15.50:0/1301731294 wait complete. 2023-01-04T18:23:45.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.081+0000 7f5b9c939700 1 Processor -- start 2023-01-04T18:23:45.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.082+0000 7f5b9c939700 1 -- start start 2023-01-04T18:23:45.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.082+0000 7f5b9c939700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b980f66e0 0x7f5b98106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:45.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.082+0000 7f5b9c939700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b980f7980 0x7f5b98107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:45.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.082+0000 7f5b9c939700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b98107a20 con 0x7f5b980f7980 2023-01-04T18:23:45.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.082+0000 7f5b9c939700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b98107b60 con 0x7f5b980f66e0 2023-01-04T18:23:45.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.082+0000 7f5b95d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b980f7980 0x7f5b98107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:45.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.082+0000 7f5b95d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b980f7980 0x7f5b98107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42274/0 (socket says 172.21.15.50:42274) 2023-01-04T18:23:45.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.082+0000 7f5b95d9b700 1 -- 172.21.15.50:0/1079258675 learned_addr learned my addr 172.21.15.50:0/1079258675 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:23:45.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.082+0000 7f5b9659c700 1 --2- 172.21.15.50:0/1079258675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b980f66e0 0x7f5b98106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:45.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.082+0000 7f5b95d9b700 1 -- 172.21.15.50:0/1079258675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b980f66e0 msgr2=0x7f5b98106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:45.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.082+0000 7f5b95d9b700 1 --2- 172.21.15.50:0/1079258675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b980f66e0 0x7f5b98106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:45.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.082+0000 7f5b95d9b700 1 -- 172.21.15.50:0/1079258675 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b88005040 con 0x7f5b980f7980 2023-01-04T18:23:45.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.082+0000 7f5b9659c700 1 --2- 172.21.15.50:0/1079258675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b980f66e0 0x7f5b98106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:23:45.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.082+0000 7f5b95d9b700 1 --2- 172.21.15.50:0/1079258675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b980f7980 0x7f5b98107470 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f5b8c002700 tx=0x7f5b8c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:45.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.083+0000 7f5b86ffd700 1 -- 172.21.15.50:0/1079258675 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b8c009320 con 0x7f5b980f7980 2023-01-04T18:23:45.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.083+0000 7f5b9c939700 1 -- 172.21.15.50:0/1079258675 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b98108500 con 0x7f5b980f7980 2023-01-04T18:23:45.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.083+0000 7f5b86ffd700 1 -- 172.21.15.50:0/1079258675 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5b8c00f040 con 0x7f5b980f7980 2023-01-04T18:23:45.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.083+0000 7f5b86ffd700 1 -- 172.21.15.50:0/1079258675 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b8c0148a0 con 0x7f5b980f7980 2023-01-04T18:23:45.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.083+0000 7f5b9c939700 1 -- 172.21.15.50:0/1079258675 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b98108ac0 con 0x7f5b980f7980 2023-01-04T18:23:45.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.084+0000 7f5b9c939700 1 -- 172.21.15.50:0/1079258675 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b98045ad0 con 0x7f5b980f7980 2023-01-04T18:23:45.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.084+0000 7f5b86ffd700 1 -- 172.21.15.50:0/1079258675 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f5b8c0077b0 con 0x7f5b980f7980 2023-01-04T18:23:45.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.085+0000 7f5b86ffd700 1 --2- 172.21.15.50:0/1079258675 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5b80060be0 0x7f5b800630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:45.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.085+0000 7f5b86ffd700 1 -- 172.21.15.50:0/1079258675 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f5b8c07c0f0 con 0x7f5b980f7980 2023-01-04T18:23:45.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.085+0000 7f5b9659c700 1 --2- 172.21.15.50:0/1079258675 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5b80060be0 0x7f5b800630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:45.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.085+0000 7f5b9659c700 1 --2- 172.21.15.50:0/1079258675 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5b80060be0 0x7f5b800630a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f5b88004e30 tx=0x7f5b88009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:45.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.089+0000 7f5b86ffd700 1 -- 172.21.15.50:0/1079258675 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f5b8c050040 con 0x7f5b980f7980 2023-01-04T18:23:45.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.292+0000 7f5b9c939700 1 -- 172.21.15.50:0/1079258675 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b980fefe0 con 0x7f5b80060be0 2023-01-04T18:23:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.293+0000 7f5b86ffd700 1 -- 172.21.15.50:0/1079258675 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f5b980fefe0 con 0x7f5b80060be0 2023-01-04T18:23:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.295+0000 7f5b9c939700 1 -- 172.21.15.50:0/1079258675 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5b80060be0 msgr2=0x7f5b800630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.295+0000 7f5b9c939700 1 --2- 172.21.15.50:0/1079258675 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5b80060be0 0x7f5b800630a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f5b88004e30 tx=0x7f5b88009b30).stop 2023-01-04T18:23:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.295+0000 7f5b9c939700 1 -- 172.21.15.50:0/1079258675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b980f7980 msgr2=0x7f5b98107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.295+0000 7f5b9c939700 1 --2- 172.21.15.50:0/1079258675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b980f7980 0x7f5b98107470 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f5b8c002700 tx=0x7f5b8c009e00).stop 2023-01-04T18:23:45.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.296+0000 7f5b9c939700 1 -- 172.21.15.50:0/1079258675 shutdown_connections 2023-01-04T18:23:45.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.296+0000 7f5b9c939700 1 --2- 172.21.15.50:0/1079258675 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5b80060be0 0x7f5b800630a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:45.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.296+0000 7f5b9c939700 1 --2- 172.21.15.50:0/1079258675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b980f66e0 0x7f5b98106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:45.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.296+0000 7f5b9c939700 1 --2- 172.21.15.50:0/1079258675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b980f7980 0x7f5b98107470 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:45.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.296+0000 7f5b9c939700 1 -- 172.21.15.50:0/1079258675 >> 172.21.15.50:0/1079258675 conn(0x7f5b980f1e40 msgr2=0x7f5b980fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:45.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.296+0000 7f5b9c939700 1 -- 172.21.15.50:0/1079258675 shutdown_connections 2023-01-04T18:23:45.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.296+0000 7f5b9c939700 1 -- 172.21.15.50:0/1079258675 wait complete. 2023-01-04T18:23:45.309 INFO:teuthology.orchestra.run.smithi050.stdout:true 2023-01-04T18:23:45.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.411+0000 7fb75f59e700 1 -- 172.21.15.50:0/2898860022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7600f96a0 msgr2=0x7fb7600fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:45.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.411+0000 7fb75f59e700 1 --2- 172.21.15.50:0/2898860022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7600f96a0 0x7fb7600fbaf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fb754004660 tx=0x7fb754009b30).stop 2023-01-04T18:23:45.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.411+0000 7fb75f59e700 1 -- 172.21.15.50:0/2898860022 shutdown_connections 2023-01-04T18:23:45.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.411+0000 7fb75f59e700 1 --2- 172.21.15.50:0/2898860022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7600f96a0 0x7fb7600fbaf0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:45.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.411+0000 7fb75f59e700 1 --2- 172.21.15.50:0/2898860022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb760060310 0x7fb7600f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:45.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.411+0000 7fb75f59e700 1 -- 172.21.15.50:0/2898860022 >> 172.21.15.50:0/2898860022 conn(0x7fb7600f0ba0 msgr2=0x7fb7600f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:45.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.411+0000 7fb75f59e700 1 -- 172.21.15.50:0/2898860022 shutdown_connections 2023-01-04T18:23:45.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.411+0000 7fb75f59e700 1 -- 172.21.15.50:0/2898860022 wait complete. 2023-01-04T18:23:45.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.412+0000 7fb75f59e700 1 Processor -- start 2023-01-04T18:23:45.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.412+0000 7fb75f59e700 1 -- start start 2023-01-04T18:23:45.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.412+0000 7fb75f59e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb760060310 0x7fb7600f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:45.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.412+0000 7fb75f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7600f96a0 0x7fb7600f5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:45.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.412+0000 7fb75f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76010a9e0 con 0x7fb7600f96a0 2023-01-04T18:23:45.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.412+0000 7fb75f59e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76010ab20 con 0x7fb760060310 2023-01-04T18:23:45.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.412+0000 7fb75dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7600f96a0 0x7fb7600f5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:45.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.412+0000 7fb75dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7600f96a0 0x7fb7600f5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42284/0 (socket says 172.21.15.50:42284) 2023-01-04T18:23:45.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.412+0000 7fb75dd9b700 1 -- 172.21.15.50:0/3457346813 learned_addr learned my addr 172.21.15.50:0/3457346813 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:23:45.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.412+0000 7fb75e59c700 1 --2- 172.21.15.50:0/3457346813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb760060310 0x7fb7600f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:45.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.413+0000 7fb75dd9b700 1 -- 172.21.15.50:0/3457346813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb760060310 msgr2=0x7fb7600f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:45.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.413+0000 7fb75dd9b700 1 --2- 172.21.15.50:0/3457346813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb760060310 0x7fb7600f6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:45.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.413+0000 7fb75dd9b700 1 -- 172.21.15.50:0/3457346813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb754005040 con 0x7fb7600f96a0 2023-01-04T18:23:45.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.413+0000 7fb75dd9b700 1 --2- 172.21.15.50:0/3457346813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7600f96a0 0x7fb7600f5020 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fb754004e30 tx=0x7fb754009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:45.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.413+0000 7fb74effd700 1 -- 172.21.15.50:0/3457346813 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb754018070 con 0x7fb7600f96a0 2023-01-04T18:23:45.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.413+0000 7fb74effd700 1 -- 172.21.15.50:0/3457346813 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb754009630 con 0x7fb7600f96a0 2023-01-04T18:23:45.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.413+0000 7fb74effd700 1 -- 172.21.15.50:0/3457346813 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb75401c3c0 con 0x7fb7600f96a0 2023-01-04T18:23:45.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.413+0000 7fb75f59e700 1 -- 172.21.15.50:0/3457346813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7600f5570 con 0x7fb7600f96a0 2023-01-04T18:23:45.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.413+0000 7fb75f59e700 1 -- 172.21.15.50:0/3457346813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7600f5ad0 con 0x7fb7600f96a0 2023-01-04T18:23:45.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.415+0000 7fb74effd700 1 -- 172.21.15.50:0/3457346813 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fb75401c520 con 0x7fb7600f96a0 2023-01-04T18:23:45.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.415+0000 7fb74effd700 1 --2- 172.21.15.50:0/3457346813 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb748060c30 0x7fb7480630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:45.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.416+0000 7fb74effd700 1 -- 172.21.15.50:0/3457346813 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fb75407d800 con 0x7fb7600f96a0 2023-01-04T18:23:45.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.416+0000 7fb75e59c700 1 --2- 172.21.15.50:0/3457346813 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb748060c30 0x7fb7480630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:45.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.416+0000 7fb75f59e700 1 -- 172.21.15.50:0/3457346813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb744004fa0 con 0x7fb7600f96a0 2023-01-04T18:23:45.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.416+0000 7fb75e59c700 1 --2- 172.21.15.50:0/3457346813 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb748060c30 0x7fb7480630f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fb7600f6930 tx=0x7fb75000b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:45.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.422+0000 7fb74effd700 1 -- 172.21.15.50:0/3457346813 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fb75404dda0 con 0x7fb7600f96a0 2023-01-04T18:23:45.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.721+0000 7fb75f59e700 1 -- 172.21.15.50:0/3457346813 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb744002a40 con 0x7fb748060c30 2023-01-04T18:23:45.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.723+0000 7fb74effd700 1 -- 172.21.15.50:0/3457346813 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fb744002a40 con 0x7fb748060c30 2023-01-04T18:23:45.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.725+0000 7fb75f59e700 1 -- 172.21.15.50:0/3457346813 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb748060c30 msgr2=0x7fb7480630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:45.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.725+0000 7fb75f59e700 1 --2- 172.21.15.50:0/3457346813 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb748060c30 0x7fb7480630f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fb7600f6930 tx=0x7fb75000b040).stop 2023-01-04T18:23:45.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.725+0000 7fb75f59e700 1 -- 172.21.15.50:0/3457346813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7600f96a0 msgr2=0x7fb7600f5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:45.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.725+0000 7fb75f59e700 1 --2- 172.21.15.50:0/3457346813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7600f96a0 0x7fb7600f5020 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fb754004e30 tx=0x7fb754009b30).stop 2023-01-04T18:23:45.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.725+0000 7fb75f59e700 1 -- 172.21.15.50:0/3457346813 shutdown_connections 2023-01-04T18:23:45.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.725+0000 7fb75f59e700 1 --2- 172.21.15.50:0/3457346813 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb748060c30 0x7fb7480630f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:45.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.725+0000 7fb75f59e700 1 --2- 172.21.15.50:0/3457346813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb760060310 0x7fb7600f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:45.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.725+0000 7fb75f59e700 1 --2- 172.21.15.50:0/3457346813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7600f96a0 0x7fb7600f5020 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:45.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.725+0000 7fb75f59e700 1 -- 172.21.15.50:0/3457346813 >> 172.21.15.50:0/3457346813 conn(0x7fb7600f0ba0 msgr2=0x7fb7600f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:45.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.725+0000 7fb75f59e700 1 -- 172.21.15.50:0/3457346813 shutdown_connections 2023-01-04T18:23:45.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.725+0000 7fb75f59e700 1 -- 172.21.15.50:0/3457346813 wait complete. 2023-01-04T18:23:45.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.840+0000 7f060d1b3700 1 -- 172.21.15.50:0/1659147043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06080f66d0 msgr2=0x7f06080f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:45.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.840+0000 7f060d1b3700 1 --2- 172.21.15.50:0/1659147043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06080f66d0 0x7f06080f6b30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f05f8004660 tx=0x7f05f8009b30).stop 2023-01-04T18:23:45.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.840+0000 7f060d1b3700 1 -- 172.21.15.50:0/1659147043 shutdown_connections 2023-01-04T18:23:45.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.840+0000 7f060d1b3700 1 --2- 172.21.15.50:0/1659147043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06080f66d0 0x7f06080f6b30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:45.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.840+0000 7f060d1b3700 1 --2- 172.21.15.50:0/1659147043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06080f5430 0x7f06080f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:45.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.840+0000 7f060d1b3700 1 -- 172.21.15.50:0/1659147043 >> 172.21.15.50:0/1659147043 conn(0x7f06080f0b90 msgr2=0x7f06080f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:45.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.840+0000 7f060d1b3700 1 -- 172.21.15.50:0/1659147043 shutdown_connections 2023-01-04T18:23:45.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.840+0000 7f060d1b3700 1 -- 172.21.15.50:0/1659147043 wait complete. 2023-01-04T18:23:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.841+0000 7f060d1b3700 1 Processor -- start 2023-01-04T18:23:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.841+0000 7f060d1b3700 1 -- start start 2023-01-04T18:23:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.841+0000 7f060d1b3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06080f5430 0x7f0608108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.841+0000 7f060d1b3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06080f66d0 0x7f0608109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:45.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.841+0000 7f060d1b3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06081099e0 con 0x7f06080f66d0 2023-01-04T18:23:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.841+0000 7f060d1b3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0608109b20 con 0x7f06080f5430 2023-01-04T18:23:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.841+0000 7f06077fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06080f66d0 0x7f0608109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.841+0000 7f06077fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06080f66d0 0x7f0608109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42300/0 (socket says 172.21.15.50:42300) 2023-01-04T18:23:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.841+0000 7f06077fe700 1 -- 172.21.15.50:0/3138160202 learned_addr learned my addr 172.21.15.50:0/3138160202 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:23:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.841+0000 7f0607fff700 1 --2- 172.21.15.50:0/3138160202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06080f5430 0x7f0608108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.842+0000 7f06077fe700 1 -- 172.21.15.50:0/3138160202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06080f5430 msgr2=0x7f0608108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.842+0000 7f06077fe700 1 --2- 172.21.15.50:0/3138160202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06080f5430 0x7f0608108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.842+0000 7f06077fe700 1 -- 172.21.15.50:0/3138160202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f8005040 con 0x7f06080f66d0 2023-01-04T18:23:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.842+0000 7f06077fe700 1 --2- 172.21.15.50:0/3138160202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06080f66d0 0x7f0608109430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f05f8009f50 tx=0x7f05f8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:45.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.842+0000 7f0604ff9700 1 -- 172.21.15.50:0/3138160202 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05f8018070 con 0x7f06080f66d0 2023-01-04T18:23:45.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.842+0000 7f060d1b3700 1 -- 172.21.15.50:0/3138160202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060810a460 con 0x7f06080f66d0 2023-01-04T18:23:45.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.842+0000 7f060d1b3700 1 -- 172.21.15.50:0/3138160202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060810a9c0 con 0x7f06080f66d0 2023-01-04T18:23:45.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.842+0000 7f0604ff9700 1 -- 172.21.15.50:0/3138160202 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f05f8009630 con 0x7f06080f66d0 2023-01-04T18:23:45.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.843+0000 7f0604ff9700 1 -- 172.21.15.50:0/3138160202 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05f801c3c0 con 0x7f06080f66d0 2023-01-04T18:23:45.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.844+0000 7f060d1b3700 1 -- 172.21.15.50:0/3138160202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05ec004fa0 con 0x7f06080f66d0 2023-01-04T18:23:45.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.844+0000 7f0604ff9700 1 -- 172.21.15.50:0/3138160202 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f05f801d420 con 0x7f06080f66d0 2023-01-04T18:23:45.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.845+0000 7f0604ff9700 1 --2- 172.21.15.50:0/3138160202 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f05f4060c30 0x7f05f40630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:45.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.845+0000 7f0604ff9700 1 -- 172.21.15.50:0/3138160202 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f05f807d9c0 con 0x7f06080f66d0 2023-01-04T18:23:45.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.845+0000 7f0607fff700 1 --2- 172.21.15.50:0/3138160202 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f05f4060c30 0x7f05f40630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:45.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.845+0000 7f0607fff700 1 --2- 172.21.15.50:0/3138160202 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f05f4060c30 0x7f05f40630f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f06080f6530 tx=0x7f05f000b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:45.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:45.850+0000 7f0604ff9700 1 -- 172.21.15.50:0/3138160202 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f05f8051910 con 0x7f06080f66d0 2023-01-04T18:23:46.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.081+0000 7f060d1b3700 1 -- 172.21.15.50:0/3138160202 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f05ec000bc0 con 0x7f05f4060c30 2023-01-04T18:23:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.091+0000 7f0604ff9700 1 -- 172.21.15.50:0/3138160202 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f05ec000bc0 con 0x7f05f4060c30 2023-01-04T18:23:46.095 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-01-04T18:23:46.095 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager.smithi050 smithi050 *:9093,9094 running (12m) 41s ago 13m 26.4M - 0.20.0 0881eb8f169f b5d3e2678a23 2023-01-04T18:23:46.095 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi050 smithi050 running (5m) 41s ago 13m 7050k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cfe28e5ab81e 2023-01-04T18:23:46.095 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi098 smithi098 running (5m) 5s ago 12m 7180k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cf5f0ca60522 2023-01-04T18:23:46.095 INFO:teuthology.orchestra.run.smithi050.stdout:grafana.smithi050 smithi050 *:3000 running (12m) 41s ago 13m 37.5M - 6.7.4 557c83e11646 7e5dccbafe78 2023-01-04T18:23:46.096 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.ezoiwl smithi050 running (63s) 41s ago 9m 15.7M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 146e50d0c3f4 2023-01-04T18:23:46.096 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.kefmuy smithi050 running (46s) 41s ago 9m 11.2M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 4aaf433888b2 2023-01-04T18:23:46.096 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.laynsk smithi098 running (9s) 5s ago 9m 14.4M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 76076b59594d 2023-01-04T18:23:46.096 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.memais smithi098 running (24s) 5s ago 9m 13.5M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d fdb3824282b1 2023-01-04T18:23:46.096 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi050.emnywo smithi050 *:8443,9283 running (6m) 41s ago 14m 450M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d ee677216e754 2023-01-04T18:23:46.096 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi098.vhfzum smithi098 *:8443,9283 running (6m) 5s ago 12m 397M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d f3d98bf0cf66 2023-01-04T18:23:46.096 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi050 smithi050 running (5m) 41s ago 14m 114M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 0423819cbaa7 2023-01-04T18:23:46.096 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi098 smithi098 running (5m) 5s ago 12m 103M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 12094818aefc 2023-01-04T18:23:46.096 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi050 smithi050 *:9100 running (13m) 41s ago 13m 18.4M - 0.18.1 e5a616e4b9cf 88892b2e5e5a 2023-01-04T18:23:46.096 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi098 smithi098 *:9100 running (12m) 5s ago 12m 18.4M - 0.18.1 e5a616e4b9cf 49bcde8331b6 2023-01-04T18:23:46.096 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (5m) 41s ago 11m 364M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 60dafedcb429 2023-01-04T18:23:46.097 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi050 running (3m) 41s ago 11m 364M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 625bd99952d9 2023-01-04T18:23:46.097 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi050 running (2m) 41s ago 11m 273M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d badf94f13661 2023-01-04T18:23:46.097 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi098 running (2m) 5s ago 11m 406M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 93c4e177ba97 2023-01-04T18:23:46.097 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi098 running (112s) 5s ago 10m 377M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 9398016f5e81 2023-01-04T18:23:46.097 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi098 running (83s) 5s ago 10m 315M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 82e86a9ed864 2023-01-04T18:23:46.097 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus.smithi050 smithi050 *:9095 running (6m) 41s ago 12m 67.1M - 2.18.1 de242295e225 7bdcf7a45d34 2023-01-04T18:23:46.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.094+0000 7f060d1b3700 1 -- 172.21.15.50:0/3138160202 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f05f4060c30 msgr2=0x7f05f40630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:46.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.094+0000 7f060d1b3700 1 --2- 172.21.15.50:0/3138160202 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f05f4060c30 0x7f05f40630f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f06080f6530 tx=0x7f05f000b040).stop 2023-01-04T18:23:46.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.094+0000 7f060d1b3700 1 -- 172.21.15.50:0/3138160202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06080f66d0 msgr2=0x7f0608109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:46.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.094+0000 7f060d1b3700 1 --2- 172.21.15.50:0/3138160202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06080f66d0 0x7f0608109430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f05f8009f50 tx=0x7f05f8009b30).stop 2023-01-04T18:23:46.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.096+0000 7f060d1b3700 1 -- 172.21.15.50:0/3138160202 shutdown_connections 2023-01-04T18:23:46.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.096+0000 7f060d1b3700 1 --2- 172.21.15.50:0/3138160202 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f05f4060c30 0x7f05f40630f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:46.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.096+0000 7f060d1b3700 1 --2- 172.21.15.50:0/3138160202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06080f5430 0x7f0608108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:46.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.096+0000 7f060d1b3700 1 --2- 172.21.15.50:0/3138160202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06080f66d0 0x7f0608109430 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:46.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.096+0000 7f060d1b3700 1 -- 172.21.15.50:0/3138160202 >> 172.21.15.50:0/3138160202 conn(0x7f06080f0b90 msgr2=0x7f06080fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:46.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.100+0000 7f060d1b3700 1 -- 172.21.15.50:0/3138160202 shutdown_connections 2023-01-04T18:23:46.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.100+0000 7f060d1b3700 1 -- 172.21.15.50:0/3138160202 wait complete. 2023-01-04T18:23:46.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.233+0000 7fa315516700 1 -- 172.21.15.50:0/1258365929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3100f7980 msgr2=0x7fa3100f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:46.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.233+0000 7fa315516700 1 --2- 172.21.15.50:0/1258365929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3100f7980 0x7fa3100f7de0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fa304004660 tx=0x7fa304009b30).stop 2023-01-04T18:23:46.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.233+0000 7fa315516700 1 -- 172.21.15.50:0/1258365929 shutdown_connections 2023-01-04T18:23:46.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.233+0000 7fa315516700 1 --2- 172.21.15.50:0/1258365929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3100f7980 0x7fa3100f7de0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:46.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.233+0000 7fa315516700 1 --2- 172.21.15.50:0/1258365929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3100f66e0 0x7fa3100f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:46.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.233+0000 7fa315516700 1 -- 172.21.15.50:0/1258365929 >> 172.21.15.50:0/1258365929 conn(0x7fa3100f1e40 msgr2=0x7fa3100f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:46.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.233+0000 7fa315516700 1 -- 172.21.15.50:0/1258365929 shutdown_connections 2023-01-04T18:23:46.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.233+0000 7fa315516700 1 -- 172.21.15.50:0/1258365929 wait complete. 2023-01-04T18:23:46.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.234+0000 7fa315516700 1 Processor -- start 2023-01-04T18:23:46.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.234+0000 7fa315516700 1 -- start start 2023-01-04T18:23:46.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.234+0000 7fa315516700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3100f66e0 0x7fa310106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:46.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.234+0000 7fa315516700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3100f7980 0x7fa310107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:46.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.234+0000 7fa315516700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa310107a20 con 0x7fa3100f66e0 2023-01-04T18:23:46.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.234+0000 7fa315516700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa310107b60 con 0x7fa3100f7980 2023-01-04T18:23:46.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.234+0000 7fa30effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3100f66e0 0x7fa310106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:46.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.234+0000 7fa30effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3100f66e0 0x7fa310106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42310/0 (socket says 172.21.15.50:42310) 2023-01-04T18:23:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.234+0000 7fa30effd700 1 -- 172.21.15.50:0/1524899497 learned_addr learned my addr 172.21.15.50:0/1524899497 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:23:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.234+0000 7fa30e7fc700 1 --2- 172.21.15.50:0/1524899497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3100f7980 0x7fa310107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.235+0000 7fa30effd700 1 -- 172.21.15.50:0/1524899497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3100f7980 msgr2=0x7fa310107470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.235+0000 7fa30effd700 1 --2- 172.21.15.50:0/1524899497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3100f7980 0x7fa310107470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.235+0000 7fa30effd700 1 -- 172.21.15.50:0/1524899497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa304005040 con 0x7fa3100f66e0 2023-01-04T18:23:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.235+0000 7fa30e7fc700 1 --2- 172.21.15.50:0/1524899497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3100f7980 0x7fa310107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-01-04T18:23:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.235+0000 7fa30effd700 1 --2- 172.21.15.50:0/1524899497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3100f66e0 0x7fa310106f80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fa300002700 tx=0x7fa300009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.235+0000 7fa2f77fe700 1 -- 172.21.15.50:0/1524899497 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3000079c0 con 0x7fa3100f66e0 2023-01-04T18:23:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.235+0000 7fa2f77fe700 1 -- 172.21.15.50:0/1524899497 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa30000f040 con 0x7fa3100f66e0 2023-01-04T18:23:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.235+0000 7fa315516700 1 -- 172.21.15.50:0/1524899497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa310108500 con 0x7fa3100f66e0 2023-01-04T18:23:46.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.235+0000 7fa2f77fe700 1 -- 172.21.15.50:0/1524899497 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3000148d0 con 0x7fa3100f66e0 2023-01-04T18:23:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.235+0000 7fa315516700 1 -- 172.21.15.50:0/1524899497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa310108ac0 con 0x7fa3100f66e0 2023-01-04T18:23:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.236+0000 7fa315516700 1 -- 172.21.15.50:0/1524899497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f0004fa0 con 0x7fa3100f66e0 2023-01-04T18:23:46.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.237+0000 7fa2f77fe700 1 -- 172.21.15.50:0/1524899497 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fa30001b060 con 0x7fa3100f66e0 2023-01-04T18:23:46.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.237+0000 7fa2f77fe700 1 --2- 172.21.15.50:0/1524899497 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa2f8060be0 0x7fa2f80630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:46.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.237+0000 7fa2f77fe700 1 -- 172.21.15.50:0/1524899497 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fa30007bbe0 con 0x7fa3100f66e0 2023-01-04T18:23:46.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.237+0000 7fa30e7fc700 1 --2- 172.21.15.50:0/1524899497 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa2f8060be0 0x7fa2f80630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:46.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.238+0000 7fa30e7fc700 1 --2- 172.21.15.50:0/1524899497 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa2f8060be0 0x7fa2f80630a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fa304009f50 tx=0x7fa304009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:46.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.241+0000 7fa2f77fe700 1 -- 172.21.15.50:0/1524899497 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fa30004fb30 con 0x7fa3100f66e0 2023-01-04T18:23:46.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.527+0000 7fa315516700 1 -- 172.21.15.50:0/1524899497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa2f0005e80 con 0x7fa3100f66e0 2023-01-04T18:23:46.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.527+0000 7fa2f77fe700 1 -- 172.21.15.50:0/1524899497 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+653 (secure 0 0 0) 0x7fa300018170 con 0x7fa3100f66e0 2023-01-04T18:23:46.531 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:23:46.531 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": { 2023-01-04T18:23:46.531 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:23:46.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:23:46.531 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": { 2023-01-04T18:23:46.531 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:23:46.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:23:46.531 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": { 2023-01-04T18:23:46.531 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 6 2023-01-04T18:23:46.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:23:46.532 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2023-01-04T18:23:46.532 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 4 2023-01-04T18:23:46.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:23:46.532 INFO:teuthology.orchestra.run.smithi050.stdout: "overall": { 2023-01-04T18:23:46.532 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 14 2023-01-04T18:23:46.532 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-01-04T18:23:46.532 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:23:46.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.529+0000 7fa315516700 1 -- 172.21.15.50:0/1524899497 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa2f8060be0 msgr2=0x7fa2f80630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:46.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.529+0000 7fa315516700 1 --2- 172.21.15.50:0/1524899497 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa2f8060be0 0x7fa2f80630a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fa304009f50 tx=0x7fa304009b30).stop 2023-01-04T18:23:46.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.529+0000 7fa315516700 1 -- 172.21.15.50:0/1524899497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3100f66e0 msgr2=0x7fa310106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:46.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.529+0000 7fa315516700 1 --2- 172.21.15.50:0/1524899497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3100f66e0 0x7fa310106f80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fa300002700 tx=0x7fa300009d80).stop 2023-01-04T18:23:46.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.529+0000 7fa315516700 1 -- 172.21.15.50:0/1524899497 shutdown_connections 2023-01-04T18:23:46.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.529+0000 7fa315516700 1 --2- 172.21.15.50:0/1524899497 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa2f8060be0 0x7fa2f80630a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:46.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.529+0000 7fa315516700 1 --2- 172.21.15.50:0/1524899497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3100f66e0 0x7fa310106f80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:46.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.529+0000 7fa315516700 1 --2- 172.21.15.50:0/1524899497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3100f7980 0x7fa310107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:46.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.529+0000 7fa315516700 1 -- 172.21.15.50:0/1524899497 >> 172.21.15.50:0/1524899497 conn(0x7fa3100f1e40 msgr2=0x7fa3100fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:46.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.529+0000 7fa315516700 1 -- 172.21.15.50:0/1524899497 shutdown_connections 2023-01-04T18:23:46.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.529+0000 7fa315516700 1 -- 172.21.15.50:0/1524899497 wait complete. 2023-01-04T18:23:46.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.633+0000 7f6c59eb2700 1 -- 172.21.15.50:0/1007959073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c540f55c0 msgr2=0x7f6c540f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:46.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.633+0000 7f6c59eb2700 1 --2- 172.21.15.50:0/1007959073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c540f55c0 0x7f6c540f59e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f6c44004660 tx=0x7f6c44009b30).stop 2023-01-04T18:23:46.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.633+0000 7f6c59eb2700 1 -- 172.21.15.50:0/1007959073 shutdown_connections 2023-01-04T18:23:46.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.633+0000 7f6c59eb2700 1 --2- 172.21.15.50:0/1007959073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c540f6860 0x7f6c540f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:46.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.633+0000 7f6c59eb2700 1 --2- 172.21.15.50:0/1007959073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c540f55c0 0x7f6c540f59e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:46.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.633+0000 7f6c59eb2700 1 -- 172.21.15.50:0/1007959073 >> 172.21.15.50:0/1007959073 conn(0x7f6c540f0d40 msgr2=0x7f6c540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:46.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.633+0000 7f6c59eb2700 1 -- 172.21.15.50:0/1007959073 shutdown_connections 2023-01-04T18:23:46.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.633+0000 7f6c59eb2700 1 -- 172.21.15.50:0/1007959073 wait complete. 2023-01-04T18:23:46.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.633+0000 7f6c59eb2700 1 Processor -- start 2023-01-04T18:23:46.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.633+0000 7f6c59eb2700 1 -- start start 2023-01-04T18:23:46.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.634+0000 7f6c59eb2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c540f55c0 0x7f6c54106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:46.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.634+0000 7f6c59eb2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c540f6860 0x7f6c54107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:46.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.634+0000 7f6c59eb2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54107a30 con 0x7f6c540f6860 2023-01-04T18:23:46.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.634+0000 7f6c59eb2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54107b70 con 0x7f6c540f55c0 2023-01-04T18:23:46.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.634+0000 7f6c52ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c540f6860 0x7f6c54107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:46.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.634+0000 7f6c52ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c540f6860 0x7f6c54107480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56382/0 (socket says 172.21.15.50:56382) 2023-01-04T18:23:46.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.634+0000 7f6c52ffd700 1 -- 172.21.15.50:0/1149113146 learned_addr learned my addr 172.21.15.50:0/1149113146 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:23:46.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.634+0000 7f6c537fe700 1 --2- 172.21.15.50:0/1149113146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c540f55c0 0x7f6c54106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:46.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.634+0000 7f6c52ffd700 1 -- 172.21.15.50:0/1149113146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c540f55c0 msgr2=0x7f6c54106f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:46.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.634+0000 7f6c52ffd700 1 --2- 172.21.15.50:0/1149113146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c540f55c0 0x7f6c54106f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:46.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.634+0000 7f6c52ffd700 1 -- 172.21.15.50:0/1149113146 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c44005040 con 0x7f6c540f6860 2023-01-04T18:23:46.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.634+0000 7f6c52ffd700 1 --2- 172.21.15.50:0/1149113146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c540f6860 0x7f6c54107480 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f6c4800c530 tx=0x7f6c48007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:46.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.634+0000 7f6c3bfff700 1 -- 172.21.15.50:0/1149113146 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c4800f650 con 0x7f6c540f6860 2023-01-04T18:23:46.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.635+0000 7f6c3bfff700 1 -- 172.21.15.50:0/1149113146 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6c4800fc70 con 0x7f6c540f6860 2023-01-04T18:23:46.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.635+0000 7f6c59eb2700 1 -- 172.21.15.50:0/1149113146 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c54108510 con 0x7f6c540f6860 2023-01-04T18:23:46.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.635+0000 7f6c3bfff700 1 -- 172.21.15.50:0/1149113146 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c48012db0 con 0x7f6c540f6860 2023-01-04T18:23:46.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.635+0000 7f6c59eb2700 1 -- 172.21.15.50:0/1149113146 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c54108ad0 con 0x7f6c540f6860 2023-01-04T18:23:46.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.636+0000 7f6c59eb2700 1 -- 172.21.15.50:0/1149113146 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c54045ad0 con 0x7f6c540f6860 2023-01-04T18:23:46.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.636+0000 7f6c3bfff700 1 -- 172.21.15.50:0/1149113146 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f6c48010070 con 0x7f6c540f6860 2023-01-04T18:23:46.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.636+0000 7f6c3bfff700 1 --2- 172.21.15.50:0/1149113146 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6c3c060be0 0x7f6c3c0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:46.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.637+0000 7f6c3bfff700 1 -- 172.21.15.50:0/1149113146 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f6c4807bb40 con 0x7f6c540f6860 2023-01-04T18:23:46.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.637+0000 7f6c537fe700 1 --2- 172.21.15.50:0/1149113146 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6c3c060be0 0x7f6c3c0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:46.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.637+0000 7f6c537fe700 1 --2- 172.21.15.50:0/1149113146 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6c3c060be0 0x7f6c3c0630a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f6c44009490 tx=0x7f6c44009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:46.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.645+0000 7f6c3bfff700 1 -- 172.21.15.50:0/1149113146 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f6c48047c30 con 0x7f6c540f6860 2023-01-04T18:23:46.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:44.688249+0000 mgr.smithi050.emnywo (mgr.24517) 332 : cluster [DBG] pgmap v244: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 21 MiB/s rd, 170 B/s wr, 10 op/s 2023-01-04T18:23:46.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:45.294064+0000 mgr.smithi050.emnywo (mgr.24517) 333 : audit [DBG] from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:23:46.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:44.688249+0000 mgr.smithi050.emnywo (mgr.24517) 332 : cluster [DBG] pgmap v244: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 21 MiB/s rd, 170 B/s wr, 10 op/s 2023-01-04T18:23:46.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:45.294064+0000 mgr.smithi050.emnywo (mgr.24517) 333 : audit [DBG] from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:23:46.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.862+0000 7f6c59eb2700 1 -- 172.21.15.50:0/1149113146 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6c54109110 con 0x7f6c540f6860 2023-01-04T18:23:46.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.862+0000 7f6c3bfff700 1 -- 172.21.15.50:0/1149113146 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1791 (secure 0 0 0) 0x7f6c4804fa90 con 0x7f6c540f6860 2023-01-04T18:23:46.866 INFO:teuthology.orchestra.run.smithi050.stdout:e36 2023-01-04T18:23:46.866 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:23:46.866 INFO:teuthology.orchestra.run.smithi050.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:23:46.866 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-01-04T18:23:46.866 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:23:46.866 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-01-04T18:23:46.866 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-01-04T18:23:46.866 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 36 2023-01-04T18:23:46.866 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 2023-01-04T18:23:46.867 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:23:46.867 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-01-04T18:23:41.431715+0000 2023-01-04T18:23:46.867 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-01-04T18:23:46.867 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-01-04T18:23:46.867 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 60 2023-01-04T18:23:46.867 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-01-04T18:23:46.867 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-01-04T18:23:46.867 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-01-04T18:23:46.867 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-01-04T18:23:46.867 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 95 2023-01-04T18:23:46.867 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:23:46.867 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 1 2023-01-04T18:23:46.868 INFO:teuthology.orchestra.run.smithi050.stdout:in 0 2023-01-04T18:23:46.868 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=34362} 2023-01-04T18:23:46.868 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-01-04T18:23:46.868 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-01-04T18:23:46.868 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-01-04T18:23:46.868 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-01-04T18:23:46.868 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-01-04T18:23:46.868 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data enabled 2023-01-04T18:23:46.868 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-01-04T18:23:46.868 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 1 2023-01-04T18:23:46.868 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.ezoiwl{0:34362} state up:active seq 17 join_fscid=1 addr [v2:172.21.15.50:6826/336562041,v1:172.21.15.50:6827/336562041] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:23:46.869 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.kefmuy{0:34366} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.50:6828/2188030488,v1:172.21.15.50:6829/2188030488] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:23:46.869 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:23:46.869 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:23:46.869 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2023-01-04T18:23:46.869 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:23:46.869 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.memais{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.98:6824/4224872601,v1:172.21.15.98:6825/4224872601] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:23:46.869 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.laynsk{-1:44317} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.98:6826/503298078,v1:172.21.15.98:6827/503298078] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:23:46.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.864+0000 7f6c59eb2700 1 -- 172.21.15.50:0/1149113146 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6c3c060be0 msgr2=0x7f6c3c0630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:46.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.864+0000 7f6c59eb2700 1 --2- 172.21.15.50:0/1149113146 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6c3c060be0 0x7f6c3c0630a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f6c44009490 tx=0x7f6c44009b30).stop 2023-01-04T18:23:46.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.864+0000 7f6c59eb2700 1 -- 172.21.15.50:0/1149113146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c540f6860 msgr2=0x7f6c54107480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:46.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.864+0000 7f6c59eb2700 1 --2- 172.21.15.50:0/1149113146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c540f6860 0x7f6c54107480 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f6c4800c530 tx=0x7f6c48007e20).stop 2023-01-04T18:23:46.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.864+0000 7f6c59eb2700 1 -- 172.21.15.50:0/1149113146 shutdown_connections 2023-01-04T18:23:46.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.864+0000 7f6c59eb2700 1 --2- 172.21.15.50:0/1149113146 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6c3c060be0 0x7f6c3c0630a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:46.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.864+0000 7f6c59eb2700 1 --2- 172.21.15.50:0/1149113146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c540f55c0 0x7f6c54106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:46.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.864+0000 7f6c59eb2700 1 --2- 172.21.15.50:0/1149113146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c540f6860 0x7f6c54107480 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.864+0000 7f6c59eb2700 1 -- 172.21.15.50:0/1149113146 >> 172.21.15.50:0/1149113146 conn(0x7f6c540f0d40 msgr2=0x7f6c5405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.864+0000 7f6c59eb2700 1 -- 172.21.15.50:0/1149113146 shutdown_connections 2023-01-04T18:23:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.864+0000 7f6c59eb2700 1 -- 172.21.15.50:0/1149113146 wait complete. 2023-01-04T18:23:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 36 2023-01-04T18:23:46.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.971+0000 7f1d3202b700 1 -- 172.21.15.50:0/2848868806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c0602b0 msgr2=0x7f1d2c0fb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:46.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.971+0000 7f1d3202b700 1 --2- 172.21.15.50:0/2848868806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c0602b0 0x7f1d2c0fb570 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f1d28004660 tx=0x7f1d28009b30).stop 2023-01-04T18:23:46.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.971+0000 7f1d3202b700 1 -- 172.21.15.50:0/2848868806 shutdown_connections 2023-01-04T18:23:46.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.971+0000 7f1d3202b700 1 --2- 172.21.15.50:0/2848868806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d2c0fba60 0x7f1d2c0fde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:46.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.971+0000 7f1d3202b700 1 --2- 172.21.15.50:0/2848868806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c0602b0 0x7f1d2c0fb570 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:46.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.971+0000 7f1d3202b700 1 -- 172.21.15.50:0/2848868806 >> 172.21.15.50:0/2848868806 conn(0x7f1d2c0f0b90 msgr2=0x7f1d2c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:46.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.971+0000 7f1d3202b700 1 -- 172.21.15.50:0/2848868806 shutdown_connections 2023-01-04T18:23:46.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.971+0000 7f1d3202b700 1 -- 172.21.15.50:0/2848868806 wait complete. 2023-01-04T18:23:46.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.972+0000 7f1d3202b700 1 Processor -- start 2023-01-04T18:23:46.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.972+0000 7f1d3202b700 1 -- start start 2023-01-04T18:23:46.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.972+0000 7f1d3202b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c0602b0 0x7f1d2c108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:46.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.972+0000 7f1d3202b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d2c0fba60 0x7f1d2c1093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:46.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.972+0000 7f1d3202b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c1099a0 con 0x7f1d2c0602b0 2023-01-04T18:23:46.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.972+0000 7f1d3202b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c109ae0 con 0x7f1d2c0fba60 2023-01-04T18:23:46.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.972+0000 7f1d31029700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c0602b0 0x7f1d2c108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:46.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.972+0000 7f1d31029700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c0602b0 0x7f1d2c108f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56404/0 (socket says 172.21.15.50:56404) 2023-01-04T18:23:46.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.972+0000 7f1d31029700 1 -- 172.21.15.50:0/3254248789 learned_addr learned my addr 172.21.15.50:0/3254248789 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:23:46.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.972+0000 7f1d30828700 1 --2- 172.21.15.50:0/3254248789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d2c0fba60 0x7f1d2c1093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:46.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.972+0000 7f1d31029700 1 -- 172.21.15.50:0/3254248789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d2c0fba60 msgr2=0x7f1d2c1093f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:46.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.972+0000 7f1d31029700 1 --2- 172.21.15.50:0/3254248789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d2c0fba60 0x7f1d2c1093f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:46.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.972+0000 7f1d31029700 1 -- 172.21.15.50:0/3254248789 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d28005040 con 0x7f1d2c0602b0 2023-01-04T18:23:46.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.972+0000 7f1d30828700 1 --2- 172.21.15.50:0/3254248789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d2c0fba60 0x7f1d2c1093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:23:46.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.972+0000 7f1d31029700 1 --2- 172.21.15.50:0/3254248789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c0602b0 0x7f1d2c108f00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f1d28004d80 tx=0x7f1d2800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:46.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.973+0000 7f1d21ffb700 1 -- 172.21.15.50:0/3254248789 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d28019070 con 0x7f1d2c0602b0 2023-01-04T18:23:46.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.973+0000 7f1d21ffb700 1 -- 172.21.15.50:0/3254248789 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1d2801e420 con 0x7f1d2c0602b0 2023-01-04T18:23:46.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.973+0000 7f1d3202b700 1 -- 172.21.15.50:0/3254248789 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2c10a420 con 0x7f1d2c0602b0 2023-01-04T18:23:46.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.973+0000 7f1d21ffb700 1 -- 172.21.15.50:0/3254248789 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d28014680 con 0x7f1d2c0602b0 2023-01-04T18:23:46.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.973+0000 7f1d3202b700 1 -- 172.21.15.50:0/3254248789 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2c10a900 con 0x7f1d2c0602b0 2023-01-04T18:23:46.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.974+0000 7f1d3202b700 1 -- 172.21.15.50:0/3254248789 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2c045ad0 con 0x7f1d2c0602b0 2023-01-04T18:23:46.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.975+0000 7f1d21ffb700 1 -- 172.21.15.50:0/3254248789 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f1d2801e9c0 con 0x7f1d2c0602b0 2023-01-04T18:23:46.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.975+0000 7f1d21ffb700 1 --2- 172.21.15.50:0/3254248789 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1d18060c30 0x7f1d180630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:23:46.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.975+0000 7f1d21ffb700 1 -- 172.21.15.50:0/3254248789 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f1d2807d250 con 0x7f1d2c0602b0 2023-01-04T18:23:46.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.975+0000 7f1d30828700 1 --2- 172.21.15.50:0/3254248789 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1d18060c30 0x7f1d180630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:23:46.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.976+0000 7f1d30828700 1 --2- 172.21.15.50:0/3254248789 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1d18060c30 0x7f1d180630f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f1d2c060080 tx=0x7f1d1c00b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:23:46.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:46.979+0000 7f1d21ffb700 1 -- 172.21.15.50:0/3254248789 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f1d28051220 con 0x7f1d2c0602b0 2023-01-04T18:23:47.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:47.171+0000 7f1d3202b700 1 -- 172.21.15.50:0/3254248789 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d2c100ff0 con 0x7f1d18060c30 2023-01-04T18:23:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:47.172+0000 7f1d21ffb700 1 -- 172.21.15.50:0/3254248789 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f1d2c100ff0 con 0x7f1d18060c30 2023-01-04T18:23:47.175 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:23:47.176 INFO:teuthology.orchestra.run.smithi050.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308", 2023-01-04T18:23:47.176 INFO:teuthology.orchestra.run.smithi050.stdout: "in_progress": true, 2023-01-04T18:23:47.176 INFO:teuthology.orchestra.run.smithi050.stdout: "which": "Upgrading all daemon types on all hosts", 2023-01-04T18:23:47.176 INFO:teuthology.orchestra.run.smithi050.stdout: "services_complete": [ 2023-01-04T18:23:47.176 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr", 2023-01-04T18:23:47.176 INFO:teuthology.orchestra.run.smithi050.stdout: "mon", 2023-01-04T18:23:47.176 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2023-01-04T18:23:47.176 INFO:teuthology.orchestra.run.smithi050.stdout: "osd", 2023-01-04T18:23:47.176 INFO:teuthology.orchestra.run.smithi050.stdout: "mds" 2023-01-04T18:23:47.176 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-01-04T18:23:47.176 INFO:teuthology.orchestra.run.smithi050.stdout: "progress": "16/21 daemons upgraded", 2023-01-04T18:23:47.177 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "Currently upgrading node-exporter daemons", 2023-01-04T18:23:47.177 INFO:teuthology.orchestra.run.smithi050.stdout: "is_paused": false 2023-01-04T18:23:47.177 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:23:47.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:47.174+0000 7f1d3202b700 1 -- 172.21.15.50:0/3254248789 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1d18060c30 msgr2=0x7f1d180630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:47.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:47.174+0000 7f1d3202b700 1 --2- 172.21.15.50:0/3254248789 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1d18060c30 0x7f1d180630f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f1d2c060080 tx=0x7f1d1c00b040).stop 2023-01-04T18:23:47.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:47.174+0000 7f1d3202b700 1 -- 172.21.15.50:0/3254248789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c0602b0 msgr2=0x7f1d2c108f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:23:47.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:47.174+0000 7f1d3202b700 1 --2- 172.21.15.50:0/3254248789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c0602b0 0x7f1d2c108f00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f1d28004d80 tx=0x7f1d2800b040).stop 2023-01-04T18:23:47.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:47.174+0000 7f1d3202b700 1 -- 172.21.15.50:0/3254248789 shutdown_connections 2023-01-04T18:23:47.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:47.174+0000 7f1d3202b700 1 --2- 172.21.15.50:0/3254248789 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1d18060c30 0x7f1d180630f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:47.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:47.174+0000 7f1d3202b700 1 --2- 172.21.15.50:0/3254248789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c0602b0 0x7f1d2c108f00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:47.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:47.174+0000 7f1d3202b700 1 --2- 172.21.15.50:0/3254248789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d2c0fba60 0x7f1d2c1093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:23:47.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:47.174+0000 7f1d3202b700 1 -- 172.21.15.50:0/3254248789 >> 172.21.15.50:0/3254248789 conn(0x7f1d2c0f0b90 msgr2=0x7f1d2c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:23:47.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:47.174+0000 7f1d3202b700 1 -- 172.21.15.50:0/3254248789 shutdown_connections 2023-01-04T18:23:47.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:23:47.174+0000 7f1d3202b700 1 -- 172.21.15.50:0/3254248789 wait complete. 2023-01-04T18:23:47.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:45.723855+0000 mgr.smithi050.emnywo (mgr.24517) 334 : audit [DBG] from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:23:47.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:46.083371+0000 mgr.smithi050.emnywo (mgr.24517) 335 : audit [DBG] from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:23:47.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:46.528653+0000 mon.smithi050 (mon.0) 661 : audit [DBG] from='client.? 172.21.15.50:0/1524899497' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:47.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:46.863682+0000 mon.smithi050 (mon.0) 662 : audit [DBG] from='client.? 172.21.15.50:0/1149113146' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:23:47.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:47 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:45.723855+0000 mgr.smithi050.emnywo (mgr.24517) 334 : audit [DBG] from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:23:47.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:47 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:46.083371+0000 mgr.smithi050.emnywo (mgr.24517) 335 : audit [DBG] from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:23:47.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:47 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:46.528653+0000 mon.smithi050 (mon.0) 661 : audit [DBG] from='client.? 172.21.15.50:0/1524899497' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:23:47.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:47 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:46.863682+0000 mon.smithi050 (mon.0) 662 : audit [DBG] from='client.? 172.21.15.50:0/1149113146' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:23:48.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:46.688670+0000 mgr.smithi050.emnywo (mgr.24517) 336 : cluster [DBG] pgmap v245: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 7 op/s 2023-01-04T18:23:48.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:47.173321+0000 mgr.smithi050.emnywo (mgr.24517) 337 : audit [DBG] from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:23:48.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:46.688670+0000 mgr.smithi050.emnywo (mgr.24517) 336 : cluster [DBG] pgmap v245: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 7 op/s 2023-01-04T18:23:48.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:47.173321+0000 mgr.smithi050.emnywo (mgr.24517) 337 : audit [DBG] from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:23:50.702 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:48.689072+0000 mgr.smithi050.emnywo (mgr.24517) 338 : cluster [DBG] pgmap v246: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 7 op/s 2023-01-04T18:23:50.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:48.689072+0000 mgr.smithi050.emnywo (mgr.24517) 338 : cluster [DBG] pgmap v246: 65 pgs: 65 active+clean; 194 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 7 op/s 2023-01-04T18:23:52.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:50.689531+0000 mgr.smithi050.emnywo (mgr.24517) 339 : cluster [DBG] pgmap v247: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 4.3 KiB/s wr, 10 op/s 2023-01-04T18:23:52.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:51.018132+0000 mon.smithi050 (mon.0) 663 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:52.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:50.689531+0000 mgr.smithi050.emnywo (mgr.24517) 339 : cluster [DBG] pgmap v247: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 4.3 KiB/s wr, 10 op/s 2023-01-04T18:23:52.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:51.018132+0000 mon.smithi050 (mon.0) 663 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:53.535 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:23:52.501838+0000 mgr.smithi050.emnywo (mgr.24517) 340 : cephadm [INF] Upgrade: Updating node-exporter.smithi098 (2/2) 2023-01-04T18:23:53.535 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:23:52.502030+0000 mgr.smithi050.emnywo (mgr.24517) 341 : cephadm [INF] Deploying daemon node-exporter.smithi098 on smithi098 2023-01-04T18:23:53.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:23:52.501838+0000 mgr.smithi050.emnywo (mgr.24517) 340 : cephadm [INF] Upgrade: Updating node-exporter.smithi098 (2/2) 2023-01-04T18:23:53.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:23:52.502030+0000 mgr.smithi050.emnywo (mgr.24517) 341 : cephadm [INF] Deploying daemon node-exporter.smithi098 on smithi098 2023-01-04T18:23:54.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:52.690039+0000 mgr.smithi050.emnywo (mgr.24517) 342 : cluster [DBG] pgmap v248: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.3 KiB/s wr, 9 op/s 2023-01-04T18:23:54.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:52.690039+0000 mgr.smithi050.emnywo (mgr.24517) 342 : cluster [DBG] pgmap v248: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.3 KiB/s wr, 9 op/s 2023-01-04T18:23:56.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:54.690600+0000 mgr.smithi050.emnywo (mgr.24517) 343 : cluster [DBG] pgmap v249: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.3 KiB/s wr, 9 op/s 2023-01-04T18:23:56.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:55 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:54.850131+0000 mon.smithi050 (mon.0) 664 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:56.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:54.690600+0000 mgr.smithi050.emnywo (mgr.24517) 343 : cluster [DBG] pgmap v249: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.3 KiB/s wr, 9 op/s 2023-01-04T18:23:56.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:54.850131+0000 mon.smithi050 (mon.0) 664 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:58.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:56.691151+0000 mgr.smithi050.emnywo (mgr.24517) 344 : cluster [DBG] pgmap v250: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 9.2 MiB/s rd, 4.2 KiB/s wr, 4 op/s 2023-01-04T18:23:58.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:56.959790+0000 mon.smithi050 (mon.0) 665 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:58.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:56.960642+0000 mon.smithi050 (mon.0) 666 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:23:58.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:56.962032+0000 mon.smithi050 (mon.0) 667 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:23:58.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:56.962958+0000 mon.smithi050 (mon.0) 668 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:23:58.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:57 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:23:56.963708+0000 mgr.smithi050.emnywo (mgr.24517) 345 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:23:58.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:56.691151+0000 mgr.smithi050.emnywo (mgr.24517) 344 : cluster [DBG] pgmap v250: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 9.2 MiB/s rd, 4.2 KiB/s wr, 4 op/s 2023-01-04T18:23:58.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:56.959790+0000 mon.smithi050 (mon.0) 665 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:23:58.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:56.960642+0000 mon.smithi050 (mon.0) 666 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:23:58.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:56.962032+0000 mon.smithi050 (mon.0) 667 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:23:58.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:56.962958+0000 mon.smithi050 (mon.0) 668 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:23:58.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:57 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:23:56.963708+0000 mgr.smithi050.emnywo (mgr.24517) 345 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:24:00.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:23:59 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:23:58.691535+0000 mgr.smithi050.emnywo (mgr.24517) 346 : cluster [DBG] pgmap v251: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 6.9 MiB/s rd, 4.2 KiB/s wr, 4 op/s 2023-01-04T18:24:00.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:23:59 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:23:58.691535+0000 mgr.smithi050.emnywo (mgr.24517) 346 : cluster [DBG] pgmap v251: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 6.9 MiB/s rd, 4.2 KiB/s wr, 4 op/s 2023-01-04T18:24:01.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:23:59.968365+0000 mon.smithi050 (mon.0) 669 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:01.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:23:59.968365+0000 mon.smithi050 (mon.0) 669 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:02.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:01 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:00.691960+0000 mgr.smithi050.emnywo (mgr.24517) 347 : cluster [DBG] pgmap v252: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 6.6 MiB/s rd, 4.2 KiB/s wr, 4 op/s 2023-01-04T18:24:02.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:01 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:00.691960+0000 mgr.smithi050.emnywo (mgr.24517) 347 : cluster [DBG] pgmap v252: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 6.6 MiB/s rd, 4.2 KiB/s wr, 4 op/s 2023-01-04T18:24:03.296 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:02.114136+0000 mon.smithi050 (mon.0) 670 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:03.297 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:02.117282+0000 mon.smithi050 (mon.0) 671 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:03.297 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:02.122137+0000 mon.smithi050 (mon.0) 672 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:24:03.297 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:02.124301+0000 mon.smithi050 (mon.0) 673 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:03.297 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:02.125428+0000 mon.smithi050 (mon.0) 674 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:03.297 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:02.126490+0000 mon.smithi050 (mon.0) 675 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:03.297 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:02.127833+0000 mon.smithi050 (mon.0) 676 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:03.297 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:02.129398+0000 mon.smithi050 (mon.0) 677 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:03.297 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:02.130253+0000 mon.smithi050 (mon.0) 678 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:03.297 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:02.131130+0000 mon.smithi050 (mon.0) 679 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:03.298 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:02.132000+0000 mon.smithi050 (mon.0) 680 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:03.298 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:02.132847+0000 mon.smithi050 (mon.0) 681 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:03.298 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:02.133718+0000 mon.smithi050 (mon.0) 682 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:03.298 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:02.134913+0000 mon.smithi050 (mon.0) 683 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:03.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:02.114136+0000 mon.smithi050 (mon.0) 670 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:03.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:02.117282+0000 mon.smithi050 (mon.0) 671 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:03.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:02.122137+0000 mon.smithi050 (mon.0) 672 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:24:03.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:02.124301+0000 mon.smithi050 (mon.0) 673 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:03.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:02.125428+0000 mon.smithi050 (mon.0) 674 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:03.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:02.126490+0000 mon.smithi050 (mon.0) 675 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:03.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:02.127833+0000 mon.smithi050 (mon.0) 676 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:03.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:02.129398+0000 mon.smithi050 (mon.0) 677 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:03.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:02.130253+0000 mon.smithi050 (mon.0) 678 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:03.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:02.131130+0000 mon.smithi050 (mon.0) 679 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:03.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:02.132000+0000 mon.smithi050 (mon.0) 680 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:03.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:02.132847+0000 mon.smithi050 (mon.0) 681 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:03.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:02.133718+0000 mon.smithi050 (mon.0) 682 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:03.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:02.134913+0000 mon.smithi050 (mon.0) 683 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:04.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:02.692483+0000 mgr.smithi050.emnywo (mgr.24517) 348 : cluster [DBG] pgmap v253: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 686 KiB/s rd, 1 op/s 2023-01-04T18:24:04.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:24:03.418729+0000 mgr.smithi050.emnywo (mgr.24517) 349 : cephadm [INF] Upgrade: Updating prometheus.smithi050 2023-01-04T18:24:04.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:24:03.429561+0000 mgr.smithi050.emnywo (mgr.24517) 350 : cephadm [INF] Deploying daemon prometheus.smithi050 on smithi050 2023-01-04T18:24:04.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:02.692483+0000 mgr.smithi050.emnywo (mgr.24517) 348 : cluster [DBG] pgmap v253: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 686 KiB/s rd, 1 op/s 2023-01-04T18:24:04.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:24:03.418729+0000 mgr.smithi050.emnywo (mgr.24517) 349 : cephadm [INF] Upgrade: Updating prometheus.smithi050 2023-01-04T18:24:04.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:24:03.429561+0000 mgr.smithi050.emnywo (mgr.24517) 350 : cephadm [INF] Deploying daemon prometheus.smithi050 on smithi050 2023-01-04T18:24:06.278 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:04.692944+0000 mgr.smithi050.emnywo (mgr.24517) 351 : cluster [DBG] pgmap v254: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 4.0 KiB/s rd, 2 op/s 2023-01-04T18:24:06.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:04.692944+0000 mgr.smithi050.emnywo (mgr.24517) 351 : cluster [DBG] pgmap v254: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 4.0 KiB/s rd, 2 op/s 2023-01-04T18:24:08.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:06.693405+0000 mgr.smithi050.emnywo (mgr.24517) 352 : cluster [DBG] pgmap v255: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:08.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:06.693405+0000 mgr.smithi050.emnywo (mgr.24517) 352 : cluster [DBG] pgmap v255: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:10.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:08.693923+0000 mgr.smithi050.emnywo (mgr.24517) 353 : cluster [DBG] pgmap v256: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:10.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:08.693923+0000 mgr.smithi050.emnywo (mgr.24517) 353 : cluster [DBG] pgmap v256: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:11.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:10.242681+0000 mon.smithi050 (mon.0) 684 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:11.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:10.243437+0000 mon.smithi050 (mon.0) 685 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:24:11.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:10.244512+0000 mon.smithi050 (mon.0) 686 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:24:11.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:10.245116+0000 mon.smithi050 (mon.0) 687 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:24:11.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:24:10.245699+0000 mgr.smithi050.emnywo (mgr.24517) 354 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:24:11.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:10.242681+0000 mon.smithi050 (mon.0) 684 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:11.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:10.243437+0000 mon.smithi050 (mon.0) 685 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:24:11.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:10.244512+0000 mon.smithi050 (mon.0) 686 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:24:11.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:10.245116+0000 mon.smithi050 (mon.0) 687 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:24:11.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:24:10.245699+0000 mgr.smithi050.emnywo (mgr.24517) 354 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:24:12.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:10.694322+0000 mgr.smithi050.emnywo (mgr.24517) 355 : cluster [DBG] pgmap v257: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:24:12.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:10.694322+0000 mgr.smithi050.emnywo (mgr.24517) 355 : cluster [DBG] pgmap v257: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:24:14.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:12.694686+0000 mgr.smithi050.emnywo (mgr.24517) 356 : cluster [DBG] pgmap v258: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:14.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:12.694686+0000 mgr.smithi050.emnywo (mgr.24517) 356 : cluster [DBG] pgmap v258: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:16.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:14.695093+0000 mgr.smithi050.emnywo (mgr.24517) 357 : cluster [DBG] pgmap v259: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:24:16.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:15.006425+0000 mon.smithi050 (mon.0) 688 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:16.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:15.009786+0000 mon.smithi050 (mon.0) 689 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:16.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:15.015947+0000 mon.smithi050 (mon.0) 690 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-01-04T18:24:16.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:15.016335+0000 mgr.smithi050.emnywo (mgr.24517) 358 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-01-04T18:24:16.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:15.017691+0000 mon.smithi050 (mon.0) 691 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:24:16.291 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:15.019797+0000 mon.smithi050 (mon.0) 692 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:15.020894+0000 mon.smithi050 (mon.0) 693 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:15.021923+0000 mon.smithi050 (mon.0) 694 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:15.023281+0000 mon.smithi050 (mon.0) 695 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:15.024887+0000 mon.smithi050 (mon.0) 696 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:15.025798+0000 mon.smithi050 (mon.0) 697 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:15.027234+0000 mon.smithi050 (mon.0) 698 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:15.028139+0000 mon.smithi050 (mon.0) 699 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:15.029005+0000 mon.smithi050 (mon.0) 700 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:15.029860+0000 mon.smithi050 (mon.0) 701 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:15.031059+0000 mon.smithi050 (mon.0) 702 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:15.032106+0000 mon.smithi050 (mon.0) 703 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:14.695093+0000 mgr.smithi050.emnywo (mgr.24517) 357 : cluster [DBG] pgmap v259: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:24:16.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:15.006425+0000 mon.smithi050 (mon.0) 688 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:16.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:15.009786+0000 mon.smithi050 (mon.0) 689 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:16.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:15.015947+0000 mon.smithi050 (mon.0) 690 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-01-04T18:24:16.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:15.016335+0000 mgr.smithi050.emnywo (mgr.24517) 358 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-01-04T18:24:16.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:15.017691+0000 mon.smithi050 (mon.0) 691 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:24:16.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:15.019797+0000 mon.smithi050 (mon.0) 692 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:15.020894+0000 mon.smithi050 (mon.0) 693 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:15.021923+0000 mon.smithi050 (mon.0) 694 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:15.023281+0000 mon.smithi050 (mon.0) 695 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:15.024887+0000 mon.smithi050 (mon.0) 696 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:15.025798+0000 mon.smithi050 (mon.0) 697 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:15.027234+0000 mon.smithi050 (mon.0) 698 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:15.028139+0000 mon.smithi050 (mon.0) 699 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:15.029005+0000 mon.smithi050 (mon.0) 700 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:15.029860+0000 mon.smithi050 (mon.0) 701 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:15.031059+0000 mon.smithi050 (mon.0) 702 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:16.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:15.032106+0000 mon.smithi050 (mon.0) 703 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:17.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.280+0000 7f2fff5a2700 1 -- 172.21.15.50:0/1383281159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ff80f6860 msgr2=0x7f2ff80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:17.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.280+0000 7f2fff5a2700 1 --2- 172.21.15.50:0/1383281159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ff80f6860 0x7f2ff80f6cc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f2fec004660 tx=0x7f2fec009b30).stop 2023-01-04T18:24:17.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.281+0000 7f2fff5a2700 1 -- 172.21.15.50:0/1383281159 shutdown_connections 2023-01-04T18:24:17.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.281+0000 7f2fff5a2700 1 --2- 172.21.15.50:0/1383281159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ff80f6860 0x7f2ff80f6cc0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:17.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.281+0000 7f2fff5a2700 1 --2- 172.21.15.50:0/1383281159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ff80f55c0 0x7f2ff80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:17.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.281+0000 7f2fff5a2700 1 -- 172.21.15.50:0/1383281159 >> 172.21.15.50:0/1383281159 conn(0x7f2ff80f0d40 msgr2=0x7f2ff80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:17.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.281+0000 7f2fff5a2700 1 -- 172.21.15.50:0/1383281159 shutdown_connections 2023-01-04T18:24:17.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.281+0000 7f2fff5a2700 1 -- 172.21.15.50:0/1383281159 wait complete. 2023-01-04T18:24:17.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.281+0000 7f2fff5a2700 1 Processor -- start 2023-01-04T18:24:17.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.281+0000 7f2fff5a2700 1 -- start start 2023-01-04T18:24:17.352 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:17 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:24:16.418593+0000 mgr.smithi050.emnywo (mgr.24517) 359 : cephadm [INF] Upgrade: Updating alertmanager.smithi050 2023-01-04T18:24:17.352 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:17 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:24:16.424326+0000 mgr.smithi050.emnywo (mgr.24517) 360 : cephadm [INF] Deploying daemon alertmanager.smithi050 on smithi050 2023-01-04T18:24:17.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.282+0000 7f2fff5a2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ff80f55c0 0x7f2ff8109b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:17.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.282+0000 7f2fff5a2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ff80f6860 0x7f2ff810c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:17.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.282+0000 7f2fff5a2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff8060420 con 0x7f2ff80f55c0 2023-01-04T18:24:17.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.282+0000 7f2fff5a2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff8060560 con 0x7f2ff80f6860 2023-01-04T18:24:17.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.282+0000 7f2ffd33e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ff80f55c0 0x7f2ff8109b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:17.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.282+0000 7f2ffd33e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ff80f55c0 0x7f2ff8109b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37460/0 (socket says 172.21.15.50:37460) 2023-01-04T18:24:17.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.282+0000 7f2ffd33e700 1 -- 172.21.15.50:0/3691007957 learned_addr learned my addr 172.21.15.50:0/3691007957 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:24:17.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.282+0000 7f2ffcb3d700 1 --2- 172.21.15.50:0/3691007957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ff80f6860 0x7f2ff810c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:17.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.282+0000 7f2ffd33e700 1 -- 172.21.15.50:0/3691007957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ff80f6860 msgr2=0x7f2ff810c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:17.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.282+0000 7f2ffd33e700 1 --2- 172.21.15.50:0/3691007957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ff80f6860 0x7f2ff810c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:17.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.282+0000 7f2ffd33e700 1 -- 172.21.15.50:0/3691007957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec005040 con 0x7f2ff80f55c0 2023-01-04T18:24:17.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.282+0000 7f2ffd33e700 1 --2- 172.21.15.50:0/3691007957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ff80f55c0 0x7f2ff8109b80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f2ff400e7c0 tx=0x7f2ff400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:17.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.283+0000 7f2fe9ffb700 1 -- 172.21.15.50:0/3691007957 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ff40092e0 con 0x7f2ff80f55c0 2023-01-04T18:24:17.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.283+0000 7f2fe9ffb700 1 -- 172.21.15.50:0/3691007957 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2ff400f040 con 0x7f2ff80f55c0 2023-01-04T18:24:17.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.283+0000 7f2fff5a2700 1 -- 172.21.15.50:0/3691007957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff810c690 con 0x7f2ff80f55c0 2023-01-04T18:24:17.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.283+0000 7f2fe9ffb700 1 -- 172.21.15.50:0/3691007957 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ff40147e0 con 0x7f2ff80f55c0 2023-01-04T18:24:17.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.283+0000 7f2fff5a2700 1 -- 172.21.15.50:0/3691007957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff810cba0 con 0x7f2ff80f55c0 2023-01-04T18:24:17.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.284+0000 7f2fff5a2700 1 -- 172.21.15.50:0/3691007957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff80f49b0 con 0x7f2ff80f55c0 2023-01-04T18:24:17.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.284+0000 7f2fe9ffb700 1 -- 172.21.15.50:0/3691007957 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f2ff401b030 con 0x7f2ff80f55c0 2023-01-04T18:24:17.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.285+0000 7f2fe9ffb700 1 --2- 172.21.15.50:0/3691007957 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2fe4060be0 0x7f2fe40630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:17.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.285+0000 7f2fe9ffb700 1 -- 172.21.15.50:0/3691007957 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f2ff407bde0 con 0x7f2ff80f55c0 2023-01-04T18:24:17.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.285+0000 7f2ffcb3d700 1 --2- 172.21.15.50:0/3691007957 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2fe4060be0 0x7f2fe40630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:17.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.285+0000 7f2ffcb3d700 1 --2- 172.21.15.50:0/3691007957 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2fe4060be0 0x7f2fe40630a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f2fec009720 tx=0x7f2fec00b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:17.356 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:17 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:24:16.418593+0000 mgr.smithi050.emnywo (mgr.24517) 359 : cephadm [INF] Upgrade: Updating alertmanager.smithi050 2023-01-04T18:24:17.356 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:17 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:24:16.424326+0000 mgr.smithi050.emnywo (mgr.24517) 360 : cephadm [INF] Deploying daemon alertmanager.smithi050 on smithi050 2023-01-04T18:24:17.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.289+0000 7f2fe9ffb700 1 -- 172.21.15.50:0/3691007957 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f2ff404c2a0 con 0x7f2ff80f55c0 2023-01-04T18:24:17.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.493+0000 7f2fff5a2700 1 -- 172.21.15.50:0/3691007957 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ff8057f10 con 0x7f2fe4060be0 2023-01-04T18:24:17.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.495+0000 7f2fe9ffb700 1 -- 172.21.15.50:0/3691007957 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7f2ff8057f10 con 0x7f2fe4060be0 2023-01-04T18:24:17.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.496+0000 7f2fff5a2700 1 -- 172.21.15.50:0/3691007957 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2fe4060be0 msgr2=0x7f2fe40630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:17.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.496+0000 7f2fff5a2700 1 --2- 172.21.15.50:0/3691007957 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2fe4060be0 0x7f2fe40630a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f2fec009720 tx=0x7f2fec00b040).stop 2023-01-04T18:24:17.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.496+0000 7f2fff5a2700 1 -- 172.21.15.50:0/3691007957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ff80f55c0 msgr2=0x7f2ff8109b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:17.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.496+0000 7f2fff5a2700 1 --2- 172.21.15.50:0/3691007957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ff80f55c0 0x7f2ff8109b80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f2ff400e7c0 tx=0x7f2ff400b040).stop 2023-01-04T18:24:17.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.496+0000 7f2fff5a2700 1 -- 172.21.15.50:0/3691007957 shutdown_connections 2023-01-04T18:24:17.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.497+0000 7f2fff5a2700 1 --2- 172.21.15.50:0/3691007957 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2fe4060be0 0x7f2fe40630a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:17.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.497+0000 7f2fff5a2700 1 --2- 172.21.15.50:0/3691007957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ff80f55c0 0x7f2ff8109b80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:17.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.497+0000 7f2fff5a2700 1 --2- 172.21.15.50:0/3691007957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ff80f6860 0x7f2ff810c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:17.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.497+0000 7f2fff5a2700 1 -- 172.21.15.50:0/3691007957 >> 172.21.15.50:0/3691007957 conn(0x7f2ff80f0d40 msgr2=0x7f2ff80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:17.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.497+0000 7f2fff5a2700 1 -- 172.21.15.50:0/3691007957 shutdown_connections 2023-01-04T18:24:17.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.497+0000 7f2fff5a2700 1 -- 172.21.15.50:0/3691007957 wait complete. 2023-01-04T18:24:17.529 INFO:teuthology.orchestra.run.smithi050.stdout:true 2023-01-04T18:24:17.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.611+0000 7f1071574700 1 -- 172.21.15.50:0/2001025033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f106c0f8610 msgr2=0x7f106c0f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:17.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.611+0000 7f1071574700 1 --2- 172.21.15.50:0/2001025033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f106c0f8610 0x7f106c0f4820 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f1060004660 tx=0x7f1060009b30).stop 2023-01-04T18:24:17.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.611+0000 7f1071574700 1 -- 172.21.15.50:0/2001025033 shutdown_connections 2023-01-04T18:24:17.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.611+0000 7f1071574700 1 --2- 172.21.15.50:0/2001025033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f106c0f8610 0x7f106c0f4820 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:17.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.611+0000 7f1071574700 1 --2- 172.21.15.50:0/2001025033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f106c0f7d00 0x7f106c0f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:17.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.611+0000 7f1071574700 1 -- 172.21.15.50:0/2001025033 >> 172.21.15.50:0/2001025033 conn(0x7f106c0f0540 msgr2=0x7f106c0f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:17.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.611+0000 7f1071574700 1 -- 172.21.15.50:0/2001025033 shutdown_connections 2023-01-04T18:24:17.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.611+0000 7f1071574700 1 -- 172.21.15.50:0/2001025033 wait complete. 2023-01-04T18:24:17.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.612+0000 7f1071574700 1 Processor -- start 2023-01-04T18:24:17.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.612+0000 7f1071574700 1 -- start start 2023-01-04T18:24:17.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.612+0000 7f1071574700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f106c0f7d00 0x7f106c106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:17.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.612+0000 7f1071574700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f106c0f8610 0x7f106c107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:17.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.612+0000 7f1071574700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c1079d0 con 0x7f106c0f8610 2023-01-04T18:24:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.612+0000 7f1071574700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c107b10 con 0x7f106c0f7d00 2023-01-04T18:24:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.612+0000 7f106a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f106c0f8610 0x7f106c107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.612+0000 7f106a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f106c0f8610 0x7f106c107420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37486/0 (socket says 172.21.15.50:37486) 2023-01-04T18:24:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.612+0000 7f106a7fc700 1 -- 172.21.15.50:0/2580883398 learned_addr learned my addr 172.21.15.50:0/2580883398 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:24:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.612+0000 7f106affd700 1 --2- 172.21.15.50:0/2580883398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f106c0f7d00 0x7f106c106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.613+0000 7f106a7fc700 1 -- 172.21.15.50:0/2580883398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f106c0f7d00 msgr2=0x7f106c106f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.613+0000 7f106a7fc700 1 --2- 172.21.15.50:0/2580883398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f106c0f7d00 0x7f106c106f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.613+0000 7f106a7fc700 1 -- 172.21.15.50:0/2580883398 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1060005040 con 0x7f106c0f8610 2023-01-04T18:24:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.613+0000 7f106a7fc700 1 --2- 172.21.15.50:0/2580883398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f106c0f8610 0x7f106c107420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f1060009830 tx=0x7f1060009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.613+0000 7f10537fe700 1 -- 172.21.15.50:0/2580883398 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1060018070 con 0x7f106c0f8610 2023-01-04T18:24:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.613+0000 7f10537fe700 1 -- 172.21.15.50:0/2580883398 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f106001d8e0 con 0x7f106c0f8610 2023-01-04T18:24:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.613+0000 7f1071574700 1 -- 172.21.15.50:0/2580883398 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106c108450 con 0x7f106c0f8610 2023-01-04T18:24:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.613+0000 7f10537fe700 1 -- 172.21.15.50:0/2580883398 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f106001c480 con 0x7f106c0f8610 2023-01-04T18:24:17.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.613+0000 7f1071574700 1 -- 172.21.15.50:0/2580883398 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106c1089b0 con 0x7f106c0f8610 2023-01-04T18:24:17.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.614+0000 7f1071574700 1 -- 172.21.15.50:0/2580883398 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f106c045ad0 con 0x7f106c0f8610 2023-01-04T18:24:17.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.615+0000 7f10537fe700 1 -- 172.21.15.50:0/2580883398 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f106001da50 con 0x7f106c0f8610 2023-01-04T18:24:17.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.615+0000 7f10537fe700 1 --2- 172.21.15.50:0/2580883398 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1054060be0 0x7f10540630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:17.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.615+0000 7f10537fe700 1 -- 172.21.15.50:0/2580883398 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f106007dbb0 con 0x7f106c0f8610 2023-01-04T18:24:17.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.615+0000 7f106affd700 1 --2- 172.21.15.50:0/2580883398 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1054060be0 0x7f10540630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:17.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.616+0000 7f106affd700 1 --2- 172.21.15.50:0/2580883398 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1054060be0 0x7f10540630a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f105c007fd0 tx=0x7f105c009040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:17.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.620+0000 7f10537fe700 1 -- 172.21.15.50:0/2580883398 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f1060084080 con 0x7f106c0f8610 2023-01-04T18:24:17.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.841+0000 7f1071574700 1 -- 172.21.15.50:0/2580883398 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f106c0fefc0 con 0x7f1054060be0 2023-01-04T18:24:17.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.843+0000 7f10537fe700 1 -- 172.21.15.50:0/2580883398 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7f106c0fefc0 con 0x7f1054060be0 2023-01-04T18:24:17.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.845+0000 7f1071574700 1 -- 172.21.15.50:0/2580883398 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1054060be0 msgr2=0x7f10540630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:17.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.845+0000 7f1071574700 1 --2- 172.21.15.50:0/2580883398 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1054060be0 0x7f10540630a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f105c007fd0 tx=0x7f105c009040).stop 2023-01-04T18:24:17.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.845+0000 7f1071574700 1 -- 172.21.15.50:0/2580883398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f106c0f8610 msgr2=0x7f106c107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:17.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.845+0000 7f1071574700 1 --2- 172.21.15.50:0/2580883398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f106c0f8610 0x7f106c107420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f1060009830 tx=0x7f1060009b30).stop 2023-01-04T18:24:17.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.845+0000 7f1071574700 1 -- 172.21.15.50:0/2580883398 shutdown_connections 2023-01-04T18:24:17.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.845+0000 7f1071574700 1 --2- 172.21.15.50:0/2580883398 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1054060be0 0x7f10540630a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.845+0000 7f1071574700 1 --2- 172.21.15.50:0/2580883398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f106c0f7d00 0x7f106c106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.845+0000 7f1071574700 1 --2- 172.21.15.50:0/2580883398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f106c0f8610 0x7f106c107420 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.845+0000 7f1071574700 1 -- 172.21.15.50:0/2580883398 >> 172.21.15.50:0/2580883398 conn(0x7f106c0f0540 msgr2=0x7f106c0fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:17.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.845+0000 7f1071574700 1 -- 172.21.15.50:0/2580883398 shutdown_connections 2023-01-04T18:24:17.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.845+0000 7f1071574700 1 -- 172.21.15.50:0/2580883398 wait complete. 2023-01-04T18:24:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.955+0000 7fc9cf4bc700 1 -- 172.21.15.50:0/2390811113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c80f66d0 msgr2=0x7fc9c80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.955+0000 7fc9cf4bc700 1 --2- 172.21.15.50:0/2390811113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c80f66d0 0x7fc9c80f6b30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fc9b8004660 tx=0x7fc9b8009b30).stop 2023-01-04T18:24:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.956+0000 7fc9cf4bc700 1 -- 172.21.15.50:0/2390811113 shutdown_connections 2023-01-04T18:24:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.956+0000 7fc9cf4bc700 1 --2- 172.21.15.50:0/2390811113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c80f66d0 0x7fc9c80f6b30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:17.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.956+0000 7fc9cf4bc700 1 --2- 172.21.15.50:0/2390811113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9c80f5430 0x7fc9c80f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:17.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.956+0000 7fc9cf4bc700 1 -- 172.21.15.50:0/2390811113 >> 172.21.15.50:0/2390811113 conn(0x7fc9c80f0b90 msgr2=0x7fc9c80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:17.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.956+0000 7fc9cf4bc700 1 -- 172.21.15.50:0/2390811113 shutdown_connections 2023-01-04T18:24:17.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.956+0000 7fc9cf4bc700 1 -- 172.21.15.50:0/2390811113 wait complete. 2023-01-04T18:24:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.956+0000 7fc9cf4bc700 1 Processor -- start 2023-01-04T18:24:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.956+0000 7fc9cf4bc700 1 -- start start 2023-01-04T18:24:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.956+0000 7fc9cf4bc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c80f5430 0x7fc9c80f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.956+0000 7fc9cf4bc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9c80f66d0 0x7fc9c80f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.956+0000 7fc9cf4bc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80f7f70 con 0x7fc9c80f5430 2023-01-04T18:24:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.956+0000 7fc9cf4bc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80f80b0 con 0x7fc9c80f66d0 2023-01-04T18:24:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.957+0000 7fc9ce4ba700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c80f5430 0x7fc9c80f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.957+0000 7fc9ce4ba700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c80f5430 0x7fc9c80f9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37506/0 (socket says 172.21.15.50:37506) 2023-01-04T18:24:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.957+0000 7fc9ce4ba700 1 -- 172.21.15.50:0/2172719077 learned_addr learned my addr 172.21.15.50:0/2172719077 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:24:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.957+0000 7fc9cdcb9700 1 --2- 172.21.15.50:0/2172719077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9c80f66d0 0x7fc9c80f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.957+0000 7fc9ce4ba700 1 -- 172.21.15.50:0/2172719077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9c80f66d0 msgr2=0x7fc9c80f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.957+0000 7fc9ce4ba700 1 --2- 172.21.15.50:0/2172719077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9c80f66d0 0x7fc9c80f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.957+0000 7fc9ce4ba700 1 -- 172.21.15.50:0/2172719077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b8005040 con 0x7fc9c80f5430 2023-01-04T18:24:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.957+0000 7fc9ce4ba700 1 --2- 172.21.15.50:0/2172719077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c80f5430 0x7fc9c80f9590 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fc9c400c790 tx=0x7fc9c4007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.957+0000 7fc9beffd700 1 -- 172.21.15.50:0/2172719077 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c4013630 con 0x7fc9c80f5430 2023-01-04T18:24:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.957+0000 7fc9beffd700 1 -- 172.21.15.50:0/2172719077 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc9c4012870 con 0x7fc9c80f5430 2023-01-04T18:24:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.957+0000 7fc9cf4bc700 1 -- 172.21.15.50:0/2172719077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c80f8390 con 0x7fc9c80f5430 2023-01-04T18:24:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.957+0000 7fc9beffd700 1 -- 172.21.15.50:0/2172719077 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c4002830 con 0x7fc9c80f5430 2023-01-04T18:24:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.957+0000 7fc9cf4bc700 1 -- 172.21.15.50:0/2172719077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c810ed80 con 0x7fc9c80f5430 2023-01-04T18:24:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.958+0000 7fc9cf4bc700 1 -- 172.21.15.50:0/2172719077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c8045ad0 con 0x7fc9c80f5430 2023-01-04T18:24:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.959+0000 7fc9beffd700 1 -- 172.21.15.50:0/2172719077 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fc9c4010070 con 0x7fc9c80f5430 2023-01-04T18:24:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.959+0000 7fc9beffd700 1 --2- 172.21.15.50:0/2172719077 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc9b4060c30 0x7fc9b40630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.959+0000 7fc9beffd700 1 -- 172.21.15.50:0/2172719077 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fc9c407be90 con 0x7fc9c80f5430 2023-01-04T18:24:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.959+0000 7fc9cdcb9700 1 --2- 172.21.15.50:0/2172719077 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc9b4060c30 0x7fc9b40630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.960+0000 7fc9cdcb9700 1 --2- 172.21.15.50:0/2172719077 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc9b4060c30 0x7fc9b40630f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fc9b8004630 tx=0x7fc9b8009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:17.963+0000 7fc9beffd700 1 -- 172.21.15.50:0/2172719077 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fc9c404c350 con 0x7fc9c80f5430 2023-01-04T18:24:18.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.166+0000 7fc9cf4bc700 1 -- 172.21.15.50:0/2172719077 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9c80fab10 con 0x7fc9b4060c30 2023-01-04T18:24:18.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.176+0000 7fc9beffd700 1 -- 172.21.15.50:0/2172719077 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7fc9c80fab10 con 0x7fc9b4060c30 2023-01-04T18:24:18.179 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-01-04T18:24:18.180 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager.smithi050 smithi050 *:9093,9094 running (12m) 3s ago 13m 26.4M - 0.20.0 0881eb8f169f b5d3e2678a23 2023-01-04T18:24:18.180 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi050 smithi050 running (6m) 3s ago 13m 7050k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cfe28e5ab81e 2023-01-04T18:24:18.180 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi098 smithi098 running (5m) 18s ago 13m 7180k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cf5f0ca60522 2023-01-04T18:24:18.180 INFO:teuthology.orchestra.run.smithi050.stdout:grafana.smithi050 smithi050 *:3000 running (12m) 3s ago 13m 37.5M - 6.7.4 557c83e11646 7e5dccbafe78 2023-01-04T18:24:18.180 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.ezoiwl smithi050 running (95s) 3s ago 9m 790M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 146e50d0c3f4 2023-01-04T18:24:18.180 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.kefmuy smithi050 running (78s) 3s ago 9m 779M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 4aaf433888b2 2023-01-04T18:24:18.180 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.laynsk smithi098 running (41s) 18s ago 9m 15.7M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 76076b59594d 2023-01-04T18:24:18.180 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.memais smithi098 running (56s) 18s ago 9m 13.6M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d fdb3824282b1 2023-01-04T18:24:18.180 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi050.emnywo smithi050 *:8443,9283 running (7m) 3s ago 14m 454M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d ee677216e754 2023-01-04T18:24:18.181 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi098.vhfzum smithi098 *:8443,9283 running (6m) 18s ago 13m 397M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d f3d98bf0cf66 2023-01-04T18:24:18.181 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi050 smithi050 running (6m) 3s ago 15m 129M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 0423819cbaa7 2023-01-04T18:24:18.181 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi098 smithi098 running (6m) 18s ago 13m 108M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 12094818aefc 2023-01-04T18:24:18.181 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi050 smithi050 *:9100 running (28s) 3s ago 13m 11.5M - 1.3.1 1dbe0e931976 c372334fd87e 2023-01-04T18:24:18.181 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi098 smithi098 *:9100 running (21s) 18s ago 12m 3854k - 1.3.1 1dbe0e931976 1c32dce64f13 2023-01-04T18:24:18.181 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (5m) 3s ago 12m 359M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 60dafedcb429 2023-01-04T18:24:18.181 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi050 running (3m) 3s ago 12m 370M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 625bd99952d9 2023-01-04T18:24:18.181 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi050 running (3m) 3s ago 11m 280M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d badf94f13661 2023-01-04T18:24:18.181 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi098 running (2m) 18s ago 11m 408M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 93c4e177ba97 2023-01-04T18:24:18.182 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi098 running (2m) 18s ago 11m 377M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 9398016f5e81 2023-01-04T18:24:18.182 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi098 running (115s) 18s ago 11m 316M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 82e86a9ed864 2023-01-04T18:24:18.182 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus.smithi050 smithi050 *:9095 running (9s) 3s ago 13m 34.4M - 2.33.4 514e6a882f6e b46bdb79fd50 2023-01-04T18:24:18.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.178+0000 7fc9cf4bc700 1 -- 172.21.15.50:0/2172719077 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc9b4060c30 msgr2=0x7fc9b40630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:18.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.178+0000 7fc9cf4bc700 1 --2- 172.21.15.50:0/2172719077 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc9b4060c30 0x7fc9b40630f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fc9b8004630 tx=0x7fc9b8009b30).stop 2023-01-04T18:24:18.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.178+0000 7fc9cf4bc700 1 -- 172.21.15.50:0/2172719077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c80f5430 msgr2=0x7fc9c80f9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:18.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.178+0000 7fc9cf4bc700 1 --2- 172.21.15.50:0/2172719077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c80f5430 0x7fc9c80f9590 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fc9c400c790 tx=0x7fc9c4007d90).stop 2023-01-04T18:24:18.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.178+0000 7fc9cf4bc700 1 -- 172.21.15.50:0/2172719077 shutdown_connections 2023-01-04T18:24:18.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.178+0000 7fc9cf4bc700 1 --2- 172.21.15.50:0/2172719077 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc9b4060c30 0x7fc9b40630f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:18.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.178+0000 7fc9cf4bc700 1 --2- 172.21.15.50:0/2172719077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9c80f5430 0x7fc9c80f9590 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:18.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.178+0000 7fc9cf4bc700 1 --2- 172.21.15.50:0/2172719077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9c80f66d0 0x7fc9c80f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:18.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.178+0000 7fc9cf4bc700 1 -- 172.21.15.50:0/2172719077 >> 172.21.15.50:0/2172719077 conn(0x7fc9c80f0b90 msgr2=0x7fc9c805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:18.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.178+0000 7fc9cf4bc700 1 -- 172.21.15.50:0/2172719077 shutdown_connections 2023-01-04T18:24:18.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.178+0000 7fc9cf4bc700 1 -- 172.21.15.50:0/2172719077 wait complete. 2023-01-04T18:24:18.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.287+0000 7f45aa8b9700 1 -- 172.21.15.50:0/3017622150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a40f6530 msgr2=0x7f45a40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:18.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.287+0000 7f45aa8b9700 1 --2- 172.21.15.50:0/3017622150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a40f6530 0x7f45a40f6950 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f45a0004660 tx=0x7f45a0009b30).stop 2023-01-04T18:24:18.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.288+0000 7f45aa8b9700 1 -- 172.21.15.50:0/3017622150 shutdown_connections 2023-01-04T18:24:18.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.288+0000 7f45aa8b9700 1 --2- 172.21.15.50:0/3017622150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45a40f77d0 0x7f45a40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:18.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.288+0000 7f45aa8b9700 1 --2- 172.21.15.50:0/3017622150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a40f6530 0x7f45a40f6950 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:18.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.288+0000 7f45aa8b9700 1 -- 172.21.15.50:0/3017622150 >> 172.21.15.50:0/3017622150 conn(0x7f45a40f1c90 msgr2=0x7f45a40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:18.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.288+0000 7f45aa8b9700 1 -- 172.21.15.50:0/3017622150 shutdown_connections 2023-01-04T18:24:18.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.288+0000 7f45aa8b9700 1 -- 172.21.15.50:0/3017622150 wait complete. 2023-01-04T18:24:18.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.288+0000 7f45aa8b9700 1 Processor -- start 2023-01-04T18:24:18.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.288+0000 7f45aa8b9700 1 -- start start 2023-01-04T18:24:18.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.289+0000 7f45aa8b9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45a40f6530 0x7f45a406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:18.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.289+0000 7f45aa8b9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a40f77d0 0x7f45a4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:18.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.289+0000 7f45aa8b9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a406a380 con 0x7f45a40f77d0 2023-01-04T18:24:18.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.289+0000 7f45aa8b9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a406a4c0 con 0x7f45a40f6530 2023-01-04T18:24:18.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.289+0000 7f45a90b6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a40f77d0 0x7f45a4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:18.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.289+0000 7f45a90b6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a40f77d0 0x7f45a4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37522/0 (socket says 172.21.15.50:37522) 2023-01-04T18:24:18.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.289+0000 7f45a98b7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45a40f6530 0x7f45a406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:18.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.289+0000 7f45a90b6700 1 -- 172.21.15.50:0/897136976 learned_addr learned my addr 172.21.15.50:0/897136976 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:24:18.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.289+0000 7f45a90b6700 1 -- 172.21.15.50:0/897136976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45a40f6530 msgr2=0x7f45a406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:18.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.289+0000 7f45a90b6700 1 --2- 172.21.15.50:0/897136976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45a40f6530 0x7f45a406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:18.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.289+0000 7f45a90b6700 1 -- 172.21.15.50:0/897136976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a0005040 con 0x7f45a40f77d0 2023-01-04T18:24:18.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.289+0000 7f45a90b6700 1 --2- 172.21.15.50:0/897136976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a40f77d0 0x7f45a4069e20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f459400e7f0 tx=0x7f459400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:18.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.289+0000 7f459a7fc700 1 -- 172.21.15.50:0/897136976 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45940092e0 con 0x7f45a40f77d0 2023-01-04T18:24:18.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.289+0000 7f459a7fc700 1 -- 172.21.15.50:0/897136976 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f459400f040 con 0x7f45a40f77d0 2023-01-04T18:24:18.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.289+0000 7f45aa8b9700 1 -- 172.21.15.50:0/897136976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a406a7a0 con 0x7f45a40f77d0 2023-01-04T18:24:18.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.289+0000 7f459a7fc700 1 -- 172.21.15.50:0/897136976 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45940147e0 con 0x7f45a40f77d0 2023-01-04T18:24:18.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.289+0000 7f45aa8b9700 1 -- 172.21.15.50:0/897136976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a410ed70 con 0x7f45a40f77d0 2023-01-04T18:24:18.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.290+0000 7f45aa8b9700 1 -- 172.21.15.50:0/897136976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a4045ad0 con 0x7f45a40f77d0 2023-01-04T18:24:18.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.291+0000 7f459a7fc700 1 -- 172.21.15.50:0/897136976 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f459401b030 con 0x7f45a40f77d0 2023-01-04T18:24:18.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.291+0000 7f459a7fc700 1 --2- 172.21.15.50:0/897136976 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4590060c30 0x7f45900630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:18.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.291+0000 7f459a7fc700 1 -- 172.21.15.50:0/897136976 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f459407bb90 con 0x7f45a40f77d0 2023-01-04T18:24:18.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.292+0000 7f45a98b7700 1 --2- 172.21.15.50:0/897136976 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4590060c30 0x7f45900630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:18.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.292+0000 7f45a98b7700 1 --2- 172.21.15.50:0/897136976 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4590060c30 0x7f45900630f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f45a0004d80 tx=0x7f45a0016040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:18.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.296+0000 7f459a7fc700 1 -- 172.21.15.50:0/897136976 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f459404c160 con 0x7f45a40f77d0 2023-01-04T18:24:18.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:16.695712+0000 mgr.smithi050.emnywo (mgr.24517) 361 : cluster [DBG] pgmap v260: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:18.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:17.495699+0000 mgr.smithi050.emnywo (mgr.24517) 362 : audit [DBG] from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:24:18.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.576+0000 7f45aa8b9700 1 -- 172.21.15.50:0/897136976 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f45a4027a00 con 0x7f45a40f77d0 2023-01-04T18:24:18.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.576+0000 7f459a7fc700 1 -- 172.21.15.50:0/897136976 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+653 (secure 0 0 0) 0x7f45940192a0 con 0x7f45a40f77d0 2023-01-04T18:24:18.580 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:24:18.580 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": { 2023-01-04T18:24:18.580 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:24:18.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:24:18.580 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": { 2023-01-04T18:24:18.581 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:24:18.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:24:18.581 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": { 2023-01-04T18:24:18.581 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 6 2023-01-04T18:24:18.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:24:18.581 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2023-01-04T18:24:18.581 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 4 2023-01-04T18:24:18.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:24:18.581 INFO:teuthology.orchestra.run.smithi050.stdout: "overall": { 2023-01-04T18:24:18.581 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 14 2023-01-04T18:24:18.581 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-01-04T18:24:18.582 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:24:18.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:16.695712+0000 mgr.smithi050.emnywo (mgr.24517) 361 : cluster [DBG] pgmap v260: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:18.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:17.495699+0000 mgr.smithi050.emnywo (mgr.24517) 362 : audit [DBG] from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:24:18.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.578+0000 7f45aa8b9700 1 -- 172.21.15.50:0/897136976 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4590060c30 msgr2=0x7f45900630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:18.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.578+0000 7f45aa8b9700 1 --2- 172.21.15.50:0/897136976 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4590060c30 0x7f45900630f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f45a0004d80 tx=0x7f45a0016040).stop 2023-01-04T18:24:18.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.578+0000 7f45aa8b9700 1 -- 172.21.15.50:0/897136976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a40f77d0 msgr2=0x7f45a4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:18.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.578+0000 7f45aa8b9700 1 --2- 172.21.15.50:0/897136976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a40f77d0 0x7f45a4069e20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f459400e7f0 tx=0x7f459400b040).stop 2023-01-04T18:24:18.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.578+0000 7f45aa8b9700 1 -- 172.21.15.50:0/897136976 shutdown_connections 2023-01-04T18:24:18.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.578+0000 7f45aa8b9700 1 --2- 172.21.15.50:0/897136976 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f4590060c30 0x7f45900630f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:18.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.578+0000 7f45aa8b9700 1 --2- 172.21.15.50:0/897136976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45a40f6530 0x7f45a406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:18.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.578+0000 7f45aa8b9700 1 --2- 172.21.15.50:0/897136976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a40f77d0 0x7f45a4069e20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:18.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.578+0000 7f45aa8b9700 1 -- 172.21.15.50:0/897136976 >> 172.21.15.50:0/897136976 conn(0x7f45a40f1c90 msgr2=0x7f45a40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:18.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.578+0000 7f45aa8b9700 1 -- 172.21.15.50:0/897136976 shutdown_connections 2023-01-04T18:24:18.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.578+0000 7f45aa8b9700 1 -- 172.21.15.50:0/897136976 wait complete. 2023-01-04T18:24:18.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.686+0000 7fe557754700 1 -- 172.21.15.50:0/3001808564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5500f55c0 msgr2=0x7fe5500f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.686+0000 7fe557754700 1 --2- 172.21.15.50:0/3001808564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5500f55c0 0x7fe5500f59e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fe540004660 tx=0x7fe540009b30).stop 2023-01-04T18:24:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.686+0000 7fe557754700 1 -- 172.21.15.50:0/3001808564 shutdown_connections 2023-01-04T18:24:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.686+0000 7fe557754700 1 --2- 172.21.15.50:0/3001808564 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5500f6860 0x7fe5500f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.686+0000 7fe557754700 1 --2- 172.21.15.50:0/3001808564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5500f55c0 0x7fe5500f59e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.686+0000 7fe557754700 1 -- 172.21.15.50:0/3001808564 >> 172.21.15.50:0/3001808564 conn(0x7fe5500f0d40 msgr2=0x7fe5500f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.686+0000 7fe557754700 1 -- 172.21.15.50:0/3001808564 shutdown_connections 2023-01-04T18:24:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.686+0000 7fe557754700 1 -- 172.21.15.50:0/3001808564 wait complete. 2023-01-04T18:24:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.687+0000 7fe557754700 1 Processor -- start 2023-01-04T18:24:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.687+0000 7fe557754700 1 -- start start 2023-01-04T18:24:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.687+0000 7fe557754700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5500f55c0 0x7fe550109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.687+0000 7fe557754700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5500f6860 0x7fe550109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.687+0000 7fe557754700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe550109c20 con 0x7fe5500f55c0 2023-01-04T18:24:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.687+0000 7fe557754700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe550109d60 con 0x7fe5500f6860 2023-01-04T18:24:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.687+0000 7fe5554f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5500f55c0 0x7fe550109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.687+0000 7fe5554f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5500f55c0 0x7fe550109180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37538/0 (socket says 172.21.15.50:37538) 2023-01-04T18:24:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.687+0000 7fe5554f0700 1 -- 172.21.15.50:0/1841191228 learned_addr learned my addr 172.21.15.50:0/1841191228 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:24:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.687+0000 7fe554cef700 1 --2- 172.21.15.50:0/1841191228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5500f6860 0x7fe550109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.687+0000 7fe5554f0700 1 -- 172.21.15.50:0/1841191228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5500f6860 msgr2=0x7fe550109670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.687+0000 7fe5554f0700 1 --2- 172.21.15.50:0/1841191228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5500f6860 0x7fe550109670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.687+0000 7fe5554f0700 1 -- 172.21.15.50:0/1841191228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe540005040 con 0x7fe5500f55c0 2023-01-04T18:24:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.688+0000 7fe5554f0700 1 --2- 172.21.15.50:0/1841191228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5500f55c0 0x7fe550109180 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fe540004e30 tx=0x7fe540009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.688+0000 7fe545ffb700 1 -- 172.21.15.50:0/1841191228 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe540018070 con 0x7fe5500f55c0 2023-01-04T18:24:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.688+0000 7fe557754700 1 -- 172.21.15.50:0/1841191228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55010a6a0 con 0x7fe5500f55c0 2023-01-04T18:24:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.688+0000 7fe545ffb700 1 -- 172.21.15.50:0/1841191228 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe540009630 con 0x7fe5500f55c0 2023-01-04T18:24:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.688+0000 7fe545ffb700 1 -- 172.21.15.50:0/1841191228 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe54001c3c0 con 0x7fe5500f55c0 2023-01-04T18:24:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.688+0000 7fe557754700 1 -- 172.21.15.50:0/1841191228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55010ac00 con 0x7fe5500f55c0 2023-01-04T18:24:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.689+0000 7fe557754700 1 -- 172.21.15.50:0/1841191228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe550045ad0 con 0x7fe5500f55c0 2023-01-04T18:24:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.690+0000 7fe545ffb700 1 -- 172.21.15.50:0/1841191228 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fe54001d420 con 0x7fe5500f55c0 2023-01-04T18:24:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.690+0000 7fe545ffb700 1 --2- 172.21.15.50:0/1841191228 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe53c060be0 0x7fe53c0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:18.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.690+0000 7fe545ffb700 1 -- 172.21.15.50:0/1841191228 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fe54007dac0 con 0x7fe5500f55c0 2023-01-04T18:24:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.690+0000 7fe554cef700 1 --2- 172.21.15.50:0/1841191228 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe53c060be0 0x7fe53c0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.691+0000 7fe554cef700 1 --2- 172.21.15.50:0/1841191228 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe53c060be0 0x7fe53c0630a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fe54c0096c0 tx=0x7fe54c009be0).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:18.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.694+0000 7fe545ffb700 1 -- 172.21.15.50:0/1841191228 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fe540051ac0 con 0x7fe5500f55c0 2023-01-04T18:24:18.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.915+0000 7fe557754700 1 -- 172.21.15.50:0/1841191228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe5500fded0 con 0x7fe5500f55c0 2023-01-04T18:24:18.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.915+0000 7fe545ffb700 1 -- 172.21.15.50:0/1841191228 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1791 (secure 0 0 0) 0x7fe5400516b0 con 0x7fe5500f55c0 2023-01-04T18:24:18.919 INFO:teuthology.orchestra.run.smithi050.stdout:e36 2023-01-04T18:24:18.919 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:24:18.919 INFO:teuthology.orchestra.run.smithi050.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:24:18.919 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-01-04T18:24:18.919 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:24:18.919 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-01-04T18:24:18.919 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-01-04T18:24:18.919 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 36 2023-01-04T18:24:18.920 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 2023-01-04T18:24:18.920 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:24:18.920 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-01-04T18:23:41.431715+0000 2023-01-04T18:24:18.920 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-01-04T18:24:18.920 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-01-04T18:24:18.920 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 60 2023-01-04T18:24:18.920 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-01-04T18:24:18.920 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-01-04T18:24:18.921 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-01-04T18:24:18.921 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-01-04T18:24:18.921 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 95 2023-01-04T18:24:18.921 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:24:18.921 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 1 2023-01-04T18:24:18.921 INFO:teuthology.orchestra.run.smithi050.stdout:in 0 2023-01-04T18:24:18.921 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=34362} 2023-01-04T18:24:18.921 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-01-04T18:24:18.921 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-01-04T18:24:18.921 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-01-04T18:24:18.922 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-01-04T18:24:18.922 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-01-04T18:24:18.922 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data enabled 2023-01-04T18:24:18.922 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-01-04T18:24:18.922 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 1 2023-01-04T18:24:18.922 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.ezoiwl{0:34362} state up:active seq 17 join_fscid=1 addr [v2:172.21.15.50:6826/336562041,v1:172.21.15.50:6827/336562041] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:24:18.922 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.kefmuy{0:34366} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.50:6828/2188030488,v1:172.21.15.50:6829/2188030488] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:24:18.922 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:24:18.922 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:24:18.922 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2023-01-04T18:24:18.922 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:24:18.923 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.memais{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.98:6824/4224872601,v1:172.21.15.98:6825/4224872601] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:24:18.923 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.laynsk{-1:44317} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.98:6826/503298078,v1:172.21.15.98:6827/503298078] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:24:18.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.917+0000 7fe557754700 1 -- 172.21.15.50:0/1841191228 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe53c060be0 msgr2=0x7fe53c0630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:18.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.917+0000 7fe557754700 1 --2- 172.21.15.50:0/1841191228 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe53c060be0 0x7fe53c0630a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fe54c0096c0 tx=0x7fe54c009be0).stop 2023-01-04T18:24:18.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.917+0000 7fe557754700 1 -- 172.21.15.50:0/1841191228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5500f55c0 msgr2=0x7fe550109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:18.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.917+0000 7fe557754700 1 --2- 172.21.15.50:0/1841191228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5500f55c0 0x7fe550109180 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fe540004e30 tx=0x7fe540009b30).stop 2023-01-04T18:24:18.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.917+0000 7fe557754700 1 -- 172.21.15.50:0/1841191228 shutdown_connections 2023-01-04T18:24:18.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.917+0000 7fe557754700 1 --2- 172.21.15.50:0/1841191228 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe53c060be0 0x7fe53c0630a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:18.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.917+0000 7fe557754700 1 --2- 172.21.15.50:0/1841191228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5500f55c0 0x7fe550109180 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:18.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.917+0000 7fe557754700 1 --2- 172.21.15.50:0/1841191228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5500f6860 0x7fe550109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:18.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.917+0000 7fe557754700 1 -- 172.21.15.50:0/1841191228 >> 172.21.15.50:0/1841191228 conn(0x7fe5500f0d40 msgr2=0x7fe55005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:18.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.917+0000 7fe557754700 1 -- 172.21.15.50:0/1841191228 shutdown_connections 2023-01-04T18:24:18.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:18.917+0000 7fe557754700 1 -- 172.21.15.50:0/1841191228 wait complete. 2023-01-04T18:24:18.924 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 36 2023-01-04T18:24:19.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.020+0000 7f14f571a700 1 -- 172.21.15.50:0/3482986466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14f00f7980 msgr2=0x7f14f00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:19.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.020+0000 7f14f571a700 1 --2- 172.21.15.50:0/3482986466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14f00f7980 0x7f14f00f7de0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f14e4004660 tx=0x7f14e4009b30).stop 2023-01-04T18:24:19.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.020+0000 7f14f571a700 1 -- 172.21.15.50:0/3482986466 shutdown_connections 2023-01-04T18:24:19.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.020+0000 7f14f571a700 1 --2- 172.21.15.50:0/3482986466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14f00f7980 0x7f14f00f7de0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:19.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.020+0000 7f14f571a700 1 --2- 172.21.15.50:0/3482986466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14f00f66e0 0x7f14f00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:19.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.020+0000 7f14f571a700 1 -- 172.21.15.50:0/3482986466 >> 172.21.15.50:0/3482986466 conn(0x7f14f00f1e40 msgr2=0x7f14f00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:19.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.020+0000 7f14f571a700 1 -- 172.21.15.50:0/3482986466 shutdown_connections 2023-01-04T18:24:19.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.020+0000 7f14f571a700 1 -- 172.21.15.50:0/3482986466 wait complete. 2023-01-04T18:24:19.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.021+0000 7f14f571a700 1 Processor -- start 2023-01-04T18:24:19.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.021+0000 7f14f571a700 1 -- start start 2023-01-04T18:24:19.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.021+0000 7f14f571a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14f00f66e0 0x7f14f01091b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:19.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.021+0000 7f14f571a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14f00f7980 0x7f14f01096a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:19.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.021+0000 7f14f571a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f0109c50 con 0x7f14f00f66e0 2023-01-04T18:24:19.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.021+0000 7f14f571a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f0109d90 con 0x7f14f00f7980 2023-01-04T18:24:19.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.021+0000 7f14eeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14f00f66e0 0x7f14f01091b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:19.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.021+0000 7f14eeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14f00f66e0 0x7f14f01091b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37552/0 (socket says 172.21.15.50:37552) 2023-01-04T18:24:19.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.021+0000 7f14eeffd700 1 -- 172.21.15.50:0/615934649 learned_addr learned my addr 172.21.15.50:0/615934649 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:24:19.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.022+0000 7f14ee7fc700 1 --2- 172.21.15.50:0/615934649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14f00f7980 0x7f14f01096a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:19.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.022+0000 7f14eeffd700 1 -- 172.21.15.50:0/615934649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14f00f7980 msgr2=0x7f14f01096a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:19.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.022+0000 7f14eeffd700 1 --2- 172.21.15.50:0/615934649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14f00f7980 0x7f14f01096a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:19.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.022+0000 7f14eeffd700 1 -- 172.21.15.50:0/615934649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e4005040 con 0x7f14f00f66e0 2023-01-04T18:24:19.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.022+0000 7f14ee7fc700 1 --2- 172.21.15.50:0/615934649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14f00f7980 0x7f14f01096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-01-04T18:24:19.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.022+0000 7f14eeffd700 1 --2- 172.21.15.50:0/615934649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14f00f66e0 0x7f14f01091b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f14e000c790 tx=0x7f14e0007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:19.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.022+0000 7f14d77fe700 1 -- 172.21.15.50:0/615934649 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14e000e680 con 0x7f14f00f66e0 2023-01-04T18:24:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.022+0000 7f14d77fe700 1 -- 172.21.15.50:0/615934649 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f14e000eca0 con 0x7f14f00f66e0 2023-01-04T18:24:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.022+0000 7f14f571a700 1 -- 172.21.15.50:0/615934649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f010a730 con 0x7f14f00f66e0 2023-01-04T18:24:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.022+0000 7f14d77fe700 1 -- 172.21.15.50:0/615934649 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14e0012d80 con 0x7f14f00f66e0 2023-01-04T18:24:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.022+0000 7f14f571a700 1 -- 172.21.15.50:0/615934649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f010acf0 con 0x7f14f00f66e0 2023-01-04T18:24:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.023+0000 7f14f571a700 1 -- 172.21.15.50:0/615934649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f0045ad0 con 0x7f14f00f66e0 2023-01-04T18:24:19.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.024+0000 7f14d77fe700 1 -- 172.21.15.50:0/615934649 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f14e0010070 con 0x7f14f00f66e0 2023-01-04T18:24:19.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.024+0000 7f14d77fe700 1 --2- 172.21.15.50:0/615934649 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f14d8060be0 0x7f14d80630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:19.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.024+0000 7f14d77fe700 1 -- 172.21.15.50:0/615934649 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f14e007be90 con 0x7f14f00f66e0 2023-01-04T18:24:19.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.024+0000 7f14ee7fc700 1 --2- 172.21.15.50:0/615934649 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f14d8060be0 0x7f14d80630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:19.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.024+0000 7f14ee7fc700 1 --2- 172.21.15.50:0/615934649 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f14d8060be0 0x7f14d80630a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f14e4005010 tx=0x7f14e4009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:19.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.028+0000 7f14d77fe700 1 -- 172.21.15.50:0/615934649 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f14e004fd80 con 0x7f14f00f66e0 2023-01-04T18:24:19.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.216+0000 7f14f571a700 1 -- 172.21.15.50:0/615934649 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f14f00fefe0 con 0x7f14d8060be0 2023-01-04T18:24:19.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.217+0000 7f14d77fe700 1 -- 172.21.15.50:0/615934649 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7f14f00fefe0 con 0x7f14d8060be0 2023-01-04T18:24:19.221 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:24:19.221 INFO:teuthology.orchestra.run.smithi050.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308", 2023-01-04T18:24:19.221 INFO:teuthology.orchestra.run.smithi050.stdout: "in_progress": true, 2023-01-04T18:24:19.223 INFO:teuthology.orchestra.run.smithi050.stdout: "which": "Upgrading all daemon types on all hosts", 2023-01-04T18:24:19.223 INFO:teuthology.orchestra.run.smithi050.stdout: "services_complete": [ 2023-01-04T18:24:19.223 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr", 2023-01-04T18:24:19.223 INFO:teuthology.orchestra.run.smithi050.stdout: "mon", 2023-01-04T18:24:19.223 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2023-01-04T18:24:19.223 INFO:teuthology.orchestra.run.smithi050.stdout: "osd", 2023-01-04T18:24:19.223 INFO:teuthology.orchestra.run.smithi050.stdout: "mds" 2023-01-04T18:24:19.223 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-01-04T18:24:19.223 INFO:teuthology.orchestra.run.smithi050.stdout: "progress": "16/21 daemons upgraded", 2023-01-04T18:24:19.223 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "Currently upgrading alertmanager daemons", 2023-01-04T18:24:19.224 INFO:teuthology.orchestra.run.smithi050.stdout: "is_paused": false 2023-01-04T18:24:19.224 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:24:19.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.219+0000 7f14f571a700 1 -- 172.21.15.50:0/615934649 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f14d8060be0 msgr2=0x7f14d80630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.219+0000 7f14f571a700 1 --2- 172.21.15.50:0/615934649 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f14d8060be0 0x7f14d80630a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f14e4005010 tx=0x7f14e4009b30).stop 2023-01-04T18:24:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.219+0000 7f14f571a700 1 -- 172.21.15.50:0/615934649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14f00f66e0 msgr2=0x7f14f01091b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.219+0000 7f14f571a700 1 --2- 172.21.15.50:0/615934649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14f00f66e0 0x7f14f01091b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f14e000c790 tx=0x7f14e0007d90).stop 2023-01-04T18:24:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.219+0000 7f14f571a700 1 -- 172.21.15.50:0/615934649 shutdown_connections 2023-01-04T18:24:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.219+0000 7f14f571a700 1 --2- 172.21.15.50:0/615934649 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f14d8060be0 0x7f14d80630a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.219+0000 7f14f571a700 1 --2- 172.21.15.50:0/615934649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14f00f66e0 0x7f14f01091b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.219+0000 7f14f571a700 1 --2- 172.21.15.50:0/615934649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14f00f7980 0x7f14f01096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.219+0000 7f14f571a700 1 -- 172.21.15.50:0/615934649 >> 172.21.15.50:0/615934649 conn(0x7f14f00f1e40 msgr2=0x7f14f006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.219+0000 7f14f571a700 1 -- 172.21.15.50:0/615934649 shutdown_connections 2023-01-04T18:24:19.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:19.219+0000 7f14f571a700 1 -- 172.21.15.50:0/615934649 wait complete. 2023-01-04T18:24:19.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:17.843941+0000 mgr.smithi050.emnywo (mgr.24517) 363 : audit [DBG] from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:24:19.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:18.168891+0000 mgr.smithi050.emnywo (mgr.24517) 364 : audit [DBG] from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:24:19.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:18.578012+0000 mon.smithi050 (mon.0) 704 : audit [DBG] from='client.? 172.21.15.50:0/897136976' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:19.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:19 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:18.916835+0000 mon.smithi050 (mon.0) 705 : audit [DBG] from='client.? 172.21.15.50:0/1841191228' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:24:19.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:17.843941+0000 mgr.smithi050.emnywo (mgr.24517) 363 : audit [DBG] from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:24:19.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:18.168891+0000 mgr.smithi050.emnywo (mgr.24517) 364 : audit [DBG] from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:24:19.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:18.578012+0000 mon.smithi050 (mon.0) 704 : audit [DBG] from='client.? 172.21.15.50:0/897136976' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:19.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:19 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:18.916835+0000 mon.smithi050 (mon.0) 705 : audit [DBG] from='client.? 172.21.15.50:0/1841191228' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:24:20.194 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:18.696085+0000 mgr.smithi050.emnywo (mgr.24517) 365 : cluster [DBG] pgmap v261: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:20.194 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:19.218794+0000 mgr.smithi050.emnywo (mgr.24517) 366 : audit [DBG] from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:24:20.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:18.696085+0000 mgr.smithi050.emnywo (mgr.24517) 365 : cluster [DBG] pgmap v261: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:20.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:19.218794+0000 mgr.smithi050.emnywo (mgr.24517) 366 : audit [DBG] from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:24:22.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:20.696658+0000 mgr.smithi050.emnywo (mgr.24517) 367 : cluster [DBG] pgmap v262: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:24:22.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:20.696658+0000 mgr.smithi050.emnywo (mgr.24517) 367 : cluster [DBG] pgmap v262: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:24:24.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:22.697131+0000 mgr.smithi050.emnywo (mgr.24517) 368 : cluster [DBG] pgmap v263: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:24.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:23.099798+0000 mon.smithi050 (mon.0) 706 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:24.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:23.100557+0000 mon.smithi050 (mon.0) 707 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:24:24.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:23.101649+0000 mon.smithi050 (mon.0) 708 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:24:24.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:23.102252+0000 mon.smithi050 (mon.0) 709 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:24:24.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:24:23.102811+0000 mgr.smithi050.emnywo (mgr.24517) 369 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:24:24.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:22.697131+0000 mgr.smithi050.emnywo (mgr.24517) 368 : cluster [DBG] pgmap v263: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:24.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:23.099798+0000 mon.smithi050 (mon.0) 706 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:24.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:23.100557+0000 mon.smithi050 (mon.0) 707 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:24:24.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:23.101649+0000 mon.smithi050 (mon.0) 708 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:24:24.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:23.102252+0000 mon.smithi050 (mon.0) 709 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:24:24.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:24:23.102811+0000 mgr.smithi050.emnywo (mgr.24517) 369 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:24:25.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:24.882503+0000 mon.smithi050 (mon.0) 710 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:24:25.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:24.886131+0000 mon.smithi050 (mon.0) 711 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:24:25.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:24.882503+0000 mon.smithi050 (mon.0) 710 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:24:25.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:24.886131+0000 mon.smithi050 (mon.0) 711 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:24:26.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:24.697639+0000 mgr.smithi050.emnywo (mgr.24517) 370 : cluster [DBG] pgmap v264: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:24:26.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:24.697639+0000 mgr.smithi050.emnywo (mgr.24517) 370 : cluster [DBG] pgmap v264: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:24:28.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:26.698122+0000 mgr.smithi050.emnywo (mgr.24517) 371 : cluster [DBG] pgmap v265: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:28.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:26.698122+0000 mgr.smithi050.emnywo (mgr.24517) 371 : cluster [DBG] pgmap v265: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:30.250 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:28.698710+0000 mgr.smithi050.emnywo (mgr.24517) 372 : cluster [DBG] pgmap v266: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:30.250 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:28.879091+0000 mon.smithi050 (mon.0) 712 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:30.250 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:28.882427+0000 mon.smithi050 (mon.0) 713 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:30.250 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:28.888544+0000 mon.smithi050 (mon.0) 714 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-01-04T18:24:30.250 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:28.888905+0000 mgr.smithi050.emnywo (mgr.24517) 373 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-01-04T18:24:30.250 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:28.889747+0000 mon.smithi050 (mon.0) 715 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi050.front.sepia.ceph.com:9093"}]: dispatch 2023-01-04T18:24:30.250 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:28.889991+0000 mgr.smithi050.emnywo (mgr.24517) 374 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi050.front.sepia.ceph.com:9093"}]: dispatch 2023-01-04T18:24:30.251 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:28.893596+0000 mon.smithi050 (mon.0) 716 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:30.251 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:28.895831+0000 mon.smithi050 (mon.0) 717 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:24:30.251 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:28.898091+0000 mon.smithi050 (mon.0) 718 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.251 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:28.899278+0000 mon.smithi050 (mon.0) 719 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.251 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:28.900421+0000 mon.smithi050 (mon.0) 720 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.251 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:28.901884+0000 mon.smithi050 (mon.0) 721 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.251 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:28.903617+0000 mon.smithi050 (mon.0) 722 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.251 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:28.904472+0000 mon.smithi050 (mon.0) 723 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.251 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:28.905333+0000 mon.smithi050 (mon.0) 724 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.251 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:28.906203+0000 mon.smithi050 (mon.0) 725 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.251 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:28.907090+0000 mon.smithi050 (mon.0) 726 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.252 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:28.907961+0000 mon.smithi050 (mon.0) 727 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.252 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:28.909343+0000 mon.smithi050 (mon.0) 728 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.252 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:28.910391+0000 mon.smithi050 (mon.0) 729 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.252 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:29 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:28.911441+0000 mon.smithi050 (mon.0) 730 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:28.698710+0000 mgr.smithi050.emnywo (mgr.24517) 372 : cluster [DBG] pgmap v266: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:28.879091+0000 mon.smithi050 (mon.0) 712 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:28.882427+0000 mon.smithi050 (mon.0) 713 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:28.888544+0000 mon.smithi050 (mon.0) 714 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-01-04T18:24:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:28.888905+0000 mgr.smithi050.emnywo (mgr.24517) 373 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-01-04T18:24:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:28.889747+0000 mon.smithi050 (mon.0) 715 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi050.front.sepia.ceph.com:9093"}]: dispatch 2023-01-04T18:24:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:28.889991+0000 mgr.smithi050.emnywo (mgr.24517) 374 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi050.front.sepia.ceph.com:9093"}]: dispatch 2023-01-04T18:24:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:28.893596+0000 mon.smithi050 (mon.0) 716 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:30.331 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:28.895831+0000 mon.smithi050 (mon.0) 717 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:24:30.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:28.898091+0000 mon.smithi050 (mon.0) 718 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:28.899278+0000 mon.smithi050 (mon.0) 719 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:28.900421+0000 mon.smithi050 (mon.0) 720 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:28.901884+0000 mon.smithi050 (mon.0) 721 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:28.903617+0000 mon.smithi050 (mon.0) 722 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:28.904472+0000 mon.smithi050 (mon.0) 723 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:28.905333+0000 mon.smithi050 (mon.0) 724 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:28.906203+0000 mon.smithi050 (mon.0) 725 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:28.907090+0000 mon.smithi050 (mon.0) 726 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:28.907961+0000 mon.smithi050 (mon.0) 727 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.332 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:28.909343+0000 mon.smithi050 (mon.0) 728 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:28.910391+0000 mon.smithi050 (mon.0) 729 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:30.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:28.911441+0000 mon.smithi050 (mon.0) 730 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:31.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:24:30.195821+0000 mgr.smithi050.emnywo (mgr.24517) 375 : cephadm [INF] Upgrade: Updating grafana.smithi050 2023-01-04T18:24:31.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:30.280759+0000 mon.smithi050 (mon.0) 731 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:31.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:30.283179+0000 mon.smithi050 (mon.0) 732 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:31.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:30.285703+0000 mon.smithi050 (mon.0) 733 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-01-04T18:24:31.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:30.286044+0000 mgr.smithi050.emnywo (mgr.24517) 376 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-01-04T18:24:31.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:31 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:24:30.290146+0000 mgr.smithi050.emnywo (mgr.24517) 377 : cephadm [INF] Deploying daemon grafana.smithi050 on smithi050 2023-01-04T18:24:31.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:24:30.195821+0000 mgr.smithi050.emnywo (mgr.24517) 375 : cephadm [INF] Upgrade: Updating grafana.smithi050 2023-01-04T18:24:31.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:30.280759+0000 mon.smithi050 (mon.0) 731 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:31.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:30.283179+0000 mon.smithi050 (mon.0) 732 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:24:31.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:30.285703+0000 mon.smithi050 (mon.0) 733 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-01-04T18:24:31.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:30.286044+0000 mgr.smithi050.emnywo (mgr.24517) 376 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-01-04T18:24:31.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:24:30.290146+0000 mgr.smithi050.emnywo (mgr.24517) 377 : cephadm [INF] Deploying daemon grafana.smithi050 on smithi050 2023-01-04T18:24:32.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:30.699227+0000 mgr.smithi050.emnywo (mgr.24517) 378 : cluster [DBG] pgmap v267: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:24:32.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:30.699227+0000 mgr.smithi050.emnywo (mgr.24517) 378 : cluster [DBG] pgmap v267: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:24:34.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:32.699824+0000 mgr.smithi050.emnywo (mgr.24517) 379 : cluster [DBG] pgmap v268: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:34.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:32.699824+0000 mgr.smithi050.emnywo (mgr.24517) 379 : cluster [DBG] pgmap v268: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:36.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:34.700260+0000 mgr.smithi050.emnywo (mgr.24517) 380 : cluster [DBG] pgmap v269: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:24:36.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:34.700260+0000 mgr.smithi050.emnywo (mgr.24517) 380 : cluster [DBG] pgmap v269: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:24:38.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:36.700612+0000 mgr.smithi050.emnywo (mgr.24517) 381 : cluster [DBG] pgmap v270: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:38.661 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:36.700612+0000 mgr.smithi050.emnywo (mgr.24517) 381 : cluster [DBG] pgmap v270: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:40.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:38.701099+0000 mgr.smithi050.emnywo (mgr.24517) 382 : cluster [DBG] pgmap v271: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:40.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:38.701099+0000 mgr.smithi050.emnywo (mgr.24517) 382 : cluster [DBG] pgmap v271: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:42.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:40.701755+0000 mgr.smithi050.emnywo (mgr.24517) 383 : cluster [DBG] pgmap v272: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:24:42.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:40.701755+0000 mgr.smithi050.emnywo (mgr.24517) 383 : cluster [DBG] pgmap v272: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:24:44.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:42.702116+0000 mgr.smithi050.emnywo (mgr.24517) 384 : cluster [DBG] pgmap v273: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:44.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:42.702116+0000 mgr.smithi050.emnywo (mgr.24517) 384 : cluster [DBG] pgmap v273: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:46.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:44.702500+0000 mgr.smithi050.emnywo (mgr.24517) 385 : cluster [DBG] pgmap v274: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:24:46.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:44.702500+0000 mgr.smithi050.emnywo (mgr.24517) 385 : cluster [DBG] pgmap v274: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:24:48.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:46.702829+0000 mgr.smithi050.emnywo (mgr.24517) 386 : cluster [DBG] pgmap v275: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:48.662 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:46.702829+0000 mgr.smithi050.emnywo (mgr.24517) 386 : cluster [DBG] pgmap v275: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.331+0000 7f33914d7700 1 -- 172.21.15.50:0/1033021978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f338c060310 msgr2=0x7f338c0f9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.331+0000 7f33914d7700 1 --2- 172.21.15.50:0/1033021978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f338c060310 0x7f338c0f9140 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f337c004660 tx=0x7f337c009b30).stop 2023-01-04T18:24:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.331+0000 7f33914d7700 1 -- 172.21.15.50:0/1033021978 shutdown_connections 2023-01-04T18:24:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.331+0000 7f33914d7700 1 --2- 172.21.15.50:0/1033021978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f338c0f96c0 0x7f338c0fbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.331+0000 7f33914d7700 1 --2- 172.21.15.50:0/1033021978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f338c060310 0x7f338c0f9140 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.331+0000 7f33914d7700 1 -- 172.21.15.50:0/1033021978 >> 172.21.15.50:0/1033021978 conn(0x7f338c0f0bc0 msgr2=0x7f338c0f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.331+0000 7f33914d7700 1 -- 172.21.15.50:0/1033021978 shutdown_connections 2023-01-04T18:24:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.331+0000 7f33914d7700 1 -- 172.21.15.50:0/1033021978 wait complete. 2023-01-04T18:24:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.331+0000 7f33914d7700 1 Processor -- start 2023-01-04T18:24:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.332+0000 7f33914d7700 1 -- start start 2023-01-04T18:24:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.332+0000 7f33914d7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f338c060310 0x7f338c0f6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.332+0000 7f33914d7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f338c0f96c0 0x7f338c0f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.332+0000 7f33914d7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c0f55a0 con 0x7f338c0f96c0 2023-01-04T18:24:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.332+0000 7f33914d7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c0f56e0 con 0x7f338c060310 2023-01-04T18:24:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.332+0000 7f338a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f338c0f96c0 0x7f338c0f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.332+0000 7f338affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f338c060310 0x7f338c0f6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.332+0000 7f338a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f338c0f96c0 0x7f338c0f5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47842/0 (socket says 172.21.15.50:47842) 2023-01-04T18:24:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.332+0000 7f338affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f338c060310 0x7f338c0f6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.50:51218/0 (socket says 172.21.15.50:51218) 2023-01-04T18:24:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.332+0000 7f338a7fc700 1 -- 172.21.15.50:0/1644189081 learned_addr learned my addr 172.21.15.50:0/1644189081 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:24:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.332+0000 7f338a7fc700 1 -- 172.21.15.50:0/1644189081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f338c060310 msgr2=0x7f338c0f6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.332+0000 7f338a7fc700 1 --2- 172.21.15.50:0/1644189081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f338c060310 0x7f338c0f6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.332+0000 7f338a7fc700 1 -- 172.21.15.50:0/1644189081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c005040 con 0x7f338c0f96c0 2023-01-04T18:24:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.332+0000 7f338affd700 1 --2- 172.21.15.50:0/1644189081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f338c060310 0x7f338c0f6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-01-04T18:24:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.332+0000 7f338a7fc700 1 --2- 172.21.15.50:0/1644189081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f338c0f96c0 0x7f338c0f5040 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f3380002700 tx=0x7f3380009da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.333+0000 7f33737fe700 1 -- 172.21.15.50:0/1644189081 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33800079c0 con 0x7f338c0f96c0 2023-01-04T18:24:49.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.333+0000 7f33914d7700 1 -- 172.21.15.50:0/1644189081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338c0f59c0 con 0x7f338c0f96c0 2023-01-04T18:24:49.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.333+0000 7f33737fe700 1 -- 172.21.15.50:0/1644189081 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f338000f040 con 0x7f338c0f96c0 2023-01-04T18:24:49.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.333+0000 7f33737fe700 1 -- 172.21.15.50:0/1644189081 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3380014860 con 0x7f338c0f96c0 2023-01-04T18:24:49.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.333+0000 7f33914d7700 1 -- 172.21.15.50:0/1644189081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f338c10edd0 con 0x7f338c0f96c0 2023-01-04T18:24:49.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.334+0000 7f33914d7700 1 -- 172.21.15.50:0/1644189081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338c045ad0 con 0x7f338c0f96c0 2023-01-04T18:24:49.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.334+0000 7f33737fe700 1 -- 172.21.15.50:0/1644189081 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f338001b060 con 0x7f338c0f96c0 2023-01-04T18:24:49.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.334+0000 7f33737fe700 1 --2- 172.21.15.50:0/1644189081 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f3374060c30 0x7f33740630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:49.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.335+0000 7f33737fe700 1 -- 172.21.15.50:0/1644189081 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f338007bd40 con 0x7f338c0f96c0 2023-01-04T18:24:49.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.335+0000 7f338affd700 1 --2- 172.21.15.50:0/1644189081 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f3374060c30 0x7f33740630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:49.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.335+0000 7f338affd700 1 --2- 172.21.15.50:0/1644189081 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f3374060c30 0x7f33740630f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f338c0f6950 tx=0x7f337c009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:49.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.339+0000 7f33737fe700 1 -- 172.21.15.50:0/1644189081 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f338004c1a0 con 0x7f338c0f96c0 2023-01-04T18:24:49.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.533+0000 7f33914d7700 1 -- 172.21.15.50:0/1644189081 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f338c057f10 con 0x7f3374060c30 2023-01-04T18:24:49.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.535+0000 7f33737fe700 1 -- 172.21.15.50:0/1644189081 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f338c057f10 con 0x7f3374060c30 2023-01-04T18:24:49.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.537+0000 7f33914d7700 1 -- 172.21.15.50:0/1644189081 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f3374060c30 msgr2=0x7f33740630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:49.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.537+0000 7f33914d7700 1 --2- 172.21.15.50:0/1644189081 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f3374060c30 0x7f33740630f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f338c0f6950 tx=0x7f337c009b30).stop 2023-01-04T18:24:49.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.537+0000 7f33914d7700 1 -- 172.21.15.50:0/1644189081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f338c0f96c0 msgr2=0x7f338c0f5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:49.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.537+0000 7f33914d7700 1 --2- 172.21.15.50:0/1644189081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f338c0f96c0 0x7f338c0f5040 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f3380002700 tx=0x7f3380009da0).stop 2023-01-04T18:24:49.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.537+0000 7f33914d7700 1 -- 172.21.15.50:0/1644189081 shutdown_connections 2023-01-04T18:24:49.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.537+0000 7f33914d7700 1 --2- 172.21.15.50:0/1644189081 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f3374060c30 0x7f33740630f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:49.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.537+0000 7f33914d7700 1 --2- 172.21.15.50:0/1644189081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f338c060310 0x7f338c0f6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:49.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.537+0000 7f33914d7700 1 --2- 172.21.15.50:0/1644189081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f338c0f96c0 0x7f338c0f5040 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:49.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.537+0000 7f33914d7700 1 -- 172.21.15.50:0/1644189081 >> 172.21.15.50:0/1644189081 conn(0x7f338c0f0bc0 msgr2=0x7f338c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:49.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.537+0000 7f33914d7700 1 -- 172.21.15.50:0/1644189081 shutdown_connections 2023-01-04T18:24:49.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.537+0000 7f33914d7700 1 -- 172.21.15.50:0/1644189081 wait complete. 2023-01-04T18:24:49.549 INFO:teuthology.orchestra.run.smithi050.stdout:true 2023-01-04T18:24:49.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.644+0000 7fcd156df700 1 -- 172.21.15.50:0/2444026456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd100f66e0 msgr2=0x7fcd100f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:49.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.644+0000 7fcd156df700 1 --2- 172.21.15.50:0/2444026456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd100f66e0 0x7fcd100f6b00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fcd00004660 tx=0x7fcd00009b30).stop 2023-01-04T18:24:49.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.644+0000 7fcd156df700 1 -- 172.21.15.50:0/2444026456 shutdown_connections 2023-01-04T18:24:49.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.644+0000 7fcd156df700 1 --2- 172.21.15.50:0/2444026456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd100f7980 0x7fcd100f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:49.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.644+0000 7fcd156df700 1 --2- 172.21.15.50:0/2444026456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd100f66e0 0x7fcd100f6b00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:49.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.644+0000 7fcd156df700 1 -- 172.21.15.50:0/2444026456 >> 172.21.15.50:0/2444026456 conn(0x7fcd100f1e40 msgr2=0x7fcd100f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:49.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.644+0000 7fcd156df700 1 -- 172.21.15.50:0/2444026456 shutdown_connections 2023-01-04T18:24:49.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.644+0000 7fcd156df700 1 -- 172.21.15.50:0/2444026456 wait complete. 2023-01-04T18:24:49.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.645+0000 7fcd156df700 1 Processor -- start 2023-01-04T18:24:49.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.645+0000 7fcd156df700 1 -- start start 2023-01-04T18:24:49.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.645+0000 7fcd156df700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd100f66e0 0x7fcd10106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:49.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.645+0000 7fcd156df700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd100f7980 0x7fcd101074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:49.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.645+0000 7fcd156df700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd10107a70 con 0x7fcd100f66e0 2023-01-04T18:24:49.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.645+0000 7fcd156df700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd10107bb0 con 0x7fcd100f7980 2023-01-04T18:24:49.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.645+0000 7fcd0effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd100f66e0 0x7fcd10106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:49.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.645+0000 7fcd0effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd100f66e0 0x7fcd10106fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47850/0 (socket says 172.21.15.50:47850) 2023-01-04T18:24:49.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.645+0000 7fcd0effd700 1 -- 172.21.15.50:0/1394533027 learned_addr learned my addr 172.21.15.50:0/1394533027 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:24:49.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.646+0000 7fcd0e7fc700 1 --2- 172.21.15.50:0/1394533027 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd100f7980 0x7fcd101074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:49.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.646+0000 7fcd0effd700 1 -- 172.21.15.50:0/1394533027 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd100f7980 msgr2=0x7fcd101074c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:49.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.646+0000 7fcd0effd700 1 --2- 172.21.15.50:0/1394533027 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd100f7980 0x7fcd101074c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:49.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.646+0000 7fcd0effd700 1 -- 172.21.15.50:0/1394533027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd00005040 con 0x7fcd100f66e0 2023-01-04T18:24:49.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.646+0000 7fcd0effd700 1 --2- 172.21.15.50:0/1394533027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd100f66e0 0x7fcd10106fd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fcd00009f50 tx=0x7fcd00009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:49.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.646+0000 7fccf77fe700 1 -- 172.21.15.50:0/1394533027 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd00018070 con 0x7fcd100f66e0 2023-01-04T18:24:49.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.646+0000 7fccf77fe700 1 -- 172.21.15.50:0/1394533027 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcd0001d8e0 con 0x7fcd100f66e0 2023-01-04T18:24:49.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.646+0000 7fcd156df700 1 -- 172.21.15.50:0/1394533027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd101084f0 con 0x7fcd100f66e0 2023-01-04T18:24:49.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.646+0000 7fcd156df700 1 -- 172.21.15.50:0/1394533027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd10108a50 con 0x7fcd100f66e0 2023-01-04T18:24:49.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.646+0000 7fccf77fe700 1 -- 172.21.15.50:0/1394533027 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd0001c440 con 0x7fcd100f66e0 2023-01-04T18:24:49.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.647+0000 7fcd156df700 1 -- 172.21.15.50:0/1394533027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf0004fa0 con 0x7fcd100f66e0 2023-01-04T18:24:49.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.648+0000 7fccf77fe700 1 -- 172.21.15.50:0/1394533027 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fcd0001da50 con 0x7fcd100f66e0 2023-01-04T18:24:49.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.648+0000 7fccf77fe700 1 --2- 172.21.15.50:0/1394533027 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fccf8060be0 0x7fccf80630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:49.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.648+0000 7fccf77fe700 1 -- 172.21.15.50:0/1394533027 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fcd0007dbf0 con 0x7fcd100f66e0 2023-01-04T18:24:49.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.649+0000 7fcd0e7fc700 1 --2- 172.21.15.50:0/1394533027 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fccf8060be0 0x7fccf80630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:49.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.649+0000 7fcd0e7fc700 1 --2- 172.21.15.50:0/1394533027 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fccf8060be0 0x7fccf80630a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fcd04007fd0 tx=0x7fcd04009040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:49.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.653+0000 7fccf77fe700 1 -- 172.21.15.50:0/1394533027 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fcd00051b40 con 0x7fcd100f66e0 2023-01-04T18:24:49.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.846+0000 7fcd156df700 1 -- 172.21.15.50:0/1394533027 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fccf0000bc0 con 0x7fccf8060be0 2023-01-04T18:24:49.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.847+0000 7fccf77fe700 1 -- 172.21.15.50:0/1394533027 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7fccf0000bc0 con 0x7fccf8060be0 2023-01-04T18:24:49.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.849+0000 7fcd156df700 1 -- 172.21.15.50:0/1394533027 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fccf8060be0 msgr2=0x7fccf80630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:49.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.849+0000 7fcd156df700 1 --2- 172.21.15.50:0/1394533027 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fccf8060be0 0x7fccf80630a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fcd04007fd0 tx=0x7fcd04009040).stop 2023-01-04T18:24:49.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.849+0000 7fcd156df700 1 -- 172.21.15.50:0/1394533027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd100f66e0 msgr2=0x7fcd10106fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:49.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.849+0000 7fcd156df700 1 --2- 172.21.15.50:0/1394533027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd100f66e0 0x7fcd10106fd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fcd00009f50 tx=0x7fcd00009b30).stop 2023-01-04T18:24:49.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.849+0000 7fcd156df700 1 -- 172.21.15.50:0/1394533027 shutdown_connections 2023-01-04T18:24:49.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.849+0000 7fcd156df700 1 --2- 172.21.15.50:0/1394533027 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fccf8060be0 0x7fccf80630a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:49.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.849+0000 7fcd156df700 1 --2- 172.21.15.50:0/1394533027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd100f66e0 0x7fcd10106fd0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:49.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.849+0000 7fcd156df700 1 --2- 172.21.15.50:0/1394533027 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd100f7980 0x7fcd101074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:49.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.849+0000 7fcd156df700 1 -- 172.21.15.50:0/1394533027 >> 172.21.15.50:0/1394533027 conn(0x7fcd100f1e40 msgr2=0x7fcd100fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:49.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.849+0000 7fcd156df700 1 -- 172.21.15.50:0/1394533027 shutdown_connections 2023-01-04T18:24:49.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.849+0000 7fcd156df700 1 -- 172.21.15.50:0/1394533027 wait complete. 2023-01-04T18:24:49.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.950+0000 7fe7e6dc6700 1 -- 172.21.15.50:0/3592184795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7e00f6530 msgr2=0x7fe7e00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:49.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.950+0000 7fe7e6dc6700 1 --2- 172.21.15.50:0/3592184795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7e00f6530 0x7fe7e00f6950 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fe7dc004660 tx=0x7fe7dc009b30).stop 2023-01-04T18:24:49.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.950+0000 7fe7e6dc6700 1 -- 172.21.15.50:0/3592184795 shutdown_connections 2023-01-04T18:24:49.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.950+0000 7fe7e6dc6700 1 --2- 172.21.15.50:0/3592184795 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7e00f77d0 0x7fe7e00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:49.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.950+0000 7fe7e6dc6700 1 --2- 172.21.15.50:0/3592184795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7e00f6530 0x7fe7e00f6950 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:49.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.950+0000 7fe7e6dc6700 1 -- 172.21.15.50:0/3592184795 >> 172.21.15.50:0/3592184795 conn(0x7fe7e00f1c90 msgr2=0x7fe7e00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:49.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.950+0000 7fe7e6dc6700 1 -- 172.21.15.50:0/3592184795 shutdown_connections 2023-01-04T18:24:49.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.950+0000 7fe7e6dc6700 1 -- 172.21.15.50:0/3592184795 wait complete. 2023-01-04T18:24:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.950+0000 7fe7e6dc6700 1 Processor -- start 2023-01-04T18:24:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.950+0000 7fe7e6dc6700 1 -- start start 2023-01-04T18:24:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.951+0000 7fe7e6dc6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7e00f6530 0x7fe7e0106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.951+0000 7fe7e6dc6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7e00f77d0 0x7fe7e0107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.951+0000 7fe7e6dc6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e0107910 con 0x7fe7e00f77d0 2023-01-04T18:24:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.951+0000 7fe7e6dc6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e0108120 con 0x7fe7e00f6530 2023-01-04T18:24:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.951+0000 7fe7e55c3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7e00f77d0 0x7fe7e0107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.951+0000 7fe7e55c3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7e00f77d0 0x7fe7e0107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47864/0 (socket says 172.21.15.50:47864) 2023-01-04T18:24:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.951+0000 7fe7e55c3700 1 -- 172.21.15.50:0/2455128769 learned_addr learned my addr 172.21.15.50:0/2455128769 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:24:49.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.951+0000 7fe7e5dc4700 1 --2- 172.21.15.50:0/2455128769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7e00f6530 0x7fe7e0106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:49.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.951+0000 7fe7e55c3700 1 -- 172.21.15.50:0/2455128769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7e00f6530 msgr2=0x7fe7e0106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:49.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.951+0000 7fe7e55c3700 1 --2- 172.21.15.50:0/2455128769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7e00f6530 0x7fe7e0106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:49.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.951+0000 7fe7e55c3700 1 -- 172.21.15.50:0/2455128769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc005040 con 0x7fe7e00f77d0 2023-01-04T18:24:49.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.951+0000 7fe7e5dc4700 1 --2- 172.21.15.50:0/2455128769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7e00f6530 0x7fe7e0106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:24:49.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.951+0000 7fe7e55c3700 1 --2- 172.21.15.50:0/2455128769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7e00f77d0 0x7fe7e0107310 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fe7d4004f60 tx=0x7fe7d4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:49.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.951+0000 7fe7d27fc700 1 -- 172.21.15.50:0/2455128769 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7d4009500 con 0x7fe7e00f77d0 2023-01-04T18:24:49.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.951+0000 7fe7d27fc700 1 -- 172.21.15.50:0/2455128769 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe7d4016070 con 0x7fe7e00f77d0 2023-01-04T18:24:49.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.951+0000 7fe7e6dc6700 1 -- 172.21.15.50:0/2455128769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e0108340 con 0x7fe7e00f77d0 2023-01-04T18:24:49.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.951+0000 7fe7d27fc700 1 -- 172.21.15.50:0/2455128769 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7d4012d70 con 0x7fe7e00f77d0 2023-01-04T18:24:49.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.952+0000 7fe7e6dc6700 1 -- 172.21.15.50:0/2455128769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e01088d0 con 0x7fe7e00f77d0 2023-01-04T18:24:49.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.952+0000 7fe7e6dc6700 1 -- 172.21.15.50:0/2455128769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e0059100 con 0x7fe7e00f77d0 2023-01-04T18:24:49.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.953+0000 7fe7d27fc700 1 -- 172.21.15.50:0/2455128769 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fe7d4022070 con 0x7fe7e00f77d0 2023-01-04T18:24:49.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.953+0000 7fe7d27fc700 1 --2- 172.21.15.50:0/2455128769 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe7cc060c30 0x7fe7cc0630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:49.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.953+0000 7fe7d27fc700 1 -- 172.21.15.50:0/2455128769 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fe7d407fdd0 con 0x7fe7e00f77d0 2023-01-04T18:24:49.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.953+0000 7fe7e5dc4700 1 --2- 172.21.15.50:0/2455128769 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe7cc060c30 0x7fe7cc0630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:49.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.954+0000 7fe7e5dc4700 1 --2- 172.21.15.50:0/2455128769 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe7cc060c30 0x7fe7cc0630f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fe7e0106b90 tx=0x7fe7dc009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:49.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:49.957+0000 7fe7d27fc700 1 -- 172.21.15.50:0/2455128769 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fe7d40503e0 con 0x7fe7e00f77d0 2023-01-04T18:24:50.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.161+0000 7fe7e6dc6700 1 -- 172.21.15.50:0/2455128769 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7e0108ba0 con 0x7fe7cc060c30 2023-01-04T18:24:50.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.171+0000 7fe7d27fc700 1 -- 172.21.15.50:0/2455128769 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7fe7e0108ba0 con 0x7fe7cc060c30 2023-01-04T18:24:50.174 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-01-04T18:24:50.175 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager.smithi050 smithi050 *:9093,9094 running (27s) 21s ago 14m 16.0M - 0.23.0 ba2b418f427c d2cbe48f1b33 2023-01-04T18:24:50.175 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi050 smithi050 running (6m) 21s ago 14m 7050k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cfe28e5ab81e 2023-01-04T18:24:50.175 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi098 smithi098 running (6m) 50s ago 13m 7180k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cf5f0ca60522 2023-01-04T18:24:50.175 INFO:teuthology.orchestra.run.smithi050.stdout:grafana.smithi050 smithi050 *:3000 running (13m) 21s ago 14m 37.5M - 6.7.4 557c83e11646 7e5dccbafe78 2023-01-04T18:24:50.175 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.ezoiwl smithi050 running (2m) 21s ago 10m 790M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 146e50d0c3f4 2023-01-04T18:24:50.175 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.kefmuy smithi050 running (110s) 21s ago 10m 779M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 4aaf433888b2 2023-01-04T18:24:50.175 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.laynsk smithi098 running (73s) 50s ago 10m 15.7M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 76076b59594d 2023-01-04T18:24:50.175 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.memais smithi098 running (88s) 50s ago 10m 13.6M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d fdb3824282b1 2023-01-04T18:24:50.175 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi050.emnywo smithi050 *:8443,9283 running (7m) 21s ago 15m 455M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d ee677216e754 2023-01-04T18:24:50.175 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi098.vhfzum smithi098 *:8443,9283 running (7m) 50s ago 13m 397M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d f3d98bf0cf66 2023-01-04T18:24:50.176 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi050 smithi050 running (7m) 21s ago 15m 131M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 0423819cbaa7 2023-01-04T18:24:50.176 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi098 smithi098 running (6m) 50s ago 13m 108M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 12094818aefc 2023-01-04T18:24:50.176 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi050 smithi050 *:9100 running (60s) 21s ago 14m 12.2M - 1.3.1 1dbe0e931976 c372334fd87e 2023-01-04T18:24:50.176 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi098 smithi098 *:9100 running (53s) 50s ago 13m 3854k - 1.3.1 1dbe0e931976 1c32dce64f13 2023-01-04T18:24:50.176 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (6m) 21s ago 13m 359M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 60dafedcb429 2023-01-04T18:24:50.176 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi050 running (4m) 21s ago 12m 370M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 625bd99952d9 2023-01-04T18:24:50.176 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi050 running (3m) 21s ago 12m 281M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d badf94f13661 2023-01-04T18:24:50.176 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi098 running (3m) 50s ago 12m 408M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 93c4e177ba97 2023-01-04T18:24:50.176 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi098 running (2m) 50s ago 11m 377M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 9398016f5e81 2023-01-04T18:24:50.176 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi098 running (2m) 50s ago 11m 316M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 82e86a9ed864 2023-01-04T18:24:50.177 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus.smithi050 smithi050 *:9095 running (41s) 21s ago 13m 58.7M - 2.33.4 514e6a882f6e b46bdb79fd50 2023-01-04T18:24:50.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.173+0000 7fe7e6dc6700 1 -- 172.21.15.50:0/2455128769 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe7cc060c30 msgr2=0x7fe7cc0630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:50.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.173+0000 7fe7e6dc6700 1 --2- 172.21.15.50:0/2455128769 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe7cc060c30 0x7fe7cc0630f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fe7e0106b90 tx=0x7fe7dc009b30).stop 2023-01-04T18:24:50.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.173+0000 7fe7e6dc6700 1 -- 172.21.15.50:0/2455128769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7e00f77d0 msgr2=0x7fe7e0107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:50.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.173+0000 7fe7e6dc6700 1 --2- 172.21.15.50:0/2455128769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7e00f77d0 0x7fe7e0107310 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fe7d4004f60 tx=0x7fe7d4009de0).stop 2023-01-04T18:24:50.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.173+0000 7fe7e6dc6700 1 -- 172.21.15.50:0/2455128769 shutdown_connections 2023-01-04T18:24:50.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.173+0000 7fe7e6dc6700 1 --2- 172.21.15.50:0/2455128769 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe7cc060c30 0x7fe7cc0630f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:50.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.173+0000 7fe7e6dc6700 1 --2- 172.21.15.50:0/2455128769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7e00f6530 0x7fe7e0106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:50.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.173+0000 7fe7e6dc6700 1 --2- 172.21.15.50:0/2455128769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7e00f77d0 0x7fe7e0107310 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:50.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.173+0000 7fe7e6dc6700 1 -- 172.21.15.50:0/2455128769 >> 172.21.15.50:0/2455128769 conn(0x7fe7e00f1c90 msgr2=0x7fe7e00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:50.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.173+0000 7fe7e6dc6700 1 -- 172.21.15.50:0/2455128769 shutdown_connections 2023-01-04T18:24:50.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.173+0000 7fe7e6dc6700 1 -- 172.21.15.50:0/2455128769 wait complete. 2023-01-04T18:24:50.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.271+0000 7f5455a96700 1 -- 172.21.15.50:0/2836247526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54500f77d0 msgr2=0x7f54500f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:50.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.271+0000 7f5455a96700 1 --2- 172.21.15.50:0/2836247526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54500f77d0 0x7f54500f7c30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f543c004660 tx=0x7f543c009b30).stop 2023-01-04T18:24:50.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.271+0000 7f5455a96700 1 -- 172.21.15.50:0/2836247526 shutdown_connections 2023-01-04T18:24:50.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.271+0000 7f5455a96700 1 --2- 172.21.15.50:0/2836247526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54500f77d0 0x7f54500f7c30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:50.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.271+0000 7f5455a96700 1 --2- 172.21.15.50:0/2836247526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54500f6530 0x7f54500f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:50.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.271+0000 7f5455a96700 1 -- 172.21.15.50:0/2836247526 >> 172.21.15.50:0/2836247526 conn(0x7f54500f1c90 msgr2=0x7f54500f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:50.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.272+0000 7f5455a96700 1 -- 172.21.15.50:0/2836247526 shutdown_connections 2023-01-04T18:24:50.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.272+0000 7f5455a96700 1 -- 172.21.15.50:0/2836247526 wait complete. 2023-01-04T18:24:50.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.272+0000 7f5455a96700 1 Processor -- start 2023-01-04T18:24:50.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.272+0000 7f5455a96700 1 -- start start 2023-01-04T18:24:50.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.272+0000 7f5455a96700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54500f6530 0x7f5450106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:50.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.272+0000 7f5455a96700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54500f77d0 0x7f5450107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:50.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.272+0000 7f5455a96700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5450107880 con 0x7f54500f77d0 2023-01-04T18:24:50.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.272+0000 7f5455a96700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54501080c0 con 0x7f54500f6530 2023-01-04T18:24:50.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.273+0000 7f544ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54500f77d0 0x7f5450107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:50.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.273+0000 7f544ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54500f77d0 0x7f5450107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47872/0 (socket says 172.21.15.50:47872) 2023-01-04T18:24:50.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.273+0000 7f544ffff700 1 -- 172.21.15.50:0/803193359 learned_addr learned my addr 172.21.15.50:0/803193359 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:24:50.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.273+0000 7f5454a94700 1 --2- 172.21.15.50:0/803193359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54500f6530 0x7f5450106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:50.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.273+0000 7f544ffff700 1 -- 172.21.15.50:0/803193359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54500f6530 msgr2=0x7f5450106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:50.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.273+0000 7f544ffff700 1 --2- 172.21.15.50:0/803193359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54500f6530 0x7f5450106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:50.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.273+0000 7f544ffff700 1 -- 172.21.15.50:0/803193359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c005040 con 0x7f54500f77d0 2023-01-04T18:24:50.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.273+0000 7f544ffff700 1 --2- 172.21.15.50:0/803193359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54500f77d0 0x7f5450107280 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f543c009830 tx=0x7f543c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:50.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.273+0000 7f544d7fa700 1 -- 172.21.15.50:0/803193359 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f543c018070 con 0x7f54500f77d0 2023-01-04T18:24:50.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.273+0000 7f5455a96700 1 -- 172.21.15.50:0/803193359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5450108340 con 0x7f54500f77d0 2023-01-04T18:24:50.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.273+0000 7f544d7fa700 1 -- 172.21.15.50:0/803193359 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f543c01d8e0 con 0x7f54500f77d0 2023-01-04T18:24:50.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.273+0000 7f544d7fa700 1 -- 172.21.15.50:0/803193359 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f543c01c540 con 0x7f54500f77d0 2023-01-04T18:24:50.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.273+0000 7f5455a96700 1 -- 172.21.15.50:0/803193359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5450108820 con 0x7f54500f77d0 2023-01-04T18:24:50.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.274+0000 7f5455a96700 1 -- 172.21.15.50:0/803193359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5450059100 con 0x7f54500f77d0 2023-01-04T18:24:50.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.275+0000 7f544d7fa700 1 -- 172.21.15.50:0/803193359 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f543c01da50 con 0x7f54500f77d0 2023-01-04T18:24:50.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.275+0000 7f544d7fa700 1 --2- 172.21.15.50:0/803193359 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5440060c30 0x7f54400630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:50.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.275+0000 7f544d7fa700 1 -- 172.21.15.50:0/803193359 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f543c07dd00 con 0x7f54500f77d0 2023-01-04T18:24:50.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.275+0000 7f5454a94700 1 --2- 172.21.15.50:0/803193359 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5440060c30 0x7f54400630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:50.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.275+0000 7f5454a94700 1 --2- 172.21.15.50:0/803193359 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5440060c30 0x7f54400630f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f5450107b50 tx=0x7f5444009040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:50.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.279+0000 7f544d7fa700 1 -- 172.21.15.50:0/803193359 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f543c081030 con 0x7f54500f77d0 2023-01-04T18:24:50.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.529+0000 7f5455a96700 1 -- 172.21.15.50:0/803193359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5450027a00 con 0x7f54500f77d0 2023-01-04T18:24:50.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.529+0000 7f544d7fa700 1 -- 172.21.15.50:0/803193359 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+653 (secure 0 0 0) 0x7f543c04e220 con 0x7f54500f77d0 2023-01-04T18:24:50.533 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:24:50.533 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": { 2023-01-04T18:24:50.533 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:24:50.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:24:50.534 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": { 2023-01-04T18:24:50.534 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:24:50.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:24:50.534 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": { 2023-01-04T18:24:50.534 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 6 2023-01-04T18:24:50.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:24:50.534 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2023-01-04T18:24:50.534 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 4 2023-01-04T18:24:50.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:24:50.535 INFO:teuthology.orchestra.run.smithi050.stdout: "overall": { 2023-01-04T18:24:50.535 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 14 2023-01-04T18:24:50.535 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-01-04T18:24:50.535 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:24:50.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.531+0000 7f5455a96700 1 -- 172.21.15.50:0/803193359 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5440060c30 msgr2=0x7f54400630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:50.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.531+0000 7f5455a96700 1 --2- 172.21.15.50:0/803193359 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5440060c30 0x7f54400630f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f5450107b50 tx=0x7f5444009040).stop 2023-01-04T18:24:50.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.531+0000 7f5455a96700 1 -- 172.21.15.50:0/803193359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54500f77d0 msgr2=0x7f5450107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:50.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.531+0000 7f5455a96700 1 --2- 172.21.15.50:0/803193359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54500f77d0 0x7f5450107280 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f543c009830 tx=0x7f543c009b30).stop 2023-01-04T18:24:50.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.531+0000 7f5455a96700 1 -- 172.21.15.50:0/803193359 shutdown_connections 2023-01-04T18:24:50.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.531+0000 7f5455a96700 1 --2- 172.21.15.50:0/803193359 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5440060c30 0x7f54400630f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:50.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.531+0000 7f5455a96700 1 --2- 172.21.15.50:0/803193359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54500f6530 0x7f5450106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:50.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.531+0000 7f5455a96700 1 --2- 172.21.15.50:0/803193359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54500f77d0 0x7f5450107280 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:50.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.531+0000 7f5455a96700 1 -- 172.21.15.50:0/803193359 >> 172.21.15.50:0/803193359 conn(0x7f54500f1c90 msgr2=0x7f54500fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:50.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.531+0000 7f5455a96700 1 -- 172.21.15.50:0/803193359 shutdown_connections 2023-01-04T18:24:50.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.531+0000 7f5455a96700 1 -- 172.21.15.50:0/803193359 wait complete. 2023-01-04T18:24:50.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:48.703183+0000 mgr.smithi050.emnywo (mgr.24517) 387 : cluster [DBG] pgmap v276: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:50.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:49.534899+0000 mgr.smithi050.emnywo (mgr.24517) 388 : audit [DBG] from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:24:50.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.635+0000 7f2f41b43700 1 -- 172.21.15.50:0/53569659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f3c0f6530 msgr2=0x7f2f3c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:50.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.635+0000 7f2f41b43700 1 --2- 172.21.15.50:0/53569659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f3c0f6530 0x7f2f3c0f6950 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f2f30004660 tx=0x7f2f30009b30).stop 2023-01-04T18:24:50.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.635+0000 7f2f41b43700 1 -- 172.21.15.50:0/53569659 shutdown_connections 2023-01-04T18:24:50.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.635+0000 7f2f41b43700 1 --2- 172.21.15.50:0/53569659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f3c0f77d0 0x7f2f3c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:50.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.635+0000 7f2f41b43700 1 --2- 172.21.15.50:0/53569659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f3c0f6530 0x7f2f3c0f6950 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:50.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.635+0000 7f2f41b43700 1 -- 172.21.15.50:0/53569659 >> 172.21.15.50:0/53569659 conn(0x7f2f3c0f1c90 msgr2=0x7f2f3c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:50.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.635+0000 7f2f41b43700 1 -- 172.21.15.50:0/53569659 shutdown_connections 2023-01-04T18:24:50.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.635+0000 7f2f41b43700 1 -- 172.21.15.50:0/53569659 wait complete. 2023-01-04T18:24:50.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.635+0000 7f2f41b43700 1 Processor -- start 2023-01-04T18:24:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.636+0000 7f2f41b43700 1 -- start start 2023-01-04T18:24:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.636+0000 7f2f41b43700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f3c0f6530 0x7f2f3c106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.636+0000 7f2f41b43700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f3c0f77d0 0x7f2f3c107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.636+0000 7f2f41b43700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c107900 con 0x7f2f3c0f6530 2023-01-04T18:24:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.636+0000 7f2f41b43700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c108110 con 0x7f2f3c0f77d0 2023-01-04T18:24:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.636+0000 7f2f40b41700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f3c0f6530 0x7f2f3c106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.636+0000 7f2f40b41700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f3c0f6530 0x7f2f3c106e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47880/0 (socket says 172.21.15.50:47880) 2023-01-04T18:24:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.636+0000 7f2f40b41700 1 -- 172.21.15.50:0/1391838200 learned_addr learned my addr 172.21.15.50:0/1391838200 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:24:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.636+0000 7f2f3bfff700 1 --2- 172.21.15.50:0/1391838200 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f3c0f77d0 0x7f2f3c107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:50.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.636+0000 7f2f40b41700 1 -- 172.21.15.50:0/1391838200 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f3c0f77d0 msgr2=0x7f2f3c107300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.636+0000 7f2f40b41700 1 --2- 172.21.15.50:0/1391838200 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f3c0f77d0 0x7f2f3c107300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.636+0000 7f2f40b41700 1 -- 172.21.15.50:0/1391838200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f30005040 con 0x7f2f3c0f6530 2023-01-04T18:24:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.636+0000 7f2f3bfff700 1 --2- 172.21.15.50:0/1391838200 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f3c0f77d0 0x7f2f3c107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:24:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.637+0000 7f2f40b41700 1 --2- 172.21.15.50:0/1391838200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f3c0f6530 0x7f2f3c106e10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f2f30014040 tx=0x7f2f3000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.637+0000 7f2f397fa700 1 -- 172.21.15.50:0/1391838200 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f30019070 con 0x7f2f3c0f6530 2023-01-04T18:24:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.637+0000 7f2f41b43700 1 -- 172.21.15.50:0/1391838200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3c108330 con 0x7f2f3c0f6530 2023-01-04T18:24:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.637+0000 7f2f397fa700 1 -- 172.21.15.50:0/1391838200 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2f3001e420 con 0x7f2f3c0f6530 2023-01-04T18:24:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.637+0000 7f2f397fa700 1 -- 172.21.15.50:0/1391838200 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f30014660 con 0x7f2f3c0f6530 2023-01-04T18:24:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.637+0000 7f2f41b43700 1 -- 172.21.15.50:0/1391838200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3c108810 con 0x7f2f3c0f6530 2023-01-04T18:24:50.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.638+0000 7f2f41b43700 1 -- 172.21.15.50:0/1391838200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f3c059100 con 0x7f2f3c0f6530 2023-01-04T18:24:50.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.638+0000 7f2f397fa700 1 -- 172.21.15.50:0/1391838200 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f2f3001e9e0 con 0x7f2f3c0f6530 2023-01-04T18:24:50.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.639+0000 7f2f397fa700 1 --2- 172.21.15.50:0/1391838200 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2f2c060c30 0x7f2f2c0630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:50.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.639+0000 7f2f397fa700 1 -- 172.21.15.50:0/1391838200 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f2f3007d2d0 con 0x7f2f3c0f6530 2023-01-04T18:24:50.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.639+0000 7f2f3bfff700 1 --2- 172.21.15.50:0/1391838200 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2f2c060c30 0x7f2f2c0630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:50.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.639+0000 7f2f3bfff700 1 --2- 172.21.15.50:0/1391838200 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2f2c060c30 0x7f2f2c0630f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f2f28007fc0 tx=0x7f2f2800b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:50.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.643+0000 7f2f397fa700 1 -- 172.21.15.50:0/1391838200 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f2f3004d7f0 con 0x7f2f3c0f6530 2023-01-04T18:24:50.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:48.703183+0000 mgr.smithi050.emnywo (mgr.24517) 387 : cluster [DBG] pgmap v276: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:50.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:49.534899+0000 mgr.smithi050.emnywo (mgr.24517) 388 : audit [DBG] from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:24:50.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.872+0000 7f2f41b43700 1 -- 172.21.15.50:0/1391838200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2f3c027a00 con 0x7f2f3c0f6530 2023-01-04T18:24:50.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.872+0000 7f2f397fa700 1 -- 172.21.15.50:0/1391838200 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1791 (secure 0 0 0) 0x7f2f30004490 con 0x7f2f3c0f6530 2023-01-04T18:24:50.876 INFO:teuthology.orchestra.run.smithi050.stdout:e36 2023-01-04T18:24:50.876 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:24:50.876 INFO:teuthology.orchestra.run.smithi050.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:24:50.877 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-01-04T18:24:50.877 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:24:50.877 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-01-04T18:24:50.877 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-01-04T18:24:50.877 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 36 2023-01-04T18:24:50.877 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 2023-01-04T18:24:50.877 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:24:50.877 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-01-04T18:23:41.431715+0000 2023-01-04T18:24:50.877 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-01-04T18:24:50.878 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-01-04T18:24:50.878 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 60 2023-01-04T18:24:50.878 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-01-04T18:24:50.878 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-01-04T18:24:50.878 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-01-04T18:24:50.878 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-01-04T18:24:50.878 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 95 2023-01-04T18:24:50.878 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:24:50.878 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 1 2023-01-04T18:24:50.879 INFO:teuthology.orchestra.run.smithi050.stdout:in 0 2023-01-04T18:24:50.879 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=34362} 2023-01-04T18:24:50.879 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-01-04T18:24:50.879 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-01-04T18:24:50.879 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-01-04T18:24:50.880 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-01-04T18:24:50.880 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-01-04T18:24:50.880 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data enabled 2023-01-04T18:24:50.880 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-01-04T18:24:50.881 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 1 2023-01-04T18:24:50.881 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.ezoiwl{0:34362} state up:active seq 17 join_fscid=1 addr [v2:172.21.15.50:6826/336562041,v1:172.21.15.50:6827/336562041] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:24:50.881 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.kefmuy{0:34366} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.50:6828/2188030488,v1:172.21.15.50:6829/2188030488] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:24:50.881 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:24:50.881 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:24:50.882 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2023-01-04T18:24:50.882 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:24:50.882 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.memais{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.98:6824/4224872601,v1:172.21.15.98:6825/4224872601] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:24:50.882 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.laynsk{-1:44317} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.98:6826/503298078,v1:172.21.15.98:6827/503298078] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:24:50.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.874+0000 7f2f41b43700 1 -- 172.21.15.50:0/1391838200 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2f2c060c30 msgr2=0x7f2f2c0630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:50.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.874+0000 7f2f41b43700 1 --2- 172.21.15.50:0/1391838200 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2f2c060c30 0x7f2f2c0630f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f2f28007fc0 tx=0x7f2f2800b040).stop 2023-01-04T18:24:50.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.874+0000 7f2f41b43700 1 -- 172.21.15.50:0/1391838200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f3c0f6530 msgr2=0x7f2f3c106e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:50.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.874+0000 7f2f41b43700 1 --2- 172.21.15.50:0/1391838200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f3c0f6530 0x7f2f3c106e10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f2f30014040 tx=0x7f2f3000b040).stop 2023-01-04T18:24:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.875+0000 7f2f41b43700 1 -- 172.21.15.50:0/1391838200 shutdown_connections 2023-01-04T18:24:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.875+0000 7f2f41b43700 1 --2- 172.21.15.50:0/1391838200 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2f2c060c30 0x7f2f2c0630f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.875+0000 7f2f41b43700 1 --2- 172.21.15.50:0/1391838200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f3c0f6530 0x7f2f3c106e10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.875+0000 7f2f41b43700 1 --2- 172.21.15.50:0/1391838200 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f3c0f77d0 0x7f2f3c107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.875+0000 7f2f41b43700 1 -- 172.21.15.50:0/1391838200 >> 172.21.15.50:0/1391838200 conn(0x7f2f3c0f1c90 msgr2=0x7f2f3c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:50.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.875+0000 7f2f41b43700 1 -- 172.21.15.50:0/1391838200 shutdown_connections 2023-01-04T18:24:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.875+0000 7f2f41b43700 1 -- 172.21.15.50:0/1391838200 wait complete. 2023-01-04T18:24:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 36 2023-01-04T18:24:50.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.982+0000 7f880b7e4700 1 -- 172.21.15.50:0/3558199703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88040f66e0 msgr2=0x7f88040f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:50.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.982+0000 7f880b7e4700 1 --2- 172.21.15.50:0/3558199703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88040f66e0 0x7f88040f6b00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f8800004660 tx=0x7f8800009b30).stop 2023-01-04T18:24:50.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.982+0000 7f880b7e4700 1 -- 172.21.15.50:0/3558199703 shutdown_connections 2023-01-04T18:24:50.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.982+0000 7f880b7e4700 1 --2- 172.21.15.50:0/3558199703 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88040f7980 0x7f88040f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:50.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.982+0000 7f880b7e4700 1 --2- 172.21.15.50:0/3558199703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88040f66e0 0x7f88040f6b00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:50.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.982+0000 7f880b7e4700 1 -- 172.21.15.50:0/3558199703 >> 172.21.15.50:0/3558199703 conn(0x7f88040f1e40 msgr2=0x7f88040f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:50.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.982+0000 7f880b7e4700 1 -- 172.21.15.50:0/3558199703 shutdown_connections 2023-01-04T18:24:50.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.982+0000 7f880b7e4700 1 -- 172.21.15.50:0/3558199703 wait complete. 2023-01-04T18:24:50.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.983+0000 7f880b7e4700 1 Processor -- start 2023-01-04T18:24:50.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.983+0000 7f880b7e4700 1 -- start start 2023-01-04T18:24:50.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.983+0000 7f880b7e4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88040f66e0 0x7f8804106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:50.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.983+0000 7f880b7e4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88040f7980 0x7f88041074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:50.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.983+0000 7f880b7e4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8804107a70 con 0x7f88040f7980 2023-01-04T18:24:50.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.983+0000 7f880b7e4700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8804107bb0 con 0x7f88040f66e0 2023-01-04T18:24:50.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.983+0000 7f8808d7f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88040f7980 0x7f88041074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:50.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.983+0000 7f8808d7f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88040f7980 0x7f88041074c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47900/0 (socket says 172.21.15.50:47900) 2023-01-04T18:24:50.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.983+0000 7f8808d7f700 1 -- 172.21.15.50:0/1996948014 learned_addr learned my addr 172.21.15.50:0/1996948014 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:24:50.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.983+0000 7f8809580700 1 --2- 172.21.15.50:0/1996948014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88040f66e0 0x7f8804106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:50.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.983+0000 7f8808d7f700 1 -- 172.21.15.50:0/1996948014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88040f66e0 msgr2=0x7f8804106fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:50.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.983+0000 7f8808d7f700 1 --2- 172.21.15.50:0/1996948014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88040f66e0 0x7f8804106fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:50.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.983+0000 7f8808d7f700 1 -- 172.21.15.50:0/1996948014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8800005040 con 0x7f88040f7980 2023-01-04T18:24:50.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.984+0000 7f8808d7f700 1 --2- 172.21.15.50:0/1996948014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88040f7980 0x7f88041074c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f87f40026d0 tx=0x7f87f4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:50.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.984+0000 7f87f9ffb700 1 -- 172.21.15.50:0/1996948014 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87f40079c0 con 0x7f88040f7980 2023-01-04T18:24:50.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.984+0000 7f87f9ffb700 1 -- 172.21.15.50:0/1996948014 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f87f400f040 con 0x7f88040f7980 2023-01-04T18:24:50.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.984+0000 7f880b7e4700 1 -- 172.21.15.50:0/1996948014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8804108550 con 0x7f88040f7980 2023-01-04T18:24:50.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.984+0000 7f87f9ffb700 1 -- 172.21.15.50:0/1996948014 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87f4014980 con 0x7f88040f7980 2023-01-04T18:24:50.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.984+0000 7f880b7e4700 1 -- 172.21.15.50:0/1996948014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8804108b10 con 0x7f88040f7980 2023-01-04T18:24:50.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.985+0000 7f880b7e4700 1 -- 172.21.15.50:0/1996948014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8804045ad0 con 0x7f88040f7980 2023-01-04T18:24:50.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.985+0000 7f87f9ffb700 1 -- 172.21.15.50:0/1996948014 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f87f4014ae0 con 0x7f88040f7980 2023-01-04T18:24:50.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.985+0000 7f87f9ffb700 1 --2- 172.21.15.50:0/1996948014 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f87f0060be0 0x7f87f00630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:24:50.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.986+0000 7f87f9ffb700 1 -- 172.21.15.50:0/1996948014 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f87f407bcd0 con 0x7f88040f7980 2023-01-04T18:24:50.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.986+0000 7f8809580700 1 --2- 172.21.15.50:0/1996948014 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f87f0060be0 0x7f87f00630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:24:50.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.986+0000 7f8809580700 1 --2- 172.21.15.50:0/1996948014 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f87f0060be0 0x7f87f00630a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f8800004630 tx=0x7f8800009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:24:50.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:50.990+0000 7f87f9ffb700 1 -- 172.21.15.50:0/1996948014 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f87f404fca0 con 0x7f88040f7980 2023-01-04T18:24:51.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:51.195+0000 7f880b7e4700 1 -- 172.21.15.50:0/1996948014 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8804108de0 con 0x7f87f0060be0 2023-01-04T18:24:51.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:51.196+0000 7f87f9ffb700 1 -- 172.21.15.50:0/1996948014 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f8804108de0 con 0x7f87f0060be0 2023-01-04T18:24:51.199 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:24:51.199 INFO:teuthology.orchestra.run.smithi050.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:195f34c2f419a298e7bc2278815b4fa5f4528fa87d00e1a80f3eb5b569b31308", 2023-01-04T18:24:51.199 INFO:teuthology.orchestra.run.smithi050.stdout: "in_progress": true, 2023-01-04T18:24:51.200 INFO:teuthology.orchestra.run.smithi050.stdout: "which": "Upgrading all daemon types on all hosts", 2023-01-04T18:24:51.200 INFO:teuthology.orchestra.run.smithi050.stdout: "services_complete": [ 2023-01-04T18:24:51.200 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr", 2023-01-04T18:24:51.200 INFO:teuthology.orchestra.run.smithi050.stdout: "mon", 2023-01-04T18:24:51.200 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2023-01-04T18:24:51.200 INFO:teuthology.orchestra.run.smithi050.stdout: "osd", 2023-01-04T18:24:51.200 INFO:teuthology.orchestra.run.smithi050.stdout: "mds" 2023-01-04T18:24:51.201 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-01-04T18:24:51.201 INFO:teuthology.orchestra.run.smithi050.stdout: "progress": "16/21 daemons upgraded", 2023-01-04T18:24:51.201 INFO:teuthology.orchestra.run.smithi050.stdout: "message": "Currently upgrading grafana daemons", 2023-01-04T18:24:51.201 INFO:teuthology.orchestra.run.smithi050.stdout: "is_paused": false 2023-01-04T18:24:51.201 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:24:51.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:51.198+0000 7f880b7e4700 1 -- 172.21.15.50:0/1996948014 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f87f0060be0 msgr2=0x7f87f00630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:51.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:51.198+0000 7f880b7e4700 1 --2- 172.21.15.50:0/1996948014 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f87f0060be0 0x7f87f00630a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f8800004630 tx=0x7f8800009b30).stop 2023-01-04T18:24:51.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:51.198+0000 7f880b7e4700 1 -- 172.21.15.50:0/1996948014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88040f7980 msgr2=0x7f88041074c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:24:51.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:51.198+0000 7f880b7e4700 1 --2- 172.21.15.50:0/1996948014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88040f7980 0x7f88041074c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f87f40026d0 tx=0x7f87f4009de0).stop 2023-01-04T18:24:51.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:51.198+0000 7f880b7e4700 1 -- 172.21.15.50:0/1996948014 shutdown_connections 2023-01-04T18:24:51.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:51.198+0000 7f880b7e4700 1 --2- 172.21.15.50:0/1996948014 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f87f0060be0 0x7f87f00630a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:51.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:51.198+0000 7f880b7e4700 1 --2- 172.21.15.50:0/1996948014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88040f66e0 0x7f8804106fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:51.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:51.198+0000 7f880b7e4700 1 --2- 172.21.15.50:0/1996948014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88040f7980 0x7f88041074c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:24:51.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:51.198+0000 7f880b7e4700 1 -- 172.21.15.50:0/1996948014 >> 172.21.15.50:0/1996948014 conn(0x7f88040f1e40 msgr2=0x7f88040fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:24:51.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:51.198+0000 7f880b7e4700 1 -- 172.21.15.50:0/1996948014 shutdown_connections 2023-01-04T18:24:51.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:24:51.198+0000 7f880b7e4700 1 -- 172.21.15.50:0/1996948014 wait complete. 2023-01-04T18:24:51.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:51 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:49.847231+0000 mgr.smithi050.emnywo (mgr.24517) 389 : audit [DBG] from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:24:51.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:51 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:50.162949+0000 mgr.smithi050.emnywo (mgr.24517) 390 : audit [DBG] from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:24:51.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:51 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:50.530965+0000 mon.smithi050 (mon.0) 734 : audit [DBG] from='client.? 172.21.15.50:0/803193359' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:51.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:51 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:50.874088+0000 mon.smithi050 (mon.0) 735 : audit [DBG] from='client.? 172.21.15.50:0/1391838200' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:24:51.690 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:49.847231+0000 mgr.smithi050.emnywo (mgr.24517) 389 : audit [DBG] from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:24:51.690 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:50.162949+0000 mgr.smithi050.emnywo (mgr.24517) 390 : audit [DBG] from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:24:51.691 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:50.530965+0000 mon.smithi050 (mon.0) 734 : audit [DBG] from='client.? 172.21.15.50:0/803193359' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:24:51.691 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:50.874088+0000 mon.smithi050 (mon.0) 735 : audit [DBG] from='client.? 172.21.15.50:0/1391838200' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:24:52.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:50.703689+0000 mgr.smithi050.emnywo (mgr.24517) 391 : cluster [DBG] pgmap v277: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:24:52.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:24:51.197031+0000 mgr.smithi050.emnywo (mgr.24517) 392 : audit [DBG] from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:24:52.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:50.703689+0000 mgr.smithi050.emnywo (mgr.24517) 391 : cluster [DBG] pgmap v277: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:24:52.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:24:51.197031+0000 mgr.smithi050.emnywo (mgr.24517) 392 : audit [DBG] from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:24:54.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:52.704353+0000 mgr.smithi050.emnywo (mgr.24517) 393 : cluster [DBG] pgmap v278: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:54.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:52.704353+0000 mgr.smithi050.emnywo (mgr.24517) 393 : cluster [DBG] pgmap v278: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:56.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:54.704766+0000 mgr.smithi050.emnywo (mgr.24517) 394 : cluster [DBG] pgmap v279: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:24:56.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:54.704766+0000 mgr.smithi050.emnywo (mgr.24517) 394 : cluster [DBG] pgmap v279: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:24:58.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:24:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:56.706836+0000 mgr.smithi050.emnywo (mgr.24517) 395 : cluster [DBG] pgmap v280: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:24:58.662 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:24:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:56.706836+0000 mgr.smithi050.emnywo (mgr.24517) 395 : cluster [DBG] pgmap v280: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:00.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:24:58.707235+0000 mgr.smithi050.emnywo (mgr.24517) 396 : cluster [DBG] pgmap v281: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:00.648 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:24:58.707235+0000 mgr.smithi050.emnywo (mgr.24517) 396 : cluster [DBG] pgmap v281: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:02.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:00.707683+0000 mgr.smithi050.emnywo (mgr.24517) 397 : cluster [DBG] pgmap v282: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:02.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:02.067109+0000 mon.smithi050 (mon.0) 736 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:25:02.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:02.067879+0000 mon.smithi050 (mon.0) 737 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:25:02.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:02.068963+0000 mon.smithi050 (mon.0) 738 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:25:02.791 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:02.069572+0000 mon.smithi050 (mon.0) 739 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:25:02.833 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:00.707683+0000 mgr.smithi050.emnywo (mgr.24517) 397 : cluster [DBG] pgmap v282: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:02.834 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:02.067109+0000 mon.smithi050 (mon.0) 736 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:25:02.834 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:02.067879+0000 mon.smithi050 (mon.0) 737 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:25:02.834 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:02.068963+0000 mon.smithi050 (mon.0) 738 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:25:02.834 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:02.069572+0000 mon.smithi050 (mon.0) 739 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:25:03.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:03 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:25:02.070133+0000 mgr.smithi050.emnywo (mgr.24517) 398 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:25:03.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:03 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:25:02.070133+0000 mgr.smithi050.emnywo (mgr.24517) 398 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:25:04.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:02.708137+0000 mgr.smithi050.emnywo (mgr.24517) 399 : cluster [DBG] pgmap v283: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:04.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:02.708137+0000 mgr.smithi050.emnywo (mgr.24517) 399 : cluster [DBG] pgmap v283: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:06.790 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:04.708582+0000 mgr.smithi050.emnywo (mgr.24517) 400 : cluster [DBG] pgmap v284: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:06.830 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:04.708582+0000 mgr.smithi050.emnywo (mgr.24517) 400 : cluster [DBG] pgmap v284: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:08.041 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:06.709085+0000 mgr.smithi050.emnywo (mgr.24517) 401 : cluster [DBG] pgmap v285: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:08.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:06.747210+0000 mon.smithi050 (mon.0) 740 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:25:08.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.156926+0000 mon.smithi050 (mon.0) 741 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:25:08.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.163221+0000 mon.smithi050 (mon.0) 742 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-01-04T18:25:08.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.163578+0000 mgr.smithi050.emnywo (mgr.24517) 402 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-01-04T18:25:08.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.164369+0000 mon.smithi050 (mon.0) 743 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi050.front.sepia.ceph.com:3000"}]: dispatch 2023-01-04T18:25:08.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.164639+0000 mgr.smithi050.emnywo (mgr.24517) 403 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi050.front.sepia.ceph.com:3000"}]: dispatch 2023-01-04T18:25:08.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.168431+0000 mon.smithi050 (mon.0) 744 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:25:08.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.171505+0000 mon.smithi050 (mon.0) 745 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:25:08.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.173846+0000 mon.smithi050 (mon.0) 746 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.175025+0000 mon.smithi050 (mon.0) 747 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.176135+0000 mon.smithi050 (mon.0) 748 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.177642+0000 mon.smithi050 (mon.0) 749 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.179307+0000 mon.smithi050 (mon.0) 750 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.180355+0000 mon.smithi050 (mon.0) 751 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.181286+0000 mon.smithi050 (mon.0) 752 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.182233+0000 mon.smithi050 (mon.0) 753 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.183175+0000 mon.smithi050 (mon.0) 754 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.184043+0000 mon.smithi050 (mon.0) 755 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.185267+0000 mon.smithi050 (mon.0) 756 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.186351+0000 mon.smithi050 (mon.0) 757 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.043 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.187423+0000 mon.smithi050 (mon.0) 758 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.044 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.188511+0000 mon.smithi050 (mon.0) 759 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.044 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:25:07.189069+0000 mgr.smithi050.emnywo (mgr.24517) 404 : cephadm [INF] Upgrade: Finalizing container_image settings 2023-01-04T18:25:08.044 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.192960+0000 mon.smithi050 (mon.0) 760 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:25:08.044 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.193622+0000 mon.smithi050 (mon.0) 761 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2023-01-04T18:25:08.044 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.196675+0000 mon.smithi050 (mon.0) 762 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2023-01-04T18:25:08.044 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.197242+0000 mon.smithi050 (mon.0) 763 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-01-04T18:25:08.044 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.199936+0000 mon.smithi050 (mon.0) 764 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2023-01-04T18:25:08.044 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.200520+0000 mon.smithi050 (mon.0) 765 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2023-01-04T18:25:08.044 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.203182+0000 mon.smithi050 (mon.0) 766 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2023-01-04T18:25:08.044 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.203748+0000 mon.smithi050 (mon.0) 767 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2023-01-04T18:25:08.044 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.206423+0000 mon.smithi050 (mon.0) 768 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2023-01-04T18:25:08.045 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.206962+0000 mon.smithi050 (mon.0) 769 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2023-01-04T18:25:08.045 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.209557+0000 mon.smithi050 (mon.0) 770 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2023-01-04T18:25:08.045 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.210089+0000 mon.smithi050 (mon.0) 771 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2023-01-04T18:25:08.045 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.212721+0000 mon.smithi050 (mon.0) 772 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2023-01-04T18:25:08.045 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.213282+0000 mon.smithi050 (mon.0) 773 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2023-01-04T18:25:08.046 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.216119+0000 mon.smithi050 (mon.0) 774 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2023-01-04T18:25:08.046 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.216677+0000 mon.smithi050 (mon.0) 775 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-01-04T18:25:08.046 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.217190+0000 mon.smithi050 (mon.0) 776 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2023-01-04T18:25:08.046 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.219876+0000 mon.smithi050 (mon.0) 777 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2023-01-04T18:25:08.046 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.220461+0000 mon.smithi050 (mon.0) 778 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2023-01-04T18:25:08.046 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.223086+0000 mon.smithi050 (mon.0) 779 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2023-01-04T18:25:08.046 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.223669+0000 mon.smithi050 (mon.0) 780 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-01-04T18:25:08.046 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.224218+0000 mon.smithi050 (mon.0) 781 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-01-04T18:25:08.046 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.224753+0000 mon.smithi050 (mon.0) 782 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-01-04T18:25:08.047 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.225287+0000 mon.smithi050 (mon.0) 783 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-01-04T18:25:08.047 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.225810+0000 mon.smithi050 (mon.0) 784 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2023-01-04T18:25:08.047 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.228951+0000 mon.smithi050 (mon.0) 785 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2023-01-04T18:25:08.047 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:25:07.229426+0000 mgr.smithi050.emnywo (mgr.24517) 405 : cephadm [INF] Upgrade: Complete! 2023-01-04T18:25:08.047 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.229785+0000 mon.smithi050 (mon.0) 786 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2023-01-04T18:25:08.047 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.231754+0000 mon.smithi050 (mon.0) 787 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2023-01-04T18:25:08.047 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.232144+0000 mon.smithi050 (mon.0) 788 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:25:08.047 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.233112+0000 mon.smithi050 (mon.0) 789 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:25:08.047 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.233706+0000 mon.smithi050 (mon.0) 790 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:25:08.047 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:25:07.234241+0000 mgr.smithi050.emnywo (mgr.24517) 406 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:25:08.048 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.237221+0000 mon.smithi050 (mon.0) 791 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:25:08.048 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.242055+0000 mon.smithi050 (mon.0) 792 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:25:08.048 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.243098+0000 mon.smithi050 (mon.0) 793 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:25:08.048 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.243682+0000 mon.smithi050 (mon.0) 794 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:25:08.048 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:25:07.244220+0000 mgr.smithi050.emnywo (mgr.24517) 407 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:25:08.048 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:07 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:07.247129+0000 mon.smithi050 (mon.0) 795 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:25:08.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:06.709085+0000 mgr.smithi050.emnywo (mgr.24517) 401 : cluster [DBG] pgmap v285: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:08.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:06.747210+0000 mon.smithi050 (mon.0) 740 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:25:08.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.156926+0000 mon.smithi050 (mon.0) 741 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:25:08.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.163221+0000 mon.smithi050 (mon.0) 742 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-01-04T18:25:08.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.163578+0000 mgr.smithi050.emnywo (mgr.24517) 402 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-01-04T18:25:08.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.164369+0000 mon.smithi050 (mon.0) 743 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi050.front.sepia.ceph.com:3000"}]: dispatch 2023-01-04T18:25:08.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.164639+0000 mgr.smithi050.emnywo (mgr.24517) 403 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi050.front.sepia.ceph.com:3000"}]: dispatch 2023-01-04T18:25:08.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.168431+0000 mon.smithi050 (mon.0) 744 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:25:08.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.171505+0000 mon.smithi050 (mon.0) 745 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:25:08.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.173846+0000 mon.smithi050 (mon.0) 746 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.175025+0000 mon.smithi050 (mon.0) 747 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.176135+0000 mon.smithi050 (mon.0) 748 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.177642+0000 mon.smithi050 (mon.0) 749 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.179307+0000 mon.smithi050 (mon.0) 750 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.180355+0000 mon.smithi050 (mon.0) 751 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.181286+0000 mon.smithi050 (mon.0) 752 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.182233+0000 mon.smithi050 (mon.0) 753 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.183175+0000 mon.smithi050 (mon.0) 754 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.184043+0000 mon.smithi050 (mon.0) 755 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.185267+0000 mon.smithi050 (mon.0) 756 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.186351+0000 mon.smithi050 (mon.0) 757 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.187423+0000 mon.smithi050 (mon.0) 758 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.188511+0000 mon.smithi050 (mon.0) 759 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:08.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:25:07.189069+0000 mgr.smithi050.emnywo (mgr.24517) 404 : cephadm [INF] Upgrade: Finalizing container_image settings 2023-01-04T18:25:08.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.192960+0000 mon.smithi050 (mon.0) 760 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:25:08.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.193622+0000 mon.smithi050 (mon.0) 761 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2023-01-04T18:25:08.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.196675+0000 mon.smithi050 (mon.0) 762 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2023-01-04T18:25:08.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.197242+0000 mon.smithi050 (mon.0) 763 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-01-04T18:25:08.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.199936+0000 mon.smithi050 (mon.0) 764 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2023-01-04T18:25:08.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.200520+0000 mon.smithi050 (mon.0) 765 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2023-01-04T18:25:08.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.203182+0000 mon.smithi050 (mon.0) 766 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2023-01-04T18:25:08.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.203748+0000 mon.smithi050 (mon.0) 767 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2023-01-04T18:25:08.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.206423+0000 mon.smithi050 (mon.0) 768 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2023-01-04T18:25:08.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.206962+0000 mon.smithi050 (mon.0) 769 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2023-01-04T18:25:08.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.209557+0000 mon.smithi050 (mon.0) 770 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2023-01-04T18:25:08.084 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.210089+0000 mon.smithi050 (mon.0) 771 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2023-01-04T18:25:08.085 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.212721+0000 mon.smithi050 (mon.0) 772 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2023-01-04T18:25:08.085 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.213282+0000 mon.smithi050 (mon.0) 773 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2023-01-04T18:25:08.085 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.216119+0000 mon.smithi050 (mon.0) 774 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2023-01-04T18:25:08.085 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.216677+0000 mon.smithi050 (mon.0) 775 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-01-04T18:25:08.085 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.217190+0000 mon.smithi050 (mon.0) 776 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2023-01-04T18:25:08.085 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.219876+0000 mon.smithi050 (mon.0) 777 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2023-01-04T18:25:08.085 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.220461+0000 mon.smithi050 (mon.0) 778 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2023-01-04T18:25:08.085 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.223086+0000 mon.smithi050 (mon.0) 779 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2023-01-04T18:25:08.085 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.223669+0000 mon.smithi050 (mon.0) 780 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-01-04T18:25:08.085 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.224218+0000 mon.smithi050 (mon.0) 781 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-01-04T18:25:08.085 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.224753+0000 mon.smithi050 (mon.0) 782 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-01-04T18:25:08.085 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.225287+0000 mon.smithi050 (mon.0) 783 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-01-04T18:25:08.086 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.225810+0000 mon.smithi050 (mon.0) 784 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2023-01-04T18:25:08.086 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.228951+0000 mon.smithi050 (mon.0) 785 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2023-01-04T18:25:08.086 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:25:07.229426+0000 mgr.smithi050.emnywo (mgr.24517) 405 : cephadm [INF] Upgrade: Complete! 2023-01-04T18:25:08.086 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.229785+0000 mon.smithi050 (mon.0) 786 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2023-01-04T18:25:08.086 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.231754+0000 mon.smithi050 (mon.0) 787 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2023-01-04T18:25:08.086 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.232144+0000 mon.smithi050 (mon.0) 788 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:25:08.086 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.233112+0000 mon.smithi050 (mon.0) 789 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:25:08.086 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.233706+0000 mon.smithi050 (mon.0) 790 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:25:08.086 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:25:07.234241+0000 mgr.smithi050.emnywo (mgr.24517) 406 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:25:08.086 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.237221+0000 mon.smithi050 (mon.0) 791 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:25:08.087 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.242055+0000 mon.smithi050 (mon.0) 792 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:25:08.087 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.243098+0000 mon.smithi050 (mon.0) 793 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:25:08.087 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.243682+0000 mon.smithi050 (mon.0) 794 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:25:08.087 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:25:07.244220+0000 mgr.smithi050.emnywo (mgr.24517) 407 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:25:08.087 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:07 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:07.247129+0000 mon.smithi050 (mon.0) 795 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:25:10.042 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:09 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:08.709710+0000 mgr.smithi050.emnywo (mgr.24517) 408 : cluster [DBG] pgmap v286: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:10.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:09 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:08.709710+0000 mgr.smithi050.emnywo (mgr.24517) 408 : cluster [DBG] pgmap v286: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:11.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:11 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:10.043824+0000 mon.smithi050 (mon.0) 796 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:25:11.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:10.043824+0000 mon.smithi050 (mon.0) 796 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:25:12.319 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:10.710266+0000 mgr.smithi050.emnywo (mgr.24517) 409 : cluster [DBG] pgmap v287: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:12.330 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:10.710266+0000 mgr.smithi050.emnywo (mgr.24517) 409 : cluster [DBG] pgmap v287: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:14.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:12.710870+0000 mgr.smithi050.emnywo (mgr.24517) 410 : cluster [DBG] pgmap v288: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:14.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:12.710870+0000 mgr.smithi050.emnywo (mgr.24517) 410 : cluster [DBG] pgmap v288: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:16.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:14.711460+0000 mgr.smithi050.emnywo (mgr.24517) 411 : cluster [DBG] pgmap v289: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:16.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:14.711460+0000 mgr.smithi050.emnywo (mgr.24517) 411 : cluster [DBG] pgmap v289: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:18.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:16.711875+0000 mgr.smithi050.emnywo (mgr.24517) 412 : cluster [DBG] pgmap v290: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:18.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:16.711875+0000 mgr.smithi050.emnywo (mgr.24517) 412 : cluster [DBG] pgmap v290: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:20.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:18.712600+0000 mgr.smithi050.emnywo (mgr.24517) 413 : cluster [DBG] pgmap v291: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:20.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:18.712600+0000 mgr.smithi050.emnywo (mgr.24517) 413 : cluster [DBG] pgmap v291: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:21.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.316+0000 7f8d411bc700 1 -- 172.21.15.50:0/3607912510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0f6860 msgr2=0x7f8d3c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:25:21.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.316+0000 7f8d411bc700 1 --2- 172.21.15.50:0/3607912510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0f6860 0x7f8d3c0f6cc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f8d24004660 tx=0x7f8d24009b30).stop 2023-01-04T18:25:21.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.316+0000 7f8d411bc700 1 -- 172.21.15.50:0/3607912510 shutdown_connections 2023-01-04T18:25:21.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.316+0000 7f8d411bc700 1 --2- 172.21.15.50:0/3607912510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0f6860 0x7f8d3c0f6cc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:25:21.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.316+0000 7f8d411bc700 1 --2- 172.21.15.50:0/3607912510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d3c0f55c0 0x7f8d3c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:25:21.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.316+0000 7f8d411bc700 1 -- 172.21.15.50:0/3607912510 >> 172.21.15.50:0/3607912510 conn(0x7f8d3c0f0d40 msgr2=0x7f8d3c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:25:21.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.316+0000 7f8d411bc700 1 -- 172.21.15.50:0/3607912510 shutdown_connections 2023-01-04T18:25:21.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.316+0000 7f8d411bc700 1 -- 172.21.15.50:0/3607912510 wait complete. 2023-01-04T18:25:21.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.317+0000 7f8d411bc700 1 Processor -- start 2023-01-04T18:25:21.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.317+0000 7f8d411bc700 1 -- start start 2023-01-04T18:25:21.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.317+0000 7f8d411bc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d3c0f55c0 0x7f8d3c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:25:21.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.317+0000 7f8d411bc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0f6860 0x7f8d3c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:25:21.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.317+0000 7f8d411bc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c107a10 con 0x7f8d3c0f6860 2023-01-04T18:25:21.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.317+0000 7f8d411bc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c107b50 con 0x7f8d3c0f55c0 2023-01-04T18:25:21.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.317+0000 7f8d3a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0f6860 0x7f8d3c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:25:21.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.317+0000 7f8d3a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0f6860 0x7f8d3c107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60018/0 (socket says 172.21.15.50:60018) 2023-01-04T18:25:21.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.317+0000 7f8d3a59c700 1 -- 172.21.15.50:0/1176004462 learned_addr learned my addr 172.21.15.50:0/1176004462 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:25:21.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.317+0000 7f8d3ad9d700 1 --2- 172.21.15.50:0/1176004462 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d3c0f55c0 0x7f8d3c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:25:21.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.318+0000 7f8d3a59c700 1 -- 172.21.15.50:0/1176004462 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d3c0f55c0 msgr2=0x7f8d3c106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:25:21.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.318+0000 7f8d3a59c700 1 --2- 172.21.15.50:0/1176004462 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d3c0f55c0 0x7f8d3c106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:25:21.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.318+0000 7f8d3a59c700 1 -- 172.21.15.50:0/1176004462 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d24005040 con 0x7f8d3c0f6860 2023-01-04T18:25:21.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.318+0000 7f8d3a59c700 1 --2- 172.21.15.50:0/1176004462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0f6860 0x7f8d3c107460 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f8d24009830 tx=0x7f8d24009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:25:21.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.318+0000 7f8d337fe700 1 -- 172.21.15.50:0/1176004462 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d24018070 con 0x7f8d3c0f6860 2023-01-04T18:25:21.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.318+0000 7f8d411bc700 1 -- 172.21.15.50:0/1176004462 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d3c108490 con 0x7f8d3c0f6860 2023-01-04T18:25:21.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.318+0000 7f8d337fe700 1 -- 172.21.15.50:0/1176004462 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f8d24007ba0 con 0x7f8d3c0f6860 2023-01-04T18:25:21.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.318+0000 7f8d337fe700 1 -- 172.21.15.50:0/1176004462 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d2401c3c0 con 0x7f8d3c0f6860 2023-01-04T18:25:21.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.318+0000 7f8d411bc700 1 -- 172.21.15.50:0/1176004462 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d3c1089f0 con 0x7f8d3c0f6860 2023-01-04T18:25:21.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.319+0000 7f8d411bc700 1 -- 172.21.15.50:0/1176004462 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d3c045ad0 con 0x7f8d3c0f6860 2023-01-04T18:25:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.320+0000 7f8d337fe700 1 -- 172.21.15.50:0/1176004462 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f8d24007d10 con 0x7f8d3c0f6860 2023-01-04T18:25:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.320+0000 7f8d337fe700 1 --2- 172.21.15.50:0/1176004462 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f8d28060be0 0x7f8d280630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:25:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.320+0000 7f8d337fe700 1 -- 172.21.15.50:0/1176004462 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f8d2407da60 con 0x7f8d3c0f6860 2023-01-04T18:25:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.320+0000 7f8d3ad9d700 1 --2- 172.21.15.50:0/1176004462 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f8d28060be0 0x7f8d280630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:25:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.321+0000 7f8d3ad9d700 1 --2- 172.21.15.50:0/1176004462 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f8d28060be0 0x7f8d280630a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f8d3c0f66c0 tx=0x7f8d2c00b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:25:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.325+0000 7f8d337fe700 1 -- 172.21.15.50:0/1176004462 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f8d24051950 con 0x7f8d3c0f6860 2023-01-04T18:25:21.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.515+0000 7f8d411bc700 1 -- 172.21.15.50:0/1176004462 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d3c0faca0 con 0x7f8d28060be0 2023-01-04T18:25:21.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.516+0000 7f8d337fe700 1 -- 172.21.15.50:0/1176004462 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f8d3c0faca0 con 0x7f8d28060be0 2023-01-04T18:25:21.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.517+0000 7f8d411bc700 1 -- 172.21.15.50:0/1176004462 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f8d28060be0 msgr2=0x7f8d280630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:25:21.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.517+0000 7f8d411bc700 1 --2- 172.21.15.50:0/1176004462 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f8d28060be0 0x7f8d280630a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f8d3c0f66c0 tx=0x7f8d2c00b040).stop 2023-01-04T18:25:21.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.517+0000 7f8d411bc700 1 -- 172.21.15.50:0/1176004462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0f6860 msgr2=0x7f8d3c107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:25:21.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.517+0000 7f8d411bc700 1 --2- 172.21.15.50:0/1176004462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0f6860 0x7f8d3c107460 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f8d24009830 tx=0x7f8d24009b30).stop 2023-01-04T18:25:21.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.517+0000 7f8d411bc700 1 -- 172.21.15.50:0/1176004462 shutdown_connections 2023-01-04T18:25:21.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.517+0000 7f8d411bc700 1 --2- 172.21.15.50:0/1176004462 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f8d28060be0 0x7f8d280630a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:25:21.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.517+0000 7f8d411bc700 1 --2- 172.21.15.50:0/1176004462 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d3c0f55c0 0x7f8d3c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:25:21.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.517+0000 7f8d411bc700 1 --2- 172.21.15.50:0/1176004462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0f6860 0x7f8d3c107460 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:25:21.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.517+0000 7f8d411bc700 1 -- 172.21.15.50:0/1176004462 >> 172.21.15.50:0/1176004462 conn(0x7f8d3c0f0d40 msgr2=0x7f8d3c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:25:21.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.518+0000 7f8d411bc700 1 -- 172.21.15.50:0/1176004462 shutdown_connections 2023-01-04T18:25:21.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:21.518+0000 7f8d411bc700 1 -- 172.21.15.50:0/1176004462 wait complete. 2023-01-04T18:25:22.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:20.713077+0000 mgr.smithi050.emnywo (mgr.24517) 414 : cluster [DBG] pgmap v292: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:22.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:21.515985+0000 mgr.smithi050.emnywo (mgr.24517) 415 : audit [DBG] from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:25:22.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:20.713077+0000 mgr.smithi050.emnywo (mgr.24517) 414 : cluster [DBG] pgmap v292: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:22.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:21.515985+0000 mgr.smithi050.emnywo (mgr.24517) 415 : audit [DBG] from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:25:23.963 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -e sha1=f2bb1478686242c0f68882a9cf8df4e0f8363116 -- bash -c 'ceph orch ps' 2023-01-04T18:25:24.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:22.713718+0000 mgr.smithi050.emnywo (mgr.24517) 416 : cluster [DBG] pgmap v293: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:24.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:22.713718+0000 mgr.smithi050.emnywo (mgr.24517) 416 : cluster [DBG] pgmap v293: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:25.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.498+0000 7f781e0c8700 1 -- 172.21.15.50:0/2342527824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78180f66e0 msgr2=0x7f78180f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:25:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.498+0000 7f781e0c8700 1 --2- 172.21.15.50:0/2342527824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78180f66e0 0x7f78180f6b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f7808004660 tx=0x7f7808009b30).stop 2023-01-04T18:25:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.498+0000 7f781e0c8700 1 -- 172.21.15.50:0/2342527824 shutdown_connections 2023-01-04T18:25:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.498+0000 7f781e0c8700 1 --2- 172.21.15.50:0/2342527824 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78180f7980 0x7f78180f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-01-04T18:25:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.498+0000 7f781e0c8700 1 --2- 172.21.15.50:0/2342527824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78180f66e0 0x7f78180f6b00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:25:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.498+0000 7f781e0c8700 1 -- 172.21.15.50:0/2342527824 >> 172.21.15.50:0/2342527824 conn(0x7f78180f1e40 msgr2=0x7f78180f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:25:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.498+0000 7f781e0c8700 1 -- 172.21.15.50:0/2342527824 shutdown_connections 2023-01-04T18:25:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.498+0000 7f781e0c8700 1 -- 172.21.15.50:0/2342527824 wait complete. 2023-01-04T18:25:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.499+0000 7f781e0c8700 1 Processor -- start 2023-01-04T18:25:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.499+0000 7f781e0c8700 1 -- start start 2023-01-04T18:25:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.499+0000 7f781e0c8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78180f66e0 0x7f7818106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:25:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.499+0000 7f781e0c8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78180f7980 0x7f78181074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:25:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.499+0000 7f781e0c8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7818107b00 con 0x7f78180f7980 2023-01-04T18:25:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.499+0000 7f781e0c8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78181083b0 con 0x7f78180f66e0 2023-01-04T18:25:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.499+0000 7f7816ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78180f7980 0x7f78181074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:25:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.499+0000 7f7816ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78180f7980 0x7f78181074c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60032/0 (socket says 172.21.15.50:60032) 2023-01-04T18:25:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.499+0000 7f7816ffd700 1 -- 172.21.15.50:0/342539787 learned_addr learned my addr 172.21.15.50:0/342539787 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:25:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.499+0000 7f78177fe700 1 --2- 172.21.15.50:0/342539787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78180f66e0 0x7f7818106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:25:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.499+0000 7f7816ffd700 1 -- 172.21.15.50:0/342539787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78180f66e0 msgr2=0x7f7818106fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:25:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.499+0000 7f7816ffd700 1 --2- 172.21.15.50:0/342539787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78180f66e0 0x7f7818106fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:25:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.500+0000 7f7816ffd700 1 -- 172.21.15.50:0/342539787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7808005040 con 0x7f78180f7980 2023-01-04T18:25:25.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.500+0000 7f7816ffd700 1 --2- 172.21.15.50:0/342539787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78180f7980 0x7f78181074c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f780000b410 tx=0x7f7800006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:25:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.500+0000 7f780ffff700 1 -- 172.21.15.50:0/342539787 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78000125f0 con 0x7f78180f7980 2023-01-04T18:25:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.500+0000 7f780ffff700 1 -- 172.21.15.50:0/342539787 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f780000be30 con 0x7f78180f7980 2023-01-04T18:25:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.500+0000 7f781e0c8700 1 -- 172.21.15.50:0/342539787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7818108690 con 0x7f78180f7980 2023-01-04T18:25:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.500+0000 7f780ffff700 1 -- 172.21.15.50:0/342539787 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7800002a70 con 0x7f78180f7980 2023-01-04T18:25:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.500+0000 7f781e0c8700 1 -- 172.21.15.50:0/342539787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7818108c50 con 0x7f78180f7980 2023-01-04T18:25:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.501+0000 7f781e0c8700 1 -- 172.21.15.50:0/342539787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78180f5ad0 con 0x7f78180f7980 2023-01-04T18:25:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.502+0000 7f780ffff700 1 -- 172.21.15.50:0/342539787 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f780000f030 con 0x7f78180f7980 2023-01-04T18:25:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.502+0000 7f780ffff700 1 --2- 172.21.15.50:0/342539787 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7804060be0 0x7f78040630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:25:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.502+0000 7f780ffff700 1 -- 172.21.15.50:0/342539787 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f780007c4c0 con 0x7f78180f7980 2023-01-04T18:25:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.502+0000 7f78177fe700 1 --2- 172.21.15.50:0/342539787 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7804060be0 0x7f78040630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:25:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.503+0000 7f78177fe700 1 --2- 172.21.15.50:0/342539787 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7804060be0 0x7f78040630a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f7808009f50 tx=0x7f7808009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:25:25.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.506+0000 7f780ffff700 1 -- 172.21.15.50:0/342539787 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f7800050490 con 0x7f78180f7980 2023-01-04T18:25:25.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:24.883902+0000 mon.smithi050 (mon.0) 797 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:25:25.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:24.887233+0000 mon.smithi050 (mon.0) 798 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:25:25.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:24.883902+0000 mon.smithi050 (mon.0) 797 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:25:25.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:24.887233+0000 mon.smithi050 (mon.0) 798 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:25:25.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.692+0000 7f781e0c8700 1 -- 172.21.15.50:0/342539787 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f78180fefd0 con 0x7f7804060be0 2023-01-04T18:25:25.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.702+0000 7f780ffff700 1 -- 172.21.15.50:0/342539787 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f78180fefd0 con 0x7f7804060be0 2023-01-04T18:25:25.704 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-01-04T18:25:25.704 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager.smithi050 smithi050 *:9093,9094 running (63s) 18s ago 14m 18.5M - 0.23.0 ba2b418f427c d2cbe48f1b33 2023-01-04T18:25:25.705 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi050 smithi050 running (7m) 18s ago 14m 7050k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cfe28e5ab81e 2023-01-04T18:25:25.705 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi098 smithi098 running (7m) 85s ago 14m 7180k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cf5f0ca60522 2023-01-04T18:25:25.705 INFO:teuthology.orchestra.run.smithi050.stdout:grafana.smithi050 smithi050 *:3000 running (24s) 18s ago 14m 48.4M - 8.3.5 dad864ee21e9 b3b281dc529b 2023-01-04T18:25:25.705 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.ezoiwl smithi050 running (2m) 18s ago 10m 790M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 146e50d0c3f4 2023-01-04T18:25:25.705 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.kefmuy smithi050 running (2m) 18s ago 10m 779M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 4aaf433888b2 2023-01-04T18:25:25.705 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.laynsk smithi098 running (108s) 85s ago 10m 15.7M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 76076b59594d 2023-01-04T18:25:25.705 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.memais smithi098 running (2m) 85s ago 10m 13.6M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d fdb3824282b1 2023-01-04T18:25:25.705 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi050.emnywo smithi050 *:8443,9283 running (8m) 18s ago 16m 459M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d ee677216e754 2023-01-04T18:25:25.705 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi098.vhfzum smithi098 *:8443,9283 running (7m) 85s ago 14m 397M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d f3d98bf0cf66 2023-01-04T18:25:25.706 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi050 smithi050 running (7m) 18s ago 16m 137M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 0423819cbaa7 2023-01-04T18:25:25.706 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi098 smithi098 running (7m) 85s ago 14m 108M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 12094818aefc 2023-01-04T18:25:25.706 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi050 smithi050 *:9100 running (95s) 18s ago 14m 13.2M - 1.3.1 1dbe0e931976 c372334fd87e 2023-01-04T18:25:25.706 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi098 smithi098 *:9100 running (89s) 85s ago 14m 3854k - 1.3.1 1dbe0e931976 1c32dce64f13 2023-01-04T18:25:25.706 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (6m) 18s ago 13m 360M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 60dafedcb429 2023-01-04T18:25:25.706 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi050 running (5m) 18s ago 13m 371M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 625bd99952d9 2023-01-04T18:25:25.706 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi050 running (4m) 18s ago 13m 282M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d badf94f13661 2023-01-04T18:25:25.706 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi098 running (4m) 85s ago 12m 408M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 93c4e177ba97 2023-01-04T18:25:25.706 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi098 running (3m) 85s ago 12m 377M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 9398016f5e81 2023-01-04T18:25:25.707 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi098 running (3m) 85s ago 12m 316M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 82e86a9ed864 2023-01-04T18:25:25.707 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus.smithi050 smithi050 *:9095 running (77s) 18s ago 14m 61.2M - 2.33.4 514e6a882f6e b46bdb79fd50 2023-01-04T18:25:25.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.704+0000 7f781e0c8700 1 -- 172.21.15.50:0/342539787 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7804060be0 msgr2=0x7f78040630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:25:25.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.704+0000 7f781e0c8700 1 --2- 172.21.15.50:0/342539787 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7804060be0 0x7f78040630a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f7808009f50 tx=0x7f7808009b30).stop 2023-01-04T18:25:25.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.704+0000 7f781e0c8700 1 -- 172.21.15.50:0/342539787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78180f7980 msgr2=0x7f78181074c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:25:25.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.704+0000 7f781e0c8700 1 --2- 172.21.15.50:0/342539787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78180f7980 0x7f78181074c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f780000b410 tx=0x7f7800006ef0).stop 2023-01-04T18:25:25.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.704+0000 7f781e0c8700 1 -- 172.21.15.50:0/342539787 shutdown_connections 2023-01-04T18:25:25.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.704+0000 7f781e0c8700 1 --2- 172.21.15.50:0/342539787 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7804060be0 0x7f78040630a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:25:25.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.704+0000 7f781e0c8700 1 --2- 172.21.15.50:0/342539787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78180f66e0 0x7f7818106fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:25:25.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.704+0000 7f781e0c8700 1 --2- 172.21.15.50:0/342539787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78180f7980 0x7f78181074c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:25:25.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.704+0000 7f781e0c8700 1 -- 172.21.15.50:0/342539787 >> 172.21.15.50:0/342539787 conn(0x7f78180f1e40 msgr2=0x7f78180fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:25:25.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.704+0000 7f781e0c8700 1 -- 172.21.15.50:0/342539787 shutdown_connections 2023-01-04T18:25:25.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:25.704+0000 7f781e0c8700 1 -- 172.21.15.50:0/342539787 wait complete. 2023-01-04T18:25:26.143 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -e sha1=f2bb1478686242c0f68882a9cf8df4e0f8363116 -- bash -c 'ceph versions' 2023-01-04T18:25:26.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:24.714167+0000 mgr.smithi050.emnywo (mgr.24517) 417 : cluster [DBG] pgmap v294: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:26.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:24.714167+0000 mgr.smithi050.emnywo (mgr.24517) 417 : cluster [DBG] pgmap v294: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:27.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:27 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:25.693672+0000 mgr.smithi050.emnywo (mgr.24517) 418 : audit [DBG] from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:25:27.583 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:25.693672+0000 mgr.smithi050.emnywo (mgr.24517) 418 : audit [DBG] from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:25:27.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.592+0000 7f8758af7700 1 -- 172.21.15.50:0/1789293766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87540f6860 msgr2=0x7f87540f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:25:27.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.592+0000 7f8758af7700 1 --2- 172.21.15.50:0/1789293766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87540f6860 0x7f87540f6cc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f8748004660 tx=0x7f8748009b30).stop 2023-01-04T18:25:27.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.592+0000 7f8758af7700 1 -- 172.21.15.50:0/1789293766 shutdown_connections 2023-01-04T18:25:27.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.592+0000 7f8758af7700 1 --2- 172.21.15.50:0/1789293766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87540f6860 0x7f87540f6cc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:25:27.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.592+0000 7f8758af7700 1 --2- 172.21.15.50:0/1789293766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87540f55c0 0x7f87540f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:25:27.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.592+0000 7f8758af7700 1 -- 172.21.15.50:0/1789293766 >> 172.21.15.50:0/1789293766 conn(0x7f87540f0d40 msgr2=0x7f87540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:25:27.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.592+0000 7f8758af7700 1 -- 172.21.15.50:0/1789293766 shutdown_connections 2023-01-04T18:25:27.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.592+0000 7f8758af7700 1 -- 172.21.15.50:0/1789293766 wait complete. 2023-01-04T18:25:27.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.593+0000 7f8758af7700 1 Processor -- start 2023-01-04T18:25:27.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.593+0000 7f8758af7700 1 -- start start 2023-01-04T18:25:27.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.593+0000 7f8758af7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87540f55c0 0x7f8754109c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:25:27.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.593+0000 7f8758af7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87540f6860 0x7f875410c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:25:27.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.593+0000 7f8758af7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87540603e0 con 0x7f87540f6860 2023-01-04T18:25:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.593+0000 7f8758af7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8754060520 con 0x7f87540f55c0 2023-01-04T18:25:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.593+0000 7f8751d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87540f6860 0x7f875410c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:25:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.593+0000 7f8751d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87540f6860 0x7f875410c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45474/0 (socket says 172.21.15.50:45474) 2023-01-04T18:25:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.593+0000 7f8751d9b700 1 -- 172.21.15.50:0/533297180 learned_addr learned my addr 172.21.15.50:0/533297180 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:25:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.593+0000 7f875259c700 1 --2- 172.21.15.50:0/533297180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87540f55c0 0x7f8754109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:25:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.594+0000 7f8751d9b700 1 -- 172.21.15.50:0/533297180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87540f55c0 msgr2=0x7f8754109c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:25:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.594+0000 7f8751d9b700 1 --2- 172.21.15.50:0/533297180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87540f55c0 0x7f8754109c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:25:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.594+0000 7f8751d9b700 1 -- 172.21.15.50:0/533297180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8748005040 con 0x7f87540f6860 2023-01-04T18:25:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.594+0000 7f8751d9b700 1 --2- 172.21.15.50:0/533297180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87540f6860 0x7f875410c180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f8748009830 tx=0x7f8748009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:25:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.594+0000 7f8742ffd700 1 -- 172.21.15.50:0/533297180 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8748018070 con 0x7f87540f6860 2023-01-04T18:25:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.594+0000 7f8742ffd700 1 -- 172.21.15.50:0/533297180 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f8748007ba0 con 0x7f87540f6860 2023-01-04T18:25:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.594+0000 7f8742ffd700 1 -- 172.21.15.50:0/533297180 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f874801c3c0 con 0x7f87540f6860 2023-01-04T18:25:27.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.594+0000 7f8758af7700 1 -- 172.21.15.50:0/533297180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f875410c6d0 con 0x7f87540f6860 2023-01-04T18:25:27.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.594+0000 7f8758af7700 1 -- 172.21.15.50:0/533297180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f875410cbe0 con 0x7f87540f6860 2023-01-04T18:25:27.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.595+0000 7f8758af7700 1 -- 172.21.15.50:0/533297180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8754045ad0 con 0x7f87540f6860 2023-01-04T18:25:27.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.595+0000 7f8742ffd700 1 -- 172.21.15.50:0/533297180 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f8748007d10 con 0x7f87540f6860 2023-01-04T18:25:27.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.596+0000 7f8742ffd700 1 --2- 172.21.15.50:0/533297180 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f873c060be0 0x7f873c0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:25:27.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.596+0000 7f8742ffd700 1 -- 172.21.15.50:0/533297180 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f874807da60 con 0x7f87540f6860 2023-01-04T18:25:27.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.596+0000 7f875259c700 1 --2- 172.21.15.50:0/533297180 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f873c060be0 0x7f873c0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:25:27.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.596+0000 7f875259c700 1 --2- 172.21.15.50:0/533297180 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f873c060be0 0x7f873c0630a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f8754060060 tx=0x7f874400b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:25:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.600+0000 7f8742ffd700 1 -- 172.21.15.50:0/533297180 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f874804df20 con 0x7f87540f6860 2023-01-04T18:25:27.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.840+0000 7f8758af7700 1 -- 172.21.15.50:0/533297180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8754027a00 con 0x7f87540f6860 2023-01-04T18:25:27.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.841+0000 7f8742ffd700 1 -- 172.21.15.50:0/533297180 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+653 (secure 0 0 0) 0x7f8748051540 con 0x7f87540f6860 2023-01-04T18:25:27.843 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:25:27.843 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": { 2023-01-04T18:25:27.843 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:25:27.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:25:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": { 2023-01-04T18:25:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:25:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:25:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": { 2023-01-04T18:25:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 6 2023-01-04T18:25:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:25:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2023-01-04T18:25:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 4 2023-01-04T18:25:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:25:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: "overall": { 2023-01-04T18:25:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 14 2023-01-04T18:25:27.845 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-01-04T18:25:27.845 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:25:27.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.843+0000 7f8758af7700 1 -- 172.21.15.50:0/533297180 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f873c060be0 msgr2=0x7f873c0630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:25:27.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.843+0000 7f8758af7700 1 --2- 172.21.15.50:0/533297180 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f873c060be0 0x7f873c0630a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f8754060060 tx=0x7f874400b040).stop 2023-01-04T18:25:27.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.843+0000 7f8758af7700 1 -- 172.21.15.50:0/533297180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87540f6860 msgr2=0x7f875410c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:25:27.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.843+0000 7f8758af7700 1 --2- 172.21.15.50:0/533297180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87540f6860 0x7f875410c180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f8748009830 tx=0x7f8748009b30).stop 2023-01-04T18:25:27.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.843+0000 7f8758af7700 1 -- 172.21.15.50:0/533297180 shutdown_connections 2023-01-04T18:25:27.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.843+0000 7f8758af7700 1 --2- 172.21.15.50:0/533297180 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f873c060be0 0x7f873c0630a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:25:27.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.843+0000 7f8758af7700 1 --2- 172.21.15.50:0/533297180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87540f55c0 0x7f8754109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:25:27.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.843+0000 7f8758af7700 1 --2- 172.21.15.50:0/533297180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87540f6860 0x7f875410c180 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:25:27.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.843+0000 7f8758af7700 1 -- 172.21.15.50:0/533297180 >> 172.21.15.50:0/533297180 conn(0x7f87540f0d40 msgr2=0x7f87540fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:25:27.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.843+0000 7f8758af7700 1 -- 172.21.15.50:0/533297180 shutdown_connections 2023-01-04T18:25:27.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:25:27.843+0000 7f8758af7700 1 -- 172.21.15.50:0/533297180 wait complete. 2023-01-04T18:25:28.261 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -e sha1=f2bb1478686242c0f68882a9cf8df4e0f8363116 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2023-01-04T18:25:28.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:26.714779+0000 mgr.smithi050.emnywo (mgr.24517) 419 : cluster [DBG] pgmap v295: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:28.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:25:27.841142+0000 mon.smithi050 (mon.0) 799 : audit [DBG] from='client.? 172.21.15.50:0/533297180' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:28.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:26.714779+0000 mgr.smithi050.emnywo (mgr.24517) 419 : cluster [DBG] pgmap v295: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:28.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:25:27.841142+0000 mon.smithi050 (mon.0) 799 : audit [DBG] from='client.? 172.21.15.50:0/533297180' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:25:29.682 INFO:teuthology.orchestra.run.smithi050.stdout:wait for servicemap items w/ changing names to refresh 2023-01-04T18:25:30.076 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -e sha1=f2bb1478686242c0f68882a9cf8df4e0f8363116 -- bash -c 'sleep 60' 2023-01-04T18:25:30.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:28.715382+0000 mgr.smithi050.emnywo (mgr.24517) 420 : cluster [DBG] pgmap v296: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:30.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:28.715382+0000 mgr.smithi050.emnywo (mgr.24517) 420 : cluster [DBG] pgmap v296: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:32.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:30.715750+0000 mgr.smithi050.emnywo (mgr.24517) 421 : cluster [DBG] pgmap v297: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:32.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:30.715750+0000 mgr.smithi050.emnywo (mgr.24517) 421 : cluster [DBG] pgmap v297: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:34.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:32.716181+0000 mgr.smithi050.emnywo (mgr.24517) 422 : cluster [DBG] pgmap v298: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:34.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:32.716181+0000 mgr.smithi050.emnywo (mgr.24517) 422 : cluster [DBG] pgmap v298: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:36.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:34.716839+0000 mgr.smithi050.emnywo (mgr.24517) 423 : cluster [DBG] pgmap v299: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:36.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:34.716839+0000 mgr.smithi050.emnywo (mgr.24517) 423 : cluster [DBG] pgmap v299: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:38.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:36.717714+0000 mgr.smithi050.emnywo (mgr.24517) 424 : cluster [DBG] pgmap v300: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:38.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:36.717714+0000 mgr.smithi050.emnywo (mgr.24517) 424 : cluster [DBG] pgmap v300: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:40.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:38.718359+0000 mgr.smithi050.emnywo (mgr.24517) 425 : cluster [DBG] pgmap v301: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:40.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:38.718359+0000 mgr.smithi050.emnywo (mgr.24517) 425 : cluster [DBG] pgmap v301: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:42.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:40.718924+0000 mgr.smithi050.emnywo (mgr.24517) 426 : cluster [DBG] pgmap v302: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:42.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:40.718924+0000 mgr.smithi050.emnywo (mgr.24517) 426 : cluster [DBG] pgmap v302: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:44.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:42.719505+0000 mgr.smithi050.emnywo (mgr.24517) 427 : cluster [DBG] pgmap v303: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:44.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:42.719505+0000 mgr.smithi050.emnywo (mgr.24517) 427 : cluster [DBG] pgmap v303: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:46.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:44.720218+0000 mgr.smithi050.emnywo (mgr.24517) 428 : cluster [DBG] pgmap v304: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:46.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:44.720218+0000 mgr.smithi050.emnywo (mgr.24517) 428 : cluster [DBG] pgmap v304: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:48.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:46.720611+0000 mgr.smithi050.emnywo (mgr.24517) 429 : cluster [DBG] pgmap v305: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:48.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:46.720611+0000 mgr.smithi050.emnywo (mgr.24517) 429 : cluster [DBG] pgmap v305: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:50.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:48.721164+0000 mgr.smithi050.emnywo (mgr.24517) 430 : cluster [DBG] pgmap v306: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:50.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:48.721164+0000 mgr.smithi050.emnywo (mgr.24517) 430 : cluster [DBG] pgmap v306: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:52.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:50.721614+0000 mgr.smithi050.emnywo (mgr.24517) 431 : cluster [DBG] pgmap v307: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:52.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:50.721614+0000 mgr.smithi050.emnywo (mgr.24517) 431 : cluster [DBG] pgmap v307: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:54.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:52.722079+0000 mgr.smithi050.emnywo (mgr.24517) 432 : cluster [DBG] pgmap v308: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:54.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:52.722079+0000 mgr.smithi050.emnywo (mgr.24517) 432 : cluster [DBG] pgmap v308: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:56.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:54.722728+0000 mgr.smithi050.emnywo (mgr.24517) 433 : cluster [DBG] pgmap v309: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:56.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:56 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:54.722728+0000 mgr.smithi050.emnywo (mgr.24517) 433 : cluster [DBG] pgmap v309: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:25:58.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:25:58 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:56.723114+0000 mgr.smithi050.emnywo (mgr.24517) 434 : cluster [DBG] pgmap v310: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:25:58.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:25:58 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:56.723114+0000 mgr.smithi050.emnywo (mgr.24517) 434 : cluster [DBG] pgmap v310: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:00.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:00 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:25:58.723610+0000 mgr.smithi050.emnywo (mgr.24517) 435 : cluster [DBG] pgmap v311: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:00.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:00 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:25:58.723610+0000 mgr.smithi050.emnywo (mgr.24517) 435 : cluster [DBG] pgmap v311: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:02.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:02 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:00.724265+0000 mgr.smithi050.emnywo (mgr.24517) 436 : cluster [DBG] pgmap v312: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:26:02.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:02 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:00.724265+0000 mgr.smithi050.emnywo (mgr.24517) 436 : cluster [DBG] pgmap v312: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:26:04.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:02.724837+0000 mgr.smithi050.emnywo (mgr.24517) 437 : cluster [DBG] pgmap v313: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:04.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:04 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:02.724837+0000 mgr.smithi050.emnywo (mgr.24517) 437 : cluster [DBG] pgmap v313: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:06.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:06 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:04.725404+0000 mgr.smithi050.emnywo (mgr.24517) 438 : cluster [DBG] pgmap v314: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:26:06.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:06 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:04.725404+0000 mgr.smithi050.emnywo (mgr.24517) 438 : cluster [DBG] pgmap v314: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:26:08.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:06.725830+0000 mgr.smithi050.emnywo (mgr.24517) 439 : cluster [DBG] pgmap v315: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:08.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:07.251915+0000 mon.smithi050 (mon.0) 800 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:26:08.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:07.253360+0000 mon.smithi050 (mon.0) 801 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:26:08.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:07.254180+0000 mon.smithi050 (mon.0) 802 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:26:08.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cephadm 2023-01-04T18:26:07.254916+0000 mgr.smithi050.emnywo (mgr.24517) 440 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:26:08.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:08 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:07.683040+0000 mon.smithi050 (mon.0) 803 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:26:08.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:06.725830+0000 mgr.smithi050.emnywo (mgr.24517) 439 : cluster [DBG] pgmap v315: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:08.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:07.251915+0000 mon.smithi050 (mon.0) 800 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-01-04T18:26:08.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:07.253360+0000 mon.smithi050 (mon.0) 801 : audit [DBG] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-01-04T18:26:08.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:07.254180+0000 mon.smithi050 (mon.0) 802 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-01-04T18:26:08.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cephadm 2023-01-04T18:26:07.254916+0000 mgr.smithi050.emnywo (mgr.24517) 440 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2023-01-04T18:26:08.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:08 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:07.683040+0000 mon.smithi050 (mon.0) 803 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' 2023-01-04T18:26:10.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:10 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:08.726396+0000 mgr.smithi050.emnywo (mgr.24517) 441 : cluster [DBG] pgmap v316: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:10.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:10 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:08.726396+0000 mgr.smithi050.emnywo (mgr.24517) 441 : cluster [DBG] pgmap v316: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:12.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:12 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:10.726900+0000 mgr.smithi050.emnywo (mgr.24517) 442 : cluster [DBG] pgmap v317: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:26:12.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:12 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:10.726900+0000 mgr.smithi050.emnywo (mgr.24517) 442 : cluster [DBG] pgmap v317: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:26:14.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:14 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:12.727478+0000 mgr.smithi050.emnywo (mgr.24517) 443 : cluster [DBG] pgmap v318: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:14.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:14 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:12.727478+0000 mgr.smithi050.emnywo (mgr.24517) 443 : cluster [DBG] pgmap v318: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:16.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:16 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:14.728099+0000 mgr.smithi050.emnywo (mgr.24517) 444 : cluster [DBG] pgmap v319: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:26:16.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:16 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:14.728099+0000 mgr.smithi050.emnywo (mgr.24517) 444 : cluster [DBG] pgmap v319: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:26:18.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:18 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:16.728611+0000 mgr.smithi050.emnywo (mgr.24517) 445 : cluster [DBG] pgmap v320: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:18.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:16.728611+0000 mgr.smithi050.emnywo (mgr.24517) 445 : cluster [DBG] pgmap v320: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:20.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:20 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:18.729152+0000 mgr.smithi050.emnywo (mgr.24517) 446 : cluster [DBG] pgmap v321: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:20.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:20 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:18.729152+0000 mgr.smithi050.emnywo (mgr.24517) 446 : cluster [DBG] pgmap v321: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:22.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:22 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:20.729697+0000 mgr.smithi050.emnywo (mgr.24517) 447 : cluster [DBG] pgmap v322: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:26:22.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:22 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:20.729697+0000 mgr.smithi050.emnywo (mgr.24517) 447 : cluster [DBG] pgmap v322: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:26:24.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:24 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:22.730162+0000 mgr.smithi050.emnywo (mgr.24517) 448 : cluster [DBG] pgmap v323: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:24.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:24 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:22.730162+0000 mgr.smithi050.emnywo (mgr.24517) 448 : cluster [DBG] pgmap v323: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:25.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:24.885452+0000 mon.smithi050 (mon.0) 804 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:26:25.541 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:25 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:24.888480+0000 mon.smithi050 (mon.0) 805 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:26:25.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:24.885452+0000 mon.smithi050 (mon.0) 804 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/mirror_snapshot_schedule"}]: dispatch 2023-01-04T18:26:25.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:24.888480+0000 mon.smithi050 (mon.0) 805 : audit [INF] from='mgr.24517 172.21.15.50:0/1634822729' entity='mgr.smithi050.emnywo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi050.emnywo/trash_purge_schedule"}]: dispatch 2023-01-04T18:26:26.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:26 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:24.730619+0000 mgr.smithi050.emnywo (mgr.24517) 449 : cluster [DBG] pgmap v324: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:26:26.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:24.730619+0000 mgr.smithi050.emnywo (mgr.24517) 449 : cluster [DBG] pgmap v324: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:26:28.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:28 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:26.731200+0000 mgr.smithi050.emnywo (mgr.24517) 450 : cluster [DBG] pgmap v325: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:28.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:26.731200+0000 mgr.smithi050.emnywo (mgr.24517) 450 : cluster [DBG] pgmap v325: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:30.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:30 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:28.731763+0000 mgr.smithi050.emnywo (mgr.24517) 451 : cluster [DBG] pgmap v326: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:30.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:28.731763+0000 mgr.smithi050.emnywo (mgr.24517) 451 : cluster [DBG] pgmap v326: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:31.943 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -e sha1=f2bb1478686242c0f68882a9cf8df4e0f8363116 -- bash -c 'ceph orch ps' 2023-01-04T18:26:32.507 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:32 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:30.732482+0000 mgr.smithi050.emnywo (mgr.24517) 452 : cluster [DBG] pgmap v327: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:26:32.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:30.732482+0000 mgr.smithi050.emnywo (mgr.24517) 452 : cluster [DBG] pgmap v327: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:26:33.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.408+0000 7fb5c9957700 1 -- 172.21.15.50:0/1686449163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5c40f6860 msgr2=0x7fb5c40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:33.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.408+0000 7fb5c9957700 1 --2- 172.21.15.50:0/1686449163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5c40f6860 0x7fb5c40f6cc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fb5ac004660 tx=0x7fb5ac009b30).stop 2023-01-04T18:26:33.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.408+0000 7fb5c9957700 1 -- 172.21.15.50:0/1686449163 shutdown_connections 2023-01-04T18:26:33.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.408+0000 7fb5c9957700 1 --2- 172.21.15.50:0/1686449163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5c40f6860 0x7fb5c40f6cc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:33.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.408+0000 7fb5c9957700 1 --2- 172.21.15.50:0/1686449163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c40f55c0 0x7fb5c40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:33.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.408+0000 7fb5c9957700 1 -- 172.21.15.50:0/1686449163 >> 172.21.15.50:0/1686449163 conn(0x7fb5c40f0d40 msgr2=0x7fb5c40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:33.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.408+0000 7fb5c9957700 1 -- 172.21.15.50:0/1686449163 shutdown_connections 2023-01-04T18:26:33.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.408+0000 7fb5c9957700 1 -- 172.21.15.50:0/1686449163 wait complete. 2023-01-04T18:26:33.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.409+0000 7fb5c9957700 1 Processor -- start 2023-01-04T18:26:33.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.409+0000 7fb5c9957700 1 -- start start 2023-01-04T18:26:33.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.409+0000 7fb5c9957700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c40f55c0 0x7fb5c40f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:33.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.409+0000 7fb5c9957700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5c40f6860 0x7fb5c40f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:33.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.409+0000 7fb5c9957700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c40f8100 con 0x7fb5c40f6860 2023-01-04T18:26:33.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.409+0000 7fb5c9957700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c40f8240 con 0x7fb5c40f55c0 2023-01-04T18:26:33.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.409+0000 7fb5c27fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5c40f6860 0x7fb5c40f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.409+0000 7fb5c27fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5c40f6860 0x7fb5c40f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46386/0 (socket says 172.21.15.50:46386) 2023-01-04T18:26:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.409+0000 7fb5c2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c40f55c0 0x7fb5c40f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.409+0000 7fb5c27fc700 1 -- 172.21.15.50:0/1804056521 learned_addr learned my addr 172.21.15.50:0/1804056521 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.410+0000 7fb5c27fc700 1 -- 172.21.15.50:0/1804056521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c40f55c0 msgr2=0x7fb5c40f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.410+0000 7fb5c27fc700 1 --2- 172.21.15.50:0/1804056521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c40f55c0 0x7fb5c40f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.410+0000 7fb5c27fc700 1 -- 172.21.15.50:0/1804056521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac005040 con 0x7fb5c40f6860 2023-01-04T18:26:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.410+0000 7fb5c27fc700 1 --2- 172.21.15.50:0/1804056521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5c40f6860 0x7fb5c40f7ba0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fb5ac009830 tx=0x7fb5ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.410+0000 7fb5bb7fe700 1 -- 172.21.15.50:0/1804056521 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5ac018070 con 0x7fb5c40f6860 2023-01-04T18:26:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.410+0000 7fb5c9957700 1 -- 172.21.15.50:0/1804056521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c40f84c0 con 0x7fb5c40f6860 2023-01-04T18:26:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.410+0000 7fb5bb7fe700 1 -- 172.21.15.50:0/1804056521 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fb5ac007c70 con 0x7fb5c40f6860 2023-01-04T18:26:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.410+0000 7fb5bb7fe700 1 -- 172.21.15.50:0/1804056521 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5ac01c620 con 0x7fb5c40f6860 2023-01-04T18:26:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.410+0000 7fb5c9957700 1 -- 172.21.15.50:0/1804056521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c40f8a20 con 0x7fb5c40f6860 2023-01-04T18:26:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.411+0000 7fb5c9957700 1 -- 172.21.15.50:0/1804056521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c4045ad0 con 0x7fb5c40f6860 2023-01-04T18:26:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.411+0000 7fb5bb7fe700 1 -- 172.21.15.50:0/1804056521 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fb5ac01c890 con 0x7fb5c40f6860 2023-01-04T18:26:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.412+0000 7fb5bb7fe700 1 --2- 172.21.15.50:0/1804056521 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb5b0060be0 0x7fb5b00630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:33.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.412+0000 7fb5bb7fe700 1 -- 172.21.15.50:0/1804056521 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fb5ac07dca0 con 0x7fb5c40f6860 2023-01-04T18:26:33.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.412+0000 7fb5c2ffd700 1 --2- 172.21.15.50:0/1804056521 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb5b0060be0 0x7fb5b00630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:33.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.412+0000 7fb5c2ffd700 1 --2- 172.21.15.50:0/1804056521 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb5b0060be0 0x7fb5b00630a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fb5c40f94b0 tx=0x7fb5b4009040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.416+0000 7fb5bb7fe700 1 -- 172.21.15.50:0/1804056521 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fb5ac082070 con 0x7fb5c40f6860 2023-01-04T18:26:33.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.601+0000 7fb5c9957700 1 -- 172.21.15.50:0/1804056521 --> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5c40faca0 con 0x7fb5b0060be0 2023-01-04T18:26:33.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.611+0000 7fb5bb7fe700 1 -- 172.21.15.50:0/1804056521 <== mgr.24517 v2:172.21.15.50:6800/3329325632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fb5c40faca0 con 0x7fb5b0060be0 2023-01-04T18:26:33.614 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-01-04T18:26:33.614 INFO:teuthology.orchestra.run.smithi050.stdout:alertmanager.smithi050 smithi050 *:9093,9094 running (2m) 86s ago 16m 18.5M - 0.23.0 ba2b418f427c d2cbe48f1b33 2023-01-04T18:26:33.615 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi050 smithi050 running (8m) 86s ago 16m 7050k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cfe28e5ab81e 2023-01-04T18:26:33.615 INFO:teuthology.orchestra.run.smithi050.stdout:crash.smithi098 smithi098 running (8m) 2m ago 15m 7180k - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d cf5f0ca60522 2023-01-04T18:26:33.615 INFO:teuthology.orchestra.run.smithi050.stdout:grafana.smithi050 smithi050 *:3000 running (91s) 86s ago 15m 48.4M - 8.3.5 dad864ee21e9 b3b281dc529b 2023-01-04T18:26:33.615 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.ezoiwl smithi050 running (3m) 86s ago 12m 790M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 146e50d0c3f4 2023-01-04T18:26:33.615 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi050.kefmuy smithi050 running (3m) 86s ago 11m 779M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 4aaf433888b2 2023-01-04T18:26:33.615 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.laynsk smithi098 running (2m) 2m ago 11m 15.7M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 76076b59594d 2023-01-04T18:26:33.615 INFO:teuthology.orchestra.run.smithi050.stdout:mds.cephfs.smithi098.memais smithi098 running (3m) 2m ago 11m 13.6M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d fdb3824282b1 2023-01-04T18:26:33.615 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi050.emnywo smithi050 *:8443,9283 running (9m) 86s ago 17m 459M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d ee677216e754 2023-01-04T18:26:33.615 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.smithi098.vhfzum smithi098 *:8443,9283 running (8m) 2m ago 15m 397M - 16.2.10-1543-gf2bb1478 86bf9f1c8b4d f3d98bf0cf66 2023-01-04T18:26:33.615 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi050 smithi050 running (8m) 86s ago 17m 137M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 0423819cbaa7 2023-01-04T18:26:33.615 INFO:teuthology.orchestra.run.smithi050.stdout:mon.smithi098 smithi098 running (8m) 2m ago 15m 108M 2048M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 12094818aefc 2023-01-04T18:26:33.616 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi050 smithi050 *:9100 running (2m) 86s ago 15m 13.2M - 1.3.1 1dbe0e931976 c372334fd87e 2023-01-04T18:26:33.616 INFO:teuthology.orchestra.run.smithi050.stdout:node-exporter.smithi098 smithi098 *:9100 running (2m) 2m ago 15m 3854k - 1.3.1 1dbe0e931976 1c32dce64f13 2023-01-04T18:26:33.616 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (7m) 86s ago 14m 360M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 60dafedcb429 2023-01-04T18:26:33.616 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi050 running (6m) 86s ago 14m 371M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 625bd99952d9 2023-01-04T18:26:33.616 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi050 running (5m) 86s ago 14m 282M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d badf94f13661 2023-01-04T18:26:33.616 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi098 running (5m) 2m ago 13m 408M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 93c4e177ba97 2023-01-04T18:26:33.616 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi098 running (4m) 2m ago 13m 377M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 9398016f5e81 2023-01-04T18:26:33.616 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi098 running (4m) 2m ago 13m 316M 4096M 16.2.10-1543-gf2bb1478 86bf9f1c8b4d 82e86a9ed864 2023-01-04T18:26:33.616 INFO:teuthology.orchestra.run.smithi050.stdout:prometheus.smithi050 smithi050 *:9095 running (2m) 86s ago 15m 61.2M - 2.33.4 514e6a882f6e b46bdb79fd50 2023-01-04T18:26:33.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.612+0000 7fb5c9957700 1 -- 172.21.15.50:0/1804056521 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb5b0060be0 msgr2=0x7fb5b00630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:33.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.612+0000 7fb5c9957700 1 --2- 172.21.15.50:0/1804056521 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb5b0060be0 0x7fb5b00630a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fb5c40f94b0 tx=0x7fb5b4009040).stop 2023-01-04T18:26:33.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.613+0000 7fb5c9957700 1 -- 172.21.15.50:0/1804056521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5c40f6860 msgr2=0x7fb5c40f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:33.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.613+0000 7fb5c9957700 1 --2- 172.21.15.50:0/1804056521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5c40f6860 0x7fb5c40f7ba0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fb5ac009830 tx=0x7fb5ac009b30).stop 2023-01-04T18:26:33.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.613+0000 7fb5c9957700 1 -- 172.21.15.50:0/1804056521 shutdown_connections 2023-01-04T18:26:33.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.613+0000 7fb5c9957700 1 --2- 172.21.15.50:0/1804056521 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb5b0060be0 0x7fb5b00630a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:33.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.613+0000 7fb5c9957700 1 --2- 172.21.15.50:0/1804056521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c40f55c0 0x7fb5c40f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:33.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.613+0000 7fb5c9957700 1 --2- 172.21.15.50:0/1804056521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5c40f6860 0x7fb5c40f7ba0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:33.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.613+0000 7fb5c9957700 1 -- 172.21.15.50:0/1804056521 >> 172.21.15.50:0/1804056521 conn(0x7fb5c40f0d40 msgr2=0x7fb5c405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:33.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.613+0000 7fb5c9957700 1 -- 172.21.15.50:0/1804056521 shutdown_connections 2023-01-04T18:26:33.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:33.613+0000 7fb5c9957700 1 -- 172.21.15.50:0/1804056521 wait complete. 2023-01-04T18:26:33.981 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -e sha1=f2bb1478686242c0f68882a9cf8df4e0f8363116 -- bash -c 'ceph versions' 2023-01-04T18:26:34.491 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:32.732902+0000 mgr.smithi050.emnywo (mgr.24517) 453 : cluster [DBG] pgmap v328: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:34.491 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:34 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:33.603506+0000 mgr.smithi050.emnywo (mgr.24517) 454 : audit [DBG] from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:26:34.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:32.732902+0000 mgr.smithi050.emnywo (mgr.24517) 453 : cluster [DBG] pgmap v328: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:34.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:33.603506+0000 mgr.smithi050.emnywo (mgr.24517) 454 : audit [DBG] from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-01-04T18:26:35.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.433+0000 7fde1a228700 1 -- 172.21.15.50:0/2257281085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde140f66e0 msgr2=0x7fde140f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:35.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.433+0000 7fde1a228700 1 --2- 172.21.15.50:0/2257281085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde140f66e0 0x7fde140f6b00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fde04004660 tx=0x7fde04009b30).stop 2023-01-04T18:26:35.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.433+0000 7fde1a228700 1 -- 172.21.15.50:0/2257281085 shutdown_connections 2023-01-04T18:26:35.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.433+0000 7fde1a228700 1 --2- 172.21.15.50:0/2257281085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde140f7980 0x7fde140f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:35.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.433+0000 7fde1a228700 1 --2- 172.21.15.50:0/2257281085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde140f66e0 0x7fde140f6b00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:35.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.433+0000 7fde1a228700 1 -- 172.21.15.50:0/2257281085 >> 172.21.15.50:0/2257281085 conn(0x7fde140f1e40 msgr2=0x7fde140f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:35.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.434+0000 7fde1a228700 1 -- 172.21.15.50:0/2257281085 shutdown_connections 2023-01-04T18:26:35.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.434+0000 7fde1a228700 1 -- 172.21.15.50:0/2257281085 wait complete. 2023-01-04T18:26:35.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.434+0000 7fde1a228700 1 Processor -- start 2023-01-04T18:26:35.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.434+0000 7fde1a228700 1 -- start start 2023-01-04T18:26:35.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.434+0000 7fde1a228700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde140f66e0 0x7fde1406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:35.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.434+0000 7fde1a228700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde140f7980 0x7fde14069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:35.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.434+0000 7fde1a228700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1406a380 con 0x7fde140f66e0 2023-01-04T18:26:35.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.434+0000 7fde1a228700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1406a4c0 con 0x7fde140f7980 2023-01-04T18:26:35.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.435+0000 7fde137fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde140f66e0 0x7fde1406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:35.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.435+0000 7fde137fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde140f66e0 0x7fde1406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46410/0 (socket says 172.21.15.50:46410) 2023-01-04T18:26:35.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.435+0000 7fde137fe700 1 -- 172.21.15.50:0/2061854815 learned_addr learned my addr 172.21.15.50:0/2061854815 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:35.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.435+0000 7fde12ffd700 1 --2- 172.21.15.50:0/2061854815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde140f7980 0x7fde14069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:35.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.435+0000 7fde137fe700 1 -- 172.21.15.50:0/2061854815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde140f7980 msgr2=0x7fde14069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:35.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.435+0000 7fde137fe700 1 --2- 172.21.15.50:0/2061854815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde140f7980 0x7fde14069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:35.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.435+0000 7fde137fe700 1 -- 172.21.15.50:0/2061854815 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde04005040 con 0x7fde140f66e0 2023-01-04T18:26:35.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.435+0000 7fde137fe700 1 --2- 172.21.15.50:0/2061854815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde140f66e0 0x7fde1406b9a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fde04009730 tx=0x7fde04009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:35.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.435+0000 7fddfbfff700 1 -- 172.21.15.50:0/2061854815 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde04018070 con 0x7fde140f66e0 2023-01-04T18:26:35.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.435+0000 7fddfbfff700 1 -- 172.21.15.50:0/2061854815 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fde04007df0 con 0x7fde140f66e0 2023-01-04T18:26:35.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.435+0000 7fde1a228700 1 -- 172.21.15.50:0/2061854815 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde1406a740 con 0x7fde140f66e0 2023-01-04T18:26:35.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.435+0000 7fddfbfff700 1 -- 172.21.15.50:0/2061854815 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde0401c6b0 con 0x7fde140f66e0 2023-01-04T18:26:35.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.435+0000 7fde1a228700 1 -- 172.21.15.50:0/2061854815 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde1406aca0 con 0x7fde140f66e0 2023-01-04T18:26:35.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.436+0000 7fde1a228700 1 -- 172.21.15.50:0/2061854815 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde14045ad0 con 0x7fde140f66e0 2023-01-04T18:26:35.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.437+0000 7fddfbfff700 1 -- 172.21.15.50:0/2061854815 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fde0401da60 con 0x7fde140f66e0 2023-01-04T18:26:35.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.437+0000 7fddfbfff700 1 --2- 172.21.15.50:0/2061854815 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fddfc060be0 0x7fddfc0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:35.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.437+0000 7fddfbfff700 1 -- 172.21.15.50:0/2061854815 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fde0407dc80 con 0x7fde140f66e0 2023-01-04T18:26:35.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.437+0000 7fde12ffd700 1 --2- 172.21.15.50:0/2061854815 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fddfc060be0 0x7fddfc0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:35.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.438+0000 7fde12ffd700 1 --2- 172.21.15.50:0/2061854815 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fddfc060be0 0x7fddfc0630a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fde08004a70 tx=0x7fde08009040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:35.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.441+0000 7fddfbfff700 1 -- 172.21.15.50:0/2061854815 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fde0404e140 con 0x7fde140f66e0 2023-01-04T18:26:35.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.687+0000 7fde1a228700 1 -- 172.21.15.50:0/2061854815 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fde140fef80 con 0x7fde140f66e0 2023-01-04T18:26:35.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.688+0000 7fddfbfff700 1 -- 172.21.15.50:0/2061854815 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+653 (secure 0 0 0) 0x7fde04051760 con 0x7fde140f66e0 2023-01-04T18:26:35.691 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-01-04T18:26:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": { 2023-01-04T18:26:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:26:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:26:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": { 2023-01-04T18:26:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 2 2023-01-04T18:26:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:26:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": { 2023-01-04T18:26:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 6 2023-01-04T18:26:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:26:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2023-01-04T18:26:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 4 2023-01-04T18:26:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-01-04T18:26:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "overall": { 2023-01-04T18:26:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)": 14 2023-01-04T18:26:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-01-04T18:26:35.692 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-01-04T18:26:35.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.689+0000 7fde1a228700 1 -- 172.21.15.50:0/2061854815 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fddfc060be0 msgr2=0x7fddfc0630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:35.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.689+0000 7fde1a228700 1 --2- 172.21.15.50:0/2061854815 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fddfc060be0 0x7fddfc0630a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fde08004a70 tx=0x7fde08009040).stop 2023-01-04T18:26:35.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.689+0000 7fde1a228700 1 -- 172.21.15.50:0/2061854815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde140f66e0 msgr2=0x7fde1406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:35.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.689+0000 7fde1a228700 1 --2- 172.21.15.50:0/2061854815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde140f66e0 0x7fde1406b9a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fde04009730 tx=0x7fde04009b30).stop 2023-01-04T18:26:35.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.689+0000 7fde1a228700 1 -- 172.21.15.50:0/2061854815 shutdown_connections 2023-01-04T18:26:35.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.690+0000 7fde1a228700 1 --2- 172.21.15.50:0/2061854815 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fddfc060be0 0x7fddfc0630a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:35.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.690+0000 7fde1a228700 1 --2- 172.21.15.50:0/2061854815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde140f66e0 0x7fde1406b9a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:35.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.690+0000 7fde1a228700 1 --2- 172.21.15.50:0/2061854815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde140f7980 0x7fde14069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:35.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.690+0000 7fde1a228700 1 -- 172.21.15.50:0/2061854815 >> 172.21.15.50:0/2061854815 conn(0x7fde140f1e40 msgr2=0x7fde140fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:35.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.690+0000 7fde1a228700 1 -- 172.21.15.50:0/2061854815 shutdown_connections 2023-01-04T18:26:35.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:35.690+0000 7fde1a228700 1 -- 172.21.15.50:0/2061854815 wait complete. 2023-01-04T18:26:36.204 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -e sha1=f2bb1478686242c0f68882a9cf8df4e0f8363116 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2023-01-04T18:26:36.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:34.733568+0000 mgr.smithi050.emnywo (mgr.24517) 455 : cluster [DBG] pgmap v329: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:26:36.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:36 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:35.689063+0000 mon.smithi050 (mon.0) 806 : audit [DBG] from='client.? 172.21.15.50:0/2061854815' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:26:36.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:34.733568+0000 mgr.smithi050.emnywo (mgr.24517) 455 : cluster [DBG] pgmap v329: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:26:36.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:35.689063+0000 mon.smithi050 (mon.0) 806 : audit [DBG] from='client.? 172.21.15.50:0/2061854815' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:26:37.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.757+0000 7ff9a214e700 1 -- 172.21.15.50:0/922066620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99c0f5430 msgr2=0x7ff99c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:37.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.757+0000 7ff9a214e700 1 --2- 172.21.15.50:0/922066620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99c0f5430 0x7ff99c0f5850 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7ff98c004660 tx=0x7ff98c009b30).stop 2023-01-04T18:26:37.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.757+0000 7ff9a214e700 1 -- 172.21.15.50:0/922066620 shutdown_connections 2023-01-04T18:26:37.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.757+0000 7ff9a214e700 1 --2- 172.21.15.50:0/922066620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff99c0f66d0 0x7ff99c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:37.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.757+0000 7ff9a214e700 1 --2- 172.21.15.50:0/922066620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99c0f5430 0x7ff99c0f5850 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:37.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.757+0000 7ff9a214e700 1 -- 172.21.15.50:0/922066620 >> 172.21.15.50:0/922066620 conn(0x7ff99c0f0b90 msgr2=0x7ff99c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:37.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.757+0000 7ff9a214e700 1 -- 172.21.15.50:0/922066620 shutdown_connections 2023-01-04T18:26:37.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.757+0000 7ff9a214e700 1 -- 172.21.15.50:0/922066620 wait complete. 2023-01-04T18:26:37.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.757+0000 7ff9a214e700 1 Processor -- start 2023-01-04T18:26:37.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.757+0000 7ff9a214e700 1 -- start start 2023-01-04T18:26:37.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.757+0000 7ff9a214e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99c0f5430 0x7ff99c105d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:37.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.757+0000 7ff9a214e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff99c0f66d0 0x7ff99c106240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:37.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.758+0000 7ff9a214e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c1067f0 con 0x7ff99c0f5430 2023-01-04T18:26:37.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.758+0000 7ff9a214e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c106ff0 con 0x7ff99c0f66d0 2023-01-04T18:26:37.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.758+0000 7ff9a114c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99c0f5430 0x7ff99c105d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:37.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.758+0000 7ff9a114c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99c0f5430 0x7ff99c105d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52412/0 (socket says 172.21.15.50:52412) 2023-01-04T18:26:37.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.758+0000 7ff9a114c700 1 -- 172.21.15.50:0/4153946442 learned_addr learned my addr 172.21.15.50:0/4153946442 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:37.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.758+0000 7ff9a094b700 1 --2- 172.21.15.50:0/4153946442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff99c0f66d0 0x7ff99c106240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:37.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.758+0000 7ff9a114c700 1 -- 172.21.15.50:0/4153946442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff99c0f66d0 msgr2=0x7ff99c106240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:37.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.758+0000 7ff9a114c700 1 --2- 172.21.15.50:0/4153946442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff99c0f66d0 0x7ff99c106240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:37.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.758+0000 7ff9a114c700 1 -- 172.21.15.50:0/4153946442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c005040 con 0x7ff99c0f5430 2023-01-04T18:26:37.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.758+0000 7ff9a114c700 1 --2- 172.21.15.50:0/4153946442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99c0f5430 0x7ff99c105d50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7ff98c009f50 tx=0x7ff98c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:37.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.758+0000 7ff991ffb700 1 -- 172.21.15.50:0/4153946442 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff98c01a070 con 0x7ff99c0f5430 2023-01-04T18:26:37.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.758+0000 7ff991ffb700 1 -- 172.21.15.50:0/4153946442 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7ff98c012c80 con 0x7ff99c0f5430 2023-01-04T18:26:37.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.758+0000 7ff9a214e700 1 -- 172.21.15.50:0/4153946442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99c107270 con 0x7ff99c0f5430 2023-01-04T18:26:37.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.758+0000 7ff991ffb700 1 -- 172.21.15.50:0/4153946442 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff98c01fa00 con 0x7ff99c0f5430 2023-01-04T18:26:37.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.759+0000 7ff9a214e700 1 -- 172.21.15.50:0/4153946442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99c1077d0 con 0x7ff99c0f5430 2023-01-04T18:26:37.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.759+0000 7ff9a214e700 1 -- 172.21.15.50:0/4153946442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff99c059100 con 0x7ff99c0f5430 2023-01-04T18:26:37.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.760+0000 7ff991ffb700 1 -- 172.21.15.50:0/4153946442 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7ff98c0127b0 con 0x7ff99c0f5430 2023-01-04T18:26:37.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.760+0000 7ff991ffb700 1 --2- 172.21.15.50:0/4153946442 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff988060c30 0x7ff9880630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:37.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.760+0000 7ff991ffb700 1 -- 172.21.15.50:0/4153946442 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7ff98c0800d0 con 0x7ff99c0f5430 2023-01-04T18:26:37.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.760+0000 7ff9a094b700 1 --2- 172.21.15.50:0/4153946442 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff988060c30 0x7ff9880630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:37.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.761+0000 7ff9a094b700 1 --2- 172.21.15.50:0/4153946442 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff988060c30 0x7ff9880630f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7ff998007fd0 tx=0x7ff998009040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:37.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:37.765+0000 7ff991ffb700 1 -- 172.21.15.50:0/4153946442 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7ff98c053f60 con 0x7ff99c0f5430 2023-01-04T18:26:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:38.008+0000 7ff9a214e700 1 -- 172.21.15.50:0/4153946442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff99c0ff620 con 0x7ff99c0f5430 2023-01-04T18:26:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:38.008+0000 7ff991ffb700 1 -- 172.21.15.50:0/4153946442 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+653 (secure 0 0 0) 0x7ff98c053b50 con 0x7ff99c0f5430 2023-01-04T18:26:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:38.010+0000 7ff9a214e700 1 -- 172.21.15.50:0/4153946442 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff988060c30 msgr2=0x7ff9880630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:38.010+0000 7ff9a214e700 1 --2- 172.21.15.50:0/4153946442 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff988060c30 0x7ff9880630f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7ff998007fd0 tx=0x7ff998009040).stop 2023-01-04T18:26:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:38.010+0000 7ff9a214e700 1 -- 172.21.15.50:0/4153946442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99c0f5430 msgr2=0x7ff99c105d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:38.010+0000 7ff9a214e700 1 --2- 172.21.15.50:0/4153946442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99c0f5430 0x7ff99c105d50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7ff98c009f50 tx=0x7ff98c009b30).stop 2023-01-04T18:26:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:38.010+0000 7ff9a214e700 1 -- 172.21.15.50:0/4153946442 shutdown_connections 2023-01-04T18:26:38.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:38.010+0000 7ff9a214e700 1 --2- 172.21.15.50:0/4153946442 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff988060c30 0x7ff9880630f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:38.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:38.010+0000 7ff9a214e700 1 --2- 172.21.15.50:0/4153946442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff99c0f5430 0x7ff99c105d50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:38.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:38.010+0000 7ff9a214e700 1 --2- 172.21.15.50:0/4153946442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff99c0f66d0 0x7ff99c106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:38.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:38.010+0000 7ff9a214e700 1 -- 172.21.15.50:0/4153946442 >> 172.21.15.50:0/4153946442 conn(0x7ff99c0f0b90 msgr2=0x7ff99c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:38.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:38.010+0000 7ff9a214e700 1 -- 172.21.15.50:0/4153946442 shutdown_connections 2023-01-04T18:26:38.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:38.010+0000 7ff9a214e700 1 -- 172.21.15.50:0/4153946442 wait complete. 2023-01-04T18:26:38.024 INFO:teuthology.orchestra.run.smithi050.stdout:true 2023-01-04T18:26:38.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:36.733967+0000 mgr.smithi050.emnywo (mgr.24517) 456 : cluster [DBG] pgmap v330: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:38.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:38 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:38.009883+0000 mon.smithi050 (mon.0) 807 : audit [DBG] from='client.? 172.21.15.50:0/4153946442' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:26:38.435 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -e sha1=f2bb1478686242c0f68882a9cf8df4e0f8363116 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2023-01-04T18:26:38.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:36.733967+0000 mgr.smithi050.emnywo (mgr.24517) 456 : cluster [DBG] pgmap v330: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:38.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:38.009883+0000 mon.smithi050 (mon.0) 807 : audit [DBG] from='client.? 172.21.15.50:0/4153946442' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:26:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.024+0000 7f94ac5ed700 1 -- 172.21.15.50:0/3631282887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a40f6860 msgr2=0x7f94a40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.024+0000 7f94ac5ed700 1 --2- 172.21.15.50:0/3631282887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a40f6860 0x7f94a40f6cc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f94a0004660 tx=0x7f94a0009b30).stop 2023-01-04T18:26:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.024+0000 7f94ac5ed700 1 -- 172.21.15.50:0/3631282887 shutdown_connections 2023-01-04T18:26:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.024+0000 7f94ac5ed700 1 --2- 172.21.15.50:0/3631282887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a40f6860 0x7f94a40f6cc0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.024+0000 7f94ac5ed700 1 --2- 172.21.15.50:0/3631282887 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94a40f55c0 0x7f94a40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.024+0000 7f94ac5ed700 1 -- 172.21.15.50:0/3631282887 >> 172.21.15.50:0/3631282887 conn(0x7f94a40f0d40 msgr2=0x7f94a40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.024+0000 7f94ac5ed700 1 -- 172.21.15.50:0/3631282887 shutdown_connections 2023-01-04T18:26:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.024+0000 7f94ac5ed700 1 -- 172.21.15.50:0/3631282887 wait complete. 2023-01-04T18:26:40.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.025+0000 7f94ac5ed700 1 Processor -- start 2023-01-04T18:26:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.025+0000 7f94ac5ed700 1 -- start start 2023-01-04T18:26:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.025+0000 7f94ac5ed700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a40f55c0 0x7f94a4109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.025+0000 7f94ac5ed700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94a40f6860 0x7f94a410c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.025+0000 7f94ac5ed700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a40603c0 con 0x7f94a40f55c0 2023-01-04T18:26:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.025+0000 7f94ac5ed700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a4060500 con 0x7f94a40f6860 2023-01-04T18:26:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.025+0000 7f94aa389700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a40f55c0 0x7f94a4109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.025+0000 7f94aa389700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a40f55c0 0x7f94a4109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52436/0 (socket says 172.21.15.50:52436) 2023-01-04T18:26:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.025+0000 7f94aa389700 1 -- 172.21.15.50:0/3845121334 learned_addr learned my addr 172.21.15.50:0/3845121334 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.025+0000 7f94a9b88700 1 --2- 172.21.15.50:0/3845121334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94a40f6860 0x7f94a410c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.025+0000 7f94aa389700 1 -- 172.21.15.50:0/3845121334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94a40f6860 msgr2=0x7f94a410c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.025+0000 7f94aa389700 1 --2- 172.21.15.50:0/3845121334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94a40f6860 0x7f94a410c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:40.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.026+0000 7f94aa389700 1 -- 172.21.15.50:0/3845121334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a0005040 con 0x7f94a40f55c0 2023-01-04T18:26:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.026+0000 7f94aa389700 1 --2- 172.21.15.50:0/3845121334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a40f55c0 0x7f94a4109c90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f949800c530 tx=0x7f9498007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.026+0000 7f9496ffd700 1 -- 172.21.15.50:0/3845121334 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f949800f650 con 0x7f94a40f55c0 2023-01-04T18:26:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.026+0000 7f9496ffd700 1 -- 172.21.15.50:0/3845121334 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f949800fc80 con 0x7f94a40f55c0 2023-01-04T18:26:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.026+0000 7f9496ffd700 1 -- 172.21.15.50:0/3845121334 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9498012e00 con 0x7f94a40f55c0 2023-01-04T18:26:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.026+0000 7f94ac5ed700 1 -- 172.21.15.50:0/3845121334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a410c740 con 0x7f94a40f55c0 2023-01-04T18:26:40.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.026+0000 7f94ac5ed700 1 -- 172.21.15.50:0/3845121334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a410cc80 con 0x7f94a40f55c0 2023-01-04T18:26:40.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.027+0000 7f94ac5ed700 1 -- 172.21.15.50:0/3845121334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a4045ad0 con 0x7f94a40f55c0 2023-01-04T18:26:40.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.027+0000 7f9496ffd700 1 -- 172.21.15.50:0/3845121334 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f9498019030 con 0x7f94a40f55c0 2023-01-04T18:26:40.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.028+0000 7f9496ffd700 1 --2- 172.21.15.50:0/3845121334 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f9490060be0 0x7f94900630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:40.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.028+0000 7f9496ffd700 1 -- 172.21.15.50:0/3845121334 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f949807bab0 con 0x7f94a40f55c0 2023-01-04T18:26:40.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.028+0000 7f94a9b88700 1 --2- 172.21.15.50:0/3845121334 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f9490060be0 0x7f94900630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:40.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.028+0000 7f94a9b88700 1 --2- 172.21.15.50:0/3845121334 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f9490060be0 0x7f94900630a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f94a0004e30 tx=0x7f94a0009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.032+0000 7f9496ffd700 1 -- 172.21.15.50:0/3845121334 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f9498048c30 con 0x7f94a40f55c0 2023-01-04T18:26:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.274+0000 7f94ac5ed700 1 -- 172.21.15.50:0/3845121334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f94a40fded0 con 0x7f94a40f55c0 2023-01-04T18:26:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.274+0000 7f9496ffd700 1 -- 172.21.15.50:0/3845121334 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+653 (secure 0 0 0) 0x7f949804c080 con 0x7f94a40f55c0 2023-01-04T18:26:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.276+0000 7f94ac5ed700 1 -- 172.21.15.50:0/3845121334 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f9490060be0 msgr2=0x7f94900630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.276+0000 7f94ac5ed700 1 --2- 172.21.15.50:0/3845121334 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f9490060be0 0x7f94900630a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f94a0004e30 tx=0x7f94a0009b30).stop 2023-01-04T18:26:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.276+0000 7f94ac5ed700 1 -- 172.21.15.50:0/3845121334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a40f55c0 msgr2=0x7f94a4109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.276+0000 7f94ac5ed700 1 --2- 172.21.15.50:0/3845121334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a40f55c0 0x7f94a4109c90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f949800c530 tx=0x7f9498007e10).stop 2023-01-04T18:26:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.276+0000 7f94ac5ed700 1 -- 172.21.15.50:0/3845121334 shutdown_connections 2023-01-04T18:26:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.276+0000 7f94ac5ed700 1 --2- 172.21.15.50:0/3845121334 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f9490060be0 0x7f94900630a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.276+0000 7f94ac5ed700 1 --2- 172.21.15.50:0/3845121334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94a40f55c0 0x7f94a4109c90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.276+0000 7f94ac5ed700 1 --2- 172.21.15.50:0/3845121334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94a40f6860 0x7f94a410c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.276+0000 7f94ac5ed700 1 -- 172.21.15.50:0/3845121334 >> 172.21.15.50:0/3845121334 conn(0x7f94a40f0d40 msgr2=0x7f94a40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:40.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.276+0000 7f94ac5ed700 1 -- 172.21.15.50:0/3845121334 shutdown_connections 2023-01-04T18:26:40.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:40.276+0000 7f94ac5ed700 1 -- 172.21.15.50:0/3845121334 wait complete. 2023-01-04T18:26:40.289 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph version 16.2.10-1543-gf2bb1478 (f2bb1478686242c0f68882a9cf8df4e0f8363116) pacific (stable)" 2023-01-04T18:26:40.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:40 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:38.734501+0000 mgr.smithi050.emnywo (mgr.24517) 457 : cluster [DBG] pgmap v331: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:40.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:40 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:38.734501+0000 mgr.smithi050.emnywo (mgr.24517) 457 : cluster [DBG] pgmap v331: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:40.869 DEBUG:teuthology.parallel:result is None 2023-01-04T18:26:40.870 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-01-04T18:26:40.885 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi050.front.sepia.ceph.com 2023-01-04T18:26:40.885 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d98671da-8c5a-11ed-821a-001a4aab830c -- bash -c 'ceph fs dump' 2023-01-04T18:26:41.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:41 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:40.274697+0000 mon.smithi050 (mon.0) 808 : audit [DBG] from='client.? 172.21.15.50:0/3845121334' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:26:41.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:41 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:40.274697+0000 mon.smithi050 (mon.0) 808 : audit [DBG] from='client.? 172.21.15.50:0/3845121334' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-01-04T18:26:42.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.483+0000 7f7eaf7c6700 1 -- 172.21.15.50:0/3416755310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ea80f66e0 msgr2=0x7f7ea80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:42.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.483+0000 7f7eaf7c6700 1 --2- 172.21.15.50:0/3416755310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ea80f66e0 0x7f7ea80f6b00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f7ea4004660 tx=0x7f7ea4009b30).stop 2023-01-04T18:26:42.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.483+0000 7f7eaf7c6700 1 -- 172.21.15.50:0/3416755310 shutdown_connections 2023-01-04T18:26:42.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.483+0000 7f7eaf7c6700 1 --2- 172.21.15.50:0/3416755310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ea80f7980 0x7f7ea80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:42.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.483+0000 7f7eaf7c6700 1 --2- 172.21.15.50:0/3416755310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ea80f66e0 0x7f7ea80f6b00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:42.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.483+0000 7f7eaf7c6700 1 -- 172.21.15.50:0/3416755310 >> 172.21.15.50:0/3416755310 conn(0x7f7ea80f1e40 msgr2=0x7f7ea80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:42.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.484+0000 7f7eaf7c6700 1 -- 172.21.15.50:0/3416755310 shutdown_connections 2023-01-04T18:26:42.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.484+0000 7f7eaf7c6700 1 -- 172.21.15.50:0/3416755310 wait complete. 2023-01-04T18:26:42.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.484+0000 7f7eaf7c6700 1 Processor -- start 2023-01-04T18:26:42.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.484+0000 7f7eaf7c6700 1 -- start start 2023-01-04T18:26:42.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.484+0000 7f7eaf7c6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ea80f66e0 0x7f7ea806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:42.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.484+0000 7f7eaf7c6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ea80f7980 0x7f7ea8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:42.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.484+0000 7f7eaf7c6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea806a380 con 0x7f7ea80f66e0 2023-01-04T18:26:42.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.484+0000 7f7eaf7c6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea806a4c0 con 0x7f7ea80f7980 2023-01-04T18:26:42.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.484+0000 7f7ead562700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ea80f66e0 0x7f7ea806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:42.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.484+0000 7f7ead562700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ea80f66e0 0x7f7ea806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52442/0 (socket says 172.21.15.50:52442) 2023-01-04T18:26:42.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.484+0000 7f7ead562700 1 -- 172.21.15.50:0/683087518 learned_addr learned my addr 172.21.15.50:0/683087518 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:42.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.485+0000 7f7eacd61700 1 --2- 172.21.15.50:0/683087518 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ea80f7980 0x7f7ea8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:42.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.485+0000 7f7ead562700 1 -- 172.21.15.50:0/683087518 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ea80f7980 msgr2=0x7f7ea8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:42.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.485+0000 7f7ead562700 1 --2- 172.21.15.50:0/683087518 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ea80f7980 0x7f7ea8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:42.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.485+0000 7f7ead562700 1 -- 172.21.15.50:0/683087518 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea4005040 con 0x7f7ea80f66e0 2023-01-04T18:26:42.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.485+0000 7f7eacd61700 1 --2- 172.21.15.50:0/683087518 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ea80f7980 0x7f7ea8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:26:42.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.485+0000 7f7ead562700 1 --2- 172.21.15.50:0/683087518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ea80f66e0 0x7f7ea806b9a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f7ea4004e30 tx=0x7f7ea4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:42.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.485+0000 7f7e99ffb700 1 -- 172.21.15.50:0/683087518 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ea4018070 con 0x7f7ea80f66e0 2023-01-04T18:26:42.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.485+0000 7f7e99ffb700 1 -- 172.21.15.50:0/683087518 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f7ea4007ba0 con 0x7f7ea80f66e0 2023-01-04T18:26:42.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.485+0000 7f7eaf7c6700 1 -- 172.21.15.50:0/683087518 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea806a740 con 0x7f7ea80f66e0 2023-01-04T18:26:42.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.485+0000 7f7e99ffb700 1 -- 172.21.15.50:0/683087518 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ea401c620 con 0x7f7ea80f66e0 2023-01-04T18:26:42.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.485+0000 7f7eaf7c6700 1 -- 172.21.15.50:0/683087518 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea806aca0 con 0x7f7ea80f66e0 2023-01-04T18:26:42.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.486+0000 7f7eaf7c6700 1 -- 172.21.15.50:0/683087518 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea8045ad0 con 0x7f7ea80f66e0 2023-01-04T18:26:42.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.487+0000 7f7e99ffb700 1 -- 172.21.15.50:0/683087518 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f7ea4007d10 con 0x7f7ea80f66e0 2023-01-04T18:26:42.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.487+0000 7f7e99ffb700 1 --2- 172.21.15.50:0/683087518 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7e94060be0 0x7f7e940630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:42.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.487+0000 7f7e99ffb700 1 -- 172.21.15.50:0/683087518 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f7ea407da50 con 0x7f7ea80f66e0 2023-01-04T18:26:42.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.487+0000 7f7eacd61700 1 --2- 172.21.15.50:0/683087518 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7e94060be0 0x7f7e940630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:42.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.487+0000 7f7eacd61700 1 --2- 172.21.15.50:0/683087518 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7e94060be0 0x7f7e940630a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f7e9c009780 tx=0x7f7e9c009c80).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:42.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.491+0000 7f7e99ffb700 1 -- 172.21.15.50:0/683087518 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f7ea404dff0 con 0x7f7ea80f66e0 2023-01-04T18:26:42.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:42 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:40.735080+0000 mgr.smithi050.emnywo (mgr.24517) 458 : cluster [DBG] pgmap v332: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:26:42.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:42 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:40.735080+0000 mgr.smithi050.emnywo (mgr.24517) 458 : cluster [DBG] pgmap v332: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:26:42.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.706+0000 7f7eaf7c6700 1 -- 172.21.15.50:0/683087518 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7ea80fef40 con 0x7f7ea80f66e0 2023-01-04T18:26:42.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.707+0000 7f7e99ffb700 1 -- 172.21.15.50:0/683087518 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1791 (secure 0 0 0) 0x7f7ea4051610 con 0x7f7ea80f66e0 2023-01-04T18:26:42.709 INFO:teuthology.orchestra.run.smithi050.stdout:e36 2023-01-04T18:26:42.709 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-01-04T18:26:42.709 INFO:teuthology.orchestra.run.smithi050.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:26:42.709 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-01-04T18:26:42.710 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:42.710 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-01-04T18:26:42.710 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-01-04T18:26:42.710 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 36 2023-01-04T18:26:42.710 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 2023-01-04T18:26:42.710 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-01-04T18:14:30.390760+0000 2023-01-04T18:26:42.710 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-01-04T18:23:41.431715+0000 2023-01-04T18:26:42.710 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-01-04T18:26:42.710 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-01-04T18:26:42.710 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 60 2023-01-04T18:26:42.710 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-01-04T18:26:42.710 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-01-04T18:26:42.711 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-01-04T18:26:42.711 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-01-04T18:26:42.711 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 95 2023-01-04T18:26:42.711 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-01-04T18:26:42.711 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 1 2023-01-04T18:26:42.711 INFO:teuthology.orchestra.run.smithi050.stdout:in 0 2023-01-04T18:26:42.711 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=34362} 2023-01-04T18:26:42.711 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-01-04T18:26:42.711 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-01-04T18:26:42.711 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-01-04T18:26:42.711 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-01-04T18:26:42.711 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-01-04T18:26:42.711 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data enabled 2023-01-04T18:26:42.712 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-01-04T18:26:42.712 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 1 2023-01-04T18:26:42.712 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.ezoiwl{0:34362} state up:active seq 17 join_fscid=1 addr [v2:172.21.15.50:6826/336562041,v1:172.21.15.50:6827/336562041] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:26:42.712 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.kefmuy{0:34366} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.50:6828/2188030488,v1:172.21.15.50:6829/2188030488] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:26:42.712 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:42.712 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:42.712 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2023-01-04T18:26:42.712 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:42.712 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.memais{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.98:6824/4224872601,v1:172.21.15.98:6825/4224872601] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:26:42.712 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi098.laynsk{-1:44317} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.98:6826/503298078,v1:172.21.15.98:6827/503298078] compat {c=[1],r=[1],i=[7ff]}] 2023-01-04T18:26:42.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.709+0000 7f7eaf7c6700 1 -- 172.21.15.50:0/683087518 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7e94060be0 msgr2=0x7f7e940630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:42.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.709+0000 7f7eaf7c6700 1 --2- 172.21.15.50:0/683087518 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7e94060be0 0x7f7e940630a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f7e9c009780 tx=0x7f7e9c009c80).stop 2023-01-04T18:26:42.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.709+0000 7f7eaf7c6700 1 -- 172.21.15.50:0/683087518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ea80f66e0 msgr2=0x7f7ea806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:42.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.709+0000 7f7eaf7c6700 1 --2- 172.21.15.50:0/683087518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ea80f66e0 0x7f7ea806b9a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f7ea4004e30 tx=0x7f7ea4009b30).stop 2023-01-04T18:26:42.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.709+0000 7f7eaf7c6700 1 -- 172.21.15.50:0/683087518 shutdown_connections 2023-01-04T18:26:42.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.709+0000 7f7eaf7c6700 1 --2- 172.21.15.50:0/683087518 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7e94060be0 0x7f7e940630a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:42.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.709+0000 7f7eaf7c6700 1 --2- 172.21.15.50:0/683087518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ea80f66e0 0x7f7ea806b9a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:42.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.709+0000 7f7eaf7c6700 1 --2- 172.21.15.50:0/683087518 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ea80f7980 0x7f7ea8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:42.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.709+0000 7f7eaf7c6700 1 -- 172.21.15.50:0/683087518 >> 172.21.15.50:0/683087518 conn(0x7f7ea80f1e40 msgr2=0x7f7ea80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:42.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.709+0000 7f7eaf7c6700 1 -- 172.21.15.50:0/683087518 shutdown_connections 2023-01-04T18:26:42.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:42.709+0000 7f7eaf7c6700 1 -- 172.21.15.50:0/683087518 wait complete. 2023-01-04T18:26:42.714 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 36 2023-01-04T18:26:43.208 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2023-01-04T18:26:43.222 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-04T18:26:43.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.344+0000 7fdad467a700 1 -- 172.21.15.50:0/1721754612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc0f5cc0 msgr2=0x7fdacc0f66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:43.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.344+0000 7fdad467a700 1 --2- 172.21.15.50:0/1721754612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc0f5cc0 0x7fdacc0f66f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fdabc004660 tx=0x7fdabc009b30).stop 2023-01-04T18:26:43.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.344+0000 7fdad467a700 1 -- 172.21.15.50:0/1721754612 shutdown_connections 2023-01-04T18:26:43.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.344+0000 7fdad467a700 1 --2- 172.21.15.50:0/1721754612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc0f5cc0 0x7fdacc0f66f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:43.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.344+0000 7fdad467a700 1 --2- 172.21.15.50:0/1721754612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdacc0f53b0 0x7fdacc0f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:43.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.344+0000 7fdad467a700 1 -- 172.21.15.50:0/1721754612 >> 172.21.15.50:0/1721754612 conn(0x7fdacc0f0bd0 msgr2=0x7fdacc0f2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:43.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.344+0000 7fdad467a700 1 -- 172.21.15.50:0/1721754612 shutdown_connections 2023-01-04T18:26:43.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.344+0000 7fdad467a700 1 -- 172.21.15.50:0/1721754612 wait complete. 2023-01-04T18:26:43.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.345+0000 7fdad467a700 1 Processor -- start 2023-01-04T18:26:43.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.345+0000 7fdad467a700 1 -- start start 2023-01-04T18:26:43.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.345+0000 7fdad467a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdacc0f53b0 0x7fdacc105ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:43.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.345+0000 7fdad467a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc0f5cc0 0x7fdacc105fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:43.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.345+0000 7fdad467a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc106570 con 0x7fdacc0f5cc0 2023-01-04T18:26:43.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.345+0000 7fdad467a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc1066b0 con 0x7fdacc0f53b0 2023-01-04T18:26:43.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.345+0000 7fdad1c15700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc0f5cc0 0x7fdacc105fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:43.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.345+0000 7fdad1c15700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc0f5cc0 0x7fdacc105fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52462/0 (socket says 172.21.15.50:52462) 2023-01-04T18:26:43.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.345+0000 7fdad1c15700 1 -- 172.21.15.50:0/2210589351 learned_addr learned my addr 172.21.15.50:0/2210589351 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:43.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.345+0000 7fdad2416700 1 --2- 172.21.15.50:0/2210589351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdacc0f53b0 0x7fdacc105ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:43.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.345+0000 7fdad1c15700 1 -- 172.21.15.50:0/2210589351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdacc0f53b0 msgr2=0x7fdacc105ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:43.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.345+0000 7fdad1c15700 1 --2- 172.21.15.50:0/2210589351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdacc0f53b0 0x7fdacc105ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:43.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.345+0000 7fdad1c15700 1 -- 172.21.15.50:0/2210589351 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc005040 con 0x7fdacc0f5cc0 2023-01-04T18:26:43.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.345+0000 7fdad2416700 1 --2- 172.21.15.50:0/2210589351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdacc0f53b0 0x7fdacc105ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:26:43.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.345+0000 7fdad1c15700 1 --2- 172.21.15.50:0/2210589351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc0f5cc0 0x7fdacc105fc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fdabc009830 tx=0x7fdabc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:43.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.346+0000 7fdac2ffd700 1 -- 172.21.15.50:0/2210589351 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdabc018070 con 0x7fdacc0f5cc0 2023-01-04T18:26:43.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.346+0000 7fdac2ffd700 1 -- 172.21.15.50:0/2210589351 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fdabc007d70 con 0x7fdacc0f5cc0 2023-01-04T18:26:43.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.346+0000 7fdac2ffd700 1 -- 172.21.15.50:0/2210589351 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdabc01c620 con 0x7fdacc0f5cc0 2023-01-04T18:26:43.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.346+0000 7fdad467a700 1 -- 172.21.15.50:0/2210589351 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdacc05f230 con 0x7fdacc0f5cc0 2023-01-04T18:26:43.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.346+0000 7fdad467a700 1 -- 172.21.15.50:0/2210589351 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdacc05f7a0 con 0x7fdacc0f5cc0 2023-01-04T18:26:43.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.347+0000 7fdad467a700 1 -- 172.21.15.50:0/2210589351 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdacc046330 con 0x7fdacc0f5cc0 2023-01-04T18:26:43.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.347+0000 7fdac2ffd700 1 -- 172.21.15.50:0/2210589351 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fdabc01c850 con 0x7fdacc0f5cc0 2023-01-04T18:26:43.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.348+0000 7fdac2ffd700 1 --2- 172.21.15.50:0/2210589351 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fdab8062eb0 0x7fdab8065370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:43.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.348+0000 7fdac2ffd700 1 -- 172.21.15.50:0/2210589351 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fdabc07dcb0 con 0x7fdacc0f5cc0 2023-01-04T18:26:43.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.348+0000 7fdad2416700 1 --2- 172.21.15.50:0/2210589351 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fdab8062eb0 0x7fdab8065370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:43.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.348+0000 7fdad2416700 1 --2- 172.21.15.50:0/2210589351 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fdab8062eb0 0x7fdab8065370 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fdac80041d0 tx=0x7fdac8009040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:43.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.352+0000 7fdac2ffd700 1 -- 172.21.15.50:0/2210589351 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fdabc051ba0 con 0x7fdacc0f5cc0 2023-01-04T18:26:43.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.526+0000 7fdad467a700 1 -- 172.21.15.50:0/2210589351 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdacc0ffb70 con 0x7fdacc0f5cc0 2023-01-04T18:26:43.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.527+0000 7fdac2ffd700 1 -- 172.21.15.50:0/2210589351 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+15124 (secure 0 0 0) 0x7fdabc051790 con 0x7fdacc0f5cc0 2023-01-04T18:26:43.533 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:43.534 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"fsid":"d98671da-8c5a-11ed-821a-001a4aab830c","created":"2023-01-04T18:09:16.009200+0000","modified":"2023-01-04T18:23:29.046767+0000","last_up_change":"2023-01-04T18:22:32.149113+0000","last_in_change":"2023-01-04T18:13:05.868442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-01-04T18:12:40.118167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-01-04T18:14:29.272955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-01-04T18:14:29.814288+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"364b88f0-63eb-4ee0-9961-6d394328fb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":45,"up_from":49,"up_thru":91,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2203732943},{"type":"v1","addr":"172.21.15.50:6803","nonce":2203732943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2203732943},{"type":"v1","addr":"172.21.15.50:6805","nonce":2203732943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2203732943},{"type":"v1","addr":"172.21.15.50:6809","nonce":2203732943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2203732943},{"type":"v1","addr":"172.21.15.50:6807","nonce":2203732943}]},"public_addr":"172.21.15.50:6803/2203732943","cluster_addr":"172.21.15.50:6805/2203732943","heartbeat_back_addr":"172.21.15.50:6809/2203732943","heartbeat_front_addr":"172.21.15.50:6807/2203732943","state":["exists","up"]},{"osd":1,"uuid":"2e3617b7-4f5a-417f-ac90-d557ed55507f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":66,"up_from":70,"up_thru":91,"down_at":67,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":4163598188},{"type":"v1","addr":"172.21.15.50:6811","nonce":4163598188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":4163598188},{"type":"v1","addr":"172.21.15.50:6813","nonce":4163598188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":4163598188},{"type":"v1","addr":"172.21.15.50:6817","nonce":4163598188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":4163598188},{"type":"v1","addr":"172.21.15.50:6815","nonce":4163598188}]},"public_addr":"172.21.15.50:6811/4163598188","cluster_addr":"172.21.15.50:6813/4163598188","heartbeat_back_addr":"172.21.15.50:6817/4163598188","heartbeat_front_addr":"172.21.15.50:6815/4163598188","state":["exists","up"]},{"osd":2,"uuid":"f5fb8cb5-19be-471e-a297-0cfa6721f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":17,"last_clean_end":71,"up_from":75,"up_thru":91,"down_at":72,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2194889581},{"type":"v1","addr":"172.21.15.50:6819","nonce":2194889581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2194889581},{"type":"v1","addr":"172.21.15.50:6821","nonce":2194889581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":2194889581},{"type":"v1","addr":"172.21.15.50:6825","nonce":2194889581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2194889581},{"type":"v1","addr":"172.21.15.50:6823","nonce":2194889581}]},"public_addr":"172.21.15.50:6819/2194889581","cluster_addr":"172.21.15.50:6821/2194889581","heartbeat_back_addr":"172.21.15.50:6825/2194889581","heartbeat_front_addr":"172.21.15.50:6823/2194889581","state":["exists","up"]},{"osd":3,"uuid":"ebc8dd52-f41d-4d85-a3bd-16ad8d121436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":25,"last_clean_end":76,"up_from":80,"up_thru":91,"down_at":77,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":342235756},{"type":"v1","addr":"172.21.15.98:6801","nonce":342235756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":342235756},{"type":"v1","addr":"172.21.15.98:6803","nonce":342235756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":342235756},{"type":"v1","addr":"172.21.15.98:6807","nonce":342235756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":342235756},{"type":"v1","addr":"172.21.15.98:6805","nonce":342235756}]},"public_addr":"172.21.15.98:6801/342235756","cluster_addr":"172.21.15.98:6803/342235756","heartbeat_back_addr":"172.21.15.98:6807/342235756","heartbeat_front_addr":"172.21.15.98:6805/342235756","state":["exists","up"]},{"osd":4,"uuid":"37f00733-dce6-4862-96b7-2eab49821451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":30,"last_clean_end":81,"up_from":85,"up_thru":91,"down_at":82,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4264187921},{"type":"v1","addr":"172.21.15.98:6809","nonce":4264187921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4264187921},{"type":"v1","addr":"172.21.15.98:6811","nonce":4264187921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4264187921},{"type":"v1","addr":"172.21.15.98:6815","nonce":4264187921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4264187921},{"type":"v1","addr":"172.21.15.98:6813","nonce":4264187921}]},"public_addr":"172.21.15.98:6809/4264187921","cluster_addr":"172.21.15.98:6811/4264187921","heartbeat_back_addr":"172.21.15.98:6815/4264187921","heartbeat_front_addr":"172.21.15.98:6813/4264187921","state":["exists","up"]},{"osd":5,"uuid":"773a186f-cbc1-40a2-a7ae-183f3bbdfd9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":86,"up_from":91,"up_thru":91,"down_at":87,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3738895016},{"type":"v1","addr":"172.21.15.98:6817","nonce":3738895016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3738895016},{"type":"v1","addr":"172.21.15.98:6819","nonce":3738895016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3738895016},{"type":"v1","addr":"172.21.15.98:6823","nonce":3738895016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3738895016},{"type":"v1","addr":"172.21.15.98:6821","nonce":3738895016}]},"public_addr":"172.21.15.98:6817/3738895016","cluster_addr":"172.21.15.98:6819/3738895016","heartbeat_back_addr":"172.21.15.98:6823/3738895016","heartbeat_front_addr":"172.21.15.98:6821/3738895016","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:11:53.534560+0000","dead_epoch":46},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:12:10.806420+0000","dead_epoch":67},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:12:28.093489+0000","dead_epoch":72},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:12:44.642140+0000","dead_epoch":77},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:13:02.605039+0000","dead_epoch":82},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-04T18:13:21.050426+0000","dead_epoch":87}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6827/1785480263":"2023-01-05T18:23:29.046738+0000","172.21.15.50:6829/3827606592":"2023-01-05T18:22:53.277501+0000","172.21.15.50:6828/3827606592":"2023-01-05T18:22:53.277501+0000","172.21.15.50:6827/4069909541":"2023-01-05T18:22:31.147559+0000","172.21.15.50:6801/3751193798":"2023-01-05T18:09:59.360317+0000","172.21.15.50:6800/3751193798":"2023-01-05T18:09:59.360317+0000","172.21.15.98:0/1005823670":"2023-01-05T18:17:23.589562+0000","172.21.15.50:0/1815506343":"2023-01-05T18:09:59.360317+0000","172.21.15.50:0/2856929359":"2023-01-05T18:09:59.360317+0000","172.21.15.98:6826/1785480263":"2023-01-05T18:23:29.046738+0000","172.21.15.50:6800/27207172":"2023-01-05T18:09:35.421204+0000","172.21.15.98:0/3235339222":"2023-01-05T18:17:23.589562+0000","172.21.15.98:0/130677606":"2023-01-05T18:17:23.589562+0000","172.21.15.50:6801/2515216785":"2023-01-05T18:10:13.194077+0000","172.21.15.98:6829/3052541756":"2023-01-05T18:17:23.589562+0000","172.21.15.50:6826/4069909541":"2023-01-05T18:22:31.147559+0000","172.21.15.50:0/2251259553":"2023-01-05T18:16:05.851793+0000","172.21.15.98:6828/3052541756":"2023-01-05T18:17:23.589562+0000","172.21.15.50:6801/27207172":"2023-01-05T18:09:35.421204+0000","172.21.15.50:0/878334031":"2023-01-05T18:10:13.194077+0000","172.21.15.98:0/2610554504":"2023-01-05T18:17:23.589562+0000","172.21.15.50:6800/2223914843":"2023-01-05T18:16:05.851793+0000","172.21.15.50:6801/2223914843":"2023-01-05T18:16:05.851793+0000","172.21.15.50:0/1586567006":"2023-01-05T18:09:35.421204+0000","172.21.15.50:0/2199987942":"2023-01-05T18:09:35.421204+0000","172.21.15.50:0/1004257612":"2023-01-05T18:10:13.194077+0000","172.21.15.50:0/1074390409":"2023-01-05T18:16:05.851793+0000","172.21.15.50:6800/2515216785":"2023-01-05T18:10:13.194077+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-04T18:26:43.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.529+0000 7fdad467a700 1 -- 172.21.15.50:0/2210589351 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fdab8062eb0 msgr2=0x7fdab8065370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.529+0000 7fdad467a700 1 --2- 172.21.15.50:0/2210589351 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fdab8062eb0 0x7fdab8065370 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fdac80041d0 tx=0x7fdac8009040).stop 2023-01-04T18:26:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.529+0000 7fdad467a700 1 -- 172.21.15.50:0/2210589351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc0f5cc0 msgr2=0x7fdacc105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.529+0000 7fdad467a700 1 --2- 172.21.15.50:0/2210589351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc0f5cc0 0x7fdacc105fc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fdabc009830 tx=0x7fdabc009b30).stop 2023-01-04T18:26:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.529+0000 7fdad467a700 1 -- 172.21.15.50:0/2210589351 shutdown_connections 2023-01-04T18:26:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.529+0000 7fdad467a700 1 --2- 172.21.15.50:0/2210589351 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fdab8062eb0 0x7fdab8065370 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.529+0000 7fdad467a700 1 --2- 172.21.15.50:0/2210589351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdacc0f53b0 0x7fdacc105ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.529+0000 7fdad467a700 1 --2- 172.21.15.50:0/2210589351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdacc0f5cc0 0x7fdacc105fc0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.529+0000 7fdad467a700 1 -- 172.21.15.50:0/2210589351 >> 172.21.15.50:0/2210589351 conn(0x7fdacc0f0bd0 msgr2=0x7fdacc0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.529+0000 7fdad467a700 1 -- 172.21.15.50:0/2210589351 shutdown_connections 2023-01-04T18:26:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.529+0000 7fdad467a700 1 -- 172.21.15.50:0/2210589351 wait complete. 2023-01-04T18:26:43.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:43 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:42.707287+0000 mon.smithi050 (mon.0) 809 : audit [DBG] from='client.? 172.21.15.50:0/683087518' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:26:43.546 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-01-04T18:12:40.118167+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-01-04T18:14:29.272955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-01-04T18:14:29.814288+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-01-04T18:26:43.547 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-01-04T18:26:43.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:43 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:42.707287+0000 mon.smithi050 (mon.0) 809 : audit [DBG] from='client.? 172.21.15.50:0/683087518' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-01-04T18:26:43.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.668+0000 7f63720f6700 1 -- 172.21.15.50:0/3249385069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f636c0f5ca0 msgr2=0x7f636c0f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:43.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.668+0000 7f63720f6700 1 --2- 172.21.15.50:0/3249385069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f636c0f5ca0 0x7f636c0f66d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f635c004660 tx=0x7f635c009b30).stop 2023-01-04T18:26:43.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.668+0000 7f63720f6700 1 -- 172.21.15.50:0/3249385069 shutdown_connections 2023-01-04T18:26:43.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.668+0000 7f63720f6700 1 --2- 172.21.15.50:0/3249385069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f636c0f5ca0 0x7f636c0f66d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:43.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.668+0000 7f63720f6700 1 --2- 172.21.15.50:0/3249385069 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f636c0f5390 0x7f636c0f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:43.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.668+0000 7f63720f6700 1 -- 172.21.15.50:0/3249385069 >> 172.21.15.50:0/3249385069 conn(0x7f636c0f0b70 msgr2=0x7f636c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:43.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.668+0000 7f63720f6700 1 -- 172.21.15.50:0/3249385069 shutdown_connections 2023-01-04T18:26:43.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.668+0000 7f63720f6700 1 -- 172.21.15.50:0/3249385069 wait complete. 2023-01-04T18:26:43.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.668+0000 7f63720f6700 1 Processor -- start 2023-01-04T18:26:43.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.669+0000 7f63720f6700 1 -- start start 2023-01-04T18:26:43.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.669+0000 7f63720f6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f636c0f5390 0x7f636c05fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:43.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.669+0000 7f63720f6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f636c0f5ca0 0x7f636c10ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:43.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.669+0000 7f63720f6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c10bf60 con 0x7f636c0f5390 2023-01-04T18:26:43.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.669+0000 7f63720f6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c10c0a0 con 0x7f636c0f5ca0 2023-01-04T18:26:43.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.669+0000 7f636b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f636c0f5390 0x7f636c05fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:43.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.669+0000 7f636b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f636c0f5390 0x7f636c05fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52474/0 (socket says 172.21.15.50:52474) 2023-01-04T18:26:43.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.669+0000 7f636b7fe700 1 -- 172.21.15.50:0/3047280947 learned_addr learned my addr 172.21.15.50:0/3047280947 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:43.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.669+0000 7f636affd700 1 --2- 172.21.15.50:0/3047280947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f636c0f5ca0 0x7f636c10ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:43.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.669+0000 7f636b7fe700 1 -- 172.21.15.50:0/3047280947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f636c0f5ca0 msgr2=0x7f636c10ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:43.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.669+0000 7f636b7fe700 1 --2- 172.21.15.50:0/3047280947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f636c0f5ca0 0x7f636c10ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:43.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.669+0000 7f636b7fe700 1 -- 172.21.15.50:0/3047280947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635c005040 con 0x7f636c0f5390 2023-01-04T18:26:43.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.669+0000 7f636affd700 1 --2- 172.21.15.50:0/3047280947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f636c0f5ca0 0x7f636c10ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-01-04T18:26:43.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.669+0000 7f636b7fe700 1 --2- 172.21.15.50:0/3047280947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f636c0f5390 0x7f636c05fc90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f635400c530 tx=0x7f6354007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:43.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.669+0000 7f6363fff700 1 -- 172.21.15.50:0/3047280947 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f635400f650 con 0x7f636c0f5390 2023-01-04T18:26:43.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.669+0000 7f63720f6700 1 -- 172.21.15.50:0/3047280947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f636c10c300 con 0x7f636c0f5390 2023-01-04T18:26:43.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.669+0000 7f6363fff700 1 -- 172.21.15.50:0/3047280947 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f635400fc80 con 0x7f636c0f5390 2023-01-04T18:26:43.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.669+0000 7f6363fff700 1 -- 172.21.15.50:0/3047280947 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6354012db0 con 0x7f636c0f5390 2023-01-04T18:26:43.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.670+0000 7f63720f6700 1 -- 172.21.15.50:0/3047280947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636c10c890 con 0x7f636c0f5390 2023-01-04T18:26:43.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.671+0000 7f63720f6700 1 -- 172.21.15.50:0/3047280947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f636c046330 con 0x7f636c0f5390 2023-01-04T18:26:43.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.671+0000 7f6363fff700 1 -- 172.21.15.50:0/3047280947 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f6354010070 con 0x7f636c0f5390 2023-01-04T18:26:43.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.671+0000 7f6363fff700 1 --2- 172.21.15.50:0/3047280947 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6358060be0 0x7f63580630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:43.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.671+0000 7f6363fff700 1 -- 172.21.15.50:0/3047280947 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f635407bae0 con 0x7f636c0f5390 2023-01-04T18:26:43.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.671+0000 7f636affd700 1 --2- 172.21.15.50:0/3047280947 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6358060be0 0x7f63580630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:43.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.672+0000 7f636affd700 1 --2- 172.21.15.50:0/3047280947 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6358060be0 0x7f63580630a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f635c005010 tx=0x7f635c009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:43.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.675+0000 7f6363fff700 1 -- 172.21.15.50:0/3047280947 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f6354047c30 con 0x7f636c0f5390 2023-01-04T18:26:43.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.849+0000 7f63720f6700 1 -- 172.21.15.50:0/3047280947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f636c027a00 con 0x7f636c0f5390 2023-01-04T18:26:43.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.849+0000 7f6363fff700 1 -- 172.21.15.50:0/3047280947 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v95) v1 ==== 110+0+10 (secure 0 0 0) 0x7f636c027a00 con 0x7f636c0f5390 2023-01-04T18:26:43.852 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-01-04T18:26:43.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.851+0000 7f63720f6700 1 -- 172.21.15.50:0/3047280947 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6358060be0 msgr2=0x7f63580630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.851+0000 7f63720f6700 1 --2- 172.21.15.50:0/3047280947 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6358060be0 0x7f63580630a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f635c005010 tx=0x7f635c009b30).stop 2023-01-04T18:26:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.851+0000 7f63720f6700 1 -- 172.21.15.50:0/3047280947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f636c0f5390 msgr2=0x7f636c05fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.851+0000 7f63720f6700 1 --2- 172.21.15.50:0/3047280947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f636c0f5390 0x7f636c05fc90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f635400c530 tx=0x7f6354007e20).stop 2023-01-04T18:26:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.851+0000 7f63720f6700 1 -- 172.21.15.50:0/3047280947 shutdown_connections 2023-01-04T18:26:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.851+0000 7f63720f6700 1 --2- 172.21.15.50:0/3047280947 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f6358060be0 0x7f63580630a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.851+0000 7f63720f6700 1 --2- 172.21.15.50:0/3047280947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f636c0f5390 0x7f636c05fc90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.851+0000 7f63720f6700 1 --2- 172.21.15.50:0/3047280947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f636c0f5ca0 0x7f636c10ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.851+0000 7f63720f6700 1 -- 172.21.15.50:0/3047280947 >> 172.21.15.50:0/3047280947 conn(0x7f636c0f0b70 msgr2=0x7f636c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.851+0000 7f63720f6700 1 -- 172.21.15.50:0/3047280947 shutdown_connections 2023-01-04T18:26:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.851+0000 7f63720f6700 1 -- 172.21.15.50:0/3047280947 wait complete. 2023-01-04T18:26:43.866 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-01-04T18:26:43.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.987+0000 7fc030519700 1 -- 172.21.15.50:0/74291773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0280f6660 msgr2=0x7fc0280f6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:43.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.987+0000 7fc030519700 1 --2- 172.21.15.50:0/74291773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0280f6660 0x7fc0280f6ac0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fc018004660 tx=0x7fc018009b30).stop 2023-01-04T18:26:43.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.987+0000 7fc030519700 1 -- 172.21.15.50:0/74291773 shutdown_connections 2023-01-04T18:26:43.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.987+0000 7fc030519700 1 --2- 172.21.15.50:0/74291773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0280f6660 0x7fc0280f6ac0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.987+0000 7fc030519700 1 --2- 172.21.15.50:0/74291773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0280f53c0 0x7fc0280f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.987+0000 7fc030519700 1 -- 172.21.15.50:0/74291773 >> 172.21.15.50:0/74291773 conn(0x7fc0280f0b00 msgr2=0x7fc0280f2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.987+0000 7fc030519700 1 -- 172.21.15.50:0/74291773 shutdown_connections 2023-01-04T18:26:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.987+0000 7fc030519700 1 -- 172.21.15.50:0/74291773 wait complete. 2023-01-04T18:26:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.987+0000 7fc030519700 1 Processor -- start 2023-01-04T18:26:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.988+0000 7fc030519700 1 -- start start 2023-01-04T18:26:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.988+0000 7fc030519700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0280f53c0 0x7fc028060120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.988+0000 7fc030519700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0280f6660 0x7fc02810ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.988+0000 7fc030519700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02810bf60 con 0x7fc0280f6660 2023-01-04T18:26:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.988+0000 7fc030519700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02810c0a0 con 0x7fc0280f53c0 2023-01-04T18:26:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.988+0000 7fc02dab4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0280f6660 0x7fc02810ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:43.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.988+0000 7fc02dab4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0280f6660 0x7fc02810ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52488/0 (socket says 172.21.15.50:52488) 2023-01-04T18:26:43.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.988+0000 7fc02dab4700 1 -- 172.21.15.50:0/3356290659 learned_addr learned my addr 172.21.15.50:0/3356290659 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:43.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.988+0000 7fc02e2b5700 1 --2- 172.21.15.50:0/3356290659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0280f53c0 0x7fc028060120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:43.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.988+0000 7fc02dab4700 1 -- 172.21.15.50:0/3356290659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0280f53c0 msgr2=0x7fc028060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:43.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.988+0000 7fc02dab4700 1 --2- 172.21.15.50:0/3356290659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0280f53c0 0x7fc028060120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:43.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.988+0000 7fc02dab4700 1 -- 172.21.15.50:0/3356290659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc018005040 con 0x7fc0280f6660 2023-01-04T18:26:43.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.988+0000 7fc02dab4700 1 --2- 172.21.15.50:0/3356290659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0280f6660 0x7fc02810ba70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fc0180096b0 tx=0x7fc018009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:43.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.988+0000 7fc01effd700 1 -- 172.21.15.50:0/3356290659 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc018018070 con 0x7fc0280f6660 2023-01-04T18:26:43.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.988+0000 7fc01effd700 1 -- 172.21.15.50:0/3356290659 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fc018007ca0 con 0x7fc0280f6660 2023-01-04T18:26:43.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.988+0000 7fc030519700 1 -- 172.21.15.50:0/3356290659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc02810c2a0 con 0x7fc0280f6660 2023-01-04T18:26:43.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.989+0000 7fc01effd700 1 -- 172.21.15.50:0/3356290659 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc01801c620 con 0x7fc0280f6660 2023-01-04T18:26:43.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.989+0000 7fc030519700 1 -- 172.21.15.50:0/3356290659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02810c800 con 0x7fc0280f6660 2023-01-04T18:26:43.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.989+0000 7fc030519700 1 -- 172.21.15.50:0/3356290659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc028027a00 con 0x7fc0280f6660 2023-01-04T18:26:43.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.990+0000 7fc01effd700 1 -- 172.21.15.50:0/3356290659 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fc01801d420 con 0x7fc0280f6660 2023-01-04T18:26:43.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.990+0000 7fc01effd700 1 --2- 172.21.15.50:0/3356290659 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc014060c30 0x7fc0140630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:43.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.990+0000 7fc01effd700 1 -- 172.21.15.50:0/3356290659 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fc01807dce0 con 0x7fc0280f6660 2023-01-04T18:26:43.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.990+0000 7fc02e2b5700 1 --2- 172.21.15.50:0/3356290659 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc014060c30 0x7fc0140630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:43.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.991+0000 7fc02e2b5700 1 --2- 172.21.15.50:0/3356290659 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc014060c30 0x7fc0140630f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fc0280f64c0 tx=0x7fc024009040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:43.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:43.995+0000 7fc01effd700 1 -- 172.21.15.50:0/3356290659 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fc018084080 con 0x7fc0280f6660 2023-01-04T18:26:44.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.166+0000 7fc030519700 1 -- 172.21.15.50:0/3356290659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fc0280fdb50 con 0x7fc0280f6660 2023-01-04T18:26:44.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.166+0000 7fc01effd700 1 -- 172.21.15.50:0/3356290659 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v95) v1 ==== 107+0+11 (secure 0 0 0) 0x7fc018051b70 con 0x7fc0280f6660 2023-01-04T18:26:44.169 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-01-04T18:26:44.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.168+0000 7fc030519700 1 -- 172.21.15.50:0/3356290659 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc014060c30 msgr2=0x7fc0140630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:44.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.168+0000 7fc030519700 1 --2- 172.21.15.50:0/3356290659 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc014060c30 0x7fc0140630f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fc0280f64c0 tx=0x7fc024009040).stop 2023-01-04T18:26:44.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.168+0000 7fc030519700 1 -- 172.21.15.50:0/3356290659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0280f6660 msgr2=0x7fc02810ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:44.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.168+0000 7fc030519700 1 --2- 172.21.15.50:0/3356290659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0280f6660 0x7fc02810ba70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fc0180096b0 tx=0x7fc018009b30).stop 2023-01-04T18:26:44.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.168+0000 7fc030519700 1 -- 172.21.15.50:0/3356290659 shutdown_connections 2023-01-04T18:26:44.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.168+0000 7fc030519700 1 --2- 172.21.15.50:0/3356290659 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc014060c30 0x7fc0140630f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:44.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.168+0000 7fc030519700 1 --2- 172.21.15.50:0/3356290659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0280f53c0 0x7fc028060120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:44.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.168+0000 7fc030519700 1 --2- 172.21.15.50:0/3356290659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0280f6660 0x7fc02810ba70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:44.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.168+0000 7fc030519700 1 -- 172.21.15.50:0/3356290659 >> 172.21.15.50:0/3356290659 conn(0x7fc0280f0b00 msgr2=0x7fc0280fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:44.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.168+0000 7fc030519700 1 -- 172.21.15.50:0/3356290659 shutdown_connections 2023-01-04T18:26:44.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.168+0000 7fc030519700 1 -- 172.21.15.50:0/3356290659 wait complete. 2023-01-04T18:26:44.183 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-01-04T18:26:44.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.304+0000 7f31a9cac700 1 -- 172.21.15.50:0/1901694472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31a40f5390 msgr2=0x7f31a40f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:44.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.304+0000 7f31a9cac700 1 --2- 172.21.15.50:0/1901694472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31a40f5390 0x7f31a40f57b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f3198004660 tx=0x7f3198009b30).stop 2023-01-04T18:26:44.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.304+0000 7f31a9cac700 1 -- 172.21.15.50:0/1901694472 shutdown_connections 2023-01-04T18:26:44.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.304+0000 7f31a9cac700 1 --2- 172.21.15.50:0/1901694472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31a40f5ca0 0x7f31a40f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:44.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.304+0000 7f31a9cac700 1 --2- 172.21.15.50:0/1901694472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31a40f5390 0x7f31a40f57b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:44.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.304+0000 7f31a9cac700 1 -- 172.21.15.50:0/1901694472 >> 172.21.15.50:0/1901694472 conn(0x7f31a40f0b70 msgr2=0x7f31a40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:44.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.304+0000 7f31a9cac700 1 -- 172.21.15.50:0/1901694472 shutdown_connections 2023-01-04T18:26:44.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.304+0000 7f31a9cac700 1 -- 172.21.15.50:0/1901694472 wait complete. 2023-01-04T18:26:44.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.304+0000 7f31a9cac700 1 Processor -- start 2023-01-04T18:26:44.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.304+0000 7f31a9cac700 1 -- start start 2023-01-04T18:26:44.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.305+0000 7f31a9cac700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31a40f5390 0x7f31a405fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:44.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.305+0000 7f31a9cac700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31a40f5ca0 0x7f31a410b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:44.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.305+0000 7f31a9cac700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a410be70 con 0x7f31a40f5390 2023-01-04T18:26:44.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.305+0000 7f31a9cac700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a410bfb0 con 0x7f31a40f5ca0 2023-01-04T18:26:44.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.305+0000 7f31a37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31a40f5390 0x7f31a405fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:44.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.305+0000 7f31a37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31a40f5390 0x7f31a405fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52502/0 (socket says 172.21.15.50:52502) 2023-01-04T18:26:44.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.305+0000 7f31a37fe700 1 -- 172.21.15.50:0/1548041411 learned_addr learned my addr 172.21.15.50:0/1548041411 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:44.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.305+0000 7f31a2ffd700 1 --2- 172.21.15.50:0/1548041411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31a40f5ca0 0x7f31a410b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:44.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.305+0000 7f31a37fe700 1 -- 172.21.15.50:0/1548041411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31a40f5ca0 msgr2=0x7f31a410b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:44.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.305+0000 7f31a37fe700 1 --2- 172.21.15.50:0/1548041411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31a40f5ca0 0x7f31a410b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.305+0000 7f31a37fe700 1 -- 172.21.15.50:0/1548041411 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3198005040 con 0x7f31a40f5390 2023-01-04T18:26:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.305+0000 7f31a37fe700 1 --2- 172.21.15.50:0/1548041411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31a40f5390 0x7f31a405fc90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f3198000c00 tx=0x7f319800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.305+0000 7f318bfff700 1 -- 172.21.15.50:0/1548041411 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3198019070 con 0x7f31a40f5390 2023-01-04T18:26:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.305+0000 7f31a9cac700 1 -- 172.21.15.50:0/1548041411 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a410c1b0 con 0x7f31a40f5390 2023-01-04T18:26:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.305+0000 7f31a9cac700 1 -- 172.21.15.50:0/1548041411 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a410c6e0 con 0x7f31a40f5390 2023-01-04T18:26:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.305+0000 7f318bfff700 1 -- 172.21.15.50:0/1548041411 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f3198007e90 con 0x7f31a40f5390 2023-01-04T18:26:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.305+0000 7f318bfff700 1 -- 172.21.15.50:0/1548041411 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3198014d40 con 0x7f31a40f5390 2023-01-04T18:26:44.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.306+0000 7f31a9cac700 1 -- 172.21.15.50:0/1548041411 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3184004fa0 con 0x7f31a40f5390 2023-01-04T18:26:44.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.307+0000 7f318bfff700 1 -- 172.21.15.50:0/1548041411 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f3198025070 con 0x7f31a40f5390 2023-01-04T18:26:44.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.307+0000 7f318bfff700 1 --2- 172.21.15.50:0/1548041411 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f318c060be0 0x7f318c0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:44.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.307+0000 7f318bfff700 1 -- 172.21.15.50:0/1548041411 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f319807cc10 con 0x7f31a40f5390 2023-01-04T18:26:44.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.307+0000 7f31a2ffd700 1 --2- 172.21.15.50:0/1548041411 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f318c060be0 0x7f318c0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:44.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.308+0000 7f31a2ffd700 1 --2- 172.21.15.50:0/1548041411 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f318c060be0 0x7f318c0630a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f3194009fd0 tx=0x7f319400b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.311+0000 7f318bfff700 1 -- 172.21.15.50:0/1548041411 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f3198050b00 con 0x7f31a40f5390 2023-01-04T18:26:44.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.484+0000 7f31a9cac700 1 -- 172.21.15.50:0/1548041411 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f3184005bf0 con 0x7f31a40f5390 2023-01-04T18:26:44.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.484+0000 7f318bfff700 1 -- 172.21.15.50:0/1548041411 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v95) v1 ==== 107+0+11 (secure 0 0 0) 0x7f3198023020 con 0x7f31a40f5390 2023-01-04T18:26:44.487 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-01-04T18:26:44.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.486+0000 7f31a9cac700 1 -- 172.21.15.50:0/1548041411 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f318c060be0 msgr2=0x7f318c0630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:44.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.486+0000 7f31a9cac700 1 --2- 172.21.15.50:0/1548041411 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f318c060be0 0x7f318c0630a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f3194009fd0 tx=0x7f319400b040).stop 2023-01-04T18:26:44.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.486+0000 7f31a9cac700 1 -- 172.21.15.50:0/1548041411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31a40f5390 msgr2=0x7f31a405fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:44.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.486+0000 7f31a9cac700 1 --2- 172.21.15.50:0/1548041411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31a40f5390 0x7f31a405fc90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f3198000c00 tx=0x7f319800b040).stop 2023-01-04T18:26:44.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.486+0000 7f31a9cac700 1 -- 172.21.15.50:0/1548041411 shutdown_connections 2023-01-04T18:26:44.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.486+0000 7f31a9cac700 1 --2- 172.21.15.50:0/1548041411 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f318c060be0 0x7f318c0630a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:44.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.486+0000 7f31a9cac700 1 --2- 172.21.15.50:0/1548041411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31a40f5390 0x7f31a405fc90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:44.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.486+0000 7f31a9cac700 1 --2- 172.21.15.50:0/1548041411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31a40f5ca0 0x7f31a410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:44.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.486+0000 7f31a9cac700 1 -- 172.21.15.50:0/1548041411 >> 172.21.15.50:0/1548041411 conn(0x7f31a40f0b70 msgr2=0x7f31a40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:44.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.486+0000 7f31a9cac700 1 -- 172.21.15.50:0/1548041411 shutdown_connections 2023-01-04T18:26:44.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.486+0000 7f31a9cac700 1 -- 172.21.15.50:0/1548041411 wait complete. 2023-01-04T18:26:44.500 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:42.735556+0000 mgr.smithi050.emnywo (mgr.24517) 459 : cluster [DBG] pgmap v333: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:44.500 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:43.526888+0000 mon.smithi050 (mon.0) 810 : audit [DBG] from='client.? 172.21.15.50:0/2210589351' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-01-04T18:26:44.500 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:43.850113+0000 mon.smithi050 (mon.0) 811 : audit [DBG] from='client.? 172.21.15.50:0/3047280947' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2023-01-04T18:26:44.500 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:44 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:44.166988+0000 mon.smithi050 (mon.0) 812 : audit [DBG] from='client.? 172.21.15.50:0/3356290659' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-01-04T18:26:44.501 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-01-04T18:26:44.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:42.735556+0000 mgr.smithi050.emnywo (mgr.24517) 459 : cluster [DBG] pgmap v333: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:44.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:43.526888+0000 mon.smithi050 (mon.0) 810 : audit [DBG] from='client.? 172.21.15.50:0/2210589351' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-01-04T18:26:44.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:43.850113+0000 mon.smithi050 (mon.0) 811 : audit [DBG] from='client.? 172.21.15.50:0/3047280947' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2023-01-04T18:26:44.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:44 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:44.166988+0000 mon.smithi050 (mon.0) 812 : audit [DBG] from='client.? 172.21.15.50:0/3356290659' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-01-04T18:26:44.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.619+0000 7f0381d81700 1 -- 172.21.15.50:0/2539163912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f037c0f53b0 msgr2=0x7f037c0f57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:44.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.619+0000 7f0381d81700 1 --2- 172.21.15.50:0/2539163912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f037c0f53b0 0x7f037c0f57d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f036c004660 tx=0x7f036c009b30).stop 2023-01-04T18:26:44.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.619+0000 7f0381d81700 1 -- 172.21.15.50:0/2539163912 shutdown_connections 2023-01-04T18:26:44.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.619+0000 7f0381d81700 1 --2- 172.21.15.50:0/2539163912 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f037c0f5cc0 0x7f037c0f66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:44.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.619+0000 7f0381d81700 1 --2- 172.21.15.50:0/2539163912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f037c0f53b0 0x7f037c0f57d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:44.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.619+0000 7f0381d81700 1 -- 172.21.15.50:0/2539163912 >> 172.21.15.50:0/2539163912 conn(0x7f037c0f0bd0 msgr2=0x7f037c0f2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:44.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.619+0000 7f0381d81700 1 -- 172.21.15.50:0/2539163912 shutdown_connections 2023-01-04T18:26:44.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.619+0000 7f0381d81700 1 -- 172.21.15.50:0/2539163912 wait complete. 2023-01-04T18:26:44.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.620+0000 7f0381d81700 1 Processor -- start 2023-01-04T18:26:44.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.620+0000 7f0381d81700 1 -- start start 2023-01-04T18:26:44.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.620+0000 7f0381d81700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f037c0f53b0 0x7f037c106af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:44.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.620+0000 7f0381d81700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f037c0f5cc0 0x7f037c106fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:44.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.620+0000 7f0381d81700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c107590 con 0x7f037c0f53b0 2023-01-04T18:26:44.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.620+0000 7f0381d81700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c1076d0 con 0x7f037c0f5cc0 2023-01-04T18:26:44.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.620+0000 7f037b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f037c0f53b0 0x7f037c106af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:44.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.620+0000 7f037b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f037c0f53b0 0x7f037c106af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52520/0 (socket says 172.21.15.50:52520) 2023-01-04T18:26:44.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.620+0000 7f037b7fe700 1 -- 172.21.15.50:0/490103980 learned_addr learned my addr 172.21.15.50:0/490103980 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:44.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.620+0000 7f037affd700 1 --2- 172.21.15.50:0/490103980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f037c0f5cc0 0x7f037c106fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:44.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.621+0000 7f037b7fe700 1 -- 172.21.15.50:0/490103980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f037c0f5cc0 msgr2=0x7f037c106fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:44.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.621+0000 7f037b7fe700 1 --2- 172.21.15.50:0/490103980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f037c0f5cc0 0x7f037c106fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:44.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.621+0000 7f037b7fe700 1 -- 172.21.15.50:0/490103980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c005040 con 0x7f037c0f53b0 2023-01-04T18:26:44.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.621+0000 7f037b7fe700 1 --2- 172.21.15.50:0/490103980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f037c0f53b0 0x7f037c106af0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f036c000c00 tx=0x7f036c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:44.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.621+0000 7f0363fff700 1 -- 172.21.15.50:0/490103980 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f036c019070 con 0x7f037c0f53b0 2023-01-04T18:26:44.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.621+0000 7f0363fff700 1 -- 172.21.15.50:0/490103980 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f036c007e90 con 0x7f037c0f53b0 2023-01-04T18:26:44.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.621+0000 7f0381d81700 1 -- 172.21.15.50:0/490103980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037c10c110 con 0x7f037c0f53b0 2023-01-04T18:26:44.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.621+0000 7f0363fff700 1 -- 172.21.15.50:0/490103980 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f036c014d40 con 0x7f037c0f53b0 2023-01-04T18:26:44.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.621+0000 7f0381d81700 1 -- 172.21.15.50:0/490103980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037c10c6d0 con 0x7f037c0f53b0 2023-01-04T18:26:44.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.622+0000 7f0381d81700 1 -- 172.21.15.50:0/490103980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037c0fdb70 con 0x7f037c0f53b0 2023-01-04T18:26:44.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.622+0000 7f0363fff700 1 -- 172.21.15.50:0/490103980 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f036c025070 con 0x7f037c0f53b0 2023-01-04T18:26:44.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.623+0000 7f0363fff700 1 --2- 172.21.15.50:0/490103980 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0364060ca0 0x7f0364063160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:44.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.623+0000 7f0363fff700 1 -- 172.21.15.50:0/490103980 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f036c07ccd0 con 0x7f037c0f53b0 2023-01-04T18:26:44.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.623+0000 7f037affd700 1 --2- 172.21.15.50:0/490103980 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0364060ca0 0x7f0364063160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:44.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.623+0000 7f037affd700 1 --2- 172.21.15.50:0/490103980 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0364060ca0 0x7f0364063160 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f0370009fd0 tx=0x7f037000b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:44.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.627+0000 7f0363fff700 1 -- 172.21.15.50:0/490103980 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f036c050bc0 con 0x7f037c0f53b0 2023-01-04T18:26:44.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.841+0000 7f0381d81700 1 -- 172.21.15.50:0/490103980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f037c10d100 con 0x7f037c0f53b0 2023-01-04T18:26:44.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.842+0000 7f0363fff700 1 -- 172.21.15.50:0/490103980 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4619 (secure 0 0 0) 0x7f036c023070 con 0x7f037c0f53b0 2023-01-04T18:26:44.844 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:44.844 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44313,"name":"cephfs.smithi098.memais","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/4224872601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4224872601},{"type":"v1","addr":"172.21.15.98:6825","nonce":4224872601}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":44317,"name":"cephfs.smithi098.laynsk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6827/503298078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":503298078},{"type":"v1","addr":"172.21.15.98:6827","nonce":503298078}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:23:41.431715+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34362":{"gid":34362,"name":"cephfs.smithi050.ezoiwl","rank":0,"incarnation":31,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6827/336562041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":336562041},{"type":"v1","addr":"172.21.15.50:6827","nonce":336562041}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34366":{"gid":34366,"name":"cephfs.smithi050.kefmuy","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6829/2188030488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2188030488},{"type":"v1","addr":"172.21.15.50:6829","nonce":2188030488}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:44.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.843+0000 7f0381d81700 1 -- 172.21.15.50:0/490103980 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0364060ca0 msgr2=0x7f0364063160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:44.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.843+0000 7f0381d81700 1 --2- 172.21.15.50:0/490103980 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0364060ca0 0x7f0364063160 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f0370009fd0 tx=0x7f037000b040).stop 2023-01-04T18:26:44.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.843+0000 7f0381d81700 1 -- 172.21.15.50:0/490103980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f037c0f53b0 msgr2=0x7f037c106af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:44.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.843+0000 7f0381d81700 1 --2- 172.21.15.50:0/490103980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f037c0f53b0 0x7f037c106af0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f036c000c00 tx=0x7f036c00b040).stop 2023-01-04T18:26:44.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.843+0000 7f0381d81700 1 -- 172.21.15.50:0/490103980 shutdown_connections 2023-01-04T18:26:44.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.843+0000 7f0381d81700 1 --2- 172.21.15.50:0/490103980 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0364060ca0 0x7f0364063160 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:44.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.843+0000 7f0381d81700 1 --2- 172.21.15.50:0/490103980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f037c0f53b0 0x7f037c106af0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:44.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.843+0000 7f0381d81700 1 --2- 172.21.15.50:0/490103980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f037c0f5cc0 0x7f037c106fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:44.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.843+0000 7f0381d81700 1 -- 172.21.15.50:0/490103980 >> 172.21.15.50:0/490103980 conn(0x7f037c0f0bd0 msgr2=0x7f037c05fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:44.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.843+0000 7f0381d81700 1 -- 172.21.15.50:0/490103980 shutdown_connections 2023-01-04T18:26:44.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.843+0000 7f0381d81700 1 -- 172.21.15.50:0/490103980 wait complete. 2023-01-04T18:26:44.848 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 36 2023-01-04T18:26:44.858 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 10, 'max_mds': 1, 'flags': 50} 2023-01-04T18:26:44.858 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 11 2023-01-04T18:26:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.978+0000 7fc6b6b90700 1 -- 172.21.15.50:0/835100233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6b00f6670 msgr2=0x7fc6b00f6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.978+0000 7fc6b6b90700 1 --2- 172.21.15.50:0/835100233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6b00f6670 0x7fc6b00f6ad0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fc69c004660 tx=0x7fc69c009b30).stop 2023-01-04T18:26:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.978+0000 7fc6b6b90700 1 -- 172.21.15.50:0/835100233 shutdown_connections 2023-01-04T18:26:44.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.978+0000 7fc6b6b90700 1 --2- 172.21.15.50:0/835100233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6b00f6670 0x7fc6b00f6ad0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:44.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.978+0000 7fc6b6b90700 1 --2- 172.21.15.50:0/835100233 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6b00f53d0 0x7fc6b00f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:44.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.978+0000 7fc6b6b90700 1 -- 172.21.15.50:0/835100233 >> 172.21.15.50:0/835100233 conn(0x7fc6b00f0b30 msgr2=0x7fc6b00f2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:44.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.978+0000 7fc6b6b90700 1 -- 172.21.15.50:0/835100233 shutdown_connections 2023-01-04T18:26:44.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.978+0000 7fc6b6b90700 1 -- 172.21.15.50:0/835100233 wait complete. 2023-01-04T18:26:44.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.979+0000 7fc6b6b90700 1 Processor -- start 2023-01-04T18:26:44.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.979+0000 7fc6b6b90700 1 -- start start 2023-01-04T18:26:44.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.980+0000 7fc6b6b90700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6b00f53d0 0x7fc6b0105ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:44.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.980+0000 7fc6b6b90700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6b00f6670 0x7fc6b0105fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:44.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.980+0000 7fc6b6b90700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b0106550 con 0x7fc6b00f53d0 2023-01-04T18:26:44.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.980+0000 7fc6b6b90700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b0106690 con 0x7fc6b00f6670 2023-01-04T18:26:44.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.980+0000 7fc6b492c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6b00f53d0 0x7fc6b0105ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:44.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.980+0000 7fc6b492c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6b00f53d0 0x7fc6b0105ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52548/0 (socket says 172.21.15.50:52548) 2023-01-04T18:26:44.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.980+0000 7fc6b492c700 1 -- 172.21.15.50:0/1156873923 learned_addr learned my addr 172.21.15.50:0/1156873923 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:44.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.980+0000 7fc6affff700 1 --2- 172.21.15.50:0/1156873923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6b00f6670 0x7fc6b0105fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:44.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.980+0000 7fc6b492c700 1 -- 172.21.15.50:0/1156873923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6b00f6670 msgr2=0x7fc6b0105fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:44.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.980+0000 7fc6b492c700 1 --2- 172.21.15.50:0/1156873923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6b00f6670 0x7fc6b0105fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:44.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.980+0000 7fc6b492c700 1 -- 172.21.15.50:0/1156873923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c005040 con 0x7fc6b00f53d0 2023-01-04T18:26:44.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.980+0000 7fc6affff700 1 --2- 172.21.15.50:0/1156873923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6b00f6670 0x7fc6b0105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-04T18:26:44.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.980+0000 7fc6b492c700 1 --2- 172.21.15.50:0/1156873923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6b00f53d0 0x7fc6b0105ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fc6a400e7c0 tx=0x7fc6a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:44.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.980+0000 7fc6ad7fa700 1 -- 172.21.15.50:0/1156873923 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6a40092e0 con 0x7fc6b00f53d0 2023-01-04T18:26:44.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.980+0000 7fc6b6b90700 1 -- 172.21.15.50:0/1156873923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b010b130 con 0x7fc6b00f53d0 2023-01-04T18:26:44.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.980+0000 7fc6ad7fa700 1 -- 172.21.15.50:0/1156873923 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fc6a400f040 con 0x7fc6b00f53d0 2023-01-04T18:26:44.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.980+0000 7fc6ad7fa700 1 -- 172.21.15.50:0/1156873923 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6a40147e0 con 0x7fc6b00f53d0 2023-01-04T18:26:44.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.980+0000 7fc6b6b90700 1 -- 172.21.15.50:0/1156873923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b010b6f0 con 0x7fc6b00f53d0 2023-01-04T18:26:44.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.981+0000 7fc6b6b90700 1 -- 172.21.15.50:0/1156873923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b0027a00 con 0x7fc6b00f53d0 2023-01-04T18:26:44.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.982+0000 7fc6ad7fa700 1 -- 172.21.15.50:0/1156873923 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fc6a401b030 con 0x7fc6b00f53d0 2023-01-04T18:26:44.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.982+0000 7fc6ad7fa700 1 --2- 172.21.15.50:0/1156873923 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc6a0060be0 0x7fc6a00630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:44.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.982+0000 7fc6ad7fa700 1 -- 172.21.15.50:0/1156873923 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fc6a407bc40 con 0x7fc6b00f53d0 2023-01-04T18:26:44.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.982+0000 7fc6affff700 1 --2- 172.21.15.50:0/1156873923 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc6a0060be0 0x7fc6a00630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:44.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.982+0000 7fc6affff700 1 --2- 172.21.15.50:0/1156873923 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc6a0060be0 0x7fc6a00630a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fc69c009720 tx=0x7fc69c00b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:44.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:44.986+0000 7fc6ad7fa700 1 -- 172.21.15.50:0/1156873923 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fc6a404fc40 con 0x7fc6b00f53d0 2023-01-04T18:26:45.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.203+0000 7fc6b6b90700 1 -- 172.21.15.50:0/1156873923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 11, "format": "json"} v 0) v1 -- 0x7fc6b00fdb60 con 0x7fc6b00f53d0 2023-01-04T18:26:45.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.204+0000 7fc6ad7fa700 1 -- 172.21.15.50:0/1156873923 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 11, "format": "json"}]=0 dumped fsmap epoch 11 v36) v1 ==== 107+0+4623 (secure 0 0 0) 0x7fc6a4019090 con 0x7fc6b00f53d0 2023-01-04T18:26:45.207 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:45.209 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14440,"name":"cephfs.smithi050.kefmuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.50:6829/3827606592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3827606592},{"type":"v1","addr":"172.21.15.50:6829","nonce":3827606592}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24297,"name":"cephfs.smithi098.laynsk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.98:6827/1785480263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1785480263},{"type":"v1","addr":"172.21.15.98:6827","nonce":1785480263}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":10,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:14:43.958806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14430":{"gid":14430,"name":"cephfs.smithi050.ezoiwl","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.50:6827/4069909541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4069909541},{"type":"v1","addr":"172.21.15.50:6827","nonce":4069909541}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24291":{"gid":24291,"name":"cephfs.smithi098.memais","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":3,"addr":"172.21.15.98:6825/1196398070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1196398070},{"type":"v1","addr":"172.21.15.98:6825","nonce":1196398070}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.206+0000 7fc6b6b90700 1 -- 172.21.15.50:0/1156873923 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc6a0060be0 msgr2=0x7fc6a00630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.206+0000 7fc6b6b90700 1 --2- 172.21.15.50:0/1156873923 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc6a0060be0 0x7fc6a00630a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fc69c009720 tx=0x7fc69c00b040).stop 2023-01-04T18:26:45.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.206+0000 7fc6b6b90700 1 -- 172.21.15.50:0/1156873923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6b00f53d0 msgr2=0x7fc6b0105ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:45.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.206+0000 7fc6b6b90700 1 --2- 172.21.15.50:0/1156873923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6b00f53d0 0x7fc6b0105ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fc6a400e7c0 tx=0x7fc6a400b040).stop 2023-01-04T18:26:45.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.206+0000 7fc6b6b90700 1 -- 172.21.15.50:0/1156873923 shutdown_connections 2023-01-04T18:26:45.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.206+0000 7fc6b6b90700 1 --2- 172.21.15.50:0/1156873923 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc6a0060be0 0x7fc6a00630a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:45.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.206+0000 7fc6b6b90700 1 --2- 172.21.15.50:0/1156873923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6b00f53d0 0x7fc6b0105ab0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:45.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.206+0000 7fc6b6b90700 1 --2- 172.21.15.50:0/1156873923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6b00f6670 0x7fc6b0105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:45.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.206+0000 7fc6b6b90700 1 -- 172.21.15.50:0/1156873923 >> 172.21.15.50:0/1156873923 conn(0x7fc6b00f0b30 msgr2=0x7fc6b00fa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:45.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.206+0000 7fc6b6b90700 1 -- 172.21.15.50:0/1156873923 shutdown_connections 2023-01-04T18:26:45.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.206+0000 7fc6b6b90700 1 -- 172.21.15.50:0/1156873923 wait complete. 2023-01-04T18:26:45.212 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 11 2023-01-04T18:26:45.220 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 12 2023-01-04T18:26:45.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.341+0000 7f84c1a8d700 1 -- 172.21.15.50:0/696618772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84bc0f5ca0 msgr2=0x7f84bc0f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:45.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.341+0000 7f84c1a8d700 1 --2- 172.21.15.50:0/696618772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84bc0f5ca0 0x7f84bc0f66d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f84b0004660 tx=0x7f84b0009b30).stop 2023-01-04T18:26:45.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.341+0000 7f84c1a8d700 1 -- 172.21.15.50:0/696618772 shutdown_connections 2023-01-04T18:26:45.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.341+0000 7f84c1a8d700 1 --2- 172.21.15.50:0/696618772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84bc0f5ca0 0x7f84bc0f66d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:45.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.341+0000 7f84c1a8d700 1 --2- 172.21.15.50:0/696618772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84bc0f5390 0x7f84bc0f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:45.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.341+0000 7f84c1a8d700 1 -- 172.21.15.50:0/696618772 >> 172.21.15.50:0/696618772 conn(0x7f84bc0f0b70 msgr2=0x7f84bc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:45.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.341+0000 7f84c1a8d700 1 -- 172.21.15.50:0/696618772 shutdown_connections 2023-01-04T18:26:45.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.341+0000 7f84c1a8d700 1 -- 172.21.15.50:0/696618772 wait complete. 2023-01-04T18:26:45.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.342+0000 7f84c1a8d700 1 Processor -- start 2023-01-04T18:26:45.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.342+0000 7f84c1a8d700 1 -- start start 2023-01-04T18:26:45.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.342+0000 7f84c1a8d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84bc0f5390 0x7f84bc05fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:45.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.342+0000 7f84c1a8d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84bc0f5ca0 0x7f84bc10ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:45.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.342+0000 7f84c1a8d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc10bf80 con 0x7f84bc0f5390 2023-01-04T18:26:45.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.342+0000 7f84c1a8d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc10c0c0 con 0x7f84bc0f5ca0 2023-01-04T18:26:45.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.342+0000 7f84bb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84bc0f5390 0x7f84bc05fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:45.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.342+0000 7f84bb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84bc0f5390 0x7f84bc05fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52572/0 (socket says 172.21.15.50:52572) 2023-01-04T18:26:45.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.342+0000 7f84bb7fe700 1 -- 172.21.15.50:0/4050458636 learned_addr learned my addr 172.21.15.50:0/4050458636 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:45.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.342+0000 7f84baffd700 1 --2- 172.21.15.50:0/4050458636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84bc0f5ca0 0x7f84bc10ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:45.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.343+0000 7f84bb7fe700 1 -- 172.21.15.50:0/4050458636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84bc0f5ca0 msgr2=0x7f84bc10ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:45.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.343+0000 7f84bb7fe700 1 --2- 172.21.15.50:0/4050458636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84bc0f5ca0 0x7f84bc10ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:45.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.343+0000 7f84bb7fe700 1 -- 172.21.15.50:0/4050458636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b0005040 con 0x7f84bc0f5390 2023-01-04T18:26:45.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.343+0000 7f84bb7fe700 1 --2- 172.21.15.50:0/4050458636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84bc0f5390 0x7f84bc05fc90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f84ac0026d0 tx=0x7f84ac009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:45.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.343+0000 7f84a3fff700 1 -- 172.21.15.50:0/4050458636 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84ac0079c0 con 0x7f84bc0f5390 2023-01-04T18:26:45.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.343+0000 7f84c1a8d700 1 -- 172.21.15.50:0/4050458636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84bc10c320 con 0x7f84bc0f5390 2023-01-04T18:26:45.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.343+0000 7f84a3fff700 1 -- 172.21.15.50:0/4050458636 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f84ac00f040 con 0x7f84bc0f5390 2023-01-04T18:26:45.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.343+0000 7f84a3fff700 1 -- 172.21.15.50:0/4050458636 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84ac014950 con 0x7f84bc0f5390 2023-01-04T18:26:45.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.343+0000 7f84c1a8d700 1 -- 172.21.15.50:0/4050458636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84bc10c8b0 con 0x7f84bc0f5390 2023-01-04T18:26:45.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.344+0000 7f84c1a8d700 1 -- 172.21.15.50:0/4050458636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84bc046330 con 0x7f84bc0f5390 2023-01-04T18:26:45.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.344+0000 7f84a3fff700 1 -- 172.21.15.50:0/4050458636 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f84ac0090d0 con 0x7f84bc0f5390 2023-01-04T18:26:45.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.345+0000 7f84a3fff700 1 --2- 172.21.15.50:0/4050458636 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f84a4060be0 0x7f84a40630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:45.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.345+0000 7f84a3fff700 1 -- 172.21.15.50:0/4050458636 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f84ac07bd70 con 0x7f84bc0f5390 2023-01-04T18:26:45.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.345+0000 7f84baffd700 1 --2- 172.21.15.50:0/4050458636 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f84a4060be0 0x7f84a40630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:45.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.345+0000 7f84baffd700 1 --2- 172.21.15.50:0/4050458636 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f84a4060be0 0x7f84a40630a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f84b0004630 tx=0x7f84b0009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:45.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.349+0000 7f84a3fff700 1 -- 172.21.15.50:0/4050458636 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f84ac04fcc0 con 0x7f84bc0f5390 2023-01-04T18:26:45.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:44.484756+0000 mon.smithi050 (mon.0) 813 : audit [DBG] from='client.? 172.21.15.50:0/1548041411' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-01-04T18:26:45.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:44.842027+0000 mon.smithi050 (mon.0) 814 : audit [DBG] from='client.? 172.21.15.50:0/490103980' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-01-04T18:26:45.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:45 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:45.204186+0000 mon.smithi050 (mon.0) 815 : audit [DBG] from='client.? 172.21.15.50:0/1156873923' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 11, "format": "json"}]: dispatch 2023-01-04T18:26:45.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.570+0000 7f84c1a8d700 1 -- 172.21.15.50:0/4050458636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 12, "format": "json"} v 0) v1 -- 0x7f84bc027a00 con 0x7f84bc0f5390 2023-01-04T18:26:45.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.571+0000 7f84a3fff700 1 -- 172.21.15.50:0/4050458636 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 12, "format": "json"}]=0 dumped fsmap epoch 12 v36) v1 ==== 107+0+4623 (secure 0 0 0) 0x7f84ac04f8b0 con 0x7f84bc0f5390 2023-01-04T18:26:45.573 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:45.573 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14440,"name":"cephfs.smithi050.kefmuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.50:6829/3827606592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3827606592},{"type":"v1","addr":"172.21.15.50:6829","nonce":3827606592}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24297,"name":"cephfs.smithi098.laynsk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.98:6827/1785480263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1785480263},{"type":"v1","addr":"172.21.15.98:6827","nonce":1785480263}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":10,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:14:43.958806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14430":{"gid":14430,"name":"cephfs.smithi050.ezoiwl","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.50:6827/4069909541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4069909541},{"type":"v1","addr":"172.21.15.50:6827","nonce":4069909541}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24291":{"gid":24291,"name":"cephfs.smithi098.memais","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":3,"addr":"172.21.15.98:6825/1196398070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1196398070},{"type":"v1","addr":"172.21.15.98:6825","nonce":1196398070}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:45.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.573+0000 7f84c1a8d700 1 -- 172.21.15.50:0/4050458636 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f84a4060be0 msgr2=0x7f84a40630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:45.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.573+0000 7f84c1a8d700 1 --2- 172.21.15.50:0/4050458636 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f84a4060be0 0x7f84a40630a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f84b0004630 tx=0x7f84b0009b30).stop 2023-01-04T18:26:45.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.573+0000 7f84c1a8d700 1 -- 172.21.15.50:0/4050458636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84bc0f5390 msgr2=0x7f84bc05fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.573+0000 7f84c1a8d700 1 --2- 172.21.15.50:0/4050458636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84bc0f5390 0x7f84bc05fc90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f84ac0026d0 tx=0x7f84ac009de0).stop 2023-01-04T18:26:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.573+0000 7f84c1a8d700 1 -- 172.21.15.50:0/4050458636 shutdown_connections 2023-01-04T18:26:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.573+0000 7f84c1a8d700 1 --2- 172.21.15.50:0/4050458636 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f84a4060be0 0x7f84a40630a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.573+0000 7f84c1a8d700 1 --2- 172.21.15.50:0/4050458636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84bc0f5390 0x7f84bc05fc90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.573+0000 7f84c1a8d700 1 --2- 172.21.15.50:0/4050458636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84bc0f5ca0 0x7f84bc10ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.573+0000 7f84c1a8d700 1 -- 172.21.15.50:0/4050458636 >> 172.21.15.50:0/4050458636 conn(0x7f84bc0f0b70 msgr2=0x7f84bc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.573+0000 7f84c1a8d700 1 -- 172.21.15.50:0/4050458636 shutdown_connections 2023-01-04T18:26:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.573+0000 7f84c1a8d700 1 -- 172.21.15.50:0/4050458636 wait complete. 2023-01-04T18:26:45.577 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 12 2023-01-04T18:26:45.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:44.484756+0000 mon.smithi050 (mon.0) 813 : audit [DBG] from='client.? 172.21.15.50:0/1548041411' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-01-04T18:26:45.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:44.842027+0000 mon.smithi050 (mon.0) 814 : audit [DBG] from='client.? 172.21.15.50:0/490103980' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-01-04T18:26:45.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:45 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:45.204186+0000 mon.smithi050 (mon.0) 815 : audit [DBG] from='client.? 172.21.15.50:0/1156873923' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 11, "format": "json"}]: dispatch 2023-01-04T18:26:45.587 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 13 2023-01-04T18:26:45.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.707+0000 7f5b1126f700 1 -- 172.21.15.50:0/1194632236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b0c0f5390 msgr2=0x7f5b0c0f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:45.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.707+0000 7f5b1126f700 1 --2- 172.21.15.50:0/1194632236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b0c0f5390 0x7f5b0c0f57b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f5afc004660 tx=0x7f5afc009b30).stop 2023-01-04T18:26:45.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.707+0000 7f5b1126f700 1 -- 172.21.15.50:0/1194632236 shutdown_connections 2023-01-04T18:26:45.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.707+0000 7f5b1126f700 1 --2- 172.21.15.50:0/1194632236 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b0c0f6630 0x7f5b0c0f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:45.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.707+0000 7f5b1126f700 1 --2- 172.21.15.50:0/1194632236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b0c0f5390 0x7f5b0c0f57b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:45.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.707+0000 7f5b1126f700 1 -- 172.21.15.50:0/1194632236 >> 172.21.15.50:0/1194632236 conn(0x7f5b0c0f0ad0 msgr2=0x7f5b0c0f2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:45.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.707+0000 7f5b1126f700 1 -- 172.21.15.50:0/1194632236 shutdown_connections 2023-01-04T18:26:45.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.707+0000 7f5b1126f700 1 -- 172.21.15.50:0/1194632236 wait complete. 2023-01-04T18:26:45.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.708+0000 7f5b1126f700 1 Processor -- start 2023-01-04T18:26:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.708+0000 7f5b1126f700 1 -- start start 2023-01-04T18:26:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.708+0000 7f5b1126f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b0c0f5390 0x7f5b0c060100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.708+0000 7f5b1126f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b0c0f6630 0x7f5b0c10bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.708+0000 7f5b1126f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c10bfb0 con 0x7f5b0c0f5390 2023-01-04T18:26:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.708+0000 7f5b1126f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c10c0f0 con 0x7f5b0c0f6630 2023-01-04T18:26:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.708+0000 7f5b0affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b0c0f5390 0x7f5b0c060100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.708+0000 7f5b0affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b0c0f5390 0x7f5b0c060100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52580/0 (socket says 172.21.15.50:52580) 2023-01-04T18:26:45.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.708+0000 7f5b0affd700 1 -- 172.21.15.50:0/67215704 learned_addr learned my addr 172.21.15.50:0/67215704 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:45.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.708+0000 7f5b0a7fc700 1 --2- 172.21.15.50:0/67215704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b0c0f6630 0x7f5b0c10bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:45.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.709+0000 7f5b0affd700 1 -- 172.21.15.50:0/67215704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b0c0f6630 msgr2=0x7f5b0c10bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:45.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.709+0000 7f5b0affd700 1 --2- 172.21.15.50:0/67215704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b0c0f6630 0x7f5b0c10bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:45.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.709+0000 7f5b0affd700 1 -- 172.21.15.50:0/67215704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc005040 con 0x7f5b0c0f5390 2023-01-04T18:26:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.709+0000 7f5b0affd700 1 --2- 172.21.15.50:0/67215704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b0c0f5390 0x7f5b0c060100 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f5afc004e30 tx=0x7f5afc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.709+0000 7f5b037fe700 1 -- 172.21.15.50:0/67215704 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5afc018070 con 0x7f5b0c0f5390 2023-01-04T18:26:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.709+0000 7f5b1126f700 1 -- 172.21.15.50:0/67215704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0c10c2f0 con 0x7f5b0c0f5390 2023-01-04T18:26:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.709+0000 7f5b037fe700 1 -- 172.21.15.50:0/67215704 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f5afc007ba0 con 0x7f5b0c0f5390 2023-01-04T18:26:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.709+0000 7f5b037fe700 1 -- 172.21.15.50:0/67215704 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5afc01c3c0 con 0x7f5b0c0f5390 2023-01-04T18:26:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.709+0000 7f5b1126f700 1 -- 172.21.15.50:0/67215704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0c10c820 con 0x7f5b0c0f5390 2023-01-04T18:26:45.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.710+0000 7f5b1126f700 1 -- 172.21.15.50:0/67215704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0c046330 con 0x7f5b0c0f5390 2023-01-04T18:26:45.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.710+0000 7f5b037fe700 1 -- 172.21.15.50:0/67215704 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f5afc007d10 con 0x7f5b0c0f5390 2023-01-04T18:26:45.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.711+0000 7f5b037fe700 1 --2- 172.21.15.50:0/67215704 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5af8060be0 0x7f5af80630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:45.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.711+0000 7f5b037fe700 1 -- 172.21.15.50:0/67215704 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f5afc07d990 con 0x7f5b0c0f5390 2023-01-04T18:26:45.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.711+0000 7f5b0a7fc700 1 --2- 172.21.15.50:0/67215704 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5af8060be0 0x7f5af80630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:45.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.711+0000 7f5b0a7fc700 1 --2- 172.21.15.50:0/67215704 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5af8060be0 0x7f5af80630a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f5af4004c40 tx=0x7f5af400b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:45.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.715+0000 7f5b037fe700 1 -- 172.21.15.50:0/67215704 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f5afc0518e0 con 0x7f5b0c0f5390 2023-01-04T18:26:45.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.928+0000 7f5b1126f700 1 -- 172.21.15.50:0/67215704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 13, "format": "json"} v 0) v1 -- 0x7f5b0c027a00 con 0x7f5b0c0f5390 2023-01-04T18:26:45.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.929+0000 7f5b037fe700 1 -- 172.21.15.50:0/67215704 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 13, "format": "json"}]=0 dumped fsmap epoch 13 v36) v1 ==== 107+0+4622 (secure 0 0 0) 0x7f5afc0514d0 con 0x7f5b0c0f5390 2023-01-04T18:26:45.933 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:45.933 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14440,"name":"cephfs.smithi050.kefmuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.50:6829/3827606592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3827606592},{"type":"v1","addr":"172.21.15.50:6829","nonce":3827606592}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24297,"name":"cephfs.smithi098.laynsk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.98:6827/1785480263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1785480263},{"type":"v1","addr":"172.21.15.98:6827","nonce":1785480263}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":10,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:14:43.958806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14430":{"gid":14430,"name":"cephfs.smithi050.ezoiwl","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.50:6827/4069909541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4069909541},{"type":"v1","addr":"172.21.15.50:6827","nonce":4069909541}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24291":{"gid":24291,"name":"cephfs.smithi098.memais","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":3,"addr":"172.21.15.98:6825/1196398070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1196398070},{"type":"v1","addr":"172.21.15.98:6825","nonce":1196398070}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:45.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.931+0000 7f5b1126f700 1 -- 172.21.15.50:0/67215704 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5af8060be0 msgr2=0x7f5af80630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:45.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.931+0000 7f5b1126f700 1 --2- 172.21.15.50:0/67215704 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5af8060be0 0x7f5af80630a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f5af4004c40 tx=0x7f5af400b040).stop 2023-01-04T18:26:45.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.931+0000 7f5b1126f700 1 -- 172.21.15.50:0/67215704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b0c0f5390 msgr2=0x7f5b0c060100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:45.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.931+0000 7f5b1126f700 1 --2- 172.21.15.50:0/67215704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b0c0f5390 0x7f5b0c060100 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f5afc004e30 tx=0x7f5afc009b30).stop 2023-01-04T18:26:45.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.931+0000 7f5b1126f700 1 -- 172.21.15.50:0/67215704 shutdown_connections 2023-01-04T18:26:45.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.931+0000 7f5b1126f700 1 --2- 172.21.15.50:0/67215704 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5af8060be0 0x7f5af80630a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:45.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.931+0000 7f5b1126f700 1 --2- 172.21.15.50:0/67215704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b0c0f5390 0x7f5b0c060100 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:45.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.931+0000 7f5b1126f700 1 --2- 172.21.15.50:0/67215704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b0c0f6630 0x7f5b0c10bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:45.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.931+0000 7f5b1126f700 1 -- 172.21.15.50:0/67215704 >> 172.21.15.50:0/67215704 conn(0x7f5b0c0f0ad0 msgr2=0x7f5b0c0fa080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:45.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.931+0000 7f5b1126f700 1 -- 172.21.15.50:0/67215704 shutdown_connections 2023-01-04T18:26:45.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:45.931+0000 7f5b1126f700 1 -- 172.21.15.50:0/67215704 wait complete. 2023-01-04T18:26:45.935 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2023-01-04T18:26:45.946 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 14 2023-01-04T18:26:46.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.064+0000 7f1ca3765700 1 -- 172.21.15.50:0/970965815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c9c0f5390 msgr2=0x7f1c9c0f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:46.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.064+0000 7f1ca3765700 1 --2- 172.21.15.50:0/970965815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c9c0f5390 0x7f1c9c0f57b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f1c98004660 tx=0x7f1c98009b30).stop 2023-01-04T18:26:46.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.064+0000 7f1ca3765700 1 -- 172.21.15.50:0/970965815 shutdown_connections 2023-01-04T18:26:46.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.064+0000 7f1ca3765700 1 --2- 172.21.15.50:0/970965815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c9c0f5ca0 0x7f1c9c0f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:46.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.064+0000 7f1ca3765700 1 --2- 172.21.15.50:0/970965815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c9c0f5390 0x7f1c9c0f57b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:46.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.064+0000 7f1ca3765700 1 -- 172.21.15.50:0/970965815 >> 172.21.15.50:0/970965815 conn(0x7f1c9c0f0b70 msgr2=0x7f1c9c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:46.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.064+0000 7f1ca3765700 1 -- 172.21.15.50:0/970965815 shutdown_connections 2023-01-04T18:26:46.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.064+0000 7f1ca3765700 1 -- 172.21.15.50:0/970965815 wait complete. 2023-01-04T18:26:46.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.065+0000 7f1ca3765700 1 Processor -- start 2023-01-04T18:26:46.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.065+0000 7f1ca3765700 1 -- start start 2023-01-04T18:26:46.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.065+0000 7f1ca3765700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c9c0f5390 0x7f1c9c05fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:46.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.065+0000 7f1ca3765700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c9c0f5ca0 0x7f1c9c10b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:46.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.065+0000 7f1ca3765700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c10bea0 con 0x7f1c9c0f5ca0 2023-01-04T18:26:46.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.065+0000 7f1ca3765700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c10bfe0 con 0x7f1c9c0f5390 2023-01-04T18:26:46.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.065+0000 7f1ca0d00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c9c0f5ca0 0x7f1c9c10b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:46.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.065+0000 7f1ca0d00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c9c0f5ca0 0x7f1c9c10b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52602/0 (socket says 172.21.15.50:52602) 2023-01-04T18:26:46.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.065+0000 7f1ca0d00700 1 -- 172.21.15.50:0/1943394365 learned_addr learned my addr 172.21.15.50:0/1943394365 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:46.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.065+0000 7f1ca1501700 1 --2- 172.21.15.50:0/1943394365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c9c0f5390 0x7f1c9c05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:46.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.065+0000 7f1ca0d00700 1 -- 172.21.15.50:0/1943394365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c9c0f5390 msgr2=0x7f1c9c05fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:46.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.065+0000 7f1ca0d00700 1 --2- 172.21.15.50:0/1943394365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c9c0f5390 0x7f1c9c05fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:46.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.065+0000 7f1ca0d00700 1 -- 172.21.15.50:0/1943394365 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c98005040 con 0x7f1c9c0f5ca0 2023-01-04T18:26:46.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.066+0000 7f1ca0d00700 1 --2- 172.21.15.50:0/1943394365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c9c0f5ca0 0x7f1c9c10b9b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f1c90002730 tx=0x7f1c90009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:46.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.066+0000 7f1c8dffb700 1 -- 172.21.15.50:0/1943394365 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c90009320 con 0x7f1c9c0f5ca0 2023-01-04T18:26:46.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.066+0000 7f1c8dffb700 1 -- 172.21.15.50:0/1943394365 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f1c9000f040 con 0x7f1c9c0f5ca0 2023-01-04T18:26:46.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.066+0000 7f1ca3765700 1 -- 172.21.15.50:0/1943394365 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c9c10c240 con 0x7f1c9c0f5ca0 2023-01-04T18:26:46.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.066+0000 7f1c8dffb700 1 -- 172.21.15.50:0/1943394365 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c900148c0 con 0x7f1c9c0f5ca0 2023-01-04T18:26:46.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.066+0000 7f1ca3765700 1 -- 172.21.15.50:0/1943394365 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9c10c800 con 0x7f1c9c0f5ca0 2023-01-04T18:26:46.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.067+0000 7f1ca3765700 1 -- 172.21.15.50:0/1943394365 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c9c027a00 con 0x7f1c9c0f5ca0 2023-01-04T18:26:46.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.068+0000 7f1c8dffb700 1 -- 172.21.15.50:0/1943394365 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f1c90009480 con 0x7f1c9c0f5ca0 2023-01-04T18:26:46.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.068+0000 7f1c8dffb700 1 --2- 172.21.15.50:0/1943394365 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1c88060be0 0x7f1c880630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:46.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.068+0000 7f1c8dffb700 1 -- 172.21.15.50:0/1943394365 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f1c9007bec0 con 0x7f1c9c0f5ca0 2023-01-04T18:26:46.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.068+0000 7f1ca1501700 1 --2- 172.21.15.50:0/1943394365 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1c88060be0 0x7f1c880630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:46.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.068+0000 7f1ca1501700 1 --2- 172.21.15.50:0/1943394365 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1c88060be0 0x7f1c880630a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f1c98004630 tx=0x7f1c98009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:46.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.072+0000 7f1c8dffb700 1 -- 172.21.15.50:0/1943394365 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f1c9004fdb0 con 0x7f1c9c0f5ca0 2023-01-04T18:26:46.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.288+0000 7f1ca3765700 1 -- 172.21.15.50:0/1943394365 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 14, "format": "json"} v 0) v1 -- 0x7f1c9c0fdb50 con 0x7f1c9c0f5ca0 2023-01-04T18:26:46.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.289+0000 7f1c8dffb700 1 -- 172.21.15.50:0/1943394365 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 14, "format": "json"}]=0 dumped fsmap epoch 14 v36) v1 ==== 107+0+3836 (secure 0 0 0) 0x7f1c9004f9a0 con 0x7f1c9c0f5ca0 2023-01-04T18:26:46.291 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:46.291 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14440,"name":"cephfs.smithi050.kefmuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.50:6829/3827606592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3827606592},{"type":"v1","addr":"172.21.15.50:6829","nonce":3827606592}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24297,"name":"cephfs.smithi098.laynsk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.98:6827/1785480263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1785480263},{"type":"v1","addr":"172.21.15.98:6827","nonce":1785480263}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:22:28.437327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14430":{"gid":14430,"name":"cephfs.smithi050.ezoiwl","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.50:6827/4069909541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4069909541},{"type":"v1","addr":"172.21.15.50:6827","nonce":4069909541}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:46.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.291+0000 7f1ca3765700 1 -- 172.21.15.50:0/1943394365 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1c88060be0 msgr2=0x7f1c880630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:46.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.291+0000 7f1ca3765700 1 --2- 172.21.15.50:0/1943394365 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1c88060be0 0x7f1c880630a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f1c98004630 tx=0x7f1c98009b30).stop 2023-01-04T18:26:46.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.291+0000 7f1ca3765700 1 -- 172.21.15.50:0/1943394365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c9c0f5ca0 msgr2=0x7f1c9c10b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:46.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.291+0000 7f1ca3765700 1 --2- 172.21.15.50:0/1943394365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c9c0f5ca0 0x7f1c9c10b9b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f1c90002730 tx=0x7f1c90009e00).stop 2023-01-04T18:26:46.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.291+0000 7f1ca3765700 1 -- 172.21.15.50:0/1943394365 shutdown_connections 2023-01-04T18:26:46.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.291+0000 7f1ca3765700 1 --2- 172.21.15.50:0/1943394365 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1c88060be0 0x7f1c880630a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:46.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.291+0000 7f1ca3765700 1 --2- 172.21.15.50:0/1943394365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c9c0f5390 0x7f1c9c05fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.291+0000 7f1ca3765700 1 --2- 172.21.15.50:0/1943394365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c9c0f5ca0 0x7f1c9c10b9b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.291+0000 7f1ca3765700 1 -- 172.21.15.50:0/1943394365 >> 172.21.15.50:0/1943394365 conn(0x7f1c9c0f0b70 msgr2=0x7f1c9c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.291+0000 7f1ca3765700 1 -- 172.21.15.50:0/1943394365 shutdown_connections 2023-01-04T18:26:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.291+0000 7f1ca3765700 1 -- 172.21.15.50:0/1943394365 wait complete. 2023-01-04T18:26:46.295 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 14 2023-01-04T18:26:46.305 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 14 2023-01-04T18:26:46.306 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 15 2023-01-04T18:26:46.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.424+0000 7f0ec89ea700 1 -- 172.21.15.50:0/1175808963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ec40f5390 msgr2=0x7f0ec40f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:46.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.424+0000 7f0ec89ea700 1 --2- 172.21.15.50:0/1175808963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ec40f5390 0x7f0ec40f57b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f0eac004660 tx=0x7f0eac009b30).stop 2023-01-04T18:26:46.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.424+0000 7f0ec89ea700 1 -- 172.21.15.50:0/1175808963 shutdown_connections 2023-01-04T18:26:46.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.424+0000 7f0ec89ea700 1 --2- 172.21.15.50:0/1175808963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec40f5ca0 0x7f0ec40f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:46.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.424+0000 7f0ec89ea700 1 --2- 172.21.15.50:0/1175808963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ec40f5390 0x7f0ec40f57b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:46.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.424+0000 7f0ec89ea700 1 -- 172.21.15.50:0/1175808963 >> 172.21.15.50:0/1175808963 conn(0x7f0ec40f0b70 msgr2=0x7f0ec40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:46.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.424+0000 7f0ec89ea700 1 -- 172.21.15.50:0/1175808963 shutdown_connections 2023-01-04T18:26:46.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.424+0000 7f0ec89ea700 1 -- 172.21.15.50:0/1175808963 wait complete. 2023-01-04T18:26:46.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.425+0000 7f0ec89ea700 1 Processor -- start 2023-01-04T18:26:46.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.425+0000 7f0ec89ea700 1 -- start start 2023-01-04T18:26:46.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.425+0000 7f0ec89ea700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ec40f5390 0x7f0ec405fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:46.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.425+0000 7f0ec89ea700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec40f5ca0 0x7f0ec410ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:46.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.425+0000 7f0ec89ea700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec410bf30 con 0x7f0ec40f5390 2023-01-04T18:26:46.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.425+0000 7f0ec89ea700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec410c070 con 0x7f0ec40f5ca0 2023-01-04T18:26:46.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.425+0000 7f0ec259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ec40f5390 0x7f0ec405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:46.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.425+0000 7f0ec259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ec40f5390 0x7f0ec405fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52620/0 (socket says 172.21.15.50:52620) 2023-01-04T18:26:46.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.425+0000 7f0ec259c700 1 -- 172.21.15.50:0/1227968905 learned_addr learned my addr 172.21.15.50:0/1227968905 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:46.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.426+0000 7f0ec1d9b700 1 --2- 172.21.15.50:0/1227968905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec40f5ca0 0x7f0ec410ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:46.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.426+0000 7f0ec259c700 1 -- 172.21.15.50:0/1227968905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec40f5ca0 msgr2=0x7f0ec410ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:46.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.426+0000 7f0ec259c700 1 --2- 172.21.15.50:0/1227968905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec40f5ca0 0x7f0ec410ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:46.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.426+0000 7f0ec259c700 1 -- 172.21.15.50:0/1227968905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac005040 con 0x7f0ec40f5390 2023-01-04T18:26:46.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.426+0000 7f0ec1d9b700 1 --2- 172.21.15.50:0/1227968905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec40f5ca0 0x7f0ec410ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-01-04T18:26:46.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.426+0000 7f0ec259c700 1 --2- 172.21.15.50:0/1227968905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ec40f5390 0x7f0ec405fcb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f0eac004fe0 tx=0x7f0eac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:46.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.426+0000 7f0ebaffd700 1 -- 172.21.15.50:0/1227968905 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0eac018070 con 0x7f0ec40f5390 2023-01-04T18:26:46.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.426+0000 7f0ebaffd700 1 -- 172.21.15.50:0/1227968905 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f0eac007ba0 con 0x7f0ec40f5390 2023-01-04T18:26:46.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.426+0000 7f0ec89ea700 1 -- 172.21.15.50:0/1227968905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec410c270 con 0x7f0ec40f5390 2023-01-04T18:26:46.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.426+0000 7f0ebaffd700 1 -- 172.21.15.50:0/1227968905 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0eac01c400 con 0x7f0ec40f5390 2023-01-04T18:26:46.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.426+0000 7f0ec89ea700 1 -- 172.21.15.50:0/1227968905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec410c7d0 con 0x7f0ec40f5390 2023-01-04T18:26:46.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.427+0000 7f0ec89ea700 1 -- 172.21.15.50:0/1227968905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec4027a00 con 0x7f0ec40f5390 2023-01-04T18:26:46.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.427+0000 7f0ebaffd700 1 -- 172.21.15.50:0/1227968905 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f0eac007d10 con 0x7f0ec40f5390 2023-01-04T18:26:46.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.428+0000 7f0ebaffd700 1 --2- 172.21.15.50:0/1227968905 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0eb0060be0 0x7f0eb00630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:46.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.428+0000 7f0ebaffd700 1 -- 172.21.15.50:0/1227968905 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f0eac07db10 con 0x7f0ec40f5390 2023-01-04T18:26:46.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.428+0000 7f0ec1d9b700 1 --2- 172.21.15.50:0/1227968905 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0eb0060be0 0x7f0eb00630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:46.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.428+0000 7f0ec1d9b700 1 --2- 172.21.15.50:0/1227968905 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0eb0060be0 0x7f0eb00630a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f0eb4009fd0 tx=0x7f0eb400b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:46.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.432+0000 7f0ebaffd700 1 -- 172.21.15.50:0/1227968905 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f0eac051ae0 con 0x7f0ec40f5390 2023-01-04T18:26:46.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:44.735997+0000 mgr.smithi050.emnywo (mgr.24517) 460 : cluster [DBG] pgmap v334: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:26:46.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:45.571211+0000 mon.smithi050 (mon.0) 816 : audit [DBG] from='client.? 172.21.15.50:0/4050458636' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 12, "format": "json"}]: dispatch 2023-01-04T18:26:46.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:46 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:45.929517+0000 mon.smithi050 (mon.0) 817 : audit [DBG] from='client.? 172.21.15.50:0/67215704' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 13, "format": "json"}]: dispatch 2023-01-04T18:26:46.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:44.735997+0000 mgr.smithi050.emnywo (mgr.24517) 460 : cluster [DBG] pgmap v334: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:26:46.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:45.571211+0000 mon.smithi050 (mon.0) 816 : audit [DBG] from='client.? 172.21.15.50:0/4050458636' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 12, "format": "json"}]: dispatch 2023-01-04T18:26:46.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:46 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:45.929517+0000 mon.smithi050 (mon.0) 817 : audit [DBG] from='client.? 172.21.15.50:0/67215704' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 13, "format": "json"}]: dispatch 2023-01-04T18:26:46.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.646+0000 7f0ec89ea700 1 -- 172.21.15.50:0/1227968905 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) v1 -- 0x7f0ec40586e0 con 0x7f0ec40f5390 2023-01-04T18:26:46.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.647+0000 7f0ebaffd700 1 -- 172.21.15.50:0/1227968905 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v36) v1 ==== 107+0+4615 (secure 0 0 0) 0x7f0eac0516d0 con 0x7f0ec40f5390 2023-01-04T18:26:46.650 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:46.650 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14440,"name":"cephfs.smithi050.kefmuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.50:6829/3827606592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3827606592},{"type":"v1","addr":"172.21.15.50:6829","nonce":3827606592}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24297,"name":"cephfs.smithi098.laynsk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.98:6827/1785480263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1785480263},{"type":"v1","addr":"172.21.15.98:6827","nonce":1785480263}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":44275,"name":"cephfs.smithi098.memais","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3576035235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3576035235},{"type":"v1","addr":"172.21.15.98:6825","nonce":3576035235}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:22:28.437327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14430":{"gid":14430,"name":"cephfs.smithi050.ezoiwl","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.50:6827/4069909541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4069909541},{"type":"v1","addr":"172.21.15.50:6827","nonce":4069909541}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:46.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.649+0000 7f0ec89ea700 1 -- 172.21.15.50:0/1227968905 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0eb0060be0 msgr2=0x7f0eb00630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:46.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.649+0000 7f0ec89ea700 1 --2- 172.21.15.50:0/1227968905 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0eb0060be0 0x7f0eb00630a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f0eb4009fd0 tx=0x7f0eb400b040).stop 2023-01-04T18:26:46.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.649+0000 7f0ec89ea700 1 -- 172.21.15.50:0/1227968905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ec40f5390 msgr2=0x7f0ec405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:46.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.649+0000 7f0ec89ea700 1 --2- 172.21.15.50:0/1227968905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ec40f5390 0x7f0ec405fcb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f0eac004fe0 tx=0x7f0eac009b30).stop 2023-01-04T18:26:46.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.649+0000 7f0ec89ea700 1 -- 172.21.15.50:0/1227968905 shutdown_connections 2023-01-04T18:26:46.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.649+0000 7f0ec89ea700 1 --2- 172.21.15.50:0/1227968905 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0eb0060be0 0x7f0eb00630a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:46.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.649+0000 7f0ec89ea700 1 --2- 172.21.15.50:0/1227968905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ec40f5390 0x7f0ec405fcb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:46.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.649+0000 7f0ec89ea700 1 --2- 172.21.15.50:0/1227968905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec40f5ca0 0x7f0ec410ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:46.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.649+0000 7f0ec89ea700 1 -- 172.21.15.50:0/1227968905 >> 172.21.15.50:0/1227968905 conn(0x7f0ec40f0b70 msgr2=0x7f0ec40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:46.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.649+0000 7f0ec89ea700 1 -- 172.21.15.50:0/1227968905 shutdown_connections 2023-01-04T18:26:46.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.649+0000 7f0ec89ea700 1 -- 172.21.15.50:0/1227968905 wait complete. 2023-01-04T18:26:46.653 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 15 2023-01-04T18:26:46.664 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 15 2023-01-04T18:26:46.664 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 16 2023-01-04T18:26:46.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.782+0000 7fb086011700 1 -- 172.21.15.50:0/1600909248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08005fdd0 msgr2=0x7fb0800f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:46.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.782+0000 7fb086011700 1 --2- 172.21.15.50:0/1600909248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08005fdd0 0x7fb0800f9170 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fb070004660 tx=0x7fb070009b30).stop 2023-01-04T18:26:46.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.782+0000 7fb086011700 1 -- 172.21.15.50:0/1600909248 shutdown_connections 2023-01-04T18:26:46.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.782+0000 7fb086011700 1 --2- 172.21.15.50:0/1600909248 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0800f9660 0x7fb0800fba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:46.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.782+0000 7fb086011700 1 --2- 172.21.15.50:0/1600909248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb08005fdd0 0x7fb0800f9170 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:46.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.782+0000 7fb086011700 1 -- 172.21.15.50:0/1600909248 >> 172.21.15.50:0/1600909248 conn(0x7fb0800f0b70 msgr2=0x7fb0800f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:46.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.782+0000 7fb086011700 1 -- 172.21.15.50:0/1600909248 shutdown_connections 2023-01-04T18:26:46.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.782+0000 7fb086011700 1 -- 172.21.15.50:0/1600909248 wait complete. 2023-01-04T18:26:46.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.783+0000 7fb086011700 1 Processor -- start 2023-01-04T18:26:46.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.783+0000 7fb086011700 1 -- start start 2023-01-04T18:26:46.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.783+0000 7fb086011700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb08005fdd0 0x7fb080106c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:46.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.783+0000 7fb086011700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0800f9660 0x7fb080107180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:46.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.783+0000 7fb086011700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb080107780 con 0x7fb0800f9660 2023-01-04T18:26:46.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.783+0000 7fb086011700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0801078f0 con 0x7fb08005fdd0 2023-01-04T18:26:46.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.783+0000 7fb07effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0800f9660 0x7fb080107180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:46.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.783+0000 7fb07effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0800f9660 0x7fb080107180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37622/0 (socket says 172.21.15.50:37622) 2023-01-04T18:26:46.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.783+0000 7fb07effd700 1 -- 172.21.15.50:0/1875252272 learned_addr learned my addr 172.21.15.50:0/1875252272 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:46.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.783+0000 7fb07f7fe700 1 --2- 172.21.15.50:0/1875252272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb08005fdd0 0x7fb080106c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:46.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.783+0000 7fb07effd700 1 -- 172.21.15.50:0/1875252272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb08005fdd0 msgr2=0x7fb080106c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:46.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.783+0000 7fb07effd700 1 --2- 172.21.15.50:0/1875252272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb08005fdd0 0x7fb080106c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:46.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.783+0000 7fb07effd700 1 -- 172.21.15.50:0/1875252272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb070005040 con 0x7fb0800f9660 2023-01-04T18:26:46.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.784+0000 7fb07effd700 1 --2- 172.21.15.50:0/1875252272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0800f9660 0x7fb080107180 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fb0740026d0 tx=0x7fb074009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:46.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.784+0000 7fb067fff700 1 -- 172.21.15.50:0/1875252272 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0740079c0 con 0x7fb0800f9660 2023-01-04T18:26:46.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.784+0000 7fb067fff700 1 -- 172.21.15.50:0/1875252272 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fb07400f040 con 0x7fb0800f9660 2023-01-04T18:26:46.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.784+0000 7fb086011700 1 -- 172.21.15.50:0/1875252272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08010c360 con 0x7fb0800f9660 2023-01-04T18:26:46.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.784+0000 7fb067fff700 1 -- 172.21.15.50:0/1875252272 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb074014950 con 0x7fb0800f9660 2023-01-04T18:26:46.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.784+0000 7fb086011700 1 -- 172.21.15.50:0/1875252272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08010c8f0 con 0x7fb0800f9660 2023-01-04T18:26:46.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.785+0000 7fb086011700 1 -- 172.21.15.50:0/1875252272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb080046330 con 0x7fb0800f9660 2023-01-04T18:26:46.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.785+0000 7fb067fff700 1 -- 172.21.15.50:0/1875252272 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fb0740090d0 con 0x7fb0800f9660 2023-01-04T18:26:46.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.785+0000 7fb067fff700 1 --2- 172.21.15.50:0/1875252272 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb068060be0 0x7fb0680630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:46.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.785+0000 7fb067fff700 1 -- 172.21.15.50:0/1875252272 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fb07407bd60 con 0x7fb0800f9660 2023-01-04T18:26:46.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.786+0000 7fb07f7fe700 1 --2- 172.21.15.50:0/1875252272 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb068060be0 0x7fb0680630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:46.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.786+0000 7fb07f7fe700 1 --2- 172.21.15.50:0/1875252272 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb068060be0 0x7fb0680630a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb080107b80 tx=0x7fb070009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:46.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:46.790+0000 7fb067fff700 1 -- 172.21.15.50:0/1875252272 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fb07404c280 con 0x7fb0800f9660 2023-01-04T18:26:47.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.010+0000 7fb086011700 1 -- 172.21.15.50:0/1875252272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7fb080027a00 con 0x7fb0800f9660 2023-01-04T18:26:47.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.011+0000 7fb067fff700 1 -- 172.21.15.50:0/1875252272 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v36) v1 ==== 107+0+3827 (secure 0 0 0) 0x7fb07404f8a0 con 0x7fb0800f9660 2023-01-04T18:26:47.013 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:47.014 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14440,"name":"cephfs.smithi050.kefmuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.50:6829/3827606592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3827606592},{"type":"v1","addr":"172.21.15.50:6829","nonce":3827606592}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24297,"name":"cephfs.smithi098.laynsk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.98:6827/1785480263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1785480263},{"type":"v1","addr":"172.21.15.98:6827","nonce":1785480263}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":44275,"name":"cephfs.smithi098.memais","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3576035235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3576035235},{"type":"v1","addr":"172.21.15.98:6825","nonce":3576035235}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:22:31.450931+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:47.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.013+0000 7fb086011700 1 -- 172.21.15.50:0/1875252272 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb068060be0 msgr2=0x7fb0680630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:47.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.013+0000 7fb086011700 1 --2- 172.21.15.50:0/1875252272 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb068060be0 0x7fb0680630a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb080107b80 tx=0x7fb070009b30).stop 2023-01-04T18:26:47.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.013+0000 7fb086011700 1 -- 172.21.15.50:0/1875252272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0800f9660 msgr2=0x7fb080107180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:47.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.013+0000 7fb086011700 1 --2- 172.21.15.50:0/1875252272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0800f9660 0x7fb080107180 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fb0740026d0 tx=0x7fb074009de0).stop 2023-01-04T18:26:47.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.013+0000 7fb086011700 1 -- 172.21.15.50:0/1875252272 shutdown_connections 2023-01-04T18:26:47.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.013+0000 7fb086011700 1 --2- 172.21.15.50:0/1875252272 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb068060be0 0x7fb0680630a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:47.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.013+0000 7fb086011700 1 --2- 172.21.15.50:0/1875252272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb08005fdd0 0x7fb080106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:47.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.013+0000 7fb086011700 1 --2- 172.21.15.50:0/1875252272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0800f9660 0x7fb080107180 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:47.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.013+0000 7fb086011700 1 -- 172.21.15.50:0/1875252272 >> 172.21.15.50:0/1875252272 conn(0x7fb0800f0b70 msgr2=0x7fb0800f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:47.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.013+0000 7fb086011700 1 -- 172.21.15.50:0/1875252272 shutdown_connections 2023-01-04T18:26:47.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.013+0000 7fb086011700 1 -- 172.21.15.50:0/1875252272 wait complete. 2023-01-04T18:26:47.017 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 16 2023-01-04T18:26:47.028 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 16 2023-01-04T18:26:47.028 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2023-01-04T18:26:47.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.147+0000 7fe19a94d700 1 -- 172.21.15.50:0/1377350659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1940f5ca0 msgr2=0x7fe1940f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:47.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.147+0000 7fe19a94d700 1 --2- 172.21.15.50:0/1377350659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1940f5ca0 0x7fe1940f66d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fe188004660 tx=0x7fe188009b30).stop 2023-01-04T18:26:47.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.147+0000 7fe19a94d700 1 -- 172.21.15.50:0/1377350659 shutdown_connections 2023-01-04T18:26:47.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.147+0000 7fe19a94d700 1 --2- 172.21.15.50:0/1377350659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1940f5ca0 0x7fe1940f66d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:47.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.147+0000 7fe19a94d700 1 --2- 172.21.15.50:0/1377350659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1940f5390 0x7fe1940f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:47.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.147+0000 7fe19a94d700 1 -- 172.21.15.50:0/1377350659 >> 172.21.15.50:0/1377350659 conn(0x7fe1940f0b70 msgr2=0x7fe1940f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.147+0000 7fe19a94d700 1 -- 172.21.15.50:0/1377350659 shutdown_connections 2023-01-04T18:26:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.148+0000 7fe19a94d700 1 -- 172.21.15.50:0/1377350659 wait complete. 2023-01-04T18:26:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.148+0000 7fe19a94d700 1 Processor -- start 2023-01-04T18:26:47.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.148+0000 7fe19a94d700 1 -- start start 2023-01-04T18:26:47.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.148+0000 7fe19a94d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1940f5390 0x7fe194106c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:47.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.148+0000 7fe19a94d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1940f5ca0 0x7fe194107100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:47.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.148+0000 7fe19a94d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe194107700 con 0x7fe1940f5ca0 2023-01-04T18:26:47.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.148+0000 7fe19a94d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe194107840 con 0x7fe1940f5390 2023-01-04T18:26:47.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.149+0000 7fe1937fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1940f5ca0 0x7fe194107100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:47.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.149+0000 7fe1937fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1940f5ca0 0x7fe194107100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37636/0 (socket says 172.21.15.50:37636) 2023-01-04T18:26:47.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.149+0000 7fe1937fe700 1 -- 172.21.15.50:0/4176767697 learned_addr learned my addr 172.21.15.50:0/4176767697 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:47.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.149+0000 7fe193fff700 1 --2- 172.21.15.50:0/4176767697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1940f5390 0x7fe194106c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.149+0000 7fe1937fe700 1 -- 172.21.15.50:0/4176767697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1940f5390 msgr2=0x7fe194106c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.149+0000 7fe1937fe700 1 --2- 172.21.15.50:0/4176767697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1940f5390 0x7fe194106c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.149+0000 7fe1937fe700 1 -- 172.21.15.50:0/4176767697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe188005040 con 0x7fe1940f5ca0 2023-01-04T18:26:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.149+0000 7fe1937fe700 1 --2- 172.21.15.50:0/4176767697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1940f5ca0 0x7fe194107100 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fe188000c00 tx=0x7fe18800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.149+0000 7fe190ff9700 1 -- 172.21.15.50:0/4176767697 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe188019070 con 0x7fe1940f5ca0 2023-01-04T18:26:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.149+0000 7fe190ff9700 1 -- 172.21.15.50:0/4176767697 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fe188007e90 con 0x7fe1940f5ca0 2023-01-04T18:26:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.149+0000 7fe19a94d700 1 -- 172.21.15.50:0/4176767697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe19410c1f0 con 0x7fe1940f5ca0 2023-01-04T18:26:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.149+0000 7fe190ff9700 1 -- 172.21.15.50:0/4176767697 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe188014d40 con 0x7fe1940f5ca0 2023-01-04T18:26:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.149+0000 7fe19a94d700 1 -- 172.21.15.50:0/4176767697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19410c750 con 0x7fe1940f5ca0 2023-01-04T18:26:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.150+0000 7fe19a94d700 1 -- 172.21.15.50:0/4176767697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1940fdb50 con 0x7fe1940f5ca0 2023-01-04T18:26:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.151+0000 7fe190ff9700 1 -- 172.21.15.50:0/4176767697 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fe188025070 con 0x7fe1940f5ca0 2023-01-04T18:26:47.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.151+0000 7fe190ff9700 1 --2- 172.21.15.50:0/4176767697 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe17c060be0 0x7fe17c0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:47.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.151+0000 7fe190ff9700 1 -- 172.21.15.50:0/4176767697 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fe18807ccd0 con 0x7fe1940f5ca0 2023-01-04T18:26:47.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.151+0000 7fe193fff700 1 --2- 172.21.15.50:0/4176767697 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe17c060be0 0x7fe17c0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:47.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.151+0000 7fe193fff700 1 --2- 172.21.15.50:0/4176767697 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe17c060be0 0x7fe17c0630a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fe194108100 tx=0x7fe18400b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:47.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.155+0000 7fe190ff9700 1 -- 172.21.15.50:0/4176767697 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fe18804d190 con 0x7fe1940f5ca0 2023-01-04T18:26:47.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:46.289031+0000 mon.smithi050 (mon.0) 818 : audit [DBG] from='client.? 172.21.15.50:0/1943394365' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2023-01-04T18:26:47.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:46.647499+0000 mon.smithi050 (mon.0) 819 : audit [DBG] from='client.? 172.21.15.50:0/1227968905' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2023-01-04T18:26:47.290 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:47 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:47.011468+0000 mon.smithi050 (mon.0) 820 : audit [DBG] from='client.? 172.21.15.50:0/1875252272' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2023-01-04T18:26:47.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.373+0000 7fe19a94d700 1 -- 172.21.15.50:0/4176767697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7fe19410d310 con 0x7fe1940f5ca0 2023-01-04T18:26:47.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.374+0000 7fe190ff9700 1 -- 172.21.15.50:0/4176767697 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v36) v1 ==== 107+0+3838 (secure 0 0 0) 0x7fe188023070 con 0x7fe1940f5ca0 2023-01-04T18:26:47.376 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:47.377 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24297,"name":"cephfs.smithi098.laynsk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.98:6827/1785480263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1785480263},{"type":"v1","addr":"172.21.15.98:6827","nonce":1785480263}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":44275,"name":"cephfs.smithi098.memais","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3576035235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3576035235},{"type":"v1","addr":"172.21.15.98:6825","nonce":3576035235}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:22:31.459582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14440},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14440":{"gid":14440,"name":"cephfs.smithi050.kefmuy","rank":0,"incarnation":17,"state":"up:replay","state_seq":3,"addr":"172.21.15.50:6829/3827606592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3827606592},{"type":"v1","addr":"172.21.15.50:6829","nonce":3827606592}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:47.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.376+0000 7fe19a94d700 1 -- 172.21.15.50:0/4176767697 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe17c060be0 msgr2=0x7fe17c0630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:47.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.376+0000 7fe19a94d700 1 --2- 172.21.15.50:0/4176767697 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe17c060be0 0x7fe17c0630a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fe194108100 tx=0x7fe18400b040).stop 2023-01-04T18:26:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.376+0000 7fe19a94d700 1 -- 172.21.15.50:0/4176767697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1940f5ca0 msgr2=0x7fe194107100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.376+0000 7fe19a94d700 1 --2- 172.21.15.50:0/4176767697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1940f5ca0 0x7fe194107100 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fe188000c00 tx=0x7fe18800b040).stop 2023-01-04T18:26:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.376+0000 7fe19a94d700 1 -- 172.21.15.50:0/4176767697 shutdown_connections 2023-01-04T18:26:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.376+0000 7fe19a94d700 1 --2- 172.21.15.50:0/4176767697 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe17c060be0 0x7fe17c0630a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.376+0000 7fe19a94d700 1 --2- 172.21.15.50:0/4176767697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1940f5390 0x7fe194106c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.376+0000 7fe19a94d700 1 --2- 172.21.15.50:0/4176767697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe1940f5ca0 0x7fe194107100 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.376+0000 7fe19a94d700 1 -- 172.21.15.50:0/4176767697 >> 172.21.15.50:0/4176767697 conn(0x7fe1940f0b70 msgr2=0x7fe19405fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.376+0000 7fe19a94d700 1 -- 172.21.15.50:0/4176767697 shutdown_connections 2023-01-04T18:26:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.376+0000 7fe19a94d700 1 -- 172.21.15.50:0/4176767697 wait complete. 2023-01-04T18:26:47.380 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2023-01-04T18:26:47.390 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 17 2023-01-04T18:26:47.391 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2023-01-04T18:26:47.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.509+0000 7ff3acea9700 1 -- 172.21.15.50:0/3797864041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3a80f5ca0 msgr2=0x7ff3a80f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:47.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.509+0000 7ff3acea9700 1 --2- 172.21.15.50:0/3797864041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3a80f5ca0 0x7ff3a80f66d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7ff390004660 tx=0x7ff390009b30).stop 2023-01-04T18:26:47.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.509+0000 7ff3acea9700 1 -- 172.21.15.50:0/3797864041 shutdown_connections 2023-01-04T18:26:47.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.509+0000 7ff3acea9700 1 --2- 172.21.15.50:0/3797864041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3a80f5ca0 0x7ff3a80f66d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:47.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.509+0000 7ff3acea9700 1 --2- 172.21.15.50:0/3797864041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3a80f5390 0x7ff3a80f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:47.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.509+0000 7ff3acea9700 1 -- 172.21.15.50:0/3797864041 >> 172.21.15.50:0/3797864041 conn(0x7ff3a80f0b70 msgr2=0x7ff3a80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:47.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.509+0000 7ff3acea9700 1 -- 172.21.15.50:0/3797864041 shutdown_connections 2023-01-04T18:26:47.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.509+0000 7ff3acea9700 1 -- 172.21.15.50:0/3797864041 wait complete. 2023-01-04T18:26:47.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.510+0000 7ff3acea9700 1 Processor -- start 2023-01-04T18:26:47.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.510+0000 7ff3acea9700 1 -- start start 2023-01-04T18:26:47.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.510+0000 7ff3acea9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3a80f5390 0x7ff3a805fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:47.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.510+0000 7ff3acea9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3a80f5ca0 0x7ff3a810b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:47.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.510+0000 7ff3acea9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a810bed0 con 0x7ff3a80f5390 2023-01-04T18:26:47.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.510+0000 7ff3acea9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a810c010 con 0x7ff3a80f5ca0 2023-01-04T18:26:47.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.510+0000 7ff3a659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3a80f5390 0x7ff3a805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:47.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.510+0000 7ff3a659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3a80f5390 0x7ff3a805fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37658/0 (socket says 172.21.15.50:37658) 2023-01-04T18:26:47.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.510+0000 7ff3a659c700 1 -- 172.21.15.50:0/1759012339 learned_addr learned my addr 172.21.15.50:0/1759012339 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:47.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.510+0000 7ff3a5d9b700 1 --2- 172.21.15.50:0/1759012339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3a80f5ca0 0x7ff3a810b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:47.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.510+0000 7ff3a659c700 1 -- 172.21.15.50:0/1759012339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3a80f5ca0 msgr2=0x7ff3a810b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:47.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.510+0000 7ff3a659c700 1 --2- 172.21.15.50:0/1759012339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3a80f5ca0 0x7ff3a810b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:47.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.510+0000 7ff3a659c700 1 -- 172.21.15.50:0/1759012339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff390005040 con 0x7ff3a80f5390 2023-01-04T18:26:47.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.511+0000 7ff3a659c700 1 --2- 172.21.15.50:0/1759012339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3a80f5390 0x7ff3a805fcb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7ff398002730 tx=0x7ff398009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:47.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.511+0000 7ff39effd700 1 -- 172.21.15.50:0/1759012339 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff398009320 con 0x7ff3a80f5390 2023-01-04T18:26:47.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.511+0000 7ff3acea9700 1 -- 172.21.15.50:0/1759012339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a810c270 con 0x7ff3a80f5390 2023-01-04T18:26:47.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.511+0000 7ff39effd700 1 -- 172.21.15.50:0/1759012339 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7ff39800f040 con 0x7ff3a80f5390 2023-01-04T18:26:47.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.511+0000 7ff39effd700 1 -- 172.21.15.50:0/1759012339 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff398014950 con 0x7ff3a80f5390 2023-01-04T18:26:47.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.511+0000 7ff3acea9700 1 -- 172.21.15.50:0/1759012339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a810c830 con 0x7ff3a80f5390 2023-01-04T18:26:47.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.512+0000 7ff3acea9700 1 -- 172.21.15.50:0/1759012339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff38c004fa0 con 0x7ff3a80f5390 2023-01-04T18:26:47.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.512+0000 7ff39effd700 1 -- 172.21.15.50:0/1759012339 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7ff398009480 con 0x7ff3a80f5390 2023-01-04T18:26:47.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.512+0000 7ff39effd700 1 --2- 172.21.15.50:0/1759012339 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff394060be0 0x7ff3940630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:47.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.513+0000 7ff39effd700 1 -- 172.21.15.50:0/1759012339 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7ff39807c290 con 0x7ff3a80f5390 2023-01-04T18:26:47.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.513+0000 7ff3a5d9b700 1 --2- 172.21.15.50:0/1759012339 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff394060be0 0x7ff3940630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:47.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.513+0000 7ff3a5d9b700 1 --2- 172.21.15.50:0/1759012339 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff394060be0 0x7ff3940630a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ff390004e30 tx=0x7ff390009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:47.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.517+0000 7ff39effd700 1 -- 172.21.15.50:0/1759012339 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7ff398050120 con 0x7ff3a80f5390 2023-01-04T18:26:47.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:47 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:46.289031+0000 mon.smithi050 (mon.0) 818 : audit [DBG] from='client.? 172.21.15.50:0/1943394365' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2023-01-04T18:26:47.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:47 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:46.647499+0000 mon.smithi050 (mon.0) 819 : audit [DBG] from='client.? 172.21.15.50:0/1227968905' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2023-01-04T18:26:47.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:47 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:47.011468+0000 mon.smithi050 (mon.0) 820 : audit [DBG] from='client.? 172.21.15.50:0/1875252272' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2023-01-04T18:26:47.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.731+0000 7ff3acea9700 1 -- 172.21.15.50:0/1759012339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7ff38c005670 con 0x7ff3a80f5390 2023-01-04T18:26:47.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.732+0000 7ff39effd700 1 -- 172.21.15.50:0/1759012339 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v36) v1 ==== 107+0+3843 (secure 0 0 0) 0x7ff39804fd10 con 0x7ff3a80f5390 2023-01-04T18:26:47.734 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:47.734 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24297,"name":"cephfs.smithi098.laynsk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.98:6827/1785480263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1785480263},{"type":"v1","addr":"172.21.15.98:6827","nonce":1785480263}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":44275,"name":"cephfs.smithi098.memais","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3576035235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3576035235},{"type":"v1","addr":"172.21.15.98:6825","nonce":3576035235}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:22:41.141888+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14440},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14440":{"gid":14440,"name":"cephfs.smithi050.kefmuy","rank":0,"incarnation":17,"state":"up:reconnect","state_seq":122,"addr":"172.21.15.50:6829/3827606592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3827606592},{"type":"v1","addr":"172.21.15.50:6829","nonce":3827606592}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:47.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.734+0000 7ff3acea9700 1 -- 172.21.15.50:0/1759012339 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff394060be0 msgr2=0x7ff3940630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:47.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.734+0000 7ff3acea9700 1 --2- 172.21.15.50:0/1759012339 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff394060be0 0x7ff3940630a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ff390004e30 tx=0x7ff390009b30).stop 2023-01-04T18:26:47.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.734+0000 7ff3acea9700 1 -- 172.21.15.50:0/1759012339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3a80f5390 msgr2=0x7ff3a805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:47.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.734+0000 7ff3acea9700 1 --2- 172.21.15.50:0/1759012339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3a80f5390 0x7ff3a805fcb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7ff398002730 tx=0x7ff398009e00).stop 2023-01-04T18:26:47.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.734+0000 7ff3acea9700 1 -- 172.21.15.50:0/1759012339 shutdown_connections 2023-01-04T18:26:47.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.734+0000 7ff3acea9700 1 --2- 172.21.15.50:0/1759012339 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff394060be0 0x7ff3940630a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:47.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.734+0000 7ff3acea9700 1 --2- 172.21.15.50:0/1759012339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3a80f5390 0x7ff3a805fcb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:47.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.734+0000 7ff3acea9700 1 --2- 172.21.15.50:0/1759012339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3a80f5ca0 0x7ff3a810b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:47.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.734+0000 7ff3acea9700 1 -- 172.21.15.50:0/1759012339 >> 172.21.15.50:0/1759012339 conn(0x7ff3a80f0b70 msgr2=0x7ff3a80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:47.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.734+0000 7ff3acea9700 1 -- 172.21.15.50:0/1759012339 shutdown_connections 2023-01-04T18:26:47.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.734+0000 7ff3acea9700 1 -- 172.21.15.50:0/1759012339 wait complete. 2023-01-04T18:26:47.737 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 18 2023-01-04T18:26:47.748 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 18 2023-01-04T18:26:47.749 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2023-01-04T18:26:47.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.869+0000 7fe32a841700 1 -- 172.21.15.50:0/3470519580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3240f7730 msgr2=0x7fe3240f7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:47.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.869+0000 7fe32a841700 1 --2- 172.21.15.50:0/3470519580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3240f7730 0x7fe3240f7b90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fe318004660 tx=0x7fe318009b30).stop 2023-01-04T18:26:47.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.869+0000 7fe32a841700 1 -- 172.21.15.50:0/3470519580 shutdown_connections 2023-01-04T18:26:47.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.869+0000 7fe32a841700 1 --2- 172.21.15.50:0/3470519580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3240f7730 0x7fe3240f7b90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:47.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.869+0000 7fe32a841700 1 --2- 172.21.15.50:0/3470519580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3240f6490 0x7fe3240f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:47.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.869+0000 7fe32a841700 1 -- 172.21.15.50:0/3470519580 >> 172.21.15.50:0/3470519580 conn(0x7fe3240f1bd0 msgr2=0x7fe3240f4010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:47.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.869+0000 7fe32a841700 1 -- 172.21.15.50:0/3470519580 shutdown_connections 2023-01-04T18:26:47.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.869+0000 7fe32a841700 1 -- 172.21.15.50:0/3470519580 wait complete. 2023-01-04T18:26:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.870+0000 7fe32a841700 1 Processor -- start 2023-01-04T18:26:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.870+0000 7fe32a841700 1 -- start start 2023-01-04T18:26:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.870+0000 7fe32a841700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3240f6490 0x7fe32406b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.870+0000 7fe32a841700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3240f7730 0x7fe324069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.870+0000 7fe32a841700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32406bd70 con 0x7fe3240f7730 2023-01-04T18:26:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.870+0000 7fe32a841700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32406a310 con 0x7fe3240f6490 2023-01-04T18:26:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.870+0000 7fe3237fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3240f7730 0x7fe324069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.870+0000 7fe3237fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3240f7730 0x7fe324069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37680/0 (socket says 172.21.15.50:37680) 2023-01-04T18:26:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.870+0000 7fe3237fe700 1 -- 172.21.15.50:0/4072572740 learned_addr learned my addr 172.21.15.50:0/4072572740 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.871+0000 7fe323fff700 1 --2- 172.21.15.50:0/4072572740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3240f6490 0x7fe32406b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.871+0000 7fe3237fe700 1 -- 172.21.15.50:0/4072572740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3240f6490 msgr2=0x7fe32406b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.871+0000 7fe3237fe700 1 --2- 172.21.15.50:0/4072572740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3240f6490 0x7fe32406b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.871+0000 7fe3237fe700 1 -- 172.21.15.50:0/4072572740 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe318005040 con 0x7fe3240f7730 2023-01-04T18:26:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.871+0000 7fe3237fe700 1 --2- 172.21.15.50:0/4072572740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3240f7730 0x7fe324069e20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fe318000c00 tx=0x7fe31800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:47.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.871+0000 7fe320ff9700 1 -- 172.21.15.50:0/4072572740 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe318019070 con 0x7fe3240f7730 2023-01-04T18:26:47.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.871+0000 7fe320ff9700 1 -- 172.21.15.50:0/4072572740 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fe318007e90 con 0x7fe3240f7730 2023-01-04T18:26:47.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.871+0000 7fe32a841700 1 -- 172.21.15.50:0/4072572740 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32406a530 con 0x7fe3240f7730 2023-01-04T18:26:47.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.871+0000 7fe320ff9700 1 -- 172.21.15.50:0/4072572740 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe318014d40 con 0x7fe3240f7730 2023-01-04T18:26:47.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.871+0000 7fe32a841700 1 -- 172.21.15.50:0/4072572740 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32406aa90 con 0x7fe3240f7730 2023-01-04T18:26:47.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.872+0000 7fe32a841700 1 -- 172.21.15.50:0/4072572740 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe324046330 con 0x7fe3240f7730 2023-01-04T18:26:47.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.872+0000 7fe320ff9700 1 -- 172.21.15.50:0/4072572740 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fe318025070 con 0x7fe3240f7730 2023-01-04T18:26:47.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.873+0000 7fe320ff9700 1 --2- 172.21.15.50:0/4072572740 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe30c060be0 0x7fe30c0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:47.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.873+0000 7fe320ff9700 1 -- 172.21.15.50:0/4072572740 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fe31807ccf0 con 0x7fe3240f7730 2023-01-04T18:26:47.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.873+0000 7fe323fff700 1 --2- 172.21.15.50:0/4072572740 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe30c060be0 0x7fe30c0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:47.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.873+0000 7fe323fff700 1 --2- 172.21.15.50:0/4072572740 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe30c060be0 0x7fe30c0630a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fe314009fd0 tx=0x7fe31400b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:47.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:47.877+0000 7fe320ff9700 1 -- 172.21.15.50:0/4072572740 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fe318050be0 con 0x7fe3240f7730 2023-01-04T18:26:48.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.094+0000 7fe32a841700 1 -- 172.21.15.50:0/4072572740 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7fe324027a00 con 0x7fe3240f7730 2023-01-04T18:26:48.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.095+0000 7fe320ff9700 1 -- 172.21.15.50:0/4072572740 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v36) v1 ==== 107+0+3840 (secure 0 0 0) 0x7fe318023070 con 0x7fe3240f7730 2023-01-04T18:26:48.098 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:48.098 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24297,"name":"cephfs.smithi098.laynsk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.98:6827/1785480263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1785480263},{"type":"v1","addr":"172.21.15.98:6827","nonce":1785480263}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":44275,"name":"cephfs.smithi098.memais","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3576035235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3576035235},{"type":"v1","addr":"172.21.15.98:6825","nonce":3576035235}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:22:42.147389+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14440},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14440":{"gid":14440,"name":"cephfs.smithi050.kefmuy","rank":0,"incarnation":17,"state":"up:rejoin","state_seq":123,"addr":"172.21.15.50:6829/3827606592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3827606592},{"type":"v1","addr":"172.21.15.50:6829","nonce":3827606592}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:48.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.097+0000 7fe32a841700 1 -- 172.21.15.50:0/4072572740 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe30c060be0 msgr2=0x7fe30c0630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:48.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.097+0000 7fe32a841700 1 --2- 172.21.15.50:0/4072572740 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe30c060be0 0x7fe30c0630a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fe314009fd0 tx=0x7fe31400b040).stop 2023-01-04T18:26:48.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.097+0000 7fe32a841700 1 -- 172.21.15.50:0/4072572740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3240f7730 msgr2=0x7fe324069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.097+0000 7fe32a841700 1 --2- 172.21.15.50:0/4072572740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3240f7730 0x7fe324069e20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fe318000c00 tx=0x7fe31800b040).stop 2023-01-04T18:26:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.097+0000 7fe32a841700 1 -- 172.21.15.50:0/4072572740 shutdown_connections 2023-01-04T18:26:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.097+0000 7fe32a841700 1 --2- 172.21.15.50:0/4072572740 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe30c060be0 0x7fe30c0630a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.097+0000 7fe32a841700 1 --2- 172.21.15.50:0/4072572740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3240f6490 0x7fe32406b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.097+0000 7fe32a841700 1 --2- 172.21.15.50:0/4072572740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3240f7730 0x7fe324069e20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:48.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.097+0000 7fe32a841700 1 -- 172.21.15.50:0/4072572740 >> 172.21.15.50:0/4072572740 conn(0x7fe3240f1bd0 msgr2=0x7fe3240fb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:48.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.097+0000 7fe32a841700 1 -- 172.21.15.50:0/4072572740 shutdown_connections 2023-01-04T18:26:48.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.097+0000 7fe32a841700 1 -- 172.21.15.50:0/4072572740 wait complete. 2023-01-04T18:26:48.103 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 19 2023-01-04T18:26:48.112 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2023-01-04T18:26:48.112 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2023-01-04T18:26:48.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.231+0000 7fe479acc700 1 -- 172.21.15.50:0/1807967047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4740f96a0 msgr2=0x7fe4740fba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:48.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.231+0000 7fe479acc700 1 --2- 172.21.15.50:0/1807967047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4740f96a0 0x7fe4740fba90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fe468004660 tx=0x7fe468009b30).stop 2023-01-04T18:26:48.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.231+0000 7fe479acc700 1 -- 172.21.15.50:0/1807967047 shutdown_connections 2023-01-04T18:26:48.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.231+0000 7fe479acc700 1 --2- 172.21.15.50:0/1807967047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4740f96a0 0x7fe4740fba90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:48.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.231+0000 7fe479acc700 1 --2- 172.21.15.50:0/1807967047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe47405fd90 0x7fe4740f91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:48.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.231+0000 7fe479acc700 1 -- 172.21.15.50:0/1807967047 >> 172.21.15.50:0/1807967047 conn(0x7fe4740f0b70 msgr2=0x7fe4740f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:48.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.231+0000 7fe479acc700 1 -- 172.21.15.50:0/1807967047 shutdown_connections 2023-01-04T18:26:48.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.232+0000 7fe479acc700 1 -- 172.21.15.50:0/1807967047 wait complete. 2023-01-04T18:26:48.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.232+0000 7fe479acc700 1 Processor -- start 2023-01-04T18:26:48.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.232+0000 7fe479acc700 1 -- start start 2023-01-04T18:26:48.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.232+0000 7fe479acc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe47405fd90 0x7fe4740f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:48.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.232+0000 7fe479acc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4740f96a0 0x7fe4740f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:48.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.232+0000 7fe479acc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4740f7000 con 0x7fe47405fd90 2023-01-04T18:26:48.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.232+0000 7fe479acc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4740f55a0 con 0x7fe4740f96a0 2023-01-04T18:26:48.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.233+0000 7fe4737fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe47405fd90 0x7fe4740f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:48.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.233+0000 7fe4737fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe47405fd90 0x7fe4740f6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37686/0 (socket says 172.21.15.50:37686) 2023-01-04T18:26:48.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.233+0000 7fe4737fe700 1 -- 172.21.15.50:0/3195376808 learned_addr learned my addr 172.21.15.50:0/3195376808 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:48.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.233+0000 7fe472ffd700 1 --2- 172.21.15.50:0/3195376808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4740f96a0 0x7fe4740f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:48.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.233+0000 7fe4737fe700 1 -- 172.21.15.50:0/3195376808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4740f96a0 msgr2=0x7fe4740f50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.233+0000 7fe4737fe700 1 --2- 172.21.15.50:0/3195376808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4740f96a0 0x7fe4740f50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.233+0000 7fe4737fe700 1 -- 172.21.15.50:0/3195376808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe468005040 con 0x7fe47405fd90 2023-01-04T18:26:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.233+0000 7fe4737fe700 1 --2- 172.21.15.50:0/3195376808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe47405fd90 0x7fe4740f6a50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fe46400c530 tx=0x7fe464007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.233+0000 7fe45bfff700 1 -- 172.21.15.50:0/3195376808 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe46400f650 con 0x7fe47405fd90 2023-01-04T18:26:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.233+0000 7fe45bfff700 1 -- 172.21.15.50:0/3195376808 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fe46400fc80 con 0x7fe47405fd90 2023-01-04T18:26:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.233+0000 7fe479acc700 1 -- 172.21.15.50:0/3195376808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4740f5820 con 0x7fe47405fd90 2023-01-04T18:26:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.233+0000 7fe45bfff700 1 -- 172.21.15.50:0/3195376808 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe464012d90 con 0x7fe47405fd90 2023-01-04T18:26:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.233+0000 7fe479acc700 1 -- 172.21.15.50:0/3195376808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4740f5de0 con 0x7fe47405fd90 2023-01-04T18:26:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.234+0000 7fe479acc700 1 -- 172.21.15.50:0/3195376808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe474027a00 con 0x7fe47405fd90 2023-01-04T18:26:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.235+0000 7fe45bfff700 1 -- 172.21.15.50:0/3195376808 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fe464019030 con 0x7fe47405fd90 2023-01-04T18:26:48.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.235+0000 7fe45bfff700 1 --2- 172.21.15.50:0/3195376808 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe45c060be0 0x7fe45c0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:48.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.235+0000 7fe45bfff700 1 -- 172.21.15.50:0/3195376808 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fe46407b9b0 con 0x7fe47405fd90 2023-01-04T18:26:48.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.235+0000 7fe472ffd700 1 --2- 172.21.15.50:0/3195376808 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe45c060be0 0x7fe45c0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:48.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.236+0000 7fe472ffd700 1 --2- 172.21.15.50:0/3195376808 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe45c060be0 0x7fe45c0630a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fe468009f50 tx=0x7fe468009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:48.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.239+0000 7fe45bfff700 1 -- 172.21.15.50:0/3195376808 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fe464048c30 con 0x7fe47405fd90 2023-01-04T18:26:48.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.459+0000 7fe479acc700 1 -- 172.21.15.50:0/3195376808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7fe4740fec30 con 0x7fe47405fd90 2023-01-04T18:26:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.460+0000 7fe45bfff700 1 -- 172.21.15.50:0/3195376808 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v36) v1 ==== 107+0+3840 (secure 0 0 0) 0x7fe46404f950 con 0x7fe47405fd90 2023-01-04T18:26:48.462 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:48.462 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24297,"name":"cephfs.smithi098.laynsk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.98:6827/1785480263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1785480263},{"type":"v1","addr":"172.21.15.98:6827","nonce":1785480263}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":44275,"name":"cephfs.smithi098.memais","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3576035235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3576035235},{"type":"v1","addr":"172.21.15.98:6825","nonce":3576035235}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:22:43.157770+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14440},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14440":{"gid":14440,"name":"cephfs.smithi050.kefmuy","rank":0,"incarnation":17,"state":"up:active","state_seq":124,"addr":"172.21.15.50:6829/3827606592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3827606592},{"type":"v1","addr":"172.21.15.50:6829","nonce":3827606592}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:48.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.461+0000 7fe479acc700 1 -- 172.21.15.50:0/3195376808 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe45c060be0 msgr2=0x7fe45c0630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:48.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.461+0000 7fe479acc700 1 --2- 172.21.15.50:0/3195376808 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe45c060be0 0x7fe45c0630a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fe468009f50 tx=0x7fe468009b30).stop 2023-01-04T18:26:48.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.461+0000 7fe479acc700 1 -- 172.21.15.50:0/3195376808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe47405fd90 msgr2=0x7fe4740f6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:48.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.461+0000 7fe479acc700 1 --2- 172.21.15.50:0/3195376808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe47405fd90 0x7fe4740f6a50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fe46400c530 tx=0x7fe464007e10).stop 2023-01-04T18:26:48.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.461+0000 7fe479acc700 1 -- 172.21.15.50:0/3195376808 shutdown_connections 2023-01-04T18:26:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.461+0000 7fe479acc700 1 --2- 172.21.15.50:0/3195376808 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fe45c060be0 0x7fe45c0630a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.461+0000 7fe479acc700 1 --2- 172.21.15.50:0/3195376808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe47405fd90 0x7fe4740f6a50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.461+0000 7fe479acc700 1 --2- 172.21.15.50:0/3195376808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4740f96a0 0x7fe4740f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.461+0000 7fe479acc700 1 -- 172.21.15.50:0/3195376808 >> 172.21.15.50:0/3195376808 conn(0x7fe4740f0b70 msgr2=0x7fe4740f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.462+0000 7fe479acc700 1 -- 172.21.15.50:0/3195376808 shutdown_connections 2023-01-04T18:26:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.462+0000 7fe479acc700 1 -- 172.21.15.50:0/3195376808 wait complete. 2023-01-04T18:26:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 20 2023-01-04T18:26:48.475 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:46.736377+0000 mgr.smithi050.emnywo (mgr.24517) 461 : cluster [DBG] pgmap v335: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:48.475 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:47.374437+0000 mon.smithi050 (mon.0) 821 : audit [DBG] from='client.? 172.21.15.50:0/4176767697' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2023-01-04T18:26:48.475 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:47.732222+0000 mon.smithi050 (mon.0) 822 : audit [DBG] from='client.? 172.21.15.50:0/1759012339' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2023-01-04T18:26:48.475 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:48 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:48.095415+0000 mon.smithi050 (mon.0) 823 : audit [DBG] from='client.? 172.21.15.50:0/4072572740' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2023-01-04T18:26:48.476 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2023-01-04T18:26:48.476 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2023-01-04T18:26:48.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:46.736377+0000 mgr.smithi050.emnywo (mgr.24517) 461 : cluster [DBG] pgmap v335: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:48.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:47.374437+0000 mon.smithi050 (mon.0) 821 : audit [DBG] from='client.? 172.21.15.50:0/4176767697' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2023-01-04T18:26:48.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:47.732222+0000 mon.smithi050 (mon.0) 822 : audit [DBG] from='client.? 172.21.15.50:0/1759012339' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2023-01-04T18:26:48.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:48 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:48.095415+0000 mon.smithi050 (mon.0) 823 : audit [DBG] from='client.? 172.21.15.50:0/4072572740' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2023-01-04T18:26:48.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.594+0000 7fb60876e700 1 -- 172.21.15.50:0/4083866916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6000f5390 msgr2=0x7fb6000f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:48.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.594+0000 7fb60876e700 1 --2- 172.21.15.50:0/4083866916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6000f5390 0x7fb6000f57b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fb5fc004660 tx=0x7fb5fc009b30).stop 2023-01-04T18:26:48.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.594+0000 7fb60876e700 1 -- 172.21.15.50:0/4083866916 shutdown_connections 2023-01-04T18:26:48.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.594+0000 7fb60876e700 1 --2- 172.21.15.50:0/4083866916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6000f5ca0 0x7fb6000f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:48.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.594+0000 7fb60876e700 1 --2- 172.21.15.50:0/4083866916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6000f5390 0x7fb6000f57b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:48.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.594+0000 7fb60876e700 1 -- 172.21.15.50:0/4083866916 >> 172.21.15.50:0/4083866916 conn(0x7fb6000f0b70 msgr2=0x7fb6000f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:48.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.594+0000 7fb60876e700 1 -- 172.21.15.50:0/4083866916 shutdown_connections 2023-01-04T18:26:48.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.594+0000 7fb60876e700 1 -- 172.21.15.50:0/4083866916 wait complete. 2023-01-04T18:26:48.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.595+0000 7fb60876e700 1 Processor -- start 2023-01-04T18:26:48.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.595+0000 7fb60876e700 1 -- start start 2023-01-04T18:26:48.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.595+0000 7fb60876e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6000f5390 0x7fb60005fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:48.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.595+0000 7fb60876e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6000f5ca0 0x7fb60010ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:48.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.595+0000 7fb60876e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60010bf50 con 0x7fb6000f5ca0 2023-01-04T18:26:48.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.595+0000 7fb60876e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60010c090 con 0x7fb6000f5390 2023-01-04T18:26:48.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.595+0000 7fb605d09700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6000f5ca0 0x7fb60010ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:48.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.595+0000 7fb60650a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6000f5390 0x7fb60005fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:48.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.595+0000 7fb605d09700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6000f5ca0 0x7fb60010ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37708/0 (socket says 172.21.15.50:37708) 2023-01-04T18:26:48.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.595+0000 7fb605d09700 1 -- 172.21.15.50:0/4255331613 learned_addr learned my addr 172.21.15.50:0/4255331613 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:48.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.596+0000 7fb605d09700 1 -- 172.21.15.50:0/4255331613 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6000f5390 msgr2=0x7fb60005fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:48.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.596+0000 7fb605d09700 1 --2- 172.21.15.50:0/4255331613 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6000f5390 0x7fb60005fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:48.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.596+0000 7fb605d09700 1 -- 172.21.15.50:0/4255331613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc005040 con 0x7fb6000f5ca0 2023-01-04T18:26:48.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.596+0000 7fb605d09700 1 --2- 172.21.15.50:0/4255331613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6000f5ca0 0x7fb60010ba60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fb5f400c530 tx=0x7fb5f4007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:48.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.596+0000 7fb5f2ffd700 1 -- 172.21.15.50:0/4255331613 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5f400f650 con 0x7fb6000f5ca0 2023-01-04T18:26:48.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.596+0000 7fb5f2ffd700 1 -- 172.21.15.50:0/4255331613 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fb5f400fc80 con 0x7fb6000f5ca0 2023-01-04T18:26:48.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.596+0000 7fb60876e700 1 -- 172.21.15.50:0/4255331613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60010c2f0 con 0x7fb6000f5ca0 2023-01-04T18:26:48.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.596+0000 7fb5f2ffd700 1 -- 172.21.15.50:0/4255331613 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5f4012d00 con 0x7fb6000f5ca0 2023-01-04T18:26:48.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.596+0000 7fb60876e700 1 -- 172.21.15.50:0/4255331613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60010c880 con 0x7fb6000f5ca0 2023-01-04T18:26:48.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.597+0000 7fb60876e700 1 -- 172.21.15.50:0/4255331613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb600046330 con 0x7fb6000f5ca0 2023-01-04T18:26:48.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.597+0000 7fb5f2ffd700 1 -- 172.21.15.50:0/4255331613 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fb5f4010070 con 0x7fb6000f5ca0 2023-01-04T18:26:48.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.598+0000 7fb5f2ffd700 1 --2- 172.21.15.50:0/4255331613 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb5ec060be0 0x7fb5ec0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:48.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.598+0000 7fb5f2ffd700 1 -- 172.21.15.50:0/4255331613 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fb5f407b9b0 con 0x7fb6000f5ca0 2023-01-04T18:26:48.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.598+0000 7fb60650a700 1 --2- 172.21.15.50:0/4255331613 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb5ec060be0 0x7fb5ec0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:48.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.598+0000 7fb60650a700 1 --2- 172.21.15.50:0/4255331613 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb5ec060be0 0x7fb5ec0630a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fb5fc009f50 tx=0x7fb5fc009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:48.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.602+0000 7fb5f2ffd700 1 -- 172.21.15.50:0/4255331613 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fb5f4047c30 con 0x7fb6000f5ca0 2023-01-04T18:26:48.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.818+0000 7fb60876e700 1 -- 172.21.15.50:0/4255331613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fb600058710 con 0x7fb6000f5ca0 2023-01-04T18:26:48.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.818+0000 7fb5f2ffd700 1 -- 172.21.15.50:0/4255331613 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v36) v1 ==== 107+0+4616 (secure 0 0 0) 0x7fb5f4012e60 con 0x7fb6000f5ca0 2023-01-04T18:26:48.821 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:48.821 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24297,"name":"cephfs.smithi098.laynsk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.98:6827/1785480263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1785480263},{"type":"v1","addr":"172.21.15.98:6827","nonce":1785480263}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34362,"name":"cephfs.smithi050.ezoiwl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6827/336562041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":336562041},{"type":"v1","addr":"172.21.15.50:6827","nonce":336562041}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44275,"name":"cephfs.smithi098.memais","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3576035235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3576035235},{"type":"v1","addr":"172.21.15.98:6825","nonce":3576035235}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:22:43.157770+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14440},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14440":{"gid":14440,"name":"cephfs.smithi050.kefmuy","rank":0,"incarnation":17,"state":"up:active","state_seq":124,"addr":"172.21.15.50:6829/3827606592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":3827606592},{"type":"v1","addr":"172.21.15.50:6829","nonce":3827606592}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:48.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.820+0000 7fb60876e700 1 -- 172.21.15.50:0/4255331613 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb5ec060be0 msgr2=0x7fb5ec0630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:48.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.820+0000 7fb60876e700 1 --2- 172.21.15.50:0/4255331613 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb5ec060be0 0x7fb5ec0630a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fb5fc009f50 tx=0x7fb5fc009b30).stop 2023-01-04T18:26:48.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.820+0000 7fb60876e700 1 -- 172.21.15.50:0/4255331613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6000f5ca0 msgr2=0x7fb60010ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:48.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.820+0000 7fb60876e700 1 --2- 172.21.15.50:0/4255331613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6000f5ca0 0x7fb60010ba60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fb5f400c530 tx=0x7fb5f4007e20).stop 2023-01-04T18:26:48.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.820+0000 7fb60876e700 1 -- 172.21.15.50:0/4255331613 shutdown_connections 2023-01-04T18:26:48.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.820+0000 7fb60876e700 1 --2- 172.21.15.50:0/4255331613 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fb5ec060be0 0x7fb5ec0630a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:48.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.820+0000 7fb60876e700 1 --2- 172.21.15.50:0/4255331613 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6000f5390 0x7fb60005fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:48.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.820+0000 7fb60876e700 1 --2- 172.21.15.50:0/4255331613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6000f5ca0 0x7fb60010ba60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:48.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.820+0000 7fb60876e700 1 -- 172.21.15.50:0/4255331613 >> 172.21.15.50:0/4255331613 conn(0x7fb6000f0b70 msgr2=0x7fb6000fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:48.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.820+0000 7fb60876e700 1 -- 172.21.15.50:0/4255331613 shutdown_connections 2023-01-04T18:26:48.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.820+0000 7fb60876e700 1 -- 172.21.15.50:0/4255331613 wait complete. 2023-01-04T18:26:48.824 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 21 2023-01-04T18:26:48.835 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2023-01-04T18:26:48.835 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2023-01-04T18:26:48.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.954+0000 7f517c2d0700 1 -- 172.21.15.50:0/2859467165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51740f5390 msgr2=0x7f51740f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:48.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.954+0000 7f517c2d0700 1 --2- 172.21.15.50:0/2859467165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51740f5390 0x7f51740f57b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f5164004660 tx=0x7f5164009b30).stop 2023-01-04T18:26:48.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.954+0000 7f517c2d0700 1 -- 172.21.15.50:0/2859467165 shutdown_connections 2023-01-04T18:26:48.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.954+0000 7f517c2d0700 1 --2- 172.21.15.50:0/2859467165 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51740f5ca0 0x7f51740f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:48.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.954+0000 7f517c2d0700 1 --2- 172.21.15.50:0/2859467165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51740f5390 0x7f51740f57b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:48.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.954+0000 7f517c2d0700 1 -- 172.21.15.50:0/2859467165 >> 172.21.15.50:0/2859467165 conn(0x7f51740f0b70 msgr2=0x7f51740f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:48.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.954+0000 7f517c2d0700 1 -- 172.21.15.50:0/2859467165 shutdown_connections 2023-01-04T18:26:48.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.954+0000 7f517c2d0700 1 -- 172.21.15.50:0/2859467165 wait complete. 2023-01-04T18:26:48.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.955+0000 7f517c2d0700 1 Processor -- start 2023-01-04T18:26:48.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.955+0000 7f517c2d0700 1 -- start start 2023-01-04T18:26:48.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.955+0000 7f517c2d0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51740f5390 0x7f5174105ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:48.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.955+0000 7f517c2d0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51740f5ca0 0x7f5174105fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:48.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.955+0000 7f517c2d0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5174106560 con 0x7f51740f5ca0 2023-01-04T18:26:48.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.955+0000 7f517c2d0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51741066a0 con 0x7f51740f5390 2023-01-04T18:26:48.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.955+0000 7f517986b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51740f5ca0 0x7f5174105fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:48.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.955+0000 7f517986b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51740f5ca0 0x7f5174105fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37726/0 (socket says 172.21.15.50:37726) 2023-01-04T18:26:48.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.955+0000 7f517986b700 1 -- 172.21.15.50:0/2157646831 learned_addr learned my addr 172.21.15.50:0/2157646831 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:48.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.955+0000 7f517a06c700 1 --2- 172.21.15.50:0/2157646831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51740f5390 0x7f5174105ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:48.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.955+0000 7f517986b700 1 -- 172.21.15.50:0/2157646831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51740f5390 msgr2=0x7f5174105ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:48.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.955+0000 7f517986b700 1 --2- 172.21.15.50:0/2157646831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51740f5390 0x7f5174105ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:48.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.955+0000 7f517986b700 1 -- 172.21.15.50:0/2157646831 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5164005040 con 0x7f51740f5ca0 2023-01-04T18:26:48.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.956+0000 7f517986b700 1 --2- 172.21.15.50:0/2157646831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51740f5ca0 0x7f5174105fb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f517000e7f0 tx=0x7f517000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:48.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.956+0000 7f516affd700 1 -- 172.21.15.50:0/2157646831 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51700092e0 con 0x7f51740f5ca0 2023-01-04T18:26:48.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.956+0000 7f516affd700 1 -- 172.21.15.50:0/2157646831 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f517000f040 con 0x7f51740f5ca0 2023-01-04T18:26:48.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.956+0000 7f517c2d0700 1 -- 172.21.15.50:0/2157646831 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f517410b140 con 0x7f51740f5ca0 2023-01-04T18:26:48.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.956+0000 7f516affd700 1 -- 172.21.15.50:0/2157646831 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51700147e0 con 0x7f51740f5ca0 2023-01-04T18:26:48.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.956+0000 7f517c2d0700 1 -- 172.21.15.50:0/2157646831 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f517410b700 con 0x7f51740f5ca0 2023-01-04T18:26:48.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.957+0000 7f517c2d0700 1 -- 172.21.15.50:0/2157646831 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5174027a00 con 0x7f51740f5ca0 2023-01-04T18:26:48.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.957+0000 7f516affd700 1 -- 172.21.15.50:0/2157646831 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f517001b030 con 0x7f51740f5ca0 2023-01-04T18:26:48.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.957+0000 7f516affd700 1 --2- 172.21.15.50:0/2157646831 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5160060be0 0x7f51600630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:48.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.957+0000 7f516affd700 1 -- 172.21.15.50:0/2157646831 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f517007bb70 con 0x7f51740f5ca0 2023-01-04T18:26:48.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.957+0000 7f517a06c700 1 --2- 172.21.15.50:0/2157646831 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5160060be0 0x7f51600630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:48.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.958+0000 7f517a06c700 1 --2- 172.21.15.50:0/2157646831 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5160060be0 0x7f51600630a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f5164004630 tx=0x7f5164016040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:48.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:48.962+0000 7f516affd700 1 -- 172.21.15.50:0/2157646831 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f517004fb70 con 0x7f51740f5ca0 2023-01-04T18:26:49.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.177+0000 7f517c2d0700 1 -- 172.21.15.50:0/2157646831 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f51740fdb50 con 0x7f51740f5ca0 2023-01-04T18:26:49.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.178+0000 7f516affd700 1 -- 172.21.15.50:0/2157646831 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v36) v1 ==== 107+0+3824 (secure 0 0 0) 0x7f5170019020 con 0x7f51740f5ca0 2023-01-04T18:26:49.181 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:49.181 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24297,"name":"cephfs.smithi098.laynsk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.98:6827/1785480263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1785480263},{"type":"v1","addr":"172.21.15.98:6827","nonce":1785480263}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34362,"name":"cephfs.smithi050.ezoiwl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6827/336562041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":336562041},{"type":"v1","addr":"172.21.15.50:6827","nonce":336562041}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44275,"name":"cephfs.smithi098.memais","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3576035235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3576035235},{"type":"v1","addr":"172.21.15.98:6825","nonce":3576035235}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:22:53.512365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:49.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.180+0000 7f517c2d0700 1 -- 172.21.15.50:0/2157646831 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5160060be0 msgr2=0x7f51600630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:49.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.180+0000 7f517c2d0700 1 --2- 172.21.15.50:0/2157646831 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5160060be0 0x7f51600630a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f5164004630 tx=0x7f5164016040).stop 2023-01-04T18:26:49.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.180+0000 7f517c2d0700 1 -- 172.21.15.50:0/2157646831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51740f5ca0 msgr2=0x7f5174105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:49.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.180+0000 7f517c2d0700 1 --2- 172.21.15.50:0/2157646831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51740f5ca0 0x7f5174105fb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f517000e7f0 tx=0x7f517000b040).stop 2023-01-04T18:26:49.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.180+0000 7f517c2d0700 1 -- 172.21.15.50:0/2157646831 shutdown_connections 2023-01-04T18:26:49.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.180+0000 7f517c2d0700 1 --2- 172.21.15.50:0/2157646831 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5160060be0 0x7f51600630a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:49.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.180+0000 7f517c2d0700 1 --2- 172.21.15.50:0/2157646831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51740f5390 0x7f5174105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:49.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.180+0000 7f517c2d0700 1 --2- 172.21.15.50:0/2157646831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51740f5ca0 0x7f5174105fb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:49.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.180+0000 7f517c2d0700 1 -- 172.21.15.50:0/2157646831 >> 172.21.15.50:0/2157646831 conn(0x7f51740f0b70 msgr2=0x7f51740fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:49.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.180+0000 7f517c2d0700 1 -- 172.21.15.50:0/2157646831 shutdown_connections 2023-01-04T18:26:49.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.180+0000 7f517c2d0700 1 -- 172.21.15.50:0/2157646831 wait complete. 2023-01-04T18:26:49.185 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 22 2023-01-04T18:26:49.194 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2023-01-04T18:26:49.195 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2023-01-04T18:26:49.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.315+0000 7fd0c282a700 1 -- 172.21.15.50:0/302898771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0bc0f6670 msgr2=0x7fd0bc0f6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:49.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.315+0000 7fd0c282a700 1 --2- 172.21.15.50:0/302898771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0bc0f6670 0x7fd0bc0f6ad0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fd0b0004660 tx=0x7fd0b0009b30).stop 2023-01-04T18:26:49.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.315+0000 7fd0c282a700 1 -- 172.21.15.50:0/302898771 shutdown_connections 2023-01-04T18:26:49.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.315+0000 7fd0c282a700 1 --2- 172.21.15.50:0/302898771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0bc0f6670 0x7fd0bc0f6ad0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:49.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.315+0000 7fd0c282a700 1 --2- 172.21.15.50:0/302898771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0bc0f53d0 0x7fd0bc0f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:49.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.315+0000 7fd0c282a700 1 -- 172.21.15.50:0/302898771 >> 172.21.15.50:0/302898771 conn(0x7fd0bc0f0b30 msgr2=0x7fd0bc0f2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:49.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.315+0000 7fd0c282a700 1 -- 172.21.15.50:0/302898771 shutdown_connections 2023-01-04T18:26:49.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.316+0000 7fd0c282a700 1 -- 172.21.15.50:0/302898771 wait complete. 2023-01-04T18:26:49.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.316+0000 7fd0c282a700 1 Processor -- start 2023-01-04T18:26:49.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.316+0000 7fd0c282a700 1 -- start start 2023-01-04T18:26:49.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.316+0000 7fd0c282a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0bc0f53d0 0x7fd0bc105b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:49.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.316+0000 7fd0c282a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0bc0f6670 0x7fd0bc106060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:49.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.316+0000 7fd0c282a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc106610 con 0x7fd0bc0f53d0 2023-01-04T18:26:49.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.316+0000 7fd0c282a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc106750 con 0x7fd0bc0f6670 2023-01-04T18:26:49.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.317+0000 7fd0bbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0bc0f53d0 0x7fd0bc105b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:49.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.317+0000 7fd0bbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0bc0f53d0 0x7fd0bc105b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37744/0 (socket says 172.21.15.50:37744) 2023-01-04T18:26:49.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.317+0000 7fd0bbfff700 1 -- 172.21.15.50:0/2024484264 learned_addr learned my addr 172.21.15.50:0/2024484264 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:49.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.317+0000 7fd0bb7fe700 1 --2- 172.21.15.50:0/2024484264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0bc0f6670 0x7fd0bc106060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:49.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.317+0000 7fd0bbfff700 1 -- 172.21.15.50:0/2024484264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0bc0f6670 msgr2=0x7fd0bc106060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:49.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.317+0000 7fd0bbfff700 1 --2- 172.21.15.50:0/2024484264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0bc0f6670 0x7fd0bc106060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:49.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.317+0000 7fd0bbfff700 1 -- 172.21.15.50:0/2024484264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b0005040 con 0x7fd0bc0f53d0 2023-01-04T18:26:49.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.317+0000 7fd0bbfff700 1 --2- 172.21.15.50:0/2024484264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0bc0f53d0 0x7fd0bc105b70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fd0ac00f910 tx=0x7fd0ac009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:49.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.317+0000 7fd0b8ff9700 1 -- 172.21.15.50:0/2024484264 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0ac009500 con 0x7fd0bc0f53d0 2023-01-04T18:26:49.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.317+0000 7fd0b8ff9700 1 -- 172.21.15.50:0/2024484264 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fd0ac009660 con 0x7fd0bc0f53d0 2023-01-04T18:26:49.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.317+0000 7fd0c282a700 1 -- 172.21.15.50:0/2024484264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0bc05f2a0 con 0x7fd0bc0f53d0 2023-01-04T18:26:49.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.317+0000 7fd0b8ff9700 1 -- 172.21.15.50:0/2024484264 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0ac00ddc0 con 0x7fd0bc0f53d0 2023-01-04T18:26:49.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.317+0000 7fd0c282a700 1 -- 172.21.15.50:0/2024484264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0bc05f860 con 0x7fd0bc0f53d0 2023-01-04T18:26:49.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.318+0000 7fd0c282a700 1 -- 172.21.15.50:0/2024484264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0bc0fdb60 con 0x7fd0bc0f53d0 2023-01-04T18:26:49.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.319+0000 7fd0b8ff9700 1 -- 172.21.15.50:0/2024484264 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fd0ac00e040 con 0x7fd0bc0f53d0 2023-01-04T18:26:49.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.319+0000 7fd0b8ff9700 1 --2- 172.21.15.50:0/2024484264 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd0a4060be0 0x7fd0a40630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:49.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.319+0000 7fd0b8ff9700 1 -- 172.21.15.50:0/2024484264 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fd0ac07e670 con 0x7fd0bc0f53d0 2023-01-04T18:26:49.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.319+0000 7fd0bb7fe700 1 --2- 172.21.15.50:0/2024484264 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd0a4060be0 0x7fd0a40630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:49.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.320+0000 7fd0bb7fe700 1 --2- 172.21.15.50:0/2024484264 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd0a4060be0 0x7fd0a40630a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fd0b0004630 tx=0x7fd0b0009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:49.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.323+0000 7fd0b8ff9700 1 -- 172.21.15.50:0/2024484264 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fd0ac052630 con 0x7fd0bc0f53d0 2023-01-04T18:26:49.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:49 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:48.459959+0000 mon.smithi050 (mon.0) 824 : audit [DBG] from='client.? 172.21.15.50:0/3195376808' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2023-01-04T18:26:49.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:49 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:48.818806+0000 mon.smithi050 (mon.0) 825 : audit [DBG] from='client.? 172.21.15.50:0/4255331613' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2023-01-04T18:26:49.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:49 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:49.178376+0000 mon.smithi050 (mon.0) 826 : audit [DBG] from='client.? 172.21.15.50:0/2157646831' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2023-01-04T18:26:49.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.542+0000 7fd0c282a700 1 -- 172.21.15.50:0/2024484264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7fd0bc10b190 con 0x7fd0bc0f53d0 2023-01-04T18:26:49.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.542+0000 7fd0b8ff9700 1 -- 172.21.15.50:0/2024484264 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v36) v1 ==== 107+0+3835 (secure 0 0 0) 0x7fd0ac052220 con 0x7fd0bc0f53d0 2023-01-04T18:26:49.545 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:49.545 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34362,"name":"cephfs.smithi050.ezoiwl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6827/336562041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":336562041},{"type":"v1","addr":"172.21.15.50:6827","nonce":336562041}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44275,"name":"cephfs.smithi098.memais","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3576035235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3576035235},{"type":"v1","addr":"172.21.15.98:6825","nonce":3576035235}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:22:53.518413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24297":{"gid":24297,"name":"cephfs.smithi098.laynsk","rank":0,"incarnation":23,"state":"up:replay","state_seq":3,"addr":"172.21.15.98:6827/1785480263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1785480263},{"type":"v1","addr":"172.21.15.98:6827","nonce":1785480263}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:49.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.544+0000 7fd0c282a700 1 -- 172.21.15.50:0/2024484264 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd0a4060be0 msgr2=0x7fd0a40630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:49.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.544+0000 7fd0c282a700 1 --2- 172.21.15.50:0/2024484264 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd0a4060be0 0x7fd0a40630a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fd0b0004630 tx=0x7fd0b0009b30).stop 2023-01-04T18:26:49.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.544+0000 7fd0c282a700 1 -- 172.21.15.50:0/2024484264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0bc0f53d0 msgr2=0x7fd0bc105b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:49.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.544+0000 7fd0c282a700 1 --2- 172.21.15.50:0/2024484264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0bc0f53d0 0x7fd0bc105b70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fd0ac00f910 tx=0x7fd0ac009d80).stop 2023-01-04T18:26:49.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.544+0000 7fd0c282a700 1 -- 172.21.15.50:0/2024484264 shutdown_connections 2023-01-04T18:26:49.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.544+0000 7fd0c282a700 1 --2- 172.21.15.50:0/2024484264 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd0a4060be0 0x7fd0a40630a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:49.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.544+0000 7fd0c282a700 1 --2- 172.21.15.50:0/2024484264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0bc0f53d0 0x7fd0bc105b70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:49.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.544+0000 7fd0c282a700 1 --2- 172.21.15.50:0/2024484264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0bc0f6670 0x7fd0bc106060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:49.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.544+0000 7fd0c282a700 1 -- 172.21.15.50:0/2024484264 >> 172.21.15.50:0/2024484264 conn(0x7fd0bc0f0b30 msgr2=0x7fd0bc0fa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:49.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.544+0000 7fd0c282a700 1 -- 172.21.15.50:0/2024484264 shutdown_connections 2023-01-04T18:26:49.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.544+0000 7fd0c282a700 1 -- 172.21.15.50:0/2024484264 wait complete. 2023-01-04T18:26:49.548 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2023-01-04T18:26:49.559 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2023-01-04T18:26:49.559 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2023-01-04T18:26:49.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:49 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:48.459959+0000 mon.smithi050 (mon.0) 824 : audit [DBG] from='client.? 172.21.15.50:0/3195376808' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2023-01-04T18:26:49.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:49 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:48.818806+0000 mon.smithi050 (mon.0) 825 : audit [DBG] from='client.? 172.21.15.50:0/4255331613' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2023-01-04T18:26:49.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:49 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:49.178376+0000 mon.smithi050 (mon.0) 826 : audit [DBG] from='client.? 172.21.15.50:0/2157646831' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2023-01-04T18:26:49.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.679+0000 7ffbd4250700 1 -- 172.21.15.50:0/517678654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbcc0f5390 msgr2=0x7ffbcc0f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:49.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.679+0000 7ffbd4250700 1 --2- 172.21.15.50:0/517678654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbcc0f5390 0x7ffbcc0f57b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7ffbc8004660 tx=0x7ffbc8009b30).stop 2023-01-04T18:26:49.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.679+0000 7ffbd4250700 1 -- 172.21.15.50:0/517678654 shutdown_connections 2023-01-04T18:26:49.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.679+0000 7ffbd4250700 1 --2- 172.21.15.50:0/517678654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbcc0f5ca0 0x7ffbcc0f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:49.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.679+0000 7ffbd4250700 1 --2- 172.21.15.50:0/517678654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbcc0f5390 0x7ffbcc0f57b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:49.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.679+0000 7ffbd4250700 1 -- 172.21.15.50:0/517678654 >> 172.21.15.50:0/517678654 conn(0x7ffbcc0f0b70 msgr2=0x7ffbcc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:49.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.679+0000 7ffbd4250700 1 -- 172.21.15.50:0/517678654 shutdown_connections 2023-01-04T18:26:49.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.679+0000 7ffbd4250700 1 -- 172.21.15.50:0/517678654 wait complete. 2023-01-04T18:26:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.679+0000 7ffbd4250700 1 Processor -- start 2023-01-04T18:26:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.679+0000 7ffbd4250700 1 -- start start 2023-01-04T18:26:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.680+0000 7ffbd4250700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbcc0f5390 0x7ffbcc05fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.680+0000 7ffbd4250700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbcc0f5ca0 0x7ffbcc10ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.680+0000 7ffbd4250700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc10bf30 con 0x7ffbcc0f5ca0 2023-01-04T18:26:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.680+0000 7ffbd4250700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc10c070 con 0x7ffbcc0f5390 2023-01-04T18:26:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.680+0000 7ffbd17eb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbcc0f5ca0 0x7ffbcc10ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.680+0000 7ffbd17eb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbcc0f5ca0 0x7ffbcc10ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37764/0 (socket says 172.21.15.50:37764) 2023-01-04T18:26:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.680+0000 7ffbd17eb700 1 -- 172.21.15.50:0/845154656 learned_addr learned my addr 172.21.15.50:0/845154656 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.680+0000 7ffbd1fec700 1 --2- 172.21.15.50:0/845154656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbcc0f5390 0x7ffbcc05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.680+0000 7ffbd17eb700 1 -- 172.21.15.50:0/845154656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbcc0f5390 msgr2=0x7ffbcc05fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.680+0000 7ffbd17eb700 1 --2- 172.21.15.50:0/845154656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbcc0f5390 0x7ffbcc05fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.680+0000 7ffbd17eb700 1 -- 172.21.15.50:0/845154656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc8005040 con 0x7ffbcc0f5ca0 2023-01-04T18:26:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.680+0000 7ffbd17eb700 1 --2- 172.21.15.50:0/845154656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbcc0f5ca0 0x7ffbcc10ba40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7ffbbc002700 tx=0x7ffbbc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.680+0000 7ffbc27fc700 1 -- 172.21.15.50:0/845154656 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbbc009320 con 0x7ffbcc0f5ca0 2023-01-04T18:26:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.680+0000 7ffbd4250700 1 -- 172.21.15.50:0/845154656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbcc10c2d0 con 0x7ffbcc0f5ca0 2023-01-04T18:26:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.680+0000 7ffbc27fc700 1 -- 172.21.15.50:0/845154656 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7ffbbc00f040 con 0x7ffbcc0f5ca0 2023-01-04T18:26:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.680+0000 7ffbc27fc700 1 -- 172.21.15.50:0/845154656 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbbc014940 con 0x7ffbcc0f5ca0 2023-01-04T18:26:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.680+0000 7ffbd4250700 1 -- 172.21.15.50:0/845154656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbcc10c890 con 0x7ffbcc0f5ca0 2023-01-04T18:26:49.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.681+0000 7ffbd4250700 1 -- 172.21.15.50:0/845154656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbcc027a00 con 0x7ffbcc0f5ca0 2023-01-04T18:26:49.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.682+0000 7ffbc27fc700 1 -- 172.21.15.50:0/845154656 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7ffbbc0077b0 con 0x7ffbcc0f5ca0 2023-01-04T18:26:49.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.682+0000 7ffbc27fc700 1 --2- 172.21.15.50:0/845154656 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ffbb8060be0 0x7ffbb80630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:49.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.682+0000 7ffbc27fc700 1 -- 172.21.15.50:0/845154656 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7ffbbc07c460 con 0x7ffbcc0f5ca0 2023-01-04T18:26:49.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.682+0000 7ffbd1fec700 1 --2- 172.21.15.50:0/845154656 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ffbb8060be0 0x7ffbb80630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:49.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.683+0000 7ffbd1fec700 1 --2- 172.21.15.50:0/845154656 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ffbb8060be0 0x7ffbb80630a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7ffbc8004e30 tx=0x7ffbc8009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:49.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.686+0000 7ffbc27fc700 1 -- 172.21.15.50:0/845154656 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7ffbbc0503b0 con 0x7ffbcc0f5ca0 2023-01-04T18:26:49.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.901+0000 7ffbd4250700 1 -- 172.21.15.50:0/845154656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7ffbcc058780 con 0x7ffbcc0f5ca0 2023-01-04T18:26:49.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.902+0000 7ffbc27fc700 1 -- 172.21.15.50:0/845154656 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v36) v1 ==== 107+0+4614 (secure 0 0 0) 0x7ffbbc0181b0 con 0x7ffbcc0f5ca0 2023-01-04T18:26:49.904 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:49.904 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34362,"name":"cephfs.smithi050.ezoiwl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6827/336562041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":336562041},{"type":"v1","addr":"172.21.15.50:6827","nonce":336562041}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":34366,"name":"cephfs.smithi050.kefmuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6829/2188030488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2188030488},{"type":"v1","addr":"172.21.15.50:6829","nonce":2188030488}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44275,"name":"cephfs.smithi098.memais","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3576035235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3576035235},{"type":"v1","addr":"172.21.15.98:6825","nonce":3576035235}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:22:53.518413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24297":{"gid":24297,"name":"cephfs.smithi098.laynsk","rank":0,"incarnation":23,"state":"up:replay","state_seq":3,"addr":"172.21.15.98:6827/1785480263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1785480263},{"type":"v1","addr":"172.21.15.98:6827","nonce":1785480263}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:49.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.904+0000 7ffbd4250700 1 -- 172.21.15.50:0/845154656 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ffbb8060be0 msgr2=0x7ffbb80630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:49.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.904+0000 7ffbd4250700 1 --2- 172.21.15.50:0/845154656 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ffbb8060be0 0x7ffbb80630a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7ffbc8004e30 tx=0x7ffbc8009b30).stop 2023-01-04T18:26:49.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.904+0000 7ffbd4250700 1 -- 172.21.15.50:0/845154656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbcc0f5ca0 msgr2=0x7ffbcc10ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:49.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.904+0000 7ffbd4250700 1 --2- 172.21.15.50:0/845154656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbcc0f5ca0 0x7ffbcc10ba40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7ffbbc002700 tx=0x7ffbbc009de0).stop 2023-01-04T18:26:49.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.904+0000 7ffbd4250700 1 -- 172.21.15.50:0/845154656 shutdown_connections 2023-01-04T18:26:49.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.904+0000 7ffbd4250700 1 --2- 172.21.15.50:0/845154656 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ffbb8060be0 0x7ffbb80630a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:49.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.904+0000 7ffbd4250700 1 --2- 172.21.15.50:0/845154656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbcc0f5390 0x7ffbcc05fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:49.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.904+0000 7ffbd4250700 1 --2- 172.21.15.50:0/845154656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbcc0f5ca0 0x7ffbcc10ba40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:49.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.904+0000 7ffbd4250700 1 -- 172.21.15.50:0/845154656 >> 172.21.15.50:0/845154656 conn(0x7ffbcc0f0b70 msgr2=0x7ffbcc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:49.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.904+0000 7ffbd4250700 1 -- 172.21.15.50:0/845154656 shutdown_connections 2023-01-04T18:26:49.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:49.904+0000 7ffbd4250700 1 -- 172.21.15.50:0/845154656 wait complete. 2023-01-04T18:26:49.908 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 24 2023-01-04T18:26:49.918 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2023-01-04T18:26:49.918 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2023-01-04T18:26:50.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.037+0000 7ff570afc700 1 -- 172.21.15.50:0/226251532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff56c0f6490 msgr2=0x7ff56c0f68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:50.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.037+0000 7ff570afc700 1 --2- 172.21.15.50:0/226251532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff56c0f6490 0x7ff56c0f68b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7ff560004660 tx=0x7ff560009b30).stop 2023-01-04T18:26:50.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.037+0000 7ff570afc700 1 -- 172.21.15.50:0/226251532 shutdown_connections 2023-01-04T18:26:50.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.037+0000 7ff570afc700 1 --2- 172.21.15.50:0/226251532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff56c0f7730 0x7ff56c0f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:50.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.037+0000 7ff570afc700 1 --2- 172.21.15.50:0/226251532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff56c0f6490 0x7ff56c0f68b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:50.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.037+0000 7ff570afc700 1 -- 172.21.15.50:0/226251532 >> 172.21.15.50:0/226251532 conn(0x7ff56c0f1bd0 msgr2=0x7ff56c0f4010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:50.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.037+0000 7ff570afc700 1 -- 172.21.15.50:0/226251532 shutdown_connections 2023-01-04T18:26:50.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.037+0000 7ff570afc700 1 -- 172.21.15.50:0/226251532 wait complete. 2023-01-04T18:26:50.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.037+0000 7ff570afc700 1 Processor -- start 2023-01-04T18:26:50.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.038+0000 7ff570afc700 1 -- start start 2023-01-04T18:26:50.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.038+0000 7ff570afc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff56c0f6490 0x7ff56c106c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:50.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.038+0000 7ff570afc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff56c0f7730 0x7ff56c107180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:50.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.038+0000 7ff570afc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c107780 con 0x7ff56c0f6490 2023-01-04T18:26:50.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.038+0000 7ff570afc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c1078f0 con 0x7ff56c0f7730 2023-01-04T18:26:50.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.038+0000 7ff56a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff56c0f6490 0x7ff56c106c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:50.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.038+0000 7ff56a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff56c0f6490 0x7ff56c106c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37772/0 (socket says 172.21.15.50:37772) 2023-01-04T18:26:50.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.038+0000 7ff56a59c700 1 -- 172.21.15.50:0/2004744647 learned_addr learned my addr 172.21.15.50:0/2004744647 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:50.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.038+0000 7ff56a59c700 1 -- 172.21.15.50:0/2004744647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff56c0f7730 msgr2=0x7ff56c107180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:50.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.038+0000 7ff569d9b700 1 --2- 172.21.15.50:0/2004744647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff56c0f7730 0x7ff56c107180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:50.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.038+0000 7ff56a59c700 1 --2- 172.21.15.50:0/2004744647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff56c0f7730 0x7ff56c107180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:50.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.038+0000 7ff56a59c700 1 -- 172.21.15.50:0/2004744647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff560005040 con 0x7ff56c0f6490 2023-01-04T18:26:50.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.038+0000 7ff569d9b700 1 --2- 172.21.15.50:0/2004744647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff56c0f7730 0x7ff56c107180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-01-04T18:26:50.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.038+0000 7ff56a59c700 1 --2- 172.21.15.50:0/2004744647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff56c0f6490 0x7ff56c106c90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7ff560004e30 tx=0x7ff560009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:50.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.038+0000 7ff55affd700 1 -- 172.21.15.50:0/2004744647 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff560018070 con 0x7ff56c0f6490 2023-01-04T18:26:50.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.038+0000 7ff55affd700 1 -- 172.21.15.50:0/2004744647 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7ff560007ba0 con 0x7ff56c0f6490 2023-01-04T18:26:50.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.038+0000 7ff570afc700 1 -- 172.21.15.50:0/2004744647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56c10c300 con 0x7ff56c0f6490 2023-01-04T18:26:50.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.038+0000 7ff55affd700 1 -- 172.21.15.50:0/2004744647 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff56001c620 con 0x7ff56c0f6490 2023-01-04T18:26:50.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.039+0000 7ff570afc700 1 -- 172.21.15.50:0/2004744647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56c10c830 con 0x7ff56c0f6490 2023-01-04T18:26:50.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.039+0000 7ff570afc700 1 -- 172.21.15.50:0/2004744647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56c046330 con 0x7ff56c0f6490 2023-01-04T18:26:50.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.040+0000 7ff55affd700 1 -- 172.21.15.50:0/2004744647 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7ff560007d10 con 0x7ff56c0f6490 2023-01-04T18:26:50.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.040+0000 7ff55affd700 1 --2- 172.21.15.50:0/2004744647 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff554060be0 0x7ff5540630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:50.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.040+0000 7ff55affd700 1 -- 172.21.15.50:0/2004744647 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7ff56007db90 con 0x7ff56c0f6490 2023-01-04T18:26:50.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.040+0000 7ff569d9b700 1 --2- 172.21.15.50:0/2004744647 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff554060be0 0x7ff5540630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:50.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.041+0000 7ff569d9b700 1 --2- 172.21.15.50:0/2004744647 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff554060be0 0x7ff5540630a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7ff55c009fd0 tx=0x7ff55c00b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:50.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.045+0000 7ff55affd700 1 -- 172.21.15.50:0/2004744647 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7ff56004e120 con 0x7ff56c0f6490 2023-01-04T18:26:50.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.267+0000 7ff570afc700 1 -- 172.21.15.50:0/2004744647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7ff56c027a00 con 0x7ff56c0f6490 2023-01-04T18:26:50.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.267+0000 7ff55affd700 1 -- 172.21.15.50:0/2004744647 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v36) v1 ==== 107+0+4619 (secure 0 0 0) 0x7ff560051740 con 0x7ff56c0f6490 2023-01-04T18:26:50.270 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:50.270 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34362,"name":"cephfs.smithi050.ezoiwl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6827/336562041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":336562041},{"type":"v1","addr":"172.21.15.50:6827","nonce":336562041}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":34366,"name":"cephfs.smithi050.kefmuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6829/2188030488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2188030488},{"type":"v1","addr":"172.21.15.50:6829","nonce":2188030488}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44275,"name":"cephfs.smithi098.memais","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3576035235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3576035235},{"type":"v1","addr":"172.21.15.98:6825","nonce":3576035235}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:23:03.540144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24297":{"gid":24297,"name":"cephfs.smithi098.laynsk","rank":0,"incarnation":23,"state":"up:reconnect","state_seq":127,"addr":"172.21.15.98:6827/1785480263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1785480263},{"type":"v1","addr":"172.21.15.98:6827","nonce":1785480263}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:50.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.269+0000 7ff570afc700 1 -- 172.21.15.50:0/2004744647 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff554060be0 msgr2=0x7ff5540630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:50.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.269+0000 7ff570afc700 1 --2- 172.21.15.50:0/2004744647 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff554060be0 0x7ff5540630a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7ff55c009fd0 tx=0x7ff55c00b040).stop 2023-01-04T18:26:50.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.269+0000 7ff570afc700 1 -- 172.21.15.50:0/2004744647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff56c0f6490 msgr2=0x7ff56c106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:50.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.269+0000 7ff570afc700 1 --2- 172.21.15.50:0/2004744647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff56c0f6490 0x7ff56c106c90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7ff560004e30 tx=0x7ff560009b30).stop 2023-01-04T18:26:50.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.269+0000 7ff570afc700 1 -- 172.21.15.50:0/2004744647 shutdown_connections 2023-01-04T18:26:50.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.269+0000 7ff570afc700 1 --2- 172.21.15.50:0/2004744647 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7ff554060be0 0x7ff5540630a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:50.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.269+0000 7ff570afc700 1 --2- 172.21.15.50:0/2004744647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff56c0f6490 0x7ff56c106c90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:50.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.269+0000 7ff570afc700 1 --2- 172.21.15.50:0/2004744647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff56c0f7730 0x7ff56c107180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:50.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.270+0000 7ff570afc700 1 -- 172.21.15.50:0/2004744647 >> 172.21.15.50:0/2004744647 conn(0x7ff56c0f1bd0 msgr2=0x7ff56c0fb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:50.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.270+0000 7ff570afc700 1 -- 172.21.15.50:0/2004744647 shutdown_connections 2023-01-04T18:26:50.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.270+0000 7ff570afc700 1 -- 172.21.15.50:0/2004744647 wait complete. 2023-01-04T18:26:50.273 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2023-01-04T18:26:50.285 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2023-01-04T18:26:50.285 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2023-01-04T18:26:50.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.407+0000 7f2fe755d700 1 -- 172.21.15.50:0/1861889162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fe00f5ca0 msgr2=0x7f2fe00f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:50.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.407+0000 7f2fe755d700 1 --2- 172.21.15.50:0/1861889162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fe00f5ca0 0x7f2fe00f66d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f2fd4004660 tx=0x7f2fd4009b30).stop 2023-01-04T18:26:50.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.407+0000 7f2fe755d700 1 -- 172.21.15.50:0/1861889162 shutdown_connections 2023-01-04T18:26:50.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.407+0000 7f2fe755d700 1 --2- 172.21.15.50:0/1861889162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fe00f5ca0 0x7f2fe00f66d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:50.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.407+0000 7f2fe755d700 1 --2- 172.21.15.50:0/1861889162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fe00f5390 0x7f2fe00f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:50.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.407+0000 7f2fe755d700 1 -- 172.21.15.50:0/1861889162 >> 172.21.15.50:0/1861889162 conn(0x7f2fe00f0b70 msgr2=0x7f2fe00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:50.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.407+0000 7f2fe755d700 1 -- 172.21.15.50:0/1861889162 shutdown_connections 2023-01-04T18:26:50.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.407+0000 7f2fe755d700 1 -- 172.21.15.50:0/1861889162 wait complete. 2023-01-04T18:26:50.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.408+0000 7f2fe755d700 1 Processor -- start 2023-01-04T18:26:50.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.408+0000 7f2fe755d700 1 -- start start 2023-01-04T18:26:50.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.408+0000 7f2fe755d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fe00f5390 0x7f2fe0105b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:50.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.408+0000 7f2fe755d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fe00f5ca0 0x7f2fe0106070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:50.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.408+0000 7f2fe755d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe0106620 con 0x7f2fe00f5ca0 2023-01-04T18:26:50.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.408+0000 7f2fe755d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe0106760 con 0x7f2fe00f5390 2023-01-04T18:26:50.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.408+0000 7f2fe4af8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fe00f5ca0 0x7f2fe0106070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:50.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.408+0000 7f2fe4af8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fe00f5ca0 0x7f2fe0106070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37778/0 (socket says 172.21.15.50:37778) 2023-01-04T18:26:50.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.408+0000 7f2fe4af8700 1 -- 172.21.15.50:0/3507355716 learned_addr learned my addr 172.21.15.50:0/3507355716 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:50.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.408+0000 7f2fe52f9700 1 --2- 172.21.15.50:0/3507355716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fe00f5390 0x7f2fe0105b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:50.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.408+0000 7f2fe4af8700 1 -- 172.21.15.50:0/3507355716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fe00f5390 msgr2=0x7f2fe0105b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:50.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.408+0000 7f2fe4af8700 1 --2- 172.21.15.50:0/3507355716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fe00f5390 0x7f2fe0105b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:50.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.408+0000 7f2fe4af8700 1 -- 172.21.15.50:0/3507355716 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd4005040 con 0x7f2fe00f5ca0 2023-01-04T18:26:50.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.408+0000 7f2fe4af8700 1 --2- 172.21.15.50:0/3507355716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fe00f5ca0 0x7f2fe0106070 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f2fd4009830 tx=0x7f2fd4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:50.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.409+0000 7f2fd1ffb700 1 -- 172.21.15.50:0/3507355716 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fd4018070 con 0x7f2fe00f5ca0 2023-01-04T18:26:50.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.409+0000 7f2fd1ffb700 1 -- 172.21.15.50:0/3507355716 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f2fd4007ba0 con 0x7f2fe00f5ca0 2023-01-04T18:26:50.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.409+0000 7f2fd1ffb700 1 -- 172.21.15.50:0/3507355716 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fd401c3c0 con 0x7f2fe00f5ca0 2023-01-04T18:26:50.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.409+0000 7f2fe755d700 1 -- 172.21.15.50:0/3507355716 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe010b1a0 con 0x7f2fe00f5ca0 2023-01-04T18:26:50.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.409+0000 7f2fe755d700 1 -- 172.21.15.50:0/3507355716 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe010b760 con 0x7f2fe00f5ca0 2023-01-04T18:26:50.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.410+0000 7f2fe755d700 1 -- 172.21.15.50:0/3507355716 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe0027a00 con 0x7f2fe00f5ca0 2023-01-04T18:26:50.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.410+0000 7f2fd1ffb700 1 -- 172.21.15.50:0/3507355716 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f2fd4007d10 con 0x7f2fe00f5ca0 2023-01-04T18:26:50.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.411+0000 7f2fd1ffb700 1 --2- 172.21.15.50:0/3507355716 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2fcc060be0 0x7f2fcc0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:50.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.411+0000 7f2fd1ffb700 1 -- 172.21.15.50:0/3507355716 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f2fd407d970 con 0x7f2fe00f5ca0 2023-01-04T18:26:50.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.411+0000 7f2fe52f9700 1 --2- 172.21.15.50:0/3507355716 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2fcc060be0 0x7f2fcc0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:50.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.411+0000 7f2fe52f9700 1 --2- 172.21.15.50:0/3507355716 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2fcc060be0 0x7f2fcc0630a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f2fdc004c40 tx=0x7f2fdc00b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:50.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.415+0000 7f2fd1ffb700 1 -- 172.21.15.50:0/3507355716 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f2fd40518e0 con 0x7f2fe00f5ca0 2023-01-04T18:26:50.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:48.736716+0000 mgr.smithi050.emnywo (mgr.24517) 462 : cluster [DBG] pgmap v336: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:50.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:49.542829+0000 mon.smithi050 (mon.0) 827 : audit [DBG] from='client.? 172.21.15.50:0/2024484264' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2023-01-04T18:26:50.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:49.902274+0000 mon.smithi050 (mon.0) 828 : audit [DBG] from='client.? 172.21.15.50:0/845154656' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2023-01-04T18:26:50.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:50 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:50.267856+0000 mon.smithi050 (mon.0) 829 : audit [DBG] from='client.? 172.21.15.50:0/2004744647' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2023-01-04T18:26:50.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:48.736716+0000 mgr.smithi050.emnywo (mgr.24517) 462 : cluster [DBG] pgmap v336: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:50.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:49.542829+0000 mon.smithi050 (mon.0) 827 : audit [DBG] from='client.? 172.21.15.50:0/2024484264' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2023-01-04T18:26:50.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:49.902274+0000 mon.smithi050 (mon.0) 828 : audit [DBG] from='client.? 172.21.15.50:0/845154656' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2023-01-04T18:26:50.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:50 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:50.267856+0000 mon.smithi050 (mon.0) 829 : audit [DBG] from='client.? 172.21.15.50:0/2004744647' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2023-01-04T18:26:50.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.631+0000 7f2fe755d700 1 -- 172.21.15.50:0/3507355716 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f2fe00fdb50 con 0x7f2fe00f5ca0 2023-01-04T18:26:50.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.631+0000 7f2fd1ffb700 1 -- 172.21.15.50:0/3507355716 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v36) v1 ==== 107+0+4616 (secure 0 0 0) 0x7f2fd40514d0 con 0x7f2fe00f5ca0 2023-01-04T18:26:50.635 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:50.635 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34362,"name":"cephfs.smithi050.ezoiwl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6827/336562041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":336562041},{"type":"v1","addr":"172.21.15.50:6827","nonce":336562041}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":34366,"name":"cephfs.smithi050.kefmuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6829/2188030488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2188030488},{"type":"v1","addr":"172.21.15.50:6829","nonce":2188030488}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44275,"name":"cephfs.smithi098.memais","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3576035235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3576035235},{"type":"v1","addr":"172.21.15.98:6825","nonce":3576035235}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:23:04.545417+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24297":{"gid":24297,"name":"cephfs.smithi098.laynsk","rank":0,"incarnation":23,"state":"up:rejoin","state_seq":128,"addr":"172.21.15.98:6827/1785480263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1785480263},{"type":"v1","addr":"172.21.15.98:6827","nonce":1785480263}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:50.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.633+0000 7f2fe755d700 1 -- 172.21.15.50:0/3507355716 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2fcc060be0 msgr2=0x7f2fcc0630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:50.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.633+0000 7f2fe755d700 1 --2- 172.21.15.50:0/3507355716 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2fcc060be0 0x7f2fcc0630a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f2fdc004c40 tx=0x7f2fdc00b040).stop 2023-01-04T18:26:50.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.633+0000 7f2fe755d700 1 -- 172.21.15.50:0/3507355716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fe00f5ca0 msgr2=0x7f2fe0106070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:50.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.633+0000 7f2fe755d700 1 --2- 172.21.15.50:0/3507355716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fe00f5ca0 0x7f2fe0106070 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f2fd4009830 tx=0x7f2fd4009b30).stop 2023-01-04T18:26:50.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.633+0000 7f2fe755d700 1 -- 172.21.15.50:0/3507355716 shutdown_connections 2023-01-04T18:26:50.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.633+0000 7f2fe755d700 1 --2- 172.21.15.50:0/3507355716 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2fcc060be0 0x7f2fcc0630a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:50.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.633+0000 7f2fe755d700 1 --2- 172.21.15.50:0/3507355716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fe00f5390 0x7f2fe0105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:50.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.633+0000 7f2fe755d700 1 --2- 172.21.15.50:0/3507355716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fe00f5ca0 0x7f2fe0106070 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:50.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.633+0000 7f2fe755d700 1 -- 172.21.15.50:0/3507355716 >> 172.21.15.50:0/3507355716 conn(0x7f2fe00f0b70 msgr2=0x7f2fe00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:50.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.633+0000 7f2fe755d700 1 -- 172.21.15.50:0/3507355716 shutdown_connections 2023-01-04T18:26:50.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.633+0000 7f2fe755d700 1 -- 172.21.15.50:0/3507355716 wait complete. 2023-01-04T18:26:50.638 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 26 2023-01-04T18:26:50.649 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2023-01-04T18:26:50.649 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2023-01-04T18:26:50.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.767+0000 7f26a94e7700 1 -- 172.21.15.50:0/2761851792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a40f56a0 msgr2=0x7f26a40f5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:50.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.767+0000 7f26a94e7700 1 --2- 172.21.15.50:0/2761851792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a40f56a0 0x7f26a40f5b20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f268c004660 tx=0x7f268c009b30).stop 2023-01-04T18:26:50.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.767+0000 7f26a94e7700 1 -- 172.21.15.50:0/2761851792 shutdown_connections 2023-01-04T18:26:50.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.767+0000 7f26a94e7700 1 --2- 172.21.15.50:0/2761851792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a40f56a0 0x7f26a40f5b20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.767+0000 7f26a94e7700 1 --2- 172.21.15.50:0/2761851792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26a40f69a0 0x7f26a40f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.767+0000 7f26a94e7700 1 -- 172.21.15.50:0/2761851792 >> 172.21.15.50:0/2761851792 conn(0x7f26a40f0290 msgr2=0x7f26a40f26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.767+0000 7f26a94e7700 1 -- 172.21.15.50:0/2761851792 shutdown_connections 2023-01-04T18:26:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.767+0000 7f26a94e7700 1 -- 172.21.15.50:0/2761851792 wait complete. 2023-01-04T18:26:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.768+0000 7f26a94e7700 1 Processor -- start 2023-01-04T18:26:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.768+0000 7f26a94e7700 1 -- start start 2023-01-04T18:26:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.768+0000 7f26a94e7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26a40f56a0 0x7f26a40f9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.768+0000 7f26a94e7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a40f69a0 0x7f26a40f79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.768+0000 7f26a94e7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a40f9940 con 0x7f26a40f69a0 2023-01-04T18:26:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.768+0000 7f26a94e7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a40f7ee0 con 0x7f26a40f56a0 2023-01-04T18:26:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.768+0000 7f26a27fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a40f69a0 0x7f26a40f79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:50.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.768+0000 7f26a27fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a40f69a0 0x7f26a40f79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37806/0 (socket says 172.21.15.50:37806) 2023-01-04T18:26:50.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.768+0000 7f26a27fc700 1 -- 172.21.15.50:0/3994003134 learned_addr learned my addr 172.21.15.50:0/3994003134 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:50.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.768+0000 7f26a2ffd700 1 --2- 172.21.15.50:0/3994003134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26a40f56a0 0x7f26a40f9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:50.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.768+0000 7f26a27fc700 1 -- 172.21.15.50:0/3994003134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26a40f56a0 msgr2=0x7f26a40f9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:50.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.768+0000 7f26a27fc700 1 --2- 172.21.15.50:0/3994003134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26a40f56a0 0x7f26a40f9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:50.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.768+0000 7f26a27fc700 1 -- 172.21.15.50:0/3994003134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268c005040 con 0x7f26a40f69a0 2023-01-04T18:26:50.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.768+0000 7f26a27fc700 1 --2- 172.21.15.50:0/3994003134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a40f69a0 0x7f26a40f79f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f268c004e30 tx=0x7f268c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:50.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.769+0000 7f269b7fe700 1 -- 172.21.15.50:0/3994003134 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f268c018070 con 0x7f26a40f69a0 2023-01-04T18:26:50.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.769+0000 7f269b7fe700 1 -- 172.21.15.50:0/3994003134 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f268c007ba0 con 0x7f26a40f69a0 2023-01-04T18:26:50.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.769+0000 7f26a94e7700 1 -- 172.21.15.50:0/3994003134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a40f8100 con 0x7f26a40f69a0 2023-01-04T18:26:50.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.769+0000 7f269b7fe700 1 -- 172.21.15.50:0/3994003134 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f268c01c3c0 con 0x7f26a40f69a0 2023-01-04T18:26:50.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.769+0000 7f26a94e7700 1 -- 172.21.15.50:0/3994003134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a40f8660 con 0x7f26a40f69a0 2023-01-04T18:26:50.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.770+0000 7f26a94e7700 1 -- 172.21.15.50:0/3994003134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a4046330 con 0x7f26a40f69a0 2023-01-04T18:26:50.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.770+0000 7f269b7fe700 1 -- 172.21.15.50:0/3994003134 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f268c007d10 con 0x7f26a40f69a0 2023-01-04T18:26:50.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.770+0000 7f269b7fe700 1 --2- 172.21.15.50:0/3994003134 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2690060be0 0x7f26900630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:50.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.770+0000 7f269b7fe700 1 -- 172.21.15.50:0/3994003134 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f268c07d990 con 0x7f26a40f69a0 2023-01-04T18:26:50.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.771+0000 7f26a2ffd700 1 --2- 172.21.15.50:0/3994003134 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2690060be0 0x7f26900630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:50.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.771+0000 7f26a2ffd700 1 --2- 172.21.15.50:0/3994003134 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2690060be0 0x7f26900630a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f26a405f120 tx=0x7f269400b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:50.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.775+0000 7f269b7fe700 1 -- 172.21.15.50:0/3994003134 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f268c0518e0 con 0x7f26a40f69a0 2023-01-04T18:26:50.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.995+0000 7f26a94e7700 1 -- 172.21.15.50:0/3994003134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f26a410f400 con 0x7f26a40f69a0 2023-01-04T18:26:50.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.996+0000 7f269b7fe700 1 -- 172.21.15.50:0/3994003134 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v36) v1 ==== 107+0+4616 (secure 0 0 0) 0x7f268c0514d0 con 0x7f26a40f69a0 2023-01-04T18:26:50.999 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:51.000 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34362,"name":"cephfs.smithi050.ezoiwl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6827/336562041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":336562041},{"type":"v1","addr":"172.21.15.50:6827","nonce":336562041}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":34366,"name":"cephfs.smithi050.kefmuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6829/2188030488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2188030488},{"type":"v1","addr":"172.21.15.50:6829","nonce":2188030488}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44275,"name":"cephfs.smithi098.memais","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/3576035235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3576035235},{"type":"v1","addr":"172.21.15.98:6825","nonce":3576035235}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:23:05.550871+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24297":{"gid":24297,"name":"cephfs.smithi098.laynsk","rank":0,"incarnation":23,"state":"up:active","state_seq":129,"addr":"172.21.15.98:6827/1785480263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1785480263},{"type":"v1","addr":"172.21.15.98:6827","nonce":1785480263}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:51.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.998+0000 7f26a94e7700 1 -- 172.21.15.50:0/3994003134 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2690060be0 msgr2=0x7f26900630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:51.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.998+0000 7f26a94e7700 1 --2- 172.21.15.50:0/3994003134 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2690060be0 0x7f26900630a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f26a405f120 tx=0x7f269400b040).stop 2023-01-04T18:26:51.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.998+0000 7f26a94e7700 1 -- 172.21.15.50:0/3994003134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a40f69a0 msgr2=0x7f26a40f79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:51.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.998+0000 7f26a94e7700 1 --2- 172.21.15.50:0/3994003134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a40f69a0 0x7f26a40f79f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f268c004e30 tx=0x7f268c009b30).stop 2023-01-04T18:26:51.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.998+0000 7f26a94e7700 1 -- 172.21.15.50:0/3994003134 shutdown_connections 2023-01-04T18:26:51.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.998+0000 7f26a94e7700 1 --2- 172.21.15.50:0/3994003134 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f2690060be0 0x7f26900630a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:51.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.998+0000 7f26a94e7700 1 --2- 172.21.15.50:0/3994003134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26a40f56a0 0x7f26a40f9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:51.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.998+0000 7f26a94e7700 1 --2- 172.21.15.50:0/3994003134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26a40f69a0 0x7f26a40f79f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:51.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.998+0000 7f26a94e7700 1 -- 172.21.15.50:0/3994003134 >> 172.21.15.50:0/3994003134 conn(0x7f26a40f0290 msgr2=0x7f26a40f4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:51.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.998+0000 7f26a94e7700 1 -- 172.21.15.50:0/3994003134 shutdown_connections 2023-01-04T18:26:51.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:50.998+0000 7f26a94e7700 1 -- 172.21.15.50:0/3994003134 wait complete. 2023-01-04T18:26:51.003 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 27 2023-01-04T18:26:51.014 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2023-01-04T18:26:51.014 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2023-01-04T18:26:51.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.132+0000 7fd637f2d700 1 -- 172.21.15.50:0/584867639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6300f5ca0 msgr2=0x7fd6300f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:51.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.132+0000 7fd637f2d700 1 --2- 172.21.15.50:0/584867639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6300f5ca0 0x7fd6300f66d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fd62c004660 tx=0x7fd62c009b30).stop 2023-01-04T18:26:51.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.132+0000 7fd637f2d700 1 -- 172.21.15.50:0/584867639 shutdown_connections 2023-01-04T18:26:51.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.132+0000 7fd637f2d700 1 --2- 172.21.15.50:0/584867639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6300f5ca0 0x7fd6300f66d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:51.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.132+0000 7fd637f2d700 1 --2- 172.21.15.50:0/584867639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6300f5390 0x7fd6300f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:51.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.132+0000 7fd637f2d700 1 -- 172.21.15.50:0/584867639 >> 172.21.15.50:0/584867639 conn(0x7fd6300f0b70 msgr2=0x7fd6300f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:51.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.132+0000 7fd637f2d700 1 -- 172.21.15.50:0/584867639 shutdown_connections 2023-01-04T18:26:51.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.132+0000 7fd637f2d700 1 -- 172.21.15.50:0/584867639 wait complete. 2023-01-04T18:26:51.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.132+0000 7fd637f2d700 1 Processor -- start 2023-01-04T18:26:51.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.133+0000 7fd637f2d700 1 -- start start 2023-01-04T18:26:51.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.133+0000 7fd637f2d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6300f5390 0x7fd630105b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:51.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.133+0000 7fd637f2d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6300f5ca0 0x7fd630106070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:51.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.133+0000 7fd637f2d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd630106620 con 0x7fd6300f5ca0 2023-01-04T18:26:51.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.133+0000 7fd637f2d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd630106760 con 0x7fd6300f5390 2023-01-04T18:26:51.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.133+0000 7fd6354c8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6300f5ca0 0x7fd630106070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:51.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.133+0000 7fd6354c8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6300f5ca0 0x7fd630106070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37824/0 (socket says 172.21.15.50:37824) 2023-01-04T18:26:51.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.133+0000 7fd6354c8700 1 -- 172.21.15.50:0/2784927110 learned_addr learned my addr 172.21.15.50:0/2784927110 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:51.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.133+0000 7fd635cc9700 1 --2- 172.21.15.50:0/2784927110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6300f5390 0x7fd630105b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:51.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.133+0000 7fd6354c8700 1 -- 172.21.15.50:0/2784927110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6300f5390 msgr2=0x7fd630105b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:51.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.133+0000 7fd6354c8700 1 --2- 172.21.15.50:0/2784927110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6300f5390 0x7fd630105b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:51.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.133+0000 7fd6354c8700 1 -- 172.21.15.50:0/2784927110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c005040 con 0x7fd6300f5ca0 2023-01-04T18:26:51.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.133+0000 7fd6354c8700 1 --2- 172.21.15.50:0/2784927110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6300f5ca0 0x7fd630106070 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fd62c009830 tx=0x7fd62c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:51.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.133+0000 7fd6227fc700 1 -- 172.21.15.50:0/2784927110 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd62c018070 con 0x7fd6300f5ca0 2023-01-04T18:26:51.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.133+0000 7fd6227fc700 1 -- 172.21.15.50:0/2784927110 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fd62c007c70 con 0x7fd6300f5ca0 2023-01-04T18:26:51.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.133+0000 7fd637f2d700 1 -- 172.21.15.50:0/2784927110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63010b1a0 con 0x7fd6300f5ca0 2023-01-04T18:26:51.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.134+0000 7fd6227fc700 1 -- 172.21.15.50:0/2784927110 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd62c01c620 con 0x7fd6300f5ca0 2023-01-04T18:26:51.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.134+0000 7fd637f2d700 1 -- 172.21.15.50:0/2784927110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63010b760 con 0x7fd6300f5ca0 2023-01-04T18:26:51.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.134+0000 7fd637f2d700 1 -- 172.21.15.50:0/2784927110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd630027a00 con 0x7fd6300f5ca0 2023-01-04T18:26:51.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.135+0000 7fd6227fc700 1 -- 172.21.15.50:0/2784927110 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fd62c01d420 con 0x7fd6300f5ca0 2023-01-04T18:26:51.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.135+0000 7fd6227fc700 1 --2- 172.21.15.50:0/2784927110 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd61c060be0 0x7fd61c0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:51.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.135+0000 7fd6227fc700 1 -- 172.21.15.50:0/2784927110 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fd62c07dbc0 con 0x7fd6300f5ca0 2023-01-04T18:26:51.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.135+0000 7fd635cc9700 1 --2- 172.21.15.50:0/2784927110 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd61c060be0 0x7fd61c0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:51.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.136+0000 7fd635cc9700 1 --2- 172.21.15.50:0/2784927110 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd61c060be0 0x7fd61c0630a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fd6240041d0 tx=0x7fd624009040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:51.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.139+0000 7fd6227fc700 1 -- 172.21.15.50:0/2784927110 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fd62c051b90 con 0x7fd6300f5ca0 2023-01-04T18:26:51.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.357+0000 7fd637f2d700 1 -- 172.21.15.50:0/2784927110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7fd6300fdb50 con 0x7fd6300f5ca0 2023-01-04T18:26:51.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.357+0000 7fd6227fc700 1 -- 172.21.15.50:0/2784927110 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v36) v1 ==== 107+0+3837 (secure 0 0 0) 0x7fd62c051780 con 0x7fd6300f5ca0 2023-01-04T18:26:51.361 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:51.361 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34362,"name":"cephfs.smithi050.ezoiwl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6827/336562041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":336562041},{"type":"v1","addr":"172.21.15.50:6827","nonce":336562041}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":34366,"name":"cephfs.smithi050.kefmuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6829/2188030488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2188030488},{"type":"v1","addr":"172.21.15.50:6829","nonce":2188030488}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:23:05.550871+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24297":{"gid":24297,"name":"cephfs.smithi098.laynsk","rank":0,"incarnation":23,"state":"up:active","state_seq":129,"addr":"172.21.15.98:6827/1785480263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1785480263},{"type":"v1","addr":"172.21.15.98:6827","nonce":1785480263}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:51.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.359+0000 7fd637f2d700 1 -- 172.21.15.50:0/2784927110 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd61c060be0 msgr2=0x7fd61c0630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:51.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.359+0000 7fd637f2d700 1 --2- 172.21.15.50:0/2784927110 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd61c060be0 0x7fd61c0630a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fd6240041d0 tx=0x7fd624009040).stop 2023-01-04T18:26:51.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.359+0000 7fd637f2d700 1 -- 172.21.15.50:0/2784927110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6300f5ca0 msgr2=0x7fd630106070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:51.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.359+0000 7fd637f2d700 1 --2- 172.21.15.50:0/2784927110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6300f5ca0 0x7fd630106070 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fd62c009830 tx=0x7fd62c009b30).stop 2023-01-04T18:26:51.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.360+0000 7fd637f2d700 1 -- 172.21.15.50:0/2784927110 shutdown_connections 2023-01-04T18:26:51.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.360+0000 7fd637f2d700 1 --2- 172.21.15.50:0/2784927110 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fd61c060be0 0x7fd61c0630a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:51.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.360+0000 7fd637f2d700 1 --2- 172.21.15.50:0/2784927110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6300f5390 0x7fd630105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:51.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.360+0000 7fd637f2d700 1 --2- 172.21.15.50:0/2784927110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6300f5ca0 0x7fd630106070 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:51.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.360+0000 7fd637f2d700 1 -- 172.21.15.50:0/2784927110 >> 172.21.15.50:0/2784927110 conn(0x7fd6300f0b70 msgr2=0x7fd6300fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:51.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.360+0000 7fd637f2d700 1 -- 172.21.15.50:0/2784927110 shutdown_connections 2023-01-04T18:26:51.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.360+0000 7fd637f2d700 1 -- 172.21.15.50:0/2784927110 wait complete. 2023-01-04T18:26:51.364 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 28 2023-01-04T18:26:51.375 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2023-01-04T18:26:51.375 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2023-01-04T18:26:51.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.493+0000 7f1fcc4c3700 1 -- 172.21.15.50:0/4240803582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fc40f5ca0 msgr2=0x7f1fc40f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:51.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.493+0000 7f1fcc4c3700 1 --2- 172.21.15.50:0/4240803582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fc40f5ca0 0x7f1fc40f66d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f1fc0004660 tx=0x7f1fc0009b30).stop 2023-01-04T18:26:51.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.493+0000 7f1fcc4c3700 1 -- 172.21.15.50:0/4240803582 shutdown_connections 2023-01-04T18:26:51.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.493+0000 7f1fcc4c3700 1 --2- 172.21.15.50:0/4240803582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fc40f5ca0 0x7f1fc40f66d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:51.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.493+0000 7f1fcc4c3700 1 --2- 172.21.15.50:0/4240803582 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fc40f5390 0x7f1fc40f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.493+0000 7f1fcc4c3700 1 -- 172.21.15.50:0/4240803582 >> 172.21.15.50:0/4240803582 conn(0x7f1fc40f0b70 msgr2=0x7f1fc40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.493+0000 7f1fcc4c3700 1 -- 172.21.15.50:0/4240803582 shutdown_connections 2023-01-04T18:26:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.493+0000 7f1fcc4c3700 1 -- 172.21.15.50:0/4240803582 wait complete. 2023-01-04T18:26:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.494+0000 7f1fcc4c3700 1 Processor -- start 2023-01-04T18:26:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.494+0000 7f1fcc4c3700 1 -- start start 2023-01-04T18:26:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.494+0000 7f1fcc4c3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fc40f5390 0x7f1fc405fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.494+0000 7f1fcc4c3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fc40f5ca0 0x7f1fc410ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.494+0000 7f1fcc4c3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc410bf60 con 0x7f1fc40f5390 2023-01-04T18:26:51.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.494+0000 7f1fcc4c3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc410c0a0 con 0x7f1fc40f5ca0 2023-01-04T18:26:51.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.494+0000 7f1fca25f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fc40f5390 0x7f1fc405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:51.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.494+0000 7f1fca25f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fc40f5390 0x7f1fc405fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37848/0 (socket says 172.21.15.50:37848) 2023-01-04T18:26:51.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.494+0000 7f1fca25f700 1 -- 172.21.15.50:0/1880545308 learned_addr learned my addr 172.21.15.50:0/1880545308 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:51.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.494+0000 7f1fc9a5e700 1 --2- 172.21.15.50:0/1880545308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fc40f5ca0 0x7f1fc410ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:51.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.494+0000 7f1fca25f700 1 -- 172.21.15.50:0/1880545308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fc40f5ca0 msgr2=0x7f1fc410ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:51.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.494+0000 7f1fca25f700 1 --2- 172.21.15.50:0/1880545308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fc40f5ca0 0x7f1fc410ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:51.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.494+0000 7f1fca25f700 1 -- 172.21.15.50:0/1880545308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc0005040 con 0x7f1fc40f5390 2023-01-04T18:26:51.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.494+0000 7f1fca25f700 1 --2- 172.21.15.50:0/1880545308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fc40f5390 0x7f1fc405fcb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f1fb4002700 tx=0x7f1fb4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:51.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.495+0000 7f1fbaffd700 1 -- 172.21.15.50:0/1880545308 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fb4009320 con 0x7f1fc40f5390 2023-01-04T18:26:51.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.495+0000 7f1fbaffd700 1 -- 172.21.15.50:0/1880545308 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f1fb400f040 con 0x7f1fc40f5390 2023-01-04T18:26:51.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.495+0000 7f1fcc4c3700 1 -- 172.21.15.50:0/1880545308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc410c300 con 0x7f1fc40f5390 2023-01-04T18:26:51.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.495+0000 7f1fbaffd700 1 -- 172.21.15.50:0/1880545308 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fb4014940 con 0x7f1fc40f5390 2023-01-04T18:26:51.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.495+0000 7f1fcc4c3700 1 -- 172.21.15.50:0/1880545308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc410c8c0 con 0x7f1fc40f5390 2023-01-04T18:26:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.496+0000 7f1fcc4c3700 1 -- 172.21.15.50:0/1880545308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc4027a00 con 0x7f1fc40f5390 2023-01-04T18:26:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.496+0000 7f1fbaffd700 1 -- 172.21.15.50:0/1880545308 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f1fb40077b0 con 0x7f1fc40f5390 2023-01-04T18:26:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.496+0000 7f1fbaffd700 1 --2- 172.21.15.50:0/1880545308 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1fb0060be0 0x7f1fb00630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.497+0000 7f1fbaffd700 1 -- 172.21.15.50:0/1880545308 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f1fb407c460 con 0x7f1fc40f5390 2023-01-04T18:26:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.497+0000 7f1fc9a5e700 1 --2- 172.21.15.50:0/1880545308 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1fb0060be0 0x7f1fb00630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.497+0000 7f1fc9a5e700 1 --2- 172.21.15.50:0/1880545308 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1fb0060be0 0x7f1fb00630a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f1fc0004e30 tx=0x7f1fc0009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:51.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.501+0000 7f1fbaffd700 1 -- 172.21.15.50:0/1880545308 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f1fb40503b0 con 0x7f1fc40f5390 2023-01-04T18:26:51.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:50.632676+0000 mon.smithi050 (mon.0) 830 : audit [DBG] from='client.? 172.21.15.50:0/3507355716' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2023-01-04T18:26:51.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:51 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:50.997428+0000 mon.smithi050 (mon.0) 831 : audit [DBG] from='client.? 172.21.15.50:0/3994003134' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2023-01-04T18:26:51.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:51 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:50.632676+0000 mon.smithi050 (mon.0) 830 : audit [DBG] from='client.? 172.21.15.50:0/3507355716' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2023-01-04T18:26:51.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:51 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:50.997428+0000 mon.smithi050 (mon.0) 831 : audit [DBG] from='client.? 172.21.15.50:0/3994003134' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2023-01-04T18:26:51.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.717+0000 7f1fcc4c3700 1 -- 172.21.15.50:0/1880545308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f1fc4058710 con 0x7f1fc40f5390 2023-01-04T18:26:51.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.718+0000 7f1fbaffd700 1 -- 172.21.15.50:0/1880545308 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v36) v1 ==== 107+0+4616 (secure 0 0 0) 0x7f1fb40181b0 con 0x7f1fc40f5390 2023-01-04T18:26:51.721 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:51.722 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34362,"name":"cephfs.smithi050.ezoiwl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6827/336562041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":336562041},{"type":"v1","addr":"172.21.15.50:6827","nonce":336562041}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":34366,"name":"cephfs.smithi050.kefmuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6829/2188030488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2188030488},{"type":"v1","addr":"172.21.15.50:6829","nonce":2188030488}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44313,"name":"cephfs.smithi098.memais","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/4224872601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4224872601},{"type":"v1","addr":"172.21.15.98:6825","nonce":4224872601}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:23:05.550871+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24297":{"gid":24297,"name":"cephfs.smithi098.laynsk","rank":0,"incarnation":23,"state":"up:active","state_seq":129,"addr":"172.21.15.98:6827/1785480263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1785480263},{"type":"v1","addr":"172.21.15.98:6827","nonce":1785480263}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:51.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.720+0000 7f1fcc4c3700 1 -- 172.21.15.50:0/1880545308 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1fb0060be0 msgr2=0x7f1fb00630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:51.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.720+0000 7f1fcc4c3700 1 --2- 172.21.15.50:0/1880545308 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1fb0060be0 0x7f1fb00630a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f1fc0004e30 tx=0x7f1fc0009b30).stop 2023-01-04T18:26:51.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.720+0000 7f1fcc4c3700 1 -- 172.21.15.50:0/1880545308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fc40f5390 msgr2=0x7f1fc405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:51.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.720+0000 7f1fcc4c3700 1 --2- 172.21.15.50:0/1880545308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fc40f5390 0x7f1fc405fcb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f1fb4002700 tx=0x7f1fb4009de0).stop 2023-01-04T18:26:51.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.720+0000 7f1fcc4c3700 1 -- 172.21.15.50:0/1880545308 shutdown_connections 2023-01-04T18:26:51.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.720+0000 7f1fcc4c3700 1 --2- 172.21.15.50:0/1880545308 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f1fb0060be0 0x7f1fb00630a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:51.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.720+0000 7f1fcc4c3700 1 --2- 172.21.15.50:0/1880545308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fc40f5390 0x7f1fc405fcb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:51.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.720+0000 7f1fcc4c3700 1 --2- 172.21.15.50:0/1880545308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fc40f5ca0 0x7f1fc410ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:51.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.720+0000 7f1fcc4c3700 1 -- 172.21.15.50:0/1880545308 >> 172.21.15.50:0/1880545308 conn(0x7f1fc40f0b70 msgr2=0x7f1fc40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:51.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.720+0000 7f1fcc4c3700 1 -- 172.21.15.50:0/1880545308 shutdown_connections 2023-01-04T18:26:51.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.720+0000 7f1fcc4c3700 1 -- 172.21.15.50:0/1880545308 wait complete. 2023-01-04T18:26:51.725 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 29 2023-01-04T18:26:51.735 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2023-01-04T18:26:51.736 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2023-01-04T18:26:51.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.854+0000 7fc88b113700 1 -- 172.21.15.50:0/4166758762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8840f5ca0 msgr2=0x7fc8840f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:51.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.854+0000 7fc88b113700 1 --2- 172.21.15.50:0/4166758762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8840f5ca0 0x7fc8840f66d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fc870004660 tx=0x7fc870009b30).stop 2023-01-04T18:26:51.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.854+0000 7fc88b113700 1 -- 172.21.15.50:0/4166758762 shutdown_connections 2023-01-04T18:26:51.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.854+0000 7fc88b113700 1 --2- 172.21.15.50:0/4166758762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8840f5ca0 0x7fc8840f66d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:51.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.854+0000 7fc88b113700 1 --2- 172.21.15.50:0/4166758762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8840f5390 0x7fc8840f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:51.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.854+0000 7fc88b113700 1 -- 172.21.15.50:0/4166758762 >> 172.21.15.50:0/4166758762 conn(0x7fc8840f0b70 msgr2=0x7fc8840f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:51.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.854+0000 7fc88b113700 1 -- 172.21.15.50:0/4166758762 shutdown_connections 2023-01-04T18:26:51.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.854+0000 7fc88b113700 1 -- 172.21.15.50:0/4166758762 wait complete. 2023-01-04T18:26:51.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.854+0000 7fc88b113700 1 Processor -- start 2023-01-04T18:26:51.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.855+0000 7fc88b113700 1 -- start start 2023-01-04T18:26:51.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.855+0000 7fc88b113700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8840f5390 0x7fc88405fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:51.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.855+0000 7fc88b113700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8840f5ca0 0x7fc88410ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:51.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.855+0000 7fc88b113700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88410bf60 con 0x7fc8840f5390 2023-01-04T18:26:51.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.855+0000 7fc88b113700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88410c0a0 con 0x7fc8840f5ca0 2023-01-04T18:26:51.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.855+0000 7fc888eaf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8840f5390 0x7fc88405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:51.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.855+0000 7fc888eaf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8840f5390 0x7fc88405fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37866/0 (socket says 172.21.15.50:37866) 2023-01-04T18:26:51.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.855+0000 7fc888eaf700 1 -- 172.21.15.50:0/3919469467 learned_addr learned my addr 172.21.15.50:0/3919469467 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:51.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.855+0000 7fc883fff700 1 --2- 172.21.15.50:0/3919469467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8840f5ca0 0x7fc88410ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:51.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.855+0000 7fc888eaf700 1 -- 172.21.15.50:0/3919469467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8840f5ca0 msgr2=0x7fc88410ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:51.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.855+0000 7fc888eaf700 1 --2- 172.21.15.50:0/3919469467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8840f5ca0 0x7fc88410ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:51.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.855+0000 7fc888eaf700 1 -- 172.21.15.50:0/3919469467 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc870005040 con 0x7fc8840f5390 2023-01-04T18:26:51.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.855+0000 7fc888eaf700 1 --2- 172.21.15.50:0/3919469467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8840f5390 0x7fc88405fcb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fc878002700 tx=0x7fc878009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:51.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.856+0000 7fc8817fa700 1 -- 172.21.15.50:0/3919469467 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc878009320 con 0x7fc8840f5390 2023-01-04T18:26:51.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.856+0000 7fc88b113700 1 -- 172.21.15.50:0/3919469467 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc88410c300 con 0x7fc8840f5390 2023-01-04T18:26:51.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.856+0000 7fc8817fa700 1 -- 172.21.15.50:0/3919469467 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fc87800f040 con 0x7fc8840f5390 2023-01-04T18:26:51.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.856+0000 7fc8817fa700 1 -- 172.21.15.50:0/3919469467 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8780148a0 con 0x7fc8840f5390 2023-01-04T18:26:51.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.856+0000 7fc88b113700 1 -- 172.21.15.50:0/3919469467 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc88410c8c0 con 0x7fc8840f5390 2023-01-04T18:26:51.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.857+0000 7fc88b113700 1 -- 172.21.15.50:0/3919469467 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc884027a00 con 0x7fc8840f5390 2023-01-04T18:26:51.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.857+0000 7fc8817fa700 1 -- 172.21.15.50:0/3919469467 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fc87801e440 con 0x7fc8840f5390 2023-01-04T18:26:51.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.858+0000 7fc8817fa700 1 --2- 172.21.15.50:0/3919469467 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc874060be0 0x7fc8740630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:51.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.858+0000 7fc8817fa700 1 -- 172.21.15.50:0/3919469467 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fc87807c350 con 0x7fc8840f5390 2023-01-04T18:26:51.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.858+0000 7fc883fff700 1 --2- 172.21.15.50:0/3919469467 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc874060be0 0x7fc8740630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:51.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.858+0000 7fc883fff700 1 --2- 172.21.15.50:0/3919469467 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc874060be0 0x7fc8740630a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fc870004630 tx=0x7fc870009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:51.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:51.862+0000 7fc8817fa700 1 -- 172.21.15.50:0/3919469467 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fc8780502a0 con 0x7fc8840f5390 2023-01-04T18:26:52.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.075+0000 7fc88b113700 1 -- 172.21.15.50:0/3919469467 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fc8840fdb50 con 0x7fc8840f5390 2023-01-04T18:26:52.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.076+0000 7fc8817fa700 1 -- 172.21.15.50:0/3919469467 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v36) v1 ==== 107+0+3824 (secure 0 0 0) 0x7fc87804fe90 con 0x7fc8840f5390 2023-01-04T18:26:52.079 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:52.080 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34362,"name":"cephfs.smithi050.ezoiwl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6827/336562041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":336562041},{"type":"v1","addr":"172.21.15.50:6827","nonce":336562041}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":34366,"name":"cephfs.smithi050.kefmuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6829/2188030488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2188030488},{"type":"v1","addr":"172.21.15.50:6829","nonce":2188030488}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44313,"name":"cephfs.smithi098.memais","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/4224872601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4224872601},{"type":"v1","addr":"172.21.15.98:6825","nonce":4224872601}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:23:29.618254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:52.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.077+0000 7fc88b113700 1 -- 172.21.15.50:0/3919469467 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc874060be0 msgr2=0x7fc8740630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:52.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.077+0000 7fc88b113700 1 --2- 172.21.15.50:0/3919469467 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc874060be0 0x7fc8740630a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fc870004630 tx=0x7fc870009b30).stop 2023-01-04T18:26:52.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.077+0000 7fc88b113700 1 -- 172.21.15.50:0/3919469467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8840f5390 msgr2=0x7fc88405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:52.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.077+0000 7fc88b113700 1 --2- 172.21.15.50:0/3919469467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8840f5390 0x7fc88405fcb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fc878002700 tx=0x7fc878009de0).stop 2023-01-04T18:26:52.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.077+0000 7fc88b113700 1 -- 172.21.15.50:0/3919469467 shutdown_connections 2023-01-04T18:26:52.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.077+0000 7fc88b113700 1 --2- 172.21.15.50:0/3919469467 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fc874060be0 0x7fc8740630a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:52.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.077+0000 7fc88b113700 1 --2- 172.21.15.50:0/3919469467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8840f5390 0x7fc88405fcb0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:52.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.077+0000 7fc88b113700 1 --2- 172.21.15.50:0/3919469467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8840f5ca0 0x7fc88410ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:52.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.077+0000 7fc88b113700 1 -- 172.21.15.50:0/3919469467 >> 172.21.15.50:0/3919469467 conn(0x7fc8840f0b70 msgr2=0x7fc8840fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:52.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.078+0000 7fc88b113700 1 -- 172.21.15.50:0/3919469467 shutdown_connections 2023-01-04T18:26:52.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.078+0000 7fc88b113700 1 -- 172.21.15.50:0/3919469467 wait complete. 2023-01-04T18:26:52.084 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 30 2023-01-04T18:26:52.093 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2023-01-04T18:26:52.093 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2023-01-04T18:26:52.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.211+0000 7fa232e23700 1 -- 172.21.15.50:0/282727766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa22c0f5390 msgr2=0x7fa22c0f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:52.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.211+0000 7fa232e23700 1 --2- 172.21.15.50:0/282727766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa22c0f5390 0x7fa22c0f57b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fa220004660 tx=0x7fa220009b30).stop 2023-01-04T18:26:52.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.211+0000 7fa232e23700 1 -- 172.21.15.50:0/282727766 shutdown_connections 2023-01-04T18:26:52.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.211+0000 7fa232e23700 1 --2- 172.21.15.50:0/282727766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa22c0f5ca0 0x7fa22c0f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:52.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.211+0000 7fa232e23700 1 --2- 172.21.15.50:0/282727766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa22c0f5390 0x7fa22c0f57b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:52.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.211+0000 7fa232e23700 1 -- 172.21.15.50:0/282727766 >> 172.21.15.50:0/282727766 conn(0x7fa22c0f0b70 msgr2=0x7fa22c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:52.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.211+0000 7fa232e23700 1 -- 172.21.15.50:0/282727766 shutdown_connections 2023-01-04T18:26:52.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.211+0000 7fa232e23700 1 -- 172.21.15.50:0/282727766 wait complete. 2023-01-04T18:26:52.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.212+0000 7fa232e23700 1 Processor -- start 2023-01-04T18:26:52.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.212+0000 7fa232e23700 1 -- start start 2023-01-04T18:26:52.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.212+0000 7fa232e23700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa22c0f5390 0x7fa22c05fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:52.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.212+0000 7fa232e23700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa22c0f5ca0 0x7fa22c10ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:52.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.212+0000 7fa232e23700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c10bef0 con 0x7fa22c0f5390 2023-01-04T18:26:52.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.212+0000 7fa232e23700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c10c030 con 0x7fa22c0f5ca0 2023-01-04T18:26:52.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.212+0000 7fa230bbf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa22c0f5390 0x7fa22c05fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:52.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.212+0000 7fa230bbf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa22c0f5390 0x7fa22c05fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37892/0 (socket says 172.21.15.50:37892) 2023-01-04T18:26:52.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.212+0000 7fa230bbf700 1 -- 172.21.15.50:0/2026978363 learned_addr learned my addr 172.21.15.50:0/2026978363 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:52.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.212+0000 7fa22bfff700 1 --2- 172.21.15.50:0/2026978363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa22c0f5ca0 0x7fa22c10ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:52.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.213+0000 7fa230bbf700 1 -- 172.21.15.50:0/2026978363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa22c0f5ca0 msgr2=0x7fa22c10ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:52.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.213+0000 7fa230bbf700 1 --2- 172.21.15.50:0/2026978363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa22c0f5ca0 0x7fa22c10ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:52.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.213+0000 7fa230bbf700 1 -- 172.21.15.50:0/2026978363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa220005040 con 0x7fa22c0f5390 2023-01-04T18:26:52.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.213+0000 7fa230bbf700 1 --2- 172.21.15.50:0/2026978363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa22c0f5390 0x7fa22c05fcf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fa220009990 tx=0x7fa220009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:52.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.213+0000 7fa2297fa700 1 -- 172.21.15.50:0/2026978363 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa220018070 con 0x7fa22c0f5390 2023-01-04T18:26:52.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.213+0000 7fa232e23700 1 -- 172.21.15.50:0/2026978363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22c10c260 con 0x7fa22c0f5390 2023-01-04T18:26:52.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.213+0000 7fa2297fa700 1 -- 172.21.15.50:0/2026978363 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fa2200097d0 con 0x7fa22c0f5390 2023-01-04T18:26:52.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.213+0000 7fa2297fa700 1 -- 172.21.15.50:0/2026978363 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa22001c3c0 con 0x7fa22c0f5390 2023-01-04T18:26:52.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.213+0000 7fa232e23700 1 -- 172.21.15.50:0/2026978363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22c10c7c0 con 0x7fa22c0f5390 2023-01-04T18:26:52.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.214+0000 7fa232e23700 1 -- 172.21.15.50:0/2026978363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa22c027a00 con 0x7fa22c0f5390 2023-01-04T18:26:52.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.215+0000 7fa2297fa700 1 -- 172.21.15.50:0/2026978363 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fa22001d420 con 0x7fa22c0f5390 2023-01-04T18:26:52.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.215+0000 7fa2297fa700 1 --2- 172.21.15.50:0/2026978363 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa21c060be0 0x7fa21c0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:52.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.215+0000 7fa2297fa700 1 -- 172.21.15.50:0/2026978363 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fa22007dcc0 con 0x7fa22c0f5390 2023-01-04T18:26:52.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.215+0000 7fa22bfff700 1 --2- 172.21.15.50:0/2026978363 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa21c060be0 0x7fa21c0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:52.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.216+0000 7fa22bfff700 1 --2- 172.21.15.50:0/2026978363 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa21c060be0 0x7fa21c0630a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fa218004c40 tx=0x7fa21800b040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:52.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.219+0000 7fa2297fa700 1 -- 172.21.15.50:0/2026978363 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fa220051c30 con 0x7fa22c0f5390 2023-01-04T18:26:52.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.437+0000 7fa232e23700 1 -- 172.21.15.50:0/2026978363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7fa22c0fdb50 con 0x7fa22c0f5390 2023-01-04T18:26:52.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.438+0000 7fa2297fa700 1 -- 172.21.15.50:0/2026978363 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v36) v1 ==== 107+0+3835 (secure 0 0 0) 0x7fa220051820 con 0x7fa22c0f5390 2023-01-04T18:26:52.443 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:52.443 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34366,"name":"cephfs.smithi050.kefmuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6829/2188030488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2188030488},{"type":"v1","addr":"172.21.15.50:6829","nonce":2188030488}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44313,"name":"cephfs.smithi098.memais","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/4224872601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4224872601},{"type":"v1","addr":"172.21.15.98:6825","nonce":4224872601}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:23:29.624414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34362":{"gid":34362,"name":"cephfs.smithi050.ezoiwl","rank":0,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.50:6827/336562041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":336562041},{"type":"v1","addr":"172.21.15.50:6827","nonce":336562041}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:52.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.439+0000 7fa232e23700 1 -- 172.21.15.50:0/2026978363 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa21c060be0 msgr2=0x7fa21c0630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:52.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.439+0000 7fa232e23700 1 --2- 172.21.15.50:0/2026978363 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa21c060be0 0x7fa21c0630a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fa218004c40 tx=0x7fa21800b040).stop 2023-01-04T18:26:52.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.439+0000 7fa232e23700 1 -- 172.21.15.50:0/2026978363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa22c0f5390 msgr2=0x7fa22c05fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:52.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.439+0000 7fa232e23700 1 --2- 172.21.15.50:0/2026978363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa22c0f5390 0x7fa22c05fcf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fa220009990 tx=0x7fa220009b30).stop 2023-01-04T18:26:52.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.439+0000 7fa232e23700 1 -- 172.21.15.50:0/2026978363 shutdown_connections 2023-01-04T18:26:52.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.439+0000 7fa232e23700 1 --2- 172.21.15.50:0/2026978363 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fa21c060be0 0x7fa21c0630a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:52.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.439+0000 7fa232e23700 1 --2- 172.21.15.50:0/2026978363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa22c0f5390 0x7fa22c05fcf0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:52.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.439+0000 7fa232e23700 1 --2- 172.21.15.50:0/2026978363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa22c0f5ca0 0x7fa22c10ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:52.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.439+0000 7fa232e23700 1 -- 172.21.15.50:0/2026978363 >> 172.21.15.50:0/2026978363 conn(0x7fa22c0f0b70 msgr2=0x7fa22c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:52.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.439+0000 7fa232e23700 1 -- 172.21.15.50:0/2026978363 shutdown_connections 2023-01-04T18:26:52.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.439+0000 7fa232e23700 1 -- 172.21.15.50:0/2026978363 wait complete. 2023-01-04T18:26:52.447 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 31 2023-01-04T18:26:52.459 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:50.737125+0000 mgr.smithi050.emnywo (mgr.24517) 463 : cluster [DBG] pgmap v337: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:26:52.459 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:51.358938+0000 mon.smithi050 (mon.0) 832 : audit [DBG] from='client.? 172.21.15.50:0/2784927110' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2023-01-04T18:26:52.459 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:51.719344+0000 mon.smithi050 (mon.0) 833 : audit [DBG] from='client.? 172.21.15.50:0/1880545308' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2023-01-04T18:26:52.459 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:52 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:52.077041+0000 mon.smithi050 (mon.0) 834 : audit [DBG] from='client.? 172.21.15.50:0/3919469467' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2023-01-04T18:26:52.461 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2023-01-04T18:26:52.463 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2023-01-04T18:26:52.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:50.737125+0000 mgr.smithi050.emnywo (mgr.24517) 463 : cluster [DBG] pgmap v337: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-01-04T18:26:52.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:51.358938+0000 mon.smithi050 (mon.0) 832 : audit [DBG] from='client.? 172.21.15.50:0/2784927110' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2023-01-04T18:26:52.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:51.719344+0000 mon.smithi050 (mon.0) 833 : audit [DBG] from='client.? 172.21.15.50:0/1880545308' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2023-01-04T18:26:52.582 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:52 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:52.077041+0000 mon.smithi050 (mon.0) 834 : audit [DBG] from='client.? 172.21.15.50:0/3919469467' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2023-01-04T18:26:52.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.582+0000 7fbe83c6f700 1 -- 172.21.15.50:0/310736366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe7c0f5390 msgr2=0x7fbe7c0f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:52.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.582+0000 7fbe83c6f700 1 --2- 172.21.15.50:0/310736366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe7c0f5390 0x7fbe7c0f57b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fbe78004660 tx=0x7fbe78009b30).stop 2023-01-04T18:26:52.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.582+0000 7fbe83c6f700 1 -- 172.21.15.50:0/310736366 shutdown_connections 2023-01-04T18:26:52.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.582+0000 7fbe83c6f700 1 --2- 172.21.15.50:0/310736366 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe7c0f5ca0 0x7fbe7c0f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:52.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.582+0000 7fbe83c6f700 1 --2- 172.21.15.50:0/310736366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe7c0f5390 0x7fbe7c0f57b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:52.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.582+0000 7fbe83c6f700 1 -- 172.21.15.50:0/310736366 >> 172.21.15.50:0/310736366 conn(0x7fbe7c0f0b70 msgr2=0x7fbe7c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:52.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.583+0000 7fbe83c6f700 1 -- 172.21.15.50:0/310736366 shutdown_connections 2023-01-04T18:26:52.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.583+0000 7fbe83c6f700 1 -- 172.21.15.50:0/310736366 wait complete. 2023-01-04T18:26:52.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.583+0000 7fbe83c6f700 1 Processor -- start 2023-01-04T18:26:52.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.583+0000 7fbe83c6f700 1 -- start start 2023-01-04T18:26:52.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.583+0000 7fbe83c6f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe7c0f5390 0x7fbe7c05fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:52.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.583+0000 7fbe83c6f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe7c0f5ca0 0x7fbe7c10b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:52.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.583+0000 7fbe83c6f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c10bec0 con 0x7fbe7c0f5390 2023-01-04T18:26:52.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.583+0000 7fbe83c6f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c10c000 con 0x7fbe7c0f5ca0 2023-01-04T18:26:52.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.583+0000 7fbe81a0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe7c0f5390 0x7fbe7c05fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:52.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.583+0000 7fbe81a0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe7c0f5390 0x7fbe7c05fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37912/0 (socket says 172.21.15.50:37912) 2023-01-04T18:26:52.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.583+0000 7fbe81a0b700 1 -- 172.21.15.50:0/2991639177 learned_addr learned my addr 172.21.15.50:0/2991639177 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:52.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.583+0000 7fbe8120a700 1 --2- 172.21.15.50:0/2991639177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe7c0f5ca0 0x7fbe7c10b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:52.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.584+0000 7fbe81a0b700 1 -- 172.21.15.50:0/2991639177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe7c0f5ca0 msgr2=0x7fbe7c10b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:52.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.584+0000 7fbe81a0b700 1 --2- 172.21.15.50:0/2991639177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe7c0f5ca0 0x7fbe7c10b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:52.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.584+0000 7fbe81a0b700 1 -- 172.21.15.50:0/2991639177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe78005040 con 0x7fbe7c0f5390 2023-01-04T18:26:52.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.584+0000 7fbe81a0b700 1 --2- 172.21.15.50:0/2991639177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe7c0f5390 0x7fbe7c05fc90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fbe78009830 tx=0x7fbe78009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:52.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.584+0000 7fbe727fc700 1 -- 172.21.15.50:0/2991639177 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe78018070 con 0x7fbe7c0f5390 2023-01-04T18:26:52.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.584+0000 7fbe83c6f700 1 -- 172.21.15.50:0/2991639177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7c10c200 con 0x7fbe7c0f5390 2023-01-04T18:26:52.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.584+0000 7fbe727fc700 1 -- 172.21.15.50:0/2991639177 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fbe78007ba0 con 0x7fbe7c0f5390 2023-01-04T18:26:52.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.584+0000 7fbe727fc700 1 -- 172.21.15.50:0/2991639177 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe7801c620 con 0x7fbe7c0f5390 2023-01-04T18:26:52.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.584+0000 7fbe83c6f700 1 -- 172.21.15.50:0/2991639177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7c10c730 con 0x7fbe7c0f5390 2023-01-04T18:26:52.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.585+0000 7fbe83c6f700 1 -- 172.21.15.50:0/2991639177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe7c027a00 con 0x7fbe7c0f5390 2023-01-04T18:26:52.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.585+0000 7fbe727fc700 1 -- 172.21.15.50:0/2991639177 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7fbe7801d420 con 0x7fbe7c0f5390 2023-01-04T18:26:52.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.586+0000 7fbe727fc700 1 --2- 172.21.15.50:0/2991639177 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fbe68060be0 0x7fbe680630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:52.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.586+0000 7fbe727fc700 1 -- 172.21.15.50:0/2991639177 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fbe7807dc40 con 0x7fbe7c0f5390 2023-01-04T18:26:52.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.586+0000 7fbe8120a700 1 --2- 172.21.15.50:0/2991639177 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fbe68060be0 0x7fbe680630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:52.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.586+0000 7fbe8120a700 1 --2- 172.21.15.50:0/2991639177 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fbe68060be0 0x7fbe680630a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fbe6c009740 tx=0x7fbe6c009c60).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:52.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.590+0000 7fbe727fc700 1 -- 172.21.15.50:0/2991639177 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7fbe78051b90 con 0x7fbe7c0f5390 2023-01-04T18:26:52.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.804+0000 7fbe83c6f700 1 -- 172.21.15.50:0/2991639177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7fbe7c058710 con 0x7fbe7c0f5390 2023-01-04T18:26:52.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.805+0000 7fbe727fc700 1 -- 172.21.15.50:0/2991639177 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v36) v1 ==== 107+0+4611 (secure 0 0 0) 0x7fbe78051780 con 0x7fbe7c0f5390 2023-01-04T18:26:52.809 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:52.809 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34366,"name":"cephfs.smithi050.kefmuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6829/2188030488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2188030488},{"type":"v1","addr":"172.21.15.50:6829","nonce":2188030488}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44313,"name":"cephfs.smithi098.memais","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/4224872601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4224872601},{"type":"v1","addr":"172.21.15.98:6825","nonce":4224872601}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":44317,"name":"cephfs.smithi098.laynsk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6827/503298078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":503298078},{"type":"v1","addr":"172.21.15.98:6827","nonce":503298078}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:23:29.624414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34362":{"gid":34362,"name":"cephfs.smithi050.ezoiwl","rank":0,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.50:6827/336562041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":336562041},{"type":"v1","addr":"172.21.15.50:6827","nonce":336562041}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:52.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.807+0000 7fbe83c6f700 1 -- 172.21.15.50:0/2991639177 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fbe68060be0 msgr2=0x7fbe680630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:52.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.807+0000 7fbe83c6f700 1 --2- 172.21.15.50:0/2991639177 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fbe68060be0 0x7fbe680630a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fbe6c009740 tx=0x7fbe6c009c60).stop 2023-01-04T18:26:52.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.807+0000 7fbe83c6f700 1 -- 172.21.15.50:0/2991639177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe7c0f5390 msgr2=0x7fbe7c05fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:52.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.807+0000 7fbe83c6f700 1 --2- 172.21.15.50:0/2991639177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe7c0f5390 0x7fbe7c05fc90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fbe78009830 tx=0x7fbe78009b30).stop 2023-01-04T18:26:52.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.807+0000 7fbe83c6f700 1 -- 172.21.15.50:0/2991639177 shutdown_connections 2023-01-04T18:26:52.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.807+0000 7fbe83c6f700 1 --2- 172.21.15.50:0/2991639177 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7fbe68060be0 0x7fbe680630a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:52.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.807+0000 7fbe83c6f700 1 --2- 172.21.15.50:0/2991639177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe7c0f5390 0x7fbe7c05fc90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:52.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.807+0000 7fbe83c6f700 1 --2- 172.21.15.50:0/2991639177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe7c0f5ca0 0x7fbe7c10b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:52.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.807+0000 7fbe83c6f700 1 -- 172.21.15.50:0/2991639177 >> 172.21.15.50:0/2991639177 conn(0x7fbe7c0f0b70 msgr2=0x7fbe7c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:52.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.807+0000 7fbe83c6f700 1 -- 172.21.15.50:0/2991639177 shutdown_connections 2023-01-04T18:26:52.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.807+0000 7fbe83c6f700 1 -- 172.21.15.50:0/2991639177 wait complete. 2023-01-04T18:26:52.812 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 32 2023-01-04T18:26:52.823 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2023-01-04T18:26:52.823 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2023-01-04T18:26:52.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.986+0000 7f7a1ebc6700 1 -- 172.21.15.50:0/3207366672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a180f5190 msgr2=0x7f7a180f7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:52.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.986+0000 7f7a1ebc6700 1 --2- 172.21.15.50:0/3207366672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a180f5190 0x7f7a180f7ad0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f7a04004660 tx=0x7f7a04009b30).stop 2023-01-04T18:26:52.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.986+0000 7f7a1ebc6700 1 -- 172.21.15.50:0/3207366672 shutdown_connections 2023-01-04T18:26:52.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.986+0000 7f7a1ebc6700 1 --2- 172.21.15.50:0/3207366672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a180f5190 0x7f7a180f7ad0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:52.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.986+0000 7f7a1ebc6700 1 --2- 172.21.15.50:0/3207366672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7a180f47f0 0x7f7a180f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:52.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.986+0000 7f7a1ebc6700 1 -- 172.21.15.50:0/3207366672 >> 172.21.15.50:0/3207366672 conn(0x7f7a180f0250 msgr2=0x7f7a180f2690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:52.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.986+0000 7f7a1ebc6700 1 -- 172.21.15.50:0/3207366672 shutdown_connections 2023-01-04T18:26:52.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.986+0000 7f7a1ebc6700 1 -- 172.21.15.50:0/3207366672 wait complete. 2023-01-04T18:26:52.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.987+0000 7f7a1ebc6700 1 Processor -- start 2023-01-04T18:26:52.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.987+0000 7f7a1ebc6700 1 -- start start 2023-01-04T18:26:52.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.987+0000 7f7a1ebc6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7a180f47f0 0x7f7a18106ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:52.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.987+0000 7f7a1ebc6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a180f5190 0x7f7a18107390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:52.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.987+0000 7f7a1ebc6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a18107940 con 0x7f7a180f5190 2023-01-04T18:26:52.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.987+0000 7f7a1ebc6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a18107a80 con 0x7f7a180f47f0 2023-01-04T18:26:52.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.987+0000 7f7a17fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a180f5190 0x7f7a18107390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:52.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.987+0000 7f7a17fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a180f5190 0x7f7a18107390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37930/0 (socket says 172.21.15.50:37930) 2023-01-04T18:26:52.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.987+0000 7f7a17fff700 1 -- 172.21.15.50:0/3230859733 learned_addr learned my addr 172.21.15.50:0/3230859733 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:52.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.987+0000 7f7a1c962700 1 --2- 172.21.15.50:0/3230859733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7a180f47f0 0x7f7a18106ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:52.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.987+0000 7f7a17fff700 1 -- 172.21.15.50:0/3230859733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7a180f47f0 msgr2=0x7f7a18106ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:52.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.987+0000 7f7a17fff700 1 --2- 172.21.15.50:0/3230859733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7a180f47f0 0x7f7a18106ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:52.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.987+0000 7f7a17fff700 1 -- 172.21.15.50:0/3230859733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a04005040 con 0x7f7a180f5190 2023-01-04T18:26:52.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.987+0000 7f7a1c962700 1 --2- 172.21.15.50:0/3230859733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7a180f47f0 0x7f7a18106ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-01-04T18:26:52.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.988+0000 7f7a17fff700 1 --2- 172.21.15.50:0/3230859733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a180f5190 0x7f7a18107390 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f7a04009f50 tx=0x7f7a04009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:52.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.988+0000 7f7a157fa700 1 -- 172.21.15.50:0/3230859733 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a04018070 con 0x7f7a180f5190 2023-01-04T18:26:52.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.988+0000 7f7a1ebc6700 1 -- 172.21.15.50:0/3230859733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1810c4c0 con 0x7f7a180f5190 2023-01-04T18:26:52.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.988+0000 7f7a157fa700 1 -- 172.21.15.50:0/3230859733 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f7a04007d70 con 0x7f7a180f5190 2023-01-04T18:26:52.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.988+0000 7f7a157fa700 1 -- 172.21.15.50:0/3230859733 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a0401c620 con 0x7f7a180f5190 2023-01-04T18:26:52.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.988+0000 7f7a1ebc6700 1 -- 172.21.15.50:0/3230859733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1810ca80 con 0x7f7a180f5190 2023-01-04T18:26:52.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.989+0000 7f7a1ebc6700 1 -- 172.21.15.50:0/3230859733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1805e6c0 con 0x7f7a180f5190 2023-01-04T18:26:52.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.989+0000 7f7a157fa700 1 -- 172.21.15.50:0/3230859733 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f7a0401c890 con 0x7f7a180f5190 2023-01-04T18:26:52.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.990+0000 7f7a157fa700 1 --2- 172.21.15.50:0/3230859733 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7a08060be0 0x7f7a080630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:52.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.990+0000 7f7a157fa700 1 -- 172.21.15.50:0/3230859733 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f7a0407dcc0 con 0x7f7a180f5190 2023-01-04T18:26:52.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.990+0000 7f7a1c962700 1 --2- 172.21.15.50:0/3230859733 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7a08060be0 0x7f7a080630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:52.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.990+0000 7f7a1c962700 1 --2- 172.21.15.50:0/3230859733 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7a08060be0 0x7f7a080630a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f7a0c0041d0 tx=0x7f7a0c009040).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:52.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:52.994+0000 7f7a157fa700 1 -- 172.21.15.50:0/3230859733 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f7a04083020 con 0x7f7a180f5190 2023-01-04T18:26:53.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.207+0000 7f7a1ebc6700 1 -- 172.21.15.50:0/3230859733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f7a18027a00 con 0x7f7a180f5190 2023-01-04T18:26:53.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.207+0000 7f7a157fa700 1 -- 172.21.15.50:0/3230859733 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v36) v1 ==== 107+0+4615 (secure 0 0 0) 0x7f7a04051b50 con 0x7f7a180f5190 2023-01-04T18:26:53.211 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:53.211 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34366,"name":"cephfs.smithi050.kefmuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6829/2188030488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2188030488},{"type":"v1","addr":"172.21.15.50:6829","nonce":2188030488}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44313,"name":"cephfs.smithi098.memais","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/4224872601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4224872601},{"type":"v1","addr":"172.21.15.98:6825","nonce":4224872601}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":44317,"name":"cephfs.smithi098.laynsk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6827/503298078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":503298078},{"type":"v1","addr":"172.21.15.98:6827","nonce":503298078}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:23:39.414295+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34362":{"gid":34362,"name":"cephfs.smithi050.ezoiwl","rank":0,"incarnation":31,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.50:6827/336562041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":336562041},{"type":"v1","addr":"172.21.15.50:6827","nonce":336562041}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:53.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.209+0000 7f7a1ebc6700 1 -- 172.21.15.50:0/3230859733 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7a08060be0 msgr2=0x7f7a080630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:53.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.209+0000 7f7a1ebc6700 1 --2- 172.21.15.50:0/3230859733 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7a08060be0 0x7f7a080630a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f7a0c0041d0 tx=0x7f7a0c009040).stop 2023-01-04T18:26:53.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.209+0000 7f7a1ebc6700 1 -- 172.21.15.50:0/3230859733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a180f5190 msgr2=0x7f7a18107390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:53.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.209+0000 7f7a1ebc6700 1 --2- 172.21.15.50:0/3230859733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a180f5190 0x7f7a18107390 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f7a04009f50 tx=0x7f7a04009b30).stop 2023-01-04T18:26:53.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.209+0000 7f7a1ebc6700 1 -- 172.21.15.50:0/3230859733 shutdown_connections 2023-01-04T18:26:53.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.209+0000 7f7a1ebc6700 1 --2- 172.21.15.50:0/3230859733 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f7a08060be0 0x7f7a080630a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:53.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.209+0000 7f7a1ebc6700 1 --2- 172.21.15.50:0/3230859733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7a180f47f0 0x7f7a18106ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:53.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.209+0000 7f7a1ebc6700 1 --2- 172.21.15.50:0/3230859733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a180f5190 0x7f7a18107390 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:53.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.209+0000 7f7a1ebc6700 1 -- 172.21.15.50:0/3230859733 >> 172.21.15.50:0/3230859733 conn(0x7f7a180f0250 msgr2=0x7f7a180fb520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:53.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.210+0000 7f7a1ebc6700 1 -- 172.21.15.50:0/3230859733 shutdown_connections 2023-01-04T18:26:53.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.210+0000 7f7a1ebc6700 1 -- 172.21.15.50:0/3230859733 wait complete. 2023-01-04T18:26:53.214 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 33 2023-01-04T18:26:53.225 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2023-01-04T18:26:53.225 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2023-01-04T18:26:53.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.343+0000 7f5cb00b1700 1 -- 172.21.15.50:0/1271730160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ca80f7780 msgr2=0x7f5ca80f7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:53.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.343+0000 7f5cb00b1700 1 --2- 172.21.15.50:0/1271730160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ca80f7780 0x7f5ca80f7be0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f5ca4004660 tx=0x7f5ca4009b30).stop 2023-01-04T18:26:53.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.343+0000 7f5cb00b1700 1 -- 172.21.15.50:0/1271730160 shutdown_connections 2023-01-04T18:26:53.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.343+0000 7f5cb00b1700 1 --2- 172.21.15.50:0/1271730160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ca80f7780 0x7f5ca80f7be0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:53.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.343+0000 7f5cb00b1700 1 --2- 172.21.15.50:0/1271730160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ca80f64e0 0x7f5ca80f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.343+0000 7f5cb00b1700 1 -- 172.21.15.50:0/1271730160 >> 172.21.15.50:0/1271730160 conn(0x7f5ca80f1c40 msgr2=0x7f5ca80f4060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.343+0000 7f5cb00b1700 1 -- 172.21.15.50:0/1271730160 shutdown_connections 2023-01-04T18:26:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.343+0000 7f5cb00b1700 1 -- 172.21.15.50:0/1271730160 wait complete. 2023-01-04T18:26:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.343+0000 7f5cb00b1700 1 Processor -- start 2023-01-04T18:26:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.343+0000 7f5cb00b1700 1 -- start start 2023-01-04T18:26:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.344+0000 7f5cb00b1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ca80f64e0 0x7f5ca8106c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.344+0000 7f5cb00b1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ca80f7780 0x7f5ca8107170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.344+0000 7f5cb00b1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca8107770 con 0x7f5ca80f64e0 2023-01-04T18:26:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.344+0000 7f5cb00b1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca81078e0 con 0x7f5ca80f7780 2023-01-04T18:26:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.344+0000 7f5cade4d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ca80f64e0 0x7f5ca8106c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.344+0000 7f5cade4d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ca80f64e0 0x7f5ca8106c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37956/0 (socket says 172.21.15.50:37956) 2023-01-04T18:26:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.344+0000 7f5cade4d700 1 -- 172.21.15.50:0/1580307321 learned_addr learned my addr 172.21.15.50:0/1580307321 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.344+0000 7f5cad64c700 1 --2- 172.21.15.50:0/1580307321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ca80f7780 0x7f5ca8107170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.344+0000 7f5cade4d700 1 -- 172.21.15.50:0/1580307321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ca80f7780 msgr2=0x7f5ca8107170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.344+0000 7f5cade4d700 1 --2- 172.21.15.50:0/1580307321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ca80f7780 0x7f5ca8107170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.344+0000 7f5cade4d700 1 -- 172.21.15.50:0/1580307321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca4005040 con 0x7f5ca80f64e0 2023-01-04T18:26:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.344+0000 7f5cade4d700 1 --2- 172.21.15.50:0/1580307321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ca80f64e0 0x7f5ca8106c80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f5c9800c530 tx=0x7f5c98007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.344+0000 7f5c9e7fc700 1 -- 172.21.15.50:0/1580307321 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c9800f650 con 0x7f5ca80f64e0 2023-01-04T18:26:53.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.344+0000 7f5c9e7fc700 1 -- 172.21.15.50:0/1580307321 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f5c9800fc80 con 0x7f5ca80f64e0 2023-01-04T18:26:53.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.344+0000 7f5cb00b1700 1 -- 172.21.15.50:0/1580307321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca810c350 con 0x7f5ca80f64e0 2023-01-04T18:26:53.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.344+0000 7f5c9e7fc700 1 -- 172.21.15.50:0/1580307321 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c98012e00 con 0x7f5ca80f64e0 2023-01-04T18:26:53.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.344+0000 7f5cb00b1700 1 -- 172.21.15.50:0/1580307321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca810c8e0 con 0x7f5ca80f64e0 2023-01-04T18:26:53.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.345+0000 7f5cb00b1700 1 -- 172.21.15.50:0/1580307321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca8046330 con 0x7f5ca80f64e0 2023-01-04T18:26:53.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.346+0000 7f5c9e7fc700 1 -- 172.21.15.50:0/1580307321 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f5c98019030 con 0x7f5ca80f64e0 2023-01-04T18:26:53.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.346+0000 7f5c9e7fc700 1 --2- 172.21.15.50:0/1580307321 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5c94060be0 0x7f5c940630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:53.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.346+0000 7f5c9e7fc700 1 -- 172.21.15.50:0/1580307321 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f5c9807bab0 con 0x7f5ca80f64e0 2023-01-04T18:26:53.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.346+0000 7f5cad64c700 1 --2- 172.21.15.50:0/1580307321 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5c94060be0 0x7f5c940630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:53.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.347+0000 7f5cad64c700 1 --2- 172.21.15.50:0/1580307321 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5c94060be0 0x7f5c940630a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f5ca4009490 tx=0x7f5ca4009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:53.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.350+0000 7f5c9e7fc700 1 -- 172.21.15.50:0/1580307321 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f5c98048c30 con 0x7f5ca80f64e0 2023-01-04T18:26:53.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:52.438984+0000 mon.smithi050 (mon.0) 835 : audit [DBG] from='client.? 172.21.15.50:0/2026978363' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2023-01-04T18:26:53.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:52.806449+0000 mon.smithi050 (mon.0) 836 : audit [DBG] from='client.? 172.21.15.50:0/2991639177' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2023-01-04T18:26:53.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:53 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:53.208767+0000 mon.smithi050 (mon.0) 837 : audit [DBG] from='client.? 172.21.15.50:0/3230859733' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2023-01-04T18:26:53.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.568+0000 7f5cb00b1700 1 -- 172.21.15.50:0/1580307321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f5ca8027a00 con 0x7f5ca80f64e0 2023-01-04T18:26:53.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.569+0000 7f5c9e7fc700 1 -- 172.21.15.50:0/1580307321 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v36) v1 ==== 107+0+4612 (secure 0 0 0) 0x7f5c9804c080 con 0x7f5ca80f64e0 2023-01-04T18:26:53.572 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:53.572 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34366,"name":"cephfs.smithi050.kefmuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6829/2188030488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2188030488},{"type":"v1","addr":"172.21.15.50:6829","nonce":2188030488}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44313,"name":"cephfs.smithi098.memais","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/4224872601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4224872601},{"type":"v1","addr":"172.21.15.98:6825","nonce":4224872601}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":44317,"name":"cephfs.smithi098.laynsk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6827/503298078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":503298078},{"type":"v1","addr":"172.21.15.98:6827","nonce":503298078}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:23:40.418643+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34362":{"gid":34362,"name":"cephfs.smithi050.ezoiwl","rank":0,"incarnation":31,"state":"up:rejoin","state_seq":16,"addr":"172.21.15.50:6827/336562041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":336562041},{"type":"v1","addr":"172.21.15.50:6827","nonce":336562041}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:53.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.570+0000 7f5cb00b1700 1 -- 172.21.15.50:0/1580307321 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5c94060be0 msgr2=0x7f5c940630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:53.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.570+0000 7f5cb00b1700 1 --2- 172.21.15.50:0/1580307321 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5c94060be0 0x7f5c940630a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f5ca4009490 tx=0x7f5ca4009b30).stop 2023-01-04T18:26:53.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.570+0000 7f5cb00b1700 1 -- 172.21.15.50:0/1580307321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ca80f64e0 msgr2=0x7f5ca8106c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:53.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.570+0000 7f5cb00b1700 1 --2- 172.21.15.50:0/1580307321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ca80f64e0 0x7f5ca8106c80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f5c9800c530 tx=0x7f5c98007e10).stop 2023-01-04T18:26:53.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.570+0000 7f5cb00b1700 1 -- 172.21.15.50:0/1580307321 shutdown_connections 2023-01-04T18:26:53.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.570+0000 7f5cb00b1700 1 --2- 172.21.15.50:0/1580307321 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f5c94060be0 0x7f5c940630a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:53.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.570+0000 7f5cb00b1700 1 --2- 172.21.15.50:0/1580307321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ca80f64e0 0x7f5ca8106c80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:53.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.570+0000 7f5cb00b1700 1 --2- 172.21.15.50:0/1580307321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ca80f7780 0x7f5ca8107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:53.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.570+0000 7f5cb00b1700 1 -- 172.21.15.50:0/1580307321 >> 172.21.15.50:0/1580307321 conn(0x7f5ca80f1c40 msgr2=0x7f5ca80fb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:53.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.571+0000 7f5cb00b1700 1 -- 172.21.15.50:0/1580307321 shutdown_connections 2023-01-04T18:26:53.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.571+0000 7f5cb00b1700 1 -- 172.21.15.50:0/1580307321 wait complete. 2023-01-04T18:26:53.575 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 34 2023-01-04T18:26:53.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:52.438984+0000 mon.smithi050 (mon.0) 835 : audit [DBG] from='client.? 172.21.15.50:0/2026978363' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2023-01-04T18:26:53.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:52.806449+0000 mon.smithi050 (mon.0) 836 : audit [DBG] from='client.? 172.21.15.50:0/2991639177' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2023-01-04T18:26:53.580 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:53 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:53.208767+0000 mon.smithi050 (mon.0) 837 : audit [DBG] from='client.? 172.21.15.50:0/3230859733' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2023-01-04T18:26:53.587 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2023-01-04T18:26:53.587 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 35 2023-01-04T18:26:53.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.707+0000 7f0bb45b9700 1 -- 172.21.15.50:0/1907851955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bac0f5ca0 msgr2=0x7f0bac0f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:53.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.707+0000 7f0bb45b9700 1 --2- 172.21.15.50:0/1907851955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bac0f5ca0 0x7f0bac0f66d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f0b9c004660 tx=0x7f0b9c009b30).stop 2023-01-04T18:26:53.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.707+0000 7f0bb45b9700 1 -- 172.21.15.50:0/1907851955 shutdown_connections 2023-01-04T18:26:53.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.707+0000 7f0bb45b9700 1 --2- 172.21.15.50:0/1907851955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bac0f5ca0 0x7f0bac0f66d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:53.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.707+0000 7f0bb45b9700 1 --2- 172.21.15.50:0/1907851955 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0bac0f5390 0x7f0bac0f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.707+0000 7f0bb45b9700 1 -- 172.21.15.50:0/1907851955 >> 172.21.15.50:0/1907851955 conn(0x7f0bac0f0b70 msgr2=0x7f0bac0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.707+0000 7f0bb45b9700 1 -- 172.21.15.50:0/1907851955 shutdown_connections 2023-01-04T18:26:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.707+0000 7f0bb45b9700 1 -- 172.21.15.50:0/1907851955 wait complete. 2023-01-04T18:26:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.707+0000 7f0bb45b9700 1 Processor -- start 2023-01-04T18:26:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.707+0000 7f0bb45b9700 1 -- start start 2023-01-04T18:26:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.707+0000 7f0bb45b9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bac0f5390 0x7f0bac106b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.707+0000 7f0bb45b9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0bac0f5ca0 0x7f0bac107070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.707+0000 7f0bb45b9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac107620 con 0x7f0bac0f5390 2023-01-04T18:26:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.707+0000 7f0bb45b9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac107760 con 0x7f0bac0f5ca0 2023-01-04T18:26:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.708+0000 7f0bb2355700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bac0f5390 0x7f0bac106b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.708+0000 7f0bb2355700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bac0f5390 0x7f0bac106b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37968/0 (socket says 172.21.15.50:37968) 2023-01-04T18:26:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.708+0000 7f0bb2355700 1 -- 172.21.15.50:0/3488731286 learned_addr learned my addr 172.21.15.50:0/3488731286 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-01-04T18:26:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.708+0000 7f0bb1b54700 1 --2- 172.21.15.50:0/3488731286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0bac0f5ca0 0x7f0bac107070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.708+0000 7f0bb2355700 1 -- 172.21.15.50:0/3488731286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0bac0f5ca0 msgr2=0x7f0bac107070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.708+0000 7f0bb2355700 1 --2- 172.21.15.50:0/3488731286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0bac0f5ca0 0x7f0bac107070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:53.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.708+0000 7f0bb2355700 1 -- 172.21.15.50:0/3488731286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c005040 con 0x7f0bac0f5390 2023-01-04T18:26:53.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.708+0000 7f0bb2355700 1 --2- 172.21.15.50:0/3488731286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bac0f5390 0x7f0bac106b80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f0ba8002700 tx=0x7f0ba8009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:53.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.708+0000 7f0ba2ffd700 1 -- 172.21.15.50:0/3488731286 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ba8009320 con 0x7f0bac0f5390 2023-01-04T18:26:53.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.708+0000 7f0ba2ffd700 1 -- 172.21.15.50:0/3488731286 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f0ba800f040 con 0x7f0bac0f5390 2023-01-04T18:26:53.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.708+0000 7f0bb45b9700 1 -- 172.21.15.50:0/3488731286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bac10c200 con 0x7f0bac0f5390 2023-01-04T18:26:53.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.708+0000 7f0ba2ffd700 1 -- 172.21.15.50:0/3488731286 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ba8014910 con 0x7f0bac0f5390 2023-01-04T18:26:53.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.708+0000 7f0bb45b9700 1 -- 172.21.15.50:0/3488731286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bac10c7c0 con 0x7f0bac0f5390 2023-01-04T18:26:53.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.709+0000 7f0bb45b9700 1 -- 172.21.15.50:0/3488731286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bac0fdb50 con 0x7f0bac0f5390 2023-01-04T18:26:53.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.710+0000 7f0ba2ffd700 1 -- 172.21.15.50:0/3488731286 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 30) v1 ==== 76940+0+0 (secure 0 0 0) 0x7f0ba8009480 con 0x7f0bac0f5390 2023-01-04T18:26:53.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.710+0000 7f0ba2ffd700 1 --2- 172.21.15.50:0/3488731286 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0b98060be0 0x7f0b980630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-01-04T18:26:53.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.710+0000 7f0ba2ffd700 1 -- 172.21.15.50:0/3488731286 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f0ba807c250 con 0x7f0bac0f5390 2023-01-04T18:26:53.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.710+0000 7f0bb1b54700 1 --2- 172.21.15.50:0/3488731286 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0b98060be0 0x7f0b980630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-01-04T18:26:53.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.711+0000 7f0bb1b54700 1 --2- 172.21.15.50:0/3488731286 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0b98060be0 0x7f0b980630a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f0b9c004630 tx=0x7f0b9c009b30).ready entity=mgr.24517 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-04T18:26:53.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.714+0000 7f0ba2ffd700 1 -- 172.21.15.50:0/3488731286 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162842 (secure 0 0 0) 0x7f0ba8050080 con 0x7f0bac0f5390 2023-01-04T18:26:53.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.930+0000 7f0bb45b9700 1 -- 172.21.15.50:0/3488731286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f0bac10cec0 con 0x7f0bac0f5390 2023-01-04T18:26:53.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.930+0000 7f0ba2ffd700 1 -- 172.21.15.50:0/3488731286 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v36) v1 ==== 107+0+4612 (secure 0 0 0) 0x7f0ba804fc70 con 0x7f0bac0f5390 2023-01-04T18:26:53.941 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-01-04T18:26:53.942 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34366,"name":"cephfs.smithi050.kefmuy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6829/2188030488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2188030488},{"type":"v1","addr":"172.21.15.50:6829","nonce":2188030488}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44313,"name":"cephfs.smithi098.memais","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6825/4224872601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4224872601},{"type":"v1","addr":"172.21.15.98:6825","nonce":4224872601}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":44317,"name":"cephfs.smithi098.laynsk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6827/503298078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":503298078},{"type":"v1","addr":"172.21.15.98:6827","nonce":503298078}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-01-04T18:14:30.390760+0000","modified":"2023-01-04T18:23:41.423675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34362},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34362":{"gid":34362,"name":"cephfs.smithi050.ezoiwl","rank":0,"incarnation":31,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6827/336562041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":336562041},{"type":"v1","addr":"172.21.15.50:6827","nonce":336562041}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-01-04T18:26:53.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.932+0000 7f0bb45b9700 1 -- 172.21.15.50:0/3488731286 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0b98060be0 msgr2=0x7f0b980630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:53.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.932+0000 7f0bb45b9700 1 --2- 172.21.15.50:0/3488731286 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0b98060be0 0x7f0b980630a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f0b9c004630 tx=0x7f0b9c009b30).stop 2023-01-04T18:26:53.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.932+0000 7f0bb45b9700 1 -- 172.21.15.50:0/3488731286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bac0f5390 msgr2=0x7f0bac106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-04T18:26:53.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.932+0000 7f0bb45b9700 1 --2- 172.21.15.50:0/3488731286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bac0f5390 0x7f0bac106b80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f0ba8002700 tx=0x7f0ba8009e00).stop 2023-01-04T18:26:53.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.932+0000 7f0bb45b9700 1 -- 172.21.15.50:0/3488731286 shutdown_connections 2023-01-04T18:26:53.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.932+0000 7f0bb45b9700 1 --2- 172.21.15.50:0/3488731286 >> [v2:172.21.15.50:6800/3329325632,v1:172.21.15.50:6801/3329325632] conn(0x7f0b98060be0 0x7f0b980630a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:53.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.932+0000 7f0bb45b9700 1 --2- 172.21.15.50:0/3488731286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bac0f5390 0x7f0bac106b80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:53.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.932+0000 7f0bb45b9700 1 --2- 172.21.15.50:0/3488731286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0bac0f5ca0 0x7f0bac107070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-01-04T18:26:53.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.932+0000 7f0bb45b9700 1 -- 172.21.15.50:0/3488731286 >> 172.21.15.50:0/3488731286 conn(0x7f0bac0f0b70 msgr2=0x7f0bac05fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-04T18:26:53.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.932+0000 7f0bb45b9700 1 -- 172.21.15.50:0/3488731286 shutdown_connections 2023-01-04T18:26:53.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-01-04T18:26:53.932+0000 7f0bb45b9700 1 -- 172.21.15.50:0/3488731286 wait complete. 2023-01-04T18:26:53.945 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 35 2023-01-04T18:26:53.948 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-01-04T18:26:53.959 INFO:tasks.kclient:Unmounting kernel clients... 2023-01-04T18:26:53.959 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-01-04T18:26:53.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-01-04T18:26:53.959 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-01-04T18:26:54.000 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-01-04T18:26:54.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:26:54.001 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-01-04T18:26:54.075 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-01-04T18:26:54.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-01-04T18:26:54.075 DEBUG:teuthology.orchestra.run.smithi098:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-01-04T18:26:54.128 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-01-04T18:26:54.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:26:54.128 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-01-04T18:26:54.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:26:54.161 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-01-04T18:26:54.180 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-01-04T18:26:54.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:26:54.180 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-01-04T18:26:54.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:26:54.275 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-01-04T18:26:54.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:26:54.385 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-01-04T18:26:54.407 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-01-04T18:26:54.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:26:54.408 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-01-04T18:26:54.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: cluster 2023-01-04T18:26:52.737537+0000 mgr.smithi050.emnywo (mgr.24517) 464 : cluster [DBG] pgmap v338: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:54.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:53.570015+0000 mon.smithi050 (mon.0) 838 : audit [DBG] from='client.? 172.21.15.50:0/1580307321' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2023-01-04T18:26:54.476 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:54 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: audit 2023-01-04T18:26:53.931634+0000 mon.smithi050 (mon.0) 839 : audit [DBG] from='client.? 172.21.15.50:0/3488731286' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2023-01-04T18:26:54.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-04T18:26:54.498 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link delete ceph-brx 2023-01-04T18:26:54.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: cluster 2023-01-04T18:26:52.737537+0000 mgr.smithi050.emnywo (mgr.24517) 464 : cluster [DBG] pgmap v338: 65 pgs: 65 active+clean; 194 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2023-01-04T18:26:54.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:53.570015+0000 mon.smithi050 (mon.0) 838 : audit [DBG] from='client.? 172.21.15.50:0/1580307321' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2023-01-04T18:26:54.540 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: audit 2023-01-04T18:26:53.931634+0000 mon.smithi050 (mon.0) 839 : audit [DBG] from='client.? 172.21.15.50:0/3488731286' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2023-01-04T18:26:54.604 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-01-04T18:26:54.616 INFO:tasks.cephadm:Teardown begin 2023-01-04T18:26:54.616 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-01-04T18:26:54.648 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-01-04T18:26:54.678 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-01-04T18:26:54.678 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-01-04T18:26:54.707 DEBUG:teuthology.orchestra.run.smithi098:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-01-04T18:26:54.737 INFO:tasks.cephadm:Stopping all daemons... 2023-01-04T18:26:54.737 INFO:tasks.cephadm.mon.smithi050:Stopping mon.smithi050... 2023-01-04T18:26:54.737 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mon.smithi050 2023-01-04T18:26:54.897 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:54 smithi050 systemd[1]: Stopping Ceph mon.smithi050 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:26:54.897 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:54 smithi050 bash[195781]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi050" found: no such container 2023-01-04T18:26:55.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:26:54.893+0000 7f3458951700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi050 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2023-01-04T18:26:55.292 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:54 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050[173160]: debug 2023-01-04T18:26:54.893+0000 7f3458951700 -1 mon.smithi050@0(leader) e2 *** Got Signal Terminated *** 2023-01-04T18:26:55.692 INFO:journalctl@ceph.mon.smithi050.smithi050.stdout:Jan 04 18:26:55 smithi050 bash[195795]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi050 2023-01-04T18:26:55.712 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mon.smithi050.service' 2023-01-04T18:26:55.762 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-01-04T18:26:55.763 INFO:tasks.cephadm.mon.smithi050:Stopped mon.smithi050 2023-01-04T18:26:55.763 INFO:tasks.cephadm.mon.smithi098:Stopping mon.smithi098... 2023-01-04T18:26:55.763 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mon.smithi098 2023-01-04T18:26:56.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:55 smithi098 systemd[1]: Stopping Ceph mon.smithi098 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:26:56.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:55 smithi098 bash[135740]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon.smithi098" found: no such container 2023-01-04T18:26:56.080 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:26:55.929+0000 7f62096f2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi098 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2023-01-04T18:26:56.081 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:55 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098[124015]: debug 2023-01-04T18:26:55.929+0000 7f62096f2700 -1 mon.smithi098@1(peon) e2 *** Got Signal Terminated *** 2023-01-04T18:26:56.522 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Jan 04 18:26:56 smithi098 bash[135754]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c-mon-smithi098 2023-01-04T18:26:56.533 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d98671da-8c5a-11ed-821a-001a4aab830c@mon.smithi098.service' 2023-01-04T18:26:56.583 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-01-04T18:26:56.583 INFO:tasks.cephadm.mon.smithi098:Stopped mon.smithi098 2023-01-04T18:26:56.584 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-01-04T18:26:56.584 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.0 2023-01-04T18:26:57.040 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:26:56 smithi050 systemd[1]: Stopping Ceph osd.0 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:26:57.041 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:26:56 smithi050 bash[195923]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.0" found: no such container 2023-01-04T18:26:57.041 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:26:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-0[176458]: debug 2023-01-04T18:26:56.743+0000 7f2010d0c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-01-04T18:26:57.041 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:26:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-0[176458]: debug 2023-01-04T18:26:56.743+0000 7f2010d0c700 -1 osd.0 95 *** Got signal Terminated *** 2023-01-04T18:26:57.041 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:26:56 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-0[176458]: debug 2023-01-04T18:26:56.743+0000 7f2010d0c700 -1 osd.0 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-01-04T18:27:02.290 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:27:02 smithi050 bash[195937]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-0 2023-01-04T18:27:02.290 INFO:journalctl@ceph.osd.0.smithi050.stdout:Jan 04 18:27:02 smithi050 bash[195981]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.0" found: no such container 2023-01-04T18:27:03.655 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.0.service' 2023-01-04T18:27:03.697 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-01-04T18:27:03.697 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-01-04T18:27:03.697 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-01-04T18:27:03.698 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.1 2023-01-04T18:27:04.021 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:27:03 smithi050 systemd[1]: Stopping Ceph osd.1 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:27:04.021 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:27:03 smithi050 bash[196168]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.1" found: no such container 2023-01-04T18:27:04.290 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:27:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-1[179762]: debug 2023-01-04T18:27:04.017+0000 7f2a19033700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-01-04T18:27:04.290 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:27:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-1[179762]: debug 2023-01-04T18:27:04.017+0000 7f2a19033700 -1 osd.1 95 *** Got signal Terminated *** 2023-01-04T18:27:04.290 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:27:04 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-1[179762]: debug 2023-01-04T18:27:04.017+0000 7f2a19033700 -1 osd.1 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-01-04T18:27:09.540 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:27:09 smithi050 bash[196181]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-1 2023-01-04T18:27:09.540 INFO:journalctl@ceph.osd.1.smithi050.stdout:Jan 04 18:27:09 smithi050 bash[196225]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.1" found: no such container 2023-01-04T18:27:10.921 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.1.service' 2023-01-04T18:27:10.964 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-01-04T18:27:10.964 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-01-04T18:27:10.964 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-01-04T18:27:10.965 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.2 2023-01-04T18:27:11.290 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:27:11 smithi050 systemd[1]: Stopping Ceph osd.2 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:27:11.290 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:27:11 smithi050 bash[196415]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.2" found: no such container 2023-01-04T18:27:11.290 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:27:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-2[182591]: debug 2023-01-04T18:27:11.146+0000 7f6fdb3e5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-01-04T18:27:11.290 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:27:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-2[182591]: debug 2023-01-04T18:27:11.146+0000 7f6fdb3e5700 -1 osd.2 95 *** Got signal Terminated *** 2023-01-04T18:27:11.290 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:27:11 smithi050 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-2[182591]: debug 2023-01-04T18:27:11.146+0000 7f6fdb3e5700 -1 osd.2 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-01-04T18:27:16.666 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:27:16 smithi050 bash[196429]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-2 2023-01-04T18:27:17.040 INFO:journalctl@ceph.osd.2.smithi050.stdout:Jan 04 18:27:16 smithi050 bash[196480]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.2" found: no such container 2023-01-04T18:27:18.139 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.2.service' 2023-01-04T18:27:18.182 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-01-04T18:27:18.182 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-01-04T18:27:18.182 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-01-04T18:27:18.182 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.3 2023-01-04T18:27:18.580 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:27:18 smithi098 systemd[1]: Stopping Ceph osd.3 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:27:18.580 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:27:18 smithi098 bash[135865]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.3" found: no such container 2023-01-04T18:27:18.580 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:27:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-3[126692]: debug 2023-01-04T18:27:18.351+0000 7f5c8d055700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-01-04T18:27:18.581 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:27:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-3[126692]: debug 2023-01-04T18:27:18.351+0000 7f5c8d055700 -1 osd.3 95 *** Got signal Terminated *** 2023-01-04T18:27:18.581 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:27:18 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-3[126692]: debug 2023-01-04T18:27:18.351+0000 7f5c8d055700 -1 osd.3 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-01-04T18:27:24.331 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:27:23 smithi098 bash[135881]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-3 2023-01-04T18:27:24.332 INFO:journalctl@ceph.osd.3.smithi098.stdout:Jan 04 18:27:24 smithi098 bash[135930]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.3" found: no such container 2023-01-04T18:27:25.728 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.3.service' 2023-01-04T18:27:25.768 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-01-04T18:27:25.768 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-01-04T18:27:25.768 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-01-04T18:27:25.768 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.4 2023-01-04T18:27:25.950 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:27:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-4[129181]: debug 2023-01-04T18:27:25.643+0000 7f599e2c9700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-01-04T18:26:59.515129+0000 front 2023-01-04T18:26:59.515120+0000 (oldest deadline 2023-01-04T18:27:25.414968+0000) 2023-01-04T18:27:25.950 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:27:25 smithi098 systemd[1]: Stopping Ceph osd.4 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:27:25.950 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:27:25 smithi098 bash[136119]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.4" found: no such container 2023-01-04T18:27:26.330 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:27:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-4[129181]: debug 2023-01-04T18:27:25.946+0000 7f59a4b53700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-01-04T18:27:26.330 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:27:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-4[129181]: debug 2023-01-04T18:27:25.946+0000 7f59a4b53700 -1 osd.4 95 *** Got signal Terminated *** 2023-01-04T18:27:26.330 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:27:25 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-4[129181]: debug 2023-01-04T18:27:25.946+0000 7f59a4b53700 -1 osd.4 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-01-04T18:27:27.084 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:27:26 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-4[129181]: debug 2023-01-04T18:27:26.638+0000 7f599e2c9700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-01-04T18:26:59.515129+0000 front 2023-01-04T18:26:59.515120+0000 (oldest deadline 2023-01-04T18:27:25.414968+0000) 2023-01-04T18:27:27.581 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:27:27.186+0000 7f8624d58700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-01-04T18:27:01.496570+0000 front 2023-01-04T18:27:01.496481+0000 (oldest deadline 2023-01-04T18:27:26.796347+0000) 2023-01-04T18:27:28.080 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:27:27 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-4[129181]: debug 2023-01-04T18:27:27.680+0000 7f599e2c9700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-01-04T18:26:59.515129+0000 front 2023-01-04T18:26:59.515120+0000 (oldest deadline 2023-01-04T18:27:25.414968+0000) 2023-01-04T18:27:28.580 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:27:28.196+0000 7f8624d58700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-01-04T18:27:01.496570+0000 front 2023-01-04T18:27:01.496481+0000 (oldest deadline 2023-01-04T18:27:26.796347+0000) 2023-01-04T18:27:29.080 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:27:28 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-4[129181]: debug 2023-01-04T18:27:28.653+0000 7f599e2c9700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-01-04T18:26:59.515129+0000 front 2023-01-04T18:26:59.515120+0000 (oldest deadline 2023-01-04T18:27:25.414968+0000) 2023-01-04T18:27:29.580 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:27:29.149+0000 7f8624d58700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-01-04T18:27:01.496570+0000 front 2023-01-04T18:27:01.496481+0000 (oldest deadline 2023-01-04T18:27:26.796347+0000) 2023-01-04T18:27:30.080 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:27:29 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-4[129181]: debug 2023-01-04T18:27:29.612+0000 7f599e2c9700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-01-04T18:26:59.515129+0000 front 2023-01-04T18:26:59.515120+0000 (oldest deadline 2023-01-04T18:27:25.414968+0000) 2023-01-04T18:27:30.580 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:27:30.128+0000 7f8624d58700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-01-04T18:27:01.496570+0000 front 2023-01-04T18:27:01.496481+0000 (oldest deadline 2023-01-04T18:27:26.796347+0000) 2023-01-04T18:27:31.085 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:27:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-4[129181]: debug 2023-01-04T18:27:30.655+0000 7f599e2c9700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-01-04T18:26:59.515129+0000 front 2023-01-04T18:26:59.515120+0000 (oldest deadline 2023-01-04T18:27:25.414968+0000) 2023-01-04T18:27:31.085 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:27:30 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-4[129181]: debug 2023-01-04T18:27:30.655+0000 7f599e2c9700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.50:6814 osd.1 since back 2023-01-04T18:27:05.415510+0000 front 2023-01-04T18:27:05.415547+0000 (oldest deadline 2023-01-04T18:27:30.115388+0000) 2023-01-04T18:27:31.512 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:31 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:27:31.155+0000 7f8624d58700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-01-04T18:27:01.496570+0000 front 2023-01-04T18:27:01.496481+0000 (oldest deadline 2023-01-04T18:27:26.796347+0000) 2023-01-04T18:27:31.513 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:27:31 smithi098 bash[136134]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-4 2023-01-04T18:27:31.830 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jan 04 18:27:31 smithi098 bash[136185]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.4" found: no such container 2023-01-04T18:27:32.580 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:32 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:27:32.193+0000 7f8624d58700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-01-04T18:27:01.496570+0000 front 2023-01-04T18:27:01.496481+0000 (oldest deadline 2023-01-04T18:27:26.796347+0000) 2023-01-04T18:27:33.090 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.4.service' 2023-01-04T18:27:33.131 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-01-04T18:27:33.131 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-01-04T18:27:33.131 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-01-04T18:27:33.131 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.5 2023-01-04T18:27:33.373 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:33 smithi098 systemd[1]: Stopping Ceph osd.5 for d98671da-8c5a-11ed-821a-001a4aab830c... 2023-01-04T18:27:33.374 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:33 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:27:33.209+0000 7f8624d58700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-01-04T18:27:01.496570+0000 front 2023-01-04T18:27:01.496481+0000 (oldest deadline 2023-01-04T18:27:26.796347+0000) 2023-01-04T18:27:33.374 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:33 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:27:33.209+0000 7f8624d58700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.50:6814 osd.1 since back 2023-01-04T18:27:06.796959+0000 front 2023-01-04T18:27:06.796880+0000 (oldest deadline 2023-01-04T18:27:32.696781+0000) 2023-01-04T18:27:33.374 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:33 smithi098 bash[136376]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.5" found: no such container 2023-01-04T18:27:33.374 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:33 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:27:33.370+0000 7f86275da700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-01-04T18:27:33.374 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:33 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:27:33.370+0000 7f86275da700 -1 osd.5 95 *** Got signal Terminated *** 2023-01-04T18:27:33.830 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:33 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:27:33.370+0000 7f86275da700 -1 osd.5 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-01-04T18:27:34.580 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:27:34.175+0000 7f8624d58700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-01-04T18:27:01.496570+0000 front 2023-01-04T18:27:01.496481+0000 (oldest deadline 2023-01-04T18:27:26.796347+0000) 2023-01-04T18:27:34.580 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:34 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:27:34.175+0000 7f8624d58700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.50:6814 osd.1 since back 2023-01-04T18:27:06.796959+0000 front 2023-01-04T18:27:06.796880+0000 (oldest deadline 2023-01-04T18:27:32.696781+0000) 2023-01-04T18:27:35.580 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:27:35.223+0000 7f8624d58700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-01-04T18:27:01.496570+0000 front 2023-01-04T18:27:01.496481+0000 (oldest deadline 2023-01-04T18:27:26.796347+0000) 2023-01-04T18:27:35.580 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:35 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:27:35.223+0000 7f8624d58700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.50:6814 osd.1 since back 2023-01-04T18:27:06.796959+0000 front 2023-01-04T18:27:06.796880+0000 (oldest deadline 2023-01-04T18:27:32.696781+0000) 2023-01-04T18:27:36.580 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:27:36.271+0000 7f8624d58700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-01-04T18:27:01.496570+0000 front 2023-01-04T18:27:01.496481+0000 (oldest deadline 2023-01-04T18:27:26.796347+0000) 2023-01-04T18:27:36.580 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:36 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:27:36.271+0000 7f8624d58700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.50:6814 osd.1 since back 2023-01-04T18:27:06.796959+0000 front 2023-01-04T18:27:06.796880+0000 (oldest deadline 2023-01-04T18:27:32.696781+0000) 2023-01-04T18:27:37.581 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:37 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:27:37.299+0000 7f8624d58700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-01-04T18:27:01.496570+0000 front 2023-01-04T18:27:01.496481+0000 (oldest deadline 2023-01-04T18:27:26.796347+0000) 2023-01-04T18:27:37.581 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:37 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:27:37.300+0000 7f8624d58700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.50:6814 osd.1 since back 2023-01-04T18:27:06.796959+0000 front 2023-01-04T18:27:06.796880+0000 (oldest deadline 2023-01-04T18:27:32.696781+0000) 2023-01-04T18:27:38.580 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:27:38.263+0000 7f8624d58700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-01-04T18:27:01.496570+0000 front 2023-01-04T18:27:01.496481+0000 (oldest deadline 2023-01-04T18:27:26.796347+0000) 2023-01-04T18:27:38.580 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:38 smithi098 ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5[131581]: debug 2023-01-04T18:27:38.263+0000 7f8624d58700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.50:6814 osd.1 since back 2023-01-04T18:27:06.796959+0000 front 2023-01-04T18:27:06.796880+0000 (oldest deadline 2023-01-04T18:27:32.696781+0000) 2023-01-04T18:27:38.942 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:38 smithi098 bash[136389]: ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd-5 2023-01-04T18:27:39.330 INFO:journalctl@ceph.osd.5.smithi098.stdout:Jan 04 18:27:38 smithi098 bash[136433]: Error: no container with name or ID "ceph-d98671da-8c5a-11ed-821a-001a4aab830c-osd.5" found: no such container 2023-01-04T18:27:40.616 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d98671da-8c5a-11ed-821a-001a4aab830c@osd.5.service' 2023-01-04T18:27:40.660 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-01-04T18:27:40.661 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-01-04T18:27:40.661 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d98671da-8c5a-11ed-821a-001a4aab830c --force --keep-logs 2023-01-04T18:27:56.633 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d98671da-8c5a-11ed-821a-001a4aab830c --force --keep-logs 2023-01-04T18:28:06.153 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-01-04T18:28:06.189 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-01-04T18:28:06.219 INFO:tasks.cephadm:Archiving crash dumps... 2023-01-04T18:28:06.232 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/crash to /home/teuthworker/archive/yuriw-2023-01-04_17:39:36-fs-pacific_16.2.11_RC4-distro-default-smithi/7131558/remote/ubuntu@smithi050.front.sepia.ceph.com/crash 2023-01-04T18:28:06.233 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/crash -- . 2023-01-04T18:28:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:tar: /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/crash: Cannot open: No such file or directory 2023-01-04T18:28:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:tar: Error is not recoverable: exiting now 2023-01-04T18:28:06.265 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/crash to /home/teuthworker/archive/yuriw-2023-01-04_17:39:36-fs-pacific_16.2.11_RC4-distro-default-smithi/7131558/remote/ubuntu@smithi098.front.sepia.ceph.com/crash 2023-01-04T18:28:06.266 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar cz -f - -C /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/crash -- . 2023-01-04T18:28:06.292 INFO:teuthology.orchestra.run.smithi098.stderr:tar: /var/lib/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/crash: Cannot open: No such file or directory 2023-01-04T18:28:06.292 INFO:teuthology.orchestra.run.smithi098.stderr:tar: Error is not recoverable: exiting now 2023-01-04T18:28:06.294 INFO:tasks.cephadm:Checking cluster log for badness... 2023-01-04T18:28:06.294 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-01-04T18:28:06.337 INFO:teuthology.orchestra.run.smithi050.stderr:grep: /var/log/ceph/d98671da-8c5a-11ed-821a-001a4aab830c/ceph.log: No such file or directory 2023-01-04T18:28:06.339 INFO:tasks.cephadm:Compressing logs... 2023-01-04T18:28:06.339 DEBUG:teuthology.orchestra.run.smithi050:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-01-04T18:28:06.382 DEBUG:teuthology.orchestra.run.smithi098:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-01-04T18:28:06.408 INFO:teuthology.orchestra.run.smithi098.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-01-04T18:28:06.409 INFO:teuthology.orchestra.run.smithi050.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-01-04T18:30:28.063 INFO:tasks.cephadm:Archiving logs... 2023-01-04T18:30:28.064 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-01-04_17:39:36-fs-pacific_16.2.11_RC4-distro-default-smithi/7131558/remote/ubuntu@smithi050.front.sepia.ceph.com/log 2023-01-04T18:30:28.065 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/log/ceph -- . 2023-01-04T18:30:58.080 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-01-04_17:39:36-fs-pacific_16.2.11_RC4-distro-default-smithi/7131558/remote/ubuntu@smithi098.front.sepia.ceph.com/log 2023-01-04T18:30:58.081 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar cz -f - -C /var/log/ceph -- . 2023-01-04T18:31:04.235 INFO:tasks.cephadm:Removing cluster... 2023-01-04T18:31:04.235 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d98671da-8c5a-11ed-821a-001a4aab830c --force 2023-01-04T18:31:04.905 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d98671da-8c5a-11ed-821a-001a4aab830c --force 2023-01-04T18:31:05.447 INFO:tasks.cephadm:Removing cephadm ... 2023-01-04T18:31:05.447 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/cephadm 2023-01-04T18:31:05.474 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/cephadm 2023-01-04T18:31:05.494 INFO:tasks.cephadm:Teardown complete 2023-01-04T18:31:05.494 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-01-04T18:31:05.515 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2023-01-04T18:31:05.515 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2023-01-04T18:31:05.526 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2023-01-04T18:31:05.612 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-01-04T18:31:05.623 INFO:teuthology.task.clock:Checking final clock skew... 2023-01-04T18:31:05.623 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-04T18:31:05.628 DEBUG:teuthology.orchestra.run.smithi098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-04T18:31:05.641 INFO:teuthology.orchestra.run.smithi050.stderr:bash: ntpq: command not found 2023-01-04T18:31:05.646 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-04T18:31:05.646 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2023-01-04T18:31:05.646 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 25 -943us[ -943us] +/- 105ms 2023-01-04T18:31:05.647 INFO:teuthology.orchestra.run.smithi050.stdout:^* hv02.front.sepia.ceph.com 3 6 377 25 +864us[ +863us] +/- 43ms 2023-01-04T18:31:05.647 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 -758us[ -759us] +/- 65ms 2023-01-04T18:31:05.647 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-01-04T18:31:05.648 INFO:teuthology.orchestra.run.smithi098.stderr:bash: ntpq: command not found 2023-01-04T18:31:05.652 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-04T18:31:05.652 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2023-01-04T18:31:05.652 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 26 -935us[ -941us] +/- 105ms 2023-01-04T18:31:05.652 INFO:teuthology.orchestra.run.smithi098.stdout:^* hv02.front.sepia.ceph.com 3 6 377 26 +876us[ +869us] +/- 43ms 2023-01-04T18:31:05.652 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 -741us[ -741us] +/- 65ms 2023-01-04T18:31:05.652 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-01-04T18:31:05.653 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-01-04T18:31:05.673 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-01-04T18:31:05.674 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-01-04T18:31:05.695 DEBUG:teuthology.orchestra.run.smithi050:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-01-04T18:31:05.793 DEBUG:teuthology.orchestra.run.smithi098:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-01-04T18:31:05.883 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-04T18:31:05.918 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-04T18:31:05.919 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-04T18:31:05.950 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-04T18:31:05.951 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-01-04T18:31:05.965 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-01-04T18:31:05.979 INFO:teuthology.task.internal:Duration was 2007.122470 seconds 2023-01-04T18:31:05.979 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-01-04T18:31:05.994 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-01-04T18:31:05.994 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-01-04T18:31:05.997 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-01-04T18:31:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-04T18:31:06.044 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-04T18:31:06.302 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-01-04T18:31:06.302 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2023-01-04T18:31:06.302 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-01-04T18:31:06.326 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi098.front.sepia.ceph.com 2023-01-04T18:31:06.326 DEBUG:teuthology.orchestra.run.smithi098:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-01-04T18:31:06.350 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-01-04T18:31:06.350 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-01-04T18:31:06.368 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-01-04T18:31:06.444 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-01-04T18:31:06.445 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-01-04T18:31:06.446 DEBUG:teuthology.orchestra.run.smithi098:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-01-04T18:31:06.574 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-01-04T18:31:06.588 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-01-04T18:31:06.588 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-01-04T18:31:06.616 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-01-04T18:31:06.643 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-01-04T18:31:06.655 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-01-04T18:31:06.658 DEBUG:teuthology.orchestra.run.smithi098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-01-04T18:31:06.683 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2023-01-04T18:31:06.710 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = core 2023-01-04T18:31:06.724 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2023-01-04T18:31:06.754 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-04T18:31:06.755 DEBUG:teuthology.orchestra.run.smithi098:> test -e /home/ubuntu/cephtest/archive/coredump 2023-01-04T18:31:06.780 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-04T18:31:06.781 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-01-04T18:31:06.798 INFO:teuthology.task.internal:Transferring archived files... 2023-01-04T18:31:06.800 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-01-04_17:39:36-fs-pacific_16.2.11_RC4-distro-default-smithi/7131558/remote/smithi050 2023-01-04T18:31:06.801 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2023-01-04T18:31:06.859 DEBUG:teuthology.misc:Transferring archived files from smithi098:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-01-04_17:39:36-fs-pacific_16.2.11_RC4-distro-default-smithi/7131558/remote/smithi098 2023-01-04T18:31:06.860 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2023-01-04T18:31:06.917 INFO:teuthology.task.internal:Removing archive directory... 2023-01-04T18:31:06.917 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2023-01-04T18:31:06.919 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf -- /home/ubuntu/cephtest/archive 2023-01-04T18:31:06.972 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-01-04T18:31:06.987 INFO:teuthology.task.internal:Not uploading archives. 2023-01-04T18:31:06.988 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-01-04T18:31:07.004 INFO:teuthology.task.internal:Tidying up after the test... 2023-01-04T18:31:07.004 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-01-04T18:31:07.006 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-01-04T18:31:07.021 INFO:teuthology.orchestra.run.smithi050.stdout: 393279 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 4 18:31 /home/ubuntu/cephtest 2023-01-04T18:31:07.029 INFO:teuthology.orchestra.run.smithi098.stdout: 393279 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 4 18:31 /home/ubuntu/cephtest 2023-01-04T18:31:07.030 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-01-04T18:31:07.060 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} duration: 2007.1224699020386 flavor: default owner: scheduled_yuriw@teuthology success: true 2023-01-04T18:31:07.060 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-01-04T18:31:07.113 INFO:teuthology.run:pass