Readiness probe failed: on pod pxc-backup-mongodb-0

PX-Backup
1

Hi,

I already install portworx backup with openshift environment, but we have issue to bring up mongodb pods, below the logs.

Advertised Hostname: pxc-backup-mongodb-0.pxc-backup-mongodb-headless
Advertised Service: pxc-backup-mongodb-headless
Pod name matches initial primary pod name, configuring node as a primary
e[38;5;6mmongodb e[38;5;5m03:49:57.14 e[0m
e[38;5;6mmongodb e[38;5;5m03:49:57.16 e[0me[1mWelcome to the Bitnami mongodb containere[0m
e[38;5;6mmongodb e[38;5;5m03:49:57.17 e[0mSubscribe to project updates by watching e[1mhttps://github.com/bitnami/containerse[0m
e[38;5;6mmongodb e[38;5;5m03:49:57.18 e[0mSubmit issues and feature requests at e[1mhttps://github.com/bitnami/containers/issuese[0m
e[38;5;6mmongodb e[38;5;5m03:49:57.18 e[0m
e[38;5;6mmongodb e[38;5;5m03:49:57.19 e[0me[38;5;2mINFO e[0m ==> ** Starting MongoDB setup **
e[38;5;6mmongodb e[38;5;5m03:49:57.25 e[0me[38;5;2mINFO e[0m ==> Validating settings in MONGODB_* env vars…
e[38;5;6mmongodb e[38;5;5m03:49:57.44 e[0me[38;5;2mINFO e[0m ==> Initializing MongoDB…
e[38;5;6mmongodb e[38;5;5m03:49:57.75 e[0me[38;5;2mINFO e[0m ==> Enabling authentication…
e[38;5;6mmongodb e[38;5;5m03:49:57.79 e[0me[38;5;2mINFO e[0m ==> Deploying MongoDB with persisted data…
e[38;5;6mmongodb e[38;5;5m03:49:57.80 e[0me[38;5;2mINFO e[0m ==> Writing keyfile for replica set authentication…
e[38;5;6mmongodb e[38;5;5m03:49:58.03 e[0me[38;5;2mINFO e[0m ==> ** MongoDB setup finished! **

e[38;5;6mmongodb e[38;5;5m03:49:58.10 e[0me[38;5;2mINFO e[0m ==> ** Starting MongoDB **

{“t”:{“$date”:“2023-07-04T03:49:58.242+00:00”},“s”:“I”, “c”:“CONTROL”, “id”:20698, “ctx”:“-”,“msg”:“***** SERVER RESTARTED *****”}
{“t”:{“$date”:“2023-07-04T03:49:58.249+00:00”},“s”:“I”, “c”:“CONTROL”, “id”:23285, “ctx”:“-”,“msg”:“Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols ‘none’”}
{“t”:{“$date”:“2023-07-04T03:49:58.250+00:00”},“s”:“I”, “c”:“NETWORK”, “id”:4915701, “ctx”:“-”,“msg”:“Initialized wire specification”,“attr”:{“spec”:{“incomingExternalClient”:{“minWireVersion”:0,“maxWireVersion”:13},“incomingInternalClient”:{“minWireVersion”:0,“maxWireVersion”:13},“outgoing”:{“minWireVersion”:0,“maxWireVersion”:13},“isInternalClient”:true}}}
{“t”:{“$date”:“2023-07-04T03:49:58.251+00:00”},“s”:“W”, “c”:“ASIO”, “id”:22601, “ctx”:“main”,“msg”:“No TransportLayer configured during NetworkInterface startup”}
{“t”:{“$date”:“2023-07-04T03:49:58.252+00:00”},“s”:“I”, “c”:“NETWORK”, “id”:4648601, “ctx”:“main”,“msg”:“Implicit TCP FastOpen unavailable. If TCP FastOpen is required, set tcpFastOpenServer, tcpFastOpenClient, and tcpFastOpenQueueSize.”}
{“t”:{“$date”:“2023-07-04T03:49:58.395+00:00”},“s”:“W”, “c”:“ASIO”, “id”:22601, “ctx”:“main”,“msg”:“No TransportLayer configured during NetworkInterface startup”}
{“t”:{“$date”:“2023-07-04T03:49:58.395+00:00”},“s”:“W”, “c”:“ASIO”, “id”:22601, “ctx”:“main”,“msg”:“No TransportLayer configured during NetworkInterface startup”}
{“t”:{“$date”:“2023-07-04T03:49:58.395+00:00”},“s”:“I”, “c”:“REPL”, “id”:5123008, “ctx”:“main”,“msg”:“Successfully registered PrimaryOnlyService”,“attr”:{“service”:“TenantMigrationDonorService”,“ns”:“config.tenantMigrationDonors”}}
{“t”:{“$date”:“2023-07-04T03:49:58.395+00:00”},“s”:“I”, “c”:“REPL”, “id”:5123008, “ctx”:“main”,“msg”:“Successfully registered PrimaryOnlyService”,“attr”:{“service”:“TenantMigrationRecipientService”,“ns”:“config.tenantMigrationRecipients”}}
{“t”:{“$date”:“2023-07-04T03:49:58.396+00:00”},“s”:“I”, “c”:“CONTROL”, “id”:5945603, “ctx”:“main”,“msg”:“Multi threading initialized”}
{“t”:{“$date”:“2023-07-04T03:49:58.398+00:00”},“s”:“I”, “c”:“CONTROL”, “id”:4615611, “ctx”:“initandlisten”,“msg”:“MongoDB starting”,“attr”:{“pid”:1,“port”:27017,“dbPath”:“/bitnami/mongodb/data/db”,“architecture”:“64-bit”,“host”:“pxc-backup-mongodb-0”}}
{“t”:{“$date”:“2023-07-04T03:49:58.399+00:00”},“s”:“I”, “c”:“CONTROL”, “id”:23403, “ctx”:“initandlisten”,“msg”:“Build Info”,“attr”:{“buildInfo”:{“version”:“5.0.14”,“gitVersion”:“1b3b0073a0b436a8a502b612f24fb2bd572772e5”,“openSSLVersion”:“OpenSSL 1.1.1n 15 Mar 2022”,“modules”:,“allocator”:“tcmalloc”,“environment”:{“distmod”:“debian11”,“distarch”:“x86_64”,“target_arch”:“x86_64”}}}}
{“t”:{“$date”:“2023-07-04T03:49:58.399+00:00”},“s”:“I”, “c”:“CONTROL”, “id”:51765, “ctx”:“initandlisten”,“msg”:“Operating System”,“attr”:{“os”:{“name”:“PRETTY_NAME="Debian GNU/Linux 11 (bullseye)"”,“version”:“Kernel 4.18.0-372.53.1.el8_6.x86_64”}}}
{“t”:{“$date”:“2023-07-04T03:49:58.399+00:00”},“s”:“I”, “c”:“CONTROL”, “id”:21951, “ctx”:“initandlisten”,“msg”:“Options set by command line”,“attr”:{“options”:{“config”:“/opt/bitnami/mongodb/conf/mongodb.conf”,“net”:{“bindIp”:“*”,“ipv6”:false,“port”:27017,“unixDomainSocket”:{“enabled”:true,“pathPrefix”:“/opt/bitnami/mongodb/tmp”}},“processManagement”:{“fork”:false,“pidFilePath”:“/opt/bitnami/mongodb/tmp/mongodb.pid”},“replication”:{“enableMajorityReadConcern”:true,“replSetName”:“rs0”},“security”:{“authorization”:“enabled”,“keyFile”:“/opt/bitnami/mongodb/conf/keyfile”},“setParameter”:{“enableLocalhostAuthBypass”:“false”},“storage”:{“dbPath”:“/bitnami/mongodb/data/db”,“directoryPerDB”:false,“journal”:{“enabled”:true},“wiredTiger”:{“engineConfig”:{“cacheSizeGB”:4}}},“systemLog”:{“destination”:“file”,“logAppend”:true,“logRotate”:“reopen”,“path”:“/opt/bitnami/mongodb/logs/mongodb.log”,“quiet”:false,“verbosity”:0}}}}
{“t”:{“$date”:“2023-07-04T03:49:58.402+00:00”},“s”:“I”, “c”:“STORAGE”, “id”:22270, “ctx”:“initandlisten”,“msg”:“Storage engine to use detected by data files”,“attr”:{“dbpath”:“/bitnami/mongodb/data/db”,“storageEngine”:“wiredTiger”}}
{“t”:{“$date”:“2023-07-04T03:49:58.402+00:00”},“s”:“I”, “c”:“STORAGE”, “id”:22297, “ctx”:“initandlisten”,“msg”:“Using the XFS filesystem is strongly recommended with the WiredTiger storage engine. See http://dochub.mongodb.org/core/prodnotes-filesystem",“tags”:["startupWarnings”]}
{“t”:{“$date”:“2023-07-04T03:49:58.402+00:00”},“s”:“I”, “c”:“STORAGE”, “id”:22315, “ctx”:“initandlisten”,“msg”:“Opening WiredTiger”,“attr”:{“config”:“create,cache_size=4096M,session_max=33000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),builtin_extension_config=(zstd=(compression_level=6)),file_manager=(close_idle_time=600,close_scan_interval=10,close_handle_minimum=250),statistics_log=(wait=0),verbose=[recovery_progress,checkpoint_progress,compact_progress],”}}
{“t”:{“$date”:“2023-07-04T03:50:00.336+00:00”},“s”:“I”, “c”:“STORAGE”, “id”:22430, “ctx”:“initandlisten”,“msg”:“WiredTiger message”,“attr”:{“message”:“[1688442600:336346][1:0x7f7e3d483c80], txn-recover: [WT_VERB_RECOVERY_PROGRESS] Recovering log 6 through 7”}}
{“t”:{“$date”:“2023-07-04T03:50:00.580+00:00”},“s”:“I”, “c”:“STORAGE”, “id”:22430, “ctx”:“initandlisten”,“msg”:“WiredTiger message”,“attr”:{“message”:“[1688442600:580862][1:0x7f7e3d483c80], txn-recover: [WT_VERB_RECOVERY_PROGRESS] Recovering log 7 through 7”}}
{“t”:{“$date”:“2023-07-04T03:50:00.953+00:00”},“s”:“I”, “c”:“STORAGE”, “id”:22430, “ctx”:“initandlisten”,“msg”:“WiredTiger message”,“attr”:{“message”:“[1688442600:953276][1:0x7f7e3d483c80], txn-recover: [WT_VERB_RECOVERY_ALL] Main recovery loop: starting at 6/13056 to 7/256”}}
{“t”:{“$date”:“2023-07-04T03:50:11.345+00:00”},“s”:“I”, “c”:“STORAGE”, “id”:22430, “ctx”:“initandlisten”,“msg”:“WiredTiger message”,“attr”:{“message”:“[1688442611:345730][1:0x7f7e3d483c80], txn-recover: [WT_VERB_RECOVERY_PROGRESS] Recovering log 6 through 7”}}
{“t”:{“$date”:“2023-07-04T03:50:11.754+00:00”},“s”:“I”, “c”:“STORAGE”, “id”:22430, “ctx”:“initandlisten”,“msg”:“WiredTiger message”,“attr”:{“message”:“[1688442611:754530][1:0x7f7e3d483c80], txn-recover: [WT_VERB_RECOVERY_PROGRESS] Recovering log 7 through 7”}}
{“t”:{“$date”:“2023-07-04T03:50:11.953+00:00”},“s”:“I”, “c”:“STORAGE”, “id”:22430, “ctx”:“initandlisten”,“msg”:“WiredTiger message”,“attr”:{“message”:“[1688442611:953854][1:0x7f7e3d483c80], txn-recover: [WT_VERB_RECOVERY_ALL] Set global recovery timestamp: (0, 0)”}}
{“t”:{“$date”:“2023-07-04T03:50:11.954+00:00”},“s”:“I”, “c”:“STORAGE”, “id”:22430, “ctx”:“initandlisten”,“msg”:“WiredTiger message”,“attr”:{“message”:“[1688442611:954000][1:0x7f7e3d483c80], txn-recover: [WT_VERB_RECOVERY_ALL] Set global oldest timestamp: (0, 0)”}}
{“t”:{“$date”:“2023-07-04T03:50:11.961+00:00”},“s”:“I”, “c”:“STORAGE”, “id”:22430, “ctx”:“initandlisten”,“msg”:“WiredTiger message”,“attr”:{“message”:“[1688442611:961538][1:0x7f7e3d483c80], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 1, snapshot max: 1 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0) base write gen: 195”}}
{“t”:{“$date”:“2023-07-04T03:50:12.377+00:00”},“s”:“I”, “c”:“STORAGE”, “id”:4795906, “ctx”:“initandlisten”,“msg”:“WiredTiger opened”,“attr”:{“durationMillis”:13974}}
{“t”:{“$date”:“2023-07-04T03:50:12.377+00:00”},“s”:“I”, “c”:“RECOVERY”, “id”:23987, “ctx”:“initandlisten”,“msg”:“WiredTiger recoveryTimestamp”,“attr”:{“recoveryTimestamp”:{“$timestamp”:{“t”:0,“i”:0}}}}
{“t”:{“$date”:“2023-07-04T03:50:12.403+00:00”},“s”:“I”, “c”:“STORAGE”, “id”:22262, “ctx”:“initandlisten”,“msg”:“Timestamp monitor starting”}
{“t”:{“$date”:“2023-07-04T03:50:12.551+00:00”},“s”:“W”, “c”:“CONTROL”, “id”:22167, “ctx”:“initandlisten”,“msg”:“You are running on a NUMA machine. We suggest launching mongod like this to avoid performance problems: numactl --interleave=all mongod [other options]”,“tags”:[“startupWarnings”]}
{“t”:{“$date”:“2023-07-04T03:50:12.552+00:00”},“s”:“W”, “c”:“CONTROL”, “id”:22178, “ctx”:“initandlisten”,“msg”:“/sys/kernel/mm/transparent_hugepage/enabled is ‘always’. We suggest setting it to ‘never’”,“tags”:[“startupWarnings”]}
{“t”:{“$date”:“2023-07-04T03:50:12.568+00:00”},“s”:“I”, “c”:“NETWORK”, “id”:4915702, “ctx”:“initandlisten”,“msg”:“Updated wire specification”,“attr”:{“oldSpec”:{“incomingExternalClient”:{“minWireVersion”:0,“maxWireVersion”:13},“incomingInternalClient”:{“minWireVersion”:0,“maxWireVersion”:13},“outgoing”:{“minWireVersion”:0,“maxWireVersion”:13},“isInternalClient”:true},“newSpec”:{“incomingExternalClient”:{“minWireVersion”:0,“maxWireVersion”:13},“incomingInternalClient”:{“minWireVersion”:13,“maxWireVersion”:13},“outgoing”:{“minWireVersion”:13,“maxWireVersion”:13},“isInternalClient”:true}}}
{“t”:{“$date”:“2023-07-04T03:50:12.568+00:00”},“s”:“I”, “c”:“STORAGE”, “id”:5071100, “ctx”:“initandlisten”,“msg”:“Clearing temp directory”}
{“t”:{“$date”:“2023-07-04T03:50:12.582+00:00”},“s”:“I”, “c”:“CONTROL”, “id”:20536, “ctx”:“initandlisten”,“msg”:“Flow Control is enabled on this deployment”}
{“t”:{“$date”:“2023-07-04T03:50:12.594+00:00”},“s”:“I”, “c”:“SHARDING”, “id”:20997, “ctx”:“initandlisten”,“msg”:“Refreshed RWC defaults”,“attr”:{“newDefaults”:{}}}
{“t”:{“$date”:“2023-07-04T03:50:12.606+00:00”},“s”:“I”, “c”:“FTDC”, “id”:20625, “ctx”:“initandlisten”,“msg”:“Initializing full-time diagnostic data capture”,“attr”:{“dataDirectory”:“/bitnami/mongodb/data/db/diagnostic.data”}}
{“t”:{“$date”:“2023-07-04T03:50:12.621+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“ReadConcernMajorityNotAvailableYet: Read concern majority reads are currently not possible.”,“nextWakeupMillis”:200}}
{“t”:{“$date”:“2023-07-04T03:50:12.626+00:00”},“s”:“I”, “c”:“REPL”, “id”:6015317, “ctx”:“initandlisten”,“msg”:“Setting new configuration state”,“attr”:{“newState”:“ConfigStartingUp”,“oldState”:“ConfigPreStart”}}
{“t”:{“$date”:“2023-07-04T03:50:12.633+00:00”},“s”:“I”, “c”:“REPL”, “id”:4280500, “ctx”:“initandlisten”,“msg”:“Attempting to create internal replication collections”}
{“t”:{“$date”:“2023-07-04T03:50:12.641+00:00”},“s”:“I”, “c”:“REPL”, “id”:4280501, “ctx”:“initandlisten”,“msg”:“Attempting to load local voted for document”}
{“t”:{“$date”:“2023-07-04T03:50:12.641+00:00”},“s”:“I”, “c”:“REPL”, “id”:21311, “ctx”:“initandlisten”,“msg”:“Did not find local initialized voted for document at startup”}
{“t”:{“$date”:“2023-07-04T03:50:12.641+00:00”},“s”:“I”, “c”:“REPL”, “id”:4280502, “ctx”:“initandlisten”,“msg”:“Searching for local Rollback ID document”}
{“t”:{“$date”:“2023-07-04T03:50:12.648+00:00”},“s”:“I”, “c”:“REPL”, “id”:21529, “ctx”:“initandlisten”,“msg”:“Initializing rollback ID”,“attr”:{“rbid”:1}}
{“t”:{“$date”:“2023-07-04T03:50:12.649+00:00”},“s”:“I”, “c”:“REPL”, “id”:21313, “ctx”:“initandlisten”,“msg”:“Did not find local replica set configuration document at startup”,“attr”:{“error”:{“code”:47,“codeName”:“NoMatchingDocument”,“errmsg”:“Did not find replica set configuration document in local.system.replset”}}}
{“t”:{“$date”:“2023-07-04T03:50:12.649+00:00”},“s”:“I”, “c”:“REPL”, “id”:6015317, “ctx”:“initandlisten”,“msg”:“Setting new configuration state”,“attr”:{“newState”:“ConfigUninitialized”,“oldState”:“ConfigStartingUp”}}
{“t”:{“$date”:“2023-07-04T03:50:12.653+00:00”},“s”:“I”, “c”:“CONTROL”, “id”:20714, “ctx”:“LogicalSessionCacheRefresh”,“msg”:“Failed to refresh session cache, will try again at the next refresh interval”,“attr”:{“error”:“NotYetInitialized: Replication has not yet been configured”}}
{“t”:{“$date”:“2023-07-04T03:50:12.657+00:00”},“s”:“I”, “c”:“REPL”, “id”:40440, “ctx”:“initandlisten”,“msg”:“Starting the TopologyVersionObserver”}
{“t”:{“$date”:“2023-07-04T03:50:12.657+00:00”},“s”:“I”, “c”:“CONTROL”, “id”:20711, “ctx”:“LogicalSessionCacheReap”,“msg”:“Failed to reap transaction table”,“attr”:{“error”:“NotYetInitialized: Replication has not yet been configured”}}
{“t”:{“$date”:“2023-07-04T03:50:12.657+00:00”},“s”:“I”, “c”:“REPL”, “id”:40445, “ctx”:“TopologyVersionObserver”,“msg”:“Started TopologyVersionObserver”}
{“t”:{“$date”:“2023-07-04T03:50:12.660+00:00”},“s”:“I”, “c”:“NETWORK”, “id”:23015, “ctx”:“listener”,“msg”:“Listening on”,“attr”:{“address”:“/opt/bitnami/mongodb/tmp/mongodb-27017.sock”}}
{“t”:{“$date”:“2023-07-04T03:50:12.660+00:00”},“s”:“I”, “c”:“NETWORK”, “id”:23015, “ctx”:“listener”,“msg”:“Listening on”,“attr”:{“address”:“0.0.0.0”}}
{“t”:{“$date”:“2023-07-04T03:50:12.660+00:00”},“s”:“I”, “c”:“NETWORK”, “id”:23016, “ctx”:“listener”,“msg”:“Waiting for connections”,“attr”:{“port”:27017,“ssl”:“off”}}
{“t”:{“$date”:“2023-07-04T03:50:12.823+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:400}}
{“t”:{“$date”:“2023-07-04T03:50:13.224+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:600}}
{“t”:{“$date”:“2023-07-04T03:50:13.827+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:800}}
{“t”:{“$date”:“2023-07-04T03:50:14.630+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:1000}}
{“t”:{“$date”:“2023-07-04T03:50:15.631+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:1200}}
{“t”:{“$date”:“2023-07-04T03:50:16.842+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:1400}}
{“t”:{“$date”:“2023-07-04T03:50:18.244+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:1600}}
{“t”:{“$date”:“2023-07-04T03:50:19.848+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:1800}}
{“t”:{“$date”:“2023-07-04T03:50:21.657+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:2000}}
{“t”:{“$date”:“2023-07-04T03:50:23.659+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:2200}}
{“t”:{“$date”:“2023-07-04T03:50:25.861+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:2400}}
{“t”:{“$date”:“2023-07-04T03:50:28.264+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:2600}}
{“t”:{“$date”:“2023-07-04T03:50:30.868+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:2800}}
{“t”:{“$date”:“2023-07-04T03:50:33.672+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:3000}}
{“t”:{“$date”:“2023-07-04T03:50:36.674+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:3200}}
{“t”:{“$date”:“2023-07-04T03:50:39.877+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:3400}}
{“t”:{“$date”:“2023-07-04T03:50:43.282+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:3600}}
{“t”:{“$date”:“2023-07-04T03:50:46.889+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:3800}}
{“t”:{“$date”:“2023-07-04T03:50:50.694+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:4000}}
{“t”:{“$date”:“2023-07-04T03:50:54.698+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:4200}}
{“t”:{“$date”:“2023-07-04T03:50:58.903+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:4400}}
{“t”:{“$date”:“2023-07-04T03:51:01.866+00:00”},“s”:“I”, “c”:“NETWORK”, “id”:22943, “ctx”:“listener”,“msg”:“Connection accepted”,“attr”:{“remote”:“127.0.0.1:54114”,“uuid”:“3eab4259-0866-42a8-90fd-22fbb06e4de0”,“connectionId”:1,“connectionCount”:1}}
{“t”:{“$date”:“2023-07-04T03:51:01.867+00:00”},“s”:“I”, “c”:“NETWORK”, “id”:51800, “ctx”:“conn1”,“msg”:“client metadata”,“attr”:{“remote”:“127.0.0.1:54114”,“client”:“conn1”,“doc”:{“application”:{“name”:“MongoDB Shell”},“driver”:{“name”:“MongoDB Internal Client”,“version”:“5.0.14”},“os”:{“type”:“Linux”,“name”:“PRETTY_NAME="Debian GNU/Linux 11 (bullseye)"”,“architecture”:“x86_64”,“version”:“Kernel 4.18.0-372.53.1.el8_6.x86_64”}}}}
{“t”:{“$date”:“2023-07-04T03:51:01.882+00:00”},“s”:“I”, “c”:“NETWORK”, “id”:22944, “ctx”:“conn1”,“msg”:“Connection ended”,“attr”:{“remote”:“127.0.0.1:54114”,“uuid”:“3eab4259-0866-42a8-90fd-22fbb06e4de0”,“connectionId”:1,“connectionCount”:0}}
{“t”:{“$date”:“2023-07-04T03:51:03.309+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:4600}}
{“t”:{“$date”:“2023-07-04T03:51:06.356+00:00”},“s”:“I”, “c”:“NETWORK”, “id”:22943, “ctx”:“listener”,“msg”:“Connection accepted”,“attr”:{“remote”:“127.0.0.1:54130”,“uuid”:“bc4b5c1c-36fe-4ed1-8f7a-910dc37d4ea5”,“connectionId”:2,“connectionCount”:1}}
{“t”:{“$date”:“2023-07-04T03:51:06.357+00:00”},“s”:“I”, “c”:“NETWORK”, “id”:51800, “ctx”:“conn2”,“msg”:“client metadata”,“attr”:{“remote”:“127.0.0.1:54130”,“client”:“conn2”,“doc”:{“application”:{“name”:“MongoDB Shell”},“driver”:{“name”:“MongoDB Internal Client”,“version”:“5.0.14”},“os”:{“type”:“Linux”,“name”:“PRETTY_NAME="Debian GNU/Linux 11 (bullseye)"”,“architecture”:“x86_64”,“version”:“Kernel 4.18.0-372.53.1.el8_6.x86_64”}}}}
{“t”:{“$date”:“2023-07-04T03:51:06.374+00:00”},“s”:“I”, “c”:“NETWORK”, “id”:22944, “ctx”:“conn2”,“msg”:“Connection ended”,“attr”:{“remote”:“127.0.0.1:54130”,“uuid”:“bc4b5c1c-36fe-4ed1-8f7a-910dc37d4ea5”,“connectionId”:2,“connectionCount”:0}}
{“t”:{“$date”:“2023-07-04T03:51:07.912+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:4800}}
{“t”:{“$date”:“2023-07-04T03:51:11.802+00:00”},“s”:“I”, “c”:“NETWORK”, “id”:22943, “ctx”:“listener”,“msg”:“Connection accepted”,“attr”:{“remote”:“127.0.0.1:58780”,“uuid”:“d00d613f-c1ef-4cd8-9a65-8da747a1b9a4”,“connectionId”:3,“connectionCount”:1}}
{“t”:{“$date”:“2023-07-04T03:51:11.803+00:00”},“s”:“I”, “c”:“NETWORK”, “id”:51800, “ctx”:“conn3”,“msg”:“client metadata”,“attr”:{“remote”:“127.0.0.1:58780”,“client”:“conn3”,“doc”:{“application”:{“name”:“MongoDB Shell”},“driver”:{“name”:“MongoDB Internal Client”,“version”:“5.0.14”},“os”:{“type”:“Linux”,“name”:“PRETTY_NAME="Debian GNU/Linux 11 (bullseye)"”,“architecture”:“x86_64”,“version”:“Kernel 4.18.0-372.53.1.el8_6.x86_64”}}}}
{“t”:{“$date”:“2023-07-04T03:51:11.824+00:00”},“s”:“I”, “c”:“NETWORK”, “id”:22944, “ctx”:“conn3”,“msg”:“Connection ended”,“attr”:{“remote”:“127.0.0.1:58780”,“uuid”:“d00d613f-c1ef-4cd8-9a65-8da747a1b9a4”,“connectionId”:3,“connectionCount”:0}}
{“t”:{“$date”:“2023-07-04T03:51:12.551+00:00”},“s”:“I”, “c”:“STORAGE”, “id”:22430, “ctx”:“Checkpointer”,“msg”:“WiredTiger message”,“attr”:{“message”:“[1688442672:551648][1:0x7f7e34c71700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 3, snapshot max: 3 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0) base write gen: 195”}}
{“t”:{“$date”:“2023-07-04T03:51:12.719+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:5000}}
{“t”:{“$date”:“2023-07-04T03:51:17.735+00:00”},“s”:“I”, “c”:“-”, “id”:4939300, “ctx”:“monitoring-keys-for-HMAC”,“msg”:“Failed to refresh key cache”,“attr”:{“error”:“NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.”,“nextWakeupMillis”:5200}}
{“t”:{“$date”:“2023-07-04T03:51:21.756+00:00”},“s”:“I”, “c”:“NETWORK”, “id”:22943, “ctx”:“listener”,“msg”:“Connection accepted”,“attr”:{“remote”:“127.0.0.1:35408”,“uuid”:“e9c000bc-ecbf-400b-a69d-b8a9ebccda41”,“connectionId”:4,“connectionCount”:1}}

Thanks