初探elasticsearch集群
·
集群概览：
{
"cluster_name": "3e4500835f604a89b762f0e854d3747f",
"status": "green",
"timed_out": false,
"number_of_nodes": 3,
"number_of_data_nodes": 2,
"active_primary_shards": 89,
"active_shards": 178,
"relocating_shards": 0,
"initializing_shards": 0,
"unassigned_shards": 0,
"delayed_unassigned_shards": 0,
"number_of_pending_tasks": 0,
"number_of_in_flight_fetch": 0,
"task_max_waiting_in_queue_millis": 0,
"active_shards_percent_as_number": 100.0
}
验证
1、 首先确认集群状态和节点情况:
# 查看集群健康状态
GET /_cluster/health
curl --location 'https://easylive.es.ap-east-1.aws.elastic-cloud.com' \
--header 'Authorization: Basic ZWxhcgg3RpYzp0YXlCYmhHUmNlYVRKd09uRDRNMm9UM1M='
- 结果：3 个节点，两个数据节点。
{
"name": "instance-0000000001",
"cluster_name": "3e4500835f604a89b762f0e854d3747f",
"cluster_uuid": "T7zNP_vTRMqXi6NTA6fMJg",
"version": {
"number": "7.17.25",
"build_flavor": "default",
"build_type": "docker",
"build_hash": "f9b6b57d1d0f76e2d14291c04fb50abeb642cfbf",
"build_date": "2024-10-16T22:06:36.904732810Z",
"build_snapshot": false,
"lucene_version": "8.11.3",
"minimum_wire_compatibility_version": "6.8.0",
"minimum_index_compatibility_version": "6.0.0-beta1"
},
"tagline": "You Know, for Search"
}
# 查看节点列表和角色
GET /_cat/nodes?v
curl请求
curl --location 'https://easylive.es.ap-east-1.aws.elastic-cloud.com/_cat/nodes?v=null' \
--header 'Authorization: Basic ZWxhcgg3RpYzp0YXlCYmhHUmNlYVRKd09uRDRNMm9UM1M='
- 结果:
ip heap.percent ram.percent cpu load_1m load_5m load_15m node.role master name
172.20.73.20 62 65 2 1.76 1.97 2.19 himrst * instance-0000000000
172.20.78.28 32 96 0 2.44 2.19 2.18 mv - tiebreaker-0000000002
172.20.81.38 65 65 1 4.40 4.36 4.02 himrst - instance-0000000001
说明
- node.role
解释: 节点的角色。示例值: himrst
说明: 节点的角色为 himrst。可能表示节点具有多种角色（如 h 表示数据节点，i 表示索引节点，m 表示主节点，r 表示远程节点，s 表示搜索节点，t 表示传输节点）。
- master
解释: 节点是否是主节点。示例值: * 或 -
说明:
- 表示该节点是主节点。
- 表示该节点不是主节点。
- 查看分片分配情况
GET /_cat/shards?v
curl·
curl --location 'https://easylive.es.ap-east-1.aws.elastic-cloud.com/_cat/shards?v=null' \
--header 'Authorization: Basic ZWxhcgg3RpYzp0YXlCYmhHUmNlYVRKd09uRDRNMm9UM1M=' \
--header 'Content-Type: text/plain' \
--data-binary '@'
- 结果：
index shard prirep state docs store ip node
.ent-search-actastic-oauth_access_tokens 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-oauth_access_tokens 0 r STARTED 172.20.73.20 instance-0000000000
.ds-.slm-history-5-2024.12.01-000001 0 p STARTED 172.20.81.38 instance-0000000001
.ds-.slm-history-5-2024.12.01-000001 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-crawler_process_crawls 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-crawler_process_crawls 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-workplace_search_content_source_user_identities_v3 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-workplace_search_content_source_user_identities_v3 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-workplace_search_invitations_v2-code-unique-constraint 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-workplace_search_invitations_v2-code-unique-constraint 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-app_search_invitations_v3 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-app_search_invitations_v3 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-workplace_search_search_groups_v4-name-unique-constraint 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-workplace_search_search_groups_v4-name-unique-constraint 0 r STARTED 172.20.73.20 instance-0000000000
.fleet-policies-7 0 p STARTED 6 31.7kb 172.20.81.38 instance-0000000001
.fleet-policies-7 0 r STARTED 6 31.7kb 172.20.73.20 instance-0000000000
.ent-search-actastic-app_search_crawler_content_metadata-content_hash-engine_oid-unique-constraint 0 r STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-app_search_crawler_content_metadata-content_hash-engine_oid-unique-constraint 0 p STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-workplace_search_invitations_v2 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-workplace_search_invitations_v2 0 r STARTED 172.20.73.20 instance-0000000000
apm-7.17.25-metric-000001 0 p STARTED 0 227b 172.20.81.38 instance-0000000001
apm-7.17.25-metric-000001 0 r STARTED 0 227b 172.20.73.20 instance-0000000000
.kibana_task_manager_7.17.25_001 0 p STARTED 18 488.3kb 172.20.81.38 instance-0000000001
.kibana_task_manager_7.17.25_001 0 r STARTED 18 2.3mb 172.20.73.20 instance-0000000000
.ent-search-actastic-app_search_role_mappings_v4 0 r STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-app_search_role_mappings_v4 0 p STARTED 172.20.73.20 instance-0000000000
.fleet-servers-7 0 p STARTED 1 53.7kb 172.20.81.38 instance-0000000001
.fleet-servers-7 0 r STARTED 1 84.7kb 172.20.73.20 instance-0000000000
.ent-search-actastic-search_relevance_suggestion_update_process_v1 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-search_relevance_suggestion_update_process_v1 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-users_v6-auth_source-elasticsearch_username-unique-constraint 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-users_v6-auth_source-elasticsearch_username-unique-constraint 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-crawler_domains_v5-engine_oid-name-unique-constraint 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-crawler_domains_v5-engine_oid-name-unique-constraint 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-oauth_access_tokens-token-unique-constraint 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-oauth_access_tokens-token-unique-constraint 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-search-relevance-suggestions-ecs-ilm-logs-production-2024.12.01-000001 0 p STARTED 0 227b 172.20.81.38 instance-0000000001
.ent-search-search-relevance-suggestions-ecs-ilm-logs-production-2024.12.01-000001 0 r STARTED 0 227b 172.20.73.20 instance-0000000000
.kibana_7.17.25_001 0 r STARTED 2068 5.2mb 172.20.81.38 instance-0000000001
.kibana_7.17.25_001 0 p STARTED 2068 5.2mb 172.20.73.20 instance-0000000000
.ent-search-actastic-crawler_crawl_requests_v7 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-crawler_crawl_requests_v7 0 r STARTED 172.20.73.20 instance-0000000000
.apm-agent-configuration 0 p STARTED 0 227b 172.20.81.38 instance-0000000001
.apm-agent-configuration 0 r STARTED 0 227b 172.20.73.20 instance-0000000000
.ent-search-esqueues-me_queue_v1_process_crawl 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-esqueues-me_queue_v1_process_crawl 0 r STARTED 172.20.73.20 instance-0000000000
.geoip_databases 0 r STARTED 37 35.3mb 172.20.81.38 instance-0000000001
.geoip_databases 0 p STARTED 37 35.3mb 172.20.73.20 instance-0000000000
.ent-search-app-search-analytics-ecs-ilm-logs-production-2024.12.01-000001 0 r STARTED 0 227b 172.20.81.38 instance-0000000001
.ent-search-app-search-analytics-ecs-ilm-logs-production-2024.12.01-000001 0 p STARTED 0 227b 172.20.73.20 instance-0000000000
.fleet-policies-leader-7 0 p STARTED 2 104.1kb 172.20.81.38 instance-0000000001
.fleet-policies-leader-7 0 r STARTED 2 127.2kb 172.20.73.20 instance-0000000000
.ent-search-actastic-oauth_access_grants-token-unique-constraint 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-oauth_access_grants-token-unique-constraint 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-crawler_domains_v5 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-crawler_domains_v5 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-app_search_crawler_content_metadata 0 r STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-app_search_crawler_content_metadata 0 p STARTED 172.20.73.20 instance-0000000000
apm-7.17.25-transaction-000001 0 p STARTED 0 227b 172.20.81.38 instance-0000000001
apm-7.17.25-transaction-000001 0 r STARTED 0 227b 172.20.73.20 instance-0000000000
.ds-.logs-deprecation.elasticsearch-default-2024.12.01-000001 0 p STARTED 172.20.81.38 instance-0000000001
.ds-.logs-deprecation.elasticsearch-default-2024.12.01-000001 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-workplace_search_organizations_v16 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-workplace_search_organizations_v16 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-api-ecs-ilm-logs-production-2024.12.01-000001 0 p STARTED 2 31.3kb 172.20.81.38 instance-0000000001
.ent-search-api-ecs-ilm-logs-production-2024.12.01-000001 0 r STARTED 2 31.3kb 172.20.73.20 instance-0000000000
.ent-search-actastic-oauth_applications_v2 0 r STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-oauth_applications_v2 0 p STARTED 172.20.73.20 instance-0000000000
.ent-search-workplace-search-analytics-ecs-ilm-logs-production-2024.12.01-000001 0 p STARTED 0 227b 172.20.81.38 instance-0000000001
.ent-search-workplace-search-analytics-ecs-ilm-logs-production-2024.12.01-000001 0 r STARTED 0 227b 172.20.73.20 instance-0000000000
.fleet-agents-7 0 p STARTED 1 355.5kb 172.20.81.38 instance-0000000001
.fleet-agents-7 0 r STARTED 1 179.5kb 172.20.73.20 instance-0000000000
.ent-search-actastic-togo_migrations_v1 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-togo_migrations_v1 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-engines_v19 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-engines_v19 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-app_search_document_position_queries_v4 0 r STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-app_search_document_position_queries_v4 0 p STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-workplace_search_accounts_v16 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-workplace_search_accounts_v16 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-esqueues-me_queue_v1_mailer 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-esqueues-me_queue_v1_mailer 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-app_search_document_positions_v3 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-app_search_document_positions_v3 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-oauth_applications_v2-uid-unique-constraint 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-oauth_applications_v2-uid-unique-constraint 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-crawler_robots_txts_v3 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-crawler_robots_txts_v3 0 r STARTED 172.20.73.20 instance-0000000000
.fleet-enrollment-api-keys-7 0 p STARTED 2 11.6kb 172.20.81.38 instance-0000000001
.fleet-enrollment-api-keys-7 0 r STARTED 2 11.6kb 172.20.73.20 instance-0000000000
apm-7.17.25-onboarding-2024.12.01 0 p STARTED 1 8.5kb 172.20.81.38 instance-0000000001
apm-7.17.25-onboarding-2024.12.01 0 r STARTED 1 8.5kb 172.20.73.20 instance-0000000000
.ent-search-db-lock-20200304 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-db-lock-20200304 0 r STARTED 172.20.73.20 instance-0000000000
apm-7.17.25-profile-000001 0 p STARTED 0 227b 172.20.81.38 instance-0000000001
apm-7.17.25-profile-000001 0 r STARTED 0 227b 172.20.73.20 instance-0000000000
.ent-search-actastic-workplace_search_accounts_v16-user_oid-unique-constraint 0 r STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-workplace_search_accounts_v16-user_oid-unique-constraint 0 p STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-connectors_jobs_v5 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-connectors_jobs_v5 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-app_search_search_settings 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-app_search_search_settings 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-synonyms 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-synonyms 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-telemetry_status_v2 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-telemetry_status_v2 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-esqueues-me_queue_v1_engine_destroyer 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-esqueues-me_queue_v1_engine_destroyer 0 r STARTED 172.20.73.20 instance-0000000000
.ds-ilm-history-5-2024.12.01-000001 0 p STARTED 172.20.81.38 instance-0000000001
.ds-ilm-history-5-2024.12.01-000001 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-users_v6 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-users_v6 0 r STARTED 172.20.73.20 instance-0000000000
.kibana-event-log-7.17.25-000001 0 p STARTED 172.20.81.38 instance-0000000001
.kibana-event-log-7.17.25-000001 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-workplace_search_content_sources_v22 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-workplace_search_content_sources_v22 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-engines_v19-loco_moco_account_id-slug-unique-constraint 0 r STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-engines_v19-loco_moco_account_id-slug-unique-constraint 0 p STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-app_search_crawler_content_url_metadata 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-app_search_crawler_content_url_metadata 0 r STARTED 172.20.73.20 instance-0000000000
.kibana_security_session_1 0 p STARTED 172.20.81.38 instance-0000000001
.kibana_security_session_1 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-users_v6-email-unique-constraint 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-users_v6-email-unique-constraint 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-secret_keeper_secrets 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-secret_keeper_secrets 0 r STARTED 172.20.73.20 instance-0000000000
apm-7.17.25-error-000001 0 p STARTED 0 227b 172.20.81.38 instance-0000000001
apm-7.17.25-error-000001 0 r STARTED 0 227b 172.20.73.20 instance-0000000000
.ent-search-actastic-app_search_api_tokens_v3-authentication_token-unique-constraint 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-app_search_api_tokens_v3-authentication_token-unique-constraint 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-search_relevance_suggestions 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-search_relevance_suggestions 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-workplace-search-content-events-ecs-ilm-logs-production-2024.12.01-000001 0 p STARTED 0 227b 172.20.81.38 instance-0000000001
.ent-search-workplace-search-content-events-ecs-ilm-logs-production-2024.12.01-000001 0 r STARTED 0 227b 172.20.73.20 instance-0000000000
.security-tokens-7 0 p STARTED 4 37.5kb 172.20.81.38 instance-0000000001
.security-tokens-7 0 r STARTED 4 62kb 172.20.73.20 instance-0000000000
.ent-search-actastic-app_search_role_engines_v3 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-app_search_role_engines_v3 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-workplace_search_pre_content_sources_v3 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-workplace_search_pre_content_sources_v3 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-app_search_roles_v3 0 r STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-app_search_roles_v3 0 p STARTED 172.20.73.20 instance-0000000000
.security-7 0 p STARTED 92 282kb 172.20.81.38 instance-0000000001
.security-7 0 r STARTED 92 282kb 172.20.73.20 instance-0000000000
.ent-search-actastic-search_relevance_suggestions-document_position_id-unique-constraint 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-search_relevance_suggestions-document_position_id-unique-constraint 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-esqueues-me_worker_v1 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-esqueues-me_worker_v1 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-oauth_access_tokens-refresh_token-unique-constraint 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-oauth_access_tokens-refresh_token-unique-constraint 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-workplace_search_role_mappings_v5 0 r STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-workplace_search_role_mappings_v5 0 p STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-app_search_role_mapping_engines_v3 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-app_search_role_mapping_engines_v3 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-workplace_search_pre_content_sources_v3-context-workplace_search_account_id-service_type-unique-constraint 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-workplace_search_pre_content_sources_v3-context-workplace_search_account_id-service_type-unique-constraint 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-app_search_api_tokens_v3 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-app_search_api_tokens_v3 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-app_search_accounts_v10 0 r STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-app_search_accounts_v10 0 p STARTED 172.20.73.20 instance-0000000000
.ent-search-crawler-ecs-ilm-logs-production-2024.12.01-000001 0 p STARTED 0 227b 172.20.81.38 instance-0000000001
.ent-search-crawler-ecs-ilm-logs-production-2024.12.01-000001 0 r STARTED 0 227b 172.20.73.20 instance-0000000000
.ent-search-actastic-app_search_role_mapping_engines_v3-engine_oid-loco_togo_role_mapping_id-unique-constraint 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-app_search_role_mapping_engines_v3-engine_oid-loco_togo_role_mapping_id-unique-constraint 0 r STARTED 172.20.73.20 instance-0000000000
.apm-custom-link 0 r STARTED 0 227b 172.20.81.38 instance-0000000001
.apm-custom-link 0 p STARTED 0 227b 172.20.73.20 instance-0000000000
.ent-search-actastic-reindex_jobs 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-reindex_jobs 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-app_search_api_token_engines 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-app_search_api_token_engines 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-actastic-oauth_access_grants 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-oauth_access_grants 0 r STARTED 172.20.73.20 instance-0000000000
.ent-search-esqueues-me_queue_v1_failed 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-esqueues-me_queue_v1_failed 0 r STARTED 172.20.73.20 instance-0000000000
apm-7.17.25-span-000001 0 p STARTED 0 227b 172.20.81.38 instance-0000000001
apm-7.17.25-span-000001 0 r STARTED 0 227b 172.20.73.20 instance-0000000000
.ent-search-actastic-workplace_search_search_groups_v4 0 p STARTED 172.20.81.38 instance-0000000001
.ent-search-actastic-workplace_search_search_groups_v4 0 r STARTED 172.20.73.20 instance-0000000000
2. 进行写入测试:
# 创建测试索引
PUT /test_index
{
"settings": {
"number_of_shards": 1,
"number_of_replicas": 1
}
}
curl格式：
curl --location --request PUT 'https://easylive.es.ap-east-1.aws.elastic-cloud.com/test_index' \
--header 'Content-Type: application/json' \
--header 'Authorization: Basic ZWxhcgg3RpYzp0YXlCYmhHUmNlYVRKd09uRDRNMm9UM1M=' \
--data '{
"settings": {
"number_of_shards": 1,
"number_of_replicas": 1
}
}'
- 结果：
{
"acknowledged": true,
"shards_acknowledged": true,
"index": "test_index"
}
# 写入一些测试数据
POST /test_index/_doc
{
"field1": "test1",
"timestamp": "2024-01-20T10:00:00Z"
}
curl格式
curl --location 'https://easylive.es.ap-east-1.aws.elastic-cloud.com/test_index/_doc' \
--header 'Content-Type: application/json' \
--header 'Authorization: Basic ZWxhcgg3RpYzp0YXlCYmhHUmNlYVRKd09uRDRNMm9UM1M=' \
--data '{
"field1": "test1",
"timestamp": "2024-01-20T10:00:00Z"
}'
- 结果：
{
"_index": "test_index",
"_type": "_doc",
"_id": "2tnjgZMB0wgyUznk8RsJ",
"_version": 1,
"result": "created",
"_shards": {
"total": 2,
"successful": 2,
"failed": 0
},
"_seq_no": 0,
"_primary_term": 1
}
3. 验证数据同步
1. 先在主节点(instance-0000000000)上写入数据
POST /test_index/_doc
{
"test_field": "sync_test_1",
"timestamp": "2024-01-20T10:00:00Z",
"node": "master_node"
}
curl格式
curl --location 'https://easylive.es.ap-east-1.aws.elastic-cloud.com/test_index/_doc' \
--header 'Content-Type: application/json' \
--header 'Authorization: Basic ZWxhcgg3RpYzp0YXlCYmhHUmNlYVRKd09uRDRNMm9UM1M=' \
--data '{
"test_field": "sync_test_1",
"timestamp": "2024-01-20T10:00:00Z",
"node": "master_node"
}'
- 结果:
{
"_index": "test_index",
"_type": "_doc",
"_id": "29nrgZMB0wgyUznknhu2",
"_version": 1,
"result": "created",
"_shards": {
"total": 2,
"successful": 2,
"failed": 0
},
"_seq_no": 1,
"_primary_term": 1
}
- 确认数据写入成功
GET /test_index/_doc/29nrgZMB0wgyUznknhu2
- curl 格式
curl --location 'https://easylive.es.ap-east-1.aws.elastic-cloud.com/test_index/_doc/29nrgZMB0wgyUznknhu2' \
--header 'Authorization: Basic ZWxhcgg3RpYzp0YXlCYmhHUmNlYVRKd09uRDRNMm9UM1M='
- 结果：
{
"_index": "test_index",
"_type": "_doc",
"_id": "29nrgZMB0wgyUznknhu2",
"_version": 1,
"_seq_no": 1,
"_primary_term": 1,
"found": true,
"_source": {
"test_field": "sync_test_1",
"timestamp": "2024-01-20T10:00:00Z",
"node": "master_node"
}
}
- 在从节点(instance-0000000001)上验证数据，可以通过在查询时指定preference参数强制在从节点上查询
GET /test_index/_search?preference=_only_nodes:instance-0000000001
{
"query": {
"match": {
"test_field": "sync_test_1"
}
}
}
- curl 格式：
curl --location --request GET 'https://easylive.es.ap-east-1.aws.elastic-cloud.com/test_index/_search?preference=_only_nodes%3Ainstance-0000000001' \
--header 'Content-Type: application/json' \
--header 'Authorization: Basic ZWxhcgg3RpYzp0YXlCYmhHUmNlYVRKd09uRDRNMm9UM1M=' \
--data '{
"query": {
"match": {
"test_field": "sync_test_1"
}
}
}'
- 结果：
{
"took": 88,
"timed_out": false,
"_shards": {
"total": 1,
"successful": 1,
"skipped": 0,
"failed": 0
},
"hits": {
"total": {
"value": 1,
"relation": "eq"
},
"max_score": 0.2876821,
"hits": [
{
"_index": "test_index",
"_type": "_doc",
"_id": "29nrgZMB0wgyUznknhu2",
"_score": 0.2876821,
"_source": {
"test_field": "sync_test_1",
"timestamp": "2024-01-20T10:00:00Z",
"node": "master_node"
}
}
]
}
}
4. 监控同步状态:
1. 查看分片同步状态 - 特别关注instance-0000000000和instance-0000000001之间的同步GET /_cat/recovery?v&h=index,shard,time,type,stage,source_node,target_node,files,files_recovered
- curl 格式：
- 结果：
index shard time type stage source_node target_node files files_recovered
apm-7.17.25-profile-000001 0 14ms empty_store done n/a instance-0000000001 0 0
apm-7.17.25-profile-000001 0 34ms peer done instance-0000000001 instance-0000000000 1 1
.fleet-agents-7 0 20ms empty_store done n/a instance-0000000001 0 0
.fleet-agents-7 0 64ms peer done instance-0000000001 instance-0000000000 1 1
.fleet-enrollment-api-keys-7 0 17ms empty_store done n/a instance-0000000001 0 0
.fleet-enrollment-api-keys-7 0 65ms peer done instance-0000000001 instance-0000000000 1 1
.ent-search-workplace-search-analytics-ecs-ilm-logs-production-2024.12.01-000001 0 17ms empty_store done n/a instance-0000000001 0 0
.ent-search-workplace-search-analytics-ecs-ilm-logs-production-2024.12.01-000001 0 43ms peer done instance-0000000001 instance-0000000000 1 1
apm-7.17.25-transaction-000001 0 16ms empty_store done n/a instance-0000000001 0 0
apm-7.17.25-transaction-000001 0 35ms peer done instance-0000000001 instance-0000000000 1 1
.apm-agent-configuration 0 18ms empty_store done n/a instance-0000000001 0 0
.apm-agent-configuration 0 85ms peer done instance-0000000001 instance-0000000000 1 1
.ent-search-search-relevance-suggestions-ecs-ilm-logs-production-2024.12.01-000001 0 16ms empty_store done n/a instance-0000000001 0 0
.ent-search-search-relevance-suggestions-ecs-ilm-logs-production-2024.12.01-000001 0 45ms peer done instance-0000000001 instance-0000000000 1 1
apm-7.17.25-onboarding-2024.12.01 0 31ms empty_store done n/a instance-0000000001 0 0
apm-7.17.25-onboarding-2024.12.01 0 76ms peer done instance-0000000001 instance-0000000000 1 1
.ent-search-api-ecs-ilm-logs-production-2024.12.01-000001 0 19ms empty_store done n/a instance-0000000001 0 0
.ent-search-api-ecs-ilm-logs-production-2024.12.01-000001 0 39ms peer done instance-0000000001 instance-0000000000 1 1
.fleet-servers-7 0 24ms empty_store done n/a instance-0000000001 0 0
.fleet-servers-7 0 51ms peer done instance-0000000001 instance-0000000000 1 1
.fleet-policies-leader-7 0 18ms empty_store done n/a instance-0000000001 0 0
.fleet-policies-leader-7 0 59ms peer done instance-0000000001 instance-0000000000 1 1
.kibana_task_manager_7.17.25_001 0 16ms empty_store done n/a instance-0000000001 0 0
.kibana_task_manager_7.17.25_001 0 41ms peer done instance-0000000001 instance-0000000000 1 1
.security-tokens-7 0 13ms empty_store done n/a instance-0000000001 0 0
.security-tokens-7 0 39ms peer done instance-0000000001 instance-0000000000 1 1
.security-7 0 16ms empty_store done n/a instance-0000000001 0 0
.security-7 0 102ms peer done instance-0000000001 instance-0000000000 1 1
apm-7.17.25-span-000001 0 16ms empty_store done n/a instance-0000000001 0 0
apm-7.17.25-span-000001 0 52ms peer done instance-0000000001 instance-0000000000 1 1
apm-7.17.25-error-000001 0 19ms empty_store done n/a instance-0000000001 0 0
apm-7.17.25-error-000001 0 30ms peer done instance-0000000001 instance-0000000000 1 1
apm-7.17.25-metric-000001 0 15ms empty_store done n/a instance-0000000001 0 0
apm-7.17.25-metric-000001 0 35ms peer done instance-0000000001 instance-0000000000 1 1
.apm-custom-link 0 618ms peer done instance-0000000000 instance-0000000001 1 1
.apm-custom-link 0 21ms empty_store done n/a instance-0000000000 0 0
.ent-search-app-search-analytics-ecs-ilm-logs-production-2024.12.01-000001 0 542ms peer done instance-0000000000 instance-0000000001 1 1
.ent-search-app-search-analytics-ecs-ilm-logs-production-2024.12.01-000001 0 16ms empty_store done n/a instance-0000000000 0 0
.kibana_7.17.25_001 0 548ms peer done instance-0000000000 instance-0000000001 1 1
.kibana_7.17.25_001 0 19ms empty_store done n/a instance-0000000000 0 0
.ent-search-workplace-search-content-events-ecs-ilm-logs-production-2024.12.01-000001 0 21ms empty_store done n/a instance-0000000001 0 0
.ent-search-workplace-search-content-events-ecs-ilm-logs-production-2024.12.01-000001 0 50ms peer done instance-0000000001 instance-0000000000 1 1
.fleet-policies-7 0 18ms empty_store done n/a instance-0000000001 0 0
.fleet-policies-7 0 55ms peer done instance-0000000001 instance-0000000000 1 1
test_index 0 18ms empty_store done n/a instance-0000000001 0 0
test_index 0 35ms peer done instance-0000000001 instance-0000000000 1 1
.ent-search-crawler-ecs-ilm-logs-production-2024.12.01-000001 0 17ms empty_store done n/a instance-0000000001 0 0
.ent-search-crawler-ecs-ilm-logs-production-2024.12.01-000001 0 39ms peer done instance-0000000001 instance-0000000000 1 1
最直接方式
方式1 - 通过文档计数比对：# 查看每个节点上的文档数量
GET /_cat/nodes?v
GET /_cat/indices?v
# 然后插入一条测试数据
POST /test_index/_doc
{
"test": "sync_test",
"timestamp": "now"
}
# 立即再次查看文档数
GET /_cat/indices?v
如果两个节点的文档数一致，说明同步正常。
方式2 - 通过查询路由测试：
# 1. 先写入一条带ID的文档
POST /test_index/_doc/test_123
{
"message": "test message",
"timestamp": "now"
}
# 2. 分别在主节点和从节点上查询这条数据
GET /test_index/_doc/test_123?preference=_only_nodes:instance-0000000000 # 主节点查询
GET /test_index/_doc/test_123?preference=_only_nodes:instance-0000000001 # 从节点查询
如果两个节点都能查到相同的数据，说明同步是正常的。这是最直观的验证方式。
3 个节点。还有一个节点为什么不需要查看？
172.20.73.20 (instance-0000000000) - himrst角色 - 主节点
172.20.78.28 (tiebreaker-0000000002) - mv角色 - 仲裁节点
172.20.81.38 (instance-0000000001) - himrst角色 - 从节点
解：其中 tiebreaker-0000000002 这个节点是仲裁节点(mv角色)，它不存储数据，只负责在主节点选举时投票，所以不需要查询这个节点的数据同步情况。
只需要关注两个数据节点(himrst角色)之间的同步：
- instance-0000000000 (主节点)
- instance-0000000001 (从节点)
这就是为什么前面的查询命令只针对这两个节点。仲裁节点的存在主要是为了防止脑裂问题，不参与数据存储和同步。
中国智能体开发者社区，聚焦智能体与大模型开发，提供前沿资讯、实用工具链、开源项目及行业案例。通过技术沙龙、开发者大赛等活动，促进经验交流与协作，助力开发者快速构建创新智能应用。
更多推荐
9
0- 0
已为社区贡献1条内容
所有评论(0)