Configure the Elasticsearch HTTP source plugin in Palo Alto Networks Telemetry Pipeline to ingest logs for processing and routing.
This information is for Palo Alto Networks Telemetry Pipeline, which is a standalone
product separate from Cortex XCOR.
The Elasticsearch HTTP source plugin
(name: elasticsearch) lets you ingest data from your Elasticsearch HTTP instances
into a telemetry pipeline.This is a
push-based
source plugin.
Supported telemetry types
The Elasticsearch HTTP source plugin for Palo Alto Networks Telemetry Pipeline supports these telemetry types:
Logs
Metrics
Traces
Configuration parameters
Use the parameters in this section to configure the Elasticsearch HTTP source plugin. The
Palo Alto Networks Telemetry Pipeline web interface uses the items in the Name column to
describe these parameters. Pipeline configuration files
use the items in the Key column as YAML keys.
Required
Name
Key
Description
Default
Port
port
Required. The TCP port used for listening for incoming messages.
9200
Advanced
Name
Key
Description
Default
Buffer Chunk Size
buffer_chunk_size
Sets the default chunk size for buffered data. If a single record exceeds this size, the plugin temporarily increases the chunk size up to the value of buffer_max_size to accommodate it.
5M
Buffer Max Size
buffer_max_size
Sets the maximum chunk size for buffered data. If a single record exceeds this size, the plugin drops that record.
20M
Memory Buffer Limit
mem_buf_limit
Sets a limit for how much buffered data the plugin can write to memory, which affects backpressure. This value must follow Fluent Bit’s rules for unit sizes. If unspecified, no limit is enforced. For v2 pipelines, this parameter affects only pipelines with the Deployment or DaemonSet workload type. To learn more, see the v2 backpressure guide. For v3 pipelines, this parameter is independent from the OpenTelemetry memory_limiter and batch processors.
none
Security and TLS
Name
Key
Description
Default
TLS
tls
If true, enables TLS/SSL. If false, disables TLS/SSL. Accepted values: true, false.
false
TLS Certificate Validation
tls.verify
If on, and if tls is true, enables TLS/SSL certificate validation. If off, disables TLS/SSL certificate validation. Accepted values: on, off.