You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
* Configure Fleet to send data from Elastic Agent to Logstash
11
-
* Create an Elastic Agent policy with the necessary integrations
12
-
* Configure Logstash to use the elastic_integration filter plugin
13
-
14
-
15
-
Logstash elastic-integration Filter Plugin Guide
16
-
17
-
Overview
18
8
The purpose of this guide is to walk through the steps necessary to configure {ls} to transform events
19
9
collected by the Elastic Agent using our pre-built Elastic Integrations that normalize data to the Elastic Common Schema (ECS).
20
10
This is possible with a new beta feature in Logstash known as the elastic-integration
21
11
filter plugin.
22
12
Using this new plugin, Logstash reads certain field values generated by the Elastic Agent, and uses them to apply the transformations from Elastic Integrations so that it can further process events before
23
13
sending them to their configured destinations.
24
14
25
-
Prerequisites/Requirements
15
+
[[ea-integrations-prereqs]]
16
+
*Prerequisites/Requirements*
26
17
27
18
There are a few requirements needed to make this possible:
28
19
@@ -35,54 +26,38 @@ There are a few requirements needed to make this possible:
35
26
This feature can also be used with a self-managed agent, but the appropriate setup and configuration details
36
27
of using a self-managed agent will not be provided in this guide.
37
28
38
-
Configure Fleet to send data from Elastic Agent to Logstash
29
+
[[ea-integrations-process-overview]]
30
+
*Process overview*
39
31
40
-
. For Fleet Managed Agent, go to Kibana and navigate to Fleet → Settings.
32
+
* <<ea-integrations-fleet>>
33
+
* <<ea-integrations-create-policy>>
34
+
* <<ea-integrations-pipeline>>
41
35
42
-
Figure 1: fleet-output
36
+
[discrete]
37
+
[[ea-integrations-fleet]]
38
+
=== Configure Fleet to send data from Elastic Agent to Logstash
43
39
40
+
. For Fleet Managed Agent, go to Kibana and navigate to Fleet → Settings.
44
41
. Create a new output and specify Logstash as the output type.
45
-
46
-
Figure 2: logstash-output
47
-
48
42
. Add the Logstash hosts (domain or IP address/s) that the Elastic Agent will send data to.
49
43
. Add the client SSL certificate and the Client SSL certificate key to the configuration.
50
-
You can specify at the bottom of the settings if you would like to make this out the default for agent
51
-
integrations. By selecting this option, all Elastic Agent policies will default to using this Logstash output
52
-
configuration.
44
+
You can specify at the bottom of the settings if you would like to make this out the default for agent integrations.
45
+
By selecting this option, all Elastic Agent policies will default to using this Logstash output configuration.
53
46
. Click “Save and apply settings” in the bottom right-hand corner of the page.
54
47
55
-
Create an Elastic Agent policy with the necessary integrations
48
+
[discrete]
49
+
[[ea-integrations-create-policy]]
50
+
=== Create an Elastic Agent policy with the necessary integrations
56
51
57
52
. In Kibana navigate to Fleet → Agent policies and click on “Create agent policy”.
58
-
59
-
60
-
61
-
Figure 3: create-agent-policy
62
53
. Give this policy a name, and then click on “Advanced options”.
63
54
. Change the “Output for integrations” setting to the Logstash output you created in the last step.
64
-
65
-
66
-
67
-
Figure 4: policy-output
68
-
69
-
70
55
. Click “Create agent policy” at the bottom of the flyout.
71
56
. The new policy should be listed on the Agent policies page now.
72
57
. Click on the policy name so that we can start configuring an integration.
73
58
. On the policy page, click “Add integration”.
74
59
This will take you to the integrations browser, where you can select an integration that will have everything necessary to _integrate_ that data source with your other data in the Elastic stack.
75
-
76
-
Figure 5: add-integration-to-policy
77
-
In this example we will search for and select the Crowdstrike integration.
78
-
79
-
Figure 6: crowdstrike-integration
80
-
81
60
. On the Crowdstrike integration overview page, click “Add Crowdstrike” to configure the integration.
82
-
83
-
84
-
85
-
Figure 7: add-crowdstrike
86
61
. Configure the integration to collect the needed data.
87
62
On step 2 at the bottom of the page (Where to add this integration?), make sure the “Existing hosts” option
88
63
is selected and the Agent policy selected is our Logstash policy we created for our Logstash output. This
@@ -92,18 +67,17 @@ A modal will appear on the screen asking if you want to add the Elastic Agent to
92
67
already done so, please install the Elastic Agent on a host somewhere. Documentation for this process can be
93
68
found here: https://www.elastic.co/guide/en/fleet/current/elastic-agent-installation.html
94
69
95
-
Figure 8: add-elastic-agent-to-host
96
-
97
-
Configure Logstash to use the elastic_integration filter plugin
98
70
71
+
[discrete]
72
+
[[ea-integrations-pipeline]]
73
+
=== Configure Logstash to use the elastic_integration filter plugin
99
74
100
75
Create a new pipeline configuration in Logstash.
101
76
102
77
Make sure elastic_integration plugin is installed or install with /bin/logstash-plugin install logstash-filter-
103
78
elastic_integration before running the pipeline.
104
79
105
-
A full list of configuration options can be found here: https://www.elastic.co/guide/en/logstash/current/plugins-
106
-
filters-elastic_integration.html
80
+
A full list of configuration options can be found here: https://www.elastic.co/guide/en/logstash/current/plugins-filters-elastic_integration.html
0 commit comments