Skip to content

Commit 0e3ab85

Browse files
committed
out_s3: Add classic format configuration for Parquet
Signed-off-by: Hiroshi Hatake <[email protected]>
1 parent b1dee3f commit 0e3ab85

File tree

1 file changed

+33
-0
lines changed

1 file changed

+33
-0
lines changed

pipeline/outputs/s3.md

Lines changed: 33 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -639,6 +639,7 @@ After being compiled, Fluent Bit can upload incoming data to S3 in Apache Arrow
639639
For example:
640640

641641
{% tabs %}
642+
642643
{% tab title="fluent-bit.yaml" %}
643644

644645
```yaml
@@ -726,6 +727,10 @@ Apache Parquet GLib is a part of Apache Arrow project.
726727

727728
Example configuration:
728729

730+
{% tabs %}
731+
732+
{% tab title="fluent-bit.yaml" %}
733+
729734
```yaml
730735
service:
731736
flush: 5
@@ -748,3 +753,31 @@ pipeline:
748753
compression: parquet
749754
# other parameters
750755
```
756+
757+
{% endtab %}
758+
{% tab title="fluent-bit.conf" %}
759+
760+
```text
761+
[SERVICE]
762+
Flush 5
763+
Daemon Off
764+
Log_Level debug
765+
HTTP_Server Off
766+
767+
[INPUT]
768+
Name dummy
769+
Tag dummy.local
770+
Dummy {"boolean": false, "int": 1, "long": 1, "float": 1.1, "double": 1.1, "bytes": "foo", "string": "foo"}
771+
772+
[OUTPUT]
773+
Name s3
774+
Match dummy*
775+
Region us-east-2
776+
Bucket <your_testing_bucket>
777+
Use_Put_Object On
778+
Compression parquet
779+
# other parameters
780+
```
781+
782+
{% endtab %}
783+
{% endtabs %}

0 commit comments

Comments
 (0)