daniel/cloudwatch-to-duckdb
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
Pull AWS Cloudwatch Logs directly into DuckDB
1 commit 1 branch 0 tags 34 KiB
  • Go 100%
Find a file
Exact
Daniel Markow 54d8a31846 first commit
2026-05-11 15:17:45 +02:00
.forgejo/workflows first commit 2026-05-11 15:17:45 +02:00
.gitignore first commit 2026-05-11 15:17:45 +02:00
go.mod first commit 2026-05-11 15:17:45 +02:00
go.sum first commit 2026-05-11 15:17:45 +02:00
LICENSE.md first commit 2026-05-11 15:17:45 +02:00
main.go first commit 2026-05-11 15:17:45 +02:00
main_e2e_test.go first commit 2026-05-11 15:17:45 +02:00
mise.toml first commit 2026-05-11 15:17:45 +02:00
README.md first commit 2026-05-11 15:17:45 +02:00

README.md

CloudWatch to DuckDB CLI

What does it do?

Annoyed by CloudWatch, but you don't want to deal with S3 and Firehose nightmare to set up parquet export? You have come to right place my friend. This is a convenient CLI that pulls CloudWatch logs from a log group and ingests them into a DuckDB. So you can analyze them in a convenient manner. All you need is an environment with AWS credentials configured for a user or a role with read access for the log group in you want to examine.

How to run?

Extracting logs from the last 2 hours

go run main.go -lg "cw-log-group" -ls "cw-log-stream" -hrs -2h -lp "noParse"

Extracting logs from a specific time frame

go run main.go -lg "cw-log-group" -ls "cw-log-stream" -start "2026-03-14T17:00:00Z" -end "2026-03-15T03:00:00Z" -lp "noParse"