2024
-
Using Amazon Data Firehose to populate Iceberg Tables
A new destination of Amazon Data Firehose makes it easier than ever to start a data lake on AWS
-
The Case for Evidence
An introduction to Evidence.dev, code first Business Intelligence: and how to make the most from it when producing visualisations for your data project
-
Bringing the Duck(DB) to the Data Lake
A walkthrough of building a pipeline to transform semi-structured JSON data into an embeddable DuckDB database, used in an Evidence.dev visualisation
-
Using Pants to Package Your Python Lambda
A brief introduction to the Pants build system, and how it provides an alternative to other ways to develop, test and package Lambda functions, such as AWS SAM, AWS CDK, etc.
-
Aggregate Time Series Data to a Single Multi-Series Grafana Graph
Time Series data sets often involve many distinct measurements over a period of time. Showing multiple measurements on a single graph can often introduce performance issues, if multiple queries are used to retrieve data. This blog demonstrates a way to let query engines do the work and reduce the burden to Grafana from downsampling and executing multiple queries.