Thoughts

The most revolutionary thing one can do is always to proclaim loudly what is happening. - Rosa Luxemburg

DE Camp Week 2 Recap

Week 2 at DE Camp was all about SQL. We started the week by wrapping up our discussion of config-driven pipelines and logging, and how to modularize our code...

DE Camp Week 1 Recap

A few months back, I decided to dive a little more seriously into the world of data engineering, and enrolled in a data engineering camp to get some guided, ...

Appreciating Docker Again

Already in my time in the Data Engineering Zoomcamp, something super useful has popped up: Docker. I’ve worked with Docker on a regular basis for several ye...

Beginning the Data Engineering Zoomcamp

The Data Engineering Zoomcamp kicked off today, and I’m excited to get started! I’ll be creating short posts throughout my learning journey noting some thoug...

Adding Tests to the GiphyScraper

(Read part 1 and part 2 of this blog series) The lack of testing nagged at me throughout the buildout of the GiphyScraper. I’m a fan of test-driven developm...

Adding a CLI Layer to GiphyScraper

(Read part 1 of this blog series here) I hadn’t worked with any kind of command-line library in Elixir before; I’d done a little bit of it with Python, and ...

Creating a Giphy Scraper

My first assignment in the the LearnElixir curriculum is to create a giphy scraper with the following requirements: use Giphy’s search endpoint to return ...