Overview Apache Beam (batch and stream) is a powerful tool for handling embarrassingly parallel workloads. It is a evolution of Google’s Flume, which provides batch and streaming data processing based on the MapReduce concepts.
Caching things can be hard to do and hard to test. In this post I’ll demonstrate a convenient way of doing that using interfaces. The problem Let’s suppose we want to cache calls to the GitHub API. Let’s say we want to get the my repository list for whatever re...
Interfaces are one of the fundamental tools for abstraction in Go. Interfaces store type information when assigned a value. Reflection is a method of examining type and value information at runtime.
Debuggers. Traditionally they are used to find complex bugs and reason about how they happen. But what if you cannot explain why some changes happen between steps?
I have written some exporters to observe things on GitHub. This is how and why. We will talk about 2 things: other projects’ releases; my projects’ releases; So let’s get started! Other Projects’ Releases On my work and personal projects I use a lot of...
Several years ago, I began exploring Linux’s Netlink inter-process communication interface. Netlink is used for retrieving information from the Linux kernel, and in order to cross the kernel boundary, information is typically packed into Netlink attributes.
One of the most popular websites at NASA is the Astronomy Picture of the Day.
As many of us know, Go version 1.11 introduced Go Modules, a brand new dependency management system. A Little Bit About Modules Before 1.11, our dependencies were a collection of Go packages with a single version number attached to all of them.
In the previous post I showed how to keep all the scripts used in the CI in one repository. Let’s see what more advanced scripts you could put in there. This time I’d like to show how to add automatic versioning to your pipeline. You will also see how to push commits...
Gpython is a Python 3.4 interpreter written in Go. This is the story of how it came to be, how it works and where it is going.