All Posts

We find ourselves in an era defined by rapid technological advancements, especially in the field of software development. So much so that the term “developer” or “programmer” was replaced with “Software Engineer”, reflecting the natural arts and crafts approach of similar occupations like mechanical engineer or civil engineer. Software development has been transformed from the mere act of code creation to an intricate dance of design, maintenance, delivery, and reliability. As organizations grapple with increasingly complex software ecosystems, there is a growing need to cultivate a broad perspective. ...

Beware of the man who won’t be bothered with details. — William Feather, Sr. Goal In this essay I want to shed some light on the details when dealing with large datasets (read: arrays), while working with Python and numerical code when datasets become increasingly large (or local memory being not enough or the overall computation being too slow using Python’s standard libraries). ...

Recently we have seen OpenAI, a company excessively funded by Microsoft, trialing a Large Language Model (LLM) called ChatGPT. Guess what? They are selling you your own data. ...

Refreshed Matlab last week. Here are my notes. :) ...

After revisiting three languages in the last three weeks from “Hello, World!” to advanced concepts, and after a little stint into lesser-known languages like 👑 nim, it is now time for something new: https://github.com/carbon-language/carbon-lang. 😊 ...

I’m falling in love with Nim. :) ...

Post-installation steps for Fedora F35 F37. ...

How to perform an easy transition from vim to neovim? The step had to come as vim’s code base is a mess as many have written already. These days evil-mode in Emacs felt even better than the early love. Let’s get on it and enjoy asynchronous job control and lua scripting. ...

Recently I was thinking about a simple explanation for information entropy. So here you have the fruits of my labor. ...

In this article we have an illustrated annotated look at the Transformer published in “Attention is all you need” in 2017 by Vaswani, Shazeer, Parmar, et al. The Transformer architecture was groundbreaking as it achieved 28.4 BLEU on the WMT 2014 English-to-German translation task with comparatively very little training. Even though it is eclipsed by the “Reformer: The Efficient Transformer” published by Nikita Kitaev, Łukasz Kaiser and Anselm Levskaya in 2020, it is still interesting to have a look at the fundamental idea of the comparatively “simple network architecture […] based solely on attention mechanisms”. ...