R's 🎪

Any sufficiently advanced technology is indistinguishable from ✨. Topics you find here include 🤖 Computer Science, 🧪 Life Sciences, 🐧 Linux, 🔋 DIY-Electronics and 🧑‍🦼 Accessibility.

Made with ✨

Philosophy of Software Engineering and Design

We find ourselves in an era defined by rapid technological advancements, especially in the field of software development. So much so that the term “developer” or “programmer” was replaced with “Software Engineer”, reflecting the natural arts and crafts approach of similar occupations like mechanical engineer or civil engineer. Software development has been transformed from the mere act of code creation to an intricate dance of design, maintenance, delivery, and reliability. As organizations grapple with increasingly complex software ecosystems, there is a growing need to cultivate a broad perspective. ...

Python, Big Data and Not Enough Memory

Beware of the man who won’t be bothered with details. — William Feather, Sr. Goal In this essay I want to shed some light on the details when dealing with large datasets (read: arrays), while working with Python and numerical code when datasets become increasingly large (or local memory being not enough or the overall computation being too slow using Python’s standard libraries). ...

All Your Data are Belong to Us!

Recently we have seen OpenAI, a company excessively funded by Microsoft, trialing a Large Language Model (LLM) called ChatGPT. Guess what? They are selling you your own data. ...

Octave/Matlab-lang in one file

Refreshed Matlab last week. Here are my notes. :) ...

Carbon Language

After revisiting three languages in the last three weeks from “Hello, World!” to advanced concepts, and after a little stint into lesser-known languages like 👑 nim, it is now time for something new: https://github.com/carbon-language/carbon-lang. 😊 ...

nim-lang in one file

I’m falling in love with Nim. :) ...

Steps to do after installing Fedora (F37)

Post-installation steps for Fedora F35 F37. ...

Upgrade from Vim to Neovim

How to perform an easy transition from vim to neovim? The step had to come as vim’s code base is a mess as many have written already. These days evil-mode in Emacs felt even better than the early love. Let’s get on it and enjoy asynchronous job control and lua scripting. ...

What is Information Entropy?

Recently I was thinking about a simple explanation for information entropy. So here you have the fruits of my labor. ...

The Annotated Transformer Revisited

In this article we have an illustrated annotated look at the Transformer published in “Attention is all you need” in 2017 by Vaswani, Shazeer, Parmar, et al. The Transformer architecture was groundbreaking as it achieved 28.4 BLEU on the WMT 2014 English-to-German translation task with comparatively very little training. Even though it is eclipsed by the “Reformer: The Efficient Transformer” published by Nikita Kitaev, Łukasz Kaiser and Anselm Levskaya in 2020, it is still interesting to have a look at the fundamental idea of the comparatively “simple network architecture […] based solely on attention mechanisms”. ...