Philosophy of Software Engineering and Design

We find ourselves in an era defined by rapid technological advancements. Especially in the field of software development. So much that the term “developer” or “programmer” was replaced with “Software Engineer”. Reflecting the natural arts and crafts approach of similar occupations like mechanical engineer or civil engineer. Software development has been transformed from the mere act of code creation to an intricate dance of design, maintenance, delivery, and reliability. As organizations grapple with increasingly complex software ecosystems, there is a growing need to cultivate a broad perspective. ...

October 6, 2023 · 926 words

Python, Big Data and not Enough Memory

Beware of the man who won’t be bothered with details. — William Feather, Sr. Goal In this essay I want to shed some light on the details when dealing with large datasets (read: arrays), while working with Python and numerical code when datasets become increasingly large (or local memory being not enough or the overall computation being too slow using Python’s standard libraries). ...

August 31, 2023 · 1027 words

All Your Data are Belong to Us!

Recently we have seen OpenAI, a company excessivly funded by Microsoft, trialing a Large Language Model (LLM) called chatGPT. Guess what? They are selling you, your own data. ...

February 11, 2023 · 356 words

Octave/Matlab-lang in one file

Refreshed Matlab the last week. Here are my notes. :) ...

July 24, 2022 · 10 words

Carbon Language

After revisiting three languages in the last three weeks from “Hello, World!” to advanced concepts. And also a little stint into lesser known languages, like 👑 nim now, something new: https://github.com/carbon-language/carbon-lang. 😊 ...

July 22, 2022 · 442 words

nim-lang in one file

I’m falling in love with nim. :) ...

July 22, 2022 · 7 words

Steps to do after installing Fedora (F37)

Post installation steps for Fedora F35 F37. ...

February 21, 2022 · 1172 words

Upgrade from vim to Neovim

How to perform an easy transition from vim to neovim? The step had to come as vim’s code base is a mess as many have written already. These days evil-mode in Emacs felt even better than the early love. Let’s get on it and enjoy asynchronous job control and lua scripting. ...

February 29, 2020 · 226 words

What is Information Entropy?

Recently I was thinking about a simple explanation for information entropy. So here you have the fruits of my labor. ...

February 23, 2020 · 858 words

The Annotated Transformer Revisited

In this article we have an illustrated annotated look at the Transformer published in “Attention is all you need” in 2017 by Vaswani, Shazeer, Parmer, et al. The Transformer architecture was groundbraking as it achieves 28.4 BLEU on the WMT 2014 English-to-German translation task with comparatively very little training. Even though it is eclipsed by the “Reformer: The Efficient Transformer” published by Nikita Kitaev, Łukasz Kaiser and Anselm Levskayain in this year/2020, it is still interesting to have a look at the fundamental idea of the comparatively “simple network architecture […] based solely on attention mechanisms”. ...

February 22, 2020 · 980 words