Upgrade from vim to neovim

Setting up Neovim on Ubuntu/Linux

How to perform an easy transition from vim to neovim? The step had to come as vim’s code base is a mess as many have written already. These days evil-mode in Emacs felt even better than the early love. Let’s get on it and enjoy asynchronous job control and lua scripting.

More …

The Annotated Transformer Revisited

Understanding transformers

In this article we have an illustrated annotated look at the Transformer published in “Attention is all you need” in 2017 by Vaswani, Shazeer, Parmer, et al. The Transformer architecture was groundbraking as it achieves 28.4 BLEU on the WMT 2014 English-to-German translation task with comparatively very little training.

Even though it is eclipsed by the “Reformer: The Efficient Transformer” published by Nikita Kitaev, Łukasz Kaiser and Anselm Levskayain in this year/2020, it is still interesting to have a look at the fundamental idea of the comparatively “simple network architecture […] based solely on attention mechanisms”.

More …

LaTeX in Jekyll

Setting up LaTeX in Jekyll

Reference equations like so \eqref{mylabel}. And define them like so:

  \begin {equation} \label{diffint}
    \frac{\mathrm{d}}{\mathrm{d} x} \int e^{x}\,dx = e^{x}
More …

Render objects based on their type in TypeScript

Rendering things upon passing things

Recently, my colleague T — a big fan of statically typed languages and working with Angular and TypeScript — came over and asked a simple question: “Hey R, do you have an idea how to realize Reflection in TypeScript? Actually, I need to render a site a little bit differentlty based upon a set of passed types.”. Naturally, Reflection sounds like a good idea. But you know… JavaScript. 🤦‍ That’s what TypeScript is transpiled into.

Having worked with TypeScript and React for a while, I suggested a few ideas from the top of my had head but soon discovered a few limits. Therefore, let’s see if we can come up with a solution to this problem using TypeScript’s inherent features.

More …