a tumblelog
Sat 12 Sep 2020

Transformers are Graph Neural Networks

While Graph Neural Networks are used in recommendation systems at Pinterest, Alibaba and Twitter, a more subtle success story is the Transformer architecture, which has taken the NLP world by storm. Through this post, I want to establish a link between Graph Neural Networks (GNNs) and Transformers. I'll talk about the intuitions behind model architectures in the NLP and GNN communities, make connections using equations and figures, and discuss how we can work together to drive future progress. Let's start by talking about the purpose of model architectures—representation learning.

Source: Transformers are Graph Neural Networks, an article by Chaitanya K. Joshi.

What could go wrong with apps on Big Sur and Apple Silicon?

With the arrival of macOS 11.0 Big Sur and Apple’s first Silicon Macs drawing ever closer, next week I’m going to ask whether you should consider upgrading to them, and how you should prepare for that. As a prelude, this article highlights some potential issues which you could experience with third-party products running under Big Sur, and on Apple Silicon Macs.

Source: What could go wrong with apps on Big Sur and Apple Silicon?, an article by Howard Oakley.