Skip to content

technology

What Makes a Great Language Model?

*Isn’t it surprising…?*

…that training a language model on the web’s data works? Isn’t there a lot of rubbish on the web? How does the model know what information to focus on?

“Correct” or “high quality” data has a tendency to repeat itself. There might be some data saying that the sun moves around the earth, but there is much more saying that the earth moves around the sun. This makes it possible for us to train language models on large datasets, even if they contain some, or even a lot, of weak information or arguments. Weak arguments and information tend to differ from each other, whereas stronger arguments or information tends to be articulated, transmitted and replicated more coherently…

Wifi that stretches for miles

Helium provides a communication network using hotspots that people install in their homes.
As a hotspot owner you earn helium tokens – a cryptocurrency – for providing coverage.
There are now about 5,000 hotspots in the world, providing full coverage in most major US cities.
So far, the Helium network has been used for tagging/tracking devices and also smart water meters, among other applications.

Alfa Laval Acquires Sandymount Technologies

Alfa Laval Acquires Sandymount Technologies. https://www.alfalaval.com/media/news/investors/2021/alfa-laval-acquires-unique-technology-to-strengthen-its-position-in-sustainable-beer-production/

DIY Self Driving Cars

I bought and installed a comma.ai self driving system. Here’s what I learned.