Tag: window

tldr; techniques to speed up training and inference of LLMs to use large context window up to 100K input tokens during training and inference: ALiBi positional embedding, Sparse Attention, FlashAttention, Multi-Query attention, Conditional computation, and 80GB A100 GPUs. Recently there ...

I don’t know if you’ll be with your husband and son at a pool hall, working on your cartoons while the other two play eight-ball, when the texts and calls come in to say your father-in-law has died on the other side of the country — but I was. I often accompany my two pool fans ...

I don’t know if you’ll be with your husband and son at a pool hall, working on your cartoons while the other two play eight-ball, when the texts and calls come in to say your father-in-law has died on the other side of the country — but I was. I often accompany my two pool fans ...

For this new brève d’art, I’ve decided to tell you about Henri Matisse, and a rather surprising work when you consider that Matisse’s work is all about light and colour. If you’re in the habit of reading me regularly, you’ll no doubt have realised that ...

The hotkey window is one of the most useful features of iTerm2. It is a floating window that slides down from the menubar when summoned by a hotkey you can configure. To enable the hotkey window, open iTerm2, click on the iTerm2 menu item in the menubar, and click “Settings......

I know what you’re thinking. The infamous Red-Light District may well be the first thing people recall as the defining characteristic of this northern European city. But that’s not where I’m headed with this. Other than changing planes at Schiphol airport ove...

From a windowsill in Prague the world is small — it’s a single courtyard from medieval times, waiting patiently for us to come and play. It’s a quilt of courtyards — of cobblestone courtyards — extending toward the distant horizon line. The horizon line is soft, smud...

I am sitting in a square in Prague having a cigarette observing the passersby. I study their faces their gestures their clothing. I theorize about their pasts hopes fears loves and losses. As my father would say: I am people watching. They come and they go. A neverending kaleidoscopic whirl of ...

Just over two months ago, my wife and I moved our very cozy, settled life in Gurgaon, India to Vancouver, Canada — a city that is as distant and distinct from Gurgaon as can be. The whims and motivations that drove this move are a topic for another post. In here, I want to capture, sans bia...

So when I saw one with puffy, sickly looking eyes, I took notice. The poor bird stayed for a long time, half blind and hungry. Google and Cornell’s ornithology institute, said to take the feeders down for at least a few weeks. I’d only seen the one so far, but many more were sure to...