Sunday, June 1, 2025

momentum stochastic descent

›
Attending the NeurIPS conference last year gave me the idea that I should combine the momentum descent with stochastic descent (people alrea...
Saturday, April 19, 2025

BCPL, B, and C

›
Have you ever wondered, what were the earlier BCPL and B languages? As it turns out, Bell Labs still hosts Dennis Ritchie's historic web...
Saturday, February 15, 2025

Asynchronous programming 11 - writing libraries

›
Writing the libraries in the asynchronous way is a special challenge. There is so much context attached to the futures, and implicitly inher...

Asynchronous programming 10 - error handling

›
What if a computation fails? Then the future still gets completed but has to return an error. At the very least, if the future can return on...
Wednesday, February 12, 2025

Asynchronous programming 9 - composition

›
 Consider this traditional function: void writeHeader() {   char buf[512];   // ... populate the bufer ...   write(buf, 512); } and its asyn...
Sunday, February 9, 2025

Asynchronous programming 8 - loops and a semahore

›
The two basic varieties of loops are where you either execute everything sequentially or schedule all the iterations in parallel. Suppose a ...
Saturday, February 8, 2025

Asynchronous programming 7 - caching

›
Caching of values becomes easy with the futures because the futures take care of almost all the needed synchronization. The combination futu...

Asynchronous programming 6 - inlining done right

›
To recap, "inlining" is when we complete a future that has some function chained to it (directly or through other futures), and th...

Asynchronous programming 5 - critical sections the right way

›
Here is how to do the critical sections (i.e. sleeplock mutex analog) properly in the asynchronous way. Consider that the chains of futures ...
Wednesday, February 5, 2025

Asynchronous programming 4 - a look under the carpet

›
  In this part I want to go over some simplifications I've made in the first part, mostly because some things are wrong and should neve...
Sunday, February 2, 2025

Asynchronous programming 3 - some assistance

›
I've been saying it 20 years ago, and 15 years ago in the TPOPP book, and I'm still saying it now: the asynchronous programming has ...
Saturday, January 25, 2025

Asynchronous programming 2 - filling in the types

›
For the sake of a quick introduction, I've glanced over some things in part 1. Here I want to come back and show them. Let's start w...
Tuesday, January 21, 2025

Asynchronous programming 1 - Futures and Promises and Executors

›
A little while ago I've worked on an OS project that was written in an entirely asynchronous way, without explicit synchronizaton. Which...
Sunday, December 29, 2024

realSEUDO and evaluation of activation profiles

›
 (This is the part 3 of discussion of realSEUDO). When the activation profiles are generated, there are different ways to scale them that ba...
Sunday, December 22, 2024

LASSO-ISTA-FISTA

›
This is a follow-up to the previous post, talking about the details of the optimization algorithms (in the math sense, i.e. trying to find a...