Tag: Interleaving

Accelerating Ranking Experimentation at Thumbtack with Interleaving

While A/B tests are rightly considered the gold standard for causal inference, they can also be costly. A typical ranking experiment takes many weeks to complete. This wouldn’t be a big problem if we only had a handful of ideas to try, but Thumbtack’s rankers are powered by ML models tha...

Accelerating Ranking Experimentation at Thumbtack with Interleaving

While A/B tests are rightly considered the gold standard for causal inference, they can also be costly. A typical ranking experiment takes many weeks to complete. This wouldn’t be a big problem if we only had a handful of ideas to try, but Thumbtack’s rankers are powered by ML models tha...

Advanced Swift Actors: Re-entrancy and Interleaving

Conceptually, they’re pretty simple: actors are reference-typed entities that enforce serial access to their methods and state. However, without understanding their nuances, it’s hard to know whether an actor is the right tool for the job or if you’re adding complexity. To help ...