Tag: Metrics

Measurement of Social Bias Fairness Metrics in NLP Models

In recent times, text-generation-based models have become more popular than ever. With the introduction of ChatGPT and similar models, the population has been using the NLP models daily. However, the use cases for NLP models are not limited to text generation; they include sentiment analysis, key...

Measurement of Social Bias Fairness Metrics in NLP Models

In recent times, text-generation-based models have become more popular than ever. With the introduction of ChatGPT and similar models, the population has been using the NLP models daily. However, the use cases for NLP models are not limited to text generation; they include sentiment analysis, key...

Unlocking the Power of Observability

Observability — While the term might sound abstract, its impact on your applications' reliability, performance, and troubleshooting capabilities is very real. In this blog post, we embark on a journey to unravel the difficulties of observability, exploring the three pillars that form its f...

The Two Metrics That Reveal True Data Dispersion Beyond Standard Deviation

Introduction We’ve all heard the saying, “Variety is the spice of life,” and in data, that variety or diversity often takes the form of dispersion. Data dispersion makes data fascinating by highlighting patterns and insights we wouldn’t have found otherwise. Typically, ...

Evaluating Model Performance in Medical Diagnosis: Understanding Confusion Matrix Metrics

In the realm of medical diagnosis, the use of machine learning and artificial intelligence has become increasingly prevalent. These technologies have the potential to aid healthcare professionals in making accurate and timely diagnoses, ultimately improving patient outcomes. However, the effectivene...

Talent Metrics Maturity Framework

While there is a lot of focus on enabling Machine Learning adoption in Talent Operations — a key pre-requisite for ML model creation is the availability of relevant data and a clear understanding of what metrics need to be tracked. Without the relevant metrics in place, any ML initiative is go...

Surviving in a World of Bad Metrics

Several months ago, I bought a new bed frame and a mattress online. While choosing which website I should buy from, I read lots of comments from different online stores and chose the one with the better Trustpilot overviews. After waiting ten days, they called me in the morning to make the delive...

How to Use Metrics Wisely, Instead of Letting Them Manipulate You

Except for the Friday I drove myself to the hospital for an emergency appendectomy, I never missed a day of work for 25 years. And I don’t even count that as a missed day because I only left work at lunchtime. It was just my luck my appendix waited until Friday afternoon, and I was back to ...

I Have Some Good News and Bad News for Your Cloud Metrics

If you’ve ever partnered with AWS when building an application you know that you go through an Infrastructure Event Management (IEM) plan in the weeks leading up to your go-live event. Part of the IEM is walking through all aspects of your application with key personnel from your com...

Exposing Python Metrics with Prometheus

Prometheus is a powerful monitoring and alerting system that collects and stores time-series data. In this step-by-step guide, we will demonstrate how to expose metrics for a simple Python API app and monitor them using Prometheus. We will also instrument the app to track request metrics. To make it...

Investment Metrics for Climate Change, Part 2: CO2 Is Our Top Priority

Climate change is visible everywhere you look. Glaciers are melting at an unprecedented rate, as those pictures from the 1930s and the 2020s show. Farmers all over the world need to cope with more frequent and more severe drought, even in moderate climates such as Switzerland. Eve...

Advocate for Equity with Daisy Mayorga— Muse and Metrics, S5E4 Episode

This episode features guest Daisy Mayorga. Daisy is a passionate technologist and new co-founder of yüda, a company dedicated to Empowering Equity in Emerging Technologies. She holds a Bachelor of Science degree in Computer Science and experience as a Google Developer Group organizer and Women ...

How to Apply Metrics for Inclusion to your Open Source Project

The first part of the answer, is to remember that open and inclusion cannot be decoupled. Historically, we believed that by being open we were by default inclusive — but we now know that’s not true. This means is that the most achievable goals for inclusi...

Surviving in a World of Bad Metrics

Several months ago, I bought a new bed frame and a mattress online. While choosing which website I should buy from, I read lots of comments from different online stores and chose the one with the better Trustpilot overviews. After waiting ten days, they called me in the morning to make the delive...

How to Size For Online Experiments With Ratio Metrics

Expedia Group™, as a global online travel solution provider, heavily relies on A/B testing to continuously bring the best travel experience to our consumers and business partners. We at the Experimentation Science & Statistics team keep exploring new methodologies and techniques ...