Tag: Transformer

Boosting Password Security with Natural Language Understanding: Building a Simple Password Strength Checker with BERT Transformer

Inan era where cyber threats are more pervasive than ever, ensuring the security of online accounts is of paramount importance. Passwords are often the first line of defense against unauthorized access, making their strength a critical factor in safeguarding our digital lives. In this article, ...

Transformer Architectures and the Rise of BERT, GPT, and T5: A Beginner’s Guide

In the vast and ever-evolving realm of artificial intelligence (AI), there are innovations that don’t just make a mark; they redefine the trajectory of the entire domain. Among these groundbreaking innovations, the Transformer architecture emerges as a beacon of change. It’s akin to the ...

Build your own Transformer from scratch using Pytorch

In this tutorial, we will build a basic Transformer model from scratch using PyTorch. The Transformer model, introduced by Vaswani et al. in the paper “Attention is All You Need,” is a deep learning architecture designed for sequence-to-sequence tasks, such as machine translation and tex...

Post-hoc analysis of Arabic transformer models.

Analyze the internal representations of Arabic transformer models. While there’ve been an extrinsic evaluation of Arabic transformer (AT) models, no work has been carried out to analyze their internal representations. This paper probe how Arabic linguistic information&n...