Transformers are a type of deep learning model, especially effective for handling sequences, like time series or text. They are the backbone of models like GPT.