Simoulin, Antoine, and Benoît Crabbé. How Many Layers and Why? An Analysis of the Model Depth in Transformers In Association of Computational Linguistics (student). Bangkok, Thailand, 2021.