The recent explosive growth of Large Language Models (LLMs) has showcased their exceptional performance across a spectrum of natural language processing tasks. However, this advancement comes with challenges, primarily stemming from their expanding size, which presents hurdles for deployment and sparks concerns regarding their environmental footprint and economic implications due to heightened energy demands. In response to these challenges, one popular st