SoniDo employs a generative architecture based on a multi-level transformer coupled with a hierarchical encoder. Through careful preprocessing, its intermediate representations are utilized as features for task-specific models across various music-related tasks, enhanced by data augmentation techniques. The model’s encoder design draws inspiration from Jukebox, but it distinguishes itself by incorporating a hierarchical structure. Using a framework called