I would guess it’s the display support (and SPI peripheral), plus on Daisy Seed it supports 2 codecs at once and one of them requires I2C peripheral. I think there was a demultiplexer chip too.
You could try compiling with optimization for size or using bootloader if Oopsy supports that.