Fastest way to access large lookup tables

Your problem is not with access time which is very fast for all practical purposes even with QSPI thanks to cache on this MCU. It sounds like you’re using delay lines in your patch and don’t intrepolate anything. This causes discontinuity from peeking at different places in delay buffer.