It turns out my filter had something to do with the previous speed problem and not using it doesn’t seem to affect the sound in any other way so that’s gone. Now it just skips and jumps a bit which is annoying, that may be down to my calculations of the duration and time stamp of the returned sample or because doing real time ffts is too demanding.