I have the same problem!
i tried first to send with a 600ksamples and I have 16seconds delay…
Then I sent with a same samples as you (3Msamples) and got the same result… 4seconds! better than before but not acceptable for a real time com
How did you solved this problem?( if you solved it?) Is there any possibility that a buffer is too big?