in that situation i would think that you might run into some challanges. personally if i am pulling a file from e-mail i always avoid moving onto other messages.
I have noticed that kind of lag before as you mentioned, but it is not isolated to DA, i have noticed it on all kinds of mail sytems, linux, exchange, novell, etc...
if it was me, i would pull the mail down and let it finish before moving on.