I've just redirected the MIA nameserver (ns2.perilith.com) to 127.0.0.1, and no more delay now.

Still.. I wonder if there's something I can set somewhere to have our local caching DNS do parallel lookups and not wait for the MIA nameserver to respond?