File operations and other IO operations can block asyncio loop and unfortunately python does not support true asynchronous disk operations (mainly due to problematic state of async disk IO in underlying os – aka linux – special library is need for true asynchronous disk operations so normally select (or other IO event library) always reports file as ready to read and write and thus file IO operations block). Current solution is to run such operations in thread pool executor. There is asyncio wrapper library for file object – aiofiles, but there are also many blocking functions in other python modules – like os, shutil etc. We can easily write wrappers for such methods, but it can be annoying and time consuming if we use many of such methods. What about to write a generic proxy, which will assure that methods are executed in thread pool and use this proxy for all potentially blocking methods within the module.
The proxy itself can be fairly simple:
def __init__(self, module, loop=None, executor = None):
self._module = module
self._loop = loop or asyncio.get_event_loop()
self._executor = executor
def __getattr__(self, name):
function = getattr(self._module, name)
if isinstance(function, ModuleType):
async def _inner(*args,**kwargs):
loop = kwargs.pop['loop'] if 'loop' in kwargs else self._loop
executor = kwargs['executor'] if 'executor' in kwargs else self._executor
f = partial(function, *args, **kwargs)
return await loop.run_in_executor(executor, f)
We can use our proxy for os module like this:
aos = AsyncProxy(os)
And we can test it with
stat method for instance:
1000 loops, best of 3: 444 µs per loop
How does speed compare with regular call to
The slowest run took 20.03 times longer than the fastest. This could mean that an intermediate result is being cached.
1000000 loops, best of 3: 1.69 µs per loop
Clearly there is an overhead for running this operation in thread pool (and some small overhead from another level of indirection in proxy) so it’s up to implementator to consider if 30 microseconds operation should be considered as blocking (that’s worth case in our test, but what if disk will be really slow, possibly spin-down? That’s the problem with most of blocking IO operations – we cannot assume how much they will really take). However with our approach one can easily change how function is call as blocking or non-blocking – by using os or aos prefix.