Rate-limit by number of concurrent requests

It would be very useful to limit number of concurrent requests per user (per api), rather than limit request rate. Any idea how to accomplish this?

Hi
Just wondering how would this look in terms of being different from a rate limit over some time period?