Using io_splice for reading from EventMachine TCP socket

Using io_splice for reading from EventMachine TCP socket

[Iñaki Baz Castillo]

Hi, I posted this question in EventMachine maillist with no success,
so let me try here :)

M EM application (TCP/UDP server) receives messages with long
bodies and I want to copy such bodies into filesystem files. Instead
of using FileUtils.cp or FileUtils.copy_stream (which AFAIK copy the
file in user space) I would like to try io_splice which performs
the copy at kernel level (faster).

My question is: is it possible with EM? I expect I just need the
socket file descriptor in which EM receives the data but the API
provided by EM::Connection doesn't seem to offer such file descriptor.

Thanks a lot.

-- 
Iñaki Baz Castillo
<ibc@aliax.net>

Re: Using io_splice for reading from EventMachine TCP socket

[Iñaki Baz Castillo]

2010/12/27 Iñaki Baz Castillo <ibc@aliax.net>:
> Hi, I posted this question in EventMachine maillist with no success,
> so let me try here :)
>
> M EM application (TCP/UDP server) receives messages with long
> bodies and I want to copy such bodies into filesystem files. Instead
> of using FileUtils.cp or FileUtils.copy_stream (which AFAIK copy the
> file in user space) I would like to try io_splice which performs
> the copy at kernel level (faster).
>
> My question is: is it possible with EM? I expect I just need the
> socket file descriptor in which EM receives the data but the API
> provided by EM::Connection doesn't seem to offer such file descriptor.

By inspecting EM code such feature is not offered at API level so I've
created a patch:

 https://github.com/eventmachine/eventmachine/pull/144

Regards.


-- 
Iñaki Baz Castillo
<ibc@aliax.net>

Re: Re: Using io_splice for reading from EventMachine TCP socket

[Eric Wong]

Iñaki Baz Castillo <ibc@aliax.net> wrote:
> > My question is: is it possible with EM? I expect I just need the
> > socket file descriptor in which EM receives the data but the API
> > provided by EM::Connection doesn't seem to offer such file descriptor.
> 
> By inspecting EM code such feature is not offered at API level so I've
> created a patch:
> 
>  https://github.com/eventmachine/eventmachine/pull/144

Actually, io_splice doesn't require integer FDs anymore, it can take IO
objects.  I've updated the example on the website (it was in git, but
never pushed up).

-- 
Eric Wong

Re: Re: Using io_splice for reading from EventMachine TCP socket

[Iñaki Baz Castillo]

2010/12/27 Eric Wong <normalperson@yhbt.net>:
> Actually, io_splice doesn't require integer FDs anymore, it can take IO
> objects.  I've updated the example on the website (it was in git, but
> never pushed up).

Great :)

-- 
Iñaki Baz Castillo
<ibc@aliax.net>