Erlang/OTP Forums

Author Message

<  RabbitMQ mailing list  ~  RabbitMQ odd behaviour

Guest
Posted: Mon Jun 23, 2008 3:31 pm Reply with quote
Guest
Hi,

I've been seeing some odd slow downs in RabbitMQ and I think it's also
possible to see them with unmodified ProducerMain and ConsumerMain. My
producers managed to publish about 18k messages/second but my consumers
only managed to read at about 1k messages/second. To replicate this run
ProducerMain and ConsumerMain at the same time and you get a good rate of
about 17K messages/second. But if you run ProducerMain until it finishes
(it gets 18K/second) and then run ConsumerMain, ConsumerMain only gets
about 1K messages/second.

Is this normal or is there something odd going on?

Thanks,

Dave

java clients
RabbitMQ 1.3.0-1
Ubuntu 8.04 amd64 with 4GB RAM
Erlang 1:11.b.5dfsg-11
OpenJDK 1.6.0_06-b02 64-bit


*********************************************************************
This communication contains confidential information, some or all of which may be privileged. It is for the intended recipient only and others must not disclose, distribute, copy, print or rely on this communication. If an addressing or transmission error has misdirected this communication, please notify the sender by replying to this e-mail and then delete the e-mail. E-mail sent to EDF Trading may be monitored by the company. Thank you.
EDF Trading Limited
80 Victoria Street, 3rd Floor, Cardinal Place, London, SW1E 5JL
A Company registered in England No. 4255974.
Switchboard: 020 7061 4000
EDF Trading Markets Limited is a member of the EDF Trading Limited Group and is authorised and regulated by the Financial Services Authority.
VAT number: GB 735 5479 07
*********************************************************************

_______________________________________________
rabbitmq-discuss mailing list
rabbitmq-discuss@lists.rabbitmq.com
http://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
Post received from mailinglist
0x6e6562
Posted: Mon Jun 23, 2008 10:58 pm Reply with quote
User Joined: 12 Jul 2007 Posts: 250
Dave,

On Mon, Jun 23, 2008 at 4:30 PM, <David.Corcoran@edftrading.com> wrote:
> I've been seeing some odd slow downs in RabbitMQ and I think it's also
> possible to see them with unmodified ProducerMain and ConsumerMain. My
> producers managed to publish about 18k messages/second but my consumers
> only managed to read at about 1k messages/second. To replicate this run
> ProducerMain and ConsumerMain at the same time and you get a good rate of
> about 17K messages/second. But if you run ProducerMain until it finishes
> (it gets 18K/second) and then run ConsumerMain, ConsumerMain only gets
> about 1K messages/second.
>
> Is this normal or is there something odd going on?

No I don't think this is normal. Using a the Apple 1.5.0.13 JDK on OSX
10.5.3 with Erlang R12B-3 on the same machine, I get 10K in and 25K
out when running them one after another. When I run them concurrently,
I get an even 7.5K in and out. I can have a look to see what
difference it makes on a Linux machine tomorrow, but unfortunately I
don't have an answer today. Can you maybe give some more details about
how you are running the tests?

> java clients
> RabbitMQ 1.3.0-1
> Ubuntu 8.04 amd64 with 4GB RAM
> Erlang 1:11.b.5dfsg-11
> OpenJDK 1.6.0_06-b02 64-bit

Just out of interest's sake, and I don't think this is causal, but
does it make any difference if you use R12B-3 instead of R11B-5? You
don't necessarily need root access to install this, if you set the
prefix-dir to be somewhere in your own user's directory when building
Erlang. Any questions, just ask.

HTH,

Ben

_______________________________________________
rabbitmq-discuss mailing list
rabbitmq-discuss@lists.rabbitmq.com
http://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
Post received from mailinglist
View user's profile Send private message
Guest
Posted: Tue Jun 24, 2008 9:50 am Reply with quote
Guest
>
> Just out of interest's sake, and I don't think this is causal, but
> does it make any difference if you use R12B-3 instead of R11B-5?

Hey Ben,

I installed R12B-3. I haven't changed anything else and now it runs
perfectly fast. If I stop rabbitmq and restart with the previous version it
goes very slow again.

Now if I run both producer and consumer at the same time I get ~18K
messages/s each. If I run producer then consumer I get 27K messages/s for
the producer and 44K messages/s for the consumer. Which is pretty
impressive.

Thanks for the help,

Dave


*********************************************************************
This communication contains confidential information, some or all of which may be privileged. It is for the intended recipient only and others must not disclose, distribute, copy, print or rely on this communication. If an addressing or transmission error has misdirected this communication, please notify the sender by replying to this e-mail and then delete the e-mail. E-mail sent to EDF Trading may be monitored by the company. Thank you.
EDF Trading Limited
80 Victoria Street, 3rd Floor, Cardinal Place, London, SW1E 5JL
A Company registered in England No. 4255974.
Switchboard: 020 7061 4000
EDF Trading Markets Limited is a member of the EDF Trading Limited Group and is authorised and regulated by the Financial Services Authority.
VAT number: GB 735 5479 07
*********************************************************************

_______________________________________________
rabbitmq-discuss mailing list
rabbitmq-discuss@lists.rabbitmq.com
http://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
Post received from mailinglist

Display posts from previous:  

All times are GMT
Page 1 of 1
This forum is locked: you cannot post, reply to, or edit topics.

Jump to:  

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You cannot download files in this forum