[Info-vax] Another "Rendez-vous autour de VMS" in France (report)

[Arne Vajhøj]

On 12/3/2022 10:27 PM, Arne Vajhøj wrote:
> On 12/3/2022 10:16 PM, Richard Maher wrote:
>> On 3/12/2022 10:16 pm, Arne Vajhøj wrote:
>>> Message queues has become a part of most new solutions today.
>>>
>>> There are 3 big players in the message queue server market: -
>>> RabbitMQ - ActiveMQ/ArtemisMQ - Kafka
>>>
>>> Note 1: Kafka is not a traditional message queue server, but it is a
>>> relevant alternative in some cases.
>>>
>>> Note 2: various commercial offerings from IBM, Oracle, MS etc. still
>>> exist but the open source ones dominate the market.
>>>
>>> But in many ways the choice of server is not so important as standard
>>> protocols has been created to talk to to those servers: AMQP, STOMP
>>> and MQTT.
>>
>> Personally, I see message queues as a 90's solution.
> 
> ActiveMQ is from 2004, RabbitMQ is from 2007 and Kafka is from 2011.
> 
> :-)
> 
>>                                                       Same with ESBs.
> 
> The big IBM/Oracle/MS/JBoss/whoever ESB's sold well up in the 00's.
> 
> But they never delivered what they promised.
> 
> But simple message queues survived.

Small and medium size solutions use ActiveMQ/ArtemisMQ or RabbitMQ
(probably mostly depending on whether they prefer product names that
start with J or not).

Large size solutions go for Kafka. Kafka is really the only
option for extreme workloads.

A few of the big Kafka users are:

LinkedIn - 100 clusters with 4000 nodes processing 7 trillion
messages per day (2019)

Pinterest - 50 clusters with 3000 nodes and a peak processing
of 40 million messages per second (2021).

Arne