pubsub Release Rss Feed

Updated Release: Distributed Pub Sub Event System Version 3.0 (Mar 27, 2013)

keithh — Sat, 27 Apr 2013 15:23:56 GMT

Important

Wsp 3.0 is NOT backward compatible with Wsp 2.1.

Prerequisites

You need to install the Microsoft Visual C++ 2010 Redistributable Package. You can find it at:

x64 http://www.microsoft.com/download/en/details.aspx?id=14632

x86 http://www.microsoft.com/download/en/details.aspx?id=5555

Wsp now uses Rx (Reactive Extensions) and .Net 4.0

3.0 Enhancements

I changed the topology from a hierarchy to peer-to-peer groups. This should provide much greater scalability and more fault-resilience. It also means event routing is more deterministic since the maximum number of hops is four. Today Wsp is installed on >9,000 production servers across 24 data centers. With this new topology, the goal is to support 100,000+ servers.

I changed the event format to a more standard format of standard headers, custom headers, and body. The two primary values to this format is you can apply event filtering based upon headers without having to deserialize the body itself. The second value is you can use your own serializor for the body (which is your object) which can be more performant than the built-in serializer. As an example, protobuf-net might be a nice choice which can handle richer data structures and is more performant.

I implemented an Rx (Reactive Extensions) interface for Wsp. If you choose to use Rx with Wsp, it means your events can go cross-process and cross-machine using a multicast paradigm. See the WspEventListenTest and WspEventServiceTest examples for using Rx.

The entire config file format has changed. The config file is simplified for large installations and it now has the concept of groups. A machine can be in one of two roles: node or hub. If it's a hub then it needs to be specified as a hub in its group section. If it's a node, it will connect to one of the hubs specified in its group section. For fault-resilience, you would want at least 3 hubs per group and they should be able to support ~500 nodes.

To use the built-in logging feature in Wsp, you need to use the Wsp serializer for your event body so it knows how to deserialize your event.

Note

I still need to write an installation document. In the meantime, feel free to ask questions.

Released: Distributed Pub Sub Event System Version 3.0 (Mar 27, 2013)

Sat, 27 Apr 2013 15:23:56 GMT

Important

Wsp 3.0 is NOT backward compatible with Wsp 2.1.

Prerequisites

You need to install the Microsoft Visual C++ 2010 Redistributable Package. You can find it at:

x64 http://www.microsoft.com/download/en/details.aspx?id=14632

x86 http://www.microsoft.com/download/en/details.aspx?id=5555

Wsp now uses Rx (Reactive Extensions) and .Net 4.0

3.0 Enhancements

Note

I still need to write an installation document. In the meantime, feel free to ask questions.

Updated Release: Distributed Pub Sub Event System Version 3.0 (Mar 27, 2013)

keithh — Fri, 19 Apr 2013 17:25:21 GMT

Important

Wsp 3.0 is NOT backward compatible with Wsp 2.1.

Prerequisites

You need to install the Microsoft Visual C++ 2010 Redistributable Package. You can find it at:

x64 http://www.microsoft.com/download/en/details.aspx?id=14632

x86 http://www.microsoft.com/download/en/details.aspx?id=5555

Wsp now uses Rx (Reactive Extensions) and .Net 4.0

3.0 Enhancements

Note

I still need to write an installation document. In the meantime, feel free to ask questions.

Released: Distributed Pub Sub Event System Version 3.0 (Mar 27, 2013)

Fri, 19 Apr 2013 17:25:21 GMT

Important

Wsp 3.0 is NOT backward compatible with Wsp 2.1.

Prerequisites

You need to install the Microsoft Visual C++ 2010 Redistributable Package. You can find it at:

x64 http://www.microsoft.com/download/en/details.aspx?id=14632

x86 http://www.microsoft.com/download/en/details.aspx?id=5555

Wsp now uses Rx (Reactive Extensions) and .Net 4.0

3.0 Enhancements

Note

I still need to write an installation document. In the meantime, feel free to ask questions.

Updated Release: Distributed Pub Sub Event System Version 3.0 (Mar 27, 2013)

keithh — Tue, 16 Apr 2013 18:57:09 GMT

Important

Wsp 3.0 is NOT backward compatible with Wsp 2.1.

Prerequisites

You need to install the Microsoft Visual C++ 2010 Redistributable Package. You can find it at:

x64 http://www.microsoft.com/download/en/details.aspx?id=14632

x86 http://www.microsoft.com/download/en/details.aspx?id=5555

Wsp now uses Rx (Reactive Extensions) and .Net 4.0

3.0 Enhancements

Note

I still need to write an installation document. In the meantime, feel free to ask questions.

Released: Distributed Pub Sub Event System Version 3.0 (Mar 27, 2013)

Tue, 16 Apr 2013 18:57:09 GMT

Important

Wsp 3.0 is NOT backward compatible with Wsp 2.1.

Prerequisites

You need to install the Microsoft Visual C++ 2010 Redistributable Package. You can find it at:

x64 http://www.microsoft.com/download/en/details.aspx?id=14632

x86 http://www.microsoft.com/download/en/details.aspx?id=5555

Wsp now uses Rx (Reactive Extensions) and .Net 4.0

3.0 Enhancements

Note

I still need to write an installation document. In the meantime, feel free to ask questions.

Updated Release: Distributed Pub Sub Event System Version 3.0 (Mar 27, 2013)

keithh — Wed, 27 Mar 2013 21:19:22 GMT

Important

Wsp 3.0 is NOT backward compatible with Wsp 2.1.

Prerequisites

You need to install the Microsoft Visual C++ 2010 Redistributable Package. You can find it at:

x64 http://www.microsoft.com/download/en/details.aspx?id=14632

x86 http://www.microsoft.com/download/en/details.aspx?id=5555

Wsp now uses Rx (Reactive Extensions) and .Net 4.0

3.0 Enhancements

Note

I still need to write an installation document. In the meantime, feel free to ask questions.

Released: Distributed Pub Sub Event System Version 3.0 (Mar 27, 2013)

Wed, 27 Mar 2013 21:19:22 GMT

Important

Wsp 3.0 is NOT backward compatible with Wsp 2.1.

Prerequisites

You need to install the Microsoft Visual C++ 2010 Redistributable Package. You can find it at:

x64 http://www.microsoft.com/download/en/details.aspx?id=14632

x86 http://www.microsoft.com/download/en/details.aspx?id=5555

Wsp now uses Rx (Reactive Extensions) and .Net 4.0

3.0 Enhancements

Note

I still need to write an installation document. In the meantime, feel free to ask questions.

Updated Release: Distributed Pub Sub Event System Version 3.0 (Nov 26, 2012)

keithh — Mon, 26 Nov 2012 17:23:33 GMT

Important

Wsp 3.0 is NOT backward compatible with Wsp 2.1.

Prerequisites

You need to install the Microsoft Visual C++ 2010 Redistributable Package. You can find it at:

x64 http://www.microsoft.com/download/en/details.aspx?id=14632

x86 http://www.microsoft.com/download/en/details.aspx?id=5555

Wsp now uses Rx (Reactive Extensions) and .Net 4.0

3.0 Enhancements

Note

I still need to write an installation document. In the meantime, feel free to ask questions.

Released: Distributed Pub Sub Event System Version 3.0 (Nov 26, 2012)

Mon, 26 Nov 2012 17:23:33 GMT

Important

Wsp 3.0 is NOT backward compatible with Wsp 2.1.

Prerequisites

You need to install the Microsoft Visual C++ 2010 Redistributable Package. You can find it at:

x64 http://www.microsoft.com/download/en/details.aspx?id=14632

x86 http://www.microsoft.com/download/en/details.aspx?id=5555

Wsp now uses Rx (Reactive Extensions) and .Net 4.0

3.0 Enhancements

Note

I still need to write an installation document. In the meantime, feel free to ask questions.

Created Release: Distributed Pub Sub Event System Version 3.0 (Nov 26, 2012)

keithh — Mon, 26 Nov 2012 17:16:26 GMT

Important

Wsp 3.0 is NOT backward compatible with Wsp 2.1.

Prerequisites

You need to install the Microsoft Visual C++ 2010 Redistributable Package. You can find it at:

x64 http://www.microsoft.com/download/en/details.aspx?id=14632

x86 http://www.microsoft.com/download/en/details.aspx?id=5555

Wsp now uses Rx (Reactive Extensions) and .Net 4.0

3.0 Enhancements

Note

I still need to write an installation document. In the meantime, feel free to ask questions.

Updated Release: Distributed Pub Sub Event System Version 2.1 (Dec 16, 2011)

keithh — Fri, 27 Jul 2012 23:58:35 GMT

Prerequisite

You need to install the Microsoft Visual C++ 2010 Redistributable Package. You can find it at:

x64 http://www.microsoft.com/download/en/details.aspx?id=14632

x86 http://www.microsoft.com/download/en/details.aspx?id=5555

Latest Enhancement

I added WspCommand to the event system. The main reason is the difficulty to collect real-time system information from servers. As an example, with the Wsp command functionality, it is now feasible to send a command to 8,000+ servers to get file version information of a specific file and get all responses back and process them within a couple of seconds. When we see performance issues in the eco-system, we can now collect real-time forensics from many or all servers to quickly find the state on the servers.

Creating commands is extensible. You would use the new CommandRequest and CommandResponse classes. To see an example of how to use the classes, you can look at the WspCommand sample application.

2.1 Enhancements

Many enhancements and bug fixes have been made to v2.1. In particular, it scales better and works across the WAN better. You now manage the config file for all machines at the origin server which is the top-most node in the hierarchy. In MSN, each data center has one or more parent routers which connect to the origin router. The client servers connect to the same name regardless of data center and the DNS resolves the name to a router in their same data center.

Logging now serializes events to JSON format.

To improve WAN communication, you can now specify how many socket connections a server has to its parent.

The whitepaper below is a out of date but close enough. The overview of the system is still mostly accurate.

I will add a deployment document in the near future to explain how to deploy and what arguments can be passed to the msi. Essentially, you set up your origin router and then all the other deployments you do will point to the origin router to get their config file. If someone really needs it sooner, let me know.

Released: Distributed Pub Sub Event System Version 2.1 (Dec 16, 2011)

Fri, 27 Jul 2012 23:58:35 GMT

Prerequisite

You need to install the Microsoft Visual C++ 2010 Redistributable Package. You can find it at:

x64 http://www.microsoft.com/download/en/details.aspx?id=14632

x86 http://www.microsoft.com/download/en/details.aspx?id=5555

Updated Release: Distributed Pub Sub Event System Version 2.1 (Dec 16, 2011)

keithh — Fri, 27 Jul 2012 23:57:30 GMT

Prerequisite

You need to install the Microsoft Visual C++ 2010 Redistributable Package. You can find it at:

x64 http://www.microsoft.com/download/en/details.aspx?id=14632

x86 http://www.microsoft.com/download/en/details.aspx?id=5555

Updated Release: Distributed Pub Sub Event System Version 2.1 (Dec 16, 2011)

keithh — Tue, 20 Dec 2011 00:39:31 GMT

Prerequisite

You need to install the Microsoft Visual C++ 2010 Redistributable Package. You can find it at:

x64 http://www.microsoft.com/download/en/details.aspx?id=14632

x86 http://www.microsoft.com/download/en/details.aspx?id=5555

Released: Distributed Pub Sub Event System Version 2.1 (Dec 16, 2011)

Tue, 20 Dec 2011 00:39:31 GMT

Prerequisite

You need to install the Microsoft Visual C++ 2010 Redistributable Package. You can find it at:

x64 http://www.microsoft.com/download/en/details.aspx?id=14632

x86 http://www.microsoft.com/download/en/details.aspx?id=5555

Updated Release: Distributed Pub Sub Event System Version 2.1 (Dec 16, 2011)

keithh — Sat, 17 Dec 2011 01:44:28 GMT

Prerequisite

You need to install the Microsoft Visual C++ 2010 Redistributable Package. You can find it at:

x64 http://www.microsoft.com/download/en/details.aspx?id=14632

x86 http://www.microsoft.com/download/en/details.aspx?id=5555

Released: Distributed Pub Sub Event System Version 2.1 (Dec 16, 2011)

Sat, 17 Dec 2011 01:44:28 GMT

Prerequisite

You need to install the Microsoft Visual C++ 2010 Redistributable Package. You can find it at:

x64 http://www.microsoft.com/download/en/details.aspx?id=14632

x86 http://www.microsoft.com/download/en/details.aspx?id=5555

Updated Release: Distributed Pub Sub Event System Version 2.1 (Jul 21, 2010)

keithh — Fri, 01 Jul 2011 17:02:17 GMT

Prerequisite

You need to install the Microsoft Visual C++ 2010 Redistributable Package. You can find it at:

x64 http://www.microsoft.com/download/en/details.aspx?id=14632

x86 http://www.microsoft.com/download/en/details.aspx?id=5555

2.1 Enhancements

Many enhancements and bug fixes have been made to v2.1. In particular, it scales better and works across the WAN better. You now manage the config file for all machines at the origin server which is the top-most node in the hierarchy. In MSN, each data center has one or more parent routers which connect to the origin router. The client servers connect to the same name regardless of data center and the DNS resolves the name to a router in their same data center.

Logging now serializes events to JSON format.

To improve WAN communication, you can now specify how many socket connections a server has to its parent.

The whitepaper below is a out of date but close enough. The overview of the system is still mostly accurate.

I will add a deployment document in the near future to explain how to deploy and what arguments can be passed to the msi. Essentially, you set up your origin router and then all the other deployments you do will point to the origin router to get their config file. If someone really needs it sooner, let me know.

Released: Distributed Pub Sub Event System Version 2.1 (Jul 21, 2010)

Fri, 01 Jul 2011 17:02:17 GMT

Prerequisite

You need to install the Microsoft Visual C++ 2010 Redistributable Package. You can find it at:

x64 http://www.microsoft.com/download/en/details.aspx?id=14632

x86 http://www.microsoft.com/download/en/details.aspx?id=5555