Michael Pollett

Building reliable events systemsAs you start to think about whether you need an event or real-time streaming platform, everyone starts in a similar place:Kafka, Samza, OpenTSDB, ELK just for illustration here — a common example but have many alternative and comparable options. This is both a great and the most natural place to start so you’ve not gone wrong yet, but you will quickly discover that this isn’t necessarily the perfect solution...

events, microservices, kafka, streaming, kinesis

A recent talk about how we use Docker at DataCamp to provide a serverless architecture for our users to learn data science. Not necessarily a perfect talk, but it digs into the security implications of building such a serverless environment and allowing users to execute code in it...

docker, data-science, online-learning, serverless, security

Why a “503: Slow Down” response from Amazon S3 can actually be good for you! The official AWS S3 docs on Request Rate and Performance Considerations for S3 clearly state, Amazon S3 scales to support very high request rates...

performance, aws, amazon, s3, engineering

Now although many sites rarely sees 2billion hits a month or 1000 hits per second, why should they not be capable of this, although the direct correlation is loose, with concurrency can come speed. Speed in this sense is possibly even serving a page to a single user at a time but why not do it in a decent timeframe...

engineering, wordpress, performance, caching, varnish

My latest exploits have involved writing an apache module so let’s look at a basic getting started guide for developing apache modules. RequirementsThis assumes running on a RHEL platform with httpd-dev installed...

c, apache, api