IoT at Scale - or, From Little Things, Big Data Grow

YOW! Data
Sydney, Australia

The Internet of Things (IoT) is really about the ubiquity of data, the possibility of humans extending their awareness and reach globally, or further.

IoT frees us from the tedium of physically monitoring or maintaining remote systems, but to be effective we must be able to rely on data being accessible but comprehensible.

This presentation covers three main areas of an IoT big data strategy

The Air Gap - options (from obvious to inventive) for connecting wireless devices to the internet

Tributaries - designing a scalable architecture for amalgamating IoT data flows into your data lake. Covers recommended API and message-bus architectures.

Management and visualisation - how to characterise and address IoT devices in ways that scale to continental populations. Examples of large scale installations to which I’ve contributed. Coping with information overload.

The attendee will learn about the particular challenges of IoT data management in the above three areas, and the leading tools and services available to address these. In the second half of the presentation, practical case-studies will build upon theory and tool-set to show the thought process and architectural decisions leading to three particular systems I have built.