IoT and BigData — The coming $2 Trillion Tsunami

Your car is no longer just a transportation device. It is an internet endpoint. As is your toaster, your microwave and your refrigator. And don’t even get me started on your television; it was already gathering and transmitting information before the term ‘IoT’ was coined. IoT, when combined with a streaming data processing pipeline, will change the way we look at everyday objects.

Where does BigData Fit in ?

  1. The NSA, monitoring millions of voice and data calls every second of every day.
  2. Google, analyzing, in real time, everything that everyone is searching for across the world.
  3. Facebook, trying to recognize a face among a billion other faces.

Sure, all of the above falls under the BigData’s data crunching expertise and portfolio. However, those aren’t the only companies that can benefit from BigData.

Small to midsized companies can also make a killing by using BigData — provided they ask the right questions!

Asking the Right Question — Where can I fit in IoT into my business process model?

Enter IoT, and a 2 Trillion Dollar Opportunity

Anything that MOVES is an IoT opportunity !

What about your shower, which has no electronic components? It is still a potential IoT device, with a market just waiting to be exploited. Hotels, for instance, get an annoyingly large number of complaints about shower malfunctions. Wouldn’t it be nice if the shower itself informed a backend system of an issue, before a customer did?

Anything that ‘moves’ — whether it is your heart, your pulse, or the water through your showerhead — are all IoT data generating candidates.

This has major consequences when you consider the items that move along manufacturing lines.

Vehicle and Appliance Breakdowns

This IoT plus BigData lethal combo can applied as easily to home appliance breakdownsor power blackouts or even termite infestations as to car crashes.

Any product, be it a pill or a pill container — be it a soda can or potato chips — if it spends any amount of time on a manufacturing line, is a candidate for IoT and BigData.

And that is why, it is possible, that most companies who think BigData isn’t for them, are not asking the right questions. IoT combined with BigData is opening up opportunities, where none existed.

The IoT value add to all industries has been estimated by Gartner, to be a staggering $1.9 Trillion.

Google’s Pixel Buds, Douglas Adams’ BabelFish is a Reality!

Sound Waves Move As Well !

Which BigData Engine is winning — Hadoop or Spark?

Spark, though a newer entry, brought real-time data processing capability to BigData. This was to overcome MapReduce’s restricted, disk-bound, batch (no real time) processing engine.

Spark, however, can run in Hadoop clusters through YARN (Yet Another Resource Negotiator), but can also run in a standalone mode. Big data practitioners expect Spark to spin-off, and perhaps replace Hadoop, especially in instances where faster access to processed data is critical.

Given that most IoT devices transmit tons of streaming data, Spark may emerge as the leader over traditional Hadoop.

Who is leading the BigData (Platforms and Products) War?

  • Google — Google DataProc, Google TensorFlow and ML. As Google displayed with the new PixelBuds, Pixel Phone and PixelBook, their Tensorflow libraries — including natural language processing, Image Recognition and other ML technologies — are clearly a force to contend with. Google’s DataProc engine, in addition, makes it relatively painless to run Hadoop / Spark as a Service. Outsourcing the big pain points in BigData to a PaaS can only be a good thing!
  • Cloudera — Cloudera QuickStart VM and Cloudera’s Hadoop Cluster are both huge time savers for companies looking to get up and running quickly.
  • AWS / Azure — both have mature BigData ecosystems that leverage their own, individual strengths.

Who will win the IoT war?

  • Current Leaders — Arduino, Raspberry Pi
  • Notables — Autonomo (with a Solar Panel and Long Battery Life), Wio Link

Summary and Next Steps

  1. Subscribe to the newsletter on , for the latest tips on blockchain, cloud computing and containerization technologies.
  2. Follow Anuj on Twitter.
  3. Thoughts? Comments? BigData + IoT Success Stories?For a free 15 minute consultation, talk to me, I’m listening…..

Ask me about Cloud Security, Google Cloud, AWS, Cloud Infrastructure, Migrations, Docker and Containerization, Quantum Physics, Relativity Theory and Blockchain