Data Extrapolation: Learning From Your Big Data
The first step in answering any Big Data-oriented question is to simply obtain the data.…
MongoDB and Apache Spark - Getting started tutorial
MongoDB and Apache Spark are two popular Big Data technologies. In my previous post [https:…
In our previous article on Nifi [https://test-ippon.ghost.io/why-nifi-2], we discussed the history,…
Why is an Address NOT a (series of) Strings?
In my article Why an Address is NOT a String [https://test-ippon.ghost.io/why-address-not-string/…
Streaming With Scala: The Nuance of Real-Time Twitter Data
At Ippon Technologies USA, we're lucky enough to have "Coding Dojos"…
Pokemon GO: A Big Data Learning Opportunity
Nick Peterson and Justin Risch have begun to study Big Data, Spark, Hadoop, and the…
Kafka Streams - Scaling up or down
Kafka Streams is a new component of the Kafka platform. It is a lightweight library…
Spark - Calling Scala code from PySpark
In a previous post [https://test-ippon.ghost.io/spark-kafka-achieving-zero-data-loss/], I demonstrated how to consume a…
With a Spark 2.0 release imminent [https://databricks.com/blog/2016/05/11/spark-2-0-technical-preview-easier-faster-and-smarter.…
Spark & Kafka - Achieving zero data-loss
Kafka and Spark Streaming are two technologies that fit well together. Both are distributed systems…
A tour of Databricks Community Edition: a hosted Spark service
With the recent announcement [https://databricks.com/blog/2016/02/17/introducing-databricks-community-edition-apache-spark-for-all.html] of the…
Kafka, Spark and Avro - Part 3 of 3, Producing and consuming Avro messages
This post is the third and last post in a series in which we learn…
Testing strategy for Spark Streaming - Part 2 of 2
In a previous post [https://test-ippon.ghost.io/testing-strategy-apache-spark-jobs/], we’ve seen why it’s…
Kafka, Spark and Avro - Part 2 of 3, Consuming Kafka messages with Spark
This post is the second post in a series in which we will learn how…