flink – Zukunft-Innovation-Technik (ZuInnoTe)

Automated Machine Learning (AutoML) and Big Data Platforms

Apr. 1, 2018

—

von

Although machine learning exists already since decades, the typical data scientist – as you would call it today – would still have to go through a manual labor-intensive process of extracting the data, cleaning, feature extraction, regularization, training, finding the right model, testing, selecting and deploying it. Furthermore, for most machine learning scenarios you do…

Ethereum & Analytics: Explore the blockchain using Hadoop, Hive, Flink and Spark

Nov. 14, 2017

—

von

Jörn Franke

in analytics, big data, tech

HadoopCryptoLedger release 1.1.0 added support for another well-known cryptocurrency: Ethereum and its Altcoins. Of course similar to its Bitcoin & Altcoin support you can use the library with many different frameworks in the Hadoop ecosystem: Hadoop MR Apache Hive Apache Flink Apache Spark and Apache Spark Datasource API Furthermore, you can use it with various…

Lambda, Kappa, Microservice and Enterprise Architecture for Big Data

Nov. 11, 2016

—

von

Jörn Franke

in big data, business, emerging trends

A few years after the emergence of the Lambda-Architecture several new architectures for Big Data have emerged. I will present and illustrate their use case scenarios. These architectures describe IT architectures, but I will describe towards the end of this blog the corresponding Enterprise Architecture artefacts, which are sometimes referred to as Zeta architecture. Lambda…

Schlagwort: flink

Automated Machine Learning (AutoML) and Big Data Platforms

Ethereum & Analytics: Explore the blockchain using Hadoop, Hive, Flink and Spark

Lambda, Kappa, Microservice and Enterprise Architecture for Big Data