When it comes to stream processing, the Open Source community provides an entire ecosystem to tackle a set of generic problems. Among the emergent Apache projects, Beam is providing a clean programming model intended to be run on top of a runtime like Flink, Spark, Google Cloud DataFlow, etc. A really convenient declarative… Continue reading Apache Beam+Apache Flink/Spark for Batch&Stream Processing
Call for Papers! ADIDSE IARIA Special Track aims at tackling the problems and discussing the advancements in Data-Intensive Distributed Systems Engineering with the community of Engineers and Scientists out there. Come and join us… The advent of the IoT (Internet of Things), by forecasts, is going to bring 40 Billion connected devices by 2020. Such… Continue reading Advancements in Data-Intensive Distributed Systems Engineering
Knot is a network server as well as Haboob. The difference is the concurrency model: Knot is thread-based, instead Haboob is event-based [9]. Clearly, from the benchmark results, the poll()/epoll() mechanism is a serious bottleneck as soon as the number of active concurrent clients become relevant (in the specific case, at 16384 clients the trashing… Continue reading Scaling to Thousands of Threads
We are living the era of buzzwords, and Docker is for sure one of those in the technological landscape. Docker has a common sense definition: hypervisor-free virtualization. In other terms: running VMs without any hypervisor-based virtualization support. Now, how is this possible? What is the arcane trick to achieving that? Let’s live a short journey… Continue reading Dense Virtualization via Linux Containers
A question raises spontaneously: why Eventual Consistency? Isn’t ACID enough? Let’s try to understand the need for Eventual Consistency guarantees when we talk about Distributed Computing on large scale, and of course Data is involved. With the advent of Internet and Cloud services, Databases and more in general Data Storage technologies have undergone a radical change:… Continue reading Pills of Eventual Consistency
Intro to FOSDEM FOSDEM (Free and Open Source Software Developers’ European Meeting) is the European Open Source Conference oriented to Engineers, grouping the Open Source Communities in a University Campus and managed by volunteers. It is an intensive two days conference that, simply, enlightens… Main Sponsors: RedHat, Google, Oracle, Cisco, Mozilla, Trivago, Bloomberg, GitHib, O’Really… Continue reading FOSDEM 2016 – Day 2 Log
Intro to FOSDEM FOSDEM (Free and Open Source Software Developers’ European Meeting) is the European Open Source Conference oriented to Engineers, grouping the Open Source Communities in a University Campus and managed by volunteers. It is an intensive two days conference that, simply, enlightens… Main Sponsors: RedHat, Google, Oracle, Cisco, Mozilla, Trivago, Bloomberg, GitHib, O’Really… Continue reading FOSDEM 2016 -Day 1 Log
Reasons for the Evolution: Tiered to SOA, SOA to Microservices There is a law governing the electronics evolution and the needs to accommodate such evolution, the Moore’s Law. The complexity for minimum component costs has increased at a rate of roughly a factor of two per year. Certainly over the short term this rate can… Continue reading From Monolithic Three-tiers Architectures to SOA Vs Microservices
For non-subjetc experts it’s not easy to get quickly introduced to OpenStack and its capabilities. Let’s try to demystify this incredibly powerful platform. OpenStack is a Cloud OS (Operating System) in the sense that it provides a set of APIs that programmatically can virtualize and manage the physical resources of any Data Center. This means:… Continue reading Demystifying OpenStack, the Cloud Operating System
TheTechSolo 