OpenShift Commons Briefing: Automate and Scale Your Data Pipelines the Cloud Native Way with Guillaume Moutier (Red Hat)
March 13, 2020 | by
In this briefing, Guillaume Moutier, Senior Principal Technical Evangelist at Red Hat, gives an overview on building automated and scalable data pipelines in the cloud leveraging Ceph notifications, Kafka, and KNative Eventing and Serving.
With accelerating need for data agility around the globe, it's important that the right data be in the right place at the right time. Failure to meet these demands can even result in regulatory non-compliance, as data retention policies change around the globe on an almost daily basis. Guillaume gives an introduction into what it means to build automated and scalable data pipelines in OpenShift.
To stay abreast of all the latest releases and events, please join the OpenShift Commons and join our mailing lists & slack channel.
What is OpenShift Commons?
Commons builds connections and collaboration across OpenShift communities, projects, and stakeholders. In doing so we'll enable the success of customers, users, partners, and contributors as we deepen our knowledge and experiences together.
Our goals go beyond code contributions. Commons is a place for companies using OpenShift to accelerate its success and adoption. To do this we'll act as resources for each other, share best practices and provide a forum for peer-to-peer communication.
When you build a Docker image, a series of layers get cached to speed up subsequent builds. However, this caching can have adverse effects if an image layer contains secrets, such as credentials. A ...