Integrating systems

in the age of

Quarkus, Knative and Kafka Connect

Peter Palaga

@ppalaga

My main job:

Camel Quarkus

porting Camel componets to Quarkus

mvnd - the Maven Daemon

https://github.com/mvndaemon/mvnd

Agenda

• Apache Camel intro
• Camel on Quarkus
• Camel on Knative/Kubernetes
• Camel on Kafka Connect

What is Apache Camel?

An integration library

Enterprise Integration Patterns (EIP)

integrate anything

through its

360+ components

... and many more

Domain Specific Languages (DSL)

class MyCamelRouter extends RouteBuilder {
  @Override
  public void configure() throws Exception {
    from("aws2-s3://my-bucket?prefix=hello.txt")
      .log("Got an S3 file: ${body}")
      .to("telegram:bots");
  }
}

<routes
  xmlns="http://camel.apache.org/schema/spring">
  <route id="my-route">
    <from uri="aws2-s3://my-bucket?prefix=hello.txt"/>
    <log message="Got an S3 file: ${body}"/>
    <to uri="telegram:bots"/>
  </route>
</routes>

Groovy, Scala, Kotlin, YAML, ...

Runnable on

Standalone
Spring Boot
	Knative/Kubernetes

Why Camel on Quarkus?

Developer joy

• Live reload:
  mvn compile quarkus:dev
• Isolation from GraalVM CLI/SPI config
• Rich ecosystem of extensions

Camel Quarkus

• 
  As of v1.7.0, Feb. 2021:
• ~90% of Camel components ported
• ~¼ JVM only
• 
  Available on code.quarkus.io

Camel Quarkus Demo

Demo code:
github.com/ppalaga/camel-quarkus-cnorris-demo

How can we deploy on Kubernetes?

Provided by Quarkus

• Build and push an image
  • quarkus-container-image-jib
  • quarkus-container-image-docker
  • quarkus-container-image-s2i
• 
  Generate Kubernetes resources
  • quarkus-kubernetes
  • quarkus-minikube
  • quarkus-openshift
  • quarkus-kubernetes-config

Watch Quarkus Insights #15: Kubernetes and OpenShift with Quarkus

How fast can you (re-)deploy?

• Jib (minimal app):
  • ~10s with local Docker daemon
  • add 3+ seconds with remote registry
  • add 3+ seconds to redeploy inside the cluster
• 
  OpenShift s2i: ~1 min

Camel K overview

Camel K demo

https://github.com/ppalaga/camel-quarkus-cnorris-demo

How Camel K works

Knative

• Building blocks for Serverless applications
• CRDs and operators

https://knative.dev

Knative Serving

Knative Eventing

https://cloudevents.io

Knative event source

Knative event sink

Knative Event Router

• A stream-processing platform
• Distributed, scalable, fault-tolerant, fast

Apache Kafka APIs

• Producer API - publish records to topics
• Consumer API - subscribe to topics to consume records
• Streams API - act as a stream processor/transformer
• Connector API, a.k.a. Kafka Connect

Kafka Connect

Stream data between Apache Kafka and other systems

• A framework to write Connectors
• A runtime to run them
  • Distributed or standalone
  • Automatic offset management
  • REST API to manage connectors

Camel Kafka Connector

Minimal (code-less) configuration

350+ Camel components supported

Wrap up

• Apache 🐪 = an integration lib with 360+ connectors
• 🚀🔬 on Quarkus
• Producer/Consumer/Router, scale to 0️⃣ on Knative
• Stream data from/to Kafka

• https://camel.apache.org
• Chat: https://gitter.im/apache/camel
• Mailing list: dev@camel.apache.org
• Follow @ApacheCamel