Real Time Kafka Architect

Posted 03 March 2025
LocationLeeds
Job type Contract
Discipline Commodities and Financial Services
Reference68802

Job description

Job Title: Real Time Kafka Architect

Location: Leeds, UK- 3 days/week

Duration: 6months+

 

Responsibilities

  • 5+ years of experience in application integration development

  • 2+ years of experience in Cloud Integration Services and Kafka
  • 3 years of experience managing Confluent / Apache Kafka platforms in Cloud and/or on premise environments.
  • Manage Kafka Cluster build, including Design, Infrastructure planning, High Availability and Disaster Recovery
  • Build and support producer / consumer apps
  • Implement encryption using SSL, authentication using SASL/LDAP & authorization using Kafka ACLs in Zookeeper, Broker/Client, Connect cluster/connectors, Schema Registry, REST API, Producers/Consumers, KSQL
  • Undertake Lifecycle Management across the Kafka on premise environments.
  • Research and recommend innovative ways to maintain the environment and ensure automation is undertaken.
  • Setting up monitoring tools such as SPLUNK, Prometheus, Grafana to provide metrics from various Kafka cluster components (eg., Broker, Zookeeper, Connect, REST proxy, Mirror Maker, Schema Registry, KSQL)
  • Undertake regular assessments of the platform health and stability, create improvement plans and ensure automation/lifecycle management is undertaken.
  • Experience in Containerisation (Openshift / Kubernetes).
  • SSL Certificate management including public key management
  • Knowledge of Network topologies and Storage (SAN/NAS/DAS), clustering and virtualisation technologies
  • Interaction with Oracle / PostgreSQL databases
  • Management of disaster recovery testing for the Middleware Services block application and supporting Product Grid block application testing
  • Architect, being able to attend Architecture forums and demonstrate pros/cons of different solutions
  • Strong Communications and ability to work with business area

 

Priyanka Sharma

Senior Delivery Consultant

Office: 02033759240 

Email: [email protected]