Back to jobs
Real Time Kafka Architect
- Posted 03 March 2025
- LocationLeeds
- Job type Contract
- Discipline Commodities and Financial Services
- Reference68802
Job description
Job Title: Real Time Kafka Architect
Location: Leeds, UK- 3 days/week
Duration: 6months+
Responsibilities
-
5+ years of experience in application integration development
-
2+ years of experience in Cloud Integration Services and Kafka
-
3 years of experience managing Confluent / Apache Kafka platforms in Cloud and/or on premise environments.
-
Manage Kafka Cluster build, including Design, Infrastructure planning, High Availability and Disaster Recovery
-
Build and support producer / consumer apps
-
Implement encryption using SSL, authentication using SASL/LDAP & authorization using Kafka ACLs in Zookeeper, Broker/Client, Connect cluster/connectors, Schema Registry, REST API, Producers/Consumers, KSQL
-
Undertake Lifecycle Management across the Kafka on premise environments.
-
Research and recommend innovative ways to maintain the environment and ensure automation is undertaken.
-
Setting up monitoring tools such as SPLUNK, Prometheus, Grafana to provide metrics from various Kafka cluster components (eg., Broker, Zookeeper, Connect, REST proxy, Mirror Maker, Schema Registry, KSQL)
-
Undertake regular assessments of the platform health and stability, create improvement plans and ensure automation/lifecycle management is undertaken.
-
Experience in Containerisation (Openshift / Kubernetes).
-
SSL Certificate management including public key management
-
Knowledge of Network topologies and Storage (SAN/NAS/DAS), clustering and virtualisation technologies
-
Interaction with Oracle / PostgreSQL databases
-
Management of disaster recovery testing for the Middleware Services block application and supporting Product Grid block application testing
-
Architect, being able to attend Architecture forums and demonstrate pros/cons of different solutions
-
Strong Communications and ability to work with business area
Priyanka Sharma
Senior Delivery Consultant
Office: 02033759240
Email: [email protected]