Distributed Systems Optimization - Apache Zookeeper

Distributed Systems Optimization Consultant - Apache Zookeeper 1681

A leading enterprise software solutions company is seeking a Distributed Systems Optimization Consultant. The successful candidate will enhance the resiliency and performance of our distributed systems infrastructure. The ideal candidate possesses deep expertise in Zookeeper configuration, tuning, and troubleshooting, with a strong understanding of distributed systems, high-availability requirements, and related technologies such as RabbitMQ, Redis, and Kafka. The company offers a great work environment.

Distributed Systems Optimization Consultant - Apache Zookeeper Pay and Benefits:

• Hourly pay: $150/hr
• Worksite: Leading enterprise software solutions company (Pleasanton, CA 94588 - Hybrid, Open to remote candidates in the United States, Candidates local to Pleasanton are preferred, Must be available to work flexible hours to meet with the team in Ireland)
• W2 Employment
• 40 hours/week, 1 Month Assignment

Distributed Systems Optimization Consultant - Apache Zookeeper Responsibilities:

• Performance Optimization:
  • Analyze the current Zookeeper setup and identify bottlenecks affecting performance.
  • Implement tuning measures for read/write latency, throughput, and leader election times.
  • Optimize JVM parameters and Zookeeper settings (e.g., tick time, heap size)
• Resiliency Enhancement:
  • Architect solutions for fault tolerance and disaster recovery.
  • Design and implement multi-region and multi-data center deployments.
  • Establish robust configurations for quorum consistency and failover mechanisms.
• Monitoring and Alerting:
  • Review monitoring tools (e.g., Prometheus, Grafana) to track Zookeeper health for resiliency.
  • Develop custom alerts for potential issues such as latency spikes, memory usage, and connection limits.
• Collaboration:
  • Work closely with engineering teams to ensure Zookeeper is optimized and resilient alongside other components like Kafka, RabbitMQ, Redis, and custom services.
  • Conduct capacity planning to ensure scalability for future workloads.

Distributed Systems Optimization Consultant - Apache Zookeeper Qualifications:

• 10+ years of hands-on experience managing and optimizing Apache Zookeeper in production environments at large scale.
• Experience with RabbitMQ, Redis, and Kafka in distributed architectures.
• Expertise in associated technologies like RabbitMQ, Redis, and Kafka, with an understanding of their integration into distributed environments.
• Experience in development and large-scale implementations and reviews/assessments.
• Relevant certifications in distributed systems, messaging technologies, or DevOps practices are a plus.
• Proven track record of designing resilient distributed systems.
• Deep understanding of distributed systems, including Zookeeper internals (leader election, session management, quorum design).
• Proficiency in monitoring and troubleshooting tools such as Prometheus, Grafana, or similar.
• Strong scripting skills (e.g., Bash, Python) for automation.
• Excellent problem-solving and communication abilities.