Senior Consultant (Elastic)

Job Description:

Key Responsibilities:

1. Architecture & Deployment

• Design and implement highly available and scalable Elasticsearch clusters.

• Conduct architecture reviews, capacity planning, and performance optimization.

• Ensure robust security configurations, including access controls and encryption.

2. Data Migration

• Develop and execute data migration strategies, including snapshot and restore mechanisms.

• Ensure seamless data movement across multiple clusters while maintaining data integrity.

3. Observability & Monitoring

• Set up log collection pipelines using Beats and Logstash, normalizing data to Elastic Common Schema (ECS).

• Deploy and configure uptime monitoring (Heartbeat), APM agents for Java applications, and synthetic monitoring.

• Define ILM policies for optimized data retention and management.

4. Custom Integrations & Security

• Implement and configure third-party integrations with Elasticsearch.

• Develop custom parsers and ingestion pipelines for structured and unstructured data.

• Enforce role-based access control (RBAC) and security best practices.

5. Dashboards & Alerting

• Develop custom Kibana dashboards for monitoring system health and business metrics.

• Implement 20+ detection rules and alerts for proactive system monitoring.

• Work closely with stakeholders to define observability use cases and data visualizations.

Requirements:

• 5 to 8 years of experience in Elasticsearch, Observability, or Cloud Data Engineering.

• Excellent communication skills are mandatory for effective client interactions and solution presentations.

• Strong expertise in Elasticsearch, Logstash, Kibana, and Beats.

• Experience in Elastic Security, ILM, and data migration strategies.

• Proficiency in cloud platforms (AWS, GCP, or Azure) and Kubernetes.

• Hands-on experience in log collection, normalization, and custom pipeline development.

• Strong knowledge of Linux environments, scripting, and automation.

• Excellent problem-solving skills and ability to work in a client-facing role.