Big Data Engineer

Job Description:

Responsibilities:

• Responsible for the architecture planning, design, and core code implementation of the company's monitoring system platform, including product technology pre-research, technology architecture selection, core code writing, design document writing, etc.
• Participate in the R&D of the company's big data computing platform, responsible for data quality and stability management
• Responsible for understanding and managing non-functional system requirements, including software maintainability, performance, reusability, reliability, scalability, effectiveness, and testability • Responsible for project technical requirements and technical risk control, overall responsibility for project technology
• Continuously improve the architectural design and constantly enhance platform performance, reliability, and scalability
• Define development standards and specifications, and promote the implementation of development standards and specifications

Requirements:

• Bachelor's degree or above in computer-related majors preferred
• 5+ years of backend development experience in big data platforms
• 4 years of big data platform-related architecture experience, with practical large-scale data collection and data analysis platform architecture design and development experience
• Deep understanding of common big data platform-related technologies such as Spark/Hadoop/Kafka/ELK
• Proficient in Java language, Spring Cloud architecture, and Web service development
• Proficient in MySQL, Cassandra, and other databases
• Familiar with the use of cloud-native technologies such as Kubernetes and Docker
• Rich experience in data warehouse modeling and data development
• Keen technical insight and strong problem analysis capabilities, broad technical vision and passion for big data technology, and strong innovation capabilities
• Familiar with common software architecture methods and requirement assessment methods
• Familiar with software architecture documentation writing and good documentation work abilities