Java Spark Engineer
- California Soft Tech INC.
1 Days Ago
NA
C2C
Berkeley Heights-NJ
8-12 Years
Required Skills: Core Java, Apache Spark, Big Data technologies, Spring Boot, Kafka, Hive, HDFS, SQL, GIT, Maven, Jenkins, CI/CD pipelines, AWS, Azure, GCP, Docker, Kubernetes
Job Description
We are looking for a skilled Java Spark Engineer with experience in building scalable, high-performance data processing applications. The ideal candidate should have strong expertise in Core Java, Apache Spark, and Big Data technologies and be comfortable working in an Agile environment to develop enterprise-grade applications.
Required Skills:
- 6+ years of experience in Java development.
- Strong hands-on experience with Core Java (Java 8/11/17).
- Experience with Apache Spark (Spark Core, Spark SQL, DataFrames, RDDs).
- Strong SQL skills and experience with relational databases.
- Knowledge of Hadoop ecosystem (Hive, HDFS) is a plus.
- Experience with Spring Boot and RESTful APIs.
- Familiarity with Kafka or other messaging platforms.
- Experience with Git, Maven, Jenkins, and CI/CD pipelines.
- Knowledge of cloud platforms (AWS, Azure, or GCP) is preferred.
- Strong debugging, performance tuning, and analytical skills.
Responsibilities:
- Develop and maintain scalable Java applications using Apache Spark.
- Design and optimize Spark jobs for large-scale data processing.
- Build and enhance ETL/data processing pipelines.
- Develop REST APIs using Spring Boot.
- Perform code reviews, unit testing, and performance optimization.
- Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions.
- Troubleshoot production issues and provide timely resolutions.
- Follow Agile/Scrum development methodologies.
Preferred Qualifications:
- Experience with financial services or enterprise applications.
- Exposure to Docker, Kubernetes, and Microservices architecture.
- Excellent communication and problem-solving skills.
