Job Description
Position Overview:
You will be responsible for designing, implementing, and maintaining Restful API servers using SpringBoot and Spring, as well as integrating collected data with ELK (Elasticsearch, Logstash, Kibana) for efficient data indexing and retrieval. In addition, you will design and build API communication with OpenAPI services, develop web crawlers, and manage their operation. You will also be involved in infrastructure setup and maintenance on cloud platforms like AWS, GCP, and server hosting.
Responsibilities:
- Design and implement Restful API servers using SpringBoot and Spring.
- Integrate collected data with ELK for effective data indexing and API server implementation.
- Design and build API communication with OpenAPI services.
- Develop and operate web crawlers for data extraction.
- Set up and maintain system infrastructure on AWS, GCP, or server hosting.
- Build and maintain CI/CD pipelines using open-source tools.
- Utilize open-source tools for BATCH job scheduling and automation.
Requirements:
- Proficiency in the Java programming language.
- 10+ years of experience in backend development using Spring.
- 5+ years of experience in web scraping (crawling) development and operation.
- Experience in utilizing open-source tools for BATCH job scheduling and operation.
- Ability to design and develop RDB and NoSQL databases.
- Experience in data indexing and API integration using ELK (Elasticsearch, Logstash, Kibana).