Data Engineer
- Intuitive Insights LLC
8 Hours Ago
NA
W2
Houston-TX
7-10 Years
Required Skills: Spring Boot, Kafka, Kubernetes
Job Description
Data Engineer – Oracle PL/SQL, Databricks, Java & Spark
We are looking for an experienced Senior Data Engineer to support modernization of the Credit Risk technology stack.
Key Responsibilities:
- Modernize and upgrade enterprise Credit Risk technology platforms.
- Develop and maintain complex Oracle PL/SQL packages, procedures, views, and business logic.
- Develop and optimize SQL and Databricks SQL queries.
- Work with Databricks, Delta Lake, Unity Catalog, and dbt.
- Develop data pipelines using Java, Python, Scala, and Apache Spark.
- Implement dimensional data modeling, SCD2, and historical data tracking.
- Perform Spark and Databricks performance tuning.
- Support legacy-to-cloud data migration, reconciliation, and validation.
Required Skills:
- Strong Oracle PL/SQL and SQL expertise.
- Databricks, Databricks SQL, Delta Lake, and Unity Catalog.
- Hands-on dbt experience, including models, snapshots, macros, Jinja, and testing.
- Java, Python, Scala, and Spark experience.
- Strong data modeling and performance optimization experience.
- Legacy-to-cloud migration and data reconciliation experience.
Preferred Skills:
- AWS, S3, Snowflake, Dremio.
- Spring Boot, Kafka, Kubernetes, and Docker.
