Required Skills: Starburst, Informatica Powercentre, Hadoop
Job Description
Must Have Technical/Functional Skills
Primary Skill: Starburst
Secondary: Hadoop, Informatica
Roles & Responsibilities
- Responsible to design and implement federated query and open Lakehouse architecture. Their core focus is enabling seamless, high-performance SQL access across disparate, distributed data sources (lakes, data warehouses, and relational databases) without requiring costly data movement.
- Data Virtualization Strategy: Design federated data access solutions utilizing distributed SQL engines and open table formats to abstract away underlying data storage locations
- Platform Architecture: Architect, deploy, and scale Starburst Enterprise or Starburst Galaxy platforms. Configure and manage diverse connectors to object storage (S3, ADLS), NoSQL, and relational databases
- Performance Tuning: Optimize distributed SQL queries, resolve data processing bottlenecks, and implement workload management and caching strategies
- Governance & Security: Collaborate with InfoSec and compliance teams to enforce role-based access control, row/column-level security, and data lineage using tools like Apache Ranger
- AI & Analytics Enablement: Support downstream data consumption for BI (Tableau, Power BI) and act as a foundation for enterprise AI and RAG pipelines