Responsible for building robust, scalable, and optimized ETL pipelines, managing Customer Data Platform (CDP) infrastructure, and driving automated workflows and data processing.
Internal Alignment: Resource will be working with core development team members in feature development along with supporting the Support team in terms of technical analysis, production RCA and business onboarding requests. [50:50 capacity split]
Technical Skills & Competencies
- Treasure Data (CDP): Deep proficiency in Treasure data workflow, understanding of Trino/hive, SQL.
- Python / PySpark: Strong hands-on experience in building distributed processing frameworks using Python/PySpark to manage large-scale data manipulation and batch transformations.
- Advanced SQL Mastery: Expert-level understanding of optimized query structuring, window functions, schema architectures, data cleansing, and performance tuning across complex database setups.
- Agile / Scrum Methodologies: Active alignment with continuous delivery pipelines, sprint ceremonies (stand-ups, retrospectives, planning), and tracking items dynamically in workflow systems like Jira or Confluence.
Soft Skills Needed
- Systems Thinking & Agility: The power to quickly adapt to rapidly changing sprint priorities, technical constraints, and data governance updates.
- Active Cross-Functional Collaboration: Strong capacity to seamlessly bridge technical infrastructure gaps with requirements set by downstream business analytics teams.
- Self-Documentation Discipline: High priority placed on clear, comprehensive blueprint mapping and ETL logic documentation to avoid pipeline knowledge gaps.
