Data Engineer
Experience – 3 to 7 years
Software Skills- PySpark, Python, Scala
Job Description
- Designing, building and deploying data systems, pipelines, and applications
- Playing a key part in defining and establishing data pipelines to produce reliable feature sets for Data Analytics and Reporting
- Ingesting data from a variety of data sources from relational databases to unstructured data such as text, CSV documents etc
- To setup database connection with various on cloud/ on premises databases using connection methods as guided/ defined by different tools and client technical requirement guidelines
- Work closely with the customers on everything including problem scoping, infrastructure provisioning, execution, deployment, maintenance Skills
- Excellent hands-on experience with PySpark, Python, Scala,
- Excellent hands-on experience of using Data Lake and Databricks, EMR
- Worked on AWS Data orchestration tools and technologies
- Ability to grasp challenges for business stakeholders and looking for their solutions
- Proven success in communicating with users, other technical teams, and senior management to collect requirements, describe data modelling decisions and data engineering strategy
- Has passion to work on new technologies.
Job Location: Bangalore Mangalore