Job description

Must have skills:

• 8+ years of experience building high performance scalable enterpris`e analytics or data centric solutions
• 8+ or 5+ years of experience in the design and build of data extraction, transformation, and loading processes by writing custom data pipelines
• At least 5 years of experience implementing complex ETL pipelines preferably in connection with Glue and/or Spark
• Exceptional coding and design skills in Python or Java/Scala
• Hands-on experience with AWS (i.e. Glue, Aurora Postgres, Lambda, EMR, EKS, Redshift, etc.)
• Experience with visualization tools like QuickSight, PowerBI, Looker or Tableau
• Experience with Talend (ETL) is a big plus

Roles and Responsibility:

• Drive a high impact and high visibility project that enables data availability, encompasses data analytics, machine learning, and petabyte scale datasets, and provides reliable and timely access to thousands of data sources
• Design, architect and support systems for collecting, storing, and analyzing data at scale
• Recommend improvements and modifications on new and existing data and ETL pipelines. Create optimal data pipeline architecture and systems using Apache Airflow
• Create data analytics for d ata scientists to innovate, build and optimize our ecosystem
• Assemble large, complex data sets that meet functional and non-functional business requirements
• Be responsible for ingesting data into our data lake and providing frameworks and services for operating on that data including the use of Spark
• Analyze, debug and correct issues with data pipelines
• Operate on or build solution required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, AWS and Spark technologies

Job Type: Full-time

Salary: $56.80 - $80.16 per hour

Experience level:

• 8 years

Schedule:

• 8 hour shift

Experience:

• Informatica: 7 years (Preferred)
• SQL: 8 years (Preferred)
• Data warehouse: 8 years (Preferred)

Work Location: On the road

smogtown13.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, smogtown13.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, smogtown13.com is the ideal place to find your next job.