Senior Data Engineer
Job description
We are looking for a Senior Data Engineer to join What If Media Group’s Data Management team to help design, build, and maintain our ETL systems. There will be additional opportunities to work with technologies used by our various Engineering and Data Science teams. This position can be remote or on-site at our Fort Lee headquarters. Help us implement best practices not only on our Data Management Team but across the technical organization.
Your Responsibilities:
- Work with our Product Engineering, DevOps, and Data Science teams to create accurate and efficient data pipelines between the key component of our infrastructure
- Create ETL processes that combine data from all of our marketing channels that enable cross-channel decision-making engines and models
- Work with stakeholders, including the Executive, Product, Engineering, and Data Science teams, to assist with data-related technical issues and support their data infrastructure needs
- Assist with the optimization of data-driven processes focusing on both performance and cost
- Ensure our ETL processes adhere to security and compliance protocols
- Propose new additions to our Data Engineering and Data Science technology stacks
- Identify, design, and implement internal process improvements, including automating manual processes and optimizing data delivery
You Today:
Education & Experience
- Bachelor’s degree or higher, preferably in Computer Science or a related STEM field discipline. Relevant practical experience will supersede a specific academic qualification.
- Experience working with modern ETL tools in a production capacity
- 7+ years of prior professional experience
Skills
Required
- Proficiency in programming languages such as Python, SQL, and Java
- Expertise with ETL/ELT tools and data integration technologies, with a focus on open-source solutions such as Apache Airflow, Apache NiFi, or Talend
- Ability to design and implement efficient data pipelines and architecture, with a focus on scalability and performance
- Strong understanding of data modeling and schema design, including experience with dimensional modeling techniques
- Familiarity with DevOps practices and tools such as Docker and Kubernetes
- Experience with data warehousing technologies such as Amazon Redshift, Snowflake, Databricks, or Google BigQuery
- Extensive knowledge of cloud computing platforms such as AWS, Azure, or GCP
- Strong understanding of data storage, processing, and analysis technologies such as Hadoop, Spark, and NoSQL databases
- Experience with Agile methodologies and project management tools such as Jira
- Strong problem-solving and analytical skills, with the ability to troubleshoot complex data issues
- Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams
- Ability to diagram processes and connected systems and present ideas to the team
- You are able to lead the design and development of more complex feature enhancements involving yourself and one or more additional engineers. You solve business problems with simple and straightforward solutions, applying appropriate technologies and software engineering best practices
Tools We Use (Nice to Have)
- Languages and frameworks: Python, Node.js, Java, Spring Boot, ES6, React, Vert.x, Go
- AWS services: EC2, ECS, EKS, RDS, S3, DMS, Lambda, Athena, and MSK
- Databases: PostgreSQL, MariaDB, DynamoDB, MongoDB, and Snowflake
- Business intelligence tools: Looker
The salary range for this role is $145,000 to $155,000 annually plus bonus. This salary range is the expected range, but your actual pay will be determined based on work location and job-related factors such as knowledge, skills, and experience. Salary is just one component of WIMG'S total compensation package for employees.
What If Media Group is an Equal Opportunity Employer. We provide employees with a competitive salary, bonus plan, and generous medical, dental, vision, & 401k plans. We look forward to hearing from you!
smogtown13.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, smogtown13.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, smogtown13.com is the ideal place to find your next job.