DESCRIPTION
Would you like to be the go-to Data Engineer for a team that constantly learns new domains, tools and data sources to identify best practices from across Amazon's broad offerings and propagate them globally?
IT PnD Data and Analytics team is looking for a Data Engineer to join the team to design, manage, and continuously enhance our data and analytics infrastructure, with process automation/improvements, developing automated reporting solutions/tools, and improving the ability of the IT Services organization to process, analyse, access and consume accurate and timely data.
As a Data Engineer you will be working in one of the largest cloud-based data lakes. You should have experience in the design, creation, management, and business use of extremely large datasets. You should have excellent business and communication skills to be able to work with business owners to develop and define key business questions, and build data sets that answer those questions. You should be able to architect highly efficient data and reporting structures, making a trade-off between scalability, performance and user functionality needs, using expert knowledge in software development technologies. You should be able to lead design reviews and offer feedback on design, integration, performance and scalability issues. Serve as an authority in the area of technical and domain expertise and mentor, develop, and train data engineers.
Key job responsibilities
In this role you will work with a team in building a Federated data ecosystem, near real time data ingestion, calculation engines, and reporting solutions for IT Services organization. The role requires someone who loves data, understands enterprise information systems, has a strong business sense, and can collaborate with multiple teams to put these skills into action. The ideal candidate thrives in a fast-paced environment, relishes working with ambiguity, big data, and enjoys the challenges of highly complex business context. This role requires an individual with a strong data modelling background, deep knowledge of cloud infrastructure, optimizing data for business intelligence solutions, and the ability to quickly learn, adapt and work with a variety of technologies.
A day in the life
A day in the life of a data engineer at ITS PnD involves building and optimizing large-scale data pipelines using tools like AWS Lambda, Glue, and Redshift. The day typically starts with a team stand-up to align on priorities, followed by deep work on developing and refining data ingestion, transformation, and automation processes. Collaboration with data scientists, analysts, and stakeholders is key, ensuring the pipelines deliver the data needed for critical business insights. The day ends with monitoring, code reviews, and documenting progress, all while keeping scalability, efficiency, and Amazon's high standards for data quality in mind.
BASIC QUALIFICATIONS
- 2+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)
- Experience with one or more scripting language (e.g., Python, KornShell)
PREFERRED QUALIFICATIONS
- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience with any ETL tool like, Informatica, ODI, SSIS, BODI, Datastage, etc.
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, disability, age, or other legally protected status. If you would like to request an accommodation, please notify your Recruiter.
The base salary for this position ranges from $80,700/year up to $134,800/year. Salary is based on a number of factors and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. Applicants should apply via our internal or external career site.