(USA) Senior Data Engineer

  • Walmart
  • Bentonville, AR, United States
  • 06/22/2022

Job Description

Position Summary...

What you'll do...

What you'll do...

At Walmart, we help people save money, so they can live better. This mission serves as the foundation for every decision we make and drives us to create the future of retail. We can't do that without the best talent - talent that is innovative, curious, and driven to create exceptional experiences for our customers.

We are seeking a Senior Data Engineer who will be responsible to establish robust data pipelines and services. We are looking for a highly motivated, resourceful, team-oriented individual to drive the data engineering process. Our ideal candidate is an exceptionally talented Senior Data engineer with an outstanding track record of working with very large data sets and building robust data pipelines. You will be working with structured/unstructured Data sets, building large scale Data processing platforms, implementing world class data governance and operational controls, solving complex performance challenges. This role will report up to the Senior Manager Data Engineering.

You'll make an impact by:

Design, develop and build database to power Big Data analytical systems.

Design data integration pipeline architecture and ensure successful creation of the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Spark, SQL, HQL and other technologies.

Build robust and scalable applications using SQL, Scala/Python and Spark.

Create real time data streaming and processing using Kafka and/or Spark streaming.

Work on creating data ingestion processes to maintain Global Data lake on Google cloud or Azure

Engage with architects and senior technical leads to create and enhance complex software components.

Design, configure and implement systems that can scale to process terabytes of data between heterogeneous systems on premise and cloud.

Work with business customers, product managers and engineers to design feature-based solutions and implement them in an agile fashion.

Develop proof-of-concept prototype with fast iteration and experimentation.

Develop and maintain design documentation, test cases, performance and monitoring and performance evaluation using Git, Crontab, Putty, Jenkins, Maven, Confluence, ETL, Automic, Zookeeper, Cluster Manager

You'll sweep us off our feet if...

5+ years of relevant technology consulting or industry experience to include experience in Information delivery, Analytics and Business Intelligence based on data

Understanding of the benefits of data warehousing, data architecture, data quality processes, data warehousing design and implementation, table structure, fact and dimension tables, logical and physical database design, data modeling, reporting process metadata, and ETL processes.

5+ years' experience in Python

5+ years' experience in SQL

5+ years' experience PySpark

4+ years of hands-on experience with data core modernization and data ingestion.

2+ years' experience leading workstreams or small teams

Bachelor's Degree or equivalent professional experience

Preferred:

An advanced degree in area of specialization is preferred.

Experience with Cloud using Microsoft Azure, and/or Google Cloud Platform (GCP)

Experience with Spark, Python

Experience designing and developing data cleansing routines utilizing typical data quality functions involving standardization, transformation, rationalization, linking and matching

Knowledge of data, master data and metadata related standards, processes and technology

Experience working with multi-Terabyte data sets

Strong oral and written communication skills, including presentation skills

Minimum Qualifications...

Outlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications.

Option 1: Bachelor's degree in Computer Science and 3 years' experience in software engineering or related field. Option 2: 5 years' experience in
software engineering or related field. Option 3: Master's degree in Computer Science and 1 year's experience in software engineering or related
field.
2 years' experience in data engineering, database engineering, business intelligence, or business analytics.

Preferred Qualifications...

Outlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications.

Data engineering, database engineering, business intelligence, or business analytics, ETL tools and working with large data sets in the cloud, Master's degree in Computer Science or related field and 3 years' experience in software engineering

Primary Location...
805 SE MOBERLY LN, BENTONVILLE, AR 72712, United States of America

Employer Job Listing Link

https://click.appcast.io/track/eidis6r-org?cs=37f&jg=1yfx&bid=lUf2CslKyPxm6i440ZgUYA==