Data Engineer II

  • Walmart
  • Bentonville, AR, United States
  • 08/17/2021

Job Description

Position Summary...

What you'll do...

Data Engineer II

  • Problem Formulation: Identifies possible options to address the business problems within one's discipline through analytics, big data analytics, and automation.
  • Applied Business Acumen: Supports the development of business cases and recommendations. Owns delivery of project activity and tasks assigned by others. Supports process updates and changes. Solves business issues.
  • Data Source Identification: Understand the appropriate data set required to develop simple models by developing initial drafts. Supports the identification of the most suitable source for data. Maintains awareness of data quality.
  • Data Transformation and Integration: Identifies and understands suitable extraction software. Reviews data from a quality perspective based on the guidelines given. Supports data processing.
  • Data Modeling: Profiles and analyzes source system data to determine data relationships, design constructs, consistency, and quality. Integrates data into existing physical data models. Defines the relational tables, primary and foreign keys, and stored procedures to create a data model structure. Identifies data entities and describes their relationships as a model. Builds a basic physical schema and objects based on a provided logical model. Creates proofs of concept to support design patterns.
  • Code Development and Testing: Writes code to develop the required solution and application features by using the recommended programming language and leveraging business, technical, and data requirements. Test the code using the recommended testing approach.
  • Data Governance: Supports the documentation of data governance processes. Supports the implementation of data governance practices
  • Data Strategy: Understands, articulates, and applies principles of the defined strategy to routine business problems that involve a single function.
  • Demonstrates up-to-date expertise and applies this to the development, execution, and improvement of action plans by providing expert advice and guidance to others in the application of information and best practices; supporting and aligning efforts to meet customer and business needs; and building commitment for perspectives and rationales.
  • Provides and supports the implementation of business solutions by building relationships and partnerships with key stakeholders; identifying business needs; determining and carrying out necessary processes and practices; monitoring progress and results; recognizing and capitalizing on improvement opportunities; and adapting to competing demands, organizational changes, and new responsibilities.
  • Models compliance with company policies and procedures and supports company mission, values, and standards of ethics and integrity by incorporating these into the development and implementation of business plans; using the Open Door Policy; and demonstrating and assisting others with how to apply these in executing business processes and practices.

What You’ll Do: 

  • Direct root cause analysis of critical business and production issues. 
  • Bring new ideas for product enhancement. 
  • Promote and support company policies, procedures, mission, values, and standards of ethics and integrity.
  • Ability to learn and adapt new technologies, passion for continuous improvement. 
  • Interact and work with multiple cross functional teams.

 What you need to be successful in the role: 

  • Prior Data Engineering experience at a startup, or mid to large sized corp. 
  • Proficient oral and written communication skills. 
  • Prior experience developing or working, with hands on experience building, running and deploying application with Cloud technologies such as Microsoft Azure, Google Cloud Platform. 
  • Ability to learn and adapt new technologies, passion for continuous improvement. 
  • Exposure to continuous build and continuous integration tools. 
  • Ability to deliver in Agile method (Kanban or SCRUM). 
  • Knowledge about containerized cloud applications. 
  • Data engineering, database engineering, business intelligence, or business analytics, ETL tools and working with data sets in the cloud.
  • Data Modeling: Analyzes data elements, systems, data flows, dependencies, and relationships to contribute to conceptual, physical, and logical data models.  
  • Develops the Logical Data Model and Physical Data Models including data warehouse and data mart designs. Defines relational tables, primary and foreign keys, and stored procedures to create a data model structure.  
  • Demonstrates expertise in writing queries across data sets to write data pipelines and data processing layers. 
  • Expertise with Big Data Technologies Hadoop, HDFS, Hive, Spark Scala/PySpark, and SQL. 

We’d Love To See: 

  • Expertise with RDBMS (Oracle, SQL Server, MySQL) with excellent understanding of transaction management and performance tuning. 
  • Experience with distributed databases like Cassandra, Cosmos, MongoDB. Understanding of non SQL databases.
  • Experience using messaging systems like Kafka or ActiveMQ.
  • Understanding about consuming ReST APIs. 

Minimal Qualification: 

  • Bachelor's degree in Computer Science or related field.
  • 2 years’ experience in software engineering or related field.

Minimum Qualifications...

Outlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications.

Option 1: Bachelor's degree in Computer Science or related field. Option 2: 2 years’ experience in software engineering or related field.

Preferred Qualifications...

Outlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications.

Masters: Computer Science

Primary Location...

805 SE MOBERLY LN, BENTONVILLE, AR 72712, United States of America

Employer Job Listing Link

https://click.appcast.io/track/alqqv9a-org?cs=37f&jg=1yfx&bid=lUf2CslKyPxm6i440ZgUYA==