Azure Data Engineer Job at Apptad Inc, Dallas, TX

dW03SnZUdU44eS9Od2ttVWpkS2xFQ3NIdXc9PQ==
  • Apptad Inc
  • Dallas, TX

Job Description

Desired Skills

1Possess a minimum of 5 years of experience in data engineering and development

2Strong experience in designing and implementing data solutions using Azure data services Azure Databricks Azure Data Lake Azure Synapse Analytics Azure Data Factory

3Have a strong background in Retail CPG domain

4Proficiency in SQL TSQL and data modelling techniques

5Experience with PySpark and orchestration tools like Apache Airflow are highly desirable

6Hands on experience with scripting languages such as Python for data processing and manipulation

7Strong analytical and problemsolving skills

8Excellent communication and interpersonal skills with ability to work effectively in a collaborative team environment

9Knowledge on Databricks Unity Catalog and visualization tools like Power BI is a plus

Roles and responsibilities

1Develop and optimize data workflows using PySpark ADLS and Databricks workflows to support business objectives

2Implement and maintain data pipelines to ensure efficient data processing and storage

3Collaborate with crossfunctional teams to gather requirements and deliver data solutions that meet business needs

4Provide technical expertise in the design and implementation of data solutions ensuring scalability and performance

5Monitor and troubleshoot data workflows to ensure reliability and accuracy of data processing

6Apply Spark in Python for advanced data processing and analytics

7Build automation solutions and utilities to eliminate manual efforts and repetitive tasks

8Utilize Databricks SQL for effective data management and querying

9Implement monitoring solutions in Azure to track resource utilization performance and health of data workflows

10Manage and organize data assets using Databricks Unity Catalog

11Leverage Azure DevOps for continuous integration and deployment of data solutions

12Secure data workflows using Azure Key Vault and ensure compliance with data security standards

Skills

Mandatory Skills : Java,Python,Scala,Snowflake,Azure BLOB,Azure Data Factory,Azure Functions,Azure SQL,Azure Synapse Analytics,AZURE DATA LAKE,ANSI-SQL,Databricks,HDInsight

Job Tags

Similar Jobs

AV Staffing Solutions

Bilingual Customer Service Representative (Fluent Spanish/English) Job at AV Staffing Solutions

 ...Strong typing skills (50+ WPM)and comfort working quickly on a computer ~ Ability to...  ...and professional ~ Willingness to work overnights, weekends, and rotating schedules in a 24...  ...focused, remote-friendly team! Benefits: ~ Work from home Work Location: Remote... 

PwC

PwC Private - Audit Senior Associate Job at PwC

 ...Time Type: Full time Travel Requirements: Up to 40% At PwC, our people in audit and assurance focus on providing independent...  ...professional and technical standards (e.g. refer to specific PwC tax and audit guidance), the Firm's code of conduct, and independence... 

PSG

PLANT CONTROLLER Job at PSG

 ...plant performance metrics. Advise leadership on spending, controls, and variance drivers. Prepare monthly performance and variance...  ...Leadership experience in Manufacturing Industry, preferably automotive manufacturing. ~ PLEX knowledge is a big plus Job Type... 

Chick-fil-A

Marketing Job at Chick-fil-A

 ...a highly skilled and motivated individual with a passion for marketing? Do you thrive in a positive and people-focused environment? Join...  ...thrive. About Chick-fil-A: Working at a Chick-fil-A restaurant is more than a job it's an opportunity for teamwork and leadership... 

Amazing Athletes

Preschool Sports & Fitness Coach Job at Amazing Athletes

 ...Amazing Athletes is seeking a Preschool Sports & Fitness Coach to join our team. Our company is the largest multi-sport enrichment program in the country, designed for children ages 2-12 years old to have fun through positive movement experiences, with a focus on meeting...