Technology Lead | Azure Data Engineering Job at 2T Consulting, Atlanta, GA

Y1gzei96c1NiaytxbjM4SGFFTHNwVVRCNGc9PQ==
  • 2T Consulting
  • Atlanta, GA

Job Description

We are seeking an experienced Technology Lead / Azure Data Engineer with strong hands-on expertise in Azure Synapse Analytics and PySpark. The ideal candidate will have a deep understanding of Apache Spark, distributed data processing, Data Lake architecture, and modern data engineering practices.

Must-Have Skills

  • Azure Synapse Analytics
  • PySpark
  • Apache Spark architecture
  • Spark SQL
  • Data Lake architecture
  • Medallion Architecture
  • Data transformation and processing
  • Strong troubleshooting and problem-solving skills

Nice-to-Have

  • Microsoft Fabric
  • Experience with modern cloud data platforms

Responsibilities

  • Design, develop, and optimize data solutions using Azure Synapse Analytics.
  • Develop scalable data pipelines and transformations using PySpark and Spark SQL.
  • Apply Apache Spark architecture and distributed processing concepts to large-scale data workloads.
  • Design and implement Data Lake and Medallion Architecture solutions.
  • Troubleshoot performance, data quality, and pipeline-related issues.
  • Collaborate with cross-functional teams to understand requirements and deliver scalable solutions.
  • Evaluate and leverage Microsoft Fabric capabilities where appropriate.
  • Provide technical leadership and contribute to solution architecture and development standards.

Required Qualifications

  • 8+ years of experience in data engineering, cloud platforms, or related technology roles.
  • Strong hands-on experience with Azure Synapse Analytics.
  • Strong programming experience with PySpark and Spark SQL.
  • Deep understanding of Apache Spark and distributed data processing.
  • Experience designing and implementing Data Lake architectures.
  • Excellent communication and collaboration skills.
  • Strong analytical, troubleshooting, and problem-solving abilities.

Job Tags

Contract work

Similar Jobs

Wynn Las Vegas

Restaurant Manager - Red 8 Job at Wynn Las Vegas

 ...Job Description Red 8 celebrates the comforting flavors of Asia through a menu of Cantonese dim sum, Hong Kong-style barbecue, wok-fired noodles, fragrant curries, fried rice, and regional specialties from across China and Southeast Asia. Whether stopping... 

Roboflow

Remote Technical Recruiter Job at Roboflow

 ...Technical Recruiter Who We Are Our mission is to make the world programmable. Sight is one of the key ways we understand the world...  ...other team members as much as youd like, while also supporting remote team members. You can work from one of our Hubs (we offer a... 

Emcube Technologies Inc

TPL - Quality Test Engineer Job at Emcube Technologies Inc

 ...Title: TPL - Quality Test Engineer Type: Contract Location: Chillicothe, IL Experience: 3+ years Quality Test Engineer to evaluate product designs, functionality, equipment, systems, and processes against established quality standards.... 

Lola Blankets

Color & Print Designer Job at Lola Blankets

 ...make the world a cozier place. We are seeking a Color & Print Designer to own color and print research, development, and design across...  ...painting and drawing skills strongly preferredDeep understanding of textile printing techniques and production processes, including lab... 

Social Factor

Social Media Community Moderator Job at Social Factor

Social Factor is always looking for great moderation talent. We'd love to hear from you if you have interest in working with us on a project/gig or temporary basis . We offer flexible schedules to fit all lifestyles. Some of our work is 24/7 so if you are an early bird...