Pyspark Engineer Job at Trinity Technology Solutions LLC, Charlotte, NC

dVduTXZ6cUk4eXpKeTB5UWh0S2dGUzhGdVE9PQ==
  • Trinity Technology Solutions LLC
  • Charlotte, NC

Job Description

Job Description:

Our client is seeking a highly skilled and experienced Senior PySpark Developer to join our dynamic data engineering team. This role is ideal for a motivated professional with a strong background in big data technologies, ETL processes, and database systems. The successful candidate will play a key role in designing, developing, and optimizing data pipelines and analytics solutions that support critical business operations.

📌 Note: Only candidates eligible to work on a W2 basis will be considered.

Key Responsibilities:

  • Design, develop, and maintain scalable data pipelines using PySpark and Spark SQL.
  • Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver robust solutions.
  • Optimize and troubleshoot complex ETL workflows and data transformation processes.
  • Write efficient SQL queries for data extraction, transformation, and loading.
  • Ensure data quality, integrity, and compliance with enterprise standards.
  • Participate in code reviews, testing, and deployment activities.
  • Monitor and maintain production workflows, including job scheduling and performance tuning.

Required Skills & Qualifications:

  • 5+ years of experience in data engineering or software development.
  • Strong proficiency in PySpark, Python, and Spark SQL.
  • Solid experience with SQL and relational database systems.
  • Proven expertise in ETL development and data pipeline orchestration.
  • Familiarity with job scheduling tools; Autosys experience is a plus.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration abilities.

Preferred Qualifications:

  • Experience working in the financial services industry.
  • Familiarity with cloud platforms and big data ecosystems.

Job Tags

Similar Jobs

FIS

Software Engineer (COBOL) Job at FIS

care was taken to include all competencies needed to successfully perform in this position. However, for Americans with Disabilities Act (ADA) purposes, the essential functions of the job may or may not have been described for purposes of ADA reasonable accommodation. All...

Sage Solutions Group

Graphic Designer Job at Sage Solutions Group

&##127932; Graphic Designer Ann Arbor, MI In-Person About the Role We are seeking a full-time, in-office Graphic Designer to...  ...This is a permanent, on-site position (not hybrid, remote, freelance, or contract) where youll be hands-on with creative projects... 

Holiday Inn Roswell

Night Auditor Job at Holiday Inn Roswell

 ...Your Future is Now!Position Summary: The Night Auditor is responsible for overseeing front desk duties during the night shift and ensuring guest payments are posted and all...  ..., operates, and owns the worlds leading hotel brands as well as boutique hotels. Raines has... 

Griswold Homecare for South Palm Beach

Companion Caregiver Job at Griswold Homecare for South Palm Beach

 ...Griswold Home Care for South Palm Beach is calling all compassionate individuals to apply to join our amazing team as a full-time Caregiver!Compensation: $15 - $18/hr.WHY YOU SHOULD JOIN OUR TEAMWe are an established company in the care giving industry that appreciates... 

Indian Grill restaurant

Server Job at Indian Grill restaurant

 ...and good salaryRestaurant open 6 days a week, 1 day off.No buffet, only dine-in from menu and to go orders.We also give free accommodation very close to restaurant and provide free meals.Hiring immediately.Job Location: Orlando, Florida.Interested...