Data Engineer Job at People Tech Group Inc, Washington DC

dldqT3VUaUw5aXJQd2txUmpkYWtGaUVDdlE9PQ==
  • People Tech Group Inc
  • Washington DC

Job Description

Role: Data Engineer

Duration: Long-term project.

Location: Redmond WA

Key Skills

  • Apache Spark (PySpark or Scala) : Writing scalable distributed rule engines.
  • Apache Hive : Querying partitioned datasets, schema handling.
  • Amazon EMR : Cluster management, tuning jobs for large datasets (20+ TB).
  • AWS S3 : Data partitioning, object lifecycle, access patterns.
  • Glue Data Catalog : Managing Hive table metadata.
  • Data Quality Frameworks : (Great Expectations, Deequ, or custom rules).
  • CI/CD : Code deployment pipelines (Git, Jenkins, Airflow, etc

Job Tags

Similar Jobs

Capital One

Manager, Process Management - Banker Efficiency & Effectiveness, Business Banking Job at Capital One

Manager, Process Management - Banker Efficiency & Effectiveness, Business BankingCapital One, a Fortune 500 company and one of the nation's top 10 banks, offers a broad spectrum of financial products and services to consumers, small businesses and commercial clients. Our... 

RUIAN YM DANCE STUDIO

Kids Jazz Dance Teacher Needed (Wenzhou, Zhejiang Province) Job at RUIAN YM DANCE STUDIO

Kids Jazz Dance Teacher Needed (Wenzhou, Zhejiang Province)RUIAN YM DANCE STUDIO.As the world of dance continues to evolve, RUIAN YM DANCE STUDIO focuses on international dance education, creating opportunities for students to learn from world-class dance masters.Our international... 

Morton County

Board Member - Morton County School Reorganization Job at Morton County

 ...The School Reorganization Board is responsible for hearing any requests, and providing a recommendation, from county patrons and/or...  ...final action. An appointment is for a term of 3 years and board members may serve for more than one term. Deadline for application is... 

WorkNomads

Remote Sales Specialist: Italian & French Job at WorkNomads

 ...We are seeking an Italian & French speaking Sales Specialist to join our dynamic team and support an exciting project in the world of payments and trusted transactions. As part of our team, youll be representing an international brand and engaging with Italian customers... 

A2H

Landscape Architect Job at A2H

 ...A2H is a collaborative planning and design firm of engineers, architects, landscape architects, interior designers, planners, and land surveyors founded in 1986. Our firm provides a diverse range of consulting services for both public and private clients, with over 10,...